This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.
Steve, It appears suspect #2 is the problem. I did a sflist on the particular daily files I suspected and sure enough the came up with segfaults in the middle of them. I've added the -n option to dchrly and will track the progress. Thanks much for your help. Regards, Chris On Tue, 22 Feb 2000, Unidata Support wrote: > > Chris, > > Two possible problems with your approach would be: > 1) The input file is currently being written into by the decoder > when your script is run. This would be common if you saw > errors like "FL -168". > > 2) The daily file is more likely to get corrupted if you are storing > the raw reports in the decoded file, and a bad report caused the > stored string to exceed the amount of space allowed. > > The case above would be the same as if you tried to use sflist on the > file with dattim=all and area=dset. So, if your sfmod script dies, do you > find that the original input file is corrupted? > > The upperair file is less likely to encounter the above two probles since > there is much less data (fewer stations), so that the likelihood of the > file being open and written to in 1) is much less; and the raw reports > are not stored in upper air files as in 2) above. You can run dchrly with the > -n flag not to store the raw reports if you find that they are problematic. > This is not a big problem that I have found, but ocassionally, I do fine > a bulleting that somehow has no line feeds for a couple of dozen metars, > so dchrly tries to store it all as one report. > > As I mentioned, you can determine if your surface file was corrupt by > trying to list the entire contents of the file using sflist. If that > fails, then that is likely why sfmod died as well. If it suceeds, then > it is more likely that the file was being updated or written to. > > Steve Chiswell > Unidata User Support > > > > > > >From: "C. Vandersip" <address@hidden> > >Organization: . > >Keywords: 200002211338.GAA21659 > > > This message is in MIME format. The first part should be readable text, > > while the remaining parts are likely unreadable without MIME-aware tools. > > Send mail to address@hidden for more info. > > > >---559023410-959030623-951140265=:24523 > >Content-Type: TEXT/PLAIN; charset=US-ASCII > > > >Hi Steve, > > > >I'm running a script that uses sfmod and snmod to take in data from the > >gempak sfc and upa files created by dchrly and creates gempak files called > >"cur.gem" to house data for the last 5 days. It does this each night to > >rotate the file and keep it current. > > > >My problem is that when this script runs, sfmod very often encounters > >problems with the daily sfc files and either dumps core (segmentation > >fault) or, more recently, the process hangs w/out seg faulting. There > >have been no problems with the snmod portion, only sfmod. Could sfmod be > >encountering corruption in the daily sfc files that cause it to die or > >hang, or is there a problem in my script syntax? A copy of the > >script is attached. Any help you can provide is appreciated. > > > >Regards, > > > >Chris > > > > ############################################################### > > # Chris Vandersip # > > # Computer Research Specialist/Dept. Sysadmin # > > # Rm. 024, Dept. of Meteorology, Florida State University # > > # address@hidden (850)644-2522 # > > ############################################################### > > > >---559023410-959030623-951140265=:24523 > >Content-Type: TEXT/PLAIN; charset=US-ASCII; name="rotate_cur.gem" > >Content-Transfer-Encoding: BASE64 > >Content-ID: <address@hidden> > >Content-Description: > >Content-Disposition: attachment; filename="rotate_cur.gem" > > > >IyEvYmluL2NzaCAtZg0KIw0KIwlyb3RhdGVfY3VyLmdlbSAtIE1haW50YWlu > >cyBnZW1wYWsgc3VyZmFjZSBhbmQgdXBwZXJhaXIgZmlsZXMNCiMJCSAgICAg > >ICAgICgkR0VNU0ZDL2N1ci5nZW0gYW5kICRHRU1VUEEvY3VyLmdlbSkgY29u > >dGFpbmluZw0KIwkJICAgCSBkYXRhIGZvciB0aGUgcGFzdCA1IGRheXMuIFRo > >aXMgc2NyaXB0IHJvdGF0ZXMgb2xkIGRhdGEgb3V0Lg0KIw0KIwlNb2RpZmlj > >YXRpb25zOg0KIw0KIwkgCUphbiAxNCwgMTk5MglPcmlnaW5hbCBzY3JpcHQJ > >CQlKZWZmIFdhcmQvRlNVDQojCQlPY3QuICAgIDE5OTQgICAgTW9kaWZpZWQg > >Zm9yIGdlbXBhayA1LjIgICAgICAgICBULiBLaXR0ZXJtYW4NCiMgICAgICAg > >ICAgICAgICBGZWIuICAgIDE5OTUgICAgTW9kaWZpZWQgZm9yIHByb3BlciBj > >eWNsaW5nIG9mDQojICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNp > >cmN1bGFyIGZpbGUgYnkgYSBjYXN0IG9mIHRob3VzYW5kcy4uLg0KIw0KIyAg > >ICAgICAgICAgICAgIE5vdi4gICAgMTk5NSAgICBGaXhlZCBzbyB0aGUgZGFy > >biB0aGluZyB3b3VsZCB3b3JrIQ0KIwkgICAgICAgICAgICAgICAgICAgICAg > >ICAtQW5kcmV3IERldmFuYXMgJiBKb24gUml6em8NCiMJICAgICAgICBKYW4u > >ICAgIDIwMDAgICAgT3ZlcmhhdWxlZCBjb21wbGV0ZWx5IHRvIGNvbWJpbmUg > >c2ZjLiBhbmQNCiMJCQkJdXBhLiBzY3JpcHRzIGFuZCByZWFsbHkgZ2V0IGl0 > >IHRvIHdvcmsuDQojCQkJCS1DaHJpcyBWYW5kZXJzaXANCiMgU2V0IHVwIHRo > >ZSBlbnZpcm9ubWVudA0KIw0Kc291cmNlIC9uYXdpcHMvR2VtZW52aXJvbg0K > >c2V0ZW52IFNGU1ROUyAvbmF3aXBzL2dlbXBhazUuNC90YWJsZXMvc3Rucy9z > >Zm1ldGFyX3NhLnRibA0Kc2V0ZW52IFNOU1ROUyAvbmF3aXBzL2dlbXBhazUu > >NC90YWJsZXMvc3Rucy9zbndvcmxkLnRibA0Kc2V0ZW52IFNGUEFDSyAvbmF3 > >aXBzL2dlbXBhazUuNC90YWJsZXMvcGFjay9ocmx5LnBhY2sNCnNldGVudiBT > >TlBBQ0sgL25hd2lwcy9nZW1wYWs1LjQvdGFibGVzL3BhY2svc25tZXJnLnBh > >Y2sNCiMNCnNldCBwYXRoID0gKC9iaW4gL3Vzci9iaW4gL3Vzci9sb2NhbC9i > >aW4gL3Vzci9vcGVud2luL2JpbiAvbmF3aXBzL2JpbiAuIC91c3IvbG9jYWwv > >bGRtL2JpbikNCiMNCiMgUm90YXRlIGRhdGUgZmlsZXMNCiMNCmNkIC9uYXdp > >cHMvRlNVL2N1cmdlbV9yb3RhdGUNCiMNCmVjaG8gIkNoZWNraW5nIGZvciBE > >YXRlIENoYW5nZSINCnNldCBub3dkYXRlPWBkYXRlIC11ICsleSVtJWRgDQpz > >ZXQgcHJldmRhdGU9YGNhdCAuL2RheXN0YXJ0LmRhdGVgDQppZiAoJG5vd2Rh > >dGUgIT0gJHByZXZkYXRlKSB0aGVuDQogICBlY2hvICJEYXRlIENoYW5nZTog > >Um90YXRpbmcgZGF0ZSBmaWxlcyINCiAgIGVjaG8NCiAgIHJtIC1mIGRheXN0 > >YXJ0LTYuZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtNS5kYXRlIGRheXN0YXJ0 > >LTYuZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtNC5kYXRlIGRheXN0YXJ0LTUu > >ZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtMy5kYXRlIGRheXN0YXJ0LTQuZGF0 > >ZQ0KICAgbXYgLWYgZGF5c3RhcnQtMi5kYXRlIGRheXN0YXJ0LTMuZGF0ZQ0K > >ICAgbXYgLWYgZGF5c3RhcnQtMS5kYXRlIGRheXN0YXJ0LTIuZGF0ZQ0KICAg > >bXYgLWYgZGF5c3RhcnQuZGF0ZSBkYXlzdGFydC0xLmRhdGUNCiAgIGVjaG8g > >JG5vd2RhdGUgPiBkYXlzdGFydC5kYXRlDQplbmRpZg0KIyBTZXQgZGF0ZSB2 > >YXJpYWJsZXMgd2l0aCBjZW50dXJ5IGluY2x1ZGVkDQpzZXQgZGF5c3RhcnQ9 > >YGNhdCAuL2RheXN0YXJ0LmRhdGVgDQpzZXQgZGF5c3RhcnQxPWBjYXQgLi9k > >YXlzdGFydC0xLmRhdGVgDQpzZXQgZGF5c3RhcnQyPWBjYXQgLi9kYXlzdGFy > >dC0yLmRhdGVgDQpzZXQgZGF5c3RhcnQzPWBjYXQgLi9kYXlzdGFydC0zLmRh > >dGVgDQpzZXQgZGF5c3RhcnQ0PWBjYXQgLi9kYXlzdGFydC00LmRhdGVgDQpz > >ZXQgZGF5c3RhcnQ1PWBjYXQgLi9kYXlzdGFydC01LmRhdGVgDQpzZXQgZGF5 > >c3RhcnQ2PWBjYXQgLi9kYXlzdGFydC02LmRhdGVgDQojDQplY2hvICJEb25l > >Ig0KZWNobyAiS2VlcGluZyBEYXRlczoiDQplY2hvICRkYXlzdGFydA0KZWNo > >byAkZGF5c3RhcnQxDQplY2hvICRkYXlzdGFydDINCmVjaG8gJGRheXN0YXJ0 > >Mw0KZWNobyAkZGF5c3RhcnQ0DQplY2hvICRkYXlzdGFydDUNCmVjaG8gJGRh > >eXN0YXJ0Ng0KZWNobw0KIw0KIyBTVVJGQUNFIFNFQ1RJT04NCiMgLS0tLS0t > >LS0tLS0tLS0tDQojDQojICBDcmVhdGUgYSBuZXcgc3VyZmFjZSBmaWxlLiAg > >UmVtb3ZpbmcgdGltZXMgZnJvbSBvbGQgDQojICBzdXJmYWNlIGZpbGUgZG9l > >cyBub3QgcmVtb3ZlIGRhdGEsIHNvIHRoZSBmaWxlIGp1c3QNCiMgIGtlZXBz > >IGdldHRpbmcgYmlnZ2VyLg0KIw0KZWNobyAiU3RhcnRpbmcgU3VyZmFjZSBT > >ZWN0aW9uIg0KZWNobw0KZWNobyAiTW92aW5nIGN1ci5nZW0gdG8gdG1wIGZp > >bGUiDQptdiAkR0VNU0ZDL2N1ci5nZW0gJEdFTVNGQy90bXAuZ2VtDQplY2hv > >ICJEb25lIg0KZWNobyAiQ3JlYXRpbmcgbmV3IGN1ci5nZW0gZmlsZSINCiRH > >RU1FWEUvc2ZjZmlsID4gc2ZjZmlsLmxvZyA8PCBlbmRzZmNmaWwNCnNmb3V0 > >Zj0iL2V4cG9ydC9kYXRhL2dlbXBhay9zdXJmYWNlL3Nhby9jdXIuZ2VtIg0K > >c2Zwcm1mPSIkU0ZQQUNLIg0Kc3RuZmlsPSIkU0ZTVE5TIg0Kc2hpcGZsPSJO > >TyINCnRpbXN0bj0iMjAwLzMwMDAiDQpydW4NCmV4aXQNCmVuZHNmY2ZpbA0K > >ZWNobyAiRG9uZSINCiMNCiMgIFJ1biBzZm1vZCB0byBtZXJnZSBkZXNpcmVk > >IGRhdGEgaW50byBjdXIuZ2VtDQojDQplY2hvICJNZXJnaW5nIGRhdGEgaW50 > >byBuZXcgY3VyLmdlbSBmaWxlIg0KJEdFTUVYRS9zZm1vZCA+IHNmbW9kNC5s > >b2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1ubw0Kc2ZmaWxlPSIkR0VNU0ZD > >LzIwJGRheXN0YXJ0NC5nZW0iDQpzZm91dGY9IiRHRU1TRkMvY3VyLmdlbSIN > >CmRhdHRpbT0iJGRheXN0YXJ0NC9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVu > >DQpleGl0DQplbmRzZm1vZA0KZWNobyAiRGF5IDUgZG9uZSINCiRHRU1FWEUv > >c2Ztb2QgPiBzZm1vZDMubG9nIDw8IGVuZHNmbW9kDQpcJHJlc3BvbmQ9bm8N > >CnNmZmlsZT0iJEdFTVNGQy8yMCRkYXlzdGFydDMuZ2VtIg0Kc2ZvdXRmPSIk > >R0VNU0ZDL2N1ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDMvYWxsIg0KYXJl > >YT0iZHNldCINCmwNCnJ1bg0KZXhpdA0KZW5kc2Ztb2QNCmVjaG8gIkRheSA0 > >IGRvbmUiDQokR0VNRVhFL3NmbW9kID4gc2Ztb2QyLmxvZyA8PCBlbmRzZm1v > >ZA0KXCRyZXNwb25kPW5vDQpzZmZpbGU9IiRHRU1TRkMvMjAkZGF5c3RhcnQy > >LmdlbSINCnNmb3V0Zj0iJEdFTVNGQy9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5 > >c3RhcnQyL2FsbCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNm > >bW9kDQplY2hvICJEYXkgMyBkb25lIg0KJEdFTUVYRS9zZm1vZCA+IHNmbW9k > >MS5sb2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1ubw0Kc2ZmaWxlPSIkR0VN > >U0ZDLzIwJGRheXN0YXJ0MS5nZW0iDQpzZm91dGY9IiRHRU1TRkMvY3VyLmdl > >bSINCmRhdHRpbT0iJGRheXN0YXJ0MS9hbGwiDQphcmVhPSJkc2V0Ig0KbA0K > >cnVuDQpleGl0DQplbmRzZm1vZA0KZWNobyAiRGF5IDIgZG9uZSINCiRHRU1F > >WEUvc2Ztb2QgPiBzZm1vZC5sb2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1u > >bw0Kc2ZmaWxlPSIkR0VNU0ZDLzIwJGRheXN0YXJ0LmdlbSINCnNmb3V0Zj0i > >JEdFTVNGQy9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQvYWxsIg0KYXJl > >YT0iZHNldCINCmwNCnJ1bg0KZXhpdA0KZW5kc2Ztb2QNCiMNCmVjaG8gIkRh > >eSAxIGRvbmUiDQojDQojIFJlbW92ZSB0ZW1wb3JhcnkgZmlsZQ0KIw0KZWNo > >byAiUmVtb3ZpbmcgdG1wLmdlbSBmaWxlIg0Kcm0gL2V4cG9ydC9kYXRhL2dl > >bXBhay9zdXJmYWNlL3Nhby90bXAuZ2VtDQplY2hvICJEb25lIg0KIw0KIyBV > >UFBFUkFJUiBTRUNUSU9ODQojIC0tLS0tLS0tLS0tLS0tLS0NCiMNCiMgIENy > >ZWF0ZSBhIG5ldyB1cHBlcmFpciBmaWxlLiAgUmVtb3ZpbmcgdGltZXMgZnJv > >bSBvbGQNCiMgIHN1cmZhY2UgZmlsZSBkb2VzIG5vdCByZW1vdmUgZGF0YSwg > >c28gdGhlIGZpbGUganVzdA0KIyAga2VlcHMgZ2V0dGluZyBiaWdnZXIuDQoj > >DQplY2hvICJTdGFydGluZyBVcHBlcmFpciBzZWN0aW9uIg0KZWNobyAiTW92 > >aW5nIGN1ci5nZW0gdG8gdG1wLmdlbSINCm12ICRHRU1VUEEvY3VyLmdlbSAk > >R0VNVVBBL3RtcC5nZW0NCmVjaG8gIkRvbmUiDQplY2hvDQplY2hvICJDcmVh > >dGluZyBuZXcgY3VyLmdlbSBmaWxlIg0KJEdFTUVYRS9zbmNmaWwgPiBzbmNm > >aWwubG9nIDw8IGVuZHNuY2ZpbA0Kc25vdXRmPSIvZXhwb3J0L2RhdGEvZ2Vt > >cGFrL3VwcGVyYWlyL2N1ci5nZW0iDQpzbnBybWY9IiRTTlBBQ0siDQpzdG5m > >aWw9IiRTTlNUTlMiDQpzaGlwZmw9Ik5PIg0KdGltc3RuPSI5OS8xMCINCnJ1 > >bg0KZXhpdA0KZW5kc25jZmlsDQplY2hvICJEb25lIg0KIw0KIyAgUnVuIHNu > >bW9kIHRvIG1lcmdlIGRlc2lyZWQgZGF0YSBpbnRvIGN1ci5nZW0NCiMNCmVj > >aG8gIk1lcmdpbmcgZGF0YSBpbnRvIG5ldyBjdXIuZ2VtIGZpbGUiDQokR0VN > >RVhFL3NubW9kID4gc25tb2Q2LmxvZyA8PCBlbmRzbm1vZA0KXCRyZXNwb25k > >PW5vDQpzbmZpbGU9IiRHRU1VUEEvMjAkZGF5c3RhcnQ2LmdlbSINCnNub3V0 > >Zj0iJEdFTVVQQS9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQ2L2FsbCIN > >CmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hvICJE > >YXkgNyBkb25lIg0KJEdFTUVYRS9zbm1vZCA+IHNubW9kNS5sb2cgPDwgZW5k > >c25tb2QNClwkcmVzcG9uZD1ubw0Kc25maWxlPSIkR0VNVVBBLzIwJGRheXN0 > >YXJ0NS5nZW0iDQpzbm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRpbT0i > >JGRheXN0YXJ0NS9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVuDQpleGl0DQpl > >bmRzbm1vZA0KZWNobyAiRGF5IDYgZG9uZSINCiRHRU1FWEUvc25tb2QgPiBz > >bm1vZDQubG9nIDw8IGVuZHNubW9kDQpcJHJlc3BvbmQ9bm8NCnNuZmlsZT0i > >JEdFTVVQQS8yMCRkYXlzdGFydDQuZ2VtIg0Kc25vdXRmPSIkR0VNVVBBL2N1 > >ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDQvYWxsIg0KYXJlYT0iZHNldCIN > >CmwNCnJ1bg0KZXhpdA0KZW5kc25tb2QNCmVjaG8gIkRheSA1IGRvbmUiDQok > >R0VNRVhFL3NubW9kID4gc25tb2QzLmxvZyA8PCBlbmRzbm1vZA0KXCRyZXNw > >b25kPW5vDQpzbmZpbGU9IiRHRU1VUEEvMjAkZGF5c3RhcnQzLmdlbSINCnNu > >b3V0Zj0iJEdFTVVQQS9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQzL2Fs > >bCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hv > >ICJEYXkgNCBkb25lIg0KJEdFTUVYRS9zbm1vZCA+IHNubW9kMi5sb2cgPDwg > >ZW5kc25tb2QNClwkcmVzcG9uZD1ubw0Kc25maWxlPSIkR0VNVVBBLzIwJGRh > >eXN0YXJ0Mi5nZW0iDQpzbm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRp > >bT0iJGRheXN0YXJ0Mi9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVuDQpleGl0 > >DQplbmRzbm1vZA0KZWNobyAiRGF5IDMgZG9uZSINCiRHRU1FWEUvc25tb2Qg > >PiBzbm1vZDEubG9nIDw8IGVuZHNubW9kDQpcJHJlc3BvbmQ9bm8NCnNuZmls > >ZT0iJEdFTVVQQS8yMCRkYXlzdGFydDEuZ2VtIg0Kc25vdXRmPSIkR0VNVVBB > >L2N1ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDEvYWxsIg0KYXJlYT0iZHNl > >dCINCmwNCnJ1bg0KZXhpdA0KZW5kc25tb2QNCmVjaG8gIkRheSAyIGRvbmUi > >DQokR0VNRVhFL3NubW9kID4gc25tb2QubG9nIDw8IGVuZHNubW9kDQpcJHJl > >c3BvbmQ9bm8NCnNuZmlsZT0iJEdFTVVQQS8yMCRkYXlzdGFydC5nZW0iDQpz > >bm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRpbT0iJGRheXN0YXJ0L2Fs > >bCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hv > >ICJEYXkgMSBkb25lIg0KIw0KIw0KIyBSZW1vdmUgdGVtcG9yYXJ5IGZpbGUg > >YW5kIHJlc3RhcnQgTERNDQojDQplY2hvICJSZW1vdmluZyB0bXAuZ2VtIGZp > >bGUiDQpybSAvZXhwb3J0L2RhdGEvZ2VtcGFrL3VwcGVyYWlyL3RtcC5nZW0N > >CmVjaG8gIkRvbmUiDQpleGl0DQo= > >---559023410-959030623-951140265=:24523-- > > > > **************************************************************************** < > Unidata User Support UCAR Unidata Program < > (303)497-8644 P.O. Box 3000 < > address@hidden Boulder, CO 80307 < > ---------------------------------------------------------------------------- < > Unidata WWW Service http://www.unidata.ucar.edu/ < > **************************************************************************** < > ############################################################### # Chris Vandersip # # Computer Research Specialist/Dept. Sysadmin # # Rm. 024, Dept. of Meteorology, Florida State University # # address@hidden (850)644-2522 # ###############################################################