20000221: Core dumps on sfmod

Chris,

Two possible problems with your approach would be:
1) The input file is currently being written into by the decoder
   when your script is run. This would be common if you saw
   errors like "FL -168".

2) The daily file is more likely to get corrupted if you are storing
   the raw reports in the decoded file, and a bad report caused the
   stored string to exceed the amount of space allowed.

   The case above would be the same as if you tried to use sflist on the
   file with dattim=all and area=dset. So, if your sfmod script dies, do you
   find that the original input file is corrupted?

The upperair file is less likely to encounter the above two probles since
there is much less data (fewer stations), so that the likelihood of the
file being open and written to in 1) is much less; and the raw reports
are not stored in upper air files as in 2) above. You can run dchrly with the
-n flag not to store the raw reports if you find that they are problematic.
This is not a big problem that I have found, but ocassionally, I do fine
a bulleting that somehow has no line feeds for a couple of dozen metars,
so dchrly tries to store it all as one report.

As I mentioned, you can determine if your surface file was corrupt by 
trying to list the entire contents of the file using sflist. If that
fails, then that is likely why sfmod died as well. If it suceeds, then
it is more likely that the file was being updated or written to.

Steve Chiswell
Unidata User Support





>From: "C. Vandersip" <address@hidden>
>Organization: .
>Keywords: 200002211338.GAA21659

>  This message is in MIME format.  The first part should be readable text,
>  while the remaining parts are likely unreadable without MIME-aware tools.
>  Send mail to address@hidden for more info.
>
>---559023410-959030623-951140265=:24523
>Content-Type: TEXT/PLAIN; charset=US-ASCII
>
>Hi Steve,
>
>I'm running a script that uses sfmod and snmod to take in data from the
>gempak sfc and upa files created by dchrly and creates gempak files called
>"cur.gem" to house data for the last 5 days.  It does this each night to
>rotate the file and keep it current.
>
>My problem is that when this script runs, sfmod very often encounters
>problems with the daily sfc files and either dumps core (segmentation
>fault) or, more recently, the process hangs w/out seg faulting.  There
>have been no problems with the snmod portion, only sfmod.  Could sfmod be
>encountering corruption in the daily sfc files that cause it to die or
>hang, or is there a problem in my script syntax?  A copy of the
>script is attached.  Any help you can provide is appreciated.  
>
>Regards,
>
>Chris
>
>        ###############################################################
>        #                      Chris Vandersip                        #
>        #        Computer Research Specialist/Dept. Sysadmin          #
>        #  Rm. 024, Dept. of Meteorology, Florida State University    #
>        #          address@hidden   (850)644-2522                     #
>        ###############################################################
>
>---559023410-959030623-951140265=:24523
>Content-Type: TEXT/PLAIN; charset=US-ASCII; name="rotate_cur.gem"
>Content-Transfer-Encoding: BASE64
>Content-ID: <address@hidden>
>Content-Description: 
>Content-Disposition: attachment; filename="rotate_cur.gem"
>
>IyEvYmluL2NzaCAtZg0KIw0KIwlyb3RhdGVfY3VyLmdlbSAtIE1haW50YWlu
>cyBnZW1wYWsgc3VyZmFjZSBhbmQgdXBwZXJhaXIgZmlsZXMNCiMJCSAgICAg
>ICAgICgkR0VNU0ZDL2N1ci5nZW0gYW5kICRHRU1VUEEvY3VyLmdlbSkgY29u
>dGFpbmluZw0KIwkJICAgCSBkYXRhIGZvciB0aGUgcGFzdCA1IGRheXMuIFRo
>aXMgc2NyaXB0IHJvdGF0ZXMgb2xkIGRhdGEgb3V0Lg0KIw0KIwlNb2RpZmlj
>YXRpb25zOg0KIw0KIwkgCUphbiAxNCwgMTk5MglPcmlnaW5hbCBzY3JpcHQJ
>CQlKZWZmIFdhcmQvRlNVDQojCQlPY3QuICAgIDE5OTQgICAgTW9kaWZpZWQg
>Zm9yIGdlbXBhayA1LjIgICAgICAgICBULiBLaXR0ZXJtYW4NCiMgICAgICAg
>ICAgICAgICBGZWIuICAgIDE5OTUgICAgTW9kaWZpZWQgZm9yIHByb3BlciBj
>eWNsaW5nIG9mDQojICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGNp
>cmN1bGFyIGZpbGUgYnkgYSBjYXN0IG9mIHRob3VzYW5kcy4uLg0KIw0KIyAg
>ICAgICAgICAgICAgIE5vdi4gICAgMTk5NSAgICBGaXhlZCBzbyB0aGUgZGFy
>biB0aGluZyB3b3VsZCB3b3JrIQ0KIwkgICAgICAgICAgICAgICAgICAgICAg
>ICAtQW5kcmV3IERldmFuYXMgJiBKb24gUml6em8NCiMJICAgICAgICBKYW4u
>ICAgIDIwMDAgICAgT3ZlcmhhdWxlZCBjb21wbGV0ZWx5IHRvIGNvbWJpbmUg
>c2ZjLiBhbmQNCiMJCQkJdXBhLiBzY3JpcHRzIGFuZCByZWFsbHkgZ2V0IGl0
>IHRvIHdvcmsuDQojCQkJCS1DaHJpcyBWYW5kZXJzaXANCiMgU2V0IHVwIHRo
>ZSBlbnZpcm9ubWVudA0KIw0Kc291cmNlIC9uYXdpcHMvR2VtZW52aXJvbg0K
>c2V0ZW52IFNGU1ROUyAvbmF3aXBzL2dlbXBhazUuNC90YWJsZXMvc3Rucy9z
>Zm1ldGFyX3NhLnRibA0Kc2V0ZW52IFNOU1ROUyAvbmF3aXBzL2dlbXBhazUu
>NC90YWJsZXMvc3Rucy9zbndvcmxkLnRibA0Kc2V0ZW52IFNGUEFDSyAvbmF3
>aXBzL2dlbXBhazUuNC90YWJsZXMvcGFjay9ocmx5LnBhY2sNCnNldGVudiBT
>TlBBQ0sgL25hd2lwcy9nZW1wYWs1LjQvdGFibGVzL3BhY2svc25tZXJnLnBh
>Y2sNCiMNCnNldCBwYXRoID0gKC9iaW4gL3Vzci9iaW4gL3Vzci9sb2NhbC9i
>aW4gL3Vzci9vcGVud2luL2JpbiAvbmF3aXBzL2JpbiAuIC91c3IvbG9jYWwv
>bGRtL2JpbikNCiMNCiMgUm90YXRlIGRhdGUgZmlsZXMNCiMNCmNkIC9uYXdp
>cHMvRlNVL2N1cmdlbV9yb3RhdGUNCiMNCmVjaG8gIkNoZWNraW5nIGZvciBE
>YXRlIENoYW5nZSINCnNldCBub3dkYXRlPWBkYXRlIC11ICsleSVtJWRgDQpz
>ZXQgcHJldmRhdGU9YGNhdCAuL2RheXN0YXJ0LmRhdGVgDQppZiAoJG5vd2Rh
>dGUgIT0gJHByZXZkYXRlKSB0aGVuDQogICBlY2hvICJEYXRlIENoYW5nZTog
>Um90YXRpbmcgZGF0ZSBmaWxlcyINCiAgIGVjaG8NCiAgIHJtIC1mIGRheXN0
>YXJ0LTYuZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtNS5kYXRlIGRheXN0YXJ0
>LTYuZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtNC5kYXRlIGRheXN0YXJ0LTUu
>ZGF0ZQ0KICAgbXYgLWYgZGF5c3RhcnQtMy5kYXRlIGRheXN0YXJ0LTQuZGF0
>ZQ0KICAgbXYgLWYgZGF5c3RhcnQtMi5kYXRlIGRheXN0YXJ0LTMuZGF0ZQ0K
>ICAgbXYgLWYgZGF5c3RhcnQtMS5kYXRlIGRheXN0YXJ0LTIuZGF0ZQ0KICAg
>bXYgLWYgZGF5c3RhcnQuZGF0ZSBkYXlzdGFydC0xLmRhdGUNCiAgIGVjaG8g
>JG5vd2RhdGUgPiBkYXlzdGFydC5kYXRlDQplbmRpZg0KIyBTZXQgZGF0ZSB2
>YXJpYWJsZXMgd2l0aCBjZW50dXJ5IGluY2x1ZGVkDQpzZXQgZGF5c3RhcnQ9
>YGNhdCAuL2RheXN0YXJ0LmRhdGVgDQpzZXQgZGF5c3RhcnQxPWBjYXQgLi9k
>YXlzdGFydC0xLmRhdGVgDQpzZXQgZGF5c3RhcnQyPWBjYXQgLi9kYXlzdGFy
>dC0yLmRhdGVgDQpzZXQgZGF5c3RhcnQzPWBjYXQgLi9kYXlzdGFydC0zLmRh
>dGVgDQpzZXQgZGF5c3RhcnQ0PWBjYXQgLi9kYXlzdGFydC00LmRhdGVgDQpz
>ZXQgZGF5c3RhcnQ1PWBjYXQgLi9kYXlzdGFydC01LmRhdGVgDQpzZXQgZGF5
>c3RhcnQ2PWBjYXQgLi9kYXlzdGFydC02LmRhdGVgDQojDQplY2hvICJEb25l
>Ig0KZWNobyAiS2VlcGluZyBEYXRlczoiDQplY2hvICRkYXlzdGFydA0KZWNo
>byAkZGF5c3RhcnQxDQplY2hvICRkYXlzdGFydDINCmVjaG8gJGRheXN0YXJ0
>Mw0KZWNobyAkZGF5c3RhcnQ0DQplY2hvICRkYXlzdGFydDUNCmVjaG8gJGRh
>eXN0YXJ0Ng0KZWNobw0KIw0KIyBTVVJGQUNFIFNFQ1RJT04NCiMgLS0tLS0t
>LS0tLS0tLS0tDQojDQojICBDcmVhdGUgYSBuZXcgc3VyZmFjZSBmaWxlLiAg
>UmVtb3ZpbmcgdGltZXMgZnJvbSBvbGQgDQojICBzdXJmYWNlIGZpbGUgZG9l
>cyBub3QgcmVtb3ZlIGRhdGEsIHNvIHRoZSBmaWxlIGp1c3QNCiMgIGtlZXBz
>IGdldHRpbmcgYmlnZ2VyLg0KIw0KZWNobyAiU3RhcnRpbmcgU3VyZmFjZSBT
>ZWN0aW9uIg0KZWNobw0KZWNobyAiTW92aW5nIGN1ci5nZW0gdG8gdG1wIGZp
>bGUiDQptdiAkR0VNU0ZDL2N1ci5nZW0gJEdFTVNGQy90bXAuZ2VtDQplY2hv
>ICJEb25lIg0KZWNobyAiQ3JlYXRpbmcgbmV3IGN1ci5nZW0gZmlsZSINCiRH
>RU1FWEUvc2ZjZmlsID4gc2ZjZmlsLmxvZyA8PCBlbmRzZmNmaWwNCnNmb3V0
>Zj0iL2V4cG9ydC9kYXRhL2dlbXBhay9zdXJmYWNlL3Nhby9jdXIuZ2VtIg0K
>c2Zwcm1mPSIkU0ZQQUNLIg0Kc3RuZmlsPSIkU0ZTVE5TIg0Kc2hpcGZsPSJO
>TyINCnRpbXN0bj0iMjAwLzMwMDAiDQpydW4NCmV4aXQNCmVuZHNmY2ZpbA0K
>ZWNobyAiRG9uZSINCiMNCiMgIFJ1biBzZm1vZCB0byBtZXJnZSBkZXNpcmVk
>IGRhdGEgaW50byBjdXIuZ2VtDQojDQplY2hvICJNZXJnaW5nIGRhdGEgaW50
>byBuZXcgY3VyLmdlbSBmaWxlIg0KJEdFTUVYRS9zZm1vZCA+IHNmbW9kNC5s
>b2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1ubw0Kc2ZmaWxlPSIkR0VNU0ZD
>LzIwJGRheXN0YXJ0NC5nZW0iDQpzZm91dGY9IiRHRU1TRkMvY3VyLmdlbSIN
>CmRhdHRpbT0iJGRheXN0YXJ0NC9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVu
>DQpleGl0DQplbmRzZm1vZA0KZWNobyAiRGF5IDUgZG9uZSINCiRHRU1FWEUv
>c2Ztb2QgPiBzZm1vZDMubG9nIDw8IGVuZHNmbW9kDQpcJHJlc3BvbmQ9bm8N
>CnNmZmlsZT0iJEdFTVNGQy8yMCRkYXlzdGFydDMuZ2VtIg0Kc2ZvdXRmPSIk
>R0VNU0ZDL2N1ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDMvYWxsIg0KYXJl
>YT0iZHNldCINCmwNCnJ1bg0KZXhpdA0KZW5kc2Ztb2QNCmVjaG8gIkRheSA0
>IGRvbmUiDQokR0VNRVhFL3NmbW9kID4gc2Ztb2QyLmxvZyA8PCBlbmRzZm1v
>ZA0KXCRyZXNwb25kPW5vDQpzZmZpbGU9IiRHRU1TRkMvMjAkZGF5c3RhcnQy
>LmdlbSINCnNmb3V0Zj0iJEdFTVNGQy9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5
>c3RhcnQyL2FsbCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNm
>bW9kDQplY2hvICJEYXkgMyBkb25lIg0KJEdFTUVYRS9zZm1vZCA+IHNmbW9k
>MS5sb2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1ubw0Kc2ZmaWxlPSIkR0VN
>U0ZDLzIwJGRheXN0YXJ0MS5nZW0iDQpzZm91dGY9IiRHRU1TRkMvY3VyLmdl
>bSINCmRhdHRpbT0iJGRheXN0YXJ0MS9hbGwiDQphcmVhPSJkc2V0Ig0KbA0K
>cnVuDQpleGl0DQplbmRzZm1vZA0KZWNobyAiRGF5IDIgZG9uZSINCiRHRU1F
>WEUvc2Ztb2QgPiBzZm1vZC5sb2cgPDwgZW5kc2Ztb2QNClwkcmVzcG9uZD1u
>bw0Kc2ZmaWxlPSIkR0VNU0ZDLzIwJGRheXN0YXJ0LmdlbSINCnNmb3V0Zj0i
>JEdFTVNGQy9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQvYWxsIg0KYXJl
>YT0iZHNldCINCmwNCnJ1bg0KZXhpdA0KZW5kc2Ztb2QNCiMNCmVjaG8gIkRh
>eSAxIGRvbmUiDQojDQojIFJlbW92ZSB0ZW1wb3JhcnkgZmlsZQ0KIw0KZWNo
>byAiUmVtb3ZpbmcgdG1wLmdlbSBmaWxlIg0Kcm0gL2V4cG9ydC9kYXRhL2dl
>bXBhay9zdXJmYWNlL3Nhby90bXAuZ2VtDQplY2hvICJEb25lIg0KIw0KIyBV
>UFBFUkFJUiBTRUNUSU9ODQojIC0tLS0tLS0tLS0tLS0tLS0NCiMNCiMgIENy
>ZWF0ZSBhIG5ldyB1cHBlcmFpciBmaWxlLiAgUmVtb3ZpbmcgdGltZXMgZnJv
>bSBvbGQNCiMgIHN1cmZhY2UgZmlsZSBkb2VzIG5vdCByZW1vdmUgZGF0YSwg
>c28gdGhlIGZpbGUganVzdA0KIyAga2VlcHMgZ2V0dGluZyBiaWdnZXIuDQoj
>DQplY2hvICJTdGFydGluZyBVcHBlcmFpciBzZWN0aW9uIg0KZWNobyAiTW92
>aW5nIGN1ci5nZW0gdG8gdG1wLmdlbSINCm12ICRHRU1VUEEvY3VyLmdlbSAk
>R0VNVVBBL3RtcC5nZW0NCmVjaG8gIkRvbmUiDQplY2hvDQplY2hvICJDcmVh
>dGluZyBuZXcgY3VyLmdlbSBmaWxlIg0KJEdFTUVYRS9zbmNmaWwgPiBzbmNm
>aWwubG9nIDw8IGVuZHNuY2ZpbA0Kc25vdXRmPSIvZXhwb3J0L2RhdGEvZ2Vt
>cGFrL3VwcGVyYWlyL2N1ci5nZW0iDQpzbnBybWY9IiRTTlBBQ0siDQpzdG5m
>aWw9IiRTTlNUTlMiDQpzaGlwZmw9Ik5PIg0KdGltc3RuPSI5OS8xMCINCnJ1
>bg0KZXhpdA0KZW5kc25jZmlsDQplY2hvICJEb25lIg0KIw0KIyAgUnVuIHNu
>bW9kIHRvIG1lcmdlIGRlc2lyZWQgZGF0YSBpbnRvIGN1ci5nZW0NCiMNCmVj
>aG8gIk1lcmdpbmcgZGF0YSBpbnRvIG5ldyBjdXIuZ2VtIGZpbGUiDQokR0VN
>RVhFL3NubW9kID4gc25tb2Q2LmxvZyA8PCBlbmRzbm1vZA0KXCRyZXNwb25k
>PW5vDQpzbmZpbGU9IiRHRU1VUEEvMjAkZGF5c3RhcnQ2LmdlbSINCnNub3V0
>Zj0iJEdFTVVQQS9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQ2L2FsbCIN
>CmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hvICJE
>YXkgNyBkb25lIg0KJEdFTUVYRS9zbm1vZCA+IHNubW9kNS5sb2cgPDwgZW5k
>c25tb2QNClwkcmVzcG9uZD1ubw0Kc25maWxlPSIkR0VNVVBBLzIwJGRheXN0
>YXJ0NS5nZW0iDQpzbm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRpbT0i
>JGRheXN0YXJ0NS9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVuDQpleGl0DQpl
>bmRzbm1vZA0KZWNobyAiRGF5IDYgZG9uZSINCiRHRU1FWEUvc25tb2QgPiBz
>bm1vZDQubG9nIDw8IGVuZHNubW9kDQpcJHJlc3BvbmQ9bm8NCnNuZmlsZT0i
>JEdFTVVQQS8yMCRkYXlzdGFydDQuZ2VtIg0Kc25vdXRmPSIkR0VNVVBBL2N1
>ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDQvYWxsIg0KYXJlYT0iZHNldCIN
>CmwNCnJ1bg0KZXhpdA0KZW5kc25tb2QNCmVjaG8gIkRheSA1IGRvbmUiDQok
>R0VNRVhFL3NubW9kID4gc25tb2QzLmxvZyA8PCBlbmRzbm1vZA0KXCRyZXNw
>b25kPW5vDQpzbmZpbGU9IiRHRU1VUEEvMjAkZGF5c3RhcnQzLmdlbSINCnNu
>b3V0Zj0iJEdFTVVQQS9jdXIuZ2VtIg0KZGF0dGltPSIkZGF5c3RhcnQzL2Fs
>bCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hv
>ICJEYXkgNCBkb25lIg0KJEdFTUVYRS9zbm1vZCA+IHNubW9kMi5sb2cgPDwg
>ZW5kc25tb2QNClwkcmVzcG9uZD1ubw0Kc25maWxlPSIkR0VNVVBBLzIwJGRh
>eXN0YXJ0Mi5nZW0iDQpzbm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRp
>bT0iJGRheXN0YXJ0Mi9hbGwiDQphcmVhPSJkc2V0Ig0KbA0KcnVuDQpleGl0
>DQplbmRzbm1vZA0KZWNobyAiRGF5IDMgZG9uZSINCiRHRU1FWEUvc25tb2Qg
>PiBzbm1vZDEubG9nIDw8IGVuZHNubW9kDQpcJHJlc3BvbmQ9bm8NCnNuZmls
>ZT0iJEdFTVVQQS8yMCRkYXlzdGFydDEuZ2VtIg0Kc25vdXRmPSIkR0VNVVBB
>L2N1ci5nZW0iDQpkYXR0aW09IiRkYXlzdGFydDEvYWxsIg0KYXJlYT0iZHNl
>dCINCmwNCnJ1bg0KZXhpdA0KZW5kc25tb2QNCmVjaG8gIkRheSAyIGRvbmUi
>DQokR0VNRVhFL3NubW9kID4gc25tb2QubG9nIDw8IGVuZHNubW9kDQpcJHJl
>c3BvbmQ9bm8NCnNuZmlsZT0iJEdFTVVQQS8yMCRkYXlzdGFydC5nZW0iDQpz
>bm91dGY9IiRHRU1VUEEvY3VyLmdlbSINCmRhdHRpbT0iJGRheXN0YXJ0L2Fs
>bCINCmFyZWE9ImRzZXQiDQpsDQpydW4NCmV4aXQNCmVuZHNubW9kDQplY2hv
>ICJEYXkgMSBkb25lIg0KIw0KIw0KIyBSZW1vdmUgdGVtcG9yYXJ5IGZpbGUg
>YW5kIHJlc3RhcnQgTERNDQojDQplY2hvICJSZW1vdmluZyB0bXAuZ2VtIGZp
>bGUiDQpybSAvZXhwb3J0L2RhdGEvZ2VtcGFrL3VwcGVyYWlyL3RtcC5nZW0N
>CmVjaG8gIkRvbmUiDQpleGl0DQo=
>---559023410-959030623-951140265=:24523--
>