This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.
Art, It sounds like the data is not getting flushed to the file on exit- which would explain why its the end of the hour thats missing. I'll look at this and see what we need to fix. Steve Chiswell Unidata User SUpport >From: address@hidden >Organization: . >Keywords: 199904081806.MAA21397 >Hi, > >I'm following up on a problem that a student has reported and is still >occuring regarding the gempak decoding of lightning data. The decoder >on our system seems to work okay a lot of the time, but at other times, >it will not decode (store?) data toward the end of an hour. I also save >the nldn data in raw format from the IDD feed (by report and by hour) >and I can see that the data come in during the latter part of each hour, >but for some reason, the decoder is not handling it, sometimes. >Thanks for any help you can give in trying to track down this problem. > > Art. > >Here's an example of the problem from this AM: > >pqact.conf entries: > >NLDN ^(.*) > FILE -close data/ldm/nldn/\1.ingest > >NLDN ^([0-9][0-9])([0-3][0-9][0-9])([0-2][0-9])([0-5][0-9])([0-5][0-9]) > FILE -close data/ldm/nldn/\1\2\3.ingest > >NLDN ^([0-9][0-9])([0-3][0-9][0-9])([0-2][0-9])([0-5][0-9])([0-5][0-9]) > PIPE /opt1/gempak/NAWIPS/bin/sol/dcnldn -v -m20000 -sminute05 > -ddata/gempak/logs/dcnldn.log > -p/opt1/gempak/NAWIPS/gempak5.4/tables/pack/nldn.pack > data/gempak/nldn/YYMMDDHH_nldn.gem > >Software: gempak 5.4 pl6 with Jl2298 updated decode_nldn.f > > >List of raw data collected: > >-rw-r--r-- 1 ldm user 48440 Apr 8 04:00 9909807.ingest >-rw-r--r-- 1 ldm user 4928 Apr 8 03:07 99098070005.ingest >-rw-r--r-- 1 ldm user 4368 Apr 8 03:13 99098070611.ingest >-rw-r--r-- 1 ldm user 5180 Apr 8 03:19 99098071217.ingest >-rw-r--r-- 1 ldm user 4872 Apr 8 03:24 99098071823.ingest >-rw-r--r-- 1 ldm user 4956 Apr 8 03:31 99098072429.ingest >-rw-r--r-- 1 ldm user 4984 Apr 8 03:36 99098073035.ingest >-rw-r--r-- 1 ldm user 4816 Apr 8 03:42 99098073641.ingest >-rw-r--r-- 1 ldm user 4844 Apr 8 03:48 99098074247.ingest >-rw-r--r-- 1 ldm user 4564 Apr 8 03:54 99098074853.ingest >-rw-r--r-- 1 ldm user 4928 Apr 8 04:00 99098075459.ingest >-rw-r--r-- 1 ldm user 58352 Apr 8 05:00 9909808.ingest >-rw-r--r-- 1 ldm user 5404 Apr 8 04:06 99098080005.ingest >-rw-r--r-- 1 ldm user 6468 Apr 8 04:12 99098080611.ingest >-rw-r--r-- 1 ldm user 5908 Apr 8 04:18 99098081217.ingest >-rw-r--r-- 1 ldm user 6412 Apr 8 04:24 99098081823.ingest >-rw-r--r-- 1 ldm user 5880 Apr 8 04:30 99098082429.ingest >-rw-r--r-- 1 ldm user 5292 Apr 8 04:36 99098083035.ingest >-rw-r--r-- 1 ldm user 5152 Apr 8 04:42 99098083641.ingest >-rw-r--r-- 1 ldm user 5656 Apr 8 04:48 99098084247.ingest >-rw-r--r-- 1 ldm user 6468 Apr 8 04:54 99098084853.ingest >-rw-r--r-- 1 ldm user 5712 Apr 8 05:00 99098085459.ingest >-rw-r--r-- 1 ldm user 57204 Apr 8 06:01 9909809.ingest >-rw-r--r-- 1 ldm user 5152 Apr 8 05:06 99098090005.ingest >-rw-r--r-- 1 ldm user 5264 Apr 8 05:13 99098090611.ingest >-rw-r--r-- 1 ldm user 5124 Apr 8 05:19 99098091217.ingest >-rw-r--r-- 1 ldm user 5936 Apr 8 05:25 99098091823.ingest >-rw-r--r-- 1 ldm user 6328 Apr 8 05:31 99098092429.ingest >-rw-r--r-- 1 ldm user 6020 Apr 8 05:37 99098093035.ingest >-rw-r--r-- 1 ldm user 5600 Apr 8 05:43 99098093641.ingest >-rw-r--r-- 1 ldm user 5936 Apr 8 05:49 99098094247.ingest >-rw-r--r-- 1 ldm user 5908 Apr 8 05:55 99098094853.ingest >-rw-r--r-- 1 ldm user 5936 Apr 8 06:01 99098095459.ingest >-rw-r--r-- 1 ldm user 71120 Apr 8 07:00 9909810.ingest >-rw-r--r-- 1 ldm user 6412 Apr 8 06:07 99098100005.ingest >-rw-r--r-- 1 ldm user 5796 Apr 8 06:13 99098100611.ingest >-rw-r--r-- 1 ldm user 6636 Apr 8 06:19 99098101217.ingest >-rw-r--r-- 1 ldm user 6580 Apr 8 06:25 99098101823.ingest >-rw-r--r-- 1 ldm user 7392 Apr 8 06:31 99098102429.ingest >-rw-r--r-- 1 ldm user 7196 Apr 8 06:37 99098103035.ingest >-rw-r--r-- 1 ldm user 7056 Apr 8 06:43 99098103641.ingest >-rw-r--r-- 1 ldm user 7504 Apr 8 06:49 99098104247.ingest >-rw-r--r-- 1 ldm user 7532 Apr 8 06:55 99098104853.ingest >-rw-r--r-- 1 ldm user 9016 Apr 8 07:00 99098105459.ingest >-rw-r--r-- 1 ldm user 67844 Apr 8 08:00 9909811.ingest >-rw-r--r-- 1 ldm user 7896 Apr 8 07:07 99098110005.ingest >-rw-r--r-- 1 ldm user 7112 Apr 8 07:13 99098110611.ingest >-rw-r--r-- 1 ldm user 6972 Apr 8 07:19 99098111217.ingest >-rw-r--r-- 1 ldm user 7336 Apr 8 07:25 99098111823.ingest >-rw-r--r-- 1 ldm user 6524 Apr 8 07:30 99098112429.ingest >-rw-r--r-- 1 ldm user 7028 Apr 8 07:36 99098113035.ingest >-rw-r--r-- 1 ldm user 6580 Apr 8 07:43 99098113641.ingest >-rw-r--r-- 1 ldm user 5600 Apr 8 07:48 99098114247.ingest >-rw-r--r-- 1 ldm user 6300 Apr 8 07:55 99098114853.ingest >-rw-r--r-- 1 ldm user 6496 Apr 8 08:00 99098115459.ingest >-rw-r--r-- 1 ldm user 63980 Apr 8 09:00 9909812.ingest >-rw-r--r-- 1 ldm user 6552 Apr 8 08:06 99098120005.ingest >-rw-r--r-- 1 ldm user 7112 Apr 8 08:12 99098120611.ingest >-rw-r--r-- 1 ldm user 8204 Apr 8 08:18 99098121217.ingest >-rw-r--r-- 1 ldm user 7364 Apr 8 08:24 99098121823.ingest >-rw-r--r-- 1 ldm user 6888 Apr 8 08:30 99098122429.ingest >-rw-r--r-- 1 ldm user 5376 Apr 8 08:36 99098123035.ingest >-rw-r--r-- 1 ldm user 5796 Apr 8 08:42 99098123641.ingest >-rw-r--r-- 1 ldm user 5152 Apr 8 08:48 99098124247.ingest >-rw-r--r-- 1 ldm user 5824 Apr 8 08:54 99098124853.ingest >-rw-r--r-- 1 ldm user 5712 Apr 8 09:00 99098125459.ingest >-rw-r--r-- 1 ldm user 74928 Apr 8 10:00 9909813.ingest >-rw-r--r-- 1 ldm user 6636 Apr 8 09:07 99098130005.ingest >-rw-r--r-- 1 ldm user 6692 Apr 8 09:12 99098130611.ingest >-rw-r--r-- 1 ldm user 6832 Apr 8 09:18 99098131217.ingest >-rw-r--r-- 1 ldm user 7756 Apr 8 09:24 99098131823.ingest >-rw-r--r-- 1 ldm user 8456 Apr 8 09:30 99098132429.ingest >-rw-r--r-- 1 ldm user 8288 Apr 8 09:36 99098133035.ingest >-rw-r--r-- 1 ldm user 8288 Apr 8 09:42 99098133641.ingest >-rw-r--r-- 1 ldm user 7840 Apr 8 09:48 99098134247.ingest >-rw-r--r-- 1 ldm user 6888 Apr 8 09:54 99098134853.ingest >-rw-r--r-- 1 ldm user 7252 Apr 8 10:00 99098135459.ingest >-rw-r--r-- 1 ldm user 74172 Apr 8 11:02 9909814.ingest >-rw-r--r-- 1 ldm user 7140 Apr 8 10:06 99098140005.ingest >-rw-r--r-- 1 ldm user 7280 Apr 8 10:12 99098140611.ingest >-rw-r--r-- 1 ldm user 6300 Apr 8 10:18 99098141217.ingest >-rw-r--r-- 1 ldm user 6916 Apr 8 10:25 99098141823.ingest >-rw-r--r-- 1 ldm user 6832 Apr 8 10:31 99098142429.ingest >-rw-r--r-- 1 ldm user 7140 Apr 8 10:37 99098143035.ingest >-rw-r--r-- 1 ldm user 6972 Apr 8 10:43 99098143641.ingest >-rw-r--r-- 1 ldm user 8120 Apr 8 10:49 99098144247.ingest >-rw-r--r-- 1 ldm user 8960 Apr 8 10:55 99098144853.ingest >-rw-r--r-- 1 ldm user 8512 Apr 8 11:02 99098145459.ingest >-rw-r--r-- 1 ldm user 73836 Apr 8 12:01 9909815.ingest >-rw-r--r-- 1 ldm user 8736 Apr 8 11:07 99098150005.ingest >-rw-r--r-- 1 ldm user 9268 Apr 8 11:14 99098150611.ingest >-rw-r--r-- 1 ldm user 8764 Apr 8 11:19 99098151217.ingest >-rw-r--r-- 1 ldm user 7924 Apr 8 11:25 99098151823.ingest >-rw-r--r-- 1 ldm user 6832 Apr 8 11:30 99098152429.ingest >-rw-r--r-- 1 ldm user 6580 Apr 8 11:37 99098153035.ingest >-rw-r--r-- 1 ldm user 7644 Apr 8 11:43 99098153641.ingest >-rw-r--r-- 1 ldm user 6580 Apr 8 11:49 99098154247.ingest >-rw-r--r-- 1 ldm user 6188 Apr 8 11:54 99098154853.ingest >-rw-r--r-- 1 ldm user 5320 Apr 8 12:01 99098155459.ingest >-rw-r--r-- 1 ldm user 25872 Apr 8 12:24 9909816.ingest >-rw-r--r-- 1 ldm user 5964 Apr 8 12:06 99098160005.ingest >-rw-r--r-- 1 ldm user 6356 Apr 8 12:12 99098160611.ingest >-rw-r--r-- 1 ldm user 6636 Apr 8 12:19 99098161217.ingest >-rw-r--r-- 1 ldm user 6916 Apr 8 12:24 99098161823.ingest > > >Data available using ltglist: > >99040807 thru minute 47 >99040808 thru minute 48 (one ob for minute 48) >99040809 thru minute 59 >99040810 thru minute 58 (three obs for minute 58) >99040811 thru minute 49 >99040812 thru minute 52 >99040813 thru minute 53 >99040814 thru minute 59 >99040815 thru minute 59 > > >Here's the dcnldn.log file: > >DCNLDN[24842]: 990408/0700: Starting up. >DCNLDN[24842]: 990408/0702: Normal Termination. >DCNLDN[24842]: 990408/0702: Number of bulletins read and processed: 168 >DCNLDN[24842]: 990408/0702: Shutting Down. >DCNLDN[27479]: 990408/0707: Starting up. >DCNLDN[27479]: 990408/0711: Normal Termination. >DCNLDN[27479]: 990408/0711: Number of bulletins read and processed: 173 >DCNLDN[27479]: 990408/0711: Shutting Down. >DCNLDN[28010]: 990408/0713: Starting up. >DCNLDN[28010]: 990408/0713: Normal Termination. >DCNLDN[28010]: 990408/0713: Number of bulletins read and processed: 153 >DCNLDN[28010]: 990408/0713: Shutting Down. >DCNLDN[747]: 990408/0719: Starting up. >DCNLDN[747]: 990408/0720: Normal Termination. >DCNLDN[747]: 990408/0720: Number of bulletins read and processed: 182 >DCNLDN[747]: 990408/0720: Shutting Down. >DCNLDN[1267]: 990408/0724: Starting up. >DCNLDN[1267]: 990408/0725: Normal Termination. >DCNLDN[1267]: 990408/0725: Number of bulletins read and processed: 171 >DCNLDN[1267]: 990408/0725: Shutting Down. >DCNLDN[3966]: 990408/0731: Starting up. >DCNLDN[3966]: 990408/0732: Normal Termination. >DCNLDN[3966]: 990408/0732: Number of bulletins read and processed: 174 >DCNLDN[3966]: 990408/0732: Shutting Down. >DCNLDN[6615]: 990408/0736: Starting up. >DCNLDN[6615]: 990408/0740: Normal Termination. >DCNLDN[6615]: 990408/0740: Number of bulletins read and processed: 175 >DCNLDN[6615]: 990408/0740: Shutting Down. >DCNLDN[7164]: 990408/0742: Starting up. >DCNLDN[7164]: 990408/0754: Normal Termination. >DCNLDN[7164]: 990408/0754: Number of bulletins read and processed: 339 >DCNLDN[7164]: 990408/0754: Shutting Down. >DCNLDN[10342]: 990408/0754: Starting up. >DCNLDN[10342]: 990408/0812: Normal Termination. >DCNLDN[10342]: 990408/0812: Number of bulletins read and processed: 751 >DCNLDN[10342]: 990408/0812: Shutting Down. >DCNLDN[22036]: 990408/0818: Starting up. >DCNLDN[22036]: 990408/0824: Normal Termination. >DCNLDN[22036]: 990408/0824: Number of bulletins read and processed: 208 >DCNLDN[22036]: 990408/0824: Shutting Down. >DCNLDN[7562]: 990408/0824: Starting up. >DCNLDN[7562]: 990408/1032: Normal Termination. >DCNLDN[7562]: 990408/1032: Number of bulletins read and processed: 4598 >DCNLDN[7562]: 990408/1032: Shutting Down. >DCNLDN[24943]: 990408/1037: Starting up. >DCNLDN[24943]: 990408/1038: Normal Termination. >DCNLDN[24943]: 990408/1038: Number of bulletins read and processed: 254 >DCNLDN[24943]: 990408/1038: Shutting Down. >DCNLDN[25556]: 990408/1043: Starting up. >DCNLDN[25556]: 990408/1343: Normal Termination. >DCNLDN[25556]: 990408/1343: Number of bulletins read and processed: 7617 >DCNLDN[25556]: 990408/1343: Shutting Down. >DCNLDN[15356]: 990408/1348: Starting up. >DCNLDN[15356]: 990408/1416: Normal Termination. >DCNLDN[15356]: 990408/1416: Number of bulletins read and processed: 1285 >DCNLDN[15356]: 990408/1416: Shutting Down. >DCNLDN[2859]: 990408/1418: Starting up. >DCNLDN[2859]: 990408/1420: Normal Termination. >DCNLDN[2859]: 990408/1420: Number of bulletins read and processed: 222 >DCNLDN[2859]: 990408/1420: Shutting Down. >DCNLDN[16811]: 990408/1425: Starting up. >DCNLDN[16811]: 990408/1428: Normal Termination. >DCNLDN[16811]: 990408/1428: Number of bulletins read and processed: 244 >DCNLDN[16811]: 990408/1428: Shutting Down. >DCNLDN[24777]: 990408/1431: Starting up. >DCNLDN[24777]: 990408/1432: Normal Termination. >DCNLDN[24777]: 990408/1432: Number of bulletins read and processed: 241 >DCNLDN[24777]: 990408/1432: Shutting Down. >DCNLDN[27472]: 990408/1437: Starting up. >DCNLDN[27472]: 990408/1438: Normal Termination. >DCNLDN[27472]: 990408/1438: Number of bulletins read and processed: 252 >DCNLDN[27472]: 990408/1438: Shutting Down. >DCNLDN[28034]: 990408/1443: Starting up. >DCNLDN[28034]: 990408/1444: Normal Termination. >DCNLDN[28034]: 990408/1444: Number of bulletins read and processed: 246 >DCNLDN[28034]: 990408/1444: Shutting Down. >DCNLDN[688]: 990408/1449: Starting up. >DCNLDN[688]: 990408/1450: Normal Termination. >DCNLDN[688]: 990408/1450: Number of bulletins read and processed: 287 >DCNLDN[688]: 990408/1450: Shutting Down. >DCNLDN[1144]: 990408/1455: Starting up. >DCNLDN[1144]: 990408/1456: Normal Termination. >DCNLDN[1144]: 990408/1456: Number of bulletins read and processed: 317 >DCNLDN[1144]: 990408/1456: Shutting Down. >DCNLDN[1755]: 990408/1502: Starting up. >DCNLDN[1755]: 990408/1502: Normal Termination. >DCNLDN[1755]: 990408/1502: Number of bulletins read and processed: 301 >DCNLDN[1755]: 990408/1502: Shutting Down. >DCNLDN[4339]: 990408/1507: Starting up. >DCNLDN[4339]: 990408/1508: Normal Termination. >DCNLDN[4339]: 990408/1508: Number of bulletins read and processed: 309 >DCNLDN[4339]: 990408/1508: Shutting Down. >DCNLDN[4931]: 990408/1514: Starting up. >DCNLDN[4931]: 990408/1514: Normal Termination. >DCNLDN[4931]: 990408/1514: Number of bulletins read and processed: 328 >DCNLDN[4931]: 990408/1514: Shutting Down. >DCNLDN[7522]: 990408/1519: Starting up. >DCNLDN[7522]: 990408/1525: Normal Termination. >DCNLDN[7522]: 990408/1525: Number of bulletins read and processed: 590 >DCNLDN[7522]: 990408/1525: Shutting Down. >DCNLDN[10544]: 990408/1530: Starting up. >DCNLDN[10544]: 990408/1533: Normal Termination. >DCNLDN[10544]: 990408/1533: Number of bulletins read and processed: 241 >DCNLDN[10544]: 990408/1533: Shutting Down. >DCNLDN[13156]: 990408/1537: Starting up. >DCNLDN[13156]: 990408/1559: Normal Termination. >DCNLDN[13156]: 990408/1559: Number of bulletins read and processed: 952 >DCNLDN[13156]: 990408/1559: Shutting Down. >DCNLDN[17664]: 990408/1601: Starting up. >DCNLDN[17664]: 990408/1605: Normal Termination. >DCNLDN[17664]: 990408/1605: Number of bulletins read and processed: 187 >DCNLDN[17664]: 990408/1605: Shutting Down. >DCNLDN[20254]: 990408/1606: Starting up. >DCNLDN[20254]: 990408/1607: Normal Termination. >DCNLDN[20254]: 990408/1607: Number of bulletins read and processed: 210 >DCNLDN[20254]: 990408/1607: Shutting Down. >DCNLDN[20872]: 990408/1612: Starting up. >DCNLDN[20872]: 990408/1619: Normal Termination. >DCNLDN[20872]: 990408/1619: Number of bulletins read and processed: 458 >DCNLDN[20872]: 990408/1619: Shutting Down. >DCNLDN[24187]: 990408/1624: Starting up. > > > >========================================================================= >Arthur A. Person >Research Assistant, System Administrator >Department of Meteorology >Penn State >email: address@hidden >phone: 814-863-1563 >========================================================================= >