[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[CONDUIT #BRX-137819]: GFS naming problems - ingest problem?
- Subject: [CONDUIT #BRX-137819]: GFS naming problems - ingest problem?
- Date: Tue, 24 Oct 2006 10:56:32 -0600
Pete,
This appears to be an issue with the GRIB1 files and the daylight savings
time change. This off by one is progressing downward by run toward Sunday AM.
I'll see if there is anything that can be done during this period.
I wrote the GRIB2 parts using the GEMPAK GRIB2 code (parameter tables etc)
and time routines, and they appear to be OK for the ensemble runs.
The grib1 names use wgrib and apparently there is a gmtime offset past the time
change.
Steve Chiswell
Unidata User Support
>
> Steve/whoever,
>
> Since the cutover to the new machine/naming structure, we've found that
> many of the GFS products (usually after 100 hours or so into the forecast)
> are being incorrectly identified. We use the Fxxx after the !grib to
> identify the forecast hour, since it is always a 3 digit forecast hour,
> rather than the fxxx number in the original file name, since for the
> < 100 hours, that is only one or two digits.
>
> Here's an example from yesterday's 18 UTC GFS run:
>
> Oct 23 22:29:12 pqutil INFO: 36004 20061023222839.142 CONDUIT 269
> data/nccf/com/gfs/prod/gfs.2006102318/gfs.t18z.pgrbf159
> !grib/ncep/GFS/#003/200610231800/F160/SOILW/40-100_cm_down! 000269
>
> Notice how the f159 product is incorrectly being labeled as F160..
>
> This looks like an ingest problem of some sort to me. At any rate,
> all of my forecast times from then on are incorrectly labeled, including
> the 2.5 deg files from 192 to 384h.
>
> Any ideas?
>
> Here's the listing of all of the files for all of forecast times
> from that run (18 UTC 10/23/2006): The problem begins here with
> the 129 hour forecast (labeled as 130) and continues the rest
> of the run.
>
>
> -rw-rw-r-- 1 ldm ldm 94154832 Oct 23 16:27
> /data/grib/gblav.06102318_F000
> -rw-rw-r-- 1 ldm ldm 26969296 Oct 23 16:29
> /data/grib/gblav.06102318_F003
> -rw-rw-r-- 1 ldm ldm 26864870 Oct 23 16:30
> /data/grib/gblav.06102318_F006
> -rw-rw-r-- 1 ldm ldm 27034284 Oct 23 16:31
> /data/grib/gblav.06102318_F009
> -rw-rw-r-- 1 ldm ldm 27103278 Oct 23 16:33
> /data/grib/gblav.06102318_F012
> -rw-rw-r-- 1 ldm ldm 27077370 Oct 23 16:35
> /data/grib/gblav.06102318_F015
> -rw-rw-r-- 1 ldm ldm 27174076 Oct 23 16:35
> /data/grib/gblav.06102318_F018
> -rw-rw-r-- 1 ldm ldm 27069314 Oct 23 16:36
> /data/grib/gblav.06102318_F021
> -rw-rw-r-- 1 ldm ldm 27123756 Oct 23 16:38
> /data/grib/gblav.06102318_F024
> -rw-rw-r-- 1 ldm ldm 27144828 Oct 23 16:39
> /data/grib/gblav.06102318_F027
> -rw-rw-r-- 1 ldm ldm 27154754 Oct 23 16:40
> /data/grib/gblav.06102318_F030
> -rw-rw-r-- 1 ldm ldm 27138234 Oct 23 16:41
> /data/grib/gblav.06102318_F033
> -rw-rw-r-- 1 ldm ldm 27100934 Oct 23 16:43
> /data/grib/gblav.06102318_F036
> -rw-rw-r-- 1 ldm ldm 27059772 Oct 23 16:43
> /data/grib/gblav.06102318_F039
> -rw-rw-r-- 1 ldm ldm 27113884 Oct 23 16:44
> /data/grib/gblav.06102318_F042
> -rw-rw-r-- 1 ldm ldm 27168774 Oct 23 16:53
> /data/grib/gblav.06102318_F045
> -rw-rw-r-- 1 ldm ldm 27181168 Oct 23 16:48
> /data/grib/gblav.06102318_F048
> -rw-rw-r-- 1 ldm ldm 27164122 Oct 23 16:51
> /data/grib/gblav.06102318_F051
> -rw-rw-r-- 1 ldm ldm 27159918 Oct 23 16:53
> /data/grib/gblav.06102318_F054
> -rw-rw-r-- 1 ldm ldm 27291726 Oct 23 16:57
> /data/grib/gblav.06102318_F057
> -rw-rw-r-- 1 ldm ldm 27297128 Oct 23 16:57
> /data/grib/gblav.06102318_F060
> -rw-rw-r-- 1 ldm ldm 27149798 Oct 23 16:58
> /data/grib/gblav.06102318_F063
> -rw-rw-r-- 1 ldm ldm 27211678 Oct 23 17:03
> /data/grib/gblav.06102318_F066
> -rw-rw-r-- 1 ldm ldm 27167316 Oct 23 17:02
> /data/grib/gblav.06102318_F069
> -rw-rw-r-- 1 ldm ldm 27345876 Oct 23 17:04
> /data/grib/gblav.06102318_F072
> -rw-rw-r-- 1 ldm ldm 27137988 Oct 23 17:05
> /data/grib/gblav.06102318_F075
> -rw-rw-r-- 1 ldm ldm 27142378 Oct 23 17:11
> /data/grib/gblav.06102318_F078
> -rw-rw-r-- 1 ldm ldm 27094842 Oct 23 17:09
> /data/grib/gblav.06102318_F081
> -rw-rw-r-- 1 ldm ldm 27105062 Oct 23 17:10
> /data/grib/gblav.06102318_F084
> -rw-rw-r-- 1 ldm ldm 27048578 Oct 23 17:12
> /data/grib/gblav.06102318_F087
> -rw-rw-r-- 1 ldm ldm 26997226 Oct 23 17:12
> /data/grib/gblav.06102318_F090
> -rw-rw-r-- 1 ldm ldm 27023282 Oct 23 17:16
> /data/grib/gblav.06102318_F093
> -rw-rw-r-- 1 ldm ldm 27050340 Oct 23 17:16
> /data/grib/gblav.06102318_F096
> -rw-rw-r-- 1 ldm ldm 27041388 Oct 23 17:17
> /data/grib/gblav.06102318_F099
> -rw-rw-r-- 1 ldm ldm 27053300 Oct 23 17:17
> /data/grib/gblav.06102318_F102
> -rw-rw-r-- 1 ldm ldm 27118918 Oct 23 17:17
> /data/grib/gblav.06102318_F105
> -rw-rw-r-- 1 ldm ldm 27138826 Oct 23 17:18
> /data/grib/gblav.06102318_F108
> -rw-rw-r-- 1 ldm ldm 27153810 Oct 23 17:19
> /data/grib/gblav.06102318_F111
> -rw-rw-r-- 1 ldm ldm 27186884 Oct 23 17:19
> /data/grib/gblav.06102318_F114
> -rw-rw-r-- 1 ldm ldm 27142610 Oct 23 17:19
> /data/grib/gblav.06102318_F117
> -rw-rw-r-- 1 ldm ldm 27137484 Oct 23 17:20
> /data/grib/gblav.06102318_F120
> -rw-rw-r-- 1 ldm ldm 27125984 Oct 23 17:21
> /data/grib/gblav.06102318_F123
> -rw-rw-r-- 1 ldm ldm 27132494 Oct 23 17:21
> /data/grib/gblav.06102318_F126
> -rw-rw-r-- 1 ldm ldm 27140954 Oct 23 17:21
> /data/grib/gblav.06102318_F130
> -rw-rw-r-- 1 ldm ldm 27231230 Oct 23 17:22
> /data/grib/gblav.06102318_F133
> -rw-rw-r-- 1 ldm ldm 27047844 Oct 23 17:22
> /data/grib/gblav.06102318_F136
> -rw-rw-r-- 1 ldm ldm 27120478 Oct 23 17:22
> /data/grib/gblav.06102318_F139
> -rw-rw-r-- 1 ldm ldm 27026972 Oct 23 17:23
> /data/grib/gblav.06102318_F142
> -rw-rw-r-- 1 ldm ldm 27059298 Oct 23 17:23
> /data/grib/gblav.06102318_F145
> -rw-rw-r-- 1 ldm ldm 26997250 Oct 23 17:24
> /data/grib/gblav.06102318_F148
> -rw-rw-r-- 1 ldm ldm 27161632 Oct 23 17:25
> /data/grib/gblav.06102318_F151
> -rw-rw-r-- 1 ldm ldm 27161780 Oct 23 17:27
> /data/grib/gblav.06102318_F154
> -rw-rw-r-- 1 ldm ldm 27059196 Oct 23 17:27
> /data/grib/gblav.06102318_F157
> -rw-rw-r-- 1 ldm ldm 27113694 Oct 23 17:29
> /data/grib/gblav.06102318_F160
> -rw-rw-r-- 1 ldm ldm 27195118 Oct 23 17:30
> /data/grib/gblav.06102318_F163
> -rw-rw-r-- 1 ldm ldm 27176770 Oct 23 17:31
> /data/grib/gblav.06102318_F166
> -rw-rw-r-- 1 ldm ldm 27199382 Oct 23 17:32
> /data/grib/gblav.06102318_F169
> -rw-rw-r-- 1 ldm ldm 27074074 Oct 23 17:33
> /data/grib/gblav.06102318_F172
> -rw-rw-r-- 1 ldm ldm 27087352 Oct 23 17:35
> /data/grib/gblav.06102318_F175
> -rw-rw-r-- 1 ldm ldm 27101512 Oct 23 17:35
> /data/grib/gblav.06102318_F178
> -rw-rw-r-- 1 ldm ldm 27199640 Oct 23 17:38
> /data/grib/gblav.06102318_F181
> -rw-rw-r-- 1 ldm ldm 4327132 Oct 23 17:38
> /data/grib/gblav.06102318_F193
> -rw-rw-r-- 1 ldm ldm 4342332 Oct 23 17:38
> /data/grib/gblav.06102318_F205
> -rw-rw-r-- 1 ldm ldm 4336014 Oct 23 17:38
> /data/grib/gblav.06102318_F217
> -rw-rw-r-- 1 ldm ldm 4335458 Oct 23 17:38
> /data/grib/gblav.06102318_F229
> -rw-rw-r-- 1 ldm ldm 4337622 Oct 23 17:39
> /data/grib/gblav.06102318_F241
> -rw-rw-r-- 1 ldm ldm 4349286 Oct 23 17:39
> /data/grib/gblav.06102318_F253
> -rw-rw-r-- 1 ldm ldm 4355426 Oct 23 17:40
> /data/grib/gblav.06102318_F265
> -rw-rw-r-- 1 ldm ldm 4325784 Oct 23 17:40
> /data/grib/gblav.06102318_F277
> -rw-rw-r-- 1 ldm ldm 4317576 Oct 23 17:41
> /data/grib/gblav.06102318_F289
> -rw-rw-r-- 1 ldm ldm 4335506 Oct 23 17:41
> /data/grib/gblav.06102318_F301
> -rw-rw-r-- 1 ldm ldm 4328630 Oct 23 17:42
> /data/grib/gblav.06102318_F313
> -rw-rw-r-- 1 ldm ldm 4325420 Oct 23 17:42
> /data/grib/gblav.06102318_F325
> -rw-rw-r-- 1 ldm ldm 4328554 Oct 23 17:42
> /data/grib/gblav.06102318_F337
> -rw-rw-r-- 1 ldm ldm 4354672 Oct 23 17:43
> /data/grib/gblav.06102318_F349
> -rw-rw-r-- 1 ldm ldm 4344730 Oct 23 17:43
> /data/grib/gblav.06102318_F361
> -rw-rw-r-- 1 ldm ldm 4325634 Oct 23 17:44
> /data/grib/gblav.06102318_F373
> -rw-rw-r-- 1 ldm ldm 4308642 Oct 23 17:44
> /data/grib/gblav.06102318_F385
>
> Thanks,
>
> Pete
>
>
> --
> +>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+
> ^ Pete Pokrandt V 1447 AOSS Bldg 1225 W Dayton St^
> ^ Systems Programmer V Madison, WI 53706 ^
> ^ V address@hidden ^
> ^ Dept of Atmos & Oceanic Sciences V (608) 262-3086 (Phone/voicemail) ^
> ^ University of Wisconsin-Madison V 262-0166 (Fax) ^
> +<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+
>
>
Ticket Details
===================
Ticket ID: BRX-137819
Department: Support CONDUIT
Priority: Normal
Status: Closed