[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[CONDUIT #BRX-137819]: GFS naming problems - ingest problem?

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [CONDUIT #BRX-137819]: GFS naming problems - ingest problem?
  • Date: Tue, 24 Oct 2006 15:59:53 -0600
Pete,

I fixed the code this morning and NCEP has installed it so that the 18Z runs 
should be OK.


Steve Chiswell
Unidata User Support


> 
> Nevermind, I think I got it.. I'm using this and it seems to be working:
> 
> CONDUIT 
> data/nccf/com/gfs/prod/gfs.20([0-9][0-9])([0-9][0-9])([0-9][0-9]).*/gfs.t(..)z.pgrbf([0-9][0-9])\
>  !grib/ncep.*/#003/.*F([0-9][0-9][0-9]).*
> FILE    /data/grib/gblav.\1\2\3\4_F0\5
> CONDUIT 
> data/nccf/com/gfs/prod/gfs.20([0-9][0-9])([0-9][0-9])([0-9][0-9]).*/gfs.t(..)z.pgrbf([0-9][0-9][0-9])\
>  !grib/ncep.*/#003/.*F([0-9][0-9][0-9]).*
> FILE    /data/grib/gblav.\1\2\3\4_F\5
> 
> 
> In a previous message to me, you wrote:
> 
> >Pete,
> >
> >This appears to be an issue with the GRIB1 files and the daylight savings
> >time change. This off by one is progressing downward by run toward Sunday AM.
> >
> >I'll see if there is anything that can be done during this period.
> >
> >I wrote the GRIB2 parts using the GEMPAK GRIB2 code (parameter tables etc)
> >and time routines, and they appear to be OK for the ensemble runs.
> >The grib1 names use wgrib and apparently there is a gmtime offset past the ti
> >me change.
> >
> >Steve Chiswell
> >Unidata User Support
> >
> >
> >>
> >> Steve/whoever,
> >>
> >> Since the cutover to the new machine/naming structure, we've found that
> >> many of the GFS products (usually after 100 hours or so into the forecast)
> >> are being incorrectly identified. We use the Fxxx after the !grib to
> >> identify the forecast hour, since it is always a 3 digit forecast hour,
> >> rather than the fxxx number in the original file name, since for the
> >> < 100 hours, that is only one or two digits.
> >>
> >> Here's an example from yesterday's 18 UTC GFS run:
> >>
> >> Oct 23 22:29:12 pqutil INFO:    36004 20061023222839.142 CONDUIT 269  data/
> >nccf/com/gfs/prod/gfs.2006102318/gfs.t18z.pgrbf159 !grib/ncep/GFS/#003/20061
> >0231800/F160/SOILW/40-100_cm_down! 000269
> >>
> >> Notice how the f159 product is incorrectly being labeled as F160..
> >>
> >> This looks like an ingest problem of some sort to me. At any rate,
> >> all of my forecast times from then on are incorrectly labeled, including
> >> the 2.5 deg files from 192 to 384h.
> >>
> >> Any ideas?
> >>
> >> Here's the listing of all of the files for all of forecast times
> >> from that run (18 UTC 10/23/2006):  The problem begins here with
> >> the 129 hour forecast (labeled as 130) and continues the rest
> >> of the run.
> >>
> >>
> >> -rw-rw-r--    1 ldm      ldm      94154832 Oct 23 16:27 /data/grib/gblav.06
> >102318_F000
> >> -rw-rw-r--    1 ldm      ldm      26969296 Oct 23 16:29 /data/grib/gblav.06
> >102318_F003
> >> -rw-rw-r--    1 ldm      ldm      26864870 Oct 23 16:30 /data/grib/gblav.06
> >102318_F006
> >> -rw-rw-r--    1 ldm      ldm      27034284 Oct 23 16:31 /data/grib/gblav.06
> >102318_F009
> >> -rw-rw-r--    1 ldm      ldm      27103278 Oct 23 16:33 /data/grib/gblav.06
> >102318_F012
> >> -rw-rw-r--    1 ldm      ldm      27077370 Oct 23 16:35 /data/grib/gblav.06
> >102318_F015
> >> -rw-rw-r--    1 ldm      ldm      27174076 Oct 23 16:35 /data/grib/gblav.06
> >102318_F018
> >> -rw-rw-r--    1 ldm      ldm      27069314 Oct 23 16:36 /data/grib/gblav.06
> >102318_F021
> >> -rw-rw-r--    1 ldm      ldm      27123756 Oct 23 16:38 /data/grib/gblav.06
> >102318_F024
> >> -rw-rw-r--    1 ldm      ldm      27144828 Oct 23 16:39 /data/grib/gblav.06
> >102318_F027
> >> -rw-rw-r--    1 ldm      ldm      27154754 Oct 23 16:40 /data/grib/gblav.06
> >102318_F030
> >> -rw-rw-r--    1 ldm      ldm      27138234 Oct 23 16:41 /data/grib/gblav.06
> >102318_F033
> >> -rw-rw-r--    1 ldm      ldm      27100934 Oct 23 16:43 /data/grib/gblav.06
> >102318_F036
> >> -rw-rw-r--    1 ldm      ldm      27059772 Oct 23 16:43 /data/grib/gblav.06
> >102318_F039
> >> -rw-rw-r--    1 ldm      ldm      27113884 Oct 23 16:44 /data/grib/gblav.06
> >102318_F042
> >> -rw-rw-r--    1 ldm      ldm      27168774 Oct 23 16:53 /data/grib/gblav.06
> >102318_F045
> >> -rw-rw-r--    1 ldm      ldm      27181168 Oct 23 16:48 /data/grib/gblav.06
> >102318_F048
> >> -rw-rw-r--    1 ldm      ldm      27164122 Oct 23 16:51 /data/grib/gblav.06
> >102318_F051
> >> -rw-rw-r--    1 ldm      ldm      27159918 Oct 23 16:53 /data/grib/gblav.06
> >102318_F054
> >> -rw-rw-r--    1 ldm      ldm      27291726 Oct 23 16:57 /data/grib/gblav.06
> >102318_F057
> >> -rw-rw-r--    1 ldm      ldm      27297128 Oct 23 16:57 /data/grib/gblav.06
> >102318_F060
> >> -rw-rw-r--    1 ldm      ldm      27149798 Oct 23 16:58 /data/grib/gblav.06
> >102318_F063
> >> -rw-rw-r--    1 ldm      ldm      27211678 Oct 23 17:03 /data/grib/gblav.06
> >102318_F066
> >> -rw-rw-r--    1 ldm      ldm      27167316 Oct 23 17:02 /data/grib/gblav.06
> >102318_F069
> >> -rw-rw-r--    1 ldm      ldm      27345876 Oct 23 17:04 /data/grib/gblav.06
> >102318_F072
> >> -rw-rw-r--    1 ldm      ldm      27137988 Oct 23 17:05 /data/grib/gblav.06
> >102318_F075
> >> -rw-rw-r--    1 ldm      ldm      27142378 Oct 23 17:11 /data/grib/gblav.06
> >102318_F078
> >> -rw-rw-r--    1 ldm      ldm      27094842 Oct 23 17:09 /data/grib/gblav.06
> >102318_F081
> >> -rw-rw-r--    1 ldm      ldm      27105062 Oct 23 17:10 /data/grib/gblav.06
> >102318_F084
> >> -rw-rw-r--    1 ldm      ldm      27048578 Oct 23 17:12 /data/grib/gblav.06
> >102318_F087
> >> -rw-rw-r--    1 ldm      ldm      26997226 Oct 23 17:12 /data/grib/gblav.06
> >102318_F090
> >> -rw-rw-r--    1 ldm      ldm      27023282 Oct 23 17:16 /data/grib/gblav.06
> >102318_F093
> >> -rw-rw-r--    1 ldm      ldm      27050340 Oct 23 17:16 /data/grib/gblav.06
> >102318_F096
> >> -rw-rw-r--    1 ldm      ldm      27041388 Oct 23 17:17 /data/grib/gblav.06
> >102318_F099
> >> -rw-rw-r--    1 ldm      ldm      27053300 Oct 23 17:17 /data/grib/gblav.06
> >102318_F102
> >> -rw-rw-r--    1 ldm      ldm      27118918 Oct 23 17:17 /data/grib/gblav.06
> >102318_F105
> >> -rw-rw-r--    1 ldm      ldm      27138826 Oct 23 17:18 /data/grib/gblav.06
> >102318_F108
> >> -rw-rw-r--    1 ldm      ldm      27153810 Oct 23 17:19 /data/grib/gblav.06
> >102318_F111
> >> -rw-rw-r--    1 ldm      ldm      27186884 Oct 23 17:19 /data/grib/gblav.06
> >102318_F114
> >> -rw-rw-r--    1 ldm      ldm      27142610 Oct 23 17:19 /data/grib/gblav.06
> >102318_F117
> >> -rw-rw-r--    1 ldm      ldm      27137484 Oct 23 17:20 /data/grib/gblav.06
> >102318_F120
> >> -rw-rw-r--    1 ldm      ldm      27125984 Oct 23 17:21 /data/grib/gblav.06
> >102318_F123
> >> -rw-rw-r--    1 ldm      ldm      27132494 Oct 23 17:21 /data/grib/gblav.06
> >102318_F126
> >> -rw-rw-r--    1 ldm      ldm      27140954 Oct 23 17:21 /data/grib/gblav.06
> >102318_F130
> >> -rw-rw-r--    1 ldm      ldm      27231230 Oct 23 17:22 /data/grib/gblav.06
> >102318_F133
> >> -rw-rw-r--    1 ldm      ldm      27047844 Oct 23 17:22 /data/grib/gblav.06
> >102318_F136
> >> -rw-rw-r--    1 ldm      ldm      27120478 Oct 23 17:22 /data/grib/gblav.06
> >102318_F139
> >> -rw-rw-r--    1 ldm      ldm      27026972 Oct 23 17:23 /data/grib/gblav.06
> >102318_F142
> >> -rw-rw-r--    1 ldm      ldm      27059298 Oct 23 17:23 /data/grib/gblav.06
> >102318_F145
> >> -rw-rw-r--    1 ldm      ldm      26997250 Oct 23 17:24 /data/grib/gblav.06
> >102318_F148
> >> -rw-rw-r--    1 ldm      ldm      27161632 Oct 23 17:25 /data/grib/gblav.06
> >102318_F151
> >> -rw-rw-r--    1 ldm      ldm      27161780 Oct 23 17:27 /data/grib/gblav.06
> >102318_F154
> >> -rw-rw-r--    1 ldm      ldm      27059196 Oct 23 17:27 /data/grib/gblav.06
> >102318_F157
> >> -rw-rw-r--    1 ldm      ldm      27113694 Oct 23 17:29 /data/grib/gblav.06
> >102318_F160
> >> -rw-rw-r--    1 ldm      ldm      27195118 Oct 23 17:30 /data/grib/gblav.06
> >102318_F163
> >> -rw-rw-r--    1 ldm      ldm      27176770 Oct 23 17:31 /data/grib/gblav.06
> >102318_F166
> >> -rw-rw-r--    1 ldm      ldm      27199382 Oct 23 17:32 /data/grib/gblav.06
> >102318_F169
> >> -rw-rw-r--    1 ldm      ldm      27074074 Oct 23 17:33 /data/grib/gblav.06
> >102318_F172
> >> -rw-rw-r--    1 ldm      ldm      27087352 Oct 23 17:35 /data/grib/gblav.06
> >102318_F175
> >> -rw-rw-r--    1 ldm      ldm      27101512 Oct 23 17:35 /data/grib/gblav.06
> >102318_F178
> >> -rw-rw-r--    1 ldm      ldm      27199640 Oct 23 17:38 /data/grib/gblav.06
> >102318_F181
> >> -rw-rw-r--    1 ldm      ldm       4327132 Oct 23 17:38 /data/grib/gblav.06
> >102318_F193
> >> -rw-rw-r--    1 ldm      ldm       4342332 Oct 23 17:38 /data/grib/gblav.06
> >102318_F205
> >> -rw-rw-r--    1 ldm      ldm       4336014 Oct 23 17:38 /data/grib/gblav.06
> >102318_F217
> >> -rw-rw-r--    1 ldm      ldm       4335458 Oct 23 17:38 /data/grib/gblav.06
> >102318_F229
> >> -rw-rw-r--    1 ldm      ldm       4337622 Oct 23 17:39 /data/grib/gblav.06
> >102318_F241
> >> -rw-rw-r--    1 ldm      ldm       4349286 Oct 23 17:39 /data/grib/gblav.06
> >102318_F253
> >> -rw-rw-r--    1 ldm      ldm       4355426 Oct 23 17:40 /data/grib/gblav.06
> >102318_F265
> >> -rw-rw-r--    1 ldm      ldm       4325784 Oct 23 17:40 /data/grib/gblav.06
> >102318_F277
> >> -rw-rw-r--    1 ldm      ldm       4317576 Oct 23 17:41 /data/grib/gblav.06
> >102318_F289
> >> -rw-rw-r--    1 ldm      ldm       4335506 Oct 23 17:41 /data/grib/gblav.06
> >102318_F301
> >> -rw-rw-r--    1 ldm      ldm       4328630 Oct 23 17:42 /data/grib/gblav.06
> >102318_F313
> >> -rw-rw-r--    1 ldm      ldm       4325420 Oct 23 17:42 /data/grib/gblav.06
> >102318_F325
> >> -rw-rw-r--    1 ldm      ldm       4328554 Oct 23 17:42 /data/grib/gblav.06
> >102318_F337
> >> -rw-rw-r--    1 ldm      ldm       4354672 Oct 23 17:43 /data/grib/gblav.06
> >102318_F349
> >> -rw-rw-r--    1 ldm      ldm       4344730 Oct 23 17:43 /data/grib/gblav.06
> >102318_F361
> >> -rw-rw-r--    1 ldm      ldm       4325634 Oct 23 17:44 /data/grib/gblav.06
> >102318_F373
> >> -rw-rw-r--    1 ldm      ldm       4308642 Oct 23 17:44 /data/grib/gblav.06
> >102318_F385
> >>
> >> Thanks,
> >>
> >> Pete
> >>
> >>
> >> --
> >> +>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+
> >> ^ Pete Pokrandt                    V 1447  AOSS Bldg  1225 W Dayton St^
> >> ^ Systems Programmer               V Madison,         WI     53706    ^
> >> ^                                  V      address@hidden       ^
> >> ^ Dept of Atmos & Oceanic Sciences V (608) 262-3086 (Phone/voicemail) ^
> >> ^ University of Wisconsin-Madison  V       262-0166 (Fax)             ^
> >> +<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+
> >>
> >>
> >
> >
> >Ticket Details
> >===================
> >Ticket ID: BRX-137819
> >Department: Support CONDUIT
> >Priority: Normal
> >Status: Closed
> >
> 
> 
> --
> +>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+
> ^ Pete Pokrandt                    V 1447  AOSS Bldg  1225 W Dayton St^
> ^ Systems Programmer               V Madison,         WI     53706    ^
> ^                                  V      address@hidden       ^
> ^ Dept of Atmos & Oceanic Sciences V (608) 262-3086 (Phone/voicemail) ^
> ^ University of Wisconsin-Madison  V       262-0166 (Fax)             ^
> <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<+>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>+
> 
> 


Ticket Details
===================
Ticket ID: BRX-137819
Department: Support CONDUIT
Priority: Normal
Status: Closed