Re: [conduit] CONDUIT Insert Tables Update

On Wed, Oct 18, 2023 at 3:42 PM Pete Pokrandt <address@hidden> wrote:

Daryl,

I'm guessing he means to get the product info back into the metadata for most of the model data on the CONDUIT stream.

Prior to the fix, after the file name and exclamation point, there was info about the forecast hour/variable/level at the end, like

20210621T163257.947961Z pqutil[37223] pqutil.c:display_watch:1186 INFO 75741 20210621163239.720822 CONDUIT 064 data/nccf/com/gfs/prod/gfs.20210621/12/atmos/gfs.t12z.pgrb2.1p00.f225 !grib2/ncep/GFS/#000/202106211200F225/HGHT/0 hPa PRES! 000064
20210621T163257.948000Z pqutil[37223] pqutil.c:display_watch:1186 INFO 77396 20210621163239.820916 CONDUIT 065 data/nccf/com/gfs/prod/gfs.20210621/12/atmos/gfs.t12z.pgrb2.1p00.f225 !grib2/ncep/GFS/#000/202106211200F225/TMPK/0 hPa PRES! 000065

20210621T163257.948039Z pqutil[37223] pqutil.c:display_watch:1186 INFO 1213997 20210621163241.523907 CONDUIT 047 data/nccf/com/gfs/prod/gfs.20210621/12/atmos/gfs.t12z.pgrb2.0p25.f225 !grib2/ncep/GFS/#000/202106211200F225/SPFH/0 hPa PRES! 000047
20210621T163257.948126Z pqutil[37223] pqutil.c:display_watch:1186 INFO 170943 20210621163228.510736 CONDUIT 738 data/nccf/com/gfs/prod/gfs.20210621/12/atmos/gfs.t12z.pgrb2.0p50.f222 !grib2/ncep/GFS/#000/202106211200F222/VREL/-2 K*m**2*kg-1*s-1 POTV! 000738

Since the migration to RHEL8 and a newer version of the ldm, they have been coming through with generic default filler info for every product, like

20231015T041432.757539Z pqutil[27287] pqutil.c:display_watch:1186 INFO 82796 20231015041414.643571 CONDUIT 659 data/nccf/com/gfs/v16.3/gfs.20231015/00/atmos/gfs.t00z.pgrb2.1p00.f162 !grib2/ncep/GFS/#000/FHRS//LVL! 000659
20231015T041432.757575Z pqutil[27287] pqutil.c:display_watch:1186 INFO 67717 20231015041414.636494 CONDUIT 650 data/nccf/com/gfs/v16.3/gfs.20231015/00/atmos/gfs.t00z.pgrb2.1p00.f162 !grib2/ncep/GFS/#000/FHRS//LVL! 000650
20231015T041432.757608Z pqutil[27287] pqutil.c:display_watch:1186 INFO 81162 20231015041414.644156 CONDUIT 660 data/nccf/com/gfs/v16.3/gfs.20231015/00/atmos/gfs.t00z.pgrb2.1p00.f162 !grib2/ncep/GFS/#000/FHRS//LVL! 000660

If you rely on the variable or level info after that exclamation point, as I do for some of my product sorting, that all broke with this change.

I would guess this change is to resolve that info. William, Mike, would you concur?

Pete

Pete Pokrandt - System Engineer IV
UW-Madison Dept of Atmospheric and Oceanic Sciences
608-262-3086 - address@hidden

From: conduit <address@hidden> on behalf of Herzmann, Daryl E [AGRON] <address@hidden>
Sent: Wednesday, October 18, 2023 10:25 AM
To: CONDUIT Users List <address@hidden>; William Boll - NOAA Federal <address@hidden>
Cc: _NWS NCEP NCO Dataflow <address@hidden>
Subject: Re: [conduit] CONDUIT Insert Tables Update

Hi William,

Curiosity always kills my cat... Could you kindly and briefly further describe what this change means? "variables to be defined in the LDM queue" doesn't ring any bells for me as to what this change means. Modifying product names can certainly be very impactful to downstream users.

daryl

________________________________________
From: conduit <address@hidden> on behalf of William Boll - NOAA Federal via conduit <address@hidden>
Sent: Wednesday, October 18, 2023 7:21 AM
To: CONDUIT Users List
Cc: _NWS NCEP NCO Dataflow
Subject: [conduit] CONDUIT Insert Tables Update

Attention CONDUIT Users,

Beginning on October 23, 2023 at 1500z, NCO Dataflow will make an update to the LDM insert tables on our CONDUIT systems. This will allow for individual variables to be defined in the LDM queue for the data products. We are not expecting any impacts to downstream users. If however you do encounter issues, please report them to NCO Dataflow (address@hidden<mailto:address@hidden>) as soon as possible.

Thank You,
William

--
Dataflow Team Lead (Acting)
NCEP Central Operations
College Park, Maryland 20740
(240)-736-8261

_______________________________________________
NOTE: All exchanges posted to Unidata maintained email lists are
recorded in the Unidata inquiry tracking system and made publicly
available through the web. Users who post to any of the lists we
maintain are reminded to remove any personal information that they
do not want to be made public.

conduit mailing list
address@hidden
For list information or to unsubscribe, visit: https://www.unidata.ucar.edu/mailing_lists/