[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDD #TQR-815973]: pqact.conf

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [IDD #TQR-815973]: pqact.conf
  • Date: Mon, 18 Jun 2007 14:59:17 -0600
Hi Massoud,

re:
> I'm currently making changes to my pqact.conf file, but
> I'm running into some problems with it. I'm looking up the
> NWS NEXRAD Composite 10 km under FNEXRAD using 'notifyme'
> and the closest I found was the mosaic national radar. I
> couldn't really find the product id(s), so I did my best
> to configure the file so that I would obtain entries for
> processing data.

Here is a snippit of the output from a 'notifyme' for FNEXRAD data I just ran:

Jun 18 20:07:11 notifyme[31930] INFO: e695a406209b1024952005e6c684264a    71673 
20070618194030.594 FNEXRAD 000  pnga2area Q5 RL 300 RADAR BREF 6km 20070618 1935
Jun 18 20:07:11 notifyme[31930] INFO: 6ad439197de29bfa64edf8fe1ea3a050    14418 
20070618194058.391 FNEXRAD 000  pnga2area Q5 RN 500 RADAR BREF 10km 20070618 
1920
Jun 18 20:07:11 notifyme[31930] INFO: ef01ac92fa386c04b26515ffda4aa629    92051 
20070618194100.711 FNEXRAD 000  rad/NEXRCOMP/4km/ntp_20070618_1939
Jun 18 20:07:11 notifyme[31930] INFO: 09519bfc23765a9d2d4a06dd50bab23c   305762 
20070618194428.805 FNEXRAD 000  radar_mosaic_national 
!grib/unidata/UPC_1/#255/200706181940/F000/N0R/sfc! 000000
Jun 18 20:07:11 notifyme[31930] INFO: f1fde2da4a9255507700aec9814b0478   269734 
20070618194428.837 FNEXRAD 001  radar_mosaic_national 
!grib/unidata/UPC_1/#255/200706181940/F000/NET/sfc! 000001
Jun 18 20:07:11 notifyme[31930] INFO: fdc634b8ea9a0ea109a4d0f8647d166c  3495010 
20070618194428.890 FNEXRAD 000  radar_mosaic_nathr 
!grib2/unidata/UPC_255/#000/200706181940F000/N0R/0 - NONE! 000000
Jun 18 20:07:12 notifyme[31930] INFO: b85cd3153a9298cb3ddc7905b435abc9    71520 
20070618194431.194 FNEXRAD 000  pnga2area Q5 RL 300 RADAR BREF 6km 20070618 1940
Jun 18 20:07:12 notifyme[31930] INFO: f9d2f98e5d4b0e6980f42fb19c38afdb  1558414 
20070618194501.483 FNEXRAD 000  rad/NEXRCOMP/1km/n0r_20070618_1941
Jun 18 20:07:12 notifyme[31930] INFO: 9e4714b4106cec288223e839a5a5ea7f   147387 
20070618194501.563 FNEXRAD 000  rad/NEXRCOMP/2km/n1p_20070618_1942
Jun 18 20:07:12 notifyme[31930] INFO: 856e3177754f31a45247b01dd53a6894    92755 
20070618194600.595 FNEXRAD 000  rad/NEXRCOMP/4km/ntp_20070618_1944
Jun 18 20:07:12 notifyme[31930] INFO: 17708714cadbc66fb2a0397f9456953d   305896 
20070618194827.516 FNEXRAD 000  radar_mosaic_national 
!grib/unidata/UPC_1/#255/200706181944/F000/N0R/sfc! 000000
Jun 18 20:07:12 notifyme[31930] INFO: 6a549522e8a8aea4defc1f9f3bb4f2eb  3514409 
20070618194827.863 FNEXRAD 000  radar_mosaic_nathr 
!grib2/unidata/UPC_255/#000/200706181944F000/N0R/0 - NONE! 000000

The product header portions of the products represented in this list are:
pnga2area Q5 RL 300 RADAR BREF 6km 20070618 1935
pnga2area Q5 RN 500 RADAR BREF 10km 20070618 1920
rad/NEXRCOMP/4km/ntp_20070618_1939
radar_mosaic_national !grib/unidata/UPC_1/#255/200706181940/F000/N0R/sfc! 000000
radar_mosaic_national !grib/unidata/UPC_1/#255/200706181940/F000/NET/sfc! 000001
radar_mosaic_nathr !grib2/unidata/UPC_255/#000/200706181940F000/N0R/0 - NONE! 
000000
pnga2area Q5 RL 300 RADAR BREF 6km 20070618 1940
rad/NEXRCOMP/1km/n0r_20070618_1941
rad/NEXRCOMP/2km/n1p_20070618_1942
rad/NEXRCOMP/4km/ntp_20070618_1944
radar_mosaic_national !grib/unidata/UPC_1/#255/200706181944/F000/N0R/sfc! 000000
radar_mosaic_nathr !grib2/unidata/UPC_255/#000/200706181944F000/N0R/0 - NONE! 
000000

Of these the 10 km RCM (radar coded message) composite in PNG-compressed McIDAS
AREA format is:

pnga2area Q5 RN 500 RADAR BREF 10km 20070618 1920

Also in the list are:

- 6 km version of the National Level III composites in PNG-compressed McIDAS
  AREA format:

pnga2area Q5 RL 300 RADAR BREF 6km 20070618 1935
pnga2area Q5 RL 300 RADAR BREF 6km 20070618 1940

- 1 km National Level III composite in PNG-compressed GINI format:

rad/NEXRCOMP/1km/n0r_20070618_1941

- 2 km National 1 hourly precipitation total in PNG-compressed GINI
  format:

rad/NEXRCOMP/2km/n1p_20070618_1942

- 4 km National storm total precipitation totals in PNG-compressed GINI
  format:

rad/NEXRCOMP/4km/ntp_20070618_1939
rad/NEXRCOMP/4km/ntp_20070618_1944

The rest of the products are GRIB messages that contain the same information
as the images.  Since you are looking for imagery, I will stay away from
a discussion of the products in GRIB format.

Similarly, here is a snippit from a notifyme for UNIWISC products I just ran:

Jun 18 20:37:02 notifyme[3340] INFO: 8300093f72782a7a61d59f68d5f0a1bf   154446 
20070618194127.928 UNIWISC 000  pnga2area Q3 UB 173 GOES-11_IMG 6.8um 8km 
20070618 1930
Jun 18 20:37:02 notifyme[3340] INFO: 8c1ad819aab3b25e2aa3f66647dbaaf2  1543720 
20070618194129.994 UNIWISC 000  pnga2area Q3 U9 123 GOES-11_IMG 0.65um 4km 
20070618 1930
Jun 18 20:37:02 notifyme[3340] INFO: d2f56d6eba4ea270b16041d482e964a1   899736 
20070618194132.105 UNIWISC 000  pnga2area Q3 U5 133 GOES-11_IMG 10.7um 4km 
20070618 1930
Jun 18 20:37:02 notifyme[3340] INFO: fb14f52d623ecd0c1b913450f9e5844e  1049976 
20070618194136.241 UNIWISC 000  pnga2area Q3 U7 1243 GOES-11_IMG 3.9um 4km 
20070618 1930
Jun 18 20:37:02 notifyme[3340] INFO: f7b523003081e9febdaeff91fc8d487a   934660 
20070618194210.394 UNIWISC 000  pnga2area Q3 U8 1253 GOES-11_IMG 12.0um 4km 
20070618 1930
Jun 18 20:37:02 notifyme[3340] INFO: 40e768277eaf9b07d045ed2fbbea7734   103458 
20070618194507.205 UNIWISC 000  pnga2area Q0 CA 1100 GOES-11_SND UNKBAND 1km 
20070618 1900
Jun 18 20:37:02 notifyme[3340] INFO: 3821010f81696f8ff1816376fdc1aabe   100253 
20070618194606.786 UNIWISC 000  pnga2area Q0 CB 1110 GOES-11_SND UNKBAND 1km 
20070618 1800
Jun 18 20:37:02 notifyme[3340] INFO: 94c5c4c742ba07baf24346630b727fcf    82775 
20070618194906.733 UNIWISC 000  pnga2area Q0 CE 1140 GOES-11_SND UNKBAND 1km 
20070618 1800
Jun 18 20:37:02 notifyme[3340] INFO: 55070299325c6e14aadf75ecf8823b22   480243 
20070618195713.846 UNIWISC 000  pnga2area Q3 UE 1233 GOES-12_IMG 13.3um 4km 
20070618 1945
Jun 18 20:37:02 notifyme[3340] INFO: db484e524daf8125ca131275cf94680d   906426 
20070618195917.767 UNIWISC 000  pnga2area Q3 UW 213 GOES-12_IMG 6.5um 4km 
20070618 1945
Jun 18 20:37:02 notifyme[3340] INFO: 6a515717ff17d6d753e8e739b8df1674  1896569 
20070618195920.319 UNIWISC 000  pnga2area Q3 UI 153 GOES-12_IMG 10.7um 4km 
20070618 1945
Jun 18 20:37:02 notifyme[3340] INFO: 7c9fbd2c400a661dc37fa285c272198f  1948395 
20070618195926.820 UNIWISC 000  pnga2area Q3 UD 1223 GOES-12_IMG 3.9um 4km 
20070618 1945
Jun 18 20:37:02 notifyme[3340] INFO: c31fcf9ea957199a30bcb32c98b05824  2709981 
20070618200031.186 UNIWISC 000  pnga2area Q3 UV 143 GOES-12_IMG 0.65um 4km 
20070618 1945

The product headers for this sequence are:

pnga2area Q3 UB 173 GOES-11_IMG 6.8um 8km 20070618 1930
pnga2area Q3 U9 123 GOES-11_IMG 0.65um 4km 20070618 1930
pnga2area Q3 U5 133 GOES-11_IMG 10.7um 4km 20070618 1930
pnga2area Q3 U7 1243 GOES-11_IMG 3.9um 4km 20070618 1930
pnga2area Q3 U8 1253 GOES-11_IMG 12.0um 4km 20070618 1930
pnga2area Q0 CA 1100 GOES-11_SND UNKBAND 1km 20070618 1900
pnga2area Q0 CB 1110 GOES-11_SND UNKBAND 1km 20070618 1800
pnga2area Q0 CE 1140 GOES-11_SND UNKBAND 1km 20070618 1800
pnga2area Q3 UE 1233 GOES-12_IMG 13.3um 4km 20070618 1945
pnga2area Q3 UW 213 GOES-12_IMG 6.5um 4km 20070618 1945
pnga2area Q3 UI 153 GOES-12_IMG 10.7um 4km 20070618 1945
pnga2area Q3 UD 1223 GOES-12_IMG 3.9um 4km 20070618 1945
pnga2area Q3 UV 143 GOES-12_IMG 0.65um 4km 20070618 1945

> I used a Unix machine to create and
> attach pqact.conf and pqact.conf.txt for you to look at.

The files you attached are not correctly formatted for use in a
pqact.conf action.  Here are the things that are wrong:

- the whitespace that MUST be tab stops are spaces

- the regular expressions you have specified in the UNIWISC actions
  will not match image products in the UNIWISC datastreams:

UNIWISC ^GOES-11_IMG
        FILE -close -overwrite data_test/GOES_11/IR/4KM/GOES_11_4km.gini
UNIWISC ^GOES-12_IMG
        FILE -close -overwrite data_test/GOES_12/IR/4KM/GOES_12_4km.gini

  Your regular expressions look for product headers that begins with
  GOES-11_IMG and GOES-12_IMG, respectively.  The PNG-compressed AREA format
  image products in the UNIWISC datafeed begin with 'pnga2area':

pnga2area Q3 UB 173 GOES-11_IMG 6.8um 8km 20070618 1930
pnga2area Q3 U9 123 GOES-11_IMG 0.65um 4km 20070618 1930
pnga2area Q3 U5 133 GOES-11_IMG 10.7um 4km 20070618 1930
pnga2area Q3 U7 1243 GOES-11_IMG 3.9um 4km 20070618 1930
pnga2area Q3 U8 1253 GOES-11_IMG 12.0um 4km 20070618 1930
pnga2area Q0 CA 1100 GOES-11_SND UNKBAND 1km 20070618 1900
pnga2area Q0 CB 1110 GOES-11_SND UNKBAND 1km 20070618 1800
pnga2area Q0 CE 1140 GOES-11_SND UNKBAND 1km 20070618 1800
pnga2area Q3 UE 1233 GOES-12_IMG 13.3um 4km 20070618 1945
pnga2area Q3 UW 213 GOES-12_IMG 6.5um 4km 20070618 1945
pnga2area Q3 UI 153 GOES-12_IMG 10.7um 4km 20070618 1945
pnga2area Q3 UD 1223 GOES-12_IMG 3.9um 4km 20070618 1945
pnga2area Q3 UV 143 GOES-12_IMG 0.65um 4km 20070618 1945

  A valid regular expression that would match GOES-11 products would
  look like:

UNIWISC<tab>^pnga2area .. .. .* (GOES-11)_... (.*) (.*km) (........) (....)
<tab>FILE<tab>-close<tab>-overwrite data_test/\1/\2/\3_\4_\5.pnga

- the regular expression you have for the FNEXRAD feed:

FNEXRAD ^radar_mosaic_national
        FILE -close -overwrite data_test/mosaic/national/FNEXRAD_1.grib

  looks like it would be OK to select the national composite in GRIB format
  _IF_ the whitespace was tabs where needed:

FNEXRAD<tab>^radar_mosaic_national
<tab>FILE<tab>-close<tab>-overwrite data/test/mosaic/national/FNEXRAD_1.grib

> The files that are being generated in my ~ldm directory
> doesn't seem to update new files for FNEXRAD, UNIWISC
> GOES-11, & UNIWISC GOES-12. Any insights why that's
> happening?

The action you have for the FNEXRAD radar_mosaic_national products explicitly
says to overwrite the existing product as each new one is received.  If
you pqact.conf file actually has tabs were I indicate above, you should
see one file in the ~ldm/data/test/mosaic/national directory.

Question: are you seeing any products get filed?

> Going back to the mosaic national radar, I used 'notifyme'
> to look up the product id(s) and I wasn't sure what this
> line meant. Any insights?
> 
> !grib/unidata/UPC_1/#255/200706152133/FOO/NoR/sfc!

This is a portion of a header for the NoR product in GRIB format.
I was under the impression that you wanted images, not grids.

> Thanks for your time. I greatly appreciate it as always.

No worries.

I have attached a pqact.conf file with actions that you can try
to use in your installation (in replacement of the ones you currently
have).  Please try them out and see if this gets you going.

Cheers,

Tom
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: TQR-815973
Department: Support IDD
Priority: Normal
Status: Closed

Attachment: pqact.conf
Description: Binary data