Re: Recommendations for Receiving Radar Data

Robert Leche wrote:
> 
> Anne,
> I reenabled the radar products. The nids_inflate.pl script is not working for
> me . When invoked, the script hangs. It hangs with an argument or no argument.
> It hangs at the " read (STDIN, $input, 1000000);" statement. has any one else
> had problems with this?
> 
> 
> nids_inflate.pl  script:
> #!/usr/bin/perl
> #
> # Based on example code available from
> # http://www.perldoc.com/cpan/Compress/Zlib.html
> #DEFLATE
> #
> # Modified for Unidata IDD-NIDS use by
> #   Pete Pokrandt, University of Wisconsin, Nov 2000.
> #   address@hidden
> #
> use Compress::Zlib ;
> $input = '' ;
> print STDOUT "made it to 1\n";
> binmode STDIN;
> binmode STDOUT;
> binmode OUTFILE;
> 
> print STDOUT "made it to 2\n";
> 
> # Read in the whole file, 1 Mb should cover it. It'll end w/o error
> # when it hits the end of stdin
> 
> read (STDIN, $input, 1000000);
> 
> print STDOUT "made it to 3\n";
> 
> 
> 
> I moved the radar data into /data3/radar_temp as I experimented with Pete
> Pokrandt's script and pqact.conf settings.
> 
> Pete Pokrandt's  pqact.conf settings from web page
> http://mapmaker.meteor.wisc.edu/~poker/nids.html:
> HRS     ^SDUS53 K(ARX) (..)(....) /p(...).*
>         PIPE
>         -close /usr/local/ldm/util/nids_inflate.pl
> /usr/local/ldm/data/nids/\1/(\2:yy)(\2:mm)\2\3.\1.\4
> 
> This  was my attempt at integrating Pete's configuratioon into my system:
> #HRS    (......) (....) (.*)
> #       PIPE
> #       -close  ~ldm/local/nids_inflate.pl
> /data1/radar/\1/(\2:yy)(\2:mm)\2\3.\1.\4
> 
> The following error where reported in the .logs Broken pipes?
> 
> Dec 19 17:01:43 nafhat rpc.ldmd[4129]: Starting Up (built: Dec 14 2000
> 13:42:51)
> Dec 19 17:01:43 nafhat pqbinstats[4130]: Starting Up (4129)
> Dec 19 17:01:43 nafhat mapmaker[4133]: run_requester: Starting Up:
> mapmaker.meteor.wisc.edu
> Dec 19 17:01:43 nafhat datoo[4132]: run_requester: Starting Up:
> datoo.srcc.lsu.edu
> Dec 19 17:01:43 nafhat datoo[4132]: run_requester: 20001219165458.398 TS_ENDT
> {{WMO,  ".*"},{DIFAX,  ".*"}}
> Dec 19 17:01:43 nafhat pqact[4131]: Starting Up
> Dec 19 17:01:43 nafhat datoo[4132]: FEEDME(datoo.srcc.lsu.edu): OK
> Dec 19 17:01:43 nafhat mapmaker[4133]: run_requester: 20001219165124.353
> TS_ENDT {{DIFAX,  ".*"}}
> Dec 19 17:01:43 nafhat pqact[4131]: pbuf_flush (4) write: Broken pipe
> Dec 19 17:01:43 nafhat pqact[4131]: pipe_dbufput:
> -close~ldm/local/nids_inflate.pl/data1/radar/ZHQW30/(KWBC:yy)(KWBC:mm)KWBC191200/mAVN.ZHQW30.
> write error
> Dec 19 17:01:43 nafhat pqact[4131]: pipe_prodput: trying again
> Dec 19 17:01:43 nafhat pqact[4131]: pbuf_flush (4) write: Broken pipe
> Dec 19 17:01:43 nafhat pqact[4131]: pipe_dbufput:
> -close~ldm/local/nids_inflate.pl/data1/radar/ZHQW30/(KWBC:yy)(KWBC:mm)KWBC191200/mAVN.ZHQW30.
> write error
> Dec 19 17:01:43 nafhat pqact[4131]: child 4136 exited with status 127
> Dec 19 17:01:43 nafhat pqact[4131]: child 4134 exited with status 127
> Dec 19 17:01:43 nafhat pqact[4131]: pbuf_flush (5) write: Broken pipe
> Dec 19 17:01:43 nafhat pqact[4131]: child 4138 exited with status 127
> Dec 19 17:01:43 nafhat pqact[4131]: pbuf_flush (6) write: Broken pipe
> Dec 19 17:01:43 nafhat pqact[4131]: pipe_dbufput:
> -close~ldm/local/nids_inflate.pl/data1/radar/ZHQW25/(KWBC:yy)(KW
> 
> Removing Petes config I am now receiving the following errors:
> ec 19 17:32:01 nafhat pqact[7496]: unio_open: /pRCMLCH: Permission denied
> Dec 19 17:32:02 nafhat pqact[7496]: unio_open: /pRCMACG: Permission denied
> Dec 19 17:32:02 nafhat pqact[7496]: unio_open: /pRCMSHV: Permission denied
> Dec 19 17:32:02 nafhat pqact[7496]: unio_open: /pRCMPOE: Permission denied
> Dec 19 17:32:03 nafhat pqact[7496]: unio_open: /pRCMAHG: Permission denied
> .
> .
> .
> .

Hi Bob,

I'm sorry for the delay in responding.  It's been very busy here.

I don't know anything about Pete's script.  I do recall from a discussion on
ldm-users that other people had used it successfully.  You can search our
archive of the messages from that list to see what people said.  See
http://www.unidata.ucar.edu/glimpsedocs/ghldm-users.html.

One point - until January 1 only the radar data from one site, KARX, is
unencrypted and compressed.  All other products are encrypted and uncompressed. 
That's why Pete's pqact.conf entry uses a pattern that only matches KARX.  I'd
expect that feed the other products into nids_inflate.pl would cause it to
choke, although I don't know why it would hang on the read per se.  Try feeding
only the radars from KARX to nids_inflate.

Hope this helps!

Anne
-- 
***************************************************
Anne Wilson                     UCAR Unidata Program            
address@hidden                 P.O. Box 3000
                                  Boulder, CO  80307
----------------------------------------------------
Unidata WWW server       http://www.unidata.ucar.edu/
****************************************************