Re: Conduit AVN data feed

On Tue, 11 May 1999, William Smith wrote:

> Steve,
> 
> 
> 
> > In your ~ldm/etc/ldmd.conf file, you should create request entry:
> > request                NMC2    ".*" flip.unidata.ucar.edu
> 
> This generated more traffic than I realized would occur.  Data
> started pouring in like crazy.  Sometimes there were 4000+
> products in the queue.  I discovered I could see what was there
> with the pqcat routine.  There didn't seem to be any problem
> with overflow so the pqexpire must have been working ok.
> 
> I saw lots of records for ETA and RUC2, but nothing for AVN.  
> It probably wasn't time, it was about 22:00 GMT.
> 
> 
> 
> > if you want  just the AVN grid #003 data set, then use the line:
> > request     NMC2    "gblav" flip.unidata.ucar.edu
> 
> I stopped ldm, commented out the ".*" request, and activated the above
> line the restarted ldm.  It hung up and I found this error in the log file:
> 
> May 10 22:20:19 5Q:mahi rpc.ldmd[36693]: Starting Up (built: Nov  5 1998 
> 15:17:15)
> May 10 22:20:19 3Q:mahi rpc.ldmd[36693]: /u/ldm/etc/ldmd.conf: line 23: 
> Syntax error
> 
> Line 23 is the "gblav" line.  I changed it to "^.*gblav.*" and restarted
> ldm.  Of course I don't know what I'm doing, but at least ldm started.
> As far as I can tell I didn't get any AVN data in.  If you want I can
> send you part of the log where there are RECLASS and skip message from
> flip and Recycled messages from pqexpire.  At the end of the queue it
> now says:
> 
> May 11 18:19:04 pqcat: Number of products 0
> 
> Where it had 3496 products when I stopped ldm with the ".*" request.
> 
> 
> 
> QUESTIONS:
> 
> 1.  What do I need to specify to get the AVN data?

request     NMC2    "avn/avn.(......)/gblav.T(..)Z" flip.unidata.ucar.edu

This request will only ask for avn data, nothing else.
> 
> 2.  Should I use a FILE command to move the product to a file?  

In pqact.conf

NMC2    avn/avn.(......)/gblav.T(..)Z
        FILE    data/GRIB/\1\2.avn

This will create files  like 99051212.avn   Remember the white spaces are
tabs.
> 
> 3.  Will the AVN be formated like the ETA products with one product for
>     each level and variable?

I believe so, here's a copy of the avn header.

May 12 15:52:18 pqutil:   105968 19990512154741.217    NMC2 269
/u/ftp/gateway/ncepb/avn/avn.990512/gblav.T12Z.PGrbF06
!grib/ncep/SPEC_126_AVN/#003/199905121200/F006/HPBL/sfc! 000269  

> 
> 4.  Should I activate the dostats program in a crontab?

Yes, this is very important for Unidata funding.

35 * * * * bin/ldmadmin dostats



> 
> 5.  If I use the FILE should I also use the scour in a crontab to clean
>     out the file area?
> 
Yep, otherwise your disk will become full.  The etc/scour.conf file is
self documenting and the crontab is also easy to set up

Robb...

> 
> Sorry for all the questions.  I know this is "old hat" for you, but
> it's really new for me.  I've been reading the LDM5 Site Managers
> Guide and the on-line workshop to figure out how to do this.  Your
> email has been a big help.  Thanks.
> 
> 
> 
> 
> 
> William
> 
> _____________________________________________________________________________
> William Smith                             address@hidden
> Maui High Performance Computing Center    (808) 879-5077  
> 550 Lipoa Parkway                         (808) 879-5018 (fax)
> Kihei, HI  96753                          WWW: http://www.mhpcc.edu
> _____________________________________________________________________________
> 

===============================================================================
Robb Kambic                                Unidata Program Center
Software Engineer III                      Univ. Corp for Atmospheric Research
address@hidden             WWW: http://www.unidata.ucar.edu/
===============================================================================