[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: NOAAPORT feed vs DDS/PPS



On Fri, 7 Apr 2000, Gregory Grosshans wrote:

> Is there a simple way to exclude SDUS5x, or does it have to be done brute 
> force in the
> request
> line:
> Would the following work?
> 
> (^[A-FK-NP-RT-X]|^[SA-SC]|^[SD-SZ])

Gregg,

Here's the RE that we use:

"^[^S]|^S[^D]|^SD..[^59]|^SD..9[^7]"


Robb...
> 
> Thanks,
> Gregg
> 
> Steve Chiswell wrote:
> 
> > Gregg,
> >
> > Yes, the GINI products all begin with T, and grib products with
> > H, Y, Z and now O for the new windwave gribs. The ECMWF grid (not grib)
> > ascii products begin with G. So, you pattern below does filter out most
> > of the gribs...but not the ^O..... KWBJ and GINI if they are in your FSL5.
> >
> > Some of the big data sets on NWSTG are the SDUS5x NIDS products. You might 
> > start
> > there to reduce some data flow.
> >
> > Steve Chiswell
> > Unidata User Support
> >
> > On Fri, 7 Apr 2000, Gregory Grosshans wrote:
> >
> > > Until yesterday I didn't realize how much data flows in from NOAAPORT.  I 
> > > knew it was
> > > in the MB/hour but not GB/day range.
> > > At the SPC a HP K server ingests the NOAAPORT NWSTG and GOES-WEST 
> > > channels into LDM.  A
> > > few days ago the 24 hour total for NOAAPORT data (FSL5) was 325216 
> > > products and 5.685
> > > GB.
> > >
> > > Another machine feeds from the above LDM with  the following request line:
> > >         request FSL5   (^[A-FK-X])     data.spc.noaa.gov
> > > resulting in FSL5 receiving 252001 products and 4.676 GB per day
> > >
> > > And a third machine ingesting the feed
> > >         # SFC/UA data and AVN MOS
> > >         request FSL5    (^U[EGHKLPQSZ]|^FE|^S[AP])              
> > > data.spc.noaa.gov
> > > resulting in FSL5 receiving 44536 products and 14 MB per day
> > >
> > > I believe the GINI (satellite data) WMO headers begin with ^T.  With the 
> > > request line
> > > A-FK-X, does this include grib data?
> > > Right now I'm interested in reducing the volume of data to something 
> > > similar in size to
> > > DDS/PPS.
> > >
> > > Thanks in advance.
> > >
> > > Gregg
> > >
> > >
> 

===============================================================================
Robb Kambic                                Unidata Program Center
Software Engineer III                      Univ. Corp for Atmospheric Research
address@hidden             WWW: http://www.unidata.ucar.edu/
===============================================================================