[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: NOAAPORT feed vs DDS/PPS
- Subject: Re: NOAAPORT feed vs DDS/PPS
- Date: Fri, 7 Apr 2000 15:42:50 -0600
Greg,
What you have below wont work. The [] set is for the single position
character, so you can't say [SD].
An example to exclude the grids, SD..5x and SD..97 products could look like:
FSL5 "^([^GHIOSYZ]|S[^D]|SD..[^5]|SD..[^9]|SD..9[^7])"
You can also have multiple request lines to the same host, so you don't have to
worry about trying to squeeze it into a single request.
Steve Chiswell
On Fri, 7 Apr 2000, Gregory Grosshans wrote:
> Is there a simple way to exclude SDUS5x, or does it have to be done brute
> force in the
> request
> line:
> Would the following work?
>
> (^[A-FK-NP-RT-X]|^[SA-SC]|^[SD-SZ])
>
> Thanks,
> Gregg
>
> Steve Chiswell wrote:
>
> > Gregg,
> >
> > Yes, the GINI products all begin with T, and grib products with
> > H, Y, Z and now O for the new windwave gribs. The ECMWF grid (not grib)
> > ascii products begin with G. So, you pattern below does filter out most
> > of the gribs...but not the ^O..... KWBJ and GINI if they are in your FSL5.
> >
> > Some of the big data sets on NWSTG are the SDUS5x NIDS products. You might
> > start
> > there to reduce some data flow.
> >
> > Steve Chiswell
> > Unidata User Support
> >
> > On Fri, 7 Apr 2000, Gregory Grosshans wrote:
> >
> > > Until yesterday I didn't realize how much data flows in from NOAAPORT. I
> > > knew it was
> > > in the MB/hour but not GB/day range.
> > > At the SPC a HP K server ingests the NOAAPORT NWSTG and GOES-WEST
> > > channels into LDM. A
> > > few days ago the 24 hour total for NOAAPORT data (FSL5) was 325216
> > > products and 5.685
> > > GB.
> > >
> > > Another machine feeds from the above LDM with the following request line:
> > > request FSL5 (^[A-FK-X]) data.spc.noaa.gov
> > > resulting in FSL5 receiving 252001 products and 4.676 GB per day
> > >
> > > And a third machine ingesting the feed
> > > # SFC/UA data and AVN MOS
> > > request FSL5 (^U[EGHKLPQSZ]|^FE|^S[AP])
> > > data.spc.noaa.gov
> > > resulting in FSL5 receiving 44536 products and 14 MB per day
> > >
> > > I believe the GINI (satellite data) WMO headers begin with ^T. With the
> > > request line
> > > A-FK-X, does this include grib data?
> > > Right now I'm interested in reducing the volume of data to something
> > > similar in size to
> > > DDS/PPS.
> > >
> > > Thanks in advance.
> > >
> > > Gregg
> > >
> > >
>