[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: 20040901: problems with NEXRAD files
- Subject: Re: 20040901: problems with NEXRAD files
- Date: Thu, 9 Sep 2004 10:37:44 -0600 (MDT)
Hi John,
Oh, you actually want to ~view the data :)
I was considering two options:
1) Install GEMPAK
nice viz tool, can view sat, radar, model, text, upa, etc..
..and we support the package and its decoders.
2) We can script some processing of the nat'l mosaic to create geo-tiffs.
ths would require installing the netCDF libraries, and access to a
geo-tiff visualizer..
We may want to do both, as the geo-tiff would be greatly appreciated by
the GIS folks, yet we have not solved the geo-tiff issue for all the
feeds.
Larry is still having issues with his LDM so we will keep you feeding from
atm.geo.nsf.gov for now.
What radars do you desire at this time and I will get you a proper request
line...and maybe a pqact.conf entry if we decide to go with one of the
above mentioned options. Keep in mind the geo-tiff generation currently is
working on the mosaic and model output only...
Jeff
---------------------------------------------------------------------
Jeff Weber address@hidden :
Unidata Program Center PH:303-497-8676 :
University Corp for Atmospheric Research 3300 Mitchell Ln :
http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000 :
---------------------------------------------------------------------
On Tue, 7 Sep 2004, John Helly wrote:
> That seems to be working. What can I use to view these data? Also, I
> want to receive products for just the radars near San Diego to get some
> experience with that sort of thing. Can you advise me on what to get
> and process? I have the radar IDs.
> Thanks. I know this is a vague request.
>
> J.
>
>
> On Sep 7, 2004, at 9:25 AM, Jeff Weber wrote:
>
> Hi John,
>
> aeolus appears to still be down....
>
> Please change your request for FNEXRAD to:
>
> atm.geo.nsf.gov
>
> and then:
>
> ldmadmin start && ldmadmin stop
>
> to initiate the changes.
>
> I do not know how long aeolus may be down, so this is an option to begin
> ingesting data now.
>
> Just comment out the request to aeolus for now and add the one to atm,
> do
> the stop/start commands..and you ~should begin ingesting and filing the
> 1km mosaic ;)
>
> Cheers,
>
> Jeff
> ---------------------------------------------------------------------
> Jeff Weber address@hidden :
> Unidata Program Center PH:303-497-8676 :
> University Corp for Atmospheric Research 3300 Mitchell Ln :
> http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000 :
> ---------------------------------------------------------------------
>
> On Tue, 7 Sep 2004, Jeff Weber wrote:
>
> > Hi John,
> >
> > Please change your request, or add a new one to ingest:
> >
> > FNEXRAD from aeolus as well..
> >
> > The 1km mosaic is in the FNEXRAD feed and not the NNEXRAD feed..sorry I
> > did not catch that the first time around ;)
> >
> > aeolus went down over the weekend so that may be a factor as well.
> >
> > Let me know how things are going after this change..
> >
> > Cheers,
> >
> > Jeff
> > ---------------------------------------------------------------------
> > Jeff Weber address@hidden :
> > Unidata Program Center PH:303-497-8676 :
> > University Corp for Atmospheric Research 3300 Mitchell Ln :
> > http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000 :
> > ---------------------------------------------------------------------
> >
> > On Fri, 3 Sep 2004, John Helly wrote:
> >
> >> Jeff Weber wrote:
> >>
> >>> Hi John,
> >>>
> >>> The 1km National mosaic "seems" to be a desirable product,
> >>> especially for
> >>> the hydrological folks...
> >>>
> >>> I suspect you have a correct request line in your ldmd.conf to get
> >>> the
> >>> data..if not it would look something like:
> >>>
> >>> request NNEXRAD ".*" [hostname]..are you feeding from
> >>> aeolus.ucsd.edu?
> >>>
> >>> if so then:
> >>>
> >>> request NNEXRAD ".*" aeolus.ucsd.edu
> >>>
> >>> Now to get the data onto your system and out of your queue (buffer)..
> >>>
> >>> In ~ldm/etc you will edit your pqact.conf file to include the
> >>> following:
> >>>
> >>> # png compressed NEXRAD Level III radar products in PNG compressed
> >>> GINI format
> >>> FNEXRAD ^rad/NEXRCOMP/(...)/(...)_(........)_(....)
> >>> FILE -close data/pub/raw/gini/RADAR/\1/\2/\2_\3_\4
> >>>
> >>> or whatever path to you choose up to: \1/
> >>>
> >>>
> >>>
> >>> Please keep in mind that no "spaces" are allowed in pqact.conf only
> >>> "tabs"..
> >>>
> >>> Obviously, you can choose a unique path that you may prefer rather
> >>> than:
> >>>
> >>> data/pub/raw/gini/RADAR/
> >>>
> >>> (That's just where we like it for access to our applications)
> >>>
> >>>
> >>> ....but keep the:
> >>>
> >>> \1/\2/\2_\3_\4
> >>>
> >>> for proper file naming and storage...
> >>>
> >>>
> >>> As the commented out section indicates, this data is in GINI format:
> >>>
> >>> Please see:
> >>>
> >>> http://weather.unisys.com/wxp/Appendices/Formats/GINI.html
> >>>
> >>> Let me know how this goes...
> >>>
> >>> We may want to load the netCDF libraries and write a script that can
> >>> generate these into geo-tiffs on the fly..just a thought.
> >>>
> >>> Cheers,
> >>>
> >>> Jeff
> >>> ---------------------------------------------------------------------
> >>> Jeff Weber address@hidden
> >>> :
> >>> Unidata Program Center PH:303-497-8676
> >>> :
> >>> University Corp for Atmospheric Research 3300 Mitchell Ln
> >>> :
> >>> http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000
> >>> :
> >>> ---------------------------------------------------------------------
> >>>
> >>> On Wed, 1 Sep 2004, John Helly wrote:
> >>>
> >>>
> >>>
> >>>> Hi Jeff.
> >>>>
> >>>> Right now we are experimenting with what we can get from the
> >>>> system. I
> >>>> have gotten different opinions from various people about what data
> >>>> we
> >>>> should be retrieving. Right now, I don't have any preference but
> >>>> welcome advice. My main concern, first, is to figure out how to
> >>>> store
> >>>> data from the buffer into the file system.
> >>>>
> >>>> J.
> >>>>
> >>>> On Sep 1, 2004, at 12:01 PM, Jeff Weber wrote:
> >>>>
> >>>> Hi John,
> >>>>
> >>>> I understand we are having issues ingesting/processing/filing
> >>>> NNEXRAD
> >>>> data..
> >>>>
> >>>> Can you help me by defining what you want to do, and if in fact
> >>>> this is
> >>>> level III or level II data..
> >>>>
> >>>>
> >>>> By "what you want to do" I mean:
> >>>>
> >>>> Simply file
> >>>>
> >>>> File and decode (GEMPAK I presume)
> >>>>
> >>>> Relay only
> >>>>
> >>>>
> >>>> I can dial you in once we determine your desires ;)
> >>>>
> >>>>
> >>>> Cheers,
> >>>>
> >>>>
> >>>> Jeff
> >>>> --------------------------------------------------------------------
> >>>> -
> >>>> Jeff Weber address@hidden
> >>>> :
> >>>> Unidata Program Center PH:303-497-8676
> >>>> :
> >>>> University Corp for Atmospheric Research 3300 Mitchell Ln
> >>>> :
> >>>> http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000
> >>>> :
> >>>> --------------------------------------------------------------------
> >>>> -
> >>>>
> >>>> On Tue, 31 Aug 2004, Ben Domenico wrote:
> >>>>
> >>>>
> >>>>
> >>>>> Hi Jeff,
> >>>>>
> >>>>> I'm attaching two notes from John Helly about problems getting
> >>>>> NEXRAD
> >>>>> files
> >>>>> out of the LDM stream. Please follow up on this? This is part of
> >>>>> John's
> >>>>> is work on real-time portions of the data systems for CUAHSI.
> >>>>>
> >>>>> -- Ben
> >>>>>
> >>>>>
> >>>> Cheers.
> >>>> --------------
> >>>> John Helly, University of California, San Diego
> >>>> San Diego Supercomputer Center 9500 Gilman Dr. Mail Code 0527, La
> >>>> Jolla
> >>>> CA 92093-0505
> >>>> Phone: Voice +01 760 840 8660 mobile / 760 943 0382 / 858 534 5060
> >>>> http://www.sdsc.edu/~hellyj
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>>
> >> Thanks, Jeff.
> >> I've done this and the ldm is running again but I don't see anything
> >> in
> >> the directory yet. How often does this product appear?
> >>
> >> J.
> >>
> >
>
>
> Cheers.
> --------------
> John Helly, University of California, San Diego
> San Diego Supercomputer Center 9500 Gilman Dr. Mail Code 0527, La Jolla
> CA 92093-0505
> Phone: Voice +01 760 840 8660 mobile / 760 943 0382 / 858 534 5060
> http://www.sdsc.edu/~hellyj
>