Re: 20050711:IDD Model Feeds via Unidata

Hi John,

Just a quick question....do you desire to decode any of these products or
is grib (grib2..whatever is native) the desired format for your model
initialization?

Jeff
---------------------------------------------------------------------
Jeff Weber                                    address@hidden        :
Unidata Program Center                        PH:303-497-8676        :
University Corp for Atmospheric Research      3300 Mitchell Ln       :
http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
---------------------------------------------------------------------

On Tue, 12 Jul 2005, John Cangialosi wrote:

> Hi Jeff,
>
> First, I'd like to say thank you very much for helping us out.
>
> I am very new with LDM and do not know much about details, but I can tell
> you how grib data is coming in our system.
>
> 1. Through LDM
> In the pqact.conf file we are getting grib data from RUC, NGM, ECMWF, AVN.
>  I believe this grib data is course and not the full fields, is that
> correct?
>
> Here is a subset of what it looks like:
>
> 2005070200_nhmrf.grib    2005070700_prmrf.grib    2005071200_usmrf.grib
> 2005070200_ocean.grib    2005070700_ruc.grib      2005071201_ruc.grib
> 2005070200_prmrf.grib    2005070700_sst-a.grib    2005071202_ruc.grib
> 2005070200_ruc.grib      2005070700_sst-m.grib    2005071203_ruc.grib
> 2005070200_sst-a.grib    2005070700_sst-t.grib    2005071204_ruc.grib
> 2005070200_sst-m.grib    2005070700_usmrf.grib    2005071205_ruc.grib
> 2005070200_sst-t.grib    2005070701_ruc.grib      2005071206_ruc.grib
> 2005070200_usmrf.grib    2005070702_ruc.grib      2005071207_ruc.grib
> 2005070201_ruc.grib      2005070703_ruc.grib      2005071208_ruc.grib
> 2005070202_ruc.grib      2005070704_ruc.grib      2005071209_ruc.grib
> 2005070203_ruc.grib      2005070705_ruc.grib      2005071210_ruc.grib
> 2005070204_ruc.grib      2005070706_ruc.grib      2005071211_ruc.grib
> 2005070205_ruc.grib      2005070707_ruc.grib      2005071212_ngm-h.grib
> 2005070206_ruc.grib      2005070708_ruc.grib      2005071212_ngm-i.grib
> 2005070207_ruc.grib      2005070709_ruc.grib      2005071212_ngm-n.grib
> 2005070208_ruc.grib      2005070710_ruc.grib      2005071212_ngm-q.grib
> 2005070209_ruc.grib      2005070711_ruc.grib      2005071212_ruc.grib
> 2005070210_ruc.grib      2005070712_ecmwf_H.grib  2005071213_ruc.grib
>
> 2. FTP
> In the datatruck.conf file we are linking to ftp sites (right now only the
> NCEP site is working) to read in the full field grib data.
>
> Here is what this file looks like:
>
> # Set my defaults
> # remote user:                ftp remote user login name
> # remote password:    ftp remote login password
> # rmaxdays:           number of past days to mirror images. undefined means 
> all
> # mail_to:            email address to mail log events to
> # mail_err:           email address to mail problems to
> package=defaults
> #     rmaxdays=1
>       remote_user=anonymous
>       remote_password=address@hidden
> #     mail_to=address@hidden
>       mail_err=address@hidden
>
>       # DO NOT TOUCH ANY OF THE FOLLOWING ENTRIES
>       # Keep a log file in each updated directory
>       # Don't overwrite my datatruck log with the remote one.
>       # Don't pull back any of their datatruck temporary files.
>       # Don't touch anything whose name begins with a space!
>       exclude_patt=^\.\w|^#.*#|^lost+found/|(^|/)\
>
>       # Don't delete own mirror log
>       delete_excl=\.LOCK$|.mirror$|.mirror.old$
>       site=ftpprd.ncep.noaa.gov
>
> package=avn1
>       get_patt=gfs\........./gfs.t..z\.*
>       local_dir=/home/disk/wx/data/oso/gfs
>       remote_dir=/pub/data/nccf/com/gfs/prod
>
> package=avn2
>       get_patt=gfs\........./gdas.t..z\.pgrbf...
>       local_dir=/home/disk/wx/data/oso/gfs
>       remote_dir=/pub/data/nccf/com/gfs/prod
>
> package=eta104
>       get_patt=nam\........./nam.t..z\.grbgrd..\.tm00
>       local_dir=/home/disk/wx/data/oso/nam
>       remote_dir=/pub/data/nccf/com/nam/prod
>
> package=eta221
>       get_patt=nam\........./nam.t..z\.awip....\.tm00
>       local_dir=/home/disk/wx/data/oso/nam
>       remote_dir=/pub/data/nccf/com/nam/prod
>
> package=fnl
>       get_patt=sst\........./sst2dvar_grb_0.5
>       local_dir=/home/disk/wx/data/oso/fnl
>       remote_dir=/pub/data/nccf/com/gfs/prod
>
>
> What we would like to have is the full model grib fields (AVN, GFDL,
> NOGAPS, CMC) to run a regional model.  Is this attainable through LDM? or
> do we need to setup the datatruck.conf file to get them ftp'd in.
>
> Thanks so much for your help,
>
> John Cangialosi
>
>
>
>
> > Hi Shuyi,
> >
> > Yes, I have been told (have not investigated myself) that the grids
> > available via ftp differ from the grids we deliver via the IDD..I have
> > been told that the ftp site has more grids...
> >
> > Yes, it sure is easier to work it through the ldm..:)
> >
> > I will check, and make available a list of the differences.
> >
> > I look forward to hearing back from John and working through this issue.
> >
> >
> > Cheers,
> >
> > Jeff
> > ---------------------------------------------------------------------
> > Jeff Weber                                    address@hidden        :
> > Unidata Program Center                        PH:303-497-8676        :
> > University Corp for Atmospheric Research      3300 Mitchell Ln       :
> > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
> > ---------------------------------------------------------------------
> >
> > On Mon, 11 Jul 2005, Shuyi Chen wrote:
> >
> >> Hi Jeff,
> >>
> >> Thanks for the info on CONDUIT feed.  Yes, dusky.rsmas.miami.edu
> >> is one of my systems.
> >>
> >> We have been given separate ftp sites for NOGAPS (FNMOC) and
> >> CMC (http://dd.weatheroffice.ec.gc.ca/grib/public/hires). However,
> >> I'd prefer the data flow through ldm if the correct grib data can
> >> be worked out since it's easier to automat the process than going
> >> to different ftp sites.
> >>
> >> John Cangialosi (I CC John on this) in my group has been working on
> >> the ldm feed and he will be able to tell you some of the details
> >> on the problems he had.  I appreciate your help.
> >>
> >> Thanks,
> >> Shuyi
> >>
> >> Shuyi S. Chen, Associate Professor
> >> RSMAS/University of Miami
> >> address@hidden
> >>
> >>
> >>
> >>
> >>
> >> > Hello Shuyi,
> >> >
> >> > Yes, we can help you ingest either or all of these models other
> >> > than the GFDL.
> >> >
> >> > Keep in mind that the output from the CMC (that we distribute) is
> >> > a regional version of the GEM output with an emphasis on the
> >> > northern portion of the hemisphere, also the grids from FNMOC
> >> > (NOGAPS model) is also a deprecated output with some fields
> >> > missing in some time frames.
> >> >
> >> > I suspect you will wish to bring in the hi-res CONDUIT feed of the
> >> > GFS.
> >> >
> >> > Please see:
> >> >
> >> > http://my.unidata.ucar.edu/content/data/conduit/ldm_idd/index.html
> >> >
> >> > This is the preferred choice for model initialization, as it has
> >> > higher resolution and fairly complete grids :)
> >> >
> >> > Please let me know if you would still like to "experiment" with
> >> > the FNMOC and CMC feeds and I will initiate the contact between
> >> > you and the
> >> > modeling centers.
> >> >
> >> >
> >> > I see that:
> >> >
> >> >                            dusky.rsmas.miami.edu [6.0.14]
> >> >                            sapodilla.rsmas.miami.edu [6.0.14]
> >> >
> >> > are currently running the LDM..is one of these yours?
> >> >
> >> > How do you want to process the data...?
> >> >
> >> > Simply file for use in native format, or decode to another format
> >> > for use?
> >> >
> >> > Let us know specifically what your desires are and we will walk
> >> > you through it..:)
> >> >
> >> >
> >> > Cheers,
> >> >
> >> > ps: I will be on vacation soon, so it is best to direct all
> >> > questions to:
> >> >
> >> > address@hidden
> >> >
> >> > as they will get answered even in my absence.
> >> >
> >> > Jeff
> >> > ---------------------------------------------------------------------
> >> > Jeff Weber                                    address@hidden
> >> >   : Unidata Program Center                        PH:303-497-8676
> >> >       : University Corp for Atmospheric Research      3300
> >> > Mitchell Ln       : http://www.unidata.ucar.edu/staff/jweber
> >> > Boulder,Co 80307-3000  :
> >> > ---------------------------------------------------------------------
> >> >
> >> > On Mon, 11 Jul 2005, Unidata Support wrote:
> >> >
> >> >>
> >> >> At 09:42 AM 7/11/2005, Shuyi Chen wrote:
> >> >> >Dear Mohan,
> >> >> >
> >> >> >It was nice seeing you in Boulder last week.
> >> >> >As I mentioned that we are trying to set up some high-res model
> >> >> forecasts for a NSF supported hurricane field program - RAINEX
> >> >> >(Hurricane Rainband and Intensity Change Experiment) starting
> >> >> >August at RSMAS/University of Miami.  We'd like to get some
> >> >> >operational global and regional model forecast fields as the
> >> >> >initial/lateral boundary conditions,
> >> >> >including GFS, GFDL, NOGAPS, and CMC (Canadian model), etc.
> >> >> >
> >> >> >However, we have some difficulties of getting the full model
> >> >> >fields through ldm, partly because we don't understand the
> >> >> >system well enough to tell where exactly the grib data from
> >> >> >each models are and how to set up ldm to do this on our system.
> >> >> So far we can only get GFS.
> >> >> >
> >> >> >Would you please let me know me if someone at UNIDATA could
> >> >> help us with this?
> >> >> >
> >> >> >Thanks,
> >> >> >Shuyi
> >> >>
> >> >>
> >> >> --
> >> >> ****************************************************************************
> >> >> < Unidata User Support                                    UCAR
> >> >> Unidata Program < (303)497-8643
> >> >>                 P.O. Box 3000 < address@hidden
> >> >> ----------------------------------------------------------------------------
> >> >> < Unidata WWW Service
> >> >> ----------------------------------------------------------------------------
> >> >> < NOTE: All email exchanges with Unidata User Support are
> >> >> recorded in the Unidata inquiry tracking system and then made
> >> >> publicly available through the web.  If you do not want to have
> >> >> your interactions made available in this way, you must let us
> >> >> know in each email you send to us.
> >> >>
> >> >> ------- End of Forwarded Message
> >>
> >>
> >>
> >
>
>
> --
>
>