Re: 20050711:IDD Model Feeds via Unidata

Hi John,

I will initiate the process for obtaining allows from FNMOC and the CMC.

I will keep you posted and "in the loop"..

Cheers,

Jeff
---------------------------------------------------------------------
Jeff Weber                                    address@hidden        :
Unidata Program Center                        PH:303-497-8676        :
University Corp for Atmospheric Research      3300 Mitchell Ln       :
http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
---------------------------------------------------------------------

On Wed, 13 Jul 2005, John Cangialosi wrote:

>
> Hi Jeff,
>
> Thanks for all of the feedback, it is very helpful.
>
> I would very much appreciate it if you could set up the IDD feed for CMC
> and NOGAPS.  I would be happy to try it on this data to see if the model
> can handle it.
>
> Thanks again,
>
> John
>
> > Hi John,
> >
> > Comments in text...
> >
> > ---------------------------------------------------------------------
> >
> > On Tue, 12 Jul 2005, John Cangialosi wrote:
> >
> >> Hi Jeff,
> >>
> >> First, I'd like to say thank you very much for helping us out.
> >>
> >> I am very new with LDM and do not know much about details, but I can
> >> tell
> >> you how grib data is coming in our system.
> >>
> >> 1. Through LDM
> >> In the pqact.conf file we are getting grib data from RUC, NGM, ECMWF,
> >> AVN.
> >>  I believe this grib data is course and not the full fields, is that
> >> correct?
> >
> > Yes, the resolution is less fine in the standard HDS/HRS feed in the LDM
> > via the IDD:..but the fields are "full" in the context that it contains
> > all the NOAAPORT data (that which is deemed operationally valuable by the
> > NWSFO's)
> >
> > http://my.unidata.ucar.edu/content/software/ldm/ldm-6.0.14/basics/feedtypes/index.html
> >
> > and
> >
> > http://my.unidata.ucar.edu/content/software/ldm/ldm-6.0.14/basics/feedtypes/hds.html
> >
> >>
> >> Here is a subset of what it looks like:
> >>
> >> 2005070200_nhmrf.grib    2005070700_prmrf.grib    2005071200_usmrf.grib
> >> 2005070200_ocean.grib    2005070700_ruc.grib      2005071201_ruc.grib
> >> 2005070200_prmrf.grib    2005070700_sst-a.grib    2005071202_ruc.grib
> >> 2005070200_ruc.grib      2005070700_sst-m.grib    2005071203_ruc.grib
> >> 2005070200_sst-a.grib    2005070700_sst-t.grib    2005071204_ruc.grib
> >> 2005070200_sst-m.grib    2005070700_usmrf.grib    2005071205_ruc.grib
> >> 2005070200_sst-t.grib    2005070701_ruc.grib      2005071206_ruc.grib
> >> 2005070200_usmrf.grib    2005070702_ruc.grib      2005071207_ruc.grib
> >> 2005070201_ruc.grib      2005070703_ruc.grib      2005071208_ruc.grib
> >> 2005070202_ruc.grib      2005070704_ruc.grib      2005071209_ruc.grib
> >> 2005070203_ruc.grib      2005070705_ruc.grib      2005071210_ruc.grib
> >> 2005070204_ruc.grib      2005070706_ruc.grib      2005071211_ruc.grib
> >> 2005070205_ruc.grib      2005070707_ruc.grib      2005071212_ngm-h.grib
> >> 2005070206_ruc.grib      2005070708_ruc.grib      2005071212_ngm-i.grib
> >> 2005070207_ruc.grib      2005070709_ruc.grib      2005071212_ngm-n.grib
> >> 2005070208_ruc.grib      2005070710_ruc.grib      2005071212_ngm-q.grib
> >> 2005070209_ruc.grib      2005070711_ruc.grib      2005071212_ruc.grib
> >> 2005070210_ruc.grib      2005070712_ecmwf_H.grib  2005071213_ruc.grib
> >>
> >> 2. FTP
> >> In the datatruck.conf file we are linking to ftp sites (right now only
> >> the
> >> NCEP site is working) to read in the full field grib data.
> >>
> >> Here is what this file looks like:
> >>
> >> # Set my defaults
> >> # remote user:             ftp remote user login name
> >> # remote password: ftp remote login password
> >> # rmaxdays:                number of past days to mirror images. undefined 
> >> means all
> >> # mail_to:         email address to mail log events to
> >> # mail_err:                email address to mail problems to
> >> package=defaults
> >> #  rmaxdays=1
> >>    remote_user=anonymous
> >>    remote_password=address@hidden
> >> #  mail_to=address@hidden
> >>    mail_err=address@hidden
> >>
> >>    # DO NOT TOUCH ANY OF THE FOLLOWING ENTRIES
> >>    # Keep a log file in each updated directory
> >>    # Don't overwrite my datatruck log with the remote one.
> >>    # Don't pull back any of their datatruck temporary files.
> >>    # Don't touch anything whose name begins with a space!
> >>    exclude_patt=^\.\w|^#.*#|^lost+found/|(^|/)\
> >>
> >>    # Don't delete own mirror log
> >>    delete_excl=\.LOCK$|.mirror$|.mirror.old$
> >>    site=ftpprd.ncep.noaa.gov
> >>
> >> package=avn1
> >>    get_patt=gfs\........./gfs.t..z\.*
> >>    local_dir=/home/disk/wx/data/oso/gfs
> >>    remote_dir=/pub/data/nccf/com/gfs/prod
> >>
> >> package=avn2
> >>    get_patt=gfs\........./gdas.t..z\.pgrbf...
> >>    local_dir=/home/disk/wx/data/oso/gfs
> >>    remote_dir=/pub/data/nccf/com/gfs/prod
> >>
> >> package=eta104
> >>    get_patt=nam\........./nam.t..z\.grbgrd..\.tm00
> >>    local_dir=/home/disk/wx/data/oso/nam
> >>    remote_dir=/pub/data/nccf/com/nam/prod
> >>
> >> package=eta221
> >>    get_patt=nam\........./nam.t..z\.awip....\.tm00
> >>    local_dir=/home/disk/wx/data/oso/nam
> >>    remote_dir=/pub/data/nccf/com/nam/prod
> >>
> >> package=fnl
> >>    get_patt=sst\........./sst2dvar_grb_0.5
> >>    local_dir=/home/disk/wx/data/oso/fnl
> >>    remote_dir=/pub/data/nccf/com/gfs/prod
> >>
> >>
> >> What we would like to have is the full model grib fields (AVN, GFDL,
> >> NOGAPS, CMC) to run a regional model.  Is this attainable through LDM?
> >> or
> >> do we need to setup the datatruck.conf file to get them ftp'd in.
> >
> >
> > OK, here is the sticky wicket...both CMC and FNMOC offer a broader product
> > via ftp than they do via the LDM/IDD..so I suspect you would be happier
> > hitting their ftp servers rather than getting it via the IDD....I am more
> > than happy to set up the feed anyway so you can see if the data via the
> > LDM/IDD suits your needs (let me know if you want to do that)..I believe
> > that you will find that the resolution and products available via the
> > CONDUIT feed are what you will desire.
> >
> > The GFS, NAM, and RUC are available in the CONDUIT feed
> >
> > Please see:
> >
> > http://my.unidata.ucar.edu/content/data/conduit/ldm_idd/index.html
> >
> > for more info re the CONDUIT feed.
> >
> > I have an "allow" in place for you for the CONDUIT feed on:
> >
> > idd.unidata.ucar.edu
> >
> >
> > Please let me and/or support know how we can help you further.
> >
> >
> > Cheers,
> >
> > Jeff Weber
> >
> >
> >>
> >> Thanks so much for your help,
> >>
> >> John Cangialosi
> >>
> >>
> >>
> >>
> >> > Hi Shuyi,
> >> >
> >> > Yes, I have been told (have not investigated myself) that the grids
> >> > available via ftp differ from the grids we deliver via the IDD..I have
> >> > been told that the ftp site has more grids...
> >> >
> >> > Yes, it sure is easier to work it through the ldm..:)
> >> >
> >> > I will check, and make available a list of the differences.
> >> >
> >> > I look forward to hearing back from John and working through this
> >> issue.
> >> >
> >> >
> >> > Cheers,
> >> >
> >> > Jeff
> >> > ---------------------------------------------------------------------
> >> > Jeff Weber                                    address@hidden        :
> >> > Unidata Program Center                        PH:303-497-8676        :
> >> > University Corp for Atmospheric Research      3300 Mitchell Ln       :
> >> > http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
> >> > ---------------------------------------------------------------------
> >> >
> >> > On Mon, 11 Jul 2005, Shuyi Chen wrote:
> >> >
> >> >> Hi Jeff,
> >> >>
> >> >> Thanks for the info on CONDUIT feed.  Yes, dusky.rsmas.miami.edu
> >> >> is one of my systems.
> >> >>
> >> >> We have been given separate ftp sites for NOGAPS (FNMOC) and
> >> >> CMC (http://dd.weatheroffice.ec.gc.ca/grib/public/hires). However,
> >> >> I'd prefer the data flow through ldm if the correct grib data can
> >> >> be worked out since it's easier to automat the process than going
> >> >> to different ftp sites.
> >> >>
> >> >> John Cangialosi (I CC John on this) in my group has been working on
> >> >> the ldm feed and he will be able to tell you some of the details
> >> >> on the problems he had.  I appreciate your help.
> >> >>
> >> >> Thanks,
> >> >> Shuyi
> >> >>
> >> >> Shuyi S. Chen, Associate Professor
> >> >> RSMAS/University of Miami
> >> >> address@hidden
> >> >>
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> > Hello Shuyi,
> >> >> >
> >> >> > Yes, we can help you ingest either or all of these models other
> >> >> > than the GFDL.
> >> >> >
> >> >> > Keep in mind that the output from the CMC (that we distribute) is
> >> >> > a regional version of the GEM output with an emphasis on the
> >> >> > northern portion of the hemisphere, also the grids from FNMOC
> >> >> > (NOGAPS model) is also a deprecated output with some fields
> >> >> > missing in some time frames.
> >> >> >
> >> >> > I suspect you will wish to bring in the hi-res CONDUIT feed of the
> >> >> > GFS.
> >> >> >
> >> >> > Please see:
> >> >> >
> >> >> > http://my.unidata.ucar.edu/content/data/conduit/ldm_idd/index.html
> >> >> >
> >> >> > This is the preferred choice for model initialization, as it has
> >> >> > higher resolution and fairly complete grids :)
> >> >> >
> >> >> > Please let me know if you would still like to "experiment" with
> >> >> > the FNMOC and CMC feeds and I will initiate the contact between
> >> >> > you and the
> >> >> > modeling centers.
> >> >> >
> >> >> >
> >> >> > I see that:
> >> >> >
> >> >> >                            dusky.rsmas.miami.edu [6.0.14]
> >> >> >                            sapodilla.rsmas.miami.edu [6.0.14]
> >> >> >
> >> >> > are currently running the LDM..is one of these yours?
> >> >> >
> >> >> > How do you want to process the data...?
> >> >> >
> >> >> > Simply file for use in native format, or decode to another format
> >> >> > for use?
> >> >> >
> >> >> > Let us know specifically what your desires are and we will walk
> >> >> > you through it..:)
> >> >> >
> >> >> >
> >> >> > Cheers,
> >> >> >
> >> >> > ps: I will be on vacation soon, so it is best to direct all
> >> >> > questions to:
> >> >> >
> >> >> > address@hidden
> >> >> >
> >> >> > as they will get answered even in my absence.
> >> >> >
> >> >> > Jeff
> >> >> > ---------------------------------------------------------------------
> >> >> > Jeff Weber                                    address@hidden
> >> >> >   : Unidata Program Center                        PH:303-497-8676
> >> >> >       : University Corp for Atmospheric Research      3300
> >> >> > Mitchell Ln       : http://www.unidata.ucar.edu/staff/jweber
> >> >> > Boulder,Co 80307-3000  :
> >> >> > ---------------------------------------------------------------------
> >> >> >
> >> >> > On Mon, 11 Jul 2005, Unidata Support wrote:
> >> >> >
> >> >> >>
> >> >> >> At 09:42 AM 7/11/2005, Shuyi Chen wrote:
> >> >> >> >Dear Mohan,
> >> >> >> >
> >> >> >> >It was nice seeing you in Boulder last week.
> >> >> >> >As I mentioned that we are trying to set up some high-res model
> >> >> >> forecasts for a NSF supported hurricane field program - RAINEX
> >> >> >> >(Hurricane Rainband and Intensity Change Experiment) starting
> >> >> >> >August at RSMAS/University of Miami.  We'd like to get some
> >> >> >> >operational global and regional model forecast fields as the
> >> >> >> >initial/lateral boundary conditions,
> >> >> >> >including GFS, GFDL, NOGAPS, and CMC (Canadian model), etc.
> >> >> >> >
> >> >> >> >However, we have some difficulties of getting the full model
> >> >> >> >fields through ldm, partly because we don't understand the
> >> >> >> >system well enough to tell where exactly the grib data from
> >> >> >> >each models are and how to set up ldm to do this on our system.
> >> >> >> So far we can only get GFS.
> >> >> >> >
> >> >> >> >Would you please let me know me if someone at UNIDATA could
> >> >> >> help us with this?
> >> >> >> >
> >> >> >> >Thanks,
> >> >> >> >Shuyi
> >> >> >>
> >> >> >>
> >> >> >> --
> >> >> >> ****************************************************************************
> >> >> >> < Unidata User Support                                    UCAR
> >> >> >> Unidata Program < (303)497-8643
> >> >> >>                 P.O. Box 3000 < address@hidden
> >> >> >> ----------------------------------------------------------------------------
> >> >> >> < Unidata WWW Service
> >> >> >> ----------------------------------------------------------------------------
> >> >> >> < NOTE: All email exchanges with Unidata User Support are
> >> >> >> recorded in the Unidata inquiry tracking system and then made
> >> >> >> publicly available through the web.  If you do not want to have
> >> >> >> your interactions made available in this way, you must let us
> >> >> >> know in each email you send to us.
> >> >> >>
> >> >> >> ------- End of Forwarded Message
> >> >>
> >> >>
> >> >>
> >> >
> >>
> >>
> >> --
> >>
> >>
> >
>
>
> --
>
>