[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: 20050509:UH IDD Connect
- Subject: Re: 20050509:UH IDD Connect
- Date: Wed, 18 May 2005 16:45:52 -0600 (MDT)
Hi Jay,
Not sure if you just want to file or if you want to decode as well...?
here are some examples of file actions for the CONDUIT feed:
CONDUIT ^/afs/.nwstg.nws.noaa.gov/ftp/(.*DF.gr1/.*)
!(.*)/(.*)/(.*)/(#.*)/(.*)/(.*)/(.*)/(.*)!
FILE -close data/pub/raw/conduit/\1/\2_\3_\4_\5_\6_\7_\8_\9
and
CONDUIT ^/afs/.nwstg.nws.noaa.gov/ftp/(.*DF.gr2/.*)
!(.*)/(.*)/(.*)/(#.*)/(.*)/(.*)/(.*)/(.*)!
FILE data/pub/raw/conduit/\1
For UNIWISC feed:
Here is some header info:
# Unidata-Wisconsin PNG compressed Products
#
# Header Format:
# \1 \2 \3 \4 \5 \6 \7
# Qx pd anum SAT BAND RES CCYYMMDD HHMM
# pnga2area Q0 CF 0015 GOES-10_SND UNKBAND 1km 20000525 2000
#
# McIDAS Product Codes and System Key Table entries used for Menu System
#-------+--------+------------------------------------+---------------------
# Code Type Description SYSKEY.TAB words
used
#-------+--------+------------------------------------+---------------------
# CA AREA CIMSS Cloud Top Pressure 2173 2174 2175
# CB AREA CIMSS Precipitable Water 2176 2177 2178
# CC AREA CIMSS Sea Surface Temperature 2179 2180 2181
# CD AREA CIMSS Lifted Index 2182 2183 2184
# CE AREA CIMSS CAPE 2185 2186 2187
# CF AREA CIMSS Ozone 2188 2189 2190
# CI AREA GOES-8/9 Infrared Composite 2161 2162 2163
# CV AREA GOES-8/9 Visible Composite 2164 2165 2166
# CW AREA GOES-8/9 Water Vapor Composite 2167 2168 2169
# N1 AREA GOES-8 IR/Topography Composite 2125 2126 2127
# N2 AREA GOES-8 VIS/Topography Composite 2128 2129 2130
# N3 AREA GOES-9 IR/Topography Composite 2131 2132 2133
# N4 AREA GOES-9 VIS/Topography Composite 2134 2135 2136
# N5 AREA MDR/Topography Composite 2137 2138 2139
# N6 AREA Mollweide/Topography Composite 2140 2141 2142
# N7 AREA GOES-8/9 IR/Topography Composite 2155 2156 2157
# N8 AREA GOES-8/9 VIS/Topography Composite 2158 2159 2160
# UA AREA Educational floater I 2101 2102 2103
# UB AREA GOES-9 Western US Water Vapor 2104 2105 2106
# UC AREA Educational floater II 2170 2171 2172
# UI AREA GOES-8 North America Infrared 2143 2144 2145
# UR AREA Research floater 2107 2108 2109
# UV AREA GOES-8 North America Visible 2146 2147 2148
# UW AREA GOES-8 North America Water Vapor 2149 2150 2151
# UX AREA Global Mollweide Infrared Composite 2122 2123 2124
# UY AREA Global Mollweide Water Vapor Composite 2152 2153 2154
# U1 AREA Antarctic composite 2119 2120 2121
# U3 AREA Manually Digitized Radar 2110 2111 2112
# U5 AREA GOES-9 Western US Infrared 2113 2114 2115
# U9 AREA GOES-9 Western US Visible 2116 2117 2118
--
...and a sample pqact.conf entry:
# RTIMAGES GW-12
MCIDAS ^pnga2area Q. (U8) (.*) (.*) (.*) (.*) (........) (....)
PIPE -close
util/pnga2area -vl /usr/local/ldm/logs/ldm-mcidas.log
-d /data/ldm/pub/decoded/mcidas/RTIMAGES/GW-12 -r \1,\2
Note, UNIWISC and MCIDAS are the same feed, this command "pipes" the data
to a decoder to generate "AREA" files, you may wish to not "act" on the
file so you could use the "FILE" command instead of the pipe, and thereby
obviating the need for:
util/pnga2area -vl /usr/local/ldm/logs/ldm-mcidas.log
Let us know if you want to decode or file only and we can be more
specific.
Cheers,
Jeff
---------------------------------------------------------------------
Jeff Weber address@hidden :
Unidata Program Center PH:303-497-8676 :
University Corp for Atmospheric Research 3300 Mitchell Ln :
http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000 :
---------------------------------------------------------------------
On Wed, 18 May 2005, Jay Krishnan wrote:
> Hi Jeff:
>
> Thanks for you help, I was able to successfully setup LDM on one of the
> two systems (namely usa-aqm.geosc.uh.edu). Now the product queue is
> active, however could you please let me know how I can get the data from
> the product queue into files on disk, the data we are getting from
> bigbird.tamu.edu are
>
> UNIWISC and
> CONDUIT
>
> I changed my pqact.conf to show
>
> NMC2 ^_ELSE_$ FILE Conduit
> UNIWISC ^_ELSE_$ FILE Uniwisc
>
> But I don't get any data, I am having some trouble understanding the ERE,
> is there any example for the Conduit and Uniwisc data types ?
>
> Ideally we would like to dump the data on disk and then have a clean up of
> 7 days (I will look in scour.conf to determine how to do this onnce I can
> get the data to disk)
>
> thanks for any help you can provide
> -Jay
>
> =============================================
> Jay Krishnan PH #: 713.743.1697
> IT Manager Fax #: 713.748.7906
> Geosciences University of Houston
> =============================================
>
> On Wed, 11 May 2005, Jeff Weber wrote:
>
> > Hi all,
> >
> > I suspect you are referencing the hi-resolution model output...that ftp
> > path sure looks like CONDUIT grids...they are the preferred output for MM5
> > initialization.
> >
> > That would be feedtype 12 (NMC2, NCEPH, or CONDUIT work as name aliases)
> >
> > HDS is the standard output from NCEP (GFS|AVN, NAM|ETA, RUC, NGM, RUC2,
> > etc...)
> >
> > ..but again I suspect you desire the hi-res CONDUIT data.
> >
> > Yes, UNIWISC is the satellite imagery feed.
> >
> >
> > An allow ~should be in place for your machines:
> >
> > 1. texas-aqm.geosc.uh.edu
> > 2. usa-aqm.geosc.uh.edu
> >
> > on
> >
> > bigbird.tamu.edu
> >
> >
> > for UNIWISC and CONDUIT feeds.
> >
> > If you have questions regarding configuring your request to only get the
> > "eta" output, please send them to:
> >
> > address@hidden (with CONDUIT) in subject line.
> >
> >
> > I am on travel and my responses from my personal account may be slow, but
> > support always has eyes on the inbox...
> >
> >
> > Cheers,
> >
> > Jeff
> > ---------------------------------------------------------------------
> > Jeff Weber address@hidden :
> > Unidata Program Center PH:303-497-8676 :
> > University Corp for Atmospheric Research 3300 Mitchell Ln :
> > http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000 :
> > ---------------------------------------------------------------------
> >
> > On Wed, 11 May 2005, Chang-Keun Song wrote:
> >
> > > Dear Jeff Weber:
> > >
> > > After I got the mail from you and Jay, I have reviewed the site,
> > > http://my.unidata.ucar.edu/content/software/ldm/ldm-current/basics/feedtypes/index.html
> > >
> > > However I cannot understand the meaning of the content of their table
> > > exactly.
> > > Is the primary name of 'HDS' related with ETA forecasting output ?
> > > Actually what data we want to ingest are 'NCEP ETA model outputs' as
> > > inputs
> > > of MM5 simulations.
> > > Those outputs could be found in WEB as following.
> > > [For example of yesterday,]
> > > the address is
> > > ftp://tgftp.nws.noaa.gov/SL.us008001/ST.opnl/MT.fnl_CY.18/RD.20050510/PT.grid_DF.gr1/
> > > and the files are named as
> > > "fh.00HH_tl.press_gr.awip3d" [where HH:00,03,......,81,84].
> > >
> > > Also we want to get the realtime satellite image whose primary name might
> > > be
> > > 'UNIWISC', I guess.
> > >
> > > I so appreciate if you would handle LDM access with above informations.
> > >
> > > Thank you in advance.
> > >
> > > Sincerely,
> > >
> > > Chang-Keun Song
> > > ----------------------------------------------------------------------------------------
> > > Chang-Keun Song, Ph.D, address@hidden
> > > Postdoctoral Fellow, IMAQS (Institute for Multidimensional Air Quality
> > > Studies)
> > > 223 Old Science Building, Dept. of Geosciences, University of Houston
> > > Houston, Texas 77204-5007
> > > Phone) 713-743-0742, Fax) 713-748-7906
> > >
> > > ----- Original Message -----
> > > From: "Jay Krishnan" <address@hidden>
> > > To: <address@hidden>; <address@hidden>
> > > Sent: Monday, May 09, 2005 4:56 PM
> > > Subject: Re: 20050509:UH IDD Connect
> > >
> > >
> > > > Dr. Song, Meongdo:
> > > >
> > > > Please review jeff's email below and let me know the data that we should
> > > > request access for
> > > >
> > > > thanks
> > > > -Jay
> > > >
> > > > =============================================
> > > > Jay Krishnan PH #: 713.743.1697
> > > > IT Manager Fax #: 713.748.7906
> > > > Geosciences University of Houston
> > > > =============================================
> > > >
> > > > On Mon, 9 May 2005, Jeff Weber wrote:
> > > >
> > > >> Hi Jay,
> > > >>
> > > >> Do you know what data you wish to ingest?
> > > >>
> > > >> Please see:
> > > >>
> > > >> http://my.unidata.ucar.edu/content/software/ldm/ldm-current/basics/feedtypes/index.html
> > > >>
> > > >> I suspect we will be feeding you from Texas A & M, but let's see what
> > > >> data
> > > >> you desire first..
> > > >>
> > > >> Cheers and welcome aboard!
> > > >>
> > > >> Jeff
> > > >> ---------------------------------------------------------------------
> > > >> Jeff Weber address@hidden :
> > > >> Unidata Program Center PH:303-497-8676 :
> > > >> University Corp for Atmospheric Research 3300 Mitchell Ln :
> > > >> http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000 :
> > > >> ---------------------------------------------------------------------
> > > >>
> > > >> On Fri, 6 May 2005, Unidata Support wrote:
> > > >>
> > > >> >
> > > >> > ------- Forwarded Message
> > > >> >
> > > >> > >To: address@hidden
> > > >> > >cc: address@hidden,
> > > >> > >cc: address@hidden,
> > > >> > >cc: address@hidden
> > > >> > >From: Jay Krishnan <address@hidden>
> > > >> > >Organization: UCAR/Unidata
> > > >> > >Keywords: 200505061804.j46I4cP3005966
> > > >> >
> > > >> > Hi:
> > > >> >
> > > >> > I am writing to request LDM access for the following systems,
> > > >> >
> > > >> > 1. texas-aqm.geosc.uh.edu
> > > >> > 2. usa-aqm.geosc.uh.edu
> > > >> >
> > > >> > we are at the IMAQS (http://imaqs.uh.edu) Geosciences Department,
> > > >> > University of Houston. Could you please help us with what is required
> > > >> > from
> > > >> > our end to make the feed possible.
> > > >> >
> > > >> > thank you
> > > >> > -Jay
> > > >> >
> > > >> > =============================================
> > > >> > Jay Krishnan PH #: 713.743.1697
> > > >> > IT Manager Fax #: 713.748.7906
> > > >> > Geosciences University of Houston
> > > >> > =============================================
> > > >> >
> > > >> > --
> > > >> > ****************************************************************************
> > > >> > Unidata User Support UCAR Unidata
> > > >> > (303)497-8643 P.O.
> > > >> > Box
> > > >> > address@hidden Boulder, CO
> > > >> > ----------------------------------------------------------------------------
> > > >> > Unidata WWW Service
> > > >> > ----------------------------------------------------------------------------
> > > >> > NOTE: All email exchanges with Unidata User Support are recorded in
> > > >> > the
> > > >> > Unidata inquiry tracking system and then made publicly available
> > > >> > through the web. If you do not want to have your interactions made
> > > >> > available in this way, you must let us know in each email you send to
> > > >> > us.
> > > >> >
> > > >> > ------- End of Forwarded Message
> > > >> >
> > > >>
> > >
> >
>