[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: quickie before the weekend

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: Re: quickie before the weekend
  • Date: Fri, 10 Jun 2011 16:30:54 -0600
On 6/10/2011 3:08 PM, Rich Signell wrote:

Quickie before the weekend!

How would I convert this to featureCollection FMRC?

Files in subdirs look like this:
rsignell@gam:~$ ls -lR /usgs/data0/rsignell/models/rtofs
/usgs/data0/rsignell/models/rtofs:
total 0
drwxrwxr-x 2 rsignell usgs 108 2011-06-10 17:05 ofs.20091122
drwxrwxr-x 2 rsignell usgs  74 2011-06-10 17:06 ofs.20091123

/usgs/data0/rsignell/models/rtofs/ofs.20091122:
total 599900
-rw-rw-r-- 1 rsignell usgs 204516013 2009-11-23 00:49
ofs_atl.t00z.F024.grb.grib2
-rw-rw-r-- 1 rsignell usgs 204624673 2009-11-23 00:56
ofs_atl.t00z.F048.grb.grib2
-rw-rw-r-- 1 rsignell usgs 205152212 2009-11-23 00:41
ofs_atl.t00z.N000.grb.grib2

/usgs/data0/rsignell/models/rtofs/ofs.20091123:
total 399712
-rw-rw-r-- 1 rsignell usgs 204466798 2009-11-24 01:09
ofs_atl.t00z.F024.grb.grib2
-rw-rw-r-- 1 rsignell usgs 204834585 2009-11-24 01:01
ofs_atl.t00z.N000.grb.grib2


and my old FMRC looks like this:
   <datasetFmrc name="RTOFS Forecast Model Run Collection" path="fmrc/rtofs">
       <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
          <aggregation dimName="runtime"
type="forecastModelRunSingleCollection" timeUnitsChange="true"
recheckEvery="10min">
             <scanFmrc location="/usgs/data0/rsignell/models/rtofs"
regExp=".*ofs_atl.*\.grib2$"
              runDateMatcher="#ofs.#yyyyMMdd"
forecastOffsetMatcher="HHH#.grb.grib2#" subdirs="true"
              olderThan="10 min"/>




In 4.2, FMRC wont work because the runtime is not in the filename

In 4.3 you can say:
<featureCollection name="RTOFS Forecast Model Run Collection" path="fmrc/rtofs" featureType="GRIB">
<collection spec="/usgs/data0/rsignell/models/rtofs/**/.*grib2$" name="RTOFS" dateFormatMark="#rtofs/ofs.#yyyyMMdd"recheckAfter="10 min" olderThan="10 min"/> 

<update startup="true" rescan="0 0/5 * * * ? *" trigger="allow"/>
<protoDataset choice="Penultimate" change="0 2 3 * * ? *"/>

</featureCollection>
(I would need to double check that - i cant write these things of the top of my head either)
this doesnt give an FMRC, just a "best" dataset and the component files. I may eventually deprecate FMRC. 

 It should be much faster. still in pre-alpha, only can be used on grib2.