[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: TDS Fmrc aggregation problem

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: Re: TDS Fmrc aggregation problem
  • Date: Thu, 30 Nov 2006 15:00:51 -0700
Hi Steven:

You have to use the <datasetFmrc> element, but then there is a bug in the 
MetdaaDataextraot. Its been fixed in the latest release 3.14.rc5. try it and let me 
know if it works. Thanks!

Steven.Anthony wrote:

Hey,
I installed the TDS version 3.14.rc2 and I'm having trouble getting these FMRC datasets to work. Ive started off with a simple set of gfs_3 data (one day, in grib1 format) in hopes of minimizing complications. 



from catalog.xml:
<dataset name="gfs3 test" ID="gfs3/test" urlPath="gfs3/test" dataType="Grid" serviceName="dods-http"> 
<netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
<aggregation dimName="run" type="forecastModelRunSingleCollection" timeUnitsChange="true" > <scanFmrc location="/nomads3_data/raid2/noaaport/merged/gfs-hi/200611/20061129" 
        regExp=".*\.grb$"
        runDateMatcher="#gfs_3_#yyyyMMdd_HH"
        forecastOffsetMatcher="HHH#.grb#"/>
    </aggregation>
</netcdf>
</dataset>
This works in that I can get to the opendap browser, however, when I try to ascii dump a variable that uses the "run" dimension, I get an error: 

Error {
    code = 0;
    message = "Connection cannot be read 
http://nomads-d.ncdc.noaa.gov:8081/thredds/dodsC/gfs3/test.dods?latLonCoordSys,Temperature[0:1:3][0:1:60][0:1:25][0:1:180][0:1:359]
 The descriptor object returned from the dataset was null
Check that the URL is correct.";
};


However, if I encapsulate the NCML in <datasetFmrc> tags instead, it fails to 
generate html output.
When I check the log file (threddsServlet.log) it ends with a exception.

2006-11-30T09:53:06.240 -0500 [    783735][      26] INFO  - thredds.servlet.ServletUtil 
- Remote host: 192.153.129.158 - Request: "GET 
/thredds/catalog/gfs3/testFmrc/catalog.html HTTP/1.1"
2006-11-30T09:53:06.252 -0500 [    783747][      26] ERROR - 
thredds.catalog.InvDatasetFmrc - Error making catalog for gfs3/testFmrc
java.lang.NullPointerException
        at 
ucar.nc2.thredds.MetadataExtractor.extractVariables(MetadataExtractor.java:181)
        at thredds.catalog.InvDatasetFmrc.makeCatalog(InvDatasetFmrc.java:273)
        at thredds.catalog.InvDatasetFmrc.makeCatalog(InvDatasetFmrc.java:141)
        at 
thredds.servlet.DataRootHandler.makeDynamicCatalog(DataRootHandler.java:1107)
        at thredds.servlet.DataRootHandler.getCatalog(DataRootHandler.java:1075)
        at 
thredds.servlet.DataRootHandler.processReqForCatalog(DataRootHandler.java:991)
        at thredds.servlet.CatalogServlet.doGet(CatalogServlet.java:78)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
        at 
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
        at 
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
        at 
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
        at 
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
        at 
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:432)
        at 
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
        at 
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
        at 
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
        at 
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
        at 
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
        at 
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
        at 
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
        at 
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
        at 
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
        at java.lang.Thread.run(Thread.java:595)
2006-11-30T09:53:06.267 -0500 [    783762][      26] INFO  - 
thredds.servlet.ServletUtil - Request Completed - 404 - 0 - 27
It looks as if there is a problem reading the variables (I think the same way that the opendap server fails to read variables with the new dimension.) 
Let me know If I can provide any more information.

Thanks,
 - Steven Anthony




--
Steven Anthony
Computer Systems Analyst
NOMADS Project
STG Inc. Federal Contractor
Veach-Baley Federal Building
151 Patton Avenue
Asheville, NC 28801-5001
Phone: 828.271.4474

http://nomads.ncdc.noaa.gov