[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: FeatureCollection error

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: Re: FeatureCollection error
  • Date: Fri, 22 Apr 2011 09:00:18 -0600
you need to set a default service, eg:

<serviceName>fmrcServices</serviceName>

in


<dataset name="NOMADS GRIB2 data">

<metadata inherited="true">
<serviceName>fmrcServices</serviceName>
<authority>edu.ucar.unidata</authority>
<dataType>GRID</dataType>
<dataFormat>GRIB-2</dataFormat>
<documentation xlink:href="http://www.emc.ncep.noaa.gov/modelinfo/index.html"; 
                     xlink:title="NCEP Model documentation"/>
<documentation type="rights">Freely available</documentation>
<documentation type="processing_level">Transmitted through Unidata Internet Data Distribution.</documentation> <documentation type="processing_level">Read by CDM GRIB Collection.</documentation> <documentation xlink:href="http://www.nco.ncep.noaa.gov/pmb/nwprod/analysis/"; xlink:title="NCEP/NWS Model Analyses and Forecasts Page"/> 

<creator>
<name vocabulary="DIF">DOC/NOAA/NWS/NCEP</name>
<contact url="http://www.ncep.noaa.gov/"; email="http://www.ncep.noaa.gov/mail_liaison.shtml"/> 
</creator>
<publisher>
<name vocabulary="DIF">DOC/NOAA/NWS/NCEP</name>
<contact url="http://www.ncep.noaa.gov/"; email="http://www.ncep.noaa.gov/mail_liaison.shtml"/> 
</publisher>
<timeCoverage>
<end>present</end>
<duration>45 days</duration>
</timeCoverage>
</metadata>
<featureCollection name="CFSR-timeseries" featureType="GRIB" harvest="true" path="NOAA/NOMADS/CFSR/timeseries"> 
<collection spec="F:/data/nomads/cfsr/.*grb2$" name="CFSR-timeseries"/>
</featureCollection>

</dataset>


On 4/13/2011 12:48 PM, Dan Swank wrote:

John,

1)  Your right, the deployment method I was
        using was not removing the old installation.
        I fixed this and am now actually running the 4.2.5
        on dev.

2)   I did not have an old threddsConfig.xml
I attempted it both with and with-out the<FeatureCollection>
directory specified.  Both resulted in an NPE below.
I am going to try it different set of files.

=======================================================================
2011-04-13T14:37:36.073 -0400 [      7360][       9] INFO  -
thredds.server.catalogservice.LocalCatalogServiceController -
handleRequestInternal(): Remote host:<>  - Request: "GET
/thredds/catalog/fmrc/nam-master//catalog.html HTTP/1.1"
2011-04-13T14:37:36.109 -0400 [      7396][       9] ERROR -
thredds.server.catalogservice.LocalCatalogServiceController -
handleRequestInternal(): Problem handling request.
java.lang.NullPointerException
     at
thredds.catalog.InvDatasetFeatureCollection.makeVirtualService(InvDatasetFeatureCollection.java:252)
     at thredds.catalog.InvDatasetFcFmrc.checkState(InvDatasetFcFmrc.java:87)
     at
thredds.catalog.InvDatasetFeatureCollection.getRawFileScan(InvDatasetFeatureCollection.java:233)
     at
thredds.servlet.DataRootHandler.getMatchingScan(DataRootHandler.java:1139)
     at
thredds.servlet.DataRootHandler.getMatchingProxyDataset(DataRootHandler.java:1116)
     at
thredds.servlet.DataRootHandler.isProxyDatasetResolver(DataRootHandler.java:1108)
     at thredds.servlet.DataRootHandler.getCatalog(DataRootHandler.java:1473)
     at
thredds.server.catalogservice.LocalCatalogServiceController.handleRequestInternal(LocalCatalogServiceController.java:196)
     at
org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
     at
org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
     at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:875)
     at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:809)
     at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:571)
     at
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:501)
     at javax.servlet.http.HttpServlet.service(HttpServlet.java:690)
     at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
     at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
     at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
     at
thredds.servlet.filter.CatalogServiceFilter.doFilter(CatalogServiceFilter.java:107)
     at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
     at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
     at
thredds.servlet.filter.RequestQueryFilter.doFilter(RequestQueryFilter.java:121)
     at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
     at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
     at
thredds.servlet.filter.RequestPathFilter.doFilter(RequestPathFilter.java:105)
     at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
     at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
     at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
     at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
     at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:433)
     at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
     at
org.jstripe.tomcat.probe.Tomcat55AgentValve.invoke(Tomcat55AgentValve.java:20)
     at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
     at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:568)
     at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
     at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
     at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
     at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
     at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
     at java.lang.Thread.run(Thread.java:619)




        -Dan



john caron wrote the following on 4/11/2011 6:22 PM:

1) so the latest version should have this inside the war file:

CHANGES for THREDDS Data Server (TDS)
Version 4.2.5
Build Date = 2011-03-02 23:15:18
Build Name = 5

can you make sure thats what you are using?

2) this error message:

[2011-04-11T16:55:50.517-0400] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv
com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
/home/nomads/tomcat-main/content/thredds/cache/collection Home
directory: /home/nomads/tomcat-main/content/thredds/cache/collection
ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
creation is not permitted, but there are no log files in the environment
directory. Environment is invalid and must be closed.
     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
     at
com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
     at com.sleepycat.je.Environment.<init>(Environment.java:212)
     at com.sleepycat.je.Environment.<init>(Environment.java:166)
     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
     at
thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)


implies that theres another process (server) thats running that is using
the same directory:

  <FeatureCollection**>
    <*dir*>/tomcat_home/content/thredds/collectionCache/</*dir*>
  </FeatureCollection



if thats true, it may be because you've copied threddsConfig.xml, which
has that directory in it. We now recommend that you dont use that
element, so that it defaults to the local tomat directory.

see

http://www.unidata.ucar.edu/projects/THREDDS/tech/tds4.2/reference/ThreddsConfigXMLFile.html



On 4/11/2011 3:02 PM, Dan Swank wrote:

I am using the "latest 4.2 release" from the home-site.

I also installed that block of xml from my last email
     into a fresh catalog.xml from the war.
Still no good.
This functionality seems great.. just gotta get it happy with something.
Is there anything outside catalog.xml you need to configure for it?

This is the full contents of featureCollectionScan.log
===========================================================

[2011-04-11T16:55:19.514-0400] INFO
thredds.servlet.DataRootHandler.fcScan: Schedule startup scan for
/raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$
at Mon Apr 11 16:55:49 EDT 2011
[2011-04-11T16:55:19.530-0400] INFO
thredds.servlet.DataRootHandler.fcScan: Schedule recurring scan for
/raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$
cronExpr=0 5 3 * * ? *
[2011-04-11T16:55:49.530-0400] INFO
thredds.servlet.DataRootHandler.fcScan: Trigger scan for NCEP-NAM-Grid-218
[2011-04-11T16:55:50.268-0400] INFO
thredds.inventory.DatasetCollectionManager: NCEP-NAM-Grid-218: initial
scan found n datasets = 1218
[2011-04-11T16:55:50.517-0400] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv
com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
/home/nomads/tomcat-main/content/thredds/cache/collection Home
directory: /home/nomads/tomcat-main/content/thredds/cache/collection
ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
creation is not permitted, but there are no log files in the environment
directory. Environment is invalid and must be closed.
     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
     at
com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
     at com.sleepycat.je.Environment.<init>(Environment.java:212)
     at com.sleepycat.je.Environment.<init>(Environment.java:166)
     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
     at
thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
     at
thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
     at
thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
     at
thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
     at
thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
     at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
[2011-04-11T16:55:50.519-0400] ERROR ucar.nc2.ft.fmrc.Fmrc:
/raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$:
initial fmrcDataset creation failed
java.lang.RuntimeException:
com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
/home/nomads/tomcat-main/content/thredds/cache/collection Home
directory: /home/nomads/tomcat-main/content/thredds/cache/collection
ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
creation is not permitted, but there are no log files in the environment
directory. Environment is invalid and must be closed.



     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:320)
     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
     at
thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
     at
thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
     at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
/home/nomads/tomcat-main/content/thredds/cache/collection Home
directory: /home/nomads/tomcat-main/content/thredds/cache/collection
ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
creation is not permitted, but there are no log files in the environment
directory. Environment is invalid and must be closed.
     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
     at
com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
     at com.sleepycat.je.Environment.<init>(Environment.java:212)
     at com.sleepycat.je.Environment.<init>(Environment.java:166)
     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
     at
thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
     at
thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
     at
thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
     ... 6 more
[2011-04-11T16:55:50.520-0400] ERROR
thredds.servlet.DataRootHandler.fcScan: InitFmrcJob failed
java.lang.RuntimeException: java.lang.RuntimeException:
com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
/home/nomads/tomcat-main/content/thredds/cache/collection Home
directory: /home/nomads/tomcat-main/content/thredds/cache/collection
ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
creation is not permitted, but there are no log files in the environment
directory. Environment is invalid and must be closed.




     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:251)
     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
     at
thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
     at
thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
     at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
Caused by: java.lang.RuntimeException:
com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
/home/nomads/tomcat-main/content/thredds/cache/collection Home
directory: /home/nomads/tomcat-main/content/thredds/cache/collection
ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
creation is not permitted, but there are no log files in the environment
directory. Environment is invalid and must be closed.
     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:320)
     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
     ... 5 more
Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
/home/nomads/tomcat-main/content/thredds/cache/collection Home
directory: /home/nomads/tomcat-main/content/thredds/cache/collection
ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
creation is not permitted, but there are no log files in the environment
directory. Environment is invalid and must be closed.
     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
     at
com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
     at com.sleepycat.je.Environment.<init>(Environment.java:212)
     at com.sleepycat.je.Environment.<init>(Environment.java:166)
     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
     at
thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
     at
thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
     at
thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
     ... 6 more

               73,2-5        Bot






John Caron wrote the following on 4/11/2011 2:17 PM:

i think its a bug that was fixed in the latest release (4.2.5)

On 4/11/2011 11:21 AM, Dan Swank wrote:

I've been tinkering with the new FeatureCollection.
I keep getting this exception:
Any immediate ideas?
The dev server is 4.2.20101116.2051 - 20101116.2051


Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
/home/nomads/tomcat-main/content/thredds/cache/collection Home
directory: /home/nomads/tomcat-main/content/thredds/cache/collection
ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
creation is not permitted, but there are no log files in the environment
directory. Environment is invalid and must be closed.


====================================================================

<featureCollection name="NCEP-NAM-Grid-218" featureType="FMRC"
harvest="true"
      path="fmrc/nam-test/">

    <collection
spec="/raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$"

            recheckAfter="30 min"  olderThan="5 min"/>
    <update startup="true" rescan="0 5 3 * * ? *" />
    <fmrcConfig regularize="true"  datasetTypes="TwoD" />

</featureCollection>