[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: FeatureCollection error

Subject: Re: FeatureCollection error
Date: Wed, 13 Apr 2011 14:48:37 -0400
John,

1)  Your right, the deployment method I was
        using was not removing the old installation.
        I fixed this and am now actually running the 4.2.5
        on dev.

2)   I did not have an old threddsConfig.xml
I attempted it both with and with-out the  <FeatureCollection>
directory specified.  Both resulted in an NPE below.
I am going to try it different set of files.

=======================================================================
2011-04-13T14:37:36.073 -0400 [      7360][       9] INFO  -
thredds.server.catalogservice.LocalCatalogServiceController -
handleRequestInternal(): Remote host: <> - Request: "GET
/thredds/catalog/fmrc/nam-master//catalog.html HTTP/1.1"
2011-04-13T14:37:36.109 -0400 [      7396][       9] ERROR -
thredds.server.catalogservice.LocalCatalogServiceController -
handleRequestInternal(): Problem handling request.
java.lang.NullPointerException
    at
thredds.catalog.InvDatasetFeatureCollection.makeVirtualService(InvDatasetFeatureCollection.java:252)
    at thredds.catalog.InvDatasetFcFmrc.checkState(InvDatasetFcFmrc.java:87)
    at
thredds.catalog.InvDatasetFeatureCollection.getRawFileScan(InvDatasetFeatureCollection.java:233)
    at
thredds.servlet.DataRootHandler.getMatchingScan(DataRootHandler.java:1139)
    at
thredds.servlet.DataRootHandler.getMatchingProxyDataset(DataRootHandler.java:1116)
    at
thredds.servlet.DataRootHandler.isProxyDatasetResolver(DataRootHandler.java:1108)
    at thredds.servlet.DataRootHandler.getCatalog(DataRootHandler.java:1473)
    at
thredds.server.catalogservice.LocalCatalogServiceController.handleRequestInternal(LocalCatalogServiceController.java:196)
    at
org.springframework.web.servlet.mvc.AbstractController.handleRequest(AbstractController.java:153)
    at
org.springframework.web.servlet.mvc.SimpleControllerHandlerAdapter.handle(SimpleControllerHandlerAdapter.java:48)
    at
org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:875)
    at
org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:809)
    at
org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:571)
    at
org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:501)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:690)
    at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
    at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
    at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at
thredds.servlet.filter.CatalogServiceFilter.doFilter(CatalogServiceFilter.java:107)
    at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at
thredds.servlet.filter.RequestQueryFilter.doFilter(RequestQueryFilter.java:121)
    at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at
thredds.servlet.filter.RequestPathFilter.doFilter(RequestPathFilter.java:105)
    at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
    at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
    at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
    at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
    at
org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:433)
    at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128)
    at
org.jstripe.tomcat.probe.Tomcat55AgentValve.invoke(Tomcat55AgentValve.java:20)
    at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
    at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:568)
    at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
    at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:286)
    at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
    at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
    at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:447)
    at java.lang.Thread.run(Thread.java:619)




        -Dan



john caron wrote the following on 4/11/2011 6:22 PM:
> 1) so the latest version should have this inside the war file:
> 
> CHANGES for THREDDS Data Server (TDS)
> Version 4.2.5
> Build Date = 2011-03-02 23:15:18
> Build Name = 5
> 
> can you make sure thats what you are using?
> 
> 2) this error message:
> 
> [2011-04-11T16:55:50.517-0400] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv
> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
> /home/nomads/tomcat-main/content/thredds/cache/collection Home
> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
> creation is not permitted, but there are no log files in the environment
> directory. Environment is invalid and must be closed.
>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
>     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
>     at
> com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
>     at com.sleepycat.je.Environment.<init>(Environment.java:212)
>     at com.sleepycat.je.Environment.<init>(Environment.java:166)
>     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
>     at
> thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
> 
> 
> implies that theres another process (server) thats running that is using
> the same directory:
> 
>  <FeatureCollection**>
>    <*dir*>/tomcat_home/content/thredds/collectionCache/</*dir*>
>  </FeatureCollection
> 
> 
> 
> if thats true, it may be because you've copied threddsConfig.xml, which
> has that directory in it. We now recommend that you dont use that
> element, so that it defaults to the local tomat directory.
> 
> see
> 
> http://www.unidata.ucar.edu/projects/THREDDS/tech/tds4.2/reference/ThreddsConfigXMLFile.html
> 
> 
> 
> On 4/11/2011 3:02 PM, Dan Swank wrote:
>> I am using the "latest 4.2 release" from the home-site.
>>
>> I also installed that block of xml from my last email
>>     into a fresh catalog.xml from the war.
>> Still no good.
>> This functionality seems great.. just gotta get it happy with something.
>> Is there anything outside catalog.xml you need to configure for it?
>>
>> This is the full contents of featureCollectionScan.log
>> ===========================================================
>>
>> [2011-04-11T16:55:19.514-0400] INFO
>> thredds.servlet.DataRootHandler.fcScan: Schedule startup scan for
>> /raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$
>> at Mon Apr 11 16:55:49 EDT 2011
>> [2011-04-11T16:55:19.530-0400] INFO
>> thredds.servlet.DataRootHandler.fcScan: Schedule recurring scan for
>> /raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$
>> cronExpr=0 5 3 * * ? *
>> [2011-04-11T16:55:49.530-0400] INFO
>> thredds.servlet.DataRootHandler.fcScan: Trigger scan for NCEP-NAM-Grid-218
>> [2011-04-11T16:55:50.268-0400] INFO
>> thredds.inventory.DatasetCollectionManager: NCEP-NAM-Grid-218: initial
>> scan found n datasets = 1218
>> [2011-04-11T16:55:50.517-0400] ERROR ucar.nc2.ft.fmrc.Fmrc: makeFmrcInv
>> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
>>     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
>>     at
>> com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:212)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:166)
>>     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
>>     at
>> thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
>>     at
>> thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
>>     at
>> thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
>>     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
>>     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
>>     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
>>     at
>> thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
>>     at
>> thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
>>     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
>>     at
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
>> [2011-04-11T16:55:50.519-0400] ERROR ucar.nc2.ft.fmrc.Fmrc:
>> /raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$:
>> initial fmrcDataset creation failed
>> java.lang.RuntimeException:
>> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>
>>
>>
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:320)
>>     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
>>     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
>>     at
>> thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
>>     at
>> thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
>>     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
>>     at
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
>> Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
>>     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
>>     at
>> com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:212)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:166)
>>     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
>>     at
>> thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
>>     at
>> thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
>>     at
>> thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
>>     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
>>     ... 6 more
>> [2011-04-11T16:55:50.520-0400] ERROR
>> thredds.servlet.DataRootHandler.fcScan: InitFmrcJob failed
>> java.lang.RuntimeException: java.lang.RuntimeException:
>> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>
>>
>>
>>
>>     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:251)
>>     at ucar.nc2.ft.fmrc.Fmrc.triggerRescan(Fmrc.java:168)
>>     at
>> thredds.catalog.InvDatasetFeatureCollection.triggerRescan(InvDatasetFeatureCollection.java:214)
>>     at
>> thredds.servlet.DataRootHandler$ScanFmrcJob.execute(DataRootHandler.java:254)
>>     at org.quartz.core.JobRunShell.run(JobRunShell.java:199)
>>     at
>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:546)
>> Caused by: java.lang.RuntimeException:
>> com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:320)
>>     at ucar.nc2.ft.fmrc.Fmrc.checkNeeded(Fmrc.java:243)
>>     ... 5 more
>> Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>> creation is not permitted, but there are no log files in the environment
>> directory. Environment is invalid and must be closed.
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:437)
>>     at com.sleepycat.je.dbi.EnvironmentImpl.<init>(EnvironmentImpl.java:337)
>>     at com.sleepycat.je.dbi.DbEnvPool.getEnvironment(DbEnvPool.java:182)
>>     at
>> com.sleepycat.je.Environment.makeEnvironmentImpl(Environment.java:230)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:212)
>>     at com.sleepycat.je.Environment.<init>(Environment.java:166)
>>     at thredds.inventory.bdb.MetadataManager.setup(MetadataManager.java:92)
>>     at
>> thredds.inventory.bdb.MetadataManager.<init>(MetadataManager.java:205)
>>     at
>> thredds.inventory.DatasetCollectionManager.initMM(DatasetCollectionManager.java:435)
>>     at
>> thredds.inventory.DatasetCollectionManager.getMetadata(DatasetCollectionManager.java:456)
>>     at ucar.nc2.ft.fmrc.GridDatasetInv.open(GridDatasetInv.java:86)
>>     at ucar.nc2.ft.fmrc.Fmrc.makeFmrcInv(Fmrc.java:288)
>>     ... 6 more
>>
>>               73,2-5        Bot
>>
>>
>>
>>
>>
>>
>> John Caron wrote the following on 4/11/2011 2:17 PM:
>>> i think its a bug that was fixed in the latest release (4.2.5)
>>>
>>> On 4/11/2011 11:21 AM, Dan Swank wrote:
>>>> I've been tinkering with the new FeatureCollection.
>>>> I keep getting this exception:
>>>> Any immediate ideas?
>>>> The dev server is 4.2.20101116.2051 - 20101116.2051
>>>>
>>>>
>>>> Caused by: com.sleepycat.je.EnvironmentNotFoundException: (JE 4.0.71)
>>>> /home/nomads/tomcat-main/content/thredds/cache/collection Home
>>>> directory: /home/nomads/tomcat-main/content/thredds/cache/collection
>>>> ENV_NOT_FOUND: EnvironmentConfig.setAllowCreate is false so environment
>>>> creation is not permitted, but there are no log files in the environment
>>>> directory. Environment is invalid and must be closed.
>>>>
>>>>
>>>> ====================================================================
>>>>
>>>> <featureCollection name="NCEP-NAM-Grid-218" featureType="FMRC"
>>>> harvest="true"
>>>>      path="fmrc/nam-test/">
>>>>
>>>>    <collection
>>>> spec="/raid2/noaaport/merged/nam/201104/**/nam_218_#yyyyMMdd_HHmm#_...\.grb$"
>>>>
>>>>            recheckAfter="30 min"  olderThan="5 min"/>
>>>>    <update startup="true" rescan="0 5 3 * * ? *" />
>>>>    <fmrcConfig regularize="true"  datasetTypes="TwoD" />
>>>>
>>>> </featureCollection>
>>>>
>>>>
> 

-- 
Dan Swank
STG, Incorporated - Government Contractor
NCDC-NOMADS Project:  Software & Data Management
Data Access Branch
National Climatic Data Center
Veach-Baley Federal Building
151 Patton Avenue
Asheville, NC 28801-5001
Email: address@hidden
Phone: 828-271-4007
Follow-Ups:
- Re: FeatureCollection error
  - From: John Caron
References:
- Re: FeatureCollection error
  - From: john caron
Prev by Date: Re: FeatureCollection error
Next by Date: Re: FeatureCollection error
Previous by thread: Re: FeatureCollection error
Next by thread: Re: FeatureCollection error
Index(es):
- Date
- Thread