[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: New Ticket - [THREDDS !FPU-806608]: HTTP file cache problem?

Hmmm, im not really sure whats happening. Are you making a lot of simultaneous calls to the server? ON the surface, it looks like there are too many socket connections, that they arent getting released by the client. 

Also check that your IOSP is calling raf.close()  in its close statement.

Is "<NetcdfFileCache> maxFiles from 400 to 20" correct ??



Ken Knapp wrote:


New Ticket: HTTP file cache problem?
We're accessing files through TDS using a script (to access with our IOSP stuff) and after reading numerous files (which was made possible by changing <NetcdfFileCache> maxFiles from 400 to 20) we are encountering a new problem that seems to be unrelated to HTTPFileCache (because it happens well past the 40 file limit). Can you help? 
Thx-
-Ken
Current Exception error is ...

OUCH! IOException: Too many open files
java.net.SocketException: Too many open files
       at java.net.Socket.createImpl(Socket.java:388)
       at java.net.Socket.connect(Socket.java:514)
       at java.net.Socket.connect(Socket.java:466)
       at sun.net.NetworkClient.doConnect(NetworkClient.java:157)
       at sun.net.www.http.HttpClient.openServer(HttpClient.java:365)
       at sun.net.www.http.HttpClient.openServer(HttpClient.java:477)
       at sun.net.www.http.HttpClient.<init>(HttpClient.java:214)
       at sun.net.www.http.HttpClient.New(HttpClient.java:287)
       at sun.net.www.http.HttpClient.New(HttpClient.java:299)
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:796) at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:748) at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:673) 
       at dods.dap.DConnect.openConnection(DConnect.java:184)
       at dods.dap.DConnect.getDataFromUrl(DConnect.java:455)
       at dods.dap.DConnect.getData(DConnect.java:404)
       at dods.servlet.dodsASCII.sendASCII(dodsASCII.java:91)
       at dods.servlet.DODSServlet.doGetASC(DODSServlet.java:874)
       at dods.servlet.DODSServlet.doGet(DODSServlet.java:1457)
       at dods.servers.netcdf.NcDODSServlet.doGet(NcDODSServlet.java:271)
       at javax.servlet.http.HttpServlet.service(HttpServlet.java:689)
       at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:432) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148) at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869) at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664) at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527) at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80) at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684) 
       at java.lang.Thread.run(Thread.java:595)