[Fwd: Re: [NCEP.List.Nomads-Users] problem with OpenDAP access to daily rtofs data]

John et al,
Just for your information: I found another email directed to the
Nomads-Users list where people reported about problems with
SocketException. I don't know if at that time some actions to fix the
problem were set, but maybe it helps.
Best Regards, Gerald

------------------------ Ursprüngliche Nachricht ------------------------
Betreff: Re: [NCEP.List.Nomads-Users] problem with OpenDAP access to daily
 rtofs data
Von:     "Rich Signell" <address@hidden>
Datum:   Di, 15.12.2009, 16:31
An:      "Hendrik Tolman" <address@hidden>
         "Jordan Alpert" <address@hidden>
Cc:      "Gerald Spreitzhofer" <address@hidden>
         "John C Warner" <address@hidden>
         "Brandy Armstrong" <address@hidden>
--------------------------------------------------------------------------

Hendrick & Jordan,

The USGS Coupled Ocean Atmosphere Wave Sediment Transport (COAWST) forecast
model has been broken since Friday of last week because RTOFS access via
OPeNDAP is broken.   Brandy Armstrong, who works with John Warner, posted
the problem to address@hidden
but has heard nothing back.   I tried calling Avichal yesterday and today,
but he is still out of the office on a family emergency.

Could someone look into this and fix the problem?  We are not the only ones
having this problem (as you can see from the response to Brandy's message
below).  Here's a simple test that illustrates the problem:

http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091213/daily/rtofs_native_000_atl.ascii?sshgsfc[0][547:1087][24:391]

Returns
*io error during data send: class java.io.EOFException: null*

Thanks
Rich

On Tue, Dec 15, 2009 at 9:19 AM, Brandy Armstrong <address@hidden>wrote:

>
> *I have not received any answers yet. I'll be happy to pass along any
> information when I receive some.*
>
> *I am still not able to load the rtofs data at **
> http://nomads.ncep.noaa.gov:9090/dods/ofs/*<http://nomads.ncep.noaa.gov:9090/dods/ofs/>
> * and I am still receiving Java errors, though not always the same one.
> Last night using the same code:*
>
> %example
> url=['http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs',Time_before,
> '/daily/rtofs_native_024_atl'];
> nc=mDataset(url);
> tmp=double(nc{''sshgsfc''}(1,547:1087,24:391));
>
> *I received a different Java message:*
>
> Dec 15, 2009 12:31:06 AM ucar.nc2.dods.DODSNetcdfFile <init>
>
> INFO: DODSNetcdfFile
> http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091214/daily/rtofs_native_024_atl
>
> java.net.SocketException: Connection reset
>
>         at java.net.SocketInputStream.read(Unknown Source)
>
>         at java.io.BufferedInputStream.fill(Unknown Source)
>
>         at java.io.BufferedInputStream.read(Unknown Source)
>
>         at
> org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)
>
>         at
> org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)
>
>         at
> org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)
>
>         at
> org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1413)
>
>         at
> org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)
>
>         at
> org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)
>
>         at
> org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)
>
>         at
> org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
>
>         at
> org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
>
>         at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
>
>         at
> org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
>
>         at opendap.dap.DConnect2.openConnection(DConnect2.java:212)
>
>         at opendap.dap.DConnect2.getDDS(DConnect2.java:440)
>
>         at opendap.dap.DConnect2.getDDS(DConnect2.java:420)
>
>         at ucar.nc2.dods.DODSNetcdfFile.<init>(DODSNetcdfFile.java:202)
>
>         at
> ucar.nc2.dataset.NetcdfDataset.acquireDODS(NetcdfDataset.java:804)
>
>         at
> ucar.nc2.dataset.NetcdfDataset.openOrAcquireFile(NetcdfDataset.java:699)
>
>         at
> ucar.nc2.dataset.NetcdfDataset.openDataset(NetcdfDataset.java:434)
>
>         at
> ucar.nc2.dataset.NetcdfDataset.acquireDataset(NetcdfDataset.java:544)
>
>         at ucar.nc2.dt.grid.GridDataset.open(GridDataset.java:88)
>
>         at msstate.cstm.data.JDataset.<init>(Unknown Source)
>
> Unable to open the dataset:
> http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091214/daily/rtofs_native_024_atl
> Connection reset
>
>
> *Trying it again just now (9:15 AM) with that same code I received this
> Java message:*
>
> Java exception occurred:
> java.io.EOFException
>
>         at java.io.DataInputStream.readInt(Unknown Source)
>
>         at java.io.DataInputStream.readFloat(Unknown Source)
>
>         at
> opendap.dap.Float32PrimitiveVector.deserialize(Float32PrimitiveVector.java:166)
>
>         at opendap.dap.DVector.deserialize(DVector.java:241)
>
>         at opendap.dap.DGrid.deserialize(DGrid.java:438)
>
>         at opendap.dap.DataDDS.readData(DataDDS.java:94)
>
>         at opendap.dap.DConnect2$DataDDSCommand.process(DConnect2.java:715)
>
>         at opendap.dap.DConnect2.openConnection(DConnect2.java:257)
>
>         at opendap.dap.DConnect2.getData(DConnect2.java:699)
>
>         at opendap.dap.DConnect2.getData(DConnect2.java:979)
>
>         at
> ucar.nc2.dods.DODSNetcdfFile.readDataDDSfromServer(DODSNetcdfFile.java:1134)
>
>         at ucar.nc2.dods.DODSNetcdfFile.readData(DODSNetcdfFile.java:1298)
>
>         at ucar.nc2.Variable._read(Variable.java:979)
>
>         at ucar.nc2.Variable.read(Variable.java:778)
>
>         at ucar.nc2.dataset.VariableDS._read(VariableDS.java:500)
>
>         at ucar.nc2.Variable.read(Variable.java:778)
>
>         at ucar.nc2.Variable.read(Variable.java:736)
>
>         at msstate.cstm.data.JVariable.readVarData(Unknown Source)
>
>         at msstate.cstm.data.JVariable.readVarData(Unknown Source)
>
>
>
> Brandy Armstrong
> (508) 457-2256
> address@hidden
>
>
>
>  From: "Gerald Spreitzhofer" <address@hidden> To: "Brandy
> Armstrong" <address@hidden> Date: 12/15/2009 08:36 AM Subject: Re:
> [NCEP.List.Nomads-Users] daily rtofs data
> ------------------------------
>
>
>
> Hi Brandy!
> Have you received any answers so far? I have very similar problems and
> error messages, using dods, especially since the last 24 hours.
> Regards, Gerald
>
> ---------------------------------------
> Dr. Gerald Spreitzhofer
> Institute of Meteorology and Geophysics
> University of Vienna
> Althanstrasse 14, UZA2
> A-1090 Vienna, Austria
> Tel.: +43-1-4277-537 38
> email: address@hidden
> ---------------------------------------
>
> On Mo, 14.12.2009, 16:44, Brandy Armstrong wrote:
> > I have been downloading the HYCOM data available at
> >
> http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091213/daily/rtofs_native_024_atl
> > for weeks now using the NJToolbox with no problems, but for the last
> three
> > days (Dec 12, 13, 14) I have been unable to load the data. The error I am
> > getting is:
> >
> > Java exception occurred:
> > java.io.EOFException
> >
> >         at java.io.DataInputStream.readInt(Unknown Source)
> >
> >         at java.io.DataInputStream.readFloat(Unknown Source)
> >
> >         at
> >
> opendap.dap.Float32PrimitiveVector.deserialize(Float32PrimitiveVector.java:166)
> >
> >         at opendap.dap.DVector.deserialize(DVector.java:241)
> >
> >         at opendap.dap.DGrid.deserialize(DGrid.java:438)
> >
> >         at opendap.dap.DataDDS.readData(DataDDS.java:94)
> >
> >         at
> > opendap.dap.DConnect2$DataDDSCommand.process(DConnect2.java:715)
> >
> >         at opendap.dap.DConnect2.openConnection(DConnect2.java:257)
> >
> >         at opendap.dap.DConnect2.getData(DConnect2.java:699)
> >
> >         at opendap.dap.DConnect2.getData(DConnect2.java:979)
> >
> >         at
> >
> ucar.nc2.dods.DODSNetcdfFile.readDataDDSfromServer(DODSNetcdfFile.java:1134)
> >
> >         at
> ucar.nc2.dods.DODSNetcdfFile.readData(DODSNetcdfFile.java:1298)
> >
> >         at ucar.nc2.Variable._read(Variable.java:979)
> >
> >         at ucar.nc2.Variable.read(Variable.java:778)
> >
> >         at ucar.nc2.dataset.VariableDS._read(VariableDS.java:500)
> >
> >         at ucar.nc2.Variable.read(Variable.java:778)
> >
> >         at ucar.nc2.Variable.read(Variable.java:736)
> >
> >         at msstate.cstm.data.JVariable.readVarData(Unknown Source)
> >
> >         at msstate.cstm.data.JVariable.readVarData(Unknown Source)
> >
> > Rich Signell also tried to access it, and got the same problem.  To
> > confirm the problem was not on our
> > end, he did the same query using the ASCII response directly from the
> > OpenDAP data URL:
> >
> >
> http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091213/daily/rtofs_native_000_atl.ascii?sshgsfc
> > [0][547:1087][24:391]
> >
> > And this returns the error:
> > io error during data send: class java.io.EOFException: null
> >
> > Is the list serve the correct place to report this problem?
> >
> > Thank you,
> > Brandy
> >
> >
> > Brandy Armstrong
> > (508) 457-2256
> > address@hidden
> > _______________________________________________
> > NCEP.List.Nomads-Users mailing list
> > address@hidden
> > https://lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.nomads-users
> >
>
>
> --
> ---------------------------------------
> Dr. Gerald Spreitzhofer
> Institute of Meteorology and Geophysics
> University of Vienna
> Althanstrasse 14, UZA2
> A-1090 Vienna, Austria
> Tel.: +43-1-4277-537 38
> email: address@hidden
> ---------------------------------------
>
>
>
>


-- 
Dr. Richard P. Signell   (508) 457-2229
USGS, 384 Woods Hole Rd.
Woods Hole, MA 02543-1598
Hendrick & Jordan,

The USGS Coupled Ocean Atmosphere Wave Sediment Transport (COAWST) forecast model has been broken since Friday of last week because RTOFS access via OPeNDAP is broken.   Brandy Armstrong, who works with John Warner, posted the problem to address@hidden
but has heard nothing back.   I tried calling Avichal yesterday and today, but he is still out of the office on a family emergency.

Could someone look into this and fix the problem?  We are not the only ones having this problem (as you can see from the response to Brandy's message below).  Here's a simple test that illustrates the problem:

http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091213/daily/rtofs_native_000_atl.ascii?sshgsfc[0][547:1087][24:391]

Returns
io error during data send: class java.io.EOFException: null

Thanks
Rich

On Tue, Dec 15, 2009 at 9:19 AM, Brandy Armstrong <address@hidden> wrote:

I have not received any answers yet. I'll be happy to pass along any information when I receive some.

I am still not able to load the rtofs data at http://nomads.ncep.noaa.gov:9090/dods/ofs/ and I am still receiving Java errors, though not always the same one. Last night using the same code:

%example
url="">'http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs',Time_before,'/daily/rtofs_native_024_atl'];
nc=mDataset(url);
tmp=double(nc{''sshgsfc''}(1,547:1087,24:391));

I received a different Java message:

Dec 15, 2009 12:31:06 AM ucar.nc2.dods.DODSNetcdfFile <init>

INFO: DODSNetcdfFile http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091214/daily/rtofs_native_024_atl

java.net.SocketException: Connection reset

        at java.net.SocketInputStream.read(Unknown Source)

        at java.io.BufferedInputStream.fill(Unknown Source)

        at java.io.BufferedInputStream.read(Unknown Source)

        at org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78)

        at org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106)

        at org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116)

        at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.readLine(MultiThreadedHttpConnectionManager.java:1413)

        at org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973)

        at org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735)

        at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098)

        at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)

        at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

        at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

        at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)

        at opendap.dap.DConnect2.openConnection(DConnect2.java:212)

        at opendap.dap.DConnect2.getDDS(DConnect2.java:440)

        at opendap.dap.DConnect2.getDDS(DConnect2.java:420)

        at ucar.nc2.dods.DODSNetcdfFile.<init>(DODSNetcdfFile.java:202)

        at ucar.nc2.dataset.NetcdfDataset.acquireDODS(NetcdfDataset.java:804)

        at ucar.nc2.dataset.NetcdfDataset.openOrAcquireFile(NetcdfDataset.java:699)

        at ucar.nc2.dataset.NetcdfDataset.openDataset(NetcdfDataset.java:434)

        at ucar.nc2.dataset.NetcdfDataset.acquireDataset(NetcdfDataset.java:544)

        at ucar.nc2.dt.grid.GridDataset.open(GridDataset.java:88)

        at msstate.cstm.data.JDataset.<init>(Unknown Source)

Unable to open the dataset: http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091214/daily/rtofs_native_024_atl
Connection reset


Trying it again just now (9:15 AM) with that same code I received this Java message:

Java exception occurred:
java.io.EOFException

        at java.io.DataInputStream.readInt(Unknown Source)

        at java.io.DataInputStream.readFloat(Unknown Source)

        at opendap.dap.Float32PrimitiveVector.deserialize(Float32PrimitiveVector.java:166)

        at opendap.dap.DVector.deserialize(DVector.java:241)

        at opendap.dap.DGrid.deserialize(DGrid.java:438)

        at opendap.dap.DataDDS.readData(DataDDS.java:94)

        at opendap.dap.DConnect2$DataDDSCommand.process(DConnect2.java:715)

        at opendap.dap.DConnect2.openConnection(DConnect2.java:257)

        at opendap.dap.DConnect2.getData(DConnect2.java:699)

        at opendap.dap.DConnect2.getData(DConnect2.java:979)

        at ucar.nc2.dods.DODSNetcdfFile.readDataDDSfromServer(DODSNetcdfFile.java:1134)

        at ucar.nc2.dods.DODSNetcdfFile.readData(DODSNetcdfFile.java:1298)

        at ucar.nc2.Variable._read(Variable.java:979)

        at ucar.nc2.Variable.read(Variable.java:778)

        at ucar.nc2.dataset.VariableDS._read(VariableDS.java:500)

        at ucar.nc2.Variable.read(Variable.java:778)

        at ucar.nc2.Variable.read(Variable.java:736)

        at msstate.cstm.data.JVariable.readVarData(Unknown Source)

        at msstate.cstm.data.JVariable.readVarData(Unknown Source)



Brandy Armstrong
(508) 457-2256
address@hidden

From:	"Gerald Spreitzhofer" <address@hidden>
To:	"Brandy Armstrong" <address@hidden>
Date:	12/15/2009 08:36 AM
Subject:	Re: [NCEP.List.Nomads-Users] daily rtofs data

---

Hi Brandy!
Have you received any answers so far? I have very similar problems and
error messages, using dods, especially since the last 24 hours.
Regards, Gerald

---------------------------------------
Dr. Gerald Spreitzhofer
Institute of Meteorology and Geophysics
University of Vienna
Althanstrasse 14, UZA2
A-1090 Vienna, Austria
Tel.: +43-1-4277-537 38
email: address@hidden
---------------------------------------

On Mo, 14.12.2009, 16:44, Brandy Armstrong wrote:
> I have been downloading the HYCOM data available at
> http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091213/daily/rtofs_native_024_atl
> for weeks now using the NJToolbox with no problems, but for the last three
> days (Dec 12, 13, 14) I have been unable to load the data. The error I am
> getting is:
>
> Java exception occurred:
> java.io.EOFException
>
>         at java.io.DataInputStream.readInt(Unknown Source)
>
>         at java.io.DataInputStream.readFloat(Unknown Source)
>
>         at
> opendap.dap.Float32PrimitiveVector.deserialize(Float32PrimitiveVector.java:166)
>
>         at opendap.dap.DVector.deserialize(DVector.java:241)
>
>         at opendap.dap.DGrid.deserialize(DGrid.java:438)
>
>         at opendap.dap.DataDDS.readData(DataDDS.java:94)
>
>         at
> opendap.dap.DConnect2$DataDDSCommand.process(DConnect2.java:715)
>
>         at opendap.dap.DConnect2.openConnection(DConnect2.java:257)
>
>         at opendap.dap.DConnect2.getData(DConnect2.java:699)
>
>         at opendap.dap.DConnect2.getData(DConnect2.java:979)
>
>         at
> ucar.nc2.dods.DODSNetcdfFile.readDataDDSfromServer(DODSNetcdfFile.java:1134)
>
>         at ucar.nc2.dods.DODSNetcdfFile.readData(DODSNetcdfFile.java:1298)
>
>         at ucar.nc2.Variable._read(Variable.java:979)
>
>         at ucar.nc2.Variable.read(Variable.java:778)
>
>         at ucar.nc2.dataset.VariableDS._read(VariableDS.java:500)
>
>         at ucar.nc2.Variable.read(Variable.java:778)
>
>         at ucar.nc2.Variable.read(Variable.java:736)
>
>         at msstate.cstm.data.JVariable.readVarData(Unknown Source)
>
>         at msstate.cstm.data.JVariable.readVarData(Unknown Source)
>
> Rich Signell also tried to access it, and got the same problem.  To
> confirm the problem was not on our
> end, he did the same query using the ASCII response directly from the
> OpenDAP data URL:
>
> http://nomads.ncep.noaa.gov:9090/dods/ofs/ofs20091213/daily/rtofs_native_000_atl.ascii?sshgsfc
> [0][547:1087][24:391]
>
> And this returns the error:
> io error during data send: class java.io.EOFException: null
>
> Is the list serve the correct place to report this problem?
>
> Thank you,
> Brandy
>
>
> Brandy Armstrong
> (508) 457-2256
> address@hidden
> _______________________________________________
> NCEP.List.Nomads-Users mailing list
> address@hidden
> https://lstsrv.ncep.noaa.gov/mailman/listinfo/ncep.list.nomads-users
>


--
---------------------------------------
Dr. Gerald Spreitzhofer
Institute of Meteorology and Geophysics
University of Vienna
Althanstrasse 14, UZA2
A-1090 Vienna, Austria
Tel.: +43-1-4277-537 38
email: address@hidden
---------------------------------------

-- 
Dr. Richard P. Signell   (508) 457-2229
USGS, 384 Woods Hole Rd.   
Woods Hole, MA 02543-1598