Re: New Client Reply - [THREDDS !GLB-616895]: NetCDF Subset Service often inaccessible (HTTP Status 500 - Internal Server Error)

Hi John:

you should go through the catalogInit.log file, and try to eliminate as 
many of the error messages as possible.

eg this one is fatal:

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/satellite.xml; 
path=idd/satellite.xml
readCatalog(): invalid catalog -- ----Catalog Validation version 1.0.01
**Fatal:  InvCatalogFactory.readXML failed
 Exception= org.jdom.input.JDOMParseException Error on line 94: The 
element type "dataset" must be terminated by the matching end-tag 
"</dataset>".
 fatalMessages= *** XML parser fatalError (94:9)= The element type 
"dataset" must be terminated by the matching end-tag "</dataset>".


others are mostly annoyances, and there are some that may not go away - 
basically flaws in the schema parser.

i dont think any of this is the problem, but just good cleanup.

On 12/17/2010 10:08 PM, John Maurer, IV wrote:
> New Client Reply: NetCDF Subset Service often inaccessible (HTTP Status 500 - 
> Internal Server Error)
>
> OK, I've zipped up my logs. They are in the same place:
>
>
> ftp.soest.hawaii.edu
> pub/jmaurer/hioos_tds_logs.zip  (~13 MB)
>
>
> Will have to look into remote manager on Monday.
> Thanks!,
> John
>
> ----- Original Message -----
> From: Unidata THREDDS Support<address@hidden>
> Date: Friday, December 17, 2010 3:41 pm
> Subject: [THREDDS #GLB-616895]: NetCDF Subset Service often inaccessible (HTTP 
> Status 500 - Internal Server Error)
> To: address@hidden
> Cc: address@hidden
>
> > meanwhile, can you zip up content/thredds/logs/* and send it?
> >
> > > ObservationNetcdf could be related to our OOSTethys Sensor
> > Observation Service (SOS)? I have the TDS Remote Manager, but
> > apparently it's only configured within our firewall. I will see
> > about opening it up and get back to you...
> > > ----- Original Message -----
> > > From: Unidata THREDDS Support<address@hidden>
> > > Date: Friday, December 17, 2010 2:48 pm
> > > Subject: [THREDDS #GLB-616895]: NetCDF Subset Service often
> > inaccessible (HTTP Status 500 - Internal Server Error)
> > > To: address@hidden
> > > Cc: address@hidden
> > >
> > > > > John
> > > > hmmm, whats ObservationNetcdf ?
> > > >
> > > > do you have remote debugging turned on, and if so, can you give
> > > > me access to it?
> > > >
> > > > Ticket Details
> > > > ===================
> > > > Ticket ID: GLB-616895
> > > > Department: Support THREDDS
> > > > Priority: High
> > > > Status: Open
> >
> > Ticket Details
> > ===================
> > Ticket ID: GLB-616895
> > Department: Support THREDDS
> > Priority: High
> > Status: Open
>
>
> Ticket Details
> ===================
> Ticket ID: GLB-616895
> Department: Support THREDDS
> Priority: High
> Status: Open
> Link:  
> https://www.unidata.ucar.edu/esupport/staff/index.php?_m=tickets&_a=viewticket&ticketid=12530

initCatalogs(): initializing 2 root catalogs.

**************************************
Catalog init catalog.xml
[2010-12-16T23:30:15GMT]
readCatalog(): full path=/usr/local/tomcat/content/thredds/catalog.xml; 
path=catalog.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/nss.xml; 
path=idd/nss.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01
*** XML parser error (189:78)= cvc-complex-type.2.4.d: Invalid content was 
found starting with element 'netcdf'. No child element is expected at this 
point.
*** XML parser error (254:49)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'attribute'. One of 
'{"http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2":remove}' is expected.
*** XML parser error (399:49)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'attribute'. One of 
'{"http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2":remove}' is expected.
*** XML parser error (499:78)= cvc-complex-type.2.4.d: Invalid content was 
found starting with element 'netcdf'. No child element is expected at this 
point.
*** XML parser error (564:49)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'attribute'. One of 
'{"http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2":remove}' is expected.
*** XML parser error (709:49)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'attribute'. One of 
'{"http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2":remove}' is expected.
*** XML parser error (800:78)= cvc-complex-type.2.4.d: Invalid content was 
found starting with element 'netcdf'. No child element is expected at this 
point.
*** XML parser error (1086:78)= cvc-complex-type.2.4.d: Invalid content was 
found starting with element 'netcdf'. No child element is expected at this 
point.

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/wqb.xml; 
path=idd/wqb.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01
*** XML parser error (186:78)= cvc-complex-type.2.4.d: Invalid content was 
found starting with element 'netcdf'. No child element is expected at this 
point.
*** XML parser error (250:49)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'attribute'. One of 
'{"http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2":remove}' is expected.
*** XML parser error (378:49)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'attribute'. One of 
'{"http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2":remove}' is expected.
*** XML parser error (466:78)= cvc-complex-type.2.4.d: Invalid content was 
found starting with element 'netcdf'. No child element is expected at this 
point.
*** XML parser error (531:49)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'attribute'. One of 
'{"http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2":remove}' is expected.
*** XML parser error (665:49)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'attribute'. One of 
'{"http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2":remove}' is expected.

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/glide.xml; 
path=idd/glide.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01
*** XML parser error (114:34)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'metadata'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (544:34)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'metadata'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (984:34)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'metadata'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (1436:34)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'metadata'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (1888:34)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'metadata'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (2322:34)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'metadata'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (2762:34)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'metadata'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (3232:34)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'metadata'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/ocn_mod.xml; 
path=idd/ocn_mod.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/ocn_mod_hiig.xml; 
path=idd/ocn_mod_hiig.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/ocn_mod_hiog.xml; 
path=idd/ocn_mod_hiog.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/ocn_mod_hiomsg.xml; 
path=idd/ocn_mod_hiomsg.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/ocn_mod_hiomwg.xml; 
path=idd/ocn_mod_hiomwg.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/ocn_mod_input.xml; 
path=idd/ocn_mod_input.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01
*** XML parser error (738:14)= cvc-complex-type.2.3: Element 'netcdf' cannot 
have character [children], because the type's content type is element-only.
*** XML parser error (917:14)= cvc-complex-type.2.3: Element 'netcdf' cannot 
have character [children], because the type's content type is element-only.
*** XML parser error (1096:14)= cvc-complex-type.2.3: Element 'netcdf' cannot 
have character [children], because the type's content type is element-only.

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/atm_mod.xml; 
path=idd/atm_mod.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01
*** XML parser error (225:23)= cvc-complex-type.2.3: Element 
'featureCollection' cannot have character [children], because the type's 
content type is element-only.

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/wav_mod.xml; 
path=idd/wav_mod.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01
*** XML parser error (234:23)= cvc-complex-type.2.3: Element 
'featureCollection' cannot have character [children], because the type's 
content type is element-only.
*** XML parser error (438:23)= cvc-complex-type.2.3: Element 
'featureCollection' cannot have character [children], because the type's 
content type is element-only.
*** XML parser error (640:23)= cvc-complex-type.2.3: Element 
'featureCollection' cannot have character [children], because the type's 
content type is element-only.
*** XML parser error (845:23)= cvc-complex-type.2.3: Element 
'featureCollection' cannot have character [children], because the type's 
content type is element-only.
*** XML parser error (1048:23)= cvc-complex-type.2.3: Element 
'featureCollection' cannot have character [children], because the type's 
content type is element-only.

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/tide_mod.xml; 
path=idd/tide_mod.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/tide_gauge.xml; 
path=idd/tide_gauge.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/uhslc_fast_hourly.xml; 
path=idd/uhslc_fast_hourly.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/uhslc_fast_daily.xml; 
path=idd/uhslc_fast_daily.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full 
path=/usr/local/tomcat/content/thredds/idd/uhslc_fast_monthly.xml; 
path=idd/uhslc_fast_monthly.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/hfr.xml; 
path=idd/hfr.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01
*** XML parser error (87:158)= cvc-complex-type.3.2.2: Attribute 'description' 
is not allowed to appear in element 'variable'.
*** XML parser error (101:23)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'resolution'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":start, 
"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":end, 
"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":duration}' is 
expected.
*** XML parser error (135:78)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'netcdf'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (205:158)= cvc-complex-type.3.2.2: Attribute 'description' 
is not allowed to appear in element 'variable'.
*** XML parser error (329:158)= cvc-complex-type.3.2.2: Attribute 'description' 
is not allowed to appear in element 'variable'.
*** XML parser error (343:23)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'resolution'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":start, 
"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":end, 
"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":duration}' is 
expected.
*** XML parser error (378:78)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'netcdf'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (448:158)= cvc-complex-type.3.2.2: Attribute 'description' 
is not allowed to appear in element 'variable'.
*** XML parser error (569:158)= cvc-complex-type.3.2.2: Attribute 'description' 
is not allowed to appear in element 'variable'.
*** XML parser error (583:23)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'resolution'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":start, 
"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":end, 
"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":duration}' is 
expected.
*** XML parser error (617:78)= cvc-complex-type.2.4.a: Invalid content was 
found starting with element 'netcdf'. One of 
'{"http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0":addTimeCoverage}'
 is expected.
*** XML parser error (686:158)= cvc-complex-type.3.2.2: Attribute 'description' 
is not allowed to appear in element 'variable'.
 ** warning: TimeCoverage error = DateRange must have 2 of start, end, duration
 ** warning: TimeCoverage error = DateRange must have 2 of start, end, duration
 ** warning: TimeCoverage error = DateRange must have 2 of start, end, duration

readCatalog(): full path=/usr/local/tomcat/content/thredds/idd/satellite.xml; 
path=idd/satellite.xml
readCatalog(): invalid catalog -- ----Catalog Validation version 1.0.01
**Fatal:  InvCatalogFactory.readXML failed
 Exception= org.jdom.input.JDOMParseException Error on line 94: The element 
type "dataset" must be terminated by the matching end-tag "</dataset>".
 fatalMessages= *** XML parser fatalError (94:9)= The element type "dataset" 
must be terminated by the matching end-tag "</dataset>".

 errMessages= 
 warnMessages= 

initCatalog(): failed to read catalog 
</usr/local/tomcat/content/thredds/idd/satellite.xml>.

**************************************
Catalog init data_from_las.xml
[2010-12-16T23:30:17GMT]
readCatalog(): full path=/usr/local/tomcat/content/thredds/data_from_las.xml; 
path=data_from_las.xml
readCatalog(): valid catalog -- ----Catalog Validation version 1.0.01
*** XML parser error (24:43)= cvc-complex-type.3.2.2: Attribute 'id' is not 
allowed to appear in element 'datasetScan'.