[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: occasional weird timestamps and bad data with THREDDS

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

Subject: Re: occasional weird timestamps and bad data with THREDDS
Date: Wed, 30 Mar 2011 13:17:35 -0700

John, thanks for the reply

On Wed, Mar 30, 2011 at 11:12 AM, John Caron <address@hidden> wrote:
> Hi Tom:
>
> 1) what version TDS?

Version 4.2.1 - 20101201.2028

> 2) is this an aggregaton? (you can send me the config catalog)
yes, threddsConfig.xml & catalog.xml attached, let me know if you want
more (we have an enhancedCatalog.xml and wmsConfig.xml too)


> 3) are there errors in threddsServlet.log?
yes, I've attached a text file with the errors from the logs

> 4) when you "update the netcdf files multiple times over 5-6 hours ", do you
> overwrite? extend?

I believe the the files are always overwritten.  I'll double check and
get back to you if I'm wrong.


THANKS
Tom
>
> its hard when its intermittent, we may have to figure out how to
> consistently reproduce.
>
> john
>
> On 3/30/2011 11:21 AM, tom cook wrote:
>>
>> HI John,
>> I have been tasked with maintaining the HF Radar national network
>> THREDDS server here at SIO. Rich has helped us set things up, and has
>> been a valuable resource for learning this system. We have been having
>> a frequent problem that Rich has been unable to help us with, which is
>> occasional bad timestamps and occasional bad data served through
>> THREDDS.
>> An example of bad data being served through THREDDS: we are working
>> with ASA&  USCG to get data into their SAROPS product. They have
>> complained that many of the data samples have had data in the wrong
>> geographical location (ie ocean currents over land). I have noticed
>> this as well using the Godiva viewer, and when I compare the Godiva
>> map with the source netcdf file, it is not plotting the data in the
>> correct location. This makes me think it is a problem with the data
>> being served by THREDDS. The problem goes away after some time, as we
>> typically update the netcdf files multiple times over 5-6 hours after
>> they are created. I'm not sure if the updating of the netcdf files is
>> the cause of the problem, but it is not something that is easy to
>> reproduce.
>>
>> The problem we have with weird timestamps happens occasionally, and in
>> random locations throughout the time index. It usually is just one
>> sample here or there, and not successive samples. It almost always
>> goes away when I empty the cache.
>>
>> I'm not sure if these issues are setup related, or issues we can
>> script some workarounds to help. But I wanted to check with you to see
>> if you have any idea of what is going on.
>>
>> Thanks for your time,
>>
>> Tom Cook
>> Programmer/Analyst
>> Coastal Observation Research&  Development Center
>> Scripps Institution of Oceanography
>
>

logs/threddsServlet.log.2010-11-15-21:2010-11-15T21:17:17.707 +0000 [     
37423][      41] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-RTV
logs/threddsServlet.log.2010-11-15-21:2010-11-15T21:25:04.694 +0000 [    
504410][      94] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-RTV
logs/threddsServlet.log.2010-11-15-22:2010-11-15T22:19:21.420 +0000 [   
3761136][     199] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-RTV
logs/threddsServlet.log.2010-11-16-02:2010-11-16T02:00:37.800 +0000 [  
17037516][     216] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-GNOME
logs/threddsServlet.log.2010-11-16-03:2010-11-16T03:34:49.099 +0000 [  
22688815][     224] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-05:2010-11-16T05:32:43.237 +0000 [  
29762953][     240] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-05:2010-11-16T05:45:03.182 +0000 [  
30502898][     244] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-RTV
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:14:59.060 +0000 [  
32298776][     249] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:30:00.566 +0000 [  
33200282][     307] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-RTV
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:39:12.856 +0000 [  
33752572][     309] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:49:45.137 +0000 [  
34384853][     314] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-06:2010-11-16T06:59:06.228 +0000 [  
34945944][     333] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:12:38.820 +0000 [  
35758536][     324] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.showForm
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:12:38.822 +0000 [  
35758538][     324] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-RTV
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:19:54.663 +0000 [  
36194379][     357] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-RTV
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:26:29.727 +0000 [  
36589443][     364] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-RTV
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:29:57.166 +0000 [  
36796882][     370] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-07:2010-11-16T07:48:55.340 +0000 [  
37935056][     375] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-RTV
logs/threddsServlet.log.2010-11-16-11:2010-11-16T11:22:48.866 +0000 [  
50768582][     427] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-RTV
logs/threddsServlet.log.2010-11-16-12:2010-11-16T12:42:02.937 +0000 [  
55522653][     455] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:21:34.659 +0000 [  
72294375][     823] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-RTV
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:21:35.717 +0000 [  
72295433][     824] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:22:10.892 +0000 [  
72330608][     826] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:22:42.215 +0000 [  
72361931][     829] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-GNOME
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:22:43.701 +0000 [  
72363417][     832] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-RTV
logs/threddsServlet.log.2010-11-16-17:2010-11-16T17:22:45.562 +0000 [  
72365278][     836] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-RTV
logs/threddsServlet.log.2010-11-16-19:2010-11-16T19:28:20.604 +0000 [  
79900320][     873] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:20:54.692 +0000 [    
319028][      11] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-RTV
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:21:15.555 +0000 [    
339891][       9] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:21:15.555 +0000 [    
339891][      10] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:24:56.414 +0000 [    
560750][      19] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:24:56.414 +0000 [    
560750][      18] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:25:02.643 +0000 [    
566979][      50] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:25:05.196 +0000 [    
569532][      56] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:25:12.570 +0000 [    
576906][      66] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:25:23.275 +0000 [    
587611][      75] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:27:51.000 +0000 [    
735336][     101] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:28:21.875 +0000 [    
766211][      87] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:28:47.717 +0000 [    
792053][     110] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:29:33.779 +0000 [    
838115][     120] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:29:36.283 +0000 [    
840619][     131] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-00:2010-12-13T00:29:36.283 +0000 [    
840619][     132] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-01:2010-12-13T01:29:48.978 +0000 [   
4453314][     196] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-RTV
logs/threddsServlet.log.2010-12-13-02:2010-12-13T02:20:05.468 +0000 [   
7469804][     296] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-02:2010-12-13T02:56:18.721 +0000 [   
9643057][     412] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-RTV
logs/threddsServlet.log.2010-12-13-03:2010-12-13T03:28:45.316 +0000 [  
11589652][     444] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-RTV
logs/threddsServlet.log.2010-12-13-04:2010-12-13T04:51:13.162 +0000 [  
16537498][     586] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-05:2010-12-13T05:26:41.677 +0000 [  
18666013][     613] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-RTV
logs/threddsServlet.log.2010-12-13-05:2010-12-13T05:41:44.124 +0000 [  
19568460][     658] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-RTV
logs/threddsServlet.log.2010-12-13-08:2010-12-13T08:03:12.248 +0000 [  
28056584][     868] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-RTV
logs/threddsServlet.log.2010-12-13-08:2010-12-13T08:23:20.508 +0000 [  
29264844][     888] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-14:2010-12-13T14:08:06.544 +0000 [  
49950880][    1595] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-GNOME
logs/threddsServlet.log.2010-12-13-14:2010-12-13T14:36:11.738 +0000 [  
51636074][    1677] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-RTV
logs/threddsServlet.log.2010-12-13-14:2010-12-13T14:36:34.765 +0000 [  
51659101][    1702] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-RTV
logs/threddsServlet.log.2010-12-13-14:2010-12-13T14:52:23.635 +0000 [  
52607971][    1705] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-GNOME
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:17:15.990 +0000 
[4928500326][  193926] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/2073744616-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:18:14.220 +0000 
[4928558556][  193928] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/1040000942-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:25:52.732 +0000 
[4929017068][  193936] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/1896543939-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:26:09.295 +0000 
[4929033631][  193937] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-780569033-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:28:22.174 +0000 
[4929166510][  193942] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-800759866-RTV.nc
logs/threddsServlet.log.2011-02-08-01:2011-02-08T01:30:59.319 +0000 
[4929323655][  193959] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-1728976716-RTV.nc
logs/threddsServlet.log.2011-02-09-23:2011-02-09T23:46:20.593 +0000 
[5095844929][  200860] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-415350283-GNOME.nc
logs/threddsServlet.log.2011-02-09-23:2011-02-09T23:46:30.859 +0000 
[5095855195][  200861] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/1505331550-GNOME.nc
logs/threddsServlet.log.2011-02-09-23:2011-02-09T23:48:40.748 +0000 
[5095985084][  200865] ERROR - thredds.server.ncSubset.GridPointWriter - 
GridPointWriter.NetcdfWriter.header
logs/threddsServlet.log.2011-02-09-23:2011-02-09T23:48:40.811 +0000 
[5095985147][  200865] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.processGridAsPoint
logs/threddsServlet.log.2011-02-17-18:2011-02-17T18:50:42.373 +0000 
[5769306709][  232655] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  synch failed on HFRNet/USEGC/2km/hourly/GNOME 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909021900_HFRadar_USEGC_2km_rtv_SIO.nc
 (No such file or directory)
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.009 +0000 
[5769973345][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909011500_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.010 +0000 
[5769973346][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909011600_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.010 +0000 
[5769973346][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909021700_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.010 +0000 
[5769973346][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909021100_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-19:2011-02-17T19:01:49.011 +0000 
[5769973347][       1] ERROR - ucar.nc2.util.cache.FileCache - FileCache 
NetcdfFileCache  close failed on 
/data1/HFRadar/RTV/USEGC/2009_09/NetCDF/200909021800_HFRadar_USEGC_2km_rtv_SIO.nc
logs/threddsServlet.log.2011-02-17-22:2011-02-17T22:42:22.114 +0000 
[5783206450][  233214] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/364212374-RTV.nc
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:00:38.652 +0000 
[5787902988][  233382] ERROR - thredds.server.ncSubset.GridPointWriter - 
GridPointWriter.NetcdfWriter.header
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:00:38.694 +0000 
[5787903030][  233382] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.processGridAsPoint
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:00:54.530 +0000 
[5787918866][  233383] ERROR - thredds.server.ncSubset.GridPointWriter - 
GridPointWriter.NetcdfWriter.header
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:00:54.532 +0000 
[5787918868][  233383] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.processGridAsPoint
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:01:02.589 +0000 
[5787926925][  233384] ERROR - thredds.server.ncSubset.GridPointWriter - 
GridPointWriter.NetcdfWriter.header
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:01:02.654 +0000 
[5787926990][  233384] ERROR - thredds.server.ncSubset.GridServlet - 
GridServlet.processGridAsPoint
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:08:50.985 +0000 
[5788395321][  233412] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-630672552-RTV.nc
logs/threddsServlet.log.2011-02-18-00:2011-02-18T00:09:02.474 +0000 
[5788406810][  233415] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-525789344-RTV.nc
logs/threddsServlet.log.2011-02-24-18:2011-02-24T18:47:56.816 +0000 
[6373941152][  256564] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-2007368388-GNOME.nc
logs/threddsServlet.log.2011-02-24-18:2011-02-24T18:48:12.381 +0000 
[6373956717][  256565] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/703218262-GNOME.nc
logs/threddsServlet.log.2011-03-03-21:2011-03-03T21:41:33.480 +0000 
[6989157816][  280646] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/1917002746-RTV.nc
logs/threddsServlet.log.2011-03-03-21:2011-03-03T21:42:47.000 +0000 
[6989231336][  280647] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-1356197353-RTV.nc
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:33:17.426 +0000 [    
231865][       9] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:42:45.480 +0000 [    
799919][      23] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:43:39.757 +0000 [    
854196][      28] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:44:24.543 +0000 [    
898982][      33] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:45:02.112 +0000 [    
936551][      38] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:51:54.821 +0000 [   
1349260][      44] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:57:36.256 +0000 [   
1690695][      45] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-17:2011-03-08T17:57:42.553 +0000 [   
1696992][      47] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-18:2011-03-08T18:00:30.352 +0000 [   
1864791][      56] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-18:2011-03-08T18:03:37.975 +0000 [   
2052414][      63] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-18:2011-03-08T18:05:31.503 +0000 [   
2165942][      64] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-19:2011-03-08T19:22:28.522 +0000 [   
6782961][     227] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-AKNS-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-20:2011-03-08T20:43:21.443 +0000 [  
11635882][     378] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:08:26.251 +0000 [  
13140690][     452] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:09:43.658 +0000 [  
13218097][     453] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:09:50.605 +0000 [  
13225044][     454] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-2km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:10:06.784 +0000 [  
13241223][     456] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-1km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:11:53.712 +0000 [  
13348151][     457] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:12:05.555 +0000 [  
13359994][     511] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-2km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:12:08.081 +0000 [  
13362520][     512] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-6km-hourly-GNOME
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:13:10.035 +0000 [  
13424474][     554] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USHI-2km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:13:51.128 +0000 [  
13465567][     558] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-500m-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:33:46.437 +0000 [  
14660876][     607] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-PRVI-6km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:33:56.280 +0000 [  
14670719][     611] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USEGC-1km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:41:02.499 +0000 [  
15096938][     656] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-2km-hourly-RTV
logs/threddsServlet.log.2011-03-08-21:2011-03-08T21:41:21.494 +0000 [  
15115933][     661] ERROR - ucar.nc2.ncml.Aggregation - Cant make cache 
directory= 
/usr/share/tomcat6/content/thredds/cache/agg/HFRNet-USWC-1km-hourly-RTV
logs/threddsServlet.log.2011-03-14-18:2011-03-14T18:00:12.762 +0000 [ 
520247201][   18265] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/193329828-RTV.nc
logs/threddsServlet.log.2011-03-14-18:2011-03-14T18:00:17.807 +0000 [ 
520252246][   18266] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-613858041-RTV.nc
logs/threddsServlet.log.2011-03-14-18:2011-03-14T18:00:35.486 +0000 [ 
520269925][   18267] ERROR - thredds.server.ncSubset.GridServlet - Writing to 
/data/tmp/thredds/ncSubsetCache/-1336016402-RTV.nc

<?xml version="1.0" encoding="UTF-8"?>
<catalog name="HFRNET Top Catalog"
        xmlns="http://www.unidata.ucar.edu/namespaces/thredds/InvCatalog/v1.0";
        xmlns:xlink="http://www.w3.org/1999/xlink";>

  <dataset name="HF RADAR RTVs">
    <catalogRef xlink:title="HF RADAR, Alaska, North Slope" 
xlink:href="HFRADAR_AKNS_hourly_RTV.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US West Coast" 
xlink:href="HFRADAR_USWC_hourly_RTV.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US East and Gulf Coast" 
xlink:href="HFRADAR_USEGC_hourly_RTV.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US Hawai'i State" 
xlink:href="HFRADAR_USHI_hourly_RTV.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, Puerto Rico and the US Virgin Islands" 
xlink:href="HFRADAR_PRVI_hourly_RTV.xml" name=""/>
  </dataset>

  <dataset name="HF RADAR RTVs (GNOME Format)">
    <catalogRef xlink:title="HF RADAR, Alaska, North Slope (GNOME Format)" 
xlink:href="HFRADAR_AKNS_hourly_GNOME.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US West Coast (GNOME Format)" 
xlink:href="HFRADAR_USWC_hourly_GNOME.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US East and Gulf Coast (GNOME Format)" 
xlink:href="HFRADAR_USEGC_hourly_GNOME.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, US Hawai'i State (GNOME Format)" 
xlink:href="HFRADAR_USHI_hourly_GNOME.xml" name=""/>
    <catalogRef xlink:title="HF RADAR, Puerto Rico and the US Virgin Islands 
(GNOME Format)" xlink:href="HFRADAR_PRVI_hourly_GNOME.xml" name=""/>
  </dataset>

</catalog>

<?xml version="1.0" encoding="UTF-8"?>
<threddsConfig>



  <!-- all options are commented out in standard install - meaning use default 
values -->
  <!-- see 
http://www.unidata.ucar.edu/projects/THREDDS/tech/reference/ThreddsConfigXMLFile.html
 -->
  <serverInformation>
    <name>CORDC Production TDS</name>
    <logoUrl>thredds.png</logoUrl>
    <logoAltText>CORDC Production TDS</logoAltText>

    <abstract>Scientific Data</abstract>
    <keywords>climate, ocean, earth science, ocean currents, HF radar</keywords>
    
    <contact>
      <name>Tom Cook</name>
      <organization>CORDC</organization>
      <email>address@hidden</email>
      <!--phone></phone-->
    </contact>
    <hostInstitution>
      <name>Coastal Observing Research and Development Center, Scripps 
Institution of Oceanography</name>
      <webSite>http://cordc.ucsd.edu</webSite>
      <logoUrl>web_bw_thmb.gif</logoUrl>
      <logoAltText>CORDC/SIO</logoAltText>
    </hostInstitution>
  </serverInformation>

  <!--
  The <catalogRoot> element:
  For catalogs you don't want visible from the /thredds/catalog.xml chain
  of catalogs, you can use catalogRoot elements. Each catalog root config
  catalog is crawled and used in configuring the TDS.
  -->

  <catalogRoot>all.xml</catalogRoot>

  <!--
   * Setup for generated HTML pages.
   *
   * NOTE: URLs may be absolute or relative, relative URLs must be relative
   * to the webapp URL, i.e., http://server:port/thredds/.
    -->
  <htmlSetup>
    <!--
     * CSS documents used in generated HTML pages.
     * The CSS document given in the "catalogCssUrl" element is used for all 
pages
     * that are HTML catalog views. The CSS document given in the 
"standardCssUrl"
     * element is used in all other generated HTML pages.
     * -->
    <standardCssUrl>tds.css</standardCssUrl>
    <catalogCssUrl>tdsCat.css</catalogCssUrl>

    <!--
     * The URLs (relative to "/thredds/") and alternate text for both
     * folder and dataset icons used in HTML catalog views.
     * -->
    <folderIconUrl>folder.gif</folderIconUrl>
    <folderIconAlt>Folder</folderIconAlt>
    <datasetIconUrl>dataset.gif</datasetIconUrl> <!-- Not currently used. -->
    <datasetIconAlt>Dataset</datasetIconAlt>     <!-- Not currently used. -->

  </htmlSetup>

  <!--
   The <CatalogServices> element:
   - Services on local TDS served catalogs are always on.
   - Services on remote catalogs are set with the allowRemote element
   below. They are off by default (recommended).
   -->
  <CatalogServices>
    <allowRemote>false</allowRemote>
  </CatalogServices>

  <!--
  Configuring the CDM (netcdf-java library)
  see 
http://www.unidata.ucar.edu/software/netcdf-java/reference/RuntimeLoading.html

  <nj22Config
    <ioServiceProvider class="edu.univ.ny.stuff.FooFiles"/>
    <coordSysBuilder convention="foo" class="test.Foo"/>
    <coordTransBuilder name="atmos_ln_sigma_coordinates" type="vertical" 
class="my.stuff.atmosSigmaLog"/>
    <typedDatasetFactory datatype="Point" 
class="gov.noaa.obscure.file.Flabulate"/>
    <table type="GRIB1" filename="/home/rkambic/grib/tables/userlookup.lst"/>
    <table type="GRIB2" 
filename="/home/rkambic/grib/tables/grib2userparameters"/>
  </nj22Config>
  -->

  <!--
  CDM uses the DiskCache directory to store temporary files, like uncompressed 
files.
  <DiskCache>
    <alwaysUse>false</alwaysUse>
    <dir>/data/tmp/thredds/cache/</dir>
    <scour>1 hour</scour>
    <maxSize>1 Gb</maxSize>
  </DiskCache>
  -->

  <!--
  Caching open NetcdfFile objects.
  default is to allow 200 - 400 open files, cleanup every 10 minutes
  <NetcdfFileCache>
    <minFiles>200</minFiles>
    <maxFiles>400</maxFiles>
    <scour>10 min</scour>
  </NetcdfFileCache>
  -->

  <!--
  Caching open NetcdfDataset objects.
   default allow 100 - 200 open datasets, cleanup every 10 minutes
  <NetcdfDatasetCache>
    <minFiles>100</minFiles>
    <maxFiles>200</maxFiles>
    <scour>10 min</scour>
  </NetcdfDatasetCache>
  -->

  <!--
  The <HTTPFileCache> element:
  allow 20 - 40 open datasets, cleanup every 10 minutes
  used by HTTP Range requests.
  <HTTPFileCache>
    <minFiles>20</minFiles>
    <maxFiles>40</maxFiles>
    <scour>10 min</scour>
  </HTTPFileCache>
  -->

  <!--
  Writing GRIB indexes.
  <GribIndexing>
    <setExtendIndex>false</setExtendIndex>
    <alwaysUseCache>false</alwaysUseCache>
  </GribIndexing>
  -->

  <!--
  Persist joinNew aggregations to named directory. scour every 24 hours, delete 
stuff older than 30 days
  <AggregationCache>
    <dir>/data/tmp/thredds/aggcache/</dir>
    <scour>24 hours</scour>
    <maxAge>30 days</maxAge>
  </AggregationCache>
  -->

  <!--
  How to choose the template dataset for an aggregation. latest, random, or 
penultimate
  -->
  <Aggregation>
    <typicalDataset>penultimate</typicalDataset>
  </Aggregation>

  <!--
  The Netcdf Subset Service is off by default.
  -->
  <NetcdfSubsetService>
    <allow>true</allow>
    <dir>/data/tmp/thredds/ncSubsetCache/</dir>
    <scour>10 min</scour>
    <maxAge>-1 min</maxAge>
    <metarDataDir>/opt/tomcat/content/thredds/public/stn/</metarDataDir>
    <metarRawDir>/data/ldm/pub/decoded/netcdf/surface/metar/</metarRawDir>
  </NetcdfSubsetService>

  <!--
  <Opendap>
    <ascLimit>50</ascLimit>
    <binLimit>500</binLimit>
    <serverVersion>opendap/3.7</serverVersion>
  </Opendap>
    -->
  
  <!--
  The WCS Service is off by default.
  Also, off by default (and encouraged) is operating on a remote dataset.
  -->
  <WCS>
    <allow>true</allow>
    <allowRemote>false</allowRemote>
    <dir>/data/tmp/thredds/wcsCache/</dir>
    <scour>15 min</scour>
    <maxAge>30 min</maxAge>
  </WCS>

  <WMS>
    <allow>true</allow>
    <allowRemote>false</allowRemote>
    <dir>/data/tmp/thredds/wmsCache/</dir>
    <maxImageWidth>2048</maxImageWidth>
    <maxImageHeight>2048</maxImageHeight>
  </WMS>


  <!-- CatalogGen service is off by default.
  <CatalogGen>
    <allow>false</allow>
  </CatalogGen>
   -->

  <!-- DLwriter service is off by default.
       As is support for operating on remote catalogs.
  <DLwriter>
    <allow>false</allow>
    <allowRemote>false</allowRemote>
  </DLwriter>
   -->

  <!-- DqcService is off by default.
  <DqcService>
    <allow>false</allow>
  </DqcService>
   -->

  <!--
   Link to a Viewer application on the HTML page:
   <Viewer>my.package.MyViewer</Viewer>
   -->

   <!--
   Add a DataSource - essentially an IOSP with access to Servlet request 
parameters
   <DatsetSource>my.package.DatsetSourceImpl</DatsetSource>
   -->

  <!--
  Forecast Model Run Collection Inventory
  <FmrcInventory>
    <openType>XML_ONLY</openType>
  </FmrcInventory>
  -->

  <!--
  Modify Logging parameters. Normally use log4j.xml
  <Logging>
    <DatePattern></DatePattern>
    <MaxFileSize></MaxFileSize>
    <MaxFiles></MaxFiles>
  </Logging>
  -->

</threddsConfig>

References:
- Re: occasional weird timestamps and bad data with THREDDS
  - From: John Caron

Prev by Date: Re: occasional weird timestamps and bad data with THREDDS
Next by Date: [THREDDS #DBM-443174]: NetcdfSubset service not working with non-standard THREDDS paths
Previous by thread: Re: occasional weird timestamps and bad data with THREDDS
Next by thread: Re: occasional weird timestamps and bad data with THREDDS
Index(es):
- Date
- Thread