[IDV #CGO-734297]: Directory Data load error

Hi Jason-

Sorry for the delay in responding.  We were out last week.

This is a bug that we are working on a fix for.  Thanks for finding it.  The
basic problem is that there is a space in the directory path (Documents and 
Settings)
which the URI parser doesn't like.  The quick solution would be to put
the files in a directory that doesn't have a space in it's path 
(e.g. c:\data\nam12km).

I'll let you know when we have a fix for this.

Don Murray

> I was trying to load a full run of 12km nam grib2 files from the ncep ftp. 
> They were in the format:
> nam.t00z.awip21800.24.grib2
> nam.t00z.awip21803.24.grib2
> nam.t00z.awip21806.24.grib2
> etc..
> 
> I was using aggregated grib for the data type from the directory chooser.  
> When I used the verify button. The files showed up according to my mask which 
> was "nam".  They were stored locally on my hd and the directory did not have 
> any files changing or being added or removed.  When I loaded them from the 
> files chooser, each file loaded fine individually but when I selected 
> multiple files from open dialog, it returned the same error as loading the 
> directory.  The settings I used were:
> 
> Data Source Type: Aggregated Grib Files
> Directory: C:\Documents and Settings\IceDown\My Documents\nam12km
> Name: Nam12km
> File Pattern: nam
> Include Hidden Files: False
> Files: All Files
> Polling: Off
> 
> Here is a dir from the directory;
> 
> C:\Documents and Settings\IceDown\My Documents\nam12km>dir
> Volume in drive C has no label.
> Volume Serial Number is 68E1-42C6
> 
> Directory of C:\Documents and Settings\IceDown\My Documents\nam12k
> 
> 06/06/2008  12:38 AM    <DIR>          .
> 06/06/2008  12:38 AM    <DIR>          ..
> 06/06/2008  12:35 AM           704,833 nam.t00z.awip21800.24.grib2
> 06/06/2008  12:35 AM           714,343 nam.t00z.awip21803.24.grib2
> 06/06/2008  12:35 AM           734,774 nam.t00z.awip21806.24.grib2
> 06/06/2008  12:35 AM           782,025 nam.t00z.awip21809.24.grib2
> 06/06/2008  12:35 AM           795,738 nam.t00z.awip21812.24.grib2
> 06/06/2008  12:35 AM           833,403 nam.t00z.awip21815.24.grib2
> 06/06/2008  12:35 AM           847,629 nam.t00z.awip21818.24.grib2
> 06/06/2008  12:35 AM           852,618 nam.t00z.awip21821.24.grib2
> 06/06/2008  12:35 AM           823,275 nam.t00z.awip21824.24.grib2
> 06/06/2008  12:35 AM           794,228 nam.t00z.awip21827.24.grib2
> 06/06/2008  12:35 AM           774,695 nam.t00z.awip21830.24.grib2
> 06/06/2008  12:35 AM           785,296 nam.t00z.awip21833.24.grib2
> 06/06/2008  12:35 AM           777,855 nam.t00z.awip21836.24.grib2
> 06/06/2008  12:35 AM           733,715 nam.t00z.awip21839.24.grib2
> 06/06/2008  12:35 AM           758,295 nam.t00z.awip21842.24.grib2
> 06/06/2008  12:35 AM           740,219 nam.t00z.awip21845.24.grib2
> 06/06/2008  12:35 AM           700,377 nam.t00z.awip21848.24.grib2
> 06/06/2008  12:35 AM           690,566 nam.t00z.awip21851.24.grib2
> 06/06/2008  12:35 AM           696,776 nam.t00z.awip21854.24.grib2
> 06/06/2008  12:35 AM           698,545 nam.t00z.awip21857.24.grib2
> 06/06/2008  12:35 AM           698,443 nam.t00z.awip21860.24.grib2
> 06/06/2008  12:35 AM           713,499 nam.t00z.awip21863.24.grib2
> 06/06/2008  12:35 AM           759,078 nam.t00z.awip21866.24.grib2
> 06/06/2008  12:35 AM           770,578 nam.t00z.awip21869.24.grib2
> 06/06/2008  12:35 AM           762,907 nam.t00z.awip21872.24.grib2
> 06/06/2008  12:35 AM           751,244 nam.t00z.awip21875.24.grib2
> 06/06/2008  12:35 AM           750,690 nam.t00z.awip21878.24.grib2
> 06/06/2008  12:35 AM           739,236 nam.t00z.awip21881.24.grib2
> 06/06/2008  12:35 AM           739,981 nam.t00z.awip21884.24.grib2
> 29 File(s)     21,924,861 bytes
> 2 Dir(s)     964,378,624 bytes free
> 
> 
> 
> If you need anymore information please contact me.  I still have everything 
> the same and can still duplicate the problem.
> 
> 
> -----Original Message-----
> From: Unidata IDV Support [mailto:address@hidden]
> Sent: Friday, June 06, 2008 9:38 AM
> To: address@hidden
> Subject: [IDV #CGO-734297]: Directory Data load error
> 
> Hi Jason-
> 
> > Full Name: Jason Brooks
> > Email Address: address@hidden
> > Organization: StormGuard Solutions
> > Package Version: 2.5 build date:2008-05-08 07:05 UTC
> > Operating System: Windows XP
> > Hardware: Java: home: C:\Program Files\IDV_2.5\jre version: 1.5.0_11 
> > j3d:1.3.2 fcs (build12)
> > Description of problem: There was an error loading the data:
> > java.lang.IllegalArgumentException
> >
> > Full trace includes this:
> >
> > Caused by: java.net.URISyntaxException: Illegal character in opaque part at 
> > index 23: file:file:/C:/Documents and Settings/IceDown/My 
> > Documents/nam12km/nam.t00z.awip21800.24.grib2
> >
> > I think the error is here:
> > file:file:/C:/
> >
> > Shouldn't it be
> > file:file://C:/
> >
> > This same error shows up when loading mulple files rom the files data 
> > source.  One file works fine though.
> 
> A few questions:
> 
> - what are you trying to do here?  Is it that you have several files,
> each with a different forecast time and you want to create an cohesive
> data set?
> - are you setting the Data Soure Type to Aggregated GRIB files?
> - when using the Directory chooser, is the data changing in that directory?
> 
> Thanks.
> 
> Don Murray
> > ******************
> > Stack trace:
> > java.lang.IllegalArgumentException
> > at java.net.URI.create(URI.java:842)
> > at ucar.nc2.util.NetworkUtils.resolve(NetworkUtils.java:66)
> > at ucar.nc2.ncml.NcMLReader.readNcML(NcMLReader.java:283)
> > at ucar.nc2.ncml.NcMLReader.access$100(NcMLReader.java:48)
> > at ucar.nc2.ncml.NcMLReader$NcmlElementReader.open(NcMLReader.java:1095)
> > at ucar.nc2.NetcdfFileCache.acquire(NetcdfFileCache.java:188)
> > at ucar.nc2.ncml.Aggregation$Dataset._acquireFile(Aggregation.java:1185)
> > at ucar.nc2.ncml.Aggregation$Dataset.acquireFile(Aggregation.java:1171)
> > at ucar.nc2.ncml.Aggregation$Dataset.getNcoords(Aggregation.java:1099)
> > at ucar.nc2.ncml.Aggregation$Dataset.setStartEnd(Aggregation.java:1120)
> > at ucar.nc2.ncml.Aggregation$Dataset.access$100(Aggregation.java:1001)
> > at ucar.nc2.ncml.Aggregation.buildCoords(Aggregation.java:315)
> > at 
> > ucar.nc2.ncml.AggregationExisting.buildDataset(AggregationExisting.java:61)
> > at ucar.nc2.ncml.Aggregation.finish(Aggregation.java:293)
> > at ucar.nc2.ncml.NcMLReader.readNetcdf(NcMLReader.java:397)
> > at ucar.nc2.ncml.NcMLReader.readNcML(NcMLReader.java:339)
> > at ucar.nc2.ncml.NcMLReader.readNcML(NcMLReader.java:191)
> > at ucar.nc2.ncml.NcMLReader.readNcML(NcMLReader.java:143)
> > at ucar.nc2.dataset.NetcdfDataset.openFile(NetcdfDataset.java:328)
> > at ucar.nc2.dataset.NetcdfDataset.openDataset(NetcdfDataset.java:175)
> > at ucar.nc2.dataset.NetcdfDatasetCache.acquire(NetcdfDatasetCache.java:203)
> > at ucar.nc2.dataset.NetcdfDatasetCache.acquire(NetcdfDatasetCache.java:183)
> > at ucar.nc2.dataset.NetcdfDatasetCache.acquire(NetcdfDatasetCache.java:171)
> > at ucar.nc2.dt.grid.GridDataset.open(GridDataset.java:72)
> > at 
> > ucar.unidata.data.grid.GeoGridDataSource.doMakeDataSet(GeoGridDataSource.java:961)
> > at 
> > ucar.unidata.data.grid.GeoGridDataSource.getDataset(GeoGridDataSource.java:982)
> > at 
> > ucar.unidata.data.grid.GeoGridDataSource.doMakeDataChoices(GeoGridDataSource.java:1009)
> > at ucar.unidata.data.DataSourceImpl.getDataChoices(DataSourceImpl.java:1681)
> > at 
> > ucar.unidata.data.FilesDataSource.sourcesChanged(FilesDataSource.java:403)
> > at 
> > ucar.unidata.data.grid.GeoGridDataSource.sourcesChanged(GeoGridDataSource.java:521)
> > at 
> > ucar.unidata.data.FilesDataSource.initWithPollingInfo(FilesDataSource.java:358)
> > at 
> > ucar.unidata.data.FilesDataSource.initAfterCreation(FilesDataSource.java:269)
> > at 
> > ucar.unidata.data.grid.GeoGridDataSource.initAfterCreation(GeoGridDataSource.java:434)
> > at ucar.unidata.data.DataManager.createDataSource(DataManager.java:1339)
> > at 
> > ucar.unidata.idv.IntegratedDataViewer.createDataSource(IntegratedDataViewer.java:1847)
> > at 
> > ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1766)
> > at 
> > ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1700)
> > at 
> > ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1681)
> > at ucar.unidata.idv.chooser.IdvChooser.makeDataSource(IdvChooser.java:839)
> > at 
> > ucar.unidata.idv.chooser.PollingFileChooser.doLoadInThread(PollingFileChooser.java:194)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at 
> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > at 
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:585)
> > at ucar.unidata.util.Misc$2.run(Misc.java:990)
> > at ucar.unidata.util.Misc$3.run(Misc.java:1018)
> > Caused by: java.net.URISyntaxException: Illegal character in opaque part at 
> > index 23: file:file:/C:/Documents and Settings/IceDown/My 
> > Documents/nam12km/nam.t00z.awip21800.24.grib2
> > at java.net.URI$Parser.fail(URI.java:2816)
> > at java.net.URI$Parser.checkChars(URI.java:2989)
> > at java.net.URI$Parser.parse(URI.java:3026)
> > at java.net.URI.<init>(URI.java:578)
> > at java.net.URI.create(URI.java:840)
> > ... 45 more
> >
> >
> >
> 
> 
> Ticket Details
> ===================
> Ticket ID: CGO-734297
> Department: Support IDV
> Priority: Normal
> Status: Open
> 
> 


Ticket Details
===================
Ticket ID: CGO-734297
Department: Support IDV
Priority: Normal
Status: Open