[IDV #WHM-665465]: Can not select some DFFD datasets

Greetings Albert,

There is a catalog, but unfortunately there is a bug such that not all
of the datasets get listed for the NDFD (not sure about the others 
yet). You can browse through the dev server by visiting:

http://motherlode.ucar.edu:9080/thredds/catalog.html

Note that even though some of the datasets aren't listed, you can 
still access them by editing the url to point to the missing data.
Also note that because this is a dev server, things such as catalog
layout are subject to change.

Cheers!

Sean

> Sean,
> 
> Is there a catalog of this I can see what is available? I want to
> iterate though several datasets using a jython script  but need a
> catalog to iterate through.
> 
> Thanks,
> Albert
> 
> On 7/19/2012 1:41 PM, Unidata IDV Support wrote:
> > Greetings Albert,
> >
> >> On 7/13/2012 8:21 PM, Unidata IDV Support wrote:
> >>> Greetings Albert,
> >>>
> >>> Yes, I looked into this a bit more and found that the problem happens
> >>> pretty often. I don't seem to have any issues with the non-conduit NDFD 
> >>> grids:
> >>>
> >>> http://motherlode.ucar.edu/thredds/catalog/fmrc/NCEP/NDFD/CONUS_5km/files/catalog.xml
> >>> '
> >> Sean,
> >>
> >> The issue for non-conduit NDFD grids is I need temps and dew points, not
> >> the daily extremes which is what seems to be in that data. I also will
> >> be building a compiling forecasted temp database for Central Park
> >> (interpolated) from NDFD so need to go though the data sets procedurally
> >> via IDV scripting so a manual download is not really viable.
> > We have a development THREDDS server that seems to have the data
> > you need. You should be able to use the following url in your script
> > to get the data (modify for date and time, of course):
> >
> > dods://motherlode.ucar.edu:9080/thredds/dodsC/grib/NCEP/NDFD/CONUS_5km_conduit/files/NDFD_CONUS_5km_conduit_YYYYMMDD_HHMM.grib2
> >
> > Let me know if this works for you.  Cheers!
> >
> > Sean
> >
> >> Cheers,
> >> Albert
> >>
> >>
> >>
> >>> However, they are only available for 12Z and 18Z.
> >>>
> >>> One way around this is to download the conduit-feed grib2 file to your
> >>> disk and load it directly into the IDV, using the following steps:
> >>>
> >>> 1) Go to 
> >>> http://motherlode.ucar.edu/thredds/catalog/NCEP/NDFD/conduit/CONUS_5km/catalog.html
> >>> find the output you wish to use, and follow that link.
> >>>
> >>> 2) On the page that the link takes you to, look for the 'Access' section 
> >>> and
> >>> click on the link after "HTTPServer" - this will download the grib2 file.
> >>>
> >>> 3) In the IDV, go to the Dashboard and click on the "Data Choosers" tab.
> >>> Make sure to select "General -> Files" on the left side of the dashboard,
> >>> then use the file system explorer in the shown in the "Data Choosers" tab
> >>> to navigate to the file you just downloaded, and click "Add Source."
> >>>
> >>> Given that this works, it seems like there may be a bug in THREDDS, so
> >>> I've submitted a bug that you can follow along with, if you wish:
> >>>
> >>> https://www.unidata.ucar.edu/jira/browse/TDS-305
> >>>
> >>> I'm not aware of any other sources for NDFD as we distribute it (it looks
> >>> like NOMADS may break up the file into several regions  for serving
> >>> http://nomads.ncdc.noaa.gov/thredds/catalog.html).
> >>>
> >>> Cheers,
> >>>
> >>> Sean
> >>>
> >>>> Sean,
> >>>>
> >>>> There are other examples peppered in the data sets that it can not read.
> >>>> This seems to be an ongoing issue. For example today (7/13) 2100, 2000,
> >>>> 1700 plus more have the same problem. (Something like a 1/3-1/2 or the
> >>>> datasets have the issue.)
> >>>> Are there other sources for the NCEP NDFD (current not historical) data?
> >>>>
> >>>> Thanks,
> >>>> Albert
> >>>>
> >>>>
> >>>> On 7/13/2012 11:49 AM, Unidata IDV Support wrote:
> >>>>> Greetings Albert!
> >>>>>
> >>>>> It looks like the 12 and 13 Z grib files from 2012-07-10 are messed up, 
> >>>>> but the others I tried are
> >>>>> ok. I'll look into what happened, but you shouldn't have any issues 
> >>>>> accessing other NDFD data. Let
> >>>>> me know if you see any other issues.
> >>>>>
> >>>>> Cheers,
> >>>>>
> >>>>> Sean
> >>>>>
> >>>>>> Full Name: Albert Boulanger
> >>>>>> Email Address:address@hidden
> >>>>>> Organization: Columbia University
> >>>>>> Package Version: 3.0u2 build date:2012-02-10 17:21 UTC
> >>>>>> Operating System: Windows 7
> >>>>>> Hardware: Java: home: D:\IDV_3.0u2\jre version: 1.6.0_20 j3d:1.5.2 fcs 
> >>>>>> (build4)
> >>>>>> Description of problem: I get this error when selecting this dataset. 
> >>>>>> Pretty straightforward error.
> >>>>>>
> >>>>>> There was an error loading the data:
> >>>>>> Error creating data source:OPENDAP.GRID 
> >>>>>> with:http://motherlode.ucar.edu:8080/thredds/dodsC/NCEP/NDFD/conduit/CONUS_5km/NDFD_CONUS_5km_conduit_20120710_1200.grib2
> >>>>>> Grid data source failed making data set: 
> >>>>>> dods://motherlode.ucar.edu:8080/thredds/dodsC/NCEP/NDFD/conduit/CONUS_5km/NDFD_CONUS_5km_conduit_20120710_1200.grib2
> >>>>>> Variable name (time) must be unique within Group
> >>>>>>
> >>>>>> ******************
> >>>>>> Stack trace:
> >>>>>> java.lang.IllegalArgumentException: Variable name (time) must be 
> >>>>>> unique within Group
> >>>>>> at ucar.nc2.Group.addVariable(Group.java:458)
> >>>>>> at ucar.nc2.dods.DODSNetcdfFile.addVariable(DODSNetcdfFile.java:646)
> >>>>>> at 
> >>>>>> ucar.nc2.dods.DODSNetcdfFile.constructTopVariables(DODSNetcdfFile.java:616)
> >>>>>> at ucar.nc2.dods.DODSNetcdfFile.<init>(DODSNetcdfFile.java:271)
> >>>>>> at ucar.nc2.dataset.NetcdfDataset.acquireDODS(NetcdfDataset.java:809)
> >>>>>> at 
> >>>>>> ucar.nc2.dataset.NetcdfDataset.openOrAcquireFile(NetcdfDataset.java:654)
> >>>>>> at ucar.nc2.dataset.NetcdfDataset.openDataset(NetcdfDataset.java:424)
> >>>>>> at 
> >>>>>> ucar.nc2.dataset.NetcdfDataset.acquireDataset(NetcdfDataset.java:520)
> >>>>>> at ucar.nc2.dt.grid.GridDataset.open(GridDataset.java:101)
> >>>>>> at ucar.nc2.dt.grid.GridDataset.open(GridDataset.java:87)
> >>>>>> at 
> >>>>>> ucar.unidata.data.grid.GeoGridDataSource.doMakeDataSet(GeoGridDataSource.java:1094)
> >>>>>> at 
> >>>>>> ucar.unidata.data.grid.GeoGridDataSource.getDataset(GeoGridDataSource.java:1116)
> >>>>>> at 
> >>>>>> ucar.unidata.data.grid.GeoGridDataSource.initAfterCreation(GeoGridDataSource.java:478)
> >>>>>> at 
> >>>>>> ucar.unidata.data.DataManager.createDataSource(DataManager.java:1577)
> >>>>>> at 
> >>>>>> ucar.unidata.idv.IntegratedDataViewer.createDataSource(IntegratedDataViewer.java:1980)
> >>>>>> at 
> >>>>>> ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1897)
> >>>>>> at 
> >>>>>> ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1831)
> >>>>>> at 
> >>>>>> ucar.unidata.idv.IntegratedDataViewer.makeDataSource(IntegratedDataViewer.java:1804)
> >>>>>> at 
> >>>>>> ucar.unidata.idv.chooser.IdvChooser.makeDataSource(IdvChooser.java:943)
> >>>>>> at 
> >>>>>> ucar.unidata.idv.chooser.XmlChooser.makeDataSource(XmlChooser.java:280)
> >>>>>> at 
> >>>>>> ucar.unidata.idv.chooser.ThreddsHandler.processNodes(ThreddsHandler.java:851)
> >>>>>> at 
> >>>>>> ucar.unidata.idv.chooser.ThreddsHandler.processNode(ThreddsHandler.java:780)
> >>>>>> at sun.reflect.GeneratedMethodAccessor142.invoke(Unknown Source)
> >>>>>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
> >>>>>> at java.lang.reflect.Method.invoke(Unknown Source)
> >>>>>> at ucar.unidata.util.Misc$2.run(Misc.java:1064)
> >>>>>> at ucar.unidata.util.Misc$3.run(Misc.java:1090)
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>> Ticket Details
> >>>>> ===================
> >>>>> Ticket ID: WHM-665465
> >>>>> Department: Support IDV
> >>>>> Priority: Normal
> >>>>> Status: Open
> >>>>>
> >>>>>
> >>>>
> >>> Ticket Details
> >>> ===================
> >>> Ticket ID: WHM-665465
> >>> Department: Support IDV
> >>> Priority: Normal
> >>> Status: Open
> >>>
> >>>
> >>
> >>
> >
> > Ticket Details
> > ===================
> > Ticket ID: WHM-665465
> > Department: Support IDV
> > Priority: Normal
> > Status: Open
> >
> >
> 
> 


Ticket Details
===================
Ticket ID: WHM-665465
Department: Support IDV
Priority: Normal
Status: Open