[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: FW: Catalog generator crawling remote OPenDAP/DODS servers - thank you!!

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: Re: FW: Catalog generator crawling remote OPenDAP/DODS servers - thank you!!
  • Date: Tue, 20 Jun 2006 15:13:35 -0600
Hi Bas,

Bas Retsios wrote:

Hello Ethan,
Thank you for your suggestions!! For now they have helped me sufficiently so that I can continue on my own for a while. 
Great.
I have one important point to add (because it took me a while to find it): To achieve the "recursive crawling" that I needed, I had to make sure that "StandardCatalogBuilder" is called with a "new BooleanCatalogRefExpander(expandAll = true)". I did notice that StandardCatalogBuilder was called from two places (DirectoryScanner and DatasetScanCatalogBuilder) but the existing code and test calls had expandAll = false.
Yes, sorry about that, the documentation is a bit sketchy. I've added that to my documentation list.
We don't do any recursive crawling in the TDS (users end up stepping through one collection level at a time) and, as you say, it looks like all our tests are for single level catalogs. I believe that some of our code uses DirectoryScanner to build multilevel catalogs. So, hopefully you won't run into any bugs in the building of multilevel catalogs. Let me know if you do. 

Ethan

--
Ethan R. Davis                                Telephone: (303) 497-8155
Software Engineer                             Fax:       (303) 497-8690
UCAR Unidata Program Center                   E-mail:    address@hidden
P.O. Box 3000
Boulder, CO  80307-3000                       http://www.unidata.ucar.edu/
---------------------------------------------------------------------------