On Wed, 14 Feb 2007, John Horel wrote:
Robb-
Starting to put together the equipment proposal to Unidata, which in
part, would include a data server to serve up mesonet observations.
So, I'd like to follow up on our conversations in San Antonio as far
as possible approaches. I'm still a bit fuzzy as to what would be the
best way to do it. My preference would be to develop a query directly
to our database rather than having to store the data in an external
hosted format. That way we don't have to keep around all 10 years of
data in a netCDF file format or some such. Have you had a chance to
proceed with your middleware to handle metars? And, could you describe
that approach a bit more for me?
Regards,
John
John,
your timing is perfect, yesterday our group had a meeting on this. in
fact, the last month i created a realtime database to store the Metars.
at this time there is a simple url servlet interface that permits one to
make queries against it. so your idea of maintaining the data in a
database is the correct approach. i'm just starting on making a general
station observation dataset adapter that would create the link from some
data repository ie database into the Java netcdf library, then the IDV.
the station observation dataset adapter would get enough info so it
could know how to query the proper data repository. at this time, i
don't know the type/amount of info needed. i'll keep you informed on our
progress.
do you keep all the data in one database? i was planning on daily
creating a new database file for data that was 3 days old and only
keeping ~3 days of data in the realtime database. this way the
performance would be good for the realtime requests and archive requests
would require opening the daily database files.
Machine requirements guess...
the Thredds Data Server would have to be installed on the machine with
cpu power to handle the amount of requests plus good network
conectivity. i'm sure you have a better handle on the disk space
requirements. you might want to look at THREDDS page for requirements
for the TDS.
http://www.unidata.ucar.edu/projects/THREDDS/
robb...
===============================================================================
Robb Kambic Unidata Program Center
Software Engineer III Univ. Corp for Atmospheric Research
address@hidden WWW: http://www.unidata.ucar.edu/
===============================================================================