[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #APD-588827]: IDV Station ragged array (contiguous) representation

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [IDV #APD-588827]: IDV Station ragged array (contiguous) representation
  • Date: Fri, 12 Nov 2010 09:55:57 -0700
Hi Helfried

For clarification, when loading the data into the IDV, what are you choosing as 
the data source type?

-Julien

> Dear IDV people,
> 
> I am using IDV version 9.2u2 on Windows XP
> 
> Attached is a netcdf file with station data in ragged array (contiguous)
> representation.
> 
> There are about 8027 stations over 58 years, which gives about 90000
> observations.
> 
> When IDV tries to read the data in, it is counting 2193500 observations,
> until the 1024 Gb memory are consumed and the story ends with a heap space
> error.
> 
> Adding the time, lat, lon, alt and station name to each individual
> observation would require less than 500000 observations.
> 
> What is the reason for this memory inefficiency of IDV? Can I do anything
> about that?
> 
> Thank you and with kind regards,
> 
> Helfried
> 
> -----------------------------------------------------------------
> Dr. Helfried Scheifinger
> Fachabteilung Klima/Section Climate
> Bereich Kundenservice/Division Customer Service
> Zentralanstalt für Meteorologie und Geodynamik
> 1190 Wien, Hohe Warte 38
> Tel.: +43 (0)1 / 36 0 26 / 2226
> Fax: +43 (0)1 / 36 0 26 74
> E-Mail: address@hidden
> Homepage:  <http://www.zamg.ac.at/> www.zamg.ac.at
> -----------------------------------------------------------------
> 
> 
> 
> 
> 


Ticket Details
===================
Ticket ID: APD-588827
Department: Support IDV
Priority: Normal
Status: Open