[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #APD-588827]: IDV Station ragged array (contiguous) representation

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [IDV #APD-588827]: IDV Station ragged array (contiguous) representation
  • Date: Mon, 15 Nov 2010 21:02:09 -0700
> Hi Julien,
> 
> I am choosing "netCDF/GEMPACK point data files"
> 
> 
> Helfried

Hi Helfried,
       The problem is that you need to subset this kind of big point dataset. 
To create a point data display,the IDV will read in all the data and create the 
data object for each point, so the only possible is to do the spatial subset of 
this data after load the data into the IDV. In the Field Selector window, the 
lower right panel is the subset panel, in the Region, you can do the subset. 
Select a small region and then .....



Yuan 
> 
> -----Ursprüngliche Nachricht-----
> Von: Unidata IDV Support [mailto:address@hidden]
> Gesendet: Freitag, 12. November 2010 17:56
> An: address@hidden
> Cc: address@hidden
> Betreff: [IDV #APD-588827]: IDV Station ragged array (contiguous) 
> representation
> 
> Hi Helfried
> 
> For clarification, when loading the data into the IDV, what are you choosing 
> as the data source type?
> 
> -Julien
> 
> > Dear IDV people,
> >
> > I am using IDV version 9.2u2 on Windows XP
> >
> > Attached is a netcdf file with station data in ragged array (contiguous)
> > representation.
> >
> > There are about 8027 stations over 58 years, which gives about 90000
> > observations.
> >
> > When IDV tries to read the data in, it is counting 2193500 observations,
> > until the 1024 Gb memory are consumed and the story ends with a heap space
> > error.
> >
> > Adding the time, lat, lon, alt and station name to each individual
> > observation would require less than 500000 observations.
> >
> > What is the reason for this memory inefficiency of IDV? Can I do anything
> > about that?
> >
> > Thank you and with kind regards,
> >
> > Helfried
> >
> > -----------------------------------------------------------------
> > Dr. Helfried Scheifinger
> > Fachabteilung Klima/Section Climate
> > Bereich Kundenservice/Division Customer Service
> > Zentralanstalt fr Meteorologie und Geodynamik
> > 1190 Wien, Hohe Warte 38
> > Tel.: +43 (0)1 / 36 0 26 / 2226
> > Fax: +43 (0)1 / 36 0 26 74
> > E-Mail: address@hidden
> > Homepage:  <http://www.zamg.ac.at/> www.zamg.ac.at
> > -----------------------------------------------------------------
> >
> >
> >
> >
> >
> 
> 
> Ticket Details
> ===================
> Ticket ID: APD-588827
> Department: Support IDV
> Priority: Normal
> Status: Open
> 
> 


Ticket Details
===================
Ticket ID: APD-588827
Department: Support IDV
Priority: Normal
Status: Closed