[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[netCDF #QEA-741463]: NetCDF4 Structural Overhead

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [netCDF #QEA-741463]: NetCDF4 Structural Overhead
  • Date: Tue, 08 Apr 2008 21:45:40 -0600
Roy,

A little more information on this.  According to a presentation given in
November at the HDF/HDF-EOS
workshop, groups have overhead for a B-tree used to manage the objects in each
group.  This
overhead is fairly significant.  An example given is an HDF5 file with 11,600
groups that used to
require 20 MB in HDF5 version 1.6 but now requires only 12 MB in HDF5 version
1.8.  That works out
to about 1000 bytes/group overhead, which may discourage use of lots of small
groups ...

--Russ


Russ Rew                                         UCAR Unidata Program
address@hidden                     http://www.unidata.ucar.edu



Ticket Details
===================
Ticket ID: QEA-741463
Department: Support netCDF
Priority: Normal
Status: Closed