[netCDFJava #CPC-398807]: FW: question about large file support

Can you send the ncdump -h output?

If dimension len > 2^31-1, we dont have a workaround presently.

John

> Here is the java print out the netcdf file (version 4) using the toString() 
> method in netcdf4 java library:
> 
> netcdf 
> /home/zpli/MLS/G17/L0/Archive/IT_ABI-L0-M03_G17_s20142461945100_e20142462000180_c20142462000204.nc
>  {
> dimensions:
> number_of_packets = UNLIMITED;   // (6131690 currently
> number_of_data_bytes = UNLIMITED;   // (0 currently
> variables:
> int offset_to_packet(number_of_packets=6131690);
> :long_name = "index in the abi_space_packet_data variable of the start of the 
> packet";
> :_ChunkSize = 256; // int
> 
> float percent_uncorrectable_L0_errors;
> :units = "percent";
> :long_name = "percent uncorrectable L0 errors";
> 
> int size_of_packet(number_of_packets=6131690);
> :long_name = "size of each packet";
> :_ChunkSize = 256; // int
> 
> byte abi_space_packet_data(number_of_data_bytes=0);
> :long_name = "GOES-R Advanced Baseline Imager (ABI) L0 CCSDS Space Packets";
> :coverage_content_type = "physicalMeasurement";
> :_ChunkSize = 2048; // int
> 
> // global attributes:
> :dataset_name = 
> "IT_ABI-L0-M03_G17_s20142461945100_e20142462000180_c20142462000204.nc";
> :naming_authority = "gov.noaa.goes-r";
> :iso_series_metadata_id = "a70be540-c38b-11e0-962b-0800200c9a66";
> :Conventions = "CF-1.6";
> :Metadata_Conventions = "Unidata Dataset Discovery v1.0, CF-1.6";
> :standard_name_vocabulary = "CF Standard Name Table (v18, 22 July 2011)";
> :title = "Advanced Baseline Imager (ABI) L0 CCSDS data packets";
> :summary = "Raw data reconstructed to unprocessed instrument data at full 
> space-time resolution with all available supplemental information to be used 
> in subsequent processing appended.";
> :keywords = "SPECTRAL/ENGINEERING > INFRARED WAVELENGTHS > SENSOR COUNTS, 
> SPECTRAL/ENGINEERING > VISIBLE WAVELENGTHS > SENSOR COUNTS";
> :keywords_vocabulary = "NASA Global Change Master Directory (GCMD) Earth 
> Science Keywords, Version 7.0.0.0.0";
> :license = "Unclassified data.  Access is restricted to approved users only.";
> :institution = "DOC/NOAA/NESDIS > U.S. Department of Commerce, National 
> Oceanic and Atmospheric Administration, National Environmental Satellite, 
> Data, and Information Services";
> :date_created = "2014-09-03T20:00:20Z";
> :processing_level = "National Aeronautics and Space Administration (NASA) L0";
> :time_coverage_start = "2014-09-03T19:45:10Z";
> :time_coverage_end = "2014-09-03T20:00:18Z";
> :timeline_id = "03";
> :orbital_slot = "GOES-West";
> :platform_ID = "G17";
> :instrument_type = "GOES R Series Advanced Baseline Imager";
> :instrument_id = "ABI-1";
> :production_data_source = "Test";
> :production_site = "WCDAS";
> :production_environment = "ITE";
> :id = "c4420190-4a71-4451-a2a2-b38c2db89296";
> }
> 
> Notice the dimension number_of_data_bytes is unlimited but 0 currently. The 
> actual size is 3374823640 when using the ncdump. In netcdf Java API: 
> getLength() method for Dimension class is defined as int, the number 
> 3374823640 would return as negative for int. Do you have a sample code for 
> work around? Also, the variable offset_to_packet should be defined as 
> unsigned int, so that it could be larger than 0x7FFFFFFF. I am getting the 
> negative output values for this variable.
> 
> Thanks for your help.
> 
> Zhenping
> 
> -----Original Message-----
> From: Unidata netCDF Java Support [mailto:address@hidden]
> Sent: Tuesday, February 10, 2015 3:42 PM
> To: address@hidden
> Cc: address@hidden; address@hidden
> Subject: [netCDFJava #CPC-398807]: FW: question about large file support
> 
> Sorry for jumping in, I hope it is not too confusing.
> When you say "...when Java reads it, the dimension length is defined as the 
> (signed) integer..."
> do you mean the netcdf-java library or a program you are writing?
> If the latter, then it is possible to use the Java long type to properly 
> represent such a number.
> =Dennis Heimbigner
> Unidata
> 
> 
> Ticket Details
> ===================
> Ticket ID: CPC-398807
> Department: Support netCDF Java
> Priority: Normal
> Status: Closed
> 
> 


Ticket Details
===================
Ticket ID: CPC-398807
Department: Support netCDF Java
Priority: Normal
Status: Closed