[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #JSX-439663]: question of how to aggregate grid files...



Salut Gilles,

Nice to hear from you again.

Unfortunately, the message is accurate. The IDV is having trouble with
the aggregation. Time aggregations are problematic for a variety of
reasons and we are working for better solutions in this area.

In the meantime, however, there is a simple workaround with some NCML
(also, see attached):

,----
| <?xml version="1.0" encoding="UTF-8"?>
| <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
|   <aggregation type="joinExisting" dimName="time1" timeUnitsChange="true">
|     <netcdf  
location="file:/tmp/gilles/GFS_Global_0p25deg_20170611_0000.grib2.nc4"  
enhance="true" ></netcdf>
|     <netcdf  
location="file:/tmp/gilles/GFS_Global_0p25deg_20170611_1200.grib2.nc4"  
enhance="true" ></netcdf>
|   </aggregation>
| </netcdf>
`----

Here, we are explicitly setting the time dimension of `time1' we wish
to aggregate over, in this case.  This is acceptable for a "one off"
but if you are having to do this a lot, for example, for a variety of
files, there are more advanced NCML features that allow you to
template the file name. For example here, we are making use of the
NCML `scan' element.

,----
| <?xml version="1.0" encoding="UTF-8"?>
| <netcdf xmlns="http://www.unidata.ucar.edu/namespaces/netcdf/ncml-2.2";>
|   <aggregation type="joinExisting" dimName="time1" timeUnitsChange="true">
|     <scan location="file:/tmp/gilles/" 
dateFormatMark="GFS_Global_0p25deg_#yyyyMMdd_HHmm" 
|               suffix=".grib2.nc4" subdirs="false"/>
|   </aggregation>
| </netcdf>
`----

You then load these NCML files into the IDV and the aggregation should
work as you expect. See here to learn more about NCML:
[http://www.unidata.ucar.edu/software/thredds/current/netcdf-java/ncml/]

Please, keep us up-to-date on your progress.

Best,

Unidata IDV Support

> Hi there,
> 
> I normally use files in grib2 format from the RDA in IDV and when in the
> data chooser of the dashboard I use "Aggregate grids by time" and it works
> just great. Like with the first two attached files, I can then work on the
> data sequence wise.
> 
> I just tried to do the same thing with small files (see last two files)
> from the thredds server that I downloaded in netcdf4 and it does not work
> sending me this error message
> 
> "There was an error loading the data:
> Error creating data source:aggregated.netcdf.grid with:
> [~/GFS_0p25_als/GFS_Global_0p25deg_20170611_0000.grib2.nc4,
> ~/GFS_0p25_als/GFS_Global_0p25deg_20170611_1200.grib2.nc4]
> Grid data source failed making data set:
> /home/gilles/.unidata/idv/DefaultIdv/tmp/multigrid_4a4d7436-caab-4fc8-b09c-3e8220feb4ff0.ncml
> Dimension time does not exist"
> 
> Any advice or reference ticket I should look at?
> 
> Thanks for any advice,
> 
> gilles
> 
> -----------------------------------
> Dr. Gilles Arfeuille
> Profesor Investigador
> Facultad de Ciencias
> Universidad de Colima
> (52)3123147687
> address@hidden
> -----------------------------------
> 
> --
> --
> Universidad de Colima
> 
> 


Ticket Details
===================
Ticket ID: JSX-439663
Department: Support IDV
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.

Attachment: data.ncml
Description: Binary data

Attachment: data2.ncml
Description: Binary data