[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: gribtonc question
- Subject: Re: gribtonc question
- Date: Tue, 20 May 2003 10:25:25 -0600 (MDT)
On Tue, 20 May 2003, [iso-8859-1] "Mathias D. Müller" wrote:
> hi Robb
>
> i still get too many dimensions with the created cdl file. it's not
> obvious what might be wrong, the dimensions in the cdl look ok.
>
> i put a grib file and the cdl file on a server:
>
> http://www.unibas.ch/geo/mcr/3d/meteo/transfer/lmbc_012
>
> http://www.unibas.ch/geo/mcr/3d/meteo/transfer/bidgdomain.cdl
Mathias,
The cdl file looks ok. Could you send a raw grib file attached to an email
and the table file if you used one. I'll take a look at it.
Robb...
>
> would be cool if you could have a look at it.
>
> a variable that's causing the trouble is called 'u' and has dimensions
> Array[183, 141, 39, 2]
> instead of Array[183, 141, 39,
>
> cu and thanks
> mathias
>
>
> At 10:55 19.05.2003 -0600, you wrote:
> On Sat, 17 May 2003, [iso-8859-1] "Mathias D. Müller" wrote:
>
> > it works now!!!!!!!!!
>
> Mathias,
>
> Great
>
> >
> > i had to compile udunits and netcdf library.
> >
> > i will have to retune the cdl file or create a tab-file (is
> there a utility
> > for the tab file?)
>
> Noop, has to be created by hand. But there is a utility to
> make the cdl
> called gribtocdl. There's man pages.
>
>
> > data in the netcdf looks good, but some 3d fields are now
> stored twice in
> > the same variable by adding a 4 th dimension
> >
> > e.g. [x,y,z,2] where [x,y,z,0] is the data which is perfect
> and [x,y,z,1]
> > is all -9999
> > anyhow it just wastes a lot of space, but the data is fine.
> >
>
> I think it's the way you created the cdl. gribtonc creates
> the space
> before hand using the supplied cdl. So if you have [x,y,z,2],
> then
> NetCDF will create [x,y,z,0] and [x,y,z,1]. Since [x,y,z,1]
> is all missing
> data values maybe your dimensions need rearranged, ie
> [x,y,z,1]. Since I
> don't know your data format my suggestion could be wrong.
> The main point is
> the space for the NetCDF file is allocated all at once for
> each new
> unlimited dimension variable (usually the record variable)
>
>
> > the 4 mb grib file is now a 80 mb netcdf, but i can read it
> much faster
> > with the idl programming language and it only takes about a
> second to
> > create the nc-file. that is awesome.
> > do you know how i could read the grib file directly with
> idl as efficient
> > as your decoder works?
>
> noop, grid is mainly a packing/transportation format.
>
> Robb...
>
> > i used to spawn wgrib, dump the grib into a binary file and
> than read this
> > binary with idl. but that takes about 2 minutes.
> > (time is very important, since i do realtime forecasting
> and have to
> > process several gigabytes of data every day)
> >
> >
> >
> > many thanks
> > mathias
> >
> > ps: here is a link to the weather forecast results:
> > http://www.unibas.ch/geo/mcr/3d/meteo/
> >
> > At 10:50 16.05.2003 -0600, you wrote:
> > >On Fri, 16 May 2003, Mathias D. Mueller wrote:
> > >
> > > > thanks
> > > >
> > > > i already had compiled with gcc. i did it by setting
> the following into the
> > > > CUSTOMIZE file
> > > >
> > > > CPP_LDM=-I/usr/local/ldm/include
> > > > LD_LDM='-L/usr/local/ldm/lib -lldm'
> > > > #
> > > > # netCDF header file and library references:
> > > > CPP_NETCDF=-I/usr/local/netcdf-3.5.0/include
> > > > LD_NETCDF='-L/usr/local/netcdf-3.5.0/lib -lnetcdf'
> > > > #
> > > > # udunits header file and library references:
> > > > CPP_UDUNITS=-I/usr/local/udunits-1.11.3/include
> > > > LD_UDUNITS='-L/usr/local/udunits-1.11.3/lib -ludunits'
> > > > #
> > > > # Type of C compiler:
> > > > CC='gcc'
> > > > #
> > > > # C compiler flags:
> > > > CFLAGS=-g
> > > > #
> > > > # Installation prefix:
> > > > prefix=/usr/local/unidata
> > > >
> > > >
> > > > the UDUNITS and netcdf library i didn't compile but
> copied a binary
> > > version from
> > > > the internet to my usr/local directory, since it seemed
> to be easier than
> > > > compiling:-)
> > >
> > >Mathias,
> > >That's probably the problem.
> > >
> > > >
> > > > i probaly have to compile those:
> > > > which source codes should i use ?
> > > >
> > >
> > >You can get the source from the web page at:
> > >
> > >http://my.unidata.ucar.edu/content/software/index.html
> > >
> > >
> > > > are there any special flags needed?
> > > >
> > >Noop
> > >
> > > > my system: RED HAT 8.0 with
> > > > Linux ws-eta 2.4.18-19.8.0 #1 Thu Dec 12 05:39:29 EST
> 2002 i686 i686
> > > i386 GNU/Linux
> > >
> > >I tested it on linux 8.0 last week
> > >
> > >Robb...
> > > >
> > > >
> > > > many thanks and best regards
> > > > mathias
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > Quoting Robb Kambic <address@hidden>:
> > > >
> > > > > On Fri, 16 May 2003, Mathias D. Mueller wrote:
> > > > >
> > > > > > hi
> > > > > > i am a phd student at the university of basel.
> > > > > > i try to decode grib files from my eta model into
> netcdf.
> > > > > >
> > > > > > i installed the new decoders.
> > > > > > i created a cdl-file, which seems to work.
> > > > > > gribdump on the girb file works also and i see all
> the data in it.
> > > > > >
> > > > > > however if i call the
> > > > > > gribtonc using the cdl-file i get only the message:
> > > > > >
> > > > > > May 16 12:40:20 gribtonc[31493]: Starting Up
> > > > > > segmentation
> > > >
> > > >
> > > > fault
> > > > > >
> > > > > > the nc-file written only probalby only contains the
> stuff from the
> > > > > cdl-file
> > > > > >
> > > > > >
> > > > > > do you have any ideas what might be wrong
> > > > >
> > > > > Hiya Mathias,
> > > > >
> > > > > Another user had a similar problem, it turned out to
> be the compiler
> > > > > flags. For linux type systems try:
> > > > >
> > > > > % setenv CC gcc
> > > > >
> > > > > For Solaris
> > > > >
> > > > > % setenv CC cc or gcc
> > > > >
> > > > > If that doesn't solve the problem, send me the
> machine type and the
> > > > > version of the OS, ie
> > > > >
> > > > > % uname -a
> > > > >
> > > > > If that is the problem, NetCDF and udunits need to be
> recompiled before
> > > > > recompiling the decoders.
> > > > >
> > > > > Robb...
> > > > >
> > > > > >
> > > > > > best regards and many thanks
> > > > > > mathias
> > > > > >
> --------------------------------------------------------
> > > > > >
> > > > > > Mathias D. Müller
> > > > > >
> > > > > > University of Basel
> > > > > > Institute of Meteorology, Climatology and Remote
> Sensing
> > > > > >
> > > > > > Klingelbergstr. 27
> > > > > > 4056 Basel
> > > > > > Tel: (+41 61) 267 07 56
> > > > > > my page: http://www.unibas.ch/geo/mcr/3d
> > > > > >
> > > > > > -------------------------------------------------
> > > > > > This mail sent through IMP: http://horde.org/imp/
> > > > > >
> > > > > >
> > > > >
> > > > >
> > >
>
> ===============================================================================
> > > > > Robb Kambic Unidata
> Program Center
> > > > > Software Engineer III Univ.
> Corp for
> > > Atmospheric Research
> > > > > address@hidden WWW:
> http://www.unidata.ucar.edu/
> > > > >
> > >
>
> ===============================================================================
> > > > >
> > > >
> > > >
> > > >
> --------------------------------------------------------
> > > >
> > > > Mathias D. Müller
> > > >
> > > > University of Basel
> > > > Institute of Meteorology, Climatology and Remote
> Sensing
> > > >
> > > > Klingelbergstr. 27
> > > > 4056 Basel
> > > > Tel: (+41 61) 267 07 56
> > > > my page: http://www.unibas.ch/geo/mcr/3d
> > > >
> > > > -------------------------------------------------
> > > > This mail sent through IMP: http://horde.org/imp/
> > > >
> > > >
> > >
>
> >>===============================================================================
>
> > >Robb Kambic Unidata Program
> Center
> > >Software Engineer III Univ. Corp for
> Atmospheric Research
> > >address@hidden WWW:
> http://www.unidata.ucar.edu/
>
> >>===============================================================================
>
> > >
> >
> > --------------------------------------------------------
> >
> > Mathias D. Müller
> >
> > University of Basel
> > Institute of Meteorology, Climatology and Remote Sensing
> >
> > Klingelbergstr. 27
> > 4056 Basel
> > Tel: (+41 61) 267 07 56
> > my page: http://www.unibas.ch/geo/mcr/3d
> >
> > -------------------------------------------------
> >
> >
> >
>
>
> ===============================================================================
> Robb Kambic Unidata Program
> Center
> Software Engineer III Univ. Corp for
> Atmospheric Research
> address@hidden WWW:
> http://www.unidata.ucar.edu/
>
> ===============================================================================
>
>
> --------------------------------------------------------
>
> Mathias D. Mueller
>
> University of Basel
> Institute of Meteorology, Climatology and Remote Sensing
>
> Klingelbergstr. 27
> 4056 Basel
> Tel: (+41 61) 267 07 56
> my page: http://www.unibas.ch/geo/mcr/3d
>
> -------------------------------------------------
>
>
===============================================================================
Robb Kambic Unidata Program Center
Software Engineer III Univ. Corp for Atmospheric Research
address@hidden WWW: http://www.unidata.ucar.edu/
===============================================================================