This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.
hiya, I am pleased to announce a new release of the netCDF decoders package (decoders-4.0.0.tar.Z). This release has so many changes that it warranted a change in the major release number to 4.0.0 Summary: - reference to perl's location changed /usr/local/bin/perl -> /usr/bin/perl - perl decoders pqact entries argument yyyymm removed - perl decoders have a new naming convention, ie Surface_METAR_yyyymmdd_hhmm.nc - perl decoders have (-n old) flag for old naming convention, new is default - perl decoders have -h flag for hourly files, daily files is default - perl decoders manage log files to only keep 3 logs - perl decoders station tables updated - perl decoders bug fixes - metar.cdl.new1 changed to added global attributes and to change some variable names to be more descriptive. - removed java Grib decoder jars etc, it's has it own release package now called GRIBJava.tar.gz. Look at the Decoders web page - gribtonc cdl files gfs_211.cdl, eta_211.cdl, and ruc2_236.cdl updated - prepended model, coverage, and resolution to netCDF file names - attached is decoders.pqact that contains the ldm pqact decoder entries - installation requires the shut down of the ldm and the removal of *.log and *.lst files otherwise netCDF files will not receive data for one day. Decoders homepage: http://www.unidata.ucar.edu/software/decoders/ Decoders downloads: http://www.unidata.ucar.edu/downloads/decoders/index.jsp Details: Since many of the os's store the perl binaries in /usr/bin/, the location of perl was changed perl from /usr/local/bin/perl to /usr/bin/perl. If your system has different perl versions installed at the different locations, then one should check that the netcdf-perl package is installed at /usr/bin/perl. One method of checking would be to run a perl decoder from the command line,ie % metar2nc metar.cdl data < <raw data file> If the command line test fails, then one should install netcdf-perl on the /usr/bin/perl installation. A temporary fix would be to change /usr/bin/perl to /usr/local/bin/perl in the perl decoders. The perl decoders pqact entries have the yyyymm argument removed because it caused multiple decoders to run at the end of the month and possibly miss data. The yyyymm inquires are now done inside the decoders. The perl decoders have a new naming convention, ie Surface_METAR_yyyymmdd_hhmm.nc, Surface_Buoy_yyyymmdd_hhmm.nc, Surface_Synoptic_yyyymmdd_hhmm.nc and Upperair_yyyymmdd_hhmm.nc Since some users would like to retain the old naming convention there is a flag "-n old" to revert back to the old convention. The perl decoders create files on a daily basis verses a hourly time period. Since some users would like to have hourly files, a flag -h has been added to write hourly files for the all perl decoders, the default is a daily file. The perl decoders managed log files to only keep 3 logs. When installing the decoders it is wise to shut down the ldm and then to delete all the log files and the *.lst files. If the the ldm is not shut down, it is possible to not receive data in the netCDF files for one day. The following station tables have been updated: sfmetar.tbl, snworld.tbl and systns_upc.tbl. If users know the information about missing table entries, sent the information to address@hidden and they will be added to the tables and made available in the next release. Bugs: - fixed bug in syn2nc decoder that returned wind DIR greater than 900 - buoy2nc decoder now store multiple reports for same time period - metar2nc decoder had regular expression fixes - changed testdata.wmo to testdata.wmo.bak in make files - metar.cdl.new1 was changed to added global attributes and change some variable names to be more descriptive. :title = "METAR Data from NWS"; :version = 2.3; :processor = "metar2nc version v1.2"; :Conventions = "Unidata Observation Dataset v1.0"; :standard_name_vocabulary = "CF-1.0"; :description = "Metar Data from NWS distributed through the Unidata IDD realtime datastream. 1 day's worth of data"; :time_coordinate = "time_observation"; :cdm_datatype = "Station"; :stationDimension = "station"; :station_id = "station_id"; :station_description = "station_description"; :latitude_coordinate = "latitude"; :longitude_coordinate = "longitude"; :altitude_coordinate = "altitude"; :geospatial_lat_max = "90.0"; :geospatial_lat_min = "-90.0"; :geospatial_lon_max = "360.0"; :geospatial_lon_min = "0.0"; :time_coverage_start = "xxxxxxxxxx"; :time_coverage_end = "xxxxxxxxxx"; :observationDimension = "recNum"; variable changes: lastChild, numChildren, parent_index, prevChild, and xfields Thanks to all the users who sent in bug reports. Removed java Grib decoder jars, it's has it own release package now called GRIBJava.tar.gz. Look at the Decoders web page The cdl files gfs_211.cdl, eta_211.cdl, and ruc2_236.cdl were updated to add new parmeters and levels. The gribtonc netCDF file names have been changed to be more descriptive by prepending the model, coverage, and resolution to the file. ie NAM_CONUS_80km_yyyymmdd_hh00.nc One can use the old pqact entries to retain the old naming convention. As always send support questions to address@hidden Robb... =============================================================================== Robb Kambic Unidata Program Center Software Engineer III Univ. Corp for Atmospheric Research address@hidden WWW: http://www.unidata.ucar.edu/ ===============================================================================
# # surface data in netCDF format # # metar decoder, creates NetCDF files formated Surface_METAR_yyyymmdd_hh00.nc # All aviation reports including metar tests. old netcdf file format DDS|IDS ^S(A....|P....|XUS8.) .... ([0-3][0-9]) PIPE decoders/metar2nc etc/metar.cdl data/pub/decoded/netcdf/surface/metarold # # metar decoder, creates NetCDF files with new CDL format on a daily basis # formated data/decoded/yyyymmdd_metar.nc DDS|IDS ^S(A....|P....|XUS8.) .... ([0-3][0-9]) PIPE decoders/metar2nc.new1 etc/metar.cdl.new1 data/pub/decoded/netcdf/surface/metar # # upper air perl decoder DDS|IDS ^U[ABDEFGHIJKLMPQRSTXZ].... .... ([0-3][0-9]) PIPE decoders/ua2nc etc/raob.cdl data/pub/decoded/netcdf/upperair # # buoy reports in yymmddhh_buoy.nc decoded into NetCDF format DDS|IDS ^S[NS].... .... ([0-3][0-9]) PIPE decoders/buoy2nc etc/buoy.cdl data/pub/decoded/netcdf/surface/buoy # # Synoptic reports in yymmddhh_syn.nc decoded into NetCDF format DDS|IDS ^SM.... .... ([0-3][0-9]) PIPE decoders/syn2nc etc/syn.cdl data/pub/decoded/netcdf/surface/synoptic # # grid data in netCDF format # # GFS grid on Lambert conformal CONUS grid replacing avn-q HRS ^Y.Q... KWB. (..)(..).*/m(AVN|SSIAVN|GFS|SSIGFS) PIPE decoders/gribtonc etc/gfs_211.cdl data/pub/decoded/netcdf/grid/NCEP/GFS/CONUS_80km/GFS_CONUS_80km_(\1:yyyy)(\1:mm)\1_\200.nc # # GFS grid on thinned grids, interpolated to global 5.0 x 2.5 regular grid HRS ^H.[I-P]... KWB. (..)(..).*/m(AVN|SSIAVN|GFS|SSIGFS) PIPE decoders/gribtonc -q "lin,dlat=2.5,dlon=5.0" etc/gfs_37-44.cdl data/pub/decoded/netcdf/grid/NCEP/GFS/Global_5x2p5deg/GFS_Global_5x2p5deg_(\1:yyyy)(\1:mm)\1_\200.nc # # ECMWF grid on global 2.5 x 2.5 degree grid HRS ^H.[A-L]... ECMF (..)(..) PIPE decoders/gribtonc etc/ecmwf_1-12.cdl data/pub/decoded/netcdf/grid/ECMWF/Global_2p5x2p5deg/ECMWF_Global_2p5x2p5deg_(\1:yyyy)(\1:mm)\1_\200.nc # # ETA grid on Lambert conformal CONUS grid HRS ^Y.Q... KWB. (..)(..).*/m(ETA|NAM) PIPE decoders/gribtonc etc/eta_211.cdl data/pub/decoded/netcdf/grid/NCEP/NAM/CONUS_80km/NAM_CONUS_80km_(\1:yyyy)(\1:mm)\1_\200.nc # # GFS grid on global 5.0 x 5.0 degree grid HRS ^H.[EF]... KWB. (..)(..) PIPE decoders/gribtonc etc/gfs_25-26.cdl data/pub/decoded/netcdf/grid/NCEP/GFS/Global_5x5deg/GFS_Global_5x5deg_(\1:yyyy)(\1:mm)\1_\200.nc # # NGM grid on Lambert conformal CONUS grid HRS ^Y.Q... KWB. (..)(..).*/mNGM PIPE decoders/gribtonc etc/ngm_211.cdl data/pub/decoded/netcdf/grid/NCEP/NGM/CONUS_80km/NGM_CONUS_80km_(\1:yyyy)(\1:mm)\1_\200.nc # # NOW and PWAV grids on global 5.0 x 2.5 degree grids HRS ^H.[A-D]... .... (..)(..).*(/mNOW|/mPWAV) PIPE decoders/gribtonc etc/ocean_21-24.cdl data/pub/decoded/netcdf/grid/NCEP/OCEAN/Global_5x2p5deg/OCEAN_Global_5x2p5deg_(\1:yyyy)(\1:mm)\1_\200.nc # # RUC grid on Lambert conformal CONUS grid HRS ^[YZ].Q... KWB. (..)(..).*/mRUC PIPE decoders/gribtonc etc/ruc_211.cdl data/pub/decoded/netcdf/grid/NCEP/RUC/CONUS_80km/RUC_CONUS_80km_(\1:yyyy)(\1:mm)\1_\200.nc # # RUC2 grid on Lambert conformal CONUS grid HRS ^Y.W... KWB. (..)(..).*/mRUC2 PIPE decoders/gribtonc etc/ruc2_236.cdl data/pub/decoded/netcdf/grid/NCEP/RUC2/CONUS_40km/RUC2_CONUS_40km_(\1:yyyy)(\1:mm)\1_\200.nc # # SST grid on global 5.0 x 2.5 degree grids HRS ^H.[A-D]... .... (..)(..).*/mSST PIPE decoders/gribtonc etc/sst_21-24.cdl data/pub/decoded/netcdf/grid/NCEP/SST/Global_5x2p5deg/SST_Global_5x2p5deg_(\1:yyyy)(\1:mm)\1_\200.nc # # SST grid on global 2.0 x 2.0 degree grid HRS ^H.[T-W]... .... (..)(..).*/mSST PIPE decoders/gribtonc etc/sst_61-64.cdl data/pub/decoded/netcdf/grid/NCEP/SST/Global_2x2deg/SST_Global_2x2deg_(\1:yyyy)(\1:mm)\1_\200.nc #