[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDD #JNM-107366]: Configuration Files

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [IDD #JNM-107366]: Configuration Files
  • Date: Fri, 15 Jun 2007 15:17:11 -0600
Hi Massoud,

re:
> Thanks for your response. I'll make some changes to the configuration files
> on Friday based on your suggestions.

Very good.

> In the meantime, could you tell me for
> sure if the GFS-CONUS-80km and NAM-CONUS_80km are contained in HDS or some
> other primary name?

The 80 km GFS data are in the HDS datastream.  The 12 km NAM data are in the
NGRID datastream.

> Also, how much disk space does would they take up?

The amount of space needed entirely depends on how much data you intend to
keep.  In order to get and idea of the volume of data, you can do either
or both of two things:

- visit our IDD information site and look at HDS and NGRID data volumes. For
  instance:

Unidata HomePage
http://www.unidata.ucar.edu
  Tools -> IDD
  http://www.unidata.ucar.edu/software/idd/
    Real-Time IDD statistics
    http://www.unidata.ucar.edu/software/idd/rtstats/
      Statistics by Host
      http://www.unidata.ucar.edu/software/idd/rtstats/siteindex.php

idd.unidata.ucar.edu [6.6.3]
http://www.unidata.ucar.edu/software/idd/rtstats/siteindex.php?idd.unidata.ucar.edu
  Cumulative volume summary
  
http://www.unidata.ucar.edu/cgi-bin/rtstats/rtstats_summary_volume?idd.unidata.ucar.edu

The following is an example listing of what you will see in the last URL:

Data Volume Summary for idd.unidata.ucar.edu

Maximum hourly volume  11415.280 M bytes/hour
Average hourly volume   3630.928 M bytes/hour

Average products per hour     174837 prods/hour

Feed                           Average             Maximum     Products
                     (M byte/hour)            (M byte/hour)   number/hour
CONDUIT                1896.563    [ 52.234%]    10072.116    45329.809
NEXRAD2                 791.096    [ 21.788%]     1020.468    53536.957
NGRID                   306.143    [  8.432%]     1119.637    10429.468
HDS                     191.025    [  5.261%]      654.239    18264.511
NIMAGE                  190.768    [  5.254%]      351.156      195.957
NNEXRAD                 147.235    [  4.055%]      174.038    22390.957
FNEXRAD                  63.914    [  1.760%]       80.842       74.468
UNIWISC                  22.405    [  0.617%]       33.294       26.362
IDS|DDPLUS               17.838    [  0.491%]       25.837    24425.745
GEM                       1.893    [  0.052%]       22.248      130.723
FSL2                      1.887    [  0.052%]        2.081       22.106
NLDN                      0.161    [  0.004%]        0.544        9.617

- the second option is to run 'notifyme' and sum the sizes of products in each
  of the datastreams you are interested in.  For example:

$ notifyme -vxl- -f NGRID -o 3600
Jun 15 21:15:20 notifyme[32135] NOTE: Starting Up: localhost: 
20070615201520.519 TS_ENDT {{NGRID,  ".*"}}
Jun 15 21:15:20 notifyme[32135] NOTE: LDM-5 desired product-class: 
20070615201520.519 TS_ENDT {{NGRID,  ".*"}}
Jun 15 21:15:20 notifyme[32135] INFO: Resolving localhost to 127.0.0.1 took 
0.000494 seconds
Jun 15 21:15:20 DEBUG: NOTIFYME(localhost) returns OK
Jun 15 21:15:20 notifyme[32135] NOTE: NOTIFYME(localhost): OK
Jun 15 21:15:21 notifyme[32135] INFO: 88dc87ead929b2c116eaf41b6dafd7c1    44113 
20070615201521.104   NGRID 23532203  LVBG10 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800F036/VREL/100 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 914aed9c4cf2374d6c1a133f305b449b    44149 
20070615201521.124   NGRID 23532204  LUBG10 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800F036/UREL/100 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 85c3475e2e779e872d5088e24e3798eb    82618 
20070615201521.146   NGRID 23532205  LOBG92 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800F036/OMEG/925 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 8e02dbd9f128df5f524a5cf4091b84ea    54922 
20070615201521.173   NGRID 23532206  LCBG99 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800F036/AVOR/1000 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 36ecdc7e04d241da9123660e200492df   231847 
20070615201521.559   NGRID 23532207  LPBG98 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800F036/PRES/0 - NONE
Jun 15 21:15:21 notifyme[32135] INFO: 7259bcb1e877067d38534be4b6288f00    39308 
20070615201521.608   NGRID 23532208  LTBG10 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800F036/TMPK/100 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 17e740f630c7537ee136bfa0f8f9fcda    87702 
20070615201521.626   NGRID 23532209  LOBG91 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800F036/OMEG/875 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 24c682a0d46879bf0131e16e7d70eec7    90597 
20070615201521.645   NGRID 23532210  LOBG77 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800F036/OMEG/775 hPa PRES
Jun 15 21:15:21 notifyme[32135] INFO: 756adcd1f23fe9c51ce042ba63c6384b    84467 
20070615201522.064   NGRID 23532211  LOBG67 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800/F036/
Jun 15 21:15:21 notifyme[32135] INFO: 94086c2101636dba0472de06da2362ab    89349 
20070615201522.100   NGRID 23532212  LOBG75 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800/F036/
Jun 15 21:15:21 notifyme[32135] INFO: b1a47c812c620d8d4d6effda30d87907    80683 
20070615201522.136   NGRID 23532213  LOBG62 KWBE 151800 
!grib2/ncep/NAM_84/#218/200706151800/F036/

The first field after the MD5 product signature is the size of the product in 
bytes.  Run 'notifyme'
for awhile to get a representative overview of the products in the datastream; 
sum the bytes; and
you will see how much disk space it will take to save them.

I think that the first way to get an idea is the best.

> Thanks again.
> 
> Massoud
> 
> 

Cheers,

Tom
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: JNM-107366
Department: Support IDD
Priority: Normal
Status: Closed