This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.
Hi Massoud, re: > Thanks for your response. I'll make some changes to the configuration files > on Friday based on your suggestions. Very good. > In the meantime, could you tell me for > sure if the GFS-CONUS-80km and NAM-CONUS_80km are contained in HDS or some > other primary name? The 80 km GFS data are in the HDS datastream. The 12 km NAM data are in the NGRID datastream. > Also, how much disk space does would they take up? The amount of space needed entirely depends on how much data you intend to keep. In order to get and idea of the volume of data, you can do either or both of two things: - visit our IDD information site and look at HDS and NGRID data volumes. For instance: Unidata HomePage http://www.unidata.ucar.edu Tools -> IDD http://www.unidata.ucar.edu/software/idd/ Real-Time IDD statistics http://www.unidata.ucar.edu/software/idd/rtstats/ Statistics by Host http://www.unidata.ucar.edu/software/idd/rtstats/siteindex.php idd.unidata.ucar.edu [6.6.3] http://www.unidata.ucar.edu/software/idd/rtstats/siteindex.php?idd.unidata.ucar.edu Cumulative volume summary http://www.unidata.ucar.edu/cgi-bin/rtstats/rtstats_summary_volume?idd.unidata.ucar.edu The following is an example listing of what you will see in the last URL: Data Volume Summary for idd.unidata.ucar.edu Maximum hourly volume 11415.280 M bytes/hour Average hourly volume 3630.928 M bytes/hour Average products per hour 174837 prods/hour Feed Average Maximum Products (M byte/hour) (M byte/hour) number/hour CONDUIT 1896.563 [ 52.234%] 10072.116 45329.809 NEXRAD2 791.096 [ 21.788%] 1020.468 53536.957 NGRID 306.143 [ 8.432%] 1119.637 10429.468 HDS 191.025 [ 5.261%] 654.239 18264.511 NIMAGE 190.768 [ 5.254%] 351.156 195.957 NNEXRAD 147.235 [ 4.055%] 174.038 22390.957 FNEXRAD 63.914 [ 1.760%] 80.842 74.468 UNIWISC 22.405 [ 0.617%] 33.294 26.362 IDS|DDPLUS 17.838 [ 0.491%] 25.837 24425.745 GEM 1.893 [ 0.052%] 22.248 130.723 FSL2 1.887 [ 0.052%] 2.081 22.106 NLDN 0.161 [ 0.004%] 0.544 9.617 - the second option is to run 'notifyme' and sum the sizes of products in each of the datastreams you are interested in. For example: $ notifyme -vxl- -f NGRID -o 3600 Jun 15 21:15:20 notifyme[32135] NOTE: Starting Up: localhost: 20070615201520.519 TS_ENDT {{NGRID, ".*"}} Jun 15 21:15:20 notifyme[32135] NOTE: LDM-5 desired product-class: 20070615201520.519 TS_ENDT {{NGRID, ".*"}} Jun 15 21:15:20 notifyme[32135] INFO: Resolving localhost to 127.0.0.1 took 0.000494 seconds Jun 15 21:15:20 DEBUG: NOTIFYME(localhost) returns OK Jun 15 21:15:20 notifyme[32135] NOTE: NOTIFYME(localhost): OK Jun 15 21:15:21 notifyme[32135] INFO: 88dc87ead929b2c116eaf41b6dafd7c1 44113 20070615201521.104 NGRID 23532203 LVBG10 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800F036/VREL/100 hPa PRES Jun 15 21:15:21 notifyme[32135] INFO: 914aed9c4cf2374d6c1a133f305b449b 44149 20070615201521.124 NGRID 23532204 LUBG10 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800F036/UREL/100 hPa PRES Jun 15 21:15:21 notifyme[32135] INFO: 85c3475e2e779e872d5088e24e3798eb 82618 20070615201521.146 NGRID 23532205 LOBG92 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800F036/OMEG/925 hPa PRES Jun 15 21:15:21 notifyme[32135] INFO: 8e02dbd9f128df5f524a5cf4091b84ea 54922 20070615201521.173 NGRID 23532206 LCBG99 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800F036/AVOR/1000 hPa PRES Jun 15 21:15:21 notifyme[32135] INFO: 36ecdc7e04d241da9123660e200492df 231847 20070615201521.559 NGRID 23532207 LPBG98 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800F036/PRES/0 - NONE Jun 15 21:15:21 notifyme[32135] INFO: 7259bcb1e877067d38534be4b6288f00 39308 20070615201521.608 NGRID 23532208 LTBG10 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800F036/TMPK/100 hPa PRES Jun 15 21:15:21 notifyme[32135] INFO: 17e740f630c7537ee136bfa0f8f9fcda 87702 20070615201521.626 NGRID 23532209 LOBG91 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800F036/OMEG/875 hPa PRES Jun 15 21:15:21 notifyme[32135] INFO: 24c682a0d46879bf0131e16e7d70eec7 90597 20070615201521.645 NGRID 23532210 LOBG77 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800F036/OMEG/775 hPa PRES Jun 15 21:15:21 notifyme[32135] INFO: 756adcd1f23fe9c51ce042ba63c6384b 84467 20070615201522.064 NGRID 23532211 LOBG67 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800/F036/ Jun 15 21:15:21 notifyme[32135] INFO: 94086c2101636dba0472de06da2362ab 89349 20070615201522.100 NGRID 23532212 LOBG75 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800/F036/ Jun 15 21:15:21 notifyme[32135] INFO: b1a47c812c620d8d4d6effda30d87907 80683 20070615201522.136 NGRID 23532213 LOBG62 KWBE 151800 !grib2/ncep/NAM_84/#218/200706151800/F036/ The first field after the MD5 product signature is the size of the product in bytes. Run 'notifyme' for awhile to get a representative overview of the products in the datastream; sum the bytes; and you will see how much disk space it will take to save them. I think that the first way to get an idea is the best. > Thanks again. > > Massoud > > Cheers, Tom **************************************************************************** Unidata User Support UCAR Unidata Program (303) 497-8642 P.O. Box 3000 address@hidden Boulder, CO 80307 ---------------------------------------------------------------------------- Unidata HomePage http://www.unidata.ucar.edu **************************************************************************** Ticket Details =================== Ticket ID: JNM-107366 Department: Support IDD Priority: Normal Status: Closed