[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[CONDUIT #PNI-592429]: LDM config statement for new GFS 0.25 data

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [CONDUIT #PNI-592429]: LDM config statement for new GFS 0.25 data
  • Date: Wed, 29 Jul 2015 12:16:29 -0600
Hi Chris,

re:
> We are setting up a dedicated virtual machine for awips2/ldm.

Hmm... Depending on what the host OS is, running AWIPS2 from a
virtual machine may be a bad idea.  One of the members of the
Unidata User's Committee is running CAVE from inside of a VMware
VM running on his MAC laptop, and this seems to work well.
Other attempts of running CAVE in a VM hosted on a Windows
laptop have not worked well.

Running the LDM in a VM seems to work nicely, at least from the
reports that we have seen from users.  To our knowledge, however,
no site has attempted to ingest a LOT of data (e.g., full CONDUIT
plus other feeds) inside of a VM, so we can not comment on if
this should work well or not.

re:
> If you can give me some desired specs or point me to a place that
> lists them, I can then work with my sysadmin to determine if we
> can accommodate the hi-res data.

I am not sure what specs to send you based on your comments of running
AWIPS2 inside of a VM.  Specs for a real machine running AWIPS2 EDEX
(the data ingest, decoding and serving portion of AWIPS2) can be seen
in:

Unidata HomePage
http://www.unidata.ucar.edu

  Software -> AWIPS II
  http://www.unidata.ucar.edu/software/awips2/#home

    System Requirements
    http://www.unidata.ucar.edu/software/awips2/#sysreqs

You can see the volume of the various IDD datastreams in links in
our IDD Operational Status -> Stats by Host pages.

For instance:

Unidata HomePage
http://www.unidata.ucar.edu

  Data -> IDD Operational Status
  http://rtstats.unidata.ucar.edu/rtstats/

    Statistics by Host
    http://rtstats.unidata.ucar.edu/cgi-bin/rtstats/siteindex

lead.unidata.ucar.edu is currently ingesting _everything_ available
in all IDD feeds plus the HRRR data from NOAA/GSD, so it is a good place
to look for the high water mark for data that is available:

http://rtstats.unidata.ucar.edu/cgi-bin/rtstats/siteindex?lead.unidata.ucar.edu

Cumulative volume summary
http://rtstats.unidata.ucar.edu/cgi-bin/rtstats/rtstats_summary_volume?lead.unidata.ucar.edu

Data Volume Summary for lead.unidata.ucar.edu

Maximum hourly volume  54722.886 M bytes/hour
Average hourly volume  30583.606 M bytes/hour

Average products per hour     374104 prods/hour

Feed                           Average             Maximum     Products
                     (M byte/hour)            (M byte/hour)   number/hour
CONDUIT                7776.854    [ 25.428%]    21555.577    89244.273
FSL2                   7691.004    [ 25.147%]    11074.348    13441.932
NEXRAD2                6079.087    [ 19.877%]     8359.773    70727.886
NGRID                  4690.050    [ 15.335%]     7663.183    33921.932
NEXRAD3                1982.612    [  6.483%]     2540.238    98409.614
FNMOC                  1194.264    [  3.905%]     6456.847     3367.591
HDS                     364.811    [  1.193%]      669.656    19754.886
NOTHER                  261.286    [  0.854%]      752.347     1177.205
NIMAGE                  161.913    [  0.529%]      258.532      192.023
FNEXRAD                 120.778    [  0.395%]      154.971      105.386
GEM                      85.337    [  0.279%]      541.563      792.295
UNIWISC                  69.168    [  0.226%]      117.123       43.909
IDS|DDPLUS               60.294    [  0.197%]       69.302    42279.295
EXP                      39.781    [  0.130%]       91.510      353.568
LIGHTNING                 6.267    [  0.020%]       17.565      291.545
GPS                       0.101    [  0.000%]        1.269        1.000

Please note that the FSL2 feed listed contains HRRR data being fed by
NOAA/GSD.  This is _not_ the HRRR data that is flowing in the NOAAPort
SBN, that data is included in the NGRID feed.

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: PNI-592429
Department: Support CONDUIT
Priority: Normal
Status: Closed