[IDD #GOK-818269]: Help -- NEXRAD3 feed no longer working, along with some GOES imagery from UNIWISC

Hi Marcus,

re:
> Getting closer now to flipping the switch on the server.

Very good.

re:
> After reviewing the data feeds, it seems there has been some change of names 
> for the feed
> for model data (CONDUIT vs HDS).

There has not been any substantial changes in names of feeds of model data for
a _long_ time.  The three IDD feeds that have model data are:

HDS     - lowest volume feed of mostly GRIB1 model output sent in NOAAPort
NGRID   - substantially higher volume feed of entirely GRIB2 model output
          in NOAAPort
CONDUIT - very high (and on the verge of getting measurably higher) volume feed
          of model output that is _not_ available in NOAAPort

re:
> This is my current 'wish list':
> 
> 1.  As much satellite imagery as possible (UNIWISC and NIMAGE)

OK.

re:
> 2.  NEXRAD data:  only N0R, N0Z, N0V, N0S, N1P, NTP, NMD, NCR

For all stations?

re:
> 3.  FNEXRAD:  only the 1km national composite (GINI)

OK.

re:
> 4.  WMO

WMO is a compound feed type.  It represents the union of HDS and
IDS|DDPLUS (observational) data.

re:
> 5.  CONDUIT (?)  or HDS (?)  -model data

If you had a WMO feed REQUEST, you would get HDS (see 4. above).

re:
> 6.  FSL2

OK.

re:
> About how much data is this per hour?

The following listing should answer this:

Data Volume Summary for idd.unidata.ucar.edu

Maximum hourly volume  15467.695 M bytes/hour
Average hourly volume   8048.563 M bytes/hour

Average products per hour     262031 prods/hour

Feed                           Average             Maximum     Products
                     (M byte/hour)            (M byte/hour)   number/hour
NEXRAD2                2932.991    [ 36.441%]     3657.335    70923.778
CONDUIT                2476.869    [ 30.774%]     6759.072    64245.333
NEXRAD3                 980.303    [ 12.180%]     1175.668    52908.822
NGRID                   735.223    [  9.135%]     1676.403    15735.489
FNMOC                   286.045    [  3.554%]     1809.603     2482.844
HDS                     255.982    [  3.180%]      443.200    18144.044
NIMAGE                  178.338    [  2.216%]      341.697      198.956
FNEXRAD                  86.809    [  1.079%]      107.950       71.222
IDS|DDPLUS               42.062    [  0.523%]       49.105    36556.644
EXP                      39.629    [  0.492%]       73.766      361.111
UNIWISC                  23.015    [  0.286%]       35.978       26.400
LIGHTNING                 5.975    [  0.074%]       12.338      348.600
DIFAX                     3.774    [  0.047%]       12.764        5.089
FSL2                      1.548    [  0.019%]        1.697       22.289

re:
> I see figures for the streams on some of the feed descriptions, but not all.

We have never tried to "size" the IDD feeds since they change frequently (and
the change is typically that more data is available in each feed).  The best
way to get a handle on how much data (volume, number of products, etc) is
available in any feed (at least the most active ones), is to review the 
real-time
feed statistics for various machines:

Unidata HomePage
http://www.unidata.ucar.edu

  Projects
  https://www.unidata.ucar.edu/projects/

    Internet Data Distribution
    https://www.unidata.ucar.edu/projects/#idd

      IDD Current Operational Status
      https://www.unidata.ucar.edu/software/idd/rtstats/

        Statistics by Host
        https://www.unidata.ucar.edu/cgi-bin/rtstats/siteindex

The toplevel IDD relay nodes are the ones that are most likely to be providing
information on all of the data available in the IDD.  The toplevel IDD relay
node that we maintain is named idd.unidata.ucar.edu:

https://www.unidata.ucar.edu/cgi-bin/rtstats/siteindex?idd.unidata.ucar.edu

The link at the bottom of the page for any particular machine that is reporting
real time stats will give a listing like the one I included above:

Cumulative volume summary
https://www.unidata.ucar.edu/cgi-bin/rtstats/rtstats_summary_volume?idd.unidata.ucar.edu

re:
> I also was looking for ECMWF model data, but could not find that in the feed 
> descriptions.

There is a small amount of ECMWF model data in the NGRID datastream.  Please be 
aware
that a number of the fields in the ECMWF dataset are subject to WMO Resolution 
40
restrictions (which basically say that they can not be re-imported into the 
country
of origin).  Use of WMO Resolution 40-restricted data is explicitly permitted
for education and research use by universities.  Where one might get into 
trouble
is if one were to make the data accessible for easy importation (snagging) back
into the country from which the data came.  This is not a theoretical 
restriction --
Unidata universities have in the past been contacted by ECMWF representatives
who informed them that they must stop making the data available for 
re-importation
(like through easy access to the data on an FTP or THREDDS Data Server).

re:
> I know I need to put these into the ldmd.conf file eventually, but I need some
> of this information first.

I think that the snapshot listing of data volumes should provide the lion's 
share
of information you will need to make your decisions.

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: GOK-818269
Department: Support IDD
Priority: Normal
Status: Closed