[IDD #UOZ-684486]: Fwd: IRADS data for academic use

Hi Arun,

re:
> Thanks. That’s quite a firehose of data, so I’ll forget about archiving it.

Yes, indeed.  If one were to receive all of the data that is available in
the IDD, there would be up to 60 GB/hr of data arriving.  And, the volume
of data that is relayed in the IDD is increasing all of the time!

re:
> Is this the definitive page for using the LDM client?
> 
> http://www.unidata.ucar.edu/software/ldm/ldm-current/

The LDM web pages are the primary source of information for how to download,
build and install the LDM.  Additional information on how the data is
used in analysis and visualization packages can be found in the web
pages for those packages (e.g., GEMPAK, McIDAS, AWIPS, TDS).

re: NOAA Big Data Project, all of the real time and historic NEXRAD Level II
data is being freely (for now) hosted in Amazon's AWS.

re:
> Where/how can I access that AWS hosted data?

A simple Google (tm) search using 'noaa big data nexrad radar' as the search
key shows a variety of sources of information on this.  The first link that
showed up in the search I just did was:

NEXRAD on AWS
https://aws.amazon.com/noaa-big-data/nexrad/

re:
> Does “real time” above mean that anyone
> (including non-academic users) can get streaming NEXRAD II data for free?

Comments:

- I should have said near real-time, not real-time; sorry

- Amazon is providing free access to the NEXRAD Level II data stored in S3
  buckets through this project

  The data is _not_ streamed!

  Receiving the data via the LDM/IDD is the closest thing to "streaming" as
  is pertinent, but the LDM does not "stream" data.  Instead, it moves
  "products" (chunks of bytes) from one place (LDM) to another (LDM).  What
  The user does with the data was it is received is up to that user.

re:
> If so, why is it advertised at a nontrivial cost here?
> 
> http://www.ou.edu/content/irads/why-irads/cost.html

OU/IRADS is providing a value-added service.  Since we do not operate this
service, we can/will not say more about it.  You should contact the IRADS
folks for more information on their services.

Comment:

- delivery of any data via the LDM is done on a best effort basis

  There is _no_ guarantee that a site receiving any of the data via the
  LDM/IDD will get the data within a user-specified time window.  That
  being said, the goal of the LDM/IDD is to deliver all data products
  as quickly as possible.  The typical latencies (the time differences from
  when a product is first put into an LDM queue and when it is received
  at a site) depends on a receiving site's network bandwidth and how loaded
  the upstream LDM(s) are.  Our goal is to keep these latencies in the
  sub-second to a hand full of seconds range.

It will be instructive for you to review the Unidata data policy:

Unidata HomePage
http://www.unidata.ucar.edu

  Data
  http://www.unidata.ucar.edu/data/

    Guidelines for Data Use
    http://www.unidata.ucar.edu/data/guidelines.html

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: UOZ-684486
Department: Support IDD
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.