[IDD #TVO-907725]: UNIWISC ingest stopped working

Hi,

re:
> Your email didn't have a message.

I was attempting to move your inquiry from the NOAAPport department to the
IDD department, and what I tried didn't work as planned.

re:
> Just to add, I read on the NOAA website the following,
> which matches with the date of our outage. Does it mean the goes 15 imagery is
> discontinued?

Yes, GOES-15 was turned off on Monday, March 2.

re:
> If yes what pattern action can we replace it with to get goes 17 images?

See below.

re:
> Our satellite products with the following pattern actions stopped working on 
> March 3. Any help is appreciated!

> MCIDAS ^pnga2area Q. (U[^ACXY1]) (.*) (.*)_IMG (0.65)um (.*) (........) (....)
> FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/VIS/VIS_\6_\7
> 
> MCIDAS ^pnga2area Q. (U[^ACXY1]) (.*) (.*)_IMG (3.9)um (.*) (........) (....)
> FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/\4/\4_\6_\7
> 
> MCIDAS ^pnga2area Q. (U[^ACXY1]) (.*) (.*)_IMG (6..)um (.*) (........) (....)
> FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/WV/WV_\6_\7
> 
> MCIDAS ^pnga2area Q. (U[^ACXY1]) (.*) (.*)_IMG (10.7)um (.*) (........) (....)
> FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/IR/IR_\6_\7
> 
> MCIDAS ^pnga2area Q. (U[8E]) (.*) (.*)_IMG (.*)um (.*) (........) (....)
> FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/\4/\4_\6_\7

The changes to the Unidata-Wisconsin IDD datastream (UNIWISC aka MCIDAS) were
announced to several Unidata email lists well in advance of GOES-15 being
decommissioned (turned off actually as there are plans to turn it back on
in late August for the Eastern Pacific hurricane season).  It appears that
you were not subscribed to any of the lists that the message was sent to,
so I advise you to subscribe to one or more of the following so that you
will get notices like this in the future:

address@hidden
address@hidden,
address@hidden
address@hidden
address@hidden
address@hidden
re:
> "Please Note:
> 
> Update 3/2/2020: GOES-15 supplemental operations ended on March 2, 2020. The 
> distribution
> of GOES-15 satellite products has been discontinued.
> 
> This site will continue to display GOES-15 (GOES-West Backup) imagery until 
> the
> satellite’s decommissioning. GOES-15 (GOES-West Backup) operations 
> (originally scheduled
> to continue only through early July 2019) has been extended at least through 
> March 1,
> 2020. To view imagery from the operational GOES East (GOES-16) and GOES West 
> (GOES-17)
> satellites, users may visit https://www.star.nesdis.noaa.gov/goes/.";

Yup, GOES-15 was turned off on March 2.

re:
> MCIDAS ^pnga2area Q. (U[^ACXY1]) (.*) (.*)_IMG (0.65)um (.*) (........) 
> (....) FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/VIS/VIS_\6_\7
> 
> MCIDAS ^pnga2area Q. (U[^ACXY1]) (.*) (.*)_IMG (3.9)um (.*) (........) (....) 
> FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/\4/\4_\6_\7
> 
> MCIDAS ^pnga2area Q. (U[^ACXY1]) (.*) (.*)_IMG (6..)um (.*) (........) (....) 
> FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/WV/WV_\6_\7
> 
> MCIDAS ^pnga2area Q. (U[^ACXY1]) (.*) (.*)_IMG (10.7)um (.*) (........) 
> (....) FILE -close /usr/local/ldm/data/gempak/images/sat/\3/\5/IR/IR_\6_\7
> 
> MCIDAS ^pnga2area Q. (U[8E]) (.*) (.*)_IMG (.*)um (.*) (........) (....) FILE 
> -close /usr/local/ldm/data/gempak/images/sat/\3/\5/\4/\4_\6_\7


Below is the second announcement that was sent to the list of email lists
above.  In the message is the URL for the web page that shows the list
of products being sent in the UNIWISC (aka MCIDAS) IDD feed now, and
that page has links to an example pattern-action file actions to 
process the images.


Date: Tue, 18 Feb 2020 16:19:05 -0700
Message-Id: <address@hidden>

2nd Notice:

Users of the IDD UNIWISC (aka MCIDAS) data feed:

We will be upgrading the Unidata-Wisconsin IDD data stream (IDD
feedtype UNIWISC (aka MCIDAS)) with products that use GOES-17 imagery in
replacement of GOES-15 imagery and with updated GOES-East and GOES-West
imagery products tomorrow, Wednesday, February 19, 2020.

Why:

  NOAA has announced the cessation of GOES-15 operations on March 2,
  so those products that currently use/incorporate GOES-15 imagery
  will need to be replaced/updated.  Here is a snippet from the NOAA
  announcement describing the GOES-15 status change:

 January 29, 2020
 "GOES-15 supplemental operations to GOES-17 will be extended to March
  2, 2020.  After that date, the GOES-15 spacecraft will be placed
  in standby.  GOES-17 will continue operating in the GOES-West role at
  137.2 degrees west with all instruments operating nominally."

  A major implication of the cessation of GOES-15 operations is that
  the GINI imagery that is currently being distributed by the NWS in
  NOAAPort will no longer be available in NOAAPort or via an IDD feed.

When:

  We are planning to add new/updated content to the UNIWISC data
  stream starting on Wednesday, February 19, 2020.  We will continue to
  distribute UNIWISC content that contains/is based on GOES-15 imagery
  for as long as GOES-15 remains operational.

Impacts of the changes being made to UNIWISC:

  The volume of data available in the UNIWISC feed will increase from an
  average of approximately 95 MB/hr to an average that is approximately
  810 MB/hr, an 8.5-fold increase!

  The new products that will be available in the revamped UNIWISC feed
  are:

  - full spatial and temporal resolutions for GOES-East (GOES-16) and
    West (GOES-17) CONUS coverage for the 6.2um WV and 10.3um thermal
    IR channels, and a reduced resolution for the 0.64um VIS channels

    GOES-East/West 0.64um CONUS VIS imagery will have (nominal)
    resolutions of 1.0km and the 6.2um WV and 10.3um thermal IR imagery
    will have (nominal) resolutions of 2km.

    GOES-East CONUS channels will be remapped into the same TANC
    projection that is used for the national composite Level III
    radar products that are distributed in the IDD FNEXRAD feed.
    GOES-West CONUS channels will be distributed in the GOES-R fixed
    grid projection.

    GOES-East/West CONUS imagery will be available every 5 minutes
    when the satellites are scanning in modes 3 or 6, and will not be
    available when the satellites are operating in scanning mode 4.

  - full spatial and temporal resolutions for all mesoscale image coverages
    for the 0.64um VIS, 6.2um WV, and 10.3um thermal IR channels

    The mesoscale images are small in size, but they are numerous since
    the are available either every minute or every 30 seconds.

    GOES-East/West mesoscale 0.64um VIS images have (nominal) resolutions
    of 0.5km and the 6.2um WV and 10.3um thermal IR images have (nominal)
    resolutions of 2km.

    All mesoscale images are in the GOES-R fixed grid projection.

  - full temporal and reduced spatial resolutions for GOES-East/West full
    disk image coverages for the 0.64um VIS, 6.2um WV, and 10.3um thermal
    IR channels

    All full disk images will have (nominal) resolutions of 4km, and
    will be available every 10 minutes when the satellite producing the
    coverage is operating in scanning mode 6, every 15 minutes when the
    satellite is operating in scanning mode 3, or every 5 minutes when
    the satellite is operating in scanning mode 4.

    All full disk images will be in the GOES-R fixed grid projection.

  - GOES-East/West composite imagery for the 0.64um VIS, 6.2um WV,
    and 10.3um thermal IR channels

    The new East/West composite images will have (nominal) 4km resolutions
    and will be available either every 10 minutes when GOES-East is
    operating in scanning mode 6, every 15 minutes when GOES-East is
    operating in scanning mode 3, or every 5 minutes when GOES-East is
    operating in scanning mode 4.

    All East/West composite images will be in the GOES-R fixed grid
    projection centered on 105W longitude.

  - GOES-East Level 2 products:

    CAPE (CONUS coverage)
    Cloud Top Pressure (CONUS coverage)
    Lifted Index (CONUS coverage)
    Total Precipitable Water (CONUS coverage)
    Rain Rate QPE (full disk coverage)
    Sea Surface Temperature (full disk coverage)
     
    The update frequencies for these Level 2 products are dependent on the
    product type.  Please refer to the following web page details:

    https://www.unidata.ucar.edu/data/uniwisc.html

    All GOES-East Level 2 products will be in the GOES-R fixed grid
    projection.

  - the other products already in the UNIWISC feed remain unchanged:

    Arctic multi-satellite composites (VIS, IRS, WV, IR, IRL)
    Antarctic mult-satellite composites (VIS, IRS, WV, IR, IRL)
    Global multi-satellite WV and IR composites in rectilinear projection
    Global multi-satellite WV and IR composites in Mollweide projection

- sites wishing to use the new/revamped imagery that are being added to
  the UNIWISC feed must insure that they REQUEST the new data in their
  LDM configuration file REQUEST line(s), and update LDM pattern-action
  file actions to correctly process the imagery

  It is our observation that the most typical LDM configuration file
  REQUEST being used is for everything from the UNIWISC feed. For example:

  REQUEST UNIWISC ".*" <upsteam feed host>

  No action is needed for sites using this type of REQUEST, but users
  should be aware of the greatly increased data volumes that will result!

  Sites that would like to tailor their UNIWISC REQUEST(s) are advised to
  contact Unidata User Support <address@hidden> if they
  need guidance.

- new processing action(s) will be need for the new imagery

  The LDM/IDD Product IDs for the great majority of the products
  in the revamped UNIWISC feed will change.  The web page:

  https://www.unidata.ucar.edu/data/uniwisc.html

  contains detailed information on the image products that will be
  available in the revamped UNIWISC feed with example LDM/IDD Product
  IDs. This web page also has links to example LDM pattern-action file
  actions needed to process the new/revamped and existing images.

  For comparison, the web page:

  https://www.unidata.ucar.edu/data/uniwisc_old.html
   
  contains information on the products that have been distributed
  in the UNIWISC feed for the past decade or so.

- all users are advised to update their display and analysis software
  to the latest version(s) that is(are) available from Unidata

  NB: this is especially true for GEMPAK users as only the most recent
  release of Unidata GEMPAK contains support for the GOES-R fixed grid 
  projection that is used for the majority of the images in the
  revamped feed.

Support

  Please send any comments/questions/concerns to Unidata User support at:

  address@hidden

Best regards,

Unidata User Support

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: TVO-907725
Department: Support IDD
Priority: Normal
Status: Closed
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.