Hi,I'm not sure this one should go out to nws-changes, but I thought you would be interested anyway.
Linda ---------- Forwarded Message ---------- Date: Wednesday, August 02, 2000 10:45 AM -0400 From: Arthur Wick <address@hidden> To: Luis Cano <address@hidden> Subject: Re: [Fwd: 20000801: Data delays-ADMIN NOTICE NOUS42 KWNO (fwd)] Louie, I don't know if you responded to this or not, but I'll take the opportunity to try to set the record straight with regard to at least a few people. As you know, the Bell-Atlantic line outage yesterday interupted access to the Internet from NCEP and some other NOAA users. It also interupted the administrative functions supported by the DC Metropolitan Area Network (e.g. e-mail). But it had no impact on the data flowing between the OSO Telecommunications Gateway and NCEP -- there was no DBNet problem. Unfortunately, during the Bell-Atlantic outage there was a computer problem within the OSO Gateway. At this point the cause of that problem is not known. I have asked Dave Weinbrenner to attempt to determine from OSO * What the problem was * What action was eventually taken (several hours after the end of the Bell-Atlantic problem) to resolve it * What escalation procedures exist or can be created to help us get more responisve consideration at OSO when events such as this occur in the future. Hopefully we can learn something from this incident so as to be better able to deal with future events of this type. Art Luis Cano wrote: Sigh ... ------------------------------------------------------------ Subject: 20000801: Data delays-ADMIN NOTICE NOUS42 KWNO (fwd) Date: Tue, 01 Aug 2000 07:56:35 -0600 From: Linda Miller <address@hidden> Organization: UCAR/Unidata To: address@hidden 209 NOUS42 KWNO 011353 ADMNFD SPECIAL NCEP DISCUSSION CENTRAL OPERATIONS/NCEP/NWS/WASHINGTON DC 1350 UTC TUE AUG 01 2000 01350Z...NCEP IS SUFFERING FROM A BELL ATLANTIC LINE OUTAGE. FORTUNATELY THIS ONE INVOLVES INTERNET AND DBNET CONNECTIONS AND NOT DATA RECEIPT BY THE IBM SP. THEREFORE ONLY MINIMAL MODEL IMPACT EXPECTED. SEVERAL PRODUCTS WHICH REQUIRE DBNET FOR TRANSMISSION WILL BE DELAYED. THE 12Z ETA BEGAN AT 1322Z WITH GOOD N AMER UPA DATA COVERAGE AND QUALITY. RAOB RECAP...LCH ABR EQUIP PBLMS AND NO DATA. CUN/76595 ADDED 4 MB/30 M TO SFC PRESS/HGTS DUE TO BASELINE ERROR. WAL ALB PURGED TOO-HIGH HGTS/TEMPS 100 MB AND 150 MB RESPECTIVELY AND ABOVE. CHS PURGED TOO-HIGH HGTS 250 MB AND ABOVE AND TOO-WARM 124 MB TEMP. MYNN/78073 PURGED ERRATIC WINDS 1000 TO 810 MB /APRT TRACKING PBLM/ AND CONVECTIVELY CONTAMINATED WINDS 196 TO 110 MB. FYI...THE NCEP IBM SP IS SCHEDULED TO BE TAKEN DOWN ON WED. AUG 2ND AFTER THE COMPLETION OF THE 12Z AVN AND ANY 12Z GHM RUNS ROUGHLY STARTING AROUND 1700Z AND LASTING ABOUT 3HRS TO ROUGHLY 2000Z. FSL RUC2 BACKUP WILL BE IMPLEMENTED DURING THIS OUTAGE. 18Z ETA AND AVN RUNS WILL START ASA THE IBM COMES BACK UP. STOUDT/SDM/NCO/NCEP NNNN ---------- End Forwarded Message ---------- ---------- End Forwarded Message ---------- Linda Miller - address@hidden External Liaison, Unidata University Corporation for Atmospheric Research P.O. Box 3000 Boulder, CO 80307-3000 303 497-8646 fax: 303-497-8690 URL: http://www.unidata.ucar.edu/staff/lmiller/un.act.html
--- Begin Message ---Louie,
- Subject: Re: [Fwd: 20000801: Data delays-ADMIN NOTICE NOUS42 KWNO (fwd)]
- Date: Wed, 02 Aug 2000 10:45:58 -0400
I don't know if you responded to this or not, but I'll take the opportunity to try to set the record straight with regard to at least a few people. As you know, the Bell-Atlantic line outage yesterday interupted access to the Internet from NCEP and some other NOAA users. It also interupted the administrative functions supported by the DC Metropolitan Area Network (e.g. e-mail). But it had no impact on the data flowing between the OSO Telecommunications Gateway and NCEP -- there was no DBNet problem.
Unfortunately, during the Bell-Atlantic outage there was a computer problem within the OSO Gateway. At this point the cause of that problem is not known. I have asked Dave Weinbrenner to attempt to determine from OSO
Hopefully we can learn something from this incident so as to be better able to deal with future events of this type.
- What the problem was
- What action was eventually taken (several hours after the end of the Bell-Atlantic problem) to resolve it
- What escalation procedures exist or can be created to help us get more responisve consideration at OSO when events such as this occur in the future.
Art
Luis Cano wrote:
Sigh ...------------------------------------------------------------
Subject: 20000801: Data delays-ADMIN NOTICE NOUS42 KWNO (fwd)
Date: Tue, 01 Aug 2000 07:56:35 -0600
From: Linda Miller <address@hidden>
Organization: UCAR/Unidata
To: address@hidden209
NOUS42 KWNO 011353
ADMNFD
SPECIAL NCEP DISCUSSION
CENTRAL OPERATIONS/NCEP/NWS/WASHINGTON DC
1350 UTC TUE AUG 01 200001350Z...NCEP IS SUFFERING FROM A BELL ATLANTIC LINE OUTAGE.
FORTUNATELY THIS ONE INVOLVES INTERNET AND DBNET CONNECTIONS
AND NOT DATA RECEIPT BY THE IBM SP. THEREFORE ONLY MINIMAL
MODEL IMPACT EXPECTED. SEVERAL PRODUCTS WHICH REQUIRE DBNET
FOR TRANSMISSION WILL BE DELAYED.THE 12Z ETA BEGAN AT 1322Z WITH GOOD N AMER UPA DATA COVERAGE
AND QUALITY. RAOB RECAP...LCH ABR EQUIP PBLMS AND NO DATA.
CUN/76595 ADDED 4 MB/30 M TO SFC PRESS/HGTS DUE TO BASELINE
ERROR. WAL ALB PURGED TOO-HIGH HGTS/TEMPS 100 MB AND 150 MB
RESPECTIVELY AND ABOVE. CHS PURGED TOO-HIGH HGTS 250 MB AND
ABOVE AND TOO-WARM 124 MB TEMP. MYNN/78073 PURGED ERRATIC
WINDS 1000 TO 810 MB /APRT TRACKING PBLM/ AND CONVECTIVELY
CONTAMINATED WINDS 196 TO 110 MB.FYI...THE NCEP IBM SP IS SCHEDULED TO BE TAKEN DOWN ON WED.
AUG 2ND AFTER THE COMPLETION OF THE 12Z AVN AND ANY 12Z GHM RUNS
ROUGHLY STARTING AROUND 1700Z AND LASTING ABOUT 3HRS TO ROUGHLY
2000Z. FSL RUC2 BACKUP WILL BE IMPLEMENTED DURING THIS OUTAGE.
18Z ETA AND AVN RUNS WILL START ASA THE IBM COMES BACK UP.STOUDT/SDM/NCO/NCEP
NNNN---------- End Forwarded Message ----------
begin:vcard n:Wick;Arthur tel;fax:301-763-8381 tel;home:301-645-1392 tel;work:301-763-8000, ext. 7155 x-mozilla-html:TRUE org:DOC/NOAA/NWS;NCEP Central Operations version:2.1 email;internet:address@hidden title:Chief, Networking and Communications Branch adr;quoted-printable:;;Room 307=0D=0AWorld Weather Building=0D=0A5200 Auth Road;Camp Springs;Maryland;20746; fn:Arthur Wick end:vcard
--- End Message ---