20030114: Strange new products and corrupted old products

Bill,

The KWAL products you mention are the NOAAPORT DCP products
being ingested on jackie.unidata.ucar.edu and sent
on the IDD along with other OCONUS grids (found in the HDS stream)
available on channel 4 of NOAAPORT.

Steve Chiswell
Unidata User Support







On Tue, 14 Jan 2003, Bill Noon wrote:

> On 12/16/02 we saw a large increase in the size and number of products
> on the DDS data stream.  It seems that the NWS is now sending a lot of
> products that are similar to the following:
>
> ^C^A^M^M
> 869 ^M^M
> SRTX20 KWAL 101202^M^M
> ^^17735134 0101202012BAOo@FqPSH 31-2NN 125E^M^M
> ^C^A^M^M
> 870 ^M^M
> SRWA20 KWAL 101202^M^M
> ^^1639C77A 010120203@@URqq 48+2NN 118W^M^M
> ^C^A^M^M
> 871 ^M^M
> SRIA30 KWAL 101202^M^M
> ^^CE628300 010120201X*GH@@@ JB@I_@Ia GB@`x 0R 45+4NN  49E^M^M
> ^C^A^M^M
> 872 ^M^M
> SRNY20 KWAL 101202^M^M
> ^^DD006256
> 0101202012A@DE@DF@DE@DF@DF@DF@DF@DF@DF@DF@DF@DF@DF@DF@DF@DFLPJ 38-1NN
> 131E^M^M
> ^C^A^M^M
> 873 ^M^M
> SRTX20 KWAL 101202^M^M
> ^^175C0634
> 010120150B1A@BT@@u@BT@@u@BU@@u@BT@@u@BT@@u@BU@@u@BT@@u@BU@@u@BT@@u@BT@@u
> @BT@@u@BT@@u@BU@@u@BT@@u@BT@@u@BU@@u@BU@@u@BT@@u@BU@@u@BU@@u@BU@@u@BU@@u
> @BT@@u@BU@@u@BV@@u@BU@@u@BU@@u@BT@@u@BU@@u@BV@@u@BU@@u@BU@@uF 47-4NN
> 107E^M^M
> ^C^A^M^M
> 874 ^M^M
> SRXX60 KWAL 101202^M^M
> ^^346917CE 010120205@@C`@@@@E@@@@Zh 50-2NN 128W^M^M
> ^C^A^M^M
> 877 ^M^M
> SRHI20 KWAL 101202^M^M
> ^^263893A2 010120207BHcAmkCYlBzbAmTCZfB{hT 37-1NN 104W^M^M
> ^C^A^M^M
>
> It looks like the header is SRxxnn KWAL where xx is a state
> abbreviation.  The product itself is in some encoded format.
>
> Does anyone know what this data is and where it came from?
>
> A probably different issue is what looks like a corruption of the
> surface observations (mostly SPECI) where a "^C\xec^T=^M^M" is dropped
> into the middle of what looks like a dump of several hours of data from
> the ASOS.
>
> 160 ^M^M
> SPUS41 KWBC 101719 RRF^M^M
> SPECI^M^M
> KPSM 090841Z 06005KT 1SM R34/6000FT -SN BR OVC006 M03/M03 A2904=^M^M
> KPVD 101023Z 02003KT 10SM -RA SCT025 BKN035 OVC047 03/01 A2937=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> ^C\xec^T=^M^M
> KPWM 101706Z 31008KT 6SM HZ OVC019 M07/M09 A2946=^M^M
> KPWM 101658Z 32007KT 2 1/2SM -SN OVC019 M07/M09 A2946=^M^M
> KPWM 101639Z 32008KT 4SM HZ OVC019 M07/M09 A2946=^M^M
> KPWM 101505Z 35006KT 3SM -SN BR OVC015 M08/M10 A2948=^M^M
> KPWM 101458Z 34007KT 2 1/2SM -SN OVC015 M08/M11 A2948=^M^M
> KPWM 101432Z 34006KT 4SM -SN BR OVC015 M08/M11 A2948=^M^M
> KPWM 101120Z 36008KT 10SM OVC017 M08/M11 A2945=^M^M
> KPWM 101039Z 03007KT 10SM SCT018 BKN024 OVC038 M08/M11 A2944=^M^M
> KPWM 101032Z 36008KT 10SM FEW018 SCT024 OVC038 M08/M11 A2945=^M^M
> KPWM 101020Z AUTO 03008KT 10SM BKN024 OVC038 M08/M11 A2945=^M^M
> KPWM 100942Z AUTO 01008KT 2SM -SN BR FEW016 OVC045 M08/M11 A2945=^M^M
> KPWM 100934Z AUTO 02009KT 1 3/4SM -SN BR SCT018 OVC045 M08/M11^M^M
> A2945=^M^M
> KPWM 100906Z AUTO 03008KT 2SM -SN BR BKN016 BKN029 OVC045 M08/M11^M^M
> A2945=^M^M
> KPWM 100859Z AUTO 02008KT 1 3/4SM -SN BR BKN012 BKN029 OVC045^M^M
> M08/M11 A2946=^M^M
> KPWM 100835Z AUTO 02008KT 1SM -SN BR VV005 M08/M10 A2946=^M^M
> KPWM 100819Z AUTO 02008KT 3/4SM -SN BR VV003 M08/M10 A2946=^M^M
> KPWM 100808Z AUTO 36009KT 1/2SM SN FZFG VV005 M08/M10 A2947=^M^M
> KPWM 100731Z AUTO 02007KT 1/2SM SN FZFG VV007 M08/M10 A2945=^M^M
> KPWM 100723Z AUTO 04008KT 1SM -SN BR VV009 M08/M10 A2945=^M^M
> ^C\xec^T=^M^M
> KROC 101013Z 29012G19KT 9SM -SN FEW018 SCT025 BKN035 M06/M10 A2958=^M^M
> KROC 100914Z 29009KT 2SM -SN BR BKN022 OVC029 M06/M07 A2956=^M^M
> KROC 100839Z 30010G20KT 5SM -SN BR SCT014 BKN022 OVC027 M05/M07^M^M
> A2955=^M^M
> KROC 100826Z 30010KT 4SM -SN BR FEW008 BKN013 OVC021 M04/M06 A2954=^M^M
> KROC 100818Z 30011KT 5SM -SN BR BKN010 BKN013 OVC021 M04/M06 A2954=^M^M
> KROC 100805Z 30011KT 7SM -SN OVC008 M05/M06 A2953=^M^M
> KROC 100746Z 31008KT 9SM -SN OVC010 M05/M06 A2952=^M^M
> KROC 100542Z 34015KT 1 3/4SM -SN BR OVC006 M03/M04 A2941=^M^M
> KROC 100533Z 35016KT 1 3/4SM -SN BR OVC004 M03/M03 A2940=^M^M
> KROC 100515Z 35010KT 8SM -SN OVC004 M02/M02 A2938=^M^M
> KROC 100407Z 29006KT 2 1/2SM -SN BR OVC004 00/00 A2935=^M^M
> KROC 100401Z 30005KT 1 3/4SM -SN BR BKN004 OVC008 00/00 A2934=^M^M
> KROC 100314Z 24008KT 2 1/2SM -SN BR OVC008 01/00 A2933=^M^M
> KROC 100223Z 24008KT 4SM -SN BR OVC008 01/00 A2933=^M^M
> KROC 100200Z 24009KT 4SM -SN BR FEW006 BKN010 OVC018 01/01 A2933=^M^M
> KROC 100112Z 26011KT 9SM -RASN FEW009 BKN013 OVC018 01/00 A2932=^M^M
> KROC 100104Z 25015KT 8SM -RASN FEW009 BKN017 OVC026 02/00 A2932=^M^M
> KROC 092218Z VRB04KT 2 1/2SM -SN BR FEW007 OVC018 M02/M02 A2933=^M^M
> KROC 092212Z 12004KT 7SM -SN OVC016 M02/M02 A2933=^M^M
> KSYR 101232Z 30007KT 3SM -SN FEW027 OVC035 M06/M09 A2963=^M^M
> KSYR 101228Z 29007KT 2SM -SN SCT027 OVC035 M06/M09 A2962=^M^M
> KSYR 101157Z 31009KT 2 1/2SM -SN SCT020 OVC029 M06/M09 A2961=^M^M
> KSYR 101125Z 30011KT 6SM -SN SCT018 OVC035 M06/M09 A2959=^M^M
> KSYR 101105Z 31013KT 7SM -SN SCT016 BKN022 OVC036 M06/M09 A2958=^M^M
> KSYR 100610Z 30010KT 6SM -SN BR FEW006 OVC011 M02/M04 A2937=^M^M
> KSYR 100541Z 30006KT 4SM -SN BR BKN008 BKN014 OVC045 M01/M03 A2935=^M^M
> KSYR 100530Z 29006KT 3SM -SN BR FEW007 BKN017 OVC050 M01/M02 A2935=^M^M
> KSYR 100444Z 00000KT 1 1/2SM -SN BR FEW007 OVC019 M01/M03 A2934=^M^M
> KSYR 100419Z 00000KT 1 1/2SM -SN BR BKN020 OVC028 M01/M03 A2933=^M^M
> KSYR 100416Z 00000KT 2SM -SN BR OVC022 M01/M03 A2933=^M^M
> KSYR 100331Z 00000KT 4SM -SN BR OVC027 M02/M03 A2933=^M^M
> KSYR 100301Z 36005KT 3SM -SN BR OVC032 M02/M03 A2933=^M^M
> KSYR 100238Z 35005KT 2SM -SN BR FEW017 SCT029 OVC036 M02/M03 A2934=^M^M
> KSYR 092319Z 07004KT 3SM -SN BR OVC021 M02/M03 A2937=^M^M
> KSYR 092012Z 00000KT 2SM -SN BR OVC035 M02/M04 A2937=^M^M
> KSYR 091905Z 32003KT 2SM -SN FEW020 OVC031 M02/M05 A2934=^M^M
> ^M^M
>
>
> Is this something that we should plan on filtering out or will there be
> a fix?
>
> Thanks.
>
> Bill Noon
> Northeast Regional Climate Center
> Cornell University
>