[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

20070330: non-ascii chars in CONDUIT headers

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: 20070330: non-ascii chars in CONDUIT headers
  • Date: Fri, 30 Mar 2007 14:10:33 -0600
David,

The problem is that the GRIB library didn't null terminate the string for
the period of accumulation. I've updated the source code, and will have to
work with ncep to install the new code at there end.

Steve Chiswell
Unidata User Support




>From: "David Wojtowicz" <address@hidden>
>Organization: UCAR/Unidata
>Keywords: 200703301828.l2UISq7f012656

>This is a multi-part message in MIME format.
>
>------=_NextPart_000_0004_01C772CF.57CC9310
>Content-Type: text/plain;
>       charset="iso-8859-1"
>Content-Transfer-Encoding: quoted-printable
>
>Hi,
>
>=20
>
>FYI, we=92re continuing to see non-ascii chars in CONDUIT headers.  This =
>may
>indicate a buffer overflow some place during ingest.  The products that =
>it
>seems to happen on are the RUC2 data fields PRX and RXX
>
>=20
>
>=20
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.grb2f01.grib2
>!grib2/ncep/RUC/#000/200703301100F
>
>001/PRXX=F9=F8*/0 - NONE! 000207
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f01.grib2
>!grib2/ncep/RUC2/#000/2007033011
>
>00F001/RXXg9+M/0 - NONE! 000683
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrbf01.grib2
>!grib2/ncep/RUC2/#000/200703301100
>
>F001/RXX_=B4+M/0 - NONE! 000683
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.grb2f02.grib2
>!grib2/ncep/RUC/#000/200703301100F
>
>002/PRXX}+/0 - NONE! 000207
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f02.grib2
>!grib2/ncep/RUC2/#000/2007033011
>
>00F002/RXX=EB*M/0 - NONE! 000683
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrbf02.grib2
>!grib2/ncep/RUC2/#000/200703301100
>
>F002/RXXH+M/0 - NONE! 000683
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.grb2f03.grib2
>!grib2/ncep/RUC/#000/200703301100F
>
>003/PRXX
>
>        $=D0*/0 - NONE! 000207
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f03.grib2
>!grib2/ncep/RUC2/#000/2007033011
>
>00F003/RXXTr+M/0 - NONE! 000683
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrbf03.grib2
>!grib2/ncep/RUC2/#000/200703301100
>
>F003/RXXm=D2=D3*M/0 - NONE! 000683
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f06.grib2
>!grib2/ncep/RUC2/#000/2007033011
>
>00F006/RXX}=C4w+M/0 - NONE! 000683
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrbf06.grib2
>!grib2/ncep/RUC2/#000/200703301100
>
>F006/RXX=D0<}+M/0 - NONE! 000683
>
>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f09.grib2
>!grib2/ncep/RUC2/#000/2007033011
>
>00F009/RXX=C3=EDq+M/0 - NONE! 000683
>
>=20
>
>-----
>David Wojtowicz, Sr. Research Programmer, Sysadmin
>Dept of Atmospheric Sciences / Computer Services
>University of Illinois at Urbana-Champaign
>address@hidden  (217) 333-8390
>
>=20
>
>
>------=_NextPart_000_0004_01C772CF.57CC9310
>Content-Type: text/html;
>       charset="iso-8859-1"
>Content-Transfer-Encoding: quoted-printable
>
><html xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
>xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
>xmlns:st1=3D"urn:schemas-microsoft-com:office:smarttags" =
>xmlns=3D"http://www.w3.org/TR/REC-html40";>
>
><head>
><meta http-equiv=3DContent-Type content=3D"text/html; =
>charset=3Diso-8859-1">
><meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
><o:SmartTagType =
>namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
> name=3D"PlaceName"/>
><o:SmartTagType =
>namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
> name=3D"PlaceType"/>
><o:SmartTagType =
>namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
> name=3D"place"/>
><!--[if !mso]>
><style>
>st1\:*{behavior:url(#default#ieooui) }
></style>
><![endif]-->
><style>
><!--
> /* Style Definitions */
> p.MsoNormal, li.MsoNormal, div.MsoNormal
>       {margin:0in;
>       margin-bottom:.0001pt;
>       font-size:12.0pt;
>       font-family:"Times New Roman";}
>a:link, span.MsoHyperlink
>       {color:blue;
>       text-decoration:underline;}
>a:visited, span.MsoHyperlinkFollowed
>       {color:purple;
>       text-decoration:underline;}
>span.EmailStyle17
>       {mso-style-type:personal-compose;
>       font-family:Arial;
>       color:windowtext;}
>@page Section1
>       {size:8.5in 11.0in;
>       margin:1.0in 1.25in 1.0in 1.25in;}
>div.Section1
>       {page:Section1;}
>-->
></style>
>
></head>
>
><body lang=3DEN-US link=3Dblue vlink=3Dpurple>
>
><div class=3DSection1>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Hi,<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>FYI, we&#8217;re continuing to see non-ascii chars in
>CONDUIT headers.=A0 This may indicate a buffer overflow some place =
>during
>ingest.=A0 The products that it seems to happen on are the RUC2 data =
>fields PRX
>and RXX<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.grb2f01.grib2
>!grib2/ncep/RUC/#000/200703301100F<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>001/PRXX=F9=F8*/0 - NONE! =
>000207<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f01.grib2
>!grib2/ncep/RUC2/#000/2007033011<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>00F001/RXXg9+M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrbf01.grib2
>!grib2/ncep/RUC2/#000/200703301100<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>F001/RXX_=B4+M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.grb2f02.grib2
>!grib2/ncep/RUC/#000/200703301100F<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>002/PRXX}+/0 - NONE! =
>000207<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f02.grib2
>!grib2/ncep/RUC2/#000/2007033011<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>00F002/RXX=EB*M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrbf02.grib2
>!grib2/ncep/RUC2/#000/200703301100<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>F002/RXXH+M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.grb2f03.grib2
>!grib2/ncep/RUC/#000/200703301100F<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>003/PRXX<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>=A0=A0=A0=A0=A0=A0=A0 $=D0*/0 - NONE! =
>000207<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f03.grib2
>!grib2/ncep/RUC2/#000/2007033011<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>00F003/RXXTr+M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrbf03.grib2
>!grib2/ncep/RUC2/#000/200703301100<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>F003/RXXm=D2=D3*M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f06.grib2
>!grib2/ncep/RUC2/#000/2007033011<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>00F006/RXX}=C4w+M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrbf06.grib2
>!grib2/ncep/RUC2/#000/200703301100<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>F006/RXX=D0&lt;}+M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>Error: Header contains non-ascii characters:
>data/nccf/com/ruc/prod/ruc2a.20070330/ruc2.t11z.bgrb20f09.grib2
>!grib2/ncep/RUC2/#000/2007033011<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>00F009/RXX=C3=EDq+M/0 - NONE! =
>000683<o:p></o:p></span></font></p>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>
>
><div>
>
><p class=3DMsoNormal><font size=3D2 face=3DArial><span =
>style=3D'font-size:10.0pt;
>font-family:Arial'>-----<br>
>David Wojtowicz, Sr. Research Programmer, Sysadmin<br>
>Dept of Atmospheric Sciences / Computer Services<br>
><st1:place w:st=3D"on"><st1:PlaceType =
>w:st=3D"on">University</st1:PlaceType> of <st1:PlaceName
> w:st=3D"on">Illinois</st1:PlaceName></st1:place> at =
>Urbana-Champaign<br>
><a href=3D"mailto:address@hidden"; =
>title=3D"mailto:address@hidden";>address@hidden</a>&nbsp;
>(217) 333-8390</span></font><o:p></o:p></p>
>
></div>
>
><p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
>style=3D'font-size:
>12.0pt'><o:p>&nbsp;</o:p></span></font></p>
>
></div>
>
></body>
>
></html>
>
>------=_NextPart_000_0004_01C772CF.57CC9310--
>
--
NOTE: All email exchanges with Unidata User Support are recorded in the
Unidata inquiry tracking system and then made publicly available
through the web.  If you do not want to have your interactions made
available in this way, you must let us know in each email you send to us.