[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #DZO-315212]: Text file ingestion issue with ByteOrderMarks

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [IDV #DZO-315212]: Text file ingestion issue with ByteOrderMarks
  • Date: Mon, 10 Mar 2014 10:58:51 -0600
U. Suesser,

Indeed there appears to be something wrong with the encoding of your 
data. Please save your data as ASCII. The attached file loaded fine.

Best Wishes,

Unidata IDV Support

> Full Name: U. Suesser
> Email Address: address@hidden
> Organization: N/A
> Package Version: 4.1 build date:2013-08-02 18:38 UTC
> Operating System: Windows 8
> Hardware: Java: home: C:\Program Files\IDV_4.1\jre version: 1.6.0_43 
> j3d:1.5.2 fcs (build4)
> Description of problem:
> 
> Have spun off a .net app to generate some point text files for use with
> IDV. It however appears that Java is having problems ignoring the BOM
> specifically the 3-byte "???" affixed to the beginning of the file used
> to represent UTF 8. The ingest consequently crashes.  Any suggestions
> on how to get around this in IDV, or to mod the ingest routines to make
> them more robust?
> 
> Regards U. Suesser
> 
> 


Ticket Details
===================
Ticket ID: DZO-315212
Department: Support IDV
Priority: Normal
Status: Closed
(index -> (Time,Latitude,Longitude,Altitude))
Time[fmt="yyyy-MM-dd HH:mm:ss"],Latitude[unit="deg"],Longitude[unit="degrees 
west"],Altitude[unit="m"]
2014-03-07 10:33:11,21.318681,157.922428,10.0
2014-03-07 12:00:00,21.6054914382007,157.692048903344,10.0
2014-03-07 18:00:00,22.8025683402895,156.717556016642,10.0
2014-03-08 00:00:00,23.9936191116269,155.725834346799,10.0
2014-03-08 06:00:00,25.1781741384522,154.715638675151,10.0
2014-03-08 12:00:00,26.3557374543671,153.685671401531,10.0
2014-03-08 18:00:00,27.5257844446457,152.634579584965,10.0
2014-03-09 00:00:00,28.6877593985308,151.560952104633,10.0
2014-03-09 06:00:00,29.8410729025722,150.463317005483,10.0
2014-03-09 12:00:00,30.9850990695179,149.340139108666,10.0
2014-03-09 18:00:00,32.1191725993225,148.189817985657,10.0
2014-03-10 00:00:00,33.242585671637,147.010686416835,10.0
2014-03-10 06:00:00,34.3545846728779,145.801009480856,10.0
2014-03-10 12:00:00,35.454366765845,144.558984450519,10.0
2014-03-10 18:00:00,36.5410763161177,143.28274170442,10.0
2014-03-11 00:00:00,37.6138011973835,141.970346901287,10.0
2014-03-11 06:00:00,38.6715690077496,140.61980470561,10.0
2014-03-11 12:00:00,39.7133432412832,139.229064398076,10.0
2014-03-11 18:00:00,40.7380194738612,137.796027751659,10.0
2014-03-12 00:00:00,41.7444216401999,136.318559601823,10.0
2014-03-12 06:00:00,42.7312984999483,134.794501584683,10.0
2014-03-12 12:00:00,43.6973204151323,133.22168955588,10.0
2014-03-12 18:00:00,44.6410765890143,131.597975230096,10.0
2014-03-13 00:00:00,45.5610729473123,129.921252589086,10.0
2014-03-13 06:00:00,46.4557308760298,128.189489585855,10.0
2014-03-13 12:00:00,47.323387064704,126.400765612784,10.0
2014-03-13 18:00:00,48.1622947377997,124.553315089317,10.0
2014-03-14 00:00:00,48.9706265874742,122.645577346005,10.0
2014-03-07 10:33:11,21.318681,157.922428,10.0
2014-03-07 12:00:00,21.6054914382007,157.692048903344,10.0
2014-03-07 18:00:00,22.8025683402895,156.717556016642,10.0
2014-03-08 00:00:00,23.9936191116269,155.725834346799,10.0
2014-03-08 06:00:00,25.1781741384522,154.715638675151,10.0
2014-03-08 12:00:00,26.3557374543671,153.685671401531,10.0
2014-03-08 18:00:00,27.5257844446457,152.634579584965,10.0
2014-03-09 00:00:00,28.6877593985308,151.560952104633,10.0
2014-03-09 06:00:00,29.8410729025722,150.463317005483,10.0
2014-03-09 12:00:00,30.9850990695179,149.340139108666,10.0
2014-03-09 18:00:00,32.1191725993225,148.189817985657,10.0
2014-03-10 00:00:00,33.242585671637,147.010686416835,10.0
2014-03-10 06:00:00,34.3545846728779,145.801009480856,10.0
2014-03-10 12:00:00,35.454366765845,144.558984450519,10.0
2014-03-10 18:00:00,36.5410763161177,143.28274170442,10.0
2014-03-11 00:00:00,37.6138011973835,141.970346901287,10.0
2014-03-11 06:00:00,38.6715690077496,140.61980470561,10.0
2014-03-11 12:00:00,39.7133432412832,139.229064398076,10.0
2014-03-11 18:00:00,40.7380194738612,137.796027751659,10.0
2014-03-12 00:00:00,41.7444216401999,136.318559601823,10.0
2014-03-12 06:00:00,42.7312984999483,134.794501584683,10.0
2014-03-12 12:00:00,43.6973204151323,133.22168955588,10.0
2014-03-12 18:00:00,44.6410765890143,131.597975230096,10.0
2014-03-13 00:00:00,45.5610729473123,129.921252589086,10.0
2014-03-13 06:00:00,46.4557308760298,128.189489585855,10.0
2014-03-13 12:00:00,47.323387064704,126.400765612784,10.0
2014-03-13 18:00:00,48.1622947377997,124.553315089317,10.0
2014-03-14 00:00:00,48.9706265874742,122.645577346005,10.0