[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDV #IEV-652340]: point data soooo slowwww - any way to subset time, or would non-text format be faster?

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [IDV #IEV-652340]: point data soooo slowwww - any way to subset time, or would non-text format be faster?
  • Date: Tue, 23 Sep 2014 14:00:40 -0600
> Hello IDVers.
> 
> I am working to get a network of GPS-met stations into the IDV.
> (for COCOnet eventually for Teddy -- for now a smaller Brazilian effort with 
> about a dozen stations)
> 
> 
> Thanks to your help, I made a single .csv file with all the stations, 5 
> minute interval, for a month.
> It is 10.3 MB, not huge.
> It involved a lot of hand editing though, so trimming the times is not 
> trivial to do.
> 
> 

Brian,
    Can you upload this point data for me to check locally?

http://motherlode.ucar.edu/repository/alias/idvupload

or point me to where it locates in your server.


Yuan
> Unfortunately the point data display works very slowly.
> It is fragile - touching the zoom or any display makes some big slow point 
> data re-rendering operation happen. ??
> I fear it will be intolerably slow for Teddy's CoConet project with 70 
> stations.
> 
> 
> 1. Might it be much faster if IDV used the Time Driver to pre-sample the 
> point data?
> 
> 2. Might it be faster if the .csv file were a .nc point file, for easier 
> subsetting?
> (If so, how to convert? Rosetta? I tried File--> Save Displayed Data as 
> NetCDF, but it gives an error).
> 
> 
> There is a "Time declutter" window, but it isn't clear what it does.
> Only after the point data are all created (presumably all 8640 times) is 
> there any "Times" menu where I can match the time driver.
> (Really, it matches From Animation Time option, not Time Driver).
> 
> 
> I attach a bundle and some screen shots.
> Sorry the bundle has some grids attached, but it is the point data that make 
> it slow.
> 
> 
> Any advice welcomed. Thanks!!
> 
> Brian, David, and Teddy.
> 
> 
> [cid:a0b4c125-21a6-4d62-881e-dc1d91bf3b62@amazon.rsmas.miami.edu]
> 
> 
> 
> [cid:07af9b57-caf6-4ee3-aaee-64551dcbc8be@amazon.rsmas.miami.edu]
> 
> 
> 
> [cid:b66df8e6-215a-438d-b305-46bc743a50ac@amazon.rsmas.miami.edu]
> 
> 
> 
> 
> [cid:67525548-2d56-4a3d-9edf-748de9617aff@amazon.rsmas.miami.edu]
> 
> 
> 
> 

Ticket Details
===================
Ticket ID: IEV-652340
Department: Support IDV
Priority: Normal
Status: Open