[THREDDS #AUI-646400]: SOS - "Too Many Open Files" Error

Greetings Cameron,

Do you use github? If so, would you mind opening an issue for this request on
our issue tracker?

https://github.com/unidata/siphon

That will help us make sure it gets on the list. If you don't use github, I can 
add it :-)

Thanks!

Sean

> Sean,
> 
> Thank you so much for your thorough response! My co-workers and I were 
> eventually able to settle on that root cause ourselves after noticing we all 
> had the same issues... we were discussing that it would definitely be great 
> if Siphon were able to return a consistent "Server Temporarily Unavailable" 
> error regardless of what weird other errors (I counted at least 3) it tried 
> to give us. Maybe something for the improvements list if possible...
> 
> Thank you!
> 
> Cameron J. Nixon
> Graduate TA - TTU ATMO
> President - SCAMS at TTU
> cameronnixonphotography.wordpress.com
> 
> 
> 
> From: Unidata Python Support
> Sent: Monday, April 16, 5:39 PM
> Subject: [THREDDS #AUI-646400]: SOS - "Too Many Open Files" Error
> To: Nixon, Cameron
> Cc: address@hidden
> 
> 
> Greetings Cameron! Good news / bad news. So, the good news is that this isn't 
> an issue with too many files open on your computer, so you are good there :-) 
> The bad news is that this is an error being generated from the NCEI THREDDS 
> Data Server, which means the whole server is going to be unresponsive until 
> it is restarted (which it looked like they have done). For your specific 
> question, Siphon uses Python's tempfile module to handle the netCDF file 
> returned by NCSS. According to the docs for tempfile: " A platform-specific 
> location: On Windows, the directories C:\TEMP, C:\TMP, \TEMP, and \TMP, in 
> that order. On all other platforms, the directories /tmp, /var/tmp, and 
> /usr/tmp, in that order. " If you close the dataset object when you are done, 
> the tempfile module will automatically remove the file. However, depending on 
> the OS, these directories will get cleaned out periodically, but I am not 
> sure of those specifics (how often, what triggers the purge, etc). You can 
> dig ar
 ound in those directories to see if if there are any netCDF files hanging out 
(if there are files, their name will probably be nonsensical, as they are 
created by the tempfile module). Let me know if you need any other help, and 
hopefully things are working again with the NCEI server! Sean > Hi! I was 
wondering if someone here would be able tell me where temporary netCDF4 files 
downloaded from a thredds server using Siphon were stored. I made the rookie 
mistake of forgetting that the close() function exists and have since 
downloaded quite a many model output analyses... Now, I get an error telling me 
that I have too many files open, and I've looked everywhere and can't seem to 
find how to delete them. This error came from downloading files from a RAP 
archive, but I have another program that pulls from a real-time RAP that works 
just fine still... any help would be much appreciated! > > > Cameron J. Nixon 
Ticket Details =================== Ticket ID: AUI-646400 Department: Su
 pport Python Priority: Normal Status: Open =================== NOTE: All email 
exchanges with Unidata User Support are recorded in the Unidata inquiry 
tracking system and then made publicly available through the web. If you do not 
want to have your interactions made available in this way, you must let us know 
in each email you send to us.
> 
> 
> 


Ticket Details
===================
Ticket ID: AUI-646400
Department: Support Python
Priority: Normal
Status: Open
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.