[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[AWIPS #UFG-297778]: EDEX Data Retention Tip Blog question



> humorously stated - no it really doesn’t.
> 
> The first "pass" is 34 versions in a 1 hour period. So no more than 34 
> versions in a 1 hour period allowed. So if 50 versions were received, it will 
> be reduced to the most recent 34 versions.
> 
> So now we have 34 versions in a 1 hour period remaining. The second criteria 
> is assessed -- no more than 15 versions in a 3 hour period. Wouldn’t those 34 
> versions that remained after the first filter be reduced to 15 versions?
> 
> Assuming we have now been reduced to 15 versions, would then the NEXT rule 
> further reduce them to 11 versions?
> 
> And likewise the final rule being that its no more than 10 versions in a 24 
> hour period --- reduce them to 10?
> 
> It would seem why not just cut to the chase and use one rule -- the last one?


Hi Pete,

It is a little confusing. I looked at the processed hdf5 obs files on our EDEX 
(/awips2/edex/data/hdf5/obs) and mapped them to each rule.

-35 files (one will probably get purged next) that are timestamped at 1 hour 
intervals (consistent with rule #1)
-15 files that are timestamped at 3 hour intervals (consistent with rule #2)
-11 files that are timestamped at 6 hour intervals (consistent with rule #3)
-10 files that are timestamped at 24 hour intervals (1 day) at 12Z (consistent 
with rule #4)

Please see the attached and let us know if this helps clarify.

Thanks,

Tiffany Meyer
AWIPS Lead Software Engineer
UCAR-Unidata

If you're interested, please feel free to fill out a survey about the support 
you receive:  
https://docs.google.com/forms/d/e/1FAIpQLSeDIkdk8qUMgq8ZdM4jhP-ubJPUOr-mJMQgxInwoAWoV5QcOw/viewform

Ticket Details
===================
Ticket ID: UFG-297778
Department: Support AWIPS
Priority: Normal
Status: Open
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.

Attachment: purge.png
Description: PNG image