[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Requesting very old data from your upstream host

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: Re: Requesting very old data from your upstream host
  • Date: Thu, 02 Nov 2000 15:43:52 -0700
Hi Karl,

Karl Feaux wrote:
> 
> Thanks, Anne.
> I'll set the queue size large enough for 1 month, and the max latency time =
> 1 month (2592000 secs).
> 
> One other question about qcact.  Data files from our GPS download program
> will put the files into a directory.  I have a perl script to do the
> following, but I thought maybe it could all be done by LDM only.
> 
> 1.  Inserts all data files from this directory into the data queue using
> pqinsert.   Is there a way to have LDM look at a certain directory, and
> insert all new files that arrive, without the use of some external script to
> do it?
> 

No, you'll need to write your own script to call pqinsert.

> 2.  Moves files after insertion, and puts them into a backup directory.    I
> was going to use a combination of a perl script (which looks at all the
> files in the original dir, compares them with what is in the backup dir, and
> deletes them if the same) and the qcact FILE command to do this, but maybe I
> can do it entirely with LDM???

You can configure pqact to write products in the queue to a file.  The product 
will not be removed from the queue until it has been written to the file, so 
you can be pretty sure that the write will eventually succeed.  Will that 
satisfy this requirement?  i.e., is there something else that needs to happen?

> 
> 3.  After 30 days, remove files from the backup directory.  I'll do this
> with scour.
> 

Yes, scour should work fine to do this.

> Thanks,
> 
> karl
> 

You're welcome!

Anne
-- 
***************************************************
Anne Wilson                     UCAR Unidata Program            
address@hidden                 P.O. Box 3000
                                  Boulder, CO  80307
----------------------------------------------------
Unidata WWW server       http://www.unidata.ucar.edu/
****************************************************