[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Requesting very old data from your upstream host
- Subject: Re: Requesting very old data from your upstream host
- Date: Thu, 02 Nov 2000 15:43:52 -0700
Hi Karl,
Karl Feaux wrote:
>
> Thanks, Anne.
> I'll set the queue size large enough for 1 month, and the max latency time =
> 1 month (2592000 secs).
>
> One other question about qcact. Data files from our GPS download program
> will put the files into a directory. I have a perl script to do the
> following, but I thought maybe it could all be done by LDM only.
>
> 1. Inserts all data files from this directory into the data queue using
> pqinsert. Is there a way to have LDM look at a certain directory, and
> insert all new files that arrive, without the use of some external script to
> do it?
>
No, you'll need to write your own script to call pqinsert.
> 2. Moves files after insertion, and puts them into a backup directory. I
> was going to use a combination of a perl script (which looks at all the
> files in the original dir, compares them with what is in the backup dir, and
> deletes them if the same) and the qcact FILE command to do this, but maybe I
> can do it entirely with LDM???
You can configure pqact to write products in the queue to a file. The product
will not be removed from the queue until it has been written to the file, so
you can be pretty sure that the write will eventually succeed. Will that
satisfy this requirement? i.e., is there something else that needs to happen?
>
> 3. After 30 days, remove files from the backup directory. I'll do this
> with scour.
>
Yes, scour should work fine to do this.
> Thanks,
>
> karl
>
You're welcome!
Anne
--
***************************************************
Anne Wilson UCAR Unidata Program
address@hidden P.O. Box 3000
Boulder, CO 80307
----------------------------------------------------
Unidata WWW server http://www.unidata.ucar.edu/
****************************************************