[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

19991005: deleting old data

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: 19991005: deleting old data
  • Date: Wed, 06 Oct 1999 08:36:05 -0600
Tom,
the scour script will not remove the directories, but is supposed
to remove data according to the time constraints for each file type in
the etc/scour.conf file.

Typicaly, the scour.conf file has a directoryname with optional
pattern and the number of days to keep. If no new data has been written
into the directory since the last time scour was run, nothing will be removed.
Data isn't removed if nothing new comes in to prevent the situation that
would occur if your LDM wasn't receiving data- yet you needed data for a
classroom lab etc.

In a directory that scour looks for data in, it will leave a ".scour"
file, so it will know if there are any files newer than .scour the next time
it runs.

If you can provide some more information about what old files are not being
deleted, I can try to analyze the situation. Please provide me with
the scour.conf configuration, as well as the output from "ls -R"
recursive listing of your data directory.

Steve Chiswell
Unidata User Support





>From: Tom Priddy <address@hidden>
>Organization: .
>Keywords: 199910061320.HAA02879

>From:  Tom Priddy
>
>Thanks, Steve.  I checked my crontab and that statement is there....I
>then ran it from the command line and received this response:
>kelvin% bin/ldmadmin scour
>rm: ./images is a directory
>rm: ./images/sat is a directory
>rm: ./hds/103798 is a directory
>rm: ./nwx is a directory
>rm: ./nwx/fflood is a directory
>rm: ./nwx/fflood/natl_summ is a directory
>rm: ./nwx/watch_warn is a directory
>rm: ./storm is a directory
>rm: ./storm/watches is a directory
>rm: ./storm/tropic is a directory
>rm: ./storm/tropic/atlantic is a directory
>rm: ./storm/tropic/epacific is a directory
>rm: ./storm/tropic/cpacific is a directory
>
>Yet....I've still got lots of old files.  Any ideas?/ktp
>
>Unidata Support wrote:
>
>> >From: Tom Priddy <address@hidden>
>> >Organization: .
>> >Keywords: 199910052016.OAA10080
>>
>> >From:  Tom Priddy
>> >
>> >We recently upgraded our sun workstations operating system to solaris 7.
>> >
>> >We have the ldm back up and online....but old data files are not being
>> >deleted. What crontab (or program) keeps file systems from filling up?
>> >ktp
>> >
>> >--
>> >============================================================
>> >Tom Priddy                                address@hidden
>> >Extension Ag. Meteorologist          ph:  606-257-3000ext245
>> >Ag. Weather Center                  fax:  606-257-5671
>> >243 Ag. Engineering Bldg
>> >Dept. of Biosystems and Ag. Engr.
>> >University of Kentucky
>> >Lexington, KY 40546-0276
>> >HOMEPAGE   http://wwwagwx.ca.uky.edu
>> >============================================================
>> >
>> >
>>
>> Tom,
>>
>> Your crontab probably used the ~ldm/bin/scour program (along with the
>> ~ldm/etc/scour.conf) to periodically scour off old data. An example
>> for running the scour program every 3 hours using ldmadmin would look like:
>> 0 1,4,7,10,13,16,19,22 * * * bin/ldmadmin scour >/dev/null 2>&1
>>
>> Your ldm log files should also be rotated daily so they don't grow too
>> large as well, eg: 00 17 * * * bin/ldmadmin newlog
>>
>> Steve Chiswell
>> ****************************************************************************
>> Unidata User Support                                    UCAR Unidata Program
>> (303)497-8644                                                  P.O. Box 3000
>> address@hidden                                   Boulder, CO 80307
>> ----------------------------------------------------------------------------
>> Unidata WWW Service                        http://www.unidata.ucar.edu/     
>> ****************************************************************************
>
>--
>============================================================
>Tom Priddy                                address@hidden
>Extension Ag. Meteorologist          ph:  606-257-3000ext245
>Ag. Weather Center                  fax:  606-257-5671
>243 Ag. Engineering Bldg
>Dept. of Biosystems and Ag. Engr.
>University of Kentucky
>Lexington, KY 40546-0276
>HOMEPAGE   http://wwwagwx.ca.uky.edu
>============================================================
>
>