20040506: s400 overload (cont.)

>From:  Elen Cutrim <address@hidden>
>Organization:  Western Michigan
>Keywords:  200405061343.i46Dh0tK004223 McIDAS LDM scour mcscour.sh

Hi Elen,

re: cleaning up on s400.
>I will try this in the lab downstairs.  Right now students are having 
>their labs, but I will try to sneak in.

I was able to get on s400 after I got into work (previous message was
sent while I was still at home).  I ran 'mcscour.sh' as 'ldm' as follows:

cd /cutrim1/ldm
/cutrim1/ldm/util/mcscour.sh

This cleaned up the /cutrim1 filesystem nicely:

before running mcscour.sh:

ldm@s400 ~> df -k
Filesystem           1k-blocks      Used Available Use% Mounted on
/dev/dsk/c0t0d0s0       493527     61731    382444  14% /
/dev/dsk/c0t0d0s6      2569343    829286   1688671  33% /usr
/dev/dsk/c0t0d0s3      2055463    449474   1544326  23% /var
swap                   2389640        24   2389616   1% /var/run
/dev/dsk/c0t0d0s7     28638311     55233  28296695   1% /misc
/dev/dsk/c0t0d0s5      2055463      2824   1990976   1% /tmp
/dev/dsk/c1t1d0s2     35009161  31923074   2735996  93% /cutrim1
/dev/dsk/c1t2d0s2     35009161  14461641  20197429  42% /cutrim2
/dev/dsk/c0t0d0s4       493527    122247    321928  28% /var/nfs
ifs1.wmich.edu:/export/home05
                      52428800   9281058  40473258  19% /import/home05
/var/nfs/cache/.cfs_mnt_points/ifs2.wmich.edu:_export_opt_solaris_8
                      10485760   5100311   5048913  51% /import/opt
ifs1.wmich.edu:/export/home01
                      52428800   6659666  42925828  14% /import/home01
ifs1.wmich.edu,ifs2.wmich.edu:/export/client-var
                       2097152     72652   1899060   4% /import/client-var

after running mcscour.sh:

ldm@s400 ~> df -k
Filesystem           1k-blocks      Used Available Use% Mounted on
/dev/dsk/c0t0d0s0       493527     61731    382444  14% /
/dev/dsk/c0t0d0s6      2569343    829286   1688671  33% /usr
/dev/dsk/c0t0d0s3      2055463    449475   1544325  23% /var
swap                   2389808        24   2389784   1% /var/run
/dev/dsk/c0t0d0s7     28638311     55233  28296695   1% /misc
/dev/dsk/c0t0d0s5      2055463      2824   1990976   1% /tmp
/dev/dsk/c1t1d0s2     35009161   6525450  28133620  19% /cutrim1
/dev/dsk/c1t2d0s2     35009161  14461641  20197429  42% /cutrim2
/dev/dsk/c0t0d0s4       493527    122247    321928  28% /var/nfs
ifs1.wmich.edu:/export/home05
                      52428800   9281061  40473255  19% /import/home05
/var/nfs/cache/.cfs_mnt_points/ifs2.wmich.edu:_export_opt_solaris_8
                      10485760   5100311   5048913  51% /import/opt
ifs1.wmich.edu:/export/home01
                      52428800   6659666  42925828  14% /import/home01
ifs2.wmich.edu,ifs1.wmich.edu:/export/client-var
                       2097152     72652   1899060   4% /import/client-var

The potential problem you will probably now have is that the MD files
for today might have data in them from 10 days ago.  If this is the
case (I will check), then they need to be deleted.  They will be
recreated as new data comes in, but the data from earlier today
will not be in them.

>Yesterday, when I was trying to login as mcidas to download some data 
>on s400 an icon at the bottom of the screen was showing 96-100% full 
>and would not allow me to even open a working screen.

OK.  /cutrim1 was very full.

>I remember Karthik starting the cleaning job from one of the PC's, 
>then to he would use this chain of commands you suggested.  But I 
>don't know what he did.

Again, what is happening is:

- the HOME directory for the user 'ldm' is automounted AND autounmounted
- the scouring actions for the data you are ingesting are kicked off
  from 'ldm' cron jobs once per day
- if a user's HOME directory is not mounted, no cron jobs for that
  user will be initiated

Since the last item is true on your machine, the cron jobs are not running
every day as they should.  I will talk to our system administrator to
see if there is something we can do to get the jobs to run.  If not,
I will have to devise a scheme where scouring is kicked off by the LDM
upon receipt of data at a certain time of the day.

>I will keep in touch.

Ditto...

Ciao,

Tom
--
+-----------------------------------------------------------------------------+
* Tom Yoksas                                             UCAR Unidata Program *
* (303) 497-8642 (last resort)                                  P.O. Box 3000 *
* address@hidden                                   Boulder, CO 80307 *
* Unidata WWW Service                             http://www.unidata.ucar.edu/*
+-----------------------------------------------------------------------------+