Re: Try again

Good Morning, Dave!

ldm is running as godaemgr
he had not added the changes to the syslog.conf file
he has now, and I got him to kick the syslog daemon
tada /usr/local/ldm/logs/ldmd.conf is now being written to
                                                    ^^^^^^^
duh...
not ldmd.conf, ldmd.log

anyway /usr/local/ldm/logs/ldmd.log  looks like:
Aug 01 22:53:02 usgodae3 pqexpire[9978]: > Recycled  40373.195 kb/hr (
10212.545 prods per hour)
Aug 01 22:58:03 usgodae3 pqexpire[9978]: > Recycled  40358.103 kb/hr (
10215.086 prods per hour)
Aug 01 23:03:04 usgodae3 pqexpire[9978]: > Recycled  40353.193 kb/hr (
10221.627 prods per hour)
Aug 01 23:08:05 usgodae3 pqexpire[9978]: > Recycled  40333.773 kb/hr (
10221.783 prods per hour)
Aug 01 23:13:06 usgodae3 pqexpire[9978]: > Recycled  40309.259 kb/hr (
10220.598 prods per hour)
Aug 01 23:18:07 usgodae3 pqexpire[9978]: > Recycled  40298.855 kb/hr (
10220.418 prods per hour)

btw, it still looks like /var/adm/messages is getting ldm stuff. Should
it?

I'm glad you've got the logging working - the messages are extremely valuable
in monitoring the LDM.

You and/or Joe can decide if you want to get the LDM messages in /var/adm/messages also, but otherwise there's no need to have these messages appear both places.    (If it was me, I'd edit /etc/syslog.conf to not have this go to /var/adm/messages since it's already in ldmd.log.   But then I'm very aware of the LDM running and thus know how to check its behavior.)

 
Aug 01 22:53:02 usgodae3 pqexpire[9978]: > Recycled  40373.195 kb/hr (
10212.545 prods per hour)
Aug 01 22:58:03 usgodae3 pqexpire[9978]: > Recycled  40358.103 kb/hr (
10215.086 prods per hour)
Aug 01 23:03:04 usgodae3 pqexpire[9978]: > Recycled  40353.193 kb/hr (
10221.627 prods per hour)
Aug 01 23:08:05 usgodae3 pqexpire[9978]: > Recycled  40333.773 kb/hr (
10221.783 prods per hour)
Aug 01 23:13:06 usgodae3 pqexpire[9978]: > Recycled  40309.259 kb/hr (
10220.598 prods per hour)
Aug 01 23:18:07 usgodae3 pqexpire[9978]: > Recycled  40298.855 kb/hr (
10220.418 prods per hour)

There was a bit in the preinstall to prevent ldm messages from going to
the console. Do console messages get written to /var/adm/messages? Maybe
Joe has not gotten to that part yet.

Again, this is determined by your /etc/syslog.conf file.  You can
configure the syslog deamon to write to either one or both.

 

regardless, wasn't this all started with you asking for deleted
messages? If so there are some a ways back in /var/adm/messages

Aug 01 21:32:39 usgodae3 whitestar[9980]: Deleting oldest to make space
1160 bytes
Aug 01 21:32:39 usgodae3 whitestar[9980]: Deleting oldest to make space
1080 bytes
Aug 01 21:32:39 usgodae3 whitestar[9980]: Deleting oldest to make space
27080 bytes
Aug 01 21:32:39 usgodae3 whitestar[9980]: Deleting oldest to make space
24096 bytes
Aug 01 21:32:40 usgodae3 whitestar[9980]: Deleting oldest to make space
27080 bytes
Aug 01 21:32:41 usgodae3 pqexpire[9978]: > Recycled  39614.441 kb/hr (
10208.914 prods per hour)
Aug 01 21:37:42 usgodae3 pqexpire[9978]: > Recycled  39777.196 kb/hr (
10210.078 prods per hour)

Is that bad?

Yes, I was asking about these messages because they are an indication that
the amount of data you are requesting is greater than the queue size can
handle - old products are being deleted to make space.  If the queue
was "big enough" you wouldn't see these messages and instead pqexpire would
expire products based on their time stamp.  The pqexpire approach
is much more efficient.  The 'deleting oldest to make space" approach
could snowball and ultimately cause near deadlock and possible lost products. 
If you see more of those messages and if you have enough memory and disk
space to make a bigger queue then I would advise you to do so.

Now, this is without the NOGAPS data.  As we discussed yesterday, your 100Mb queue won't be big enough to handle 300 - 400Mb of NOGAPS data plus what you are already receiving.  If your system can handle it, you might start with a 1 gigabyte queue.
 

Thanks again,
Dave D

ps. got the script.

Great!

Anne

-- 
***************************************************
Anne Wilson                     UCAR Unidata Program            
address@hidden                  P.O. Box 3000
                                  Boulder, CO  80307
----------------------------------------------------
Unidata WWW server       http://www.unidata.ucar.edu/
****************************************************