[Support #TXN-293177]: LDM 6.6.5: make failure on Intel Mac (OS X 10.5)

Dave,

> Looks like the LDM on virga.sfsu.edu hung yesterday afternoon. What I
> don't get, though, is why at least some (most? all?) data seem to have
> started flowing again at times ranging from 8:33 to 11:15 or so this
> morning P.D.T., even though the LDM had been running continuously (without
> being restarted) since Tuesday evening.

The change in the status of the LDM processes would be due to me.
This morning I noticed that some of the LDM
processes were hung, so I attached to them with the debugger, gdb.
Apparently, doing that causes them to unhang.

> Not only that, I just tried
> stopping the LDM, and two of our of our usual eight rpc processes won't
> terminate, which has been consistent with being hung, at least recently.

If an LDM processes won't terminate, then it's hung.

> Running dtruss on those processes confirms that they're hung. (I don't
> know how to tell which feeds they're associated with, though, if in fact
> they're associated with particular feed requests.)

I use a command like

    fgrep Start `ls -rt logs/ldmd.log*` | fgrep IDS | fgrep idd.unidata

to obtain the PID of the downstream LDM that's getting IDS data from
idd.unidata.ucar.edu.  I then use a command like

    fgrep 267 `ls -rt logs/ldmd.log*` 

to get all the log messages from that process.

> I've killed the hung processes and restarted the LDM.
> 
> Time to switch over to your new version of the LDM?

Upon further reflection, I actually expect that the new version won't
solve the problem (I'd still try it, however).

> -- Dave
> 
> ****************************************************************
> *                                      |         __ __    \|/  *
> *   Dr. Dave Dempsey                   | )   ^  /|| ||\  --0-- *
> *   Dept. of Geosciences               |) ) ^  / ||_|| \  /|\  *
> *   San Francisco State University     | ) )  /  | _ |  \      *
> *   1600 Holloway Ave.                 |)   )/   || ||   \     *
> *   San Francisco, CA   94132          | )   )   ||_||    \    *
> *                                      |)  ) )   | _ |     \   *
> *   Phone:  (415) 338-7716             |  )   )  || ||      \  *
> *   FAX:    (415) 338-7705             |)   )  )~~~~~~~~~~~~~~~*
> *   Email:  address@hidden   |  )  )  )  ~  ~   ~ ~  *
> *                                      |)  )   ) )  ~   ~  ~   *
> ****************************************************************

Regards,
Steve Emmerson

Ticket Details
===================
Ticket ID: TXN-293177
Department: Support LDM
Priority: Normal
Status: Open