Re: LDM clients have stopped receiving files

Hi Angelo,

>Date: Wed, 14 Dec 2005 02:48:18 -1000
>From: "Alvarez, Angelo CIV NAVPACMETOCCEN JTWC" <address@hidden>
>Organization: NAVPACMETOCCEN
>To: <address@hidden>
>Subject: LDM clients have stopped receiving files

The above message contained the following:

> Aloha.  We are running LDM 6.3.0.  I was using "ldmadmin watch" to
> monitor incoming products on a client and noticed that while products
> where being inserted into the queue on the upstream server, they were
> not showing up on the client.  I restarted the upstream ldm server, and
> now I see nothing when I run "ldmadmin watch" on the clients.  Notifyme
> requests, pqsend to clients, and client "feedme" requests are working
> for those clients on the same network as the ldm upstream server.  I
> cannot get feedme requests to work for clients inside our firewall.  Any
> ideas as to the cause of the problem?? Any other ways to troubleshoot
> this?? Nothing changed on the clients or the server.  To troubleshoot
> this, I deleted and then recreated the queue on the server but no
> effect.

I suspect that firewall rules are interfering with the operation of the
LDM.  Especially because you say that nothing's changed on the upstream
or downstream hosts.

From your log entries, I assume that host Mahele is the upstream host and
that host Hawaii, for example, is one of the downstream hosts whose LDM
can't receive data-products from the LDM on host Mahele.  If this is
incorrect, then please tell me.

Try this: on host Hawaii, use the rpcinfo(1) utility to see if you can
contact the LDM-6 on port 388 on host Mahele via TCP, e.g.,

    rpcinfo -n 388 -t Mahele 300029 6

You might have to adjust this command to suit your rpcinfo(1) utility.

Let me know what you discover.

> [ldm@mahele ~]$ pqmon -i 5
> Dec 14 11:08:51 pqmon: Starting Up (16077)
> Dec 14 11:08:51 pqmon: nprods nfree  nempty      nbytes  maxprods 
> maxfree  minempty    maxext  age
> Dec 14 11:08:51 pqmon:   2988     0   94668   400003072      2988       
> 1     94668         0 16310
> Dec 14 11:08:56 pqmon:   2987     0   94669   400003072      2988       
> 1     94668         0 16305
> Dec 14 11:09:01 pqmon:   2987     0   94669   400003072      2988       
> 1     94668         0 16310
> Dec 14 11:09:06 pqmon:   2987     0   94669   400003072      2988       
> 1     94668         0 16305
> 
> Notifyme works:
> Dec 14 11:11:45 mahele gw1-dmz(noti)[24225]:
> 78ceddfd1432a79a52680cb7641f791a    89989 20051214111145.931   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_10800F0OF2005121406_0100_002500-000000wnd_vcmp=
> 
> Dec 14 11:11:56 mahele gw1-dmz(noti)[24225]:
> f099d04c70d2245d29c761745eccec44    73699 20051214111156.190   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_11400F0OF2005121406_0105_000100-000000wnd_ucmp=
> 
> Dec 14 11:12:06 mahele gw1-dmz(noti)[24225]:
> 920c988521ae518a3926dbb0c5697aba    89989 20051214111206.451   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_12000F0OF2005121406_0100_002500-000000wnd_ucmp=
> 
> Dec 14 11:12:16 mahele gw1-dmz(noti)[24225]:
> 75486f177452e80e614a2438638f3212    81845 20051214111216.710   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_09600F0OF2005121406_0100_005000-000000wnd_vcmp=
> 
> Dec 14 11:12:16 mahele gw1-dmz(noti)[24225]:
> 7cb1d7810861c93063c0d804b96e70a1    81845 20051214111216.751   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_12000F0OF2005121406_0105_000100-000000wnd_ucmp=
> 
> Dec 14 11:12:22 mahele su(pam_unix)[21228]: session opened for user root
> by ldm(uid=3D501)
> Dec 14 11:12:37 mahele gw1-dmz(noti)[24225]:
> daa3fb1754d4baa882b83d1a08eb3724   212165 20051214111237.233   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_11400F0OF2005121406_0100_005000-000000vpr_pres=
> 
> Dec 14 11:12:47 mahele gw1-dmz(noti)[24225]:
> 49273a5cb4d6350556584fbab3eff495    73699 20051214111247.492   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_08400F0OF2005121406_0105_000100-000000wnd_ucmp=
> 
> Dec 14 11:12:57 mahele gw1-dmz(noti)[24225]:
> 9f200692165cc076a156bf3dd892b997    81845 20051214111257.755   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_08400F0OF2005121406_0100_008500-000000wnd_ucmp=
> 
> Dec 14 11:13:08 mahele gw1-dmz(noti)[24225]:
> b0bf06c7aef3bd5863b6736f5e9420c1   106279 20051214111308.015   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13800F0OF2005121406_0100_010000-000000air_temp=
> 
>
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> 8c681e44007858b6b7dae096ee5d9755    98135 20051214115514.216   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13800F0OF2005121406_0100_003000-000000air_temp=
> 
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> 95143d2cda39da2713ecc3f4e26fe7dc    98135 20051214115524.490   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_14400F0OF2005121406_0100_001500-000000air_temp=
> 
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> adfe80cbde2dc4c08c56637fbdaa9220    98135 20051214115534.787   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_09000F0OF2005121406_0100_004000-000000air_temp=
> 
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> b1e3c34e2629a9795039696d8f8eca01   114423 20051214115545.063   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13800F0OF2005121406_0100_001500-000000geop_ht
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> 6638aa683154a6c1d0fb98de79857807    73699 20051214115545.103   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13800F0OF2005121406_0105_000100-000000wnd_ucmp=
> 
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> f5c01e867654d3950f072e6df2d0c11a    98135 20051214115555.380   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_12600F0OF2005121406_0100_001500-000000air_temp=
> 
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> e93109431efd7fa29a0acf804707619a    98135 20051214115605.659   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13200F0OF2005121406_0100_001500-000000air_temp=
> 
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> b593120de5e416ebe80383a86dc0b293    98135 20051214115605.700   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13800F0OF2005121406_0100_002500-000000air_temp=
> 
> Dec 14 11:56:35 mahele hawaii(noti)[26168]:
> f44dcf5eb0a5dbe189683f23711972d6   106279 20051214115615.980   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13200F0OF2005121406_0100_007000-000000air_temp=
> 
> Dec 14 11:56:36 mahele hawaii(noti)[26168]:
> 7709c5cd347da566267aede959fc4b37    98135 20051214115636.484   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13800F0OF2005121406_0100_002000-000000air_temp=
> 
> Dec 14 11:56:36 mahele hawaii(noti)[26168]:
> a77225e85c9096a617651ddc43eb18b9    98135 20051214115636.529   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_14400F0OF2005121406_0100_003000-000000air_temp=
> 
> Dec 14 11:56:46 mahele hawaii(noti)[26168]:
> d0695af37f34b699f008b81a85304d75   114423 20051214115646.806   NGRID 000
> 
> US058GMET-GR1mdl.0058_0240_13800F0OF2005121406_0100_002500-000000geop_ht
> 
>
> 
>
> Debug log shows the following:
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 11:14:16 mahele gw1-dmz[24305]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 11:14:16 mahele gw1-dmz[24305]: Exiting
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: SIGCHLD
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: child 24305 exited with status 0
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 11:14:16 mahele oahu[24306]: Connection from oahu
> Dec 14 11:14:16 mahele oahu[24306]: Exiting
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: SIGCHLD
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: child 24306 exited with status 0
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 11:14:16 mahele hawaii[24307]: Connection from hawaii
> Dec 14 11:14:16 mahele hawaii[24307]: Exiting
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: SIGCHLD
> Dec 14 11:14:16 mahele rpc.ldmd[19084]: child 24307 exited with status 0
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 11:15:16 mahele gw1-dmz[25794]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 11:15:16 mahele gw1-dmz[25794]: Exiting
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: SIGCHLD
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: child 25794 exited with status 0
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 11:15:16 mahele oahu[25795]: Connection from oahu
> Dec 14 11:15:16 mahele oahu[25795]: Exiting
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: SIGCHLD
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: child 25795 exited with status 0
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 11:15:16 mahele hawaii[25796]: Connection from hawaii
> Dec 14 11:15:16 mahele hawaii[25796]: Exiting
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: SIGCHLD
> Dec 14 11:15:16 mahele rpc.ldmd[19084]: child 25796 exited with status 0
>
> Dec 14 12:17:09 mahele gw1-dmz[27957]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: child 27956 exited with status 0
> Dec 14 12:17:09 mahele gw1-dmz[27957]: Exiting
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: child 27957 exited with status 0
> Dec 14 12:17:09 mahele oahu[27958]: Connection from oahu
> Dec 14 12:17:09 mahele oahu[27958]: Exiting
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: child 27958 exited with status 0
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:18:52 mahele gw1-dmz[30770]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 12:18:52 mahele gw1-dmz[30770]: Exiting
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: child 30770 exited with status 0
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 12:18:52 mahele hawaii[30771]: Connection from hawaii
> Dec 14 12:18:52 mahele hawaii[30771]: Exiting
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: child 30771 exited with status 0
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 12:18:52 mahele oahu[30772]: Connection from oahu
> Dec 14 12:18:52 mahele oahu[30772]: Exiting
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: child 30772 exited with status 0
> 
> 
> These are entries related to feedme requests :
> Dec 14 11:39:36 mahele hawaii[31575]: Connection from hawaii
> Dec 14 11:39:36 mahele hawaii[31575]: feedme5: hawaii:
> 20051214113219.801 TS_ENDT {{ANY,  "ANY"}}
> Dec 14 11:39:36 mahele hawaii(feed)[31575]: Starting Up(6.3.0/5):
> 20051214113219.801 TS_ENDT {{ANY,  "ANY"}}
> Dec 14 11:39:36 mahele hawaii(feed)[31575]: topo:  hawaii ANY
> Dec 14 11:41:52 mahele hawaii[2752]: Connection from hawaii
> Dec 14 11:41:52 mahele hawaii[2752]: Exiting
> 
> Dec 14 12:09:35 mahele oahu[15467]: Connection from oahu
> Dec 14 12:09:36 mahele oahu(feed)[15467]: up6.c:334: Starting
> Up(6.3.0/6): 20051214165017.275 TS_ENDT {{ANY,  ".*"}}
> Dec 14 12:09:36 mahele oahu(feed)[15467]: topo:  oahu ANY
>
> Dec 14 12:09:30 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw2-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:09:30 mahele gw2-dmz[15437]: Connection from
> gw2-dmz.npmoc.navy.mil
> Dec 14 12:09:30 mahele gw2-dmz[15437]: feedme5: gw2-dmz.npmoc.navy.mil:
> 20051214111845.106 TS_ENDT {{NGRID,  "ANY"}}
> Dec 14 12:09:30 mahele gw2-dmz(feed)[15437]: Starting Up(6.3.0/5):
> 20051214111845.106 TS_ENDT {{NGRID,  "ANY"}}
> Dec 14 12:09:30 mahele gw2-dmz(feed)[15437]: topo: 
> gw2-dmz.npmoc.navy.mil NGRID
> Dec 14 12:09:34 mahele su(pam_unix)[15137]: session opened for user root
> by ldm(uid=3D501)
> Dec 14 12:09:35 mahele rpc.ldmd[14521]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 12:09:35 mahele oahu[15467]: Connection from oahu
> Dec 14 12:09:36 mahele oahu(feed)[15467]: up6.c:334: Starting
> Up(6.3.0/6): 20051214165017.275 TS_ENDT {{ANY,  ".*"}}
> Dec 14 12:09:36 mahele oahu(feed)[15467]: topo:  oahu ANY
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:12:52 mahele gw1-dmz[20910]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 12:12:52 mahele gw1-dmz[20910]: Exiting
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: child 20910 exited with status 0
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 12:12:52 mahele hawaii[20911]: Connection from hawaii
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 12:12:52 mahele oahu[20912]: Connection from oahu
> Dec 14 12:12:52 mahele hawaii[20911]: Exiting
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:12:52 mahele oahu[20912]: Exiting
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: child 20911 exited with status 0
> Dec 14 12:12:52 mahele rpc.ldmd[14521]: child 20912 exited with status 0
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:14:14 mahele gw1-dmz[23170]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 12:14:14 mahele gw1-dmz[23170]: Exiting
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: child 23170 exited with status 0
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 12:14:14 mahele hawaii[23171]: Connection from hawaii
> Dec 14 12:14:14 mahele hawaii[23171]: Exiting
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: child 23171 exited with status 0
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 12:14:14 mahele oahu[23172]: Connection from oahu
> Dec 14 12:14:14 mahele oahu[23172]: Exiting
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:14:14 mahele rpc.ldmd[14521]: child 23172 exited with status 0
> Dec 14 12:14:36 mahele hawaii(feed)[15436]: nullproc5(hawaii): RPC:
> Unable to receive
> Dec 14 12:14:36 mahele hawaii(feed)[15436]: Exiting
> Dec 14 12:14:36 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:14:36 mahele gw2-dmz(feed)[15437]:
> nullproc5(gw2-dmz.npmoc.navy.mil): RPC: Unable to receive
> Dec 14 12:14:36 mahele rpc.ldmd[14521]: child 15436 exited with status 0
> Dec 14 12:14:36 mahele gw2-dmz(feed)[15437]: Exiting
> Dec 14 12:14:36 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:14:36 mahele rpc.ldmd[14521]: child 15437 exited with status 0
> Dec 14 12:14:57 mahele rpc.ldmd[14521]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 12:14:57 mahele hawaii[24586]: Connection from hawaii
> Dec 14 12:14:57 mahele hawaii[24586]: feedme5: hawaii:
> 20051214113219.801 TS_ENDT {{ANY,  "ANY"}}
> Dec 14 12:14:57 mahele hawaii(feed)[24586]: Starting Up(6.3.0/5):
> 20051214113219.801 TS_ENDT {{ANY,  "ANY"}}
> Dec 14 12:14:57 mahele hawaii(feed)[24586]: topo:  hawaii ANY
> Dec 14 12:14:58 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw2-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:14:58 mahele gw2-dmz[24587]: Connection from
> gw2-dmz.npmoc.navy.mil
> Dec 14 12:14:58 mahele gw2-dmz[24587]: feedme5: gw2-dmz.npmoc.navy.mil:
> 20051214111845.106 TS_ENDT {{NGRID,  "ANY"}}
> Dec 14 12:14:58 mahele gw2-dmz(feed)[24587]: Starting Up(6.3.0/5):
> 20051214111845.106 TS_ENDT {{NGRID,  "ANY"}}
> Dec 14 12:14:58 mahele gw2-dmz(feed)[24587]: topo: 
> gw2-dmz.npmoc.navy.mil NGRID
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 12:17:09 mahele hawaii[27956]: Connection from hawaii
> Dec 14 12:17:09 mahele hawaii[27956]: Exiting
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:17:09 mahele gw1-dmz[27957]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: child 27956 exited with status 0
> Dec 14 12:17:09 mahele gw1-dmz[27957]: Exiting
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: child 27957 exited with status 0
> Dec 14 12:17:09 mahele oahu[27958]: Connection from oahu
> Dec 14 12:17:09 mahele oahu[27958]: Exiting
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:17:09 mahele rpc.ldmd[14521]: child 27958 exited with status 0
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:18:52 mahele gw1-dmz[30770]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 12:18:52 mahele gw1-dmz[30770]: Exiting
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: child 30770 exited with status 0
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 12:18:52 mahele hawaii[30771]: Connection from hawaii
> Dec 14 12:18:52 mahele hawaii[30771]: Exiting
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: child 30771 exited with status 0
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 12:18:52 mahele oahu[30772]: Connection from oahu
> Dec 14 12:18:52 mahele oahu[30772]: Exiting
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:18:52 mahele rpc.ldmd[14521]: child 30772 exited with status 0
> Dec 14 12:20:05 mahele gw2-dmz(feed)[24587]:
> nullproc5(gw2-dmz.npmoc.navy.mil): RPC: Unable to receive
> Dec 14 12:20:05 mahele hawaii(feed)[24586]: nullproc5(hawaii): RPC:
> Unable to receive
> Dec 14 12:20:05 mahele gw2-dmz(feed)[24587]: Exiting
> Dec 14 12:20:05 mahele hawaii(feed)[24586]: Exiting
> Dec 14 12:20:05 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:20:05 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:20:05 mahele rpc.ldmd[14521]: child 24587 exited with status 0
> Dec 14 12:20:05 mahele rpc.ldmd[14521]: child 24586 exited with status 0
> Dec 14 12:20:24 mahele rpc.ldmd[14521]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 12:20:24 mahele hawaii[1188]: Connection from hawaii
> Dec 14 12:20:24 mahele hawaii[1188]: feedme5: hawaii: 20051214113219.801
> TS_ENDT {{ANY,  "ANY"}}
> Dec 14 12:20:24 mahele hawaii(feed)[1188]: Starting Up(6.3.0/5):
> 20051214113219.801 TS_ENDT {{ANY,  "ANY"}}
> Dec 14 12:20:24 mahele hawaii(feed)[1188]: topo:  hawaii ANY
> Dec 14 12:20:25 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:20:25 mahele gw1-dmz[1189]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 12:20:25 mahele gw1-dmz[1189]: feedme5: gw1-dmz.npmoc.navy.mil:
> 20051214111845.106 TS_ENDT {{NGRID,  "ANY"}}
> Dec 14 12:20:25 mahele gw1-dmz(feed)[1189]: Starting Up(6.3.0/5):
> 20051214111845.106 TS_ENDT {{NGRID,  "ANY"}}
> Dec 14 12:20:25 mahele gw1-dmz(feed)[1189]: topo: 
> gw1-dmz.npmoc.navy.mil NGRID
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: RPC buffer sizes for hawaii:
> send=3D16384; recv=3D87380
> Dec 14 12:21:57 mahele hawaii[3809]: Connection from hawaii
> Dec 14 12:21:57 mahele hawaii[3809]: Exiting
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: child 3809 exited with status 0
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: RPC buffer sizes for oahu:
> send=3D16384; recv=3D87380
> Dec 14 12:21:57 mahele oahu[3810]: Connection from oahu
> Dec 14 12:21:57 mahele oahu[3810]: Exiting
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: child 3810 exited with status 0
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: RPC buffer sizes for
> gw1-dmz.npmoc.navy.mil: send=3D16384; recv=3D87380
> Dec 14 12:21:57 mahele gw1-dmz[3811]: Connection from
> gw1-dmz.npmoc.navy.mil
> Dec 14 12:21:57 mahele gw1-dmz[3811]: Exiting
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: SIGCHLD
> Dec 14 12:21:57 mahele rpc.ldmd[14521]: child 3811 exited with status 0
> 
> v/r
> angelo

Regards,
Steve Emmerson