Re: [address@hidden: Re: 20030425LDM-RAP ofour and iita]

Celia,

Please feed from thelma with just chisel..

# netstat | grep rap
thelma.ldm  chisel.rap.ucar.edu.59107 63712      0 131768     28
ESTABLISHED
thelma.ldm  chisel.rap.ucar.edu.59111 63712      0 131768     28
ESTABLISHED
thelma.ldm  chisel.rap.ucar.edu.59117 63712      0 131768      0
ESTABLISHED
thelma.ldm  chisel.rap.ucar.edu.59122 63712      0 131768      0
ESTABLISHED
thelma.ldm  chisel.rap.ucar.edu.59133 63712      0 131768      0
ESTABLISHED
thelma.ldm moonbow.rap.ucar.edu.44802 63712      0 131768      0
ESTABLISHED
thelma.ldm   ofour.rap.ucar.edu.50819 65700      0 131400     28
ESTABLISHED
thelma.ldm   ofour.rap.ucar.edu.50831 65700      0 131400      0
ESTABLISHED
thelma.ldm   ofour.rap.ucar.edu.50837 65700   2787 131400      0
ESTABLISHED
thelma.ldm     iita.rap.ucar.edu.2333 31856      0 131768      0
ESTABLISHED
thelma.ldm     iita.rap.ucar.edu.2339 31856      0 131768     28
ESTABLISHED
thelma.ldm     iita.rap.ucar.edu.2345 31856      0 131768      0
ESTABLISHED
thelma.ldm     iita.rap.ucar.edu.2347 31856      0 131768      0
ESTABLISHED


moonbow, ofour, and iita should feed from chisel..

Jeff
---------------------------------------------------------------------
Jeff Weber                                    address@hidden        :
Unidata Program Center                        PH:303-497-8676        :
University Corp for Atmospheric Research      3300 Mitchell Ln       :
http://www.unidata.ucar.edu/staff/jweber      Boulder,Co 80307-3000  :
---------------------------------------------------------------------

On Tue, 6 May 2003, Celia Chen wrote:

> Hi Jeff,
>
> I have just finished upgrading RAP's main ldm servers to the latest
> ldm-6.0.10.
>
> Now based on the info in Tres' message below, on the size of TCP window,
> do you think it is a good idea to use chisel as the RAP ldm server to receive
> data from thelma directly?
>
> If so, I think I will need to ask you to configure thelma's ldmd.conf
> for feeding chisel.rap.ucar.edu the following (if they are not already
> setup):
>
>       CRAFT (NEXRD2)
>       DIFAX
>       FSL2
>       MCIDAS
>       NEXRAD
>       NMC2
>       WMO
>       WSI
>
> I will get chisel ready to receive data from thelma and turn off the
> other RAP machines that are currently receiving data from thelma.
>
>
> Thanks.
>
> Celia
>
>
>
> ----- Forwarded message from Tres Hofmeister <address@hidden> -----
>
> From: Tres Hofmeister <address@hidden>
> To: Celia Chen <address@hidden>
> Cc: Jeff Weber <address@hidden>,
>    ldm-support <address@hidden>,
>    NCAR/RAP/OSG Help Desk <address@hidden>
> Subject: Re: 20030425LDM-RAP ofour and iita
>
> On 2003-04-25, Celia Chen <address@hidden> wrote:
> :
> : Could you let me know what the TCP window sizes are for chisel,
> : iita, and ofour?
>
>       It's not entirely clear to me at the moment how the settings
> controlling these values affects system behavior on the various OSes
> in question, but here's where things are currently and what (currently
> temporary) changes I have made.
>
>       iita is currently running Linux kernel 2.2.20.  The default
> TCP send and receive buffer sizes are set to 65536 bytes.  TCP window
> scaling is enabled, and the maximum buffer sizes for each were also
> 65536.  I bumped them both to 8MB by hand just now through the proc
> interface:
>
>     echo 8388608 >/proc/sys/net/core/rmem_max
>     echo 8388608 >/proc/sys/net/core/wmem_max
>
>
>       chisel is running Linux 2.4.18.  Its default buffer sizes
> are also set to 65536 bytes, but the max is set to 131071 bytes.
> TCP window scaling is enabled.  I just bumped the maximums to 8MB each.
>
>       ofour is running SunOS 5.7.  Its maximum window size
> (tcp_max_buf) is set to 1MB.  The default TCP window sizes
> (tcp_recv_hiwat, tcp_xmit_hiwat) were set to only 8192 bytes.  I made
> the following changes using ndd:
>
>     ndd -set /dev/tcp tcp_max_buf 4194304
>     ndd -set /dev/tcp tcp_cwnd_max 2097152
>     ndd -set /dev/tcp tcp_xmit_hiwat 65536
>     ndd -set /dev/tcp tcp_recv_hiwat 65536
>
>       I think more research would be a good idea.  I'm making these
> changes based on suggestions found here:
>
>     http://www-didc.lbl.gov/TCP-tuning/buffers.html
>
>
> Jeff Weber <address@hidden> wrote:
> :
> : Celia,
> :
> : Your two machines feeding from thelma are the biggest users of
> : the cpu...
> :
> : It really is not OK to have them both feed from thelma, we can set-up
> : a failover site for the other machine to aide in case of failure.
> :
> : You should feed from thelma from the biggest TCP window size machine..
> :
> : iita is also generating about 95% of our re-class messages.
> :
> : We need to clean this up as it is impacting thelma.
> :
> : I have no info re chisel, I suggest contacting your sys admin.
> :
> : Please keep me informed as to what you decide, but we must get to one
> : machine, and it should be running LDM 6, and hopefully an expanded
> : TCP window size.
>
>
> On Fri, 25 Apr 2003, Celia Chen wrote:
> :
> : I have upgraded chisel's LDM to 6.0.10 and will be doing the upgrades
> : for the other LDM servers at RAP next week.
> :
> : Do you have the TCP info on chisel?  I don't know about this TCP
> : receive window size issre.  But if chisel has a bigger size I can
> : feed ofour from chisel.  I would like to have thelma feed two of
> : RAP's LDM machines just in case something happens to one.
> :
> : If ofour has the smaller TCP receive window size, should I set up
> : to feed ofour from iita, instead of "have iita feed from ofour"?
>
>
> On Fri, Apr 25, 2003 at 02:59:57PM -0600, Jeff Weber wrote:
> : Celia,
> :
> : #1 ofour.rap.ucar.edu and #2 iita.rap.ucar.edu.  Both are requesting
> : the same data;
> :
> : topo:  ofour.rap.ucar.edu NNEXRAD|CONDUIT|UNIDATA
> : topo:  iita.rap.ucar.edu NNEXRAD|DIFAX|CONDUIT|FSL2|UNIDATA
> :
> : and they both have small TCP receive window sizes (ofour is very
> : small).  I'd recommend at least 64k, maybe even 128k.
> :
> : thelma.ldm    ofour.rap.ucar.edu.36202  2920   1851  64240   0 EST
> : thelma.ldm    iita.rap.ucar.edu.2851   28960   2363 131768   0 EST
> :                                        ^^^^^
> :
> : Please have iita feed from ofour (and not thelma), and if you could
> : contact your sysadmin re the TCP receive window sizes, it would be
> : helpful for both parties.
> :
> : Also, please upgrade to LDM 6.0.10 asap, it will improve your
> : performance greatly..
> :
> : http://my.unidata.ucar.edu/content/software/ldm/ldm-6.0.10/index.html
> :
> : Please keep me posted as to the progress of these requests.
>
> --
> Tres Hofmeister <address@hidden>      http://www.rap.ucar.edu/~tres/
> Research Applications Program, National Center for Atmospheric Research
>
> ----- End forwarded message -----
>