[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [address@hidden: Re: 20030425LDM-RAP ofour and iita]
- Subject: Re: [address@hidden: Re: 20030425LDM-RAP ofour and iita]
- Date: Tue, 6 May 2003 17:24:15 -0600 (MDT)
Celia,
Please feed from thelma with just chisel..
# netstat | grep rap
thelma.ldm chisel.rap.ucar.edu.59107 63712 0 131768 28
ESTABLISHED
thelma.ldm chisel.rap.ucar.edu.59111 63712 0 131768 28
ESTABLISHED
thelma.ldm chisel.rap.ucar.edu.59117 63712 0 131768 0
ESTABLISHED
thelma.ldm chisel.rap.ucar.edu.59122 63712 0 131768 0
ESTABLISHED
thelma.ldm chisel.rap.ucar.edu.59133 63712 0 131768 0
ESTABLISHED
thelma.ldm moonbow.rap.ucar.edu.44802 63712 0 131768 0
ESTABLISHED
thelma.ldm ofour.rap.ucar.edu.50819 65700 0 131400 28
ESTABLISHED
thelma.ldm ofour.rap.ucar.edu.50831 65700 0 131400 0
ESTABLISHED
thelma.ldm ofour.rap.ucar.edu.50837 65700 2787 131400 0
ESTABLISHED
thelma.ldm iita.rap.ucar.edu.2333 31856 0 131768 0
ESTABLISHED
thelma.ldm iita.rap.ucar.edu.2339 31856 0 131768 28
ESTABLISHED
thelma.ldm iita.rap.ucar.edu.2345 31856 0 131768 0
ESTABLISHED
thelma.ldm iita.rap.ucar.edu.2347 31856 0 131768 0
ESTABLISHED
moonbow, ofour, and iita should feed from chisel..
Jeff
---------------------------------------------------------------------
Jeff Weber address@hidden :
Unidata Program Center PH:303-497-8676 :
University Corp for Atmospheric Research 3300 Mitchell Ln :
http://www.unidata.ucar.edu/staff/jweber Boulder,Co 80307-3000 :
---------------------------------------------------------------------
On Tue, 6 May 2003, Celia Chen wrote:
> Hi Jeff,
>
> I have just finished upgrading RAP's main ldm servers to the latest
> ldm-6.0.10.
>
> Now based on the info in Tres' message below, on the size of TCP window,
> do you think it is a good idea to use chisel as the RAP ldm server to receive
> data from thelma directly?
>
> If so, I think I will need to ask you to configure thelma's ldmd.conf
> for feeding chisel.rap.ucar.edu the following (if they are not already
> setup):
>
> CRAFT (NEXRD2)
> DIFAX
> FSL2
> MCIDAS
> NEXRAD
> NMC2
> WMO
> WSI
>
> I will get chisel ready to receive data from thelma and turn off the
> other RAP machines that are currently receiving data from thelma.
>
>
> Thanks.
>
> Celia
>
>
>
> ----- Forwarded message from Tres Hofmeister <address@hidden> -----
>
> From: Tres Hofmeister <address@hidden>
> To: Celia Chen <address@hidden>
> Cc: Jeff Weber <address@hidden>,
> ldm-support <address@hidden>,
> NCAR/RAP/OSG Help Desk <address@hidden>
> Subject: Re: 20030425LDM-RAP ofour and iita
>
> On 2003-04-25, Celia Chen <address@hidden> wrote:
> :
> : Could you let me know what the TCP window sizes are for chisel,
> : iita, and ofour?
>
> It's not entirely clear to me at the moment how the settings
> controlling these values affects system behavior on the various OSes
> in question, but here's where things are currently and what (currently
> temporary) changes I have made.
>
> iita is currently running Linux kernel 2.2.20. The default
> TCP send and receive buffer sizes are set to 65536 bytes. TCP window
> scaling is enabled, and the maximum buffer sizes for each were also
> 65536. I bumped them both to 8MB by hand just now through the proc
> interface:
>
> echo 8388608 >/proc/sys/net/core/rmem_max
> echo 8388608 >/proc/sys/net/core/wmem_max
>
>
> chisel is running Linux 2.4.18. Its default buffer sizes
> are also set to 65536 bytes, but the max is set to 131071 bytes.
> TCP window scaling is enabled. I just bumped the maximums to 8MB each.
>
> ofour is running SunOS 5.7. Its maximum window size
> (tcp_max_buf) is set to 1MB. The default TCP window sizes
> (tcp_recv_hiwat, tcp_xmit_hiwat) were set to only 8192 bytes. I made
> the following changes using ndd:
>
> ndd -set /dev/tcp tcp_max_buf 4194304
> ndd -set /dev/tcp tcp_cwnd_max 2097152
> ndd -set /dev/tcp tcp_xmit_hiwat 65536
> ndd -set /dev/tcp tcp_recv_hiwat 65536
>
> I think more research would be a good idea. I'm making these
> changes based on suggestions found here:
>
> http://www-didc.lbl.gov/TCP-tuning/buffers.html
>
>
> Jeff Weber <address@hidden> wrote:
> :
> : Celia,
> :
> : Your two machines feeding from thelma are the biggest users of
> : the cpu...
> :
> : It really is not OK to have them both feed from thelma, we can set-up
> : a failover site for the other machine to aide in case of failure.
> :
> : You should feed from thelma from the biggest TCP window size machine..
> :
> : iita is also generating about 95% of our re-class messages.
> :
> : We need to clean this up as it is impacting thelma.
> :
> : I have no info re chisel, I suggest contacting your sys admin.
> :
> : Please keep me informed as to what you decide, but we must get to one
> : machine, and it should be running LDM 6, and hopefully an expanded
> : TCP window size.
>
>
> On Fri, 25 Apr 2003, Celia Chen wrote:
> :
> : I have upgraded chisel's LDM to 6.0.10 and will be doing the upgrades
> : for the other LDM servers at RAP next week.
> :
> : Do you have the TCP info on chisel? I don't know about this TCP
> : receive window size issre. But if chisel has a bigger size I can
> : feed ofour from chisel. I would like to have thelma feed two of
> : RAP's LDM machines just in case something happens to one.
> :
> : If ofour has the smaller TCP receive window size, should I set up
> : to feed ofour from iita, instead of "have iita feed from ofour"?
>
>
> On Fri, Apr 25, 2003 at 02:59:57PM -0600, Jeff Weber wrote:
> : Celia,
> :
> : #1 ofour.rap.ucar.edu and #2 iita.rap.ucar.edu. Both are requesting
> : the same data;
> :
> : topo: ofour.rap.ucar.edu NNEXRAD|CONDUIT|UNIDATA
> : topo: iita.rap.ucar.edu NNEXRAD|DIFAX|CONDUIT|FSL2|UNIDATA
> :
> : and they both have small TCP receive window sizes (ofour is very
> : small). I'd recommend at least 64k, maybe even 128k.
> :
> : thelma.ldm ofour.rap.ucar.edu.36202 2920 1851 64240 0 EST
> : thelma.ldm iita.rap.ucar.edu.2851 28960 2363 131768 0 EST
> : ^^^^^
> :
> : Please have iita feed from ofour (and not thelma), and if you could
> : contact your sysadmin re the TCP receive window sizes, it would be
> : helpful for both parties.
> :
> : Also, please upgrade to LDM 6.0.10 asap, it will improve your
> : performance greatly..
> :
> : http://my.unidata.ucar.edu/content/software/ldm/ldm-6.0.10/index.html
> :
> : Please keep me posted as to the progress of these requests.
>
> --
> Tres Hofmeister <address@hidden> http://www.rap.ucar.edu/~tres/
> Research Applications Program, National Center for Atmospheric Research
>
> ----- End forwarded message -----
>