[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[IDD #UQG-528842]: Puzzling IDD latencies from idd.unidata to metfs1.agron.iastate.edu

This archive contains answers to questions sent to Unidata support through mid-2025. Note that the archive is no longer being updated. We provide the archive for reference; many of the answers presented here remain technically correct, even if somewhat outdated. For the most up-to-date information on the use of NSF Unidata software and data services, please consult the Software Documentation first.

  • Subject: [IDD #UQG-528842]: Puzzling IDD latencies from idd.unidata to metfs1.agron.iastate.edu
  • Date: Thu, 20 Jun 2019 13:11:45 -0600
Hi Daryl,

re:
> It has been a bit of a struggle and thrashing to figure out where the network 
> bottleneck
> is here.  Could I get you kindly to test these two large file downloads and 
> report back
> the transfer speeds you get?
> 
> https://mesonet-nexrad.agron.iastate.edu/level2/raw/testfile
> 
> https://mesonet.agron.iastate.edu/onsite/iemre/1893_iemre_daily.nc
> 
> These two files are coming from different machine rooms with different 
> internal paths to
> Internet 2.  I can get good bandwidth to UCAR from one of the rooms, but not 
> the other.
> I am currently bouncing the LDM traffic via the good bandwidth machine room 
> to reach the
> other :(

Here are the results of what I ran:

% time wget https://mesonet-nexrad.agron.iastate.edu/level2/raw/testfile
--2019-06-20 13:07:35--  
https://mesonet-nexrad.agron.iastate.edu/level2/raw/testfile
Resolving mesonet-nexrad.agron.iastate.edu... 129.186.90.3, 2610:130:108:480::3
Connecting to mesonet-nexrad.agron.iastate.edu|129.186.90.3|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 212034048 (202M)
Saving to: “testfile”

100%[===========================================>] 212,034,048 1.57M/s   in 2m 
9s   

2019-06-20 13:09:44 (1.57 MB/s) - “testfile” saved [212034048/212034048]

2.060u 1.422s 2:09.18 2.6%      0+0k 1040+414136io 7pf+0w


% time wget https://mesonet.agron.iastate.edu/onsite/iemre/1893_iemre_daily.nc
--2019-06-20 13:10:24--  
https://mesonet.agron.iastate.edu/onsite/iemre/1893_iemre_daily.nc
Resolving mesonet.agron.iastate.edu... 129.186.185.33, 2610:130:104:100::5
Connecting to mesonet.agron.iastate.edu|129.186.185.33|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 846564580 (807M) [application/x-netcdf]
Saving to: “1893_iemre_daily.nc”

100%[===========================================>] 846,564,580 71.3M/s   in 12s 
    

2019-06-20 13:10:37 (65.7 MB/s) - “1893_iemre_daily.nc” saved 
[846564580/846564580]

6.958u 2.913s 0:12.68 77.7%     0+0k 0+1653448io 0pf+0w

Are these the sort of results you were expecting/dreading?

Cheers,

Tom
--
****************************************************************************
Unidata User Support                                    UCAR Unidata Program
(303) 497-8642                                                 P.O. Box 3000
address@hidden                                   Boulder, CO 80307
----------------------------------------------------------------------------
Unidata HomePage                       http://www.unidata.ucar.edu
****************************************************************************


Ticket Details
===================
Ticket ID: UQG-528842
Department: Support IDD
Priority: Normal
Status: Open
===================
NOTE: All email exchanges with Unidata User Support are recorded in the Unidata 
inquiry tracking system and then made publicly available through the web.  If 
you do not want to have your interactions made available in this way, you must 
let us know in each email you send to us.