Edit this page
r10 - 30 Oct 2007 - 23:12:07 - DantongYuYou are here: TWiki >  Admins Web > BNL-BUNetworkTest

BNL-BUNetworkTest

Test Between BNL and BU.

Tuning on Oct/30/2007

Network test from BU to BNL before network tuning.

The test from atlas-g01.bu.edu to BNL 

[root@dct00 ~]# tracepath atlas-g01.bu.edu
 1:  dct00.usatlas.bnl.gov (192.12.15.8)                    0.146ms pmtu 1500
 1:  hsrp.usatlas.bnl.gov (192.12.15.24)                    0.550ms 
 2:  bnlmr1-bnlsite.es.net (198.124.216.177)              178.975ms 
 3:  aoacr1-bnlmr1.es.net (134.55.217.58)                 asymm  4   2.597ms 
 4:  198.124.216.158 (198.124.216.158)                    asymm  5   2.958ms 
 5:  nox300gw1-Vl-110-NoX-INTERNET2.nox.org (192.5.89.221)   7.651ms 
 6:  nox300gw1-PEER-NoX-BU-192-5-89-142.nox.org (192.5.89.142)   9.203ms 


[root@dct00 ~]# iperf -s -w 4MB -i 5
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  4] local 192.12.15.8 port 5001 connected with 192.5.207.95 port 32995
[  4]  0.0- 5.0 sec  66.0 MBytes    111 Mbits/sec
[  4]  5.0-10.0 sec  49.4 MBytes  82.9 Mbits/sec
[  4] 10.0-15.0 sec  64.0 MBytes    107 Mbits/sec
[  4] 15.0-20.0 sec  74.4 MBytes    125 Mbits/sec
[  4] 20.0-25.0 sec  58.5 MBytes  98.2 Mbits/sec
[  4] 25.0-30.0 sec  45.6 MBytes  76.6 Mbits/sec
[  4] 30.0-35.0 sec  73.2 MBytes    123 Mbits/sec
[  4] 35.0-40.0 sec  66.2 MBytes    111 Mbits/sec
[  4] 40.0-45.0 sec  64.3 MBytes    108 Mbits/sec
[  4] 45.0-50.0 sec  70.1 MBytes    118 Mbits/sec
[  4] 50.0-55.0 sec  50.7 MBytes  85.1 Mbits/sec
[  4] 55.0-60.0 sec  70.2 MBytes    118 Mbits/sec
[  4]  0.0-60.0 sec    753 MBytes    105 Mbits/sec


The test from  atlas.bu.edu to BNL
[root@dct00 ~]# iperf -s -w 4MB -i 5

[  4] local 192.12.15.8 port 5001 connected with 192.5.207.10 port 47685
[  4]  0.0- 5.0 sec  34.4 MBytes  57.6 Mbits/sec
[  4]  5.0-10.0 sec  39.6 MBytes  66.4 Mbits/sec
[  4] 10.0-15.0 sec  32.7 MBytes  54.8 Mbits/sec
[  4] 15.0-20.0 sec  37.1 MBytes  62.2 Mbits/sec
[  4] 20.0-25.0 sec  59.9 MBytes    100 Mbits/sec
[  4] 25.0-30.0 sec  41.2 MBytes  69.0 Mbits/sec
[  4] 30.0-35.0 sec  49.2 MBytes  82.6 Mbits/sec
[  4] 35.0-40.0 sec  47.6 MBytes  79.9 Mbits/sec
[  4] 40.0-45.0 sec  39.8 MBytes  66.7 Mbits/sec
[  4] 45.0-50.0 sec  37.3 MBytes  62.5 Mbits/sec
[  4] 50.0-55.0 sec  34.6 MBytes  58.0 Mbits/sec
[  4] 55.0-60.0 sec  40.3 MBytes  67.6 Mbits/sec
[  4]  0.0-60.0 sec    494 MBytes  69.0 Mbits/sec


The test from BNL to BU site: 
[root@dct00 ~]# iperf  -c atlas-g01.bu.edu -w 4M -t 60 -i 5 
------------------------------------------------------------
Client connecting to atlas-g01.bu.edu, TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 57664 connected with 192.5.207.95 port 5001
[  3]  0.0- 5.0 sec  46.8 MBytes  78.4 Mbits/sec
[  3]  5.0-10.0 sec  38.3 MBytes  64.2 Mbits/sec
[  3] 10.0-15.0 sec  35.8 MBytes  60.0 Mbits/sec
[  3] 15.0-20.0 sec  35.8 MBytes  60.0 Mbits/sec
[  3] 20.0-25.0 sec  33.3 MBytes  55.8 Mbits/sec
[  3] 25.0-30.0 sec  33.1 MBytes  55.6 Mbits/sec
[  3] 30.0-35.0 sec  35.7 MBytes  59.9 Mbits/sec
[  3] 35.0-40.0 sec  35.8 MBytes  60.0 Mbits/sec
[  3] 40.0-45.0 sec  35.8 MBytes  60.1 Mbits/sec
[  3] 45.0-50.0 sec  38.4 MBytes  64.4 Mbits/sec
[  3] 50.0-55.0 sec  33.3 MBytes  55.9 Mbits/sec
[  3] 55.0-60.0 sec  33.2 MBytes  55.7 Mbits/sec
[  3]  0.0-60.6 sec    435 MBytes  60.3 Mbits/sec

After we tuned the network setting, the results of iperf transfer from BU to BU is shown as follows: 

[root@dct00 ~]# iperf -s -w 4MB -i 5
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  4] local 192.12.15.8 port 5001 connected with 192.5.207.95 port 33040

[  4]  0.0- 5.0 sec  37.9 MBytes  63.6 Mbits/sec
[  4]  5.0-10.0 sec  26.7 MBytes  44.7 Mbits/sec
[  4] 10.0-15.0 sec  24.2 MBytes  40.6 Mbits/sec
[  4] 15.0-20.0 sec  26.8 MBytes  45.0 Mbits/sec
[  4] 20.0-25.0 sec  29.5 MBytes  49.5 Mbits/sec
[  4] 25.0-30.0 sec  16.3 MBytes  27.3 Mbits/sec
[  4] 30.0-35.0 sec  29.3 MBytes  49.2 Mbits/sec
[  4] 35.0-40.0 sec  21.1 MBytes  35.4 Mbits/sec
[  4] 40.0-45.0 sec  25.6 MBytes  42.9 Mbits/sec
[  4] 45.0-50.0 sec  25.7 MBytes  43.2 Mbits/sec
[  4] 50.0-55.0 sec  21.6 MBytes  36.3 Mbits/sec
[  4] 55.0-60.0 sec  21.6 MBytes  36.2 Mbits/sec
[  4]  0.0-61.0 sec    311 MBytes  42.8 Mbits/sec
[  4] local 192.12.15.8 port 5001 connected with 192.5.207.95 port 3


[root@dct00 ~]# iperf  -c atlas-g01.bu.edu -w 4MB -t 60 -i 5 
------------------------------------------------------------
Client connecting to atlas-g01.bu.edu, TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 57665 connected with 192.5.207.95 port 5001
[  3]  0.0- 5.0 sec    561 MBytes    941 Mbits/sec
[  3]  5.0-10.0 sec    561 MBytes    940 Mbits/sec
[  3] 10.0-15.0 sec    563 MBytes    945 Mbits/sec
[  3] 15.0-20.0 sec    560 MBytes    940 Mbits/sec
[  3] 20.0-25.0 sec    560 MBytes    940 Mbits/sec
[  3] 25.0-30.0 sec    515 MBytes    864 Mbits/sec
[  3] 30.0-35.0 sec    561 MBytes    941 Mbits/sec
[  3] 35.0-40.0 sec    562 MBytes    942 Mbits/sec
[  3] 40.0-45.0 sec    562 MBytes    943 Mbits/sec
[  3] 45.0-50.0 sec    560 MBytes    940 Mbits/sec
[  3] 50.0-55.0 sec    521 MBytes    874 Mbits/sec
[  3] 55.0-60.0 sec    561 MBytes    941 Mbits/sec
[  3]  0.0-60.0 sec  6.49 GBytes    929 Mbits/sec

Since there is a symmetrical performance between data from BU to BNL and from BNL to BU. 
There is a wire speed from BNL to BU. But the performance is really bad from BU to BNL. 

We used the UDP test from BU to BNL: 
[root@dct00 ~]# iperf -s -u -w 4MB -i 5
------------------------------------------------------------
Server listening on UDP port 5001
Receiving 1470 byte datagrams
UDP buffer size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 5001 connected with 192.5.207.95 port 32775
[  3]  0.0- 5.0 sec    568 MBytes    952 Mbits/sec  0.015 ms 10138/414972 (2.4%)
[  3]  5.0-10.0 sec    567 MBytes    952 Mbits/sec  0.015 ms 11481/416274 (2.8%)
[  3] 10.0-15.0 sec    567 MBytes    952 Mbits/sec  0.015 ms 11653/416393 (2.8%)
[  3] 15.0-20.0 sec    567 MBytes    952 Mbits/sec  0.014 ms 11681/416426 (2.8%)
[  3] 20.0-25.0 sec    567 MBytes    952 Mbits/sec  0.016 ms 11843/416505 (2.8%)
[  3] 20.0-25.0 sec  1 datagrams received out-of-order
[  3] 25.0-30.0 sec    567 MBytes    952 Mbits/sec  0.017 ms 11704/416460 (2.8%)
[  3] 30.0-35.0 sec    567 MBytes    952 Mbits/sec  0.014 ms 11773/416393 (2.8%)
[  3] 35.0-40.0 sec    567 MBytes    952 Mbits/sec  0.016 ms 11752/416426 (2.8%)
[  3] 40.0-45.0 sec    567 MBytes    952 Mbits/sec  0.018 ms 11842/416511 (2.8%)
[  3] 45.0-50.0 sec    567 MBytes    952 Mbits/sec  0.015 ms 11892/416496 (2.9%)
[  3] 50.0-55.0 sec    567 MBytes    952 Mbits/sec  0.014 ms 11688/416375 (2.8%)
[  3] 55.0-60.0 sec    567 MBytes    952 Mbits/sec  0.014 ms 11736/416420 (2.8%)
[  3]  0.0-60.0 sec  6.65 GBytes    952 Mbits/sec  0.019 ms 139219/4996904 (2.8%

[  3]  0.0-60.0 sec  2 datagrams received out-of-order
[  4] local 192.12.15.8 port 5001 connected with 192.5.207.95 port 32776
[  4]  0.0- 5.0 sec    303 MBytes    508 Mbits/sec  0.031 ms 1238/217390 (0.57%)
[  4]  5.0-10.0 sec    303 MBytes    508 Mbits/sec  0.030 ms 1346/217395 (0.62%)
[  4] 10.0-15.0 sec    303 MBytes    508 Mbits/sec  0.031 ms 1255/217389 (0.58%)
[  4] 15.0-20.0 sec    303 MBytes    508 Mbits/sec  0.031 ms 1294/217390 (0.6%)
[  4] 15.0-20.0 sec  1 datagrams received out-of-order
[  4] 20.0-25.0 sec    303 MBytes    508 Mbits/sec  0.032 ms 1300/217392 (0.6%)
[  4] 25.0-30.0 sec    303 MBytes    508 Mbits/sec  0.030 ms 1334/217393 (0.61%)
[  4] 30.0-35.0 sec    303 MBytes    508 Mbits/sec  0.031 ms 1320/217389 (0.61%)
[  4] 35.0-40.0 sec    303 MBytes    508 Mbits/sec  0.030 ms 1423/217390 (0.65%)
[  4] 40.0-45.0 sec    303 MBytes    508 Mbits/sec  0.032 ms 1386/217396 (0.64%)
[  4] 45.0-50.0 sec    303 MBytes    508 Mbits/sec  0.030 ms 1408/217390 (0.65%)
[  4] 50.0-55.0 sec    303 MBytes    508 Mbits/sec  0.030 ms 1368/217389 (0.63%)
[  4]  0.0-60.0 sec  3.55 GBytes    508 Mbits/sec  0.032 ms 16036/2608695 (0.61%
)
[  4]  0.0-60.0 sec  2 datagrams received out-of-order


We run the UDP test from BNL to BU: the direction seems clean: 

[root@dct00 ~]# iperf  -c atlas-g01.bu.edu -u -b 500m -t 60 -i 5 
------------------------------------------------------------
Client connecting to atlas-g01.bu.edu, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size:   108 KByte (default)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41169 connected with 192.5.207.95 port 5001
[  3]  0.0- 5.0 sec    305 MBytes    511 Mbits/sec
[  3]  5.0-10.0 sec    305 MBytes    511 Mbits/sec
[  3] 10.0-15.0 sec    305 MBytes    511 Mbits/sec
[  3] 15.0-20.0 sec    305 MBytes    511 Mbits/sec
[  3] 20.0-25.0 sec    305 MBytes    511 Mbits/sec
[  3] 25.0-30.0 sec    305 MBytes    511 Mbits/sec
[  3] 30.0-35.0 sec    305 MBytes    511 Mbits/sec
[  3] 35.0-40.0 sec    305 MBytes    511 Mbits/sec
[  3] 40.0-45.0 sec    305 MBytes    511 Mbits/sec
[  3] 45.0-50.0 sec    305 MBytes    511 Mbits/sec
[  3] 50.0-55.0 sec    305 MBytes    511 Mbits/sec
[  3] 55.0-60.0 sec    305 MBytes    511 Mbits/sec
[  3]  0.0-60.0 sec  3.57 GBytes    511 Mbits/sec
[  3] Sent 2608696 datagrams
[  3] Server Report:
[  3]  0.0-60.0 sec  3.57 GBytes    511 Mbits/sec  0.009 ms    0/2608695 (0%)
[  3]  0.0-60.0 sec  1 datagrams received out-of-order


[root@dct00 ~]# iperf  -c atlas-g01.bu.edu -u -b 940m -t 60 -i 5 
------------------------------------------------------------
Client connecting to atlas-g01.bu.edu, UDP port 5001
Sending 1470 byte datagrams
UDP buffer size:   108 KByte (default)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41169 connected with 192.5.207.95 port 5001
[  3]  0.0- 5.0 sec    570 MBytes    957 Mbits/sec
[  3]  5.0-10.0 sec    570 MBytes    957 Mbits/sec
[  3] 10.0-15.0 sec    570 MBytes    957 Mbits/sec
[  3] 15.0-20.0 sec    570 MBytes    957 Mbits/sec
[  3] 20.0-25.0 sec    570 MBytes    957 Mbits/sec
[  3] 25.0-30.0 sec    570 MBytes    957 Mbits/sec
[  3] 30.0-35.0 sec    570 MBytes    957 Mbits/sec
[  3] 35.0-40.0 sec    570 MBytes    957 Mbits/sec
[  3] 40.0-45.0 sec    570 MBytes    957 Mbits/sec
[  3] 45.0-50.0 sec    570 MBytes    957 Mbits/sec
[  3] 50.0-55.0 sec    570 MBytes    957 Mbits/sec
[  3] 55.0-60.0 sec    570 MBytes    957 Mbits/sec
[  3]  0.0-60.0 sec  6.69 GBytes    957 Mbits/sec
[  3] Sent 4882984 datagrams
[  3] Server Report:
[  3]  0.0-60.0 sec  6.69 GBytes    957 Mbits/sec  0.035 ms   14/4882983 (0.00029%)
[  3]  0.0-60.0 sec  3 datagrams received out-of-order
-- DantongYu - 30 Oct 2007

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback