BNL-UTA_SWT2

Test Between BNL and NetworkPerformanceUTA.

Tuning on Oct/04/2007

Network test from NetworkPerformanceUTA to BNL before network tuning.

[root@dct00 ~]# ping gk03.swt2.uta.edu
PING gk03.swt2.uta.edu (129.107.255.4) 56(84) bytes of data.
64 bytes from gk03.swt2.uta.edu (129.107.255.4): icmp_seq=0 ttl=50 time=64.0 ms
64 bytes from gk03.swt2.uta.edu (129.107.255.4): icmp_seq=1 ttl=50 time=64.2 ms

--- gk03.swt2.uta.edu ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 64.012/64.139/64.267/0.283 ms, pipe 2


[root@dct00 ~]# tracepath gk03.swt2.uta.edu 
 1:  dct00.usatlas.bnl.gov (192.12.15.8)                    0.154ms pmtu 1500
 1:  hsrp.usatlas.bnl.gov (192.12.15.24)                    2.306ms 
 2:  bnlmr1-bnlsite.es.net (198.124.216.177)                3.023ms 
 3:  aoacr1-bnlmr1.es.net (134.55.217.58)                 asymm  4   2.638ms 
 4:  chiccr1-aofacr1.es.net (134.55.218.93)               asymm  5  29.529ms 
 5:  chislsdn1-chicr1.es.net (134.55.207.34)              asymm  6  29.656ms 
 6:  chislmr1-chislsdn1.es.net (134.55.219.26)             29.956ms 
 7:  star-esnet.abilene.iu.edu (198.125.140.230)          asymm  8 301.004ms 
 8:  so-4-3-0.0.rtr.kans.net.internet2.edu (64.57.28.36)  asymm  9  50.713ms 
 9:  64.57.28.57 (64.57.28.57)                            asymm 10  68.487ms 
10:  hstn-hstn-newnet-ge-1-0-2-27-layer3.tx-learn.net (74.200.187.6) asymm 11  55.842ms 
11:  dlls-hstn-newnet-ge-1-0-0-309-layer3.tx-learn.net (74.200.187.18) asymm 12  61.108ms 
12:  ntg-dlls-newnet-layer3.tx-learn.net (74.200.187.22)  asymm 13  61.355ms 
13:  ntg-gw1-rcsntx-vl-403-ge-2-3-0.northtexasgigapop.org (206.223.141.137) asymm 14  61.987ms 
14:  as16905_uta7206.uta.edu (129.107.35.46)               63.385ms 
15:  gk03.swt2.uta.edu (129.107.255.4)                     64.380ms !H
     Resume: pmtu 1500 
[root@dct00 ~]# 


[root@dct00 ~]# iperf -s -w 4MB -i 4
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  4] local 192.12.15.8 port 5001 connected with 129.107.255.9 port 58540
[  4]  0.0- 4.0 sec  2.33 MBytes  4.88 Mbits/sec
[  4]  4.0- 8.0 sec  2.54 MBytes  5.32 Mbits/sec
[  4]  8.0-12.0 sec  4.42 MBytes  9.28 Mbits/sec
[  4] 12.0-16.0 sec  11.9 MBytes  24.9 Mbits/sec
[  4] 16.0-20.0 sec  22.5 MBytes  47.1 Mbits/sec
[  4] 20.0-24.0 sec  24.0 MBytes  50.3 Mbits/sec
[  4] 24.0-28.0 sec  25.4 MBytes  53.3 Mbits/sec
[  4] 28.0-32.0 sec  26.8 MBytes  56.2 Mbits/sec
[  4] 32.0-36.0 sec  16.9 MBytes  35.3 Mbits/sec
[  4] 36.0-40.0 sec  15.1 MBytes  31.6 Mbits/sec
[  4] 40.0-44.0 sec  16.4 MBytes  34.3 Mbits/sec
[  4] 44.0-48.0 sec  17.8 MBytes  37.4 Mbits/sec
[  4] 48.0-52.0 sec  19.3 MBytes  40.5 Mbits/sec
[  4] 52.0-56.0 sec  20.8 MBytes  43.6 Mbits/sec
[  4] 56.0-60.0 sec  22.2 MBytes  46.6 Mbits/sec
[  4]  0.0-60.6 sec    252 MBytes  34.9 Mbits/sec

/pre>

---++++ Network test from BNL to NetworkPerformanceUTA before network tuning.
[root@dct00 ~]# iperf  -c ndt.swt2.uta.edu  -w 4MB -i 4  -t 60
------------------------------------------------------------
Client connecting to ndt.swt2.uta.edu, TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41951 connected with 129.107.255.9 port 5001
[  3]  0.0- 4.0 sec  53.7 MBytes    113 Mbits/sec
[  3]  4.0- 8.0 sec    155 MBytes    324 Mbits/sec
[  3]  8.0-12.0 sec  11.4 MBytes  24.0 Mbits/sec
[  3] 12.0-16.0 sec  1.97 MBytes  4.13 Mbits/sec
[  3] 16.0-20.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 20.0-24.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 24.0-28.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 28.0-32.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 32.0-36.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 36.0-40.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 40.0-44.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 44.0-48.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 48.0-52.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 52.0-56.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 56.0-60.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 60.0-64.0 sec  0.00 Bytes  0.00 bits/sec
[  3]  0.0-66.4 sec    222 MBytes  28.0 Mbits/sec

Second try:

[root@dct00 ~]# iperf  -c ndt.swt2.uta.edu  -w 4MB -i 4  -t 60
------------------------------------------------------------
Client connecting to ndt.swt2.uta.edu, TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41953 connected with 129.107.255.9 port 5001
[  3]  0.0- 4.0 sec  82.3 MBytes    173 Mbits/sec
[  3]  4.0- 8.0 sec  97.0 MBytes    203 Mbits/sec
[  3]  8.0-12.0 sec    113 MBytes    236 Mbits/sec
[  3] 12.0-16.0 sec    130 MBytes    273 Mbits/sec
[  3] 16.0-20.0 sec    163 MBytes    342 Mbits/sec
[  3] 20.0-24.0 sec    127 MBytes    266 Mbits/sec
[  3] 24.0-28.0 sec    105 MBytes    220 Mbits/sec
[  3] 28.0-32.0 sec    138 MBytes    290 Mbits/sec
[  3] 32.0-36.0 sec    165 MBytes    347 Mbits/sec
[  3] 36.0-40.0 sec    183 MBytes    384 Mbits/sec
[  3] 40.0-44.0 sec    180 MBytes    378 Mbits/sec
[  3] 44.0-48.0 sec  92.4 MBytes    194 Mbits/sec
[  3] 48.0-52.0 sec    117 MBytes    244 Mbits/sec
[  3] 52.0-56.0 sec    144 MBytes    301 Mbits/sec
[  3] 56.0-60.0 sec    186 MBytes    390 Mbits/sec
[  3]  0.0-60.0 sec  1.98 GBytes    283 Mbits/sec


We used four streams: 

[root@dct00 ~]# iperf  -c ndt.swt2.uta.edu  -w 4MB -i 4  -t 60 -P 4 | grep -i SUM
[SUM]  0.0- 4.0 sec    205 MBytes    430 Mbits/sec
[SUM]  4.0- 8.0 sec    228 MBytes    479 Mbits/sec
[SUM]  8.0-12.0 sec    219 MBytes    460 Mbits/sec
[SUM] 12.0-16.0 sec    225 MBytes    472 Mbits/sec
[SUM] 16.0-20.0 sec    223 MBytes    468 Mbits/sec
[SUM] 20.0-24.0 sec    220 MBytes    461 Mbits/sec
[SUM] 24.0-28.0 sec    224 MBytes    471 Mbits/sec
[SUM] 28.0-32.0 sec    224 MBytes    469 Mbits/sec
[SUM] 32.0-36.0 sec    225 MBytes    471 Mbits/sec
[SUM] 36.0-40.0 sec    220 MBytes    461 Mbits/sec
[SUM] 40.0-44.0 sec    221 MBytes    464 Mbits/sec
[SUM] 44.0-48.0 sec    226 MBytes    475 Mbits/sec
[SUM] 48.0-52.0 sec    227 MBytes    476 Mbits/sec
[SUM] 52.0-56.0 sec    185 MBytes    387 Mbits/sec
[SUM] 56.0-60.0 sec  18.2 MBytes  38.1 Mbits/sec
[SUM]  0.0-93.0 sec  3.02 GBytes    279 Mbits/sec







We tested network performance on a different server:

[root@dct00 ~]# iperf  -s -w 4MB -i 4
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  4] local 192.12.15.8 port 5001 connected with 129.107.255.4 port 36860
[  4]  0.0- 4.0 sec  9.13 MBytes  19.1 Mbits/sec
[  4]  4.0- 8.0 sec  10.8 MBytes  22.6 Mbits/sec
[  4]  8.0-12.0 sec  12.2 MBytes  25.6 Mbits/sec
[  4] 12.0-16.0 sec  13.6 MBytes  28.6 Mbits/sec
[  4] 16.0-20.0 sec  15.1 MBytes  31.6 Mbits/sec
[  4] 20.0-24.0 sec  16.5 MBytes  34.7 Mbits/sec
[  4] 24.0-28.0 sec  18.0 MBytes  37.7 Mbits/sec
[  4] 28.0-32.0 sec  19.5 MBytes  40.8 Mbits/sec
[  4] 32.0-36.0 sec  20.8 MBytes  43.6 Mbits/sec
[  4] 36.0-40.0 sec  22.2 MBytes  46.6 Mbits/sec
[  4] 40.0-44.0 sec  23.6 MBytes  49.4 Mbits/sec
[  4] 44.0-48.0 sec  24.9 MBytes  52.3 Mbits/sec
[  4] 48.0-52.0 sec  26.4 MBytes  55.4 Mbits/sec
[  4] 52.0-56.0 sec  27.8 MBytes  58.3 Mbits/sec
[  4] 56.0-60.0 sec  11.8 MBytes  24.8 Mbits/sec
[  4] 60.0-64.0 sec  5.28 MBytes  11.1 Mbits/sec


[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000
------------------------------------------------------------
Client connecting to gk03.swt2.uta.edu, TCP port 20000
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41963 connected with 129.107.255.4 port 20000
[  3]  0.0- 5.0 sec  72.3 MBytes    121 Mbits/sec
[  3]  5.0-10.0 sec    123 MBytes    206 Mbits/sec
[  3] 10.0-15.0 sec    135 MBytes    227 Mbits/sec
[  3] 15.0-20.0 sec    212 MBytes    355 Mbits/sec
[  3] 20.0-25.0 sec    116 MBytes    194 Mbits/sec
[  3] 25.0-30.0 sec    159 MBytes    266 Mbits/sec
[  3] 30.0-35.0 sec    181 MBytes    304 Mbits/sec
[  3] 35.0-40.0 sec    232 MBytes    389 Mbits/sec
[  3] 40.0-45.0 sec    233 MBytes    391 Mbits/sec
[  3] 45.0-50.0 sec    104 MBytes    174 Mbits/sec
[  3] 50.0-55.0 sec    159 MBytes    267 Mbits/sec
[  3] 55.0-60.0 sec    142 MBytes    238 Mbits/sec
[  3]  0.0-60.1 sec  1.82 GBytes    261 Mbits/sec

[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000 -P 4 | gr
ep -i SUM
[SUM]  0.0- 5.0 sec    192 MBytes    322 Mbits/sec
[SUM]  5.0-10.0 sec    199 MBytes    333 Mbits/sec
[SUM] 10.0-15.0 sec    259 MBytes    435 Mbits/sec
[SUM] 15.0-20.0 sec    256 MBytes    430 Mbits/sec
[SUM] 20.0-25.0 sec    284 MBytes    477 Mbits/sec
[SUM] 25.0-30.0 sec    187 MBytes    313 Mbits/sec
[SUM] 30.0-35.0 sec    270 MBytes    453 Mbits/sec
[SUM] 35.0-40.0 sec    229 MBytes    385 Mbits/sec
[SUM] 40.0-45.0 sec    270 MBytes    453 Mbits/sec
[SUM] 45.0-50.0 sec    282 MBytes    474 Mbits/sec
[SUM] 50.0-55.0 sec    256 MBytes    430 Mbits/sec
[SUM] 55.0-60.0 sec    266 MBytes    446 Mbits/sec
[SUM]  0.0-60.2 sec  2.88 GBytes    411 Mbits/sec
[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000 -P 20 | g
rep -i SUM 
[SUM]  0.0- 5.0 sec    374 MBytes    627 Mbits/sec
[SUM]  5.0-10.0 sec    285 MBytes    478 Mbits/sec
[SUM] 10.0-15.0 sec    281 MBytes    472 Mbits/sec
[SUM] 15.0-20.0 sec    199 MBytes    333 Mbits/sec
[SUM] 20.0-25.0 sec    271 MBytes    455 Mbits/sec
[SUM] 25.0-30.0 sec    281 MBytes    471 Mbits/sec
[SUM] 30.0-35.0 sec    288 MBytes    483 Mbits/sec
[SUM] 35.0-40.0 sec    265 MBytes    444 Mbits/sec
[SUM] 40.0-45.0 sec    260 MBytes    437 Mbits/sec
[SUM] 45.0-50.0 sec    286 MBytes    479 Mbits/sec
[SUM] 50.0-55.0 sec    280 MBytes    470 Mbits/sec
[SUM] 55.0-60.0 sec    275 MBytes    462 Mbits/sec
[SUM]  0.0-63.3 sec  3.27 GBytes    444 Mbits/sec



After we tuned the NetworkPerformanceUTA network. 
------------------------------------------------------------
[root@dct00 ~]# iperf  -s -w 8MB -i 4
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 16.0 MByte (WARNING: requested 8.00 MByte)
------------------------------------------------------------
[  4] local 192.12.15.8 port 5001 connected with 129.107.255.4 port 36989
[  4]  0.0- 4.0 sec  11.4 MBytes  23.8 Mbits/sec
[  4]  4.0- 8.0 sec  11.5 MBytes  24.1 Mbits/sec
[  4]  8.0-12.0 sec  12.8 MBytes  26.8 Mbits/sec
[  4] 12.0-16.0 sec  14.3 MBytes  30.0 Mbits/sec
[  4] 16.0-20.0 sec  15.7 MBytes  33.0 Mbits/sec
[  4] 20.0-24.0 sec  17.1 MBytes  35.9 Mbits/sec
[  4] 24.0-28.0 sec  18.7 MBytes  39.1 Mbits/sec
[  4] 28.0-32.0 sec  20.2 MBytes  42.3 Mbits/sec
[  4] 32.0-36.0 sec  21.6 MBytes  45.3 Mbits/sec
[  4] 36.0-40.0 sec  23.0 MBytes  48.3 Mbits/sec
[  4] 40.0-44.0 sec  24.5 MBytes  51.3 Mbits/sec
[  4] 44.0-48.0 sec  25.8 MBytes  54.1 Mbits/sec
[  4] 48.0-52.0 sec  27.2 MBytes  57.1 Mbits/sec
[  4] 52.0-56.0 sec  28.7 MBytes  60.3 Mbits/sec
[  4] 56.0-60.0 sec  30.0 MBytes  62.9 Mbits/sec
[  4]  0.0-60.5 sec    306 MBytes  42.5 Mbits/sec


Send Data from BNL to NetworkPerformanceUTA: 

[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000
------------------------------------------------------------
Client connecting to gk03.swt2.uta.edu, TCP port 20000
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41993 connected with 129.107.255.4 port 20000
[  3]  0.0- 5.0 sec  50.9 MBytes  85.4 Mbits/sec
[  3]  5.0-10.0 sec  48.5 MBytes  81.4 Mbits/sec
[  3] 10.0-15.0 sec  92.0 MBytes    154 Mbits/sec
[  3] 15.0-20.0 sec    102 MBytes    171 Mbits/sec
[  3] 20.0-25.0 sec    111 MBytes    186 Mbits/sec
[  3] 25.0-30.0 sec    152 MBytes    256 Mbits/sec
[  3] 30.0-35.0 sec    116 MBytes    195 Mbits/sec
[  3] 35.0-40.0 sec    121 MBytes    204 Mbits/sec
[  3] 40.0-45.0 sec    119 MBytes    200 Mbits/sec
[  3] 45.0-50.0 sec  85.0 MBytes    143 Mbits/sec
[  3] 50.0-55.0 sec  55.7 MBytes  93.4 Mbits/sec
[  3] 55.0-60.0 sec  78.1 MBytes    131 Mbits/sec
[  3]  0.0-60.1 sec  1.11 GBytes    158 Mbits/sec

[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 8MB -t 60 -i 5 -p 20000

[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 8MB -t 60 -i 5 -p 20000
------------------------------------------------------------
Client connecting to gk03.swt2.uta.edu, TCP port 20000
TCP window size: 16.0 MByte (WARNING: requested 8.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41994 connected with 129.107.255.4 port 20000
[  3]  0.0- 5.0 sec  64.3 MBytes    108 Mbits/sec
[  3]  5.0-10.0 sec  92.4 MBytes    155 Mbits/sec
[  3] 10.0-15.0 sec    114 MBytes    192 Mbits/sec
[  3] 15.0-20.0 sec    123 MBytes    207 Mbits/sec
[  3] 20.0-25.0 sec  38.0 MBytes  63.8 Mbits/sec
[  3] 25.0-30.0 sec  45.4 MBytes  76.2 Mbits/sec
[  3] 30.0-35.0 sec  63.4 MBytes    106 Mbits/sec
[  3] 35.0-40.0 sec  74.0 MBytes    124 Mbits/sec
[  3] 40.0-45.0 sec  78.0 MBytes    131 Mbits/sec
[  3] 45.0-50.0 sec  74.1 MBytes    124 Mbits/sec
[  3] 50.0-55.0 sec  77.9 MBytes    131 Mbits/sec
[  3] 55.0-60.0 sec  87.3 MBytes    146 Mbits/sec
[  3]  0.0-60.1 sec    933 MBytes    130 Mbits/sec


We use multiple streams: 
[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000 -P 20 | grep -i SUM
[SUM]  0.0- 5.0 sec    380 MBytes    637 Mbits/sec
[SUM]  5.0-10.0 sec    286 MBytes    480 Mbits/sec
[SUM] 10.0-15.0 sec    229 MBytes    384 Mbits/sec
[SUM] 15.0-20.0 sec    275 MBytes    461 Mbits/sec
[SUM] 20.0-25.0 sec    280 MBytes    470 Mbits/sec
[SUM] 25.0-30.0 sec    279 MBytes    468 Mbits/sec
[SUM] 30.0-35.0 sec    285 MBytes    478 Mbits/sec
[SUM] 35.0-40.0 sec    289 MBytes    485 Mbits/sec
[SUM] 40.0-45.0 sec    238 MBytes    400 Mbits/sec
[SUM] 45.0-50.0 sec    282 MBytes    473 Mbits/sec
[SUM] 50.0-55.0 sec    271 MBytes    455 Mbits/sec
[SUM]  0.0-61.6 sec  3.30 GBytes    460 Mbits/sec



-- Main.DantongYu - 04 Oct 2007