r10 - 10 Jun 2008 - 10:37:02 - RobertGardnerYou are here: TWiki >  Admins Web > BNL-UTA_SWT2

BNL-UTA_SWT2

Test Between BNL and NetworkPerformanceUTA.

Tuning on Oct/04/2007

Network test from NetworkPerformanceUTA to BNL before network tuning.


[root@dct00 ~]# ping gk03.swt2.uta.edu
PING gk03.swt2.uta.edu (129.107.255.4) 56(84) bytes of data.
64 bytes from gk03.swt2.uta.edu (129.107.255.4): icmp_seq=0 ttl=50 time=64.0 ms
64 bytes from gk03.swt2.uta.edu (129.107.255.4): icmp_seq=1 ttl=50 time=64.2 ms

--- gk03.swt2.uta.edu ping statistics ---
2 packets transmitted, 2 received, 0% packet loss, time 1001ms
rtt min/avg/max/mdev = 64.012/64.139/64.267/0.283 ms, pipe 2


[root@dct00 ~]# tracepath gk03.swt2.uta.edu 
 1:  dct00.usatlas.bnl.gov (192.12.15.8)                    0.154ms pmtu 1500
 1:  hsrp.usatlas.bnl.gov (192.12.15.24)                    2.306ms 
 2:  bnlmr1-bnlsite.es.net (198.124.216.177)                3.023ms 
 3:  aoacr1-bnlmr1.es.net (134.55.217.58)                 asymm  4   2.638ms 
 4:  chiccr1-aofacr1.es.net (134.55.218.93)               asymm  5  29.529ms 
 5:  chislsdn1-chicr1.es.net (134.55.207.34)              asymm  6  29.656ms 
 6:  chislmr1-chislsdn1.es.net (134.55.219.26)             29.956ms 
 7:  star-esnet.abilene.iu.edu (198.125.140.230)          asymm  8 301.004ms 
 8:  so-4-3-0.0.rtr.kans.net.internet2.edu (64.57.28.36)  asymm  9  50.713ms 
 9:  64.57.28.57 (64.57.28.57)                            asymm 10  68.487ms 
10:  hstn-hstn-newnet-ge-1-0-2-27-layer3.tx-learn.net (74.200.187.6) asymm 11  55.842ms 
11:  dlls-hstn-newnet-ge-1-0-0-309-layer3.tx-learn.net (74.200.187.18) asymm 12  61.108ms 
12:  ntg-dlls-newnet-layer3.tx-learn.net (74.200.187.22)  asymm 13  61.355ms 
13:  ntg-gw1-rcsntx-vl-403-ge-2-3-0.northtexasgigapop.org (206.223.141.137) asymm 14  61.987ms 
14:  as16905_uta7206.uta.edu (129.107.35.46)               63.385ms 
15:  gk03.swt2.uta.edu (129.107.255.4)                     64.380ms !H
     Resume: pmtu 1500 
[root@dct00 ~]# 


[root@dct00 ~]# iperf -s -w 4MB -i 4
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  4] local 192.12.15.8 port 5001 connected with 129.107.255.9 port 58540
[  4]  0.0- 4.0 sec  2.33 MBytes  4.88 Mbits/sec
[  4]  4.0- 8.0 sec  2.54 MBytes  5.32 Mbits/sec
[  4]  8.0-12.0 sec  4.42 MBytes  9.28 Mbits/sec
[  4] 12.0-16.0 sec  11.9 MBytes  24.9 Mbits/sec
[  4] 16.0-20.0 sec  22.5 MBytes  47.1 Mbits/sec
[  4] 20.0-24.0 sec  24.0 MBytes  50.3 Mbits/sec
[  4] 24.0-28.0 sec  25.4 MBytes  53.3 Mbits/sec
[  4] 28.0-32.0 sec  26.8 MBytes  56.2 Mbits/sec
[  4] 32.0-36.0 sec  16.9 MBytes  35.3 Mbits/sec
[  4] 36.0-40.0 sec  15.1 MBytes  31.6 Mbits/sec
[  4] 40.0-44.0 sec  16.4 MBytes  34.3 Mbits/sec
[  4] 44.0-48.0 sec  17.8 MBytes  37.4 Mbits/sec
[  4] 48.0-52.0 sec  19.3 MBytes  40.5 Mbits/sec
[  4] 52.0-56.0 sec  20.8 MBytes  43.6 Mbits/sec
[  4] 56.0-60.0 sec  22.2 MBytes  46.6 Mbits/sec
[  4]  0.0-60.6 sec    252 MBytes  34.9 Mbits/sec

/pre>

---++++ Network test from BNL to NetworkPerformanceUTA before network tuning.
[root@dct00 ~]# iperf  -c ndt.swt2.uta.edu  -w 4MB -i 4  -t 60
------------------------------------------------------------
Client connecting to ndt.swt2.uta.edu, TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41951 connected with 129.107.255.9 port 5001
[  3]  0.0- 4.0 sec  53.7 MBytes    113 Mbits/sec
[  3]  4.0- 8.0 sec    155 MBytes    324 Mbits/sec
[  3]  8.0-12.0 sec  11.4 MBytes  24.0 Mbits/sec
[  3] 12.0-16.0 sec  1.97 MBytes  4.13 Mbits/sec
[  3] 16.0-20.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 20.0-24.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 24.0-28.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 28.0-32.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 32.0-36.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 36.0-40.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 40.0-44.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 44.0-48.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 48.0-52.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 52.0-56.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 56.0-60.0 sec  0.00 Bytes  0.00 bits/sec
[  3] 60.0-64.0 sec  0.00 Bytes  0.00 bits/sec
[  3]  0.0-66.4 sec    222 MBytes  28.0 Mbits/sec

Second try:

[root@dct00 ~]# iperf  -c ndt.swt2.uta.edu  -w 4MB -i 4  -t 60
------------------------------------------------------------
Client connecting to ndt.swt2.uta.edu, TCP port 5001
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41953 connected with 129.107.255.9 port 5001
[  3]  0.0- 4.0 sec  82.3 MBytes    173 Mbits/sec
[  3]  4.0- 8.0 sec  97.0 MBytes    203 Mbits/sec
[  3]  8.0-12.0 sec    113 MBytes    236 Mbits/sec
[  3] 12.0-16.0 sec    130 MBytes    273 Mbits/sec
[  3] 16.0-20.0 sec    163 MBytes    342 Mbits/sec
[  3] 20.0-24.0 sec    127 MBytes    266 Mbits/sec
[  3] 24.0-28.0 sec    105 MBytes    220 Mbits/sec
[  3] 28.0-32.0 sec    138 MBytes    290 Mbits/sec
[  3] 32.0-36.0 sec    165 MBytes    347 Mbits/sec
[  3] 36.0-40.0 sec    183 MBytes    384 Mbits/sec
[  3] 40.0-44.0 sec    180 MBytes    378 Mbits/sec
[  3] 44.0-48.0 sec  92.4 MBytes    194 Mbits/sec
[  3] 48.0-52.0 sec    117 MBytes    244 Mbits/sec
[  3] 52.0-56.0 sec    144 MBytes    301 Mbits/sec
[  3] 56.0-60.0 sec    186 MBytes    390 Mbits/sec
[  3]  0.0-60.0 sec  1.98 GBytes    283 Mbits/sec


We used four streams: 

[root@dct00 ~]# iperf  -c ndt.swt2.uta.edu  -w 4MB -i 4  -t 60 -P 4 | grep -i SUM
[SUM]  0.0- 4.0 sec    205 MBytes    430 Mbits/sec
[SUM]  4.0- 8.0 sec    228 MBytes    479 Mbits/sec
[SUM]  8.0-12.0 sec    219 MBytes    460 Mbits/sec
[SUM] 12.0-16.0 sec    225 MBytes    472 Mbits/sec
[SUM] 16.0-20.0 sec    223 MBytes    468 Mbits/sec
[SUM] 20.0-24.0 sec    220 MBytes    461 Mbits/sec
[SUM] 24.0-28.0 sec    224 MBytes    471 Mbits/sec
[SUM] 28.0-32.0 sec    224 MBytes    469 Mbits/sec
[SUM] 32.0-36.0 sec    225 MBytes    471 Mbits/sec
[SUM] 36.0-40.0 sec    220 MBytes    461 Mbits/sec
[SUM] 40.0-44.0 sec    221 MBytes    464 Mbits/sec
[SUM] 44.0-48.0 sec    226 MBytes    475 Mbits/sec
[SUM] 48.0-52.0 sec    227 MBytes    476 Mbits/sec
[SUM] 52.0-56.0 sec    185 MBytes    387 Mbits/sec
[SUM] 56.0-60.0 sec  18.2 MBytes  38.1 Mbits/sec
[SUM]  0.0-93.0 sec  3.02 GBytes    279 Mbits/sec




We tested network performance on a different server: [root@dct00 ~]# iperf -s -w 4MB -i 4 ------------------------------------------------------------ Server listening on TCP port 5001 TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte) ------------------------------------------------------------ [ 4] local 192.12.15.8 port 5001 connected with 129.107.255.4 port 36860 [ 4] 0.0- 4.0 sec 9.13 MBytes 19.1 Mbits/sec [ 4] 4.0- 8.0 sec 10.8 MBytes 22.6 Mbits/sec [ 4] 8.0-12.0 sec 12.2 MBytes 25.6 Mbits/sec [ 4] 12.0-16.0 sec 13.6 MBytes 28.6 Mbits/sec [ 4] 16.0-20.0 sec 15.1 MBytes 31.6 Mbits/sec [ 4] 20.0-24.0 sec 16.5 MBytes 34.7 Mbits/sec [ 4] 24.0-28.0 sec 18.0 MBytes 37.7 Mbits/sec [ 4] 28.0-32.0 sec 19.5 MBytes 40.8 Mbits/sec [ 4] 32.0-36.0 sec 20.8 MBytes 43.6 Mbits/sec [ 4] 36.0-40.0 sec 22.2 MBytes 46.6 Mbits/sec [ 4] 40.0-44.0 sec 23.6 MBytes 49.4 Mbits/sec [ 4] 44.0-48.0 sec 24.9 MBytes 52.3 Mbits/sec [ 4] 48.0-52.0 sec 26.4 MBytes 55.4 Mbits/sec [ 4] 52.0-56.0 sec 27.8 MBytes 58.3 Mbits/sec [ 4] 56.0-60.0 sec 11.8 MBytes 24.8 Mbits/sec [ 4] 60.0-64.0 sec 5.28 MBytes 11.1 Mbits/sec [root@dct00 ~]# iperf -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000 ------------------------------------------------------------ Client connecting to gk03.swt2.uta.edu, TCP port 20000 TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte) ------------------------------------------------------------ [ 3] local 192.12.15.8 port 41963 connected with 129.107.255.4 port 20000 [ 3] 0.0- 5.0 sec 72.3 MBytes 121 Mbits/sec [ 3] 5.0-10.0 sec 123 MBytes 206 Mbits/sec [ 3] 10.0-15.0 sec 135 MBytes 227 Mbits/sec [ 3] 15.0-20.0 sec 212 MBytes 355 Mbits/sec [ 3] 20.0-25.0 sec 116 MBytes 194 Mbits/sec [ 3] 25.0-30.0 sec 159 MBytes 266 Mbits/sec [ 3] 30.0-35.0 sec 181 MBytes 304 Mbits/sec [ 3] 35.0-40.0 sec 232 MBytes 389 Mbits/sec [ 3] 40.0-45.0 sec 233 MBytes 391 Mbits/sec [ 3] 45.0-50.0 sec 104 MBytes 174 Mbits/sec [ 3] 50.0-55.0 sec 159 MBytes 267 Mbits/sec [ 3] 55.0-60.0 sec 142 MBytes 238 Mbits/sec [ 3] 0.0-60.1 sec 1.82 GBytes 261 Mbits/sec [root@dct00 ~]# iperf -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000 -P 4 | gr ep -i SUM [SUM] 0.0- 5.0 sec 192 MBytes 322 Mbits/sec [SUM] 5.0-10.0 sec 199 MBytes 333 Mbits/sec [SUM] 10.0-15.0 sec 259 MBytes 435 Mbits/sec [SUM] 15.0-20.0 sec 256 MBytes 430 Mbits/sec [SUM] 20.0-25.0 sec 284 MBytes 477 Mbits/sec [SUM] 25.0-30.0 sec 187 MBytes 313 Mbits/sec [SUM] 30.0-35.0 sec 270 MBytes 453 Mbits/sec [SUM] 35.0-40.0 sec 229 MBytes 385 Mbits/sec [SUM] 40.0-45.0 sec 270 MBytes 453 Mbits/sec [SUM] 45.0-50.0 sec 282 MBytes 474 Mbits/sec [SUM] 50.0-55.0 sec 256 MBytes 430 Mbits/sec [SUM] 55.0-60.0 sec 266 MBytes 446 Mbits/sec [SUM] 0.0-60.2 sec 2.88 GBytes 411 Mbits/sec [root@dct00 ~]# iperf -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000 -P 20 | g rep -i SUM [SUM] 0.0- 5.0 sec 374 MBytes 627 Mbits/sec [SUM] 5.0-10.0 sec 285 MBytes 478 Mbits/sec [SUM] 10.0-15.0 sec 281 MBytes 472 Mbits/sec [SUM] 15.0-20.0 sec 199 MBytes 333 Mbits/sec [SUM] 20.0-25.0 sec 271 MBytes 455 Mbits/sec [SUM] 25.0-30.0 sec 281 MBytes 471 Mbits/sec [SUM] 30.0-35.0 sec 288 MBytes 483 Mbits/sec [SUM] 35.0-40.0 sec 265 MBytes 444 Mbits/sec [SUM] 40.0-45.0 sec 260 MBytes 437 Mbits/sec [SUM] 45.0-50.0 sec 286 MBytes 479 Mbits/sec [SUM] 50.0-55.0 sec 280 MBytes 470 Mbits/sec [SUM] 55.0-60.0 sec 275 MBytes 462 Mbits/sec [SUM] 0.0-63.3 sec 3.27 GBytes 444 Mbits/sec


After we tuned the NetworkPerformanceUTA network. 
------------------------------------------------------------
[root@dct00 ~]# iperf  -s -w 8MB -i 4
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 16.0 MByte (WARNING: requested 8.00 MByte)
------------------------------------------------------------
[  4] local 192.12.15.8 port 5001 connected with 129.107.255.4 port 36989
[  4]  0.0- 4.0 sec  11.4 MBytes  23.8 Mbits/sec
[  4]  4.0- 8.0 sec  11.5 MBytes  24.1 Mbits/sec
[  4]  8.0-12.0 sec  12.8 MBytes  26.8 Mbits/sec
[  4] 12.0-16.0 sec  14.3 MBytes  30.0 Mbits/sec
[  4] 16.0-20.0 sec  15.7 MBytes  33.0 Mbits/sec
[  4] 20.0-24.0 sec  17.1 MBytes  35.9 Mbits/sec
[  4] 24.0-28.0 sec  18.7 MBytes  39.1 Mbits/sec
[  4] 28.0-32.0 sec  20.2 MBytes  42.3 Mbits/sec
[  4] 32.0-36.0 sec  21.6 MBytes  45.3 Mbits/sec
[  4] 36.0-40.0 sec  23.0 MBytes  48.3 Mbits/sec
[  4] 40.0-44.0 sec  24.5 MBytes  51.3 Mbits/sec
[  4] 44.0-48.0 sec  25.8 MBytes  54.1 Mbits/sec
[  4] 48.0-52.0 sec  27.2 MBytes  57.1 Mbits/sec
[  4] 52.0-56.0 sec  28.7 MBytes  60.3 Mbits/sec
[  4] 56.0-60.0 sec  30.0 MBytes  62.9 Mbits/sec
[  4]  0.0-60.5 sec    306 MBytes  42.5 Mbits/sec


Send Data from BNL to NetworkPerformanceUTA: 

[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000
------------------------------------------------------------
Client connecting to gk03.swt2.uta.edu, TCP port 20000
TCP window size: 8.00 MByte (WARNING: requested 4.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41993 connected with 129.107.255.4 port 20000
[  3]  0.0- 5.0 sec  50.9 MBytes  85.4 Mbits/sec
[  3]  5.0-10.0 sec  48.5 MBytes  81.4 Mbits/sec
[  3] 10.0-15.0 sec  92.0 MBytes    154 Mbits/sec
[  3] 15.0-20.0 sec    102 MBytes    171 Mbits/sec
[  3] 20.0-25.0 sec    111 MBytes    186 Mbits/sec
[  3] 25.0-30.0 sec    152 MBytes    256 Mbits/sec
[  3] 30.0-35.0 sec    116 MBytes    195 Mbits/sec
[  3] 35.0-40.0 sec    121 MBytes    204 Mbits/sec
[  3] 40.0-45.0 sec    119 MBytes    200 Mbits/sec
[  3] 45.0-50.0 sec  85.0 MBytes    143 Mbits/sec
[  3] 50.0-55.0 sec  55.7 MBytes  93.4 Mbits/sec
[  3] 55.0-60.0 sec  78.1 MBytes    131 Mbits/sec
[  3]  0.0-60.1 sec  1.11 GBytes    158 Mbits/sec

[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 8MB -t 60 -i 5 -p 20000

[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 8MB -t 60 -i 5 -p 20000
------------------------------------------------------------
Client connecting to gk03.swt2.uta.edu, TCP port 20000
TCP window size: 16.0 MByte (WARNING: requested 8.00 MByte)
------------------------------------------------------------
[  3] local 192.12.15.8 port 41994 connected with 129.107.255.4 port 20000
[  3]  0.0- 5.0 sec  64.3 MBytes    108 Mbits/sec
[  3]  5.0-10.0 sec  92.4 MBytes    155 Mbits/sec
[  3] 10.0-15.0 sec    114 MBytes    192 Mbits/sec
[  3] 15.0-20.0 sec    123 MBytes    207 Mbits/sec
[  3] 20.0-25.0 sec  38.0 MBytes  63.8 Mbits/sec
[  3] 25.0-30.0 sec  45.4 MBytes  76.2 Mbits/sec
[  3] 30.0-35.0 sec  63.4 MBytes    106 Mbits/sec
[  3] 35.0-40.0 sec  74.0 MBytes    124 Mbits/sec
[  3] 40.0-45.0 sec  78.0 MBytes    131 Mbits/sec
[  3] 45.0-50.0 sec  74.1 MBytes    124 Mbits/sec
[  3] 50.0-55.0 sec  77.9 MBytes    131 Mbits/sec
[  3] 55.0-60.0 sec  87.3 MBytes    146 Mbits/sec
[  3]  0.0-60.1 sec    933 MBytes    130 Mbits/sec


We use multiple streams: 
[root@dct00 ~]# iperf  -c gk03.swt2.uta.edu -w 4MB -t 60 -i 5 -p 20000 -P 20 | grep -i SUM
[SUM]  0.0- 5.0 sec    380 MBytes    637 Mbits/sec
[SUM]  5.0-10.0 sec    286 MBytes    480 Mbits/sec
[SUM] 10.0-15.0 sec    229 MBytes    384 Mbits/sec
[SUM] 15.0-20.0 sec    275 MBytes    461 Mbits/sec
[SUM] 20.0-25.0 sec    280 MBytes    470 Mbits/sec
[SUM] 25.0-30.0 sec    279 MBytes    468 Mbits/sec
[SUM] 30.0-35.0 sec    285 MBytes    478 Mbits/sec
[SUM] 35.0-40.0 sec    289 MBytes    485 Mbits/sec
[SUM] 40.0-45.0 sec    238 MBytes    400 Mbits/sec
[SUM] 45.0-50.0 sec    282 MBytes    473 Mbits/sec
[SUM] 50.0-55.0 sec    271 MBytes    455 Mbits/sec
[SUM]  0.0-61.6 sec  3.30 GBytes    460 Mbits/sec


-- Main.DantongYu - 04 Oct 2007

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To [[https://www.usatlas.bnl.gov/twiki/bin/edit/Admins/BNL-UTA_SWT2][edit the content of this page]], click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments


* *[[http://lhc.web.cern.ch/lhc/][LHC Site]]* * *[[http://atlas.web.cern.ch/Atlas/index.html][ATLAS Experiment Site]]* * *[[http://www.usatlas.bnl.gov/][USATLAS Site]]* * *[[Main.WebHome][USATLAS Support Site]]* --- * *USATLAS Site Admin Topics* * [[WebHome][Admin Support Home]] * [[Admins.SoftwareInstallation][Site Setup Help]] * [[Admins.WebSearch][Search]] --- * *Site Admin Help Desk* * [[https://www.racf.bnl.gov/docs/rt][Submit a help ticket]] * [[https://www.racf.bnl.gov/about/contactinfo][Facility contacts]] * [[http://www.opensciencegrid.org/index.php?option=com_content&task=view&id=48&Itemid=66][Open Science Grid Support Center]] --- * *Facility Integration Program* * [[IntegrationProgram][Integration home]] * [[ProofXrootd/WebHome][Proof-Xrootd]] --- * Site Admin External Links * [[http://www.atlasgrid.bnl.gov/dcache/manuals/][dCache]] * [[http://grid.racf.bnl.gov/GUMS/][GUMS]]
 
Powered by TWiki *
*
*
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback