Edit this page
r13 - 22 Jan 2009 - 15:49:51 - JohnDeStefanoYou are here: TWiki >  Admins Web > LoadTestsP3

LoadTestsP3

Introduction

Results from previous phases:

General load testing activity in this Phase

  • Continue setting up sites and performing tests in LoadTestsP2
  • Measure iperf ceilings for each site
  • Complete network tunings as in NetworkPerformanceP2
  • Optimize dCache service tunings at BNL, UC, AGLT2

Load test framework deliverables

  • Optimize scheduling for measurement tests to provide meaningful results of throughput performance.
  • Continue plotting adjustments (selection of quantities, scale, labels) in Monalisa to provide best views for facility peformance monitoring.
  • Provide ability to adjust number of streams, payloads (file size, number of files), concurrent transfers.
  • Provide an easily viewable web display of selected Monalisa plots/views
  • Produce a table showinghttps://www.usatlas.bnl.gov/twiki/bin/edit/Admins/LoadTestsP3?t=1201626472 each storage system endpoint for each Tier-2. Should include Host, Directory, Network Link, Read-Speed, Write-Speed.

Storage Endpoint Table

This should be filled out by EACH Tier-2 site. List all used storage endpoints and their relevant information. For the Read and Write you should provide a link to the measurement details, either a web page describing the tests and results or a figure showing the results. Make sure the "Big" testing uses files > 2X the size of the physical memory.

Wenjing can you produce a web page which describes how to run the Read/Write tests by 'time dd' and IOZone and link it here?

Site Host Directory Size(TB) ReadBig WriteBig Read(132MB) Write(132MB)
BNL acas0014.usatlas.bnl.gov /data/dcache_pool_1/pool/test 1TB 29MB/s 54MB/s 150MB/s 270MB/s
BNL acas0600.usatlas.bnl.gov /data/dcache_pool_1/pool/test 400GB        
AGLT2_MSU msufs01.aglt2.org /export/vdisk_{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_MSU msufs02.aglt2.org /export/vdisk_{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_MSU msufs03.aglt2.org /export/vdisk_{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_MSU msufs04.aglt2.org /export/vdisk_{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_MSU msufs05.aglt2.org /export/vdisk_{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_UM umfs01.grid.umich.edu /data07 4.4TB 303MB/s 312MB/s 682MB/s 2471MB/s
AGLT2_UM umfs02.grid.umich.edu /atlas/data08 11TB 129MB/s 250MB/s 338MB/s 872MB/s
AGLT2_UM umfs03.aglt2.org /atlas/data13 16TB 498MB/s 653MB/s 681MB/s 1645MB/s
AGLT2_UM umfs04.aglt2.org /atlas/data14 16TB 430MB/s 487MB/s 605MB/s 1267MB/s
AGLT2_UM umfs05.aglt2.org /atlas/data16 20TB 271MB/s 688MB/s 873MB/s 2407MB/s
AGLT2_UM umfs06.aglt2.org /atlas/data17{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_UM umfs07.aglt2.org /atlas/data17{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_UM umfs08.aglt2.org /atlas/data19{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_UM umfs09.aglt2.org /atlas/data22{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_UM umfs10.aglt2.org /atlas/data22{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
AGLT2_UM umfs11.aglt2.org /atlas/data22{a,b} 20TB 390MB/s 800MB/s 973MB/s 2658MB/s
OU_OCHEP_SWT2 tier2-01.ochep.ou.edu /ibrix/data/dq2-cache/test 12TB 200MB/s 100MB/s 200MB/s 100MB/s
OU_OCHEP_SWT2 tier2-02.ochep.ou.edu /ibrix/data/dq2-cache/test 12TB 200MB/s 100MB/s 200MB/s 100MB/s

IOTest Instructions IOTest Instructions .

Target benchmarks

Establish the following benchmarks for tansfers between BNL and Tier2 centers:
  • Memory-to-memory (iperf): >950 Mbps (1 Gpbs links), > 8000 Mbps (10 Gpbs links)
  • Writing (standard "dataset" payload-type): > 110 MB/s sustained over 10 minutes (72 GB) for a 1 Gbps link
  • Reading (standard "dataset" payload-type): > 100 MB/s sustained over 10 minutes for a 1 Gpbs link

-- RobertGardner - 17 Oct 2007

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback