r2 - 03 Nov 2009 - 13:54:04 - KaushikDeYou are here: TWiki >  Admins Web > MinutesDataManageNov3

MinutesDataManageNov3

Introduction

Minutes of the US ATLAS Data Management meeting, Nov. 3, 2009
  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (605) 715-4900, Access code: 735188; Dial *6 to mute/un-mute.

Attending

  • Meeting attendees: Bob, John, Wei, Armen, Michael, Charles, Patrick
  • Apologies:
  • Guests:

Topics for this week

  • UAT09 post mortem
    • AGLT2 - only 30 dedicated, rest shared. So, slow to ramp up.
    • MWT2 - had to increase nqueue. Not keeping site full.
    • BNLT1 - could have benefitted from larger nqueue, since LONG queue was used for UAT09.
    • BNLT1 - did not see much effect from larger number of job slots. Had to tune maximum number of accesses allowed to some servers.
    • SWT2 - saw higher error rates of looping jobs with more slots. SWT2 is set up for direct access. Data server was saturated.
    • SLACT2 - also saw overload in NFS servers providing release. Saw some servers getting saturated.
    • MWT2 - aggressively provisioned 1100 slots for UAT09. Few pools got overwhelmed - older, slower ones. pcache helped with input files. Saw issues with local I/O disk contention (many jobs on same node).
    • NET2 - did not see any major issues.
    • Sites please report any issues/experiences to UAT09 Twiki.
  • Available space status - Armen
    • UAT09 datasets already being cleaned - so lots of free space everywhere now.
    • USERDISK cleaning email was sent. No complaints so far.
    • AGLT2 reporting not correct - follow up by email.
    • Space Usage at MWT2 - from Charles.
  • LOCALGROUPDISK at Tier 2's
    • New version of XRootD? deployed at SLAC, which allows longer space token name. But there are still couple of issues/problems.
    • All T2 sites need to provision this token, with access only by US ATLAS users. Minimum 5 TB, by end of year will need 40 TB per site. Hiro will monitor usage.
  • Hot issues
    • Reminder - meeting in Arlington next week. Hope to see everyone.
  • AOB


-- KaushikDe - 03 Nov 2009

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback