r2 - 01 Jun 2010 - 13:55:27 - KaushikDeYou are here: TWiki >  Admins Web > MinutesDataManageJun1

MinutesDataManageJun1

Introduction

Minutes of the US ATLAS Data Management meeting, June 1, 2010
  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (605) 715-4900, Access code: 735188; Dial *6 to mute/un-mute.

Attending

  • Meeting attendees: Wei, Armen, Shawn, Wensheng, Bob, John, Saul, Patrick, Charles, Michael
  • Apologies: Hiro
  • Guests:

Topics for this week

  • Space status - Armen, Kaushik
    • We are running short of space everywhere
    • New data distribution plan being discussed in ADC - it will be tried in US first
      • US Tier 2's will get data when users need it, Panda will make subscriptions, rather than AKTR sending copies of all data irrespective of popularity
      • All US sites like this plan - we would like the maximum number of copies, for very popular datasets to be more than 2
    • BNL: looks OK, 400 TB free on MCDISK, 300 TB free on DATADISK, Pedro/Armen will check logs if deletion is missing some files
    • MWT2: OK. Charles - trying something new, a cron which balances distribution among tokens, make all space tokens have same fraction of free space
    • AGLT2: relatively OK. Shawn - 160 TB free, 100 TB cleaned during the weekend, which helped.
    • Saul - NET2: dramatically improved. Expect new storage ~3 weeks. Armen - still some dark data.
    • Wei - SLACT2: only 29 TB left, FTS stopped. Need more central deletion. Armen - see 20 TB dark data. Wei - will run consistency check.
    • Patrick - SWT2: 40 TB free, can free up another 40 TB, can add 200 TB this week, another 200 TB in few weeks
  • USERDISK deletions - Hiro
    • Armen - helped a lot with BNL, Tier 2's in progress
  • DATADISK/MCDISK deletions - Armen, Wensheng
    • Going well.
  • Slow transfers to Tier 2's - Hiro
  • Hot issues
  • AOB
    • Action item - Hiro looking for dark files on MCDISK and DATADISK at BNL
    • Action item - Need to automatically delete empty datasets older than 2 weeks - Charles will look into making script
    • Action item - checksum by pilot at AGLT2, needs to update glite, Shawn/Bob will look into it. Done.
    • Action item - why incomplete datasets on HOTDISK? Shawn will follow up. OK - only new datasets. Done.
    • Action item - delete-obsolete. Tier 2's will try. Armen - study the dump of what was deleted. Everything looks ok. Done.
    • Action item - Kaushik will follow up on topic of making all US sites consistent with long/short names in LFC


-- KaushikDe - 01 Jun 2010

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback