r3 - 25 May 2010 - 14:05:45 - KaushikDeYou are here: TWiki >  Admins Web > MinutesDataManageMay25

MinutesDataManageMay25

Introduction

Minutes of the US ATLAS Data Management meeting, May 25, 2010
  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (605) 715-4900, Access code: 735188; Dial *6 to mute/un-mute.

Attending

  • Meeting attendees: Charles, Bob, Shawn, Saul, Wensheng, Armen, John, Hiro
  • Apologies: Wei, Patrick
  • Guests:

Topics for this week

  • Space status - Armen, Kaushik
    • We are running short of space everywhere
    • Future number of copies have been reduced for all US Tier 2's (see RAC minutes) - should reduce rate by at least factor of 2 (upto 3.5 for DESD's)
    • BNL free space at main space tokens - DATADISK: 70TB (+50), MCDISK: 300TB, SCRATCHDISK: 50TB, USERDISK: 25TB, GROUPDISK: 10TB
    • 100 TB dark data on DATADISK - Armen following up
    • SCRATCHDISK filling up fast - ADC will implement quotas, but software not ready
    • T2-s free space DATADISK/MCDISK - AGLT2 16TB/30TB, MWT2: 47TB/13TB, NET2: 8TB/10TB, SLAC: 40TB, SWT2: 45TB
    • US sites feel helpless - need to discuss better automatic deletion mechanisms with ADC
    • Saul will help Kaushik figure out what can be deleted right now!
  • USERDISK deletions - Hiro
    • 2 months policy needs changing? Let's wait.
    • Hiro will make a page with top 10 user at every site.
    • Hiro - still continuing with cleaning last years files
  • Data deletions - Armen, Wensheng
    • Continuing to delete based on lists made by Kaushik
    • Wensheng - will try to make list of duplicate datasets on USERDISK, SCRATCDISK and GROUPDISK in the US
  • Slow transfers to Tier 2's - Hiro
    • SLAC and SW
  • Hot issues
    • Hiro looking for dark files on MCDISK and DATADISK at BNL
    • Need to automatically delete empty datasets older than 2 weeks - Charles will look into making script
    • Wensheng - checksum by pilot at AGLT2, needs to update glite, Shawn/Bob will look into it
    • Shawn - why incomplete datasets on HOTDISK? Will follow up
  • AOB
    • Action item - delete-obsolete. Tier 2's will try. Armen - study the dump of what was deleted.
    • Action item - Kaushik will follow up on topic of making all US sites consistent with long/short names in LFC


-- KaushikDe - 24 May 2010

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback