r2 - 26 May 2009 - 13:57:57 - KaushikDeYou are here: TWiki >  Admins Web > MinutesDataManageMay26



Minutes of the US ATLAS Data Management meeting, May 26, 2009
  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (309) 946-5300, Access code: 735188; Dial *6 to mute/un-mute.


  • Meeting attendees: Armen, Rob, Charles, Saul, Patrick, Wei, Pedro, Michael, Shawn, Bob, Wensheng, John
  • Apologies:
  • Guests: None

Topics for this week

  • Space cleanup for STEP09 - Armen, Charles, Hiro
    • All ESD's have been cleaned by ADC operations from US Tier 2's
    • DATADISK ~15TB used at all Tier 2's according to DQ2 accounting (Kaushik checked AGLT2 and SWT2 with script - agrees)
    • AGLT2 shows discrepancy - DQ2 reports ~15TB, SRM reports 40TB (used to be 70TB last week), Shawn sees 50TB used
    • Slow deletion or dark data? - Shawn will check
    • MWT2 shows opposite discrepancy - DQ2 says 85TB, srm says 15TB? - Charles will check
    • Kaushik will provide required space to all Tier 2's
    • Action item - cleaning up non space token areas at Tier 2's (Charles - dq2-delete-replicas does not work with containers?)
  • Obsolete dataset cleanup - Charles, Armen
    • Starting with obsolete dataset list, check on LFC (can also check storage), then delete
    • Cleaned up 10TB at UC, going slowly at IU
    • Try at AGLT2 next, then SLAC
    • Armen - bulkdelete has bug (did not remove record from LFC). Charles is not using this.
    • Proceed cautiously when we try this at BNL
  • BNL checksum problems (and missing files) - Hiro
    • Cleaned and resubscribed
  • SCRATCHDISK deployment
    • Problem for XRootD? sites - name of SCRATCHDISK too long. New release (end of month) will have fix. SWT2, SLACT2 waiting.
  • Hot issues
    • Wei - directory structure under PRODDISK is too flat, all _sub directories in same directory, Kaushik needs to follow up
    • Charles - we should have common library for this, so DQ2, pandamover, pilot, scripts can all follow same convention
    • Shawn - Tigren provided java script to get adler32 for Chimera, will continue to look for other solution
  • AOB

-- KaushikDe - 26 May 2009

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback