r2 - 09 Jun 2009 - 14:05:26 - KaushikDeYou are here: TWiki >  Admins Web > MinutesDataManageJun9



Minutes of the US ATLAS Data Management meeting, June 9, 2009
  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (309) 946-5300, Access code: 735188; Dial *6 to mute/un-mute.


  • Meeting attendees: Bob, Shawn, Patrick, Charles, Armen, Saul, Pedro, Rob, Michael, Wensheng
  • Apologies:
  • Guests:

Topics for this week

  • STEP09 status - All
    • Pedro - yesterday problem with write pools on DATATAPE, looks ok now
    • Michael, Hiro - don't understand large backlog in DATADISK, everything looks fine in FTS, seems to be bandwidth issue (but was transferring twice as fast couple of days ago), problem started ~24 hours ago
    • Michael - puzzling, no transfers reported, but no transfer activity (KD will follow up by email)
    • Shawn - everything looks fine (will seek clarification why plots are red)
  • Available storage - Armen, all
    • Keeping eye on BNL, will add more today, have 380 TB on reserve
    • Tier 2's look OK except SLAC
  • Checksum validation in SS - All
    • SLAC, AGLT2, UC, IU soon, NET2 working on it, SWT2 worried about load on SS (looking into dataserver doing it)
    • BNL implemented locally, what to do about DATADISK/DATATAPE/AGLT2_CALIBDISK (SS running from CERN)?
    • No current solution for Tier 3? Can Chimera solution be ported?
  • Obsolete and ccrc dataset cleanup - Charles, Hiro
    • New version of cleanup script working well, tested at UC & IU, adding capability to clear up arbitrary datasets (like ccrc), tested at UC
    • Check with Stephane if ccrc datasets are declared obsolete?
    • AGLT2 - found 90k empty directories after cleanup (will try new version), and many other DQ2/DDM oddities, cleaned up ~77Tb manually over past 2 weeks, ~20TB dark data (very labor intensive)
    • Hiro - assuming Stephane deleting from BNL too?
    • Need wiki/web pages, use CERN svn - Charles will follow up
  • Hot issues
    • Hiro - please specify BNL as source if trying to recover lost files at Tier 2's
  • AOB

-- KaushikDe - 09 Jun 2009

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback