r4 - 13 May 2009 - 14:04:04 - WeiYangYou are here: TWiki >  Admins Web > MinutesDataManageMay12



Minutes of the US ATLAS Data Management meeting, May12, 2009
  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (309) 946-5300, Access code: 735188; Dial *6 to mute/un-mute.


  • Meeting attendees: Wei, Saul, Bob, John, Armen, Patrick, Shawn, Charles, Hiro, Wensheng, Pedro
  • Apologies:
  • Guests: None

Topics for this week

  • BNL dcache upgrade status - Pedro
    • still on-going
  • DQ2 upgrades - All
    • All sites fine (except Wisc)
    • Staging request is very fast (10k in few minutes) - Hiro following up with developers
    • Status checking (polling) by DQ2 is very aggressive, every second - Hiro discussing with developers
  • BNL checksum problems - Hiro, Wensheng
    • Many bug reports - mainly due to problem with two thumpers (discussed previously)
    • Hiro working on cleaning up (scanning done) - few days, starting tomorrow
    • If there are urgent datasets, send email to Hiro
  • Missing files at BNL - Hiro, Wensheng
    • Mostly junk files (ccrc, test etc - cleaned these up)
    • Still 300k files missing, 2/3rd DATADISK, maybe central deletion (Hiro will check his deletion logs)
    • Need list - followup next week
  • SCRATCHDISK deployment
    • Problem for XRootD? sites - name of SCRATCHDISK too long. New release (end of month) will have fix. SWT2, SLACT2 waiting.
  • Hot issues
    • Chimera update at AGLT2 - broke checksum validation by DQ2, may be difficult to solve
    • Central deletion - too much latency between LFC and storage deletion, some files getting left behind (Wei - found 109 out of 230k files were missed), some getting resubscribed before storage deletion (seen at AGLT2)
    • Kaushik - requested no latency (synchronized deletion) and longer time frame for monitoring from DQ2 developers
  • AOB
    • Sites often resubscribe to fill holes (missing files) - can this cause collisions with ADC ops?
    • Sometimes dataset replicas are not registered (central catalog is missing location) - Hiro will followup

-- KaushikDe - 12 May 2009

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback