r5 - 20 Jul 2009 - 13:58:10 - KaushikDeYou are here: TWiki >  Admins Web > MinutesDataManageJul14



Minutes of the US ATLAS Data Management meeting, July 14, 2009
  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (309) 946-5300, Access code: 735188; Dial *6 to mute/un-mute.


  • Meeting attendees: Saul, Rob, Armen, Charles, Pedro, Hiro, Bob, Wensheng
  • Apologies: John, Michael
  • Guests:

Topics for this week

  • Corrupted files at AGLT2 - Shawn, Bob
    • Bob - same problem as back in April, NIC caused corruption
    • Hiro - jobs will fail in transferring, after a few retries
    • Charles will help AGLT2 to set up lsm (local site mover) so that this kind of error is caught locally by pilot
  • pcache update - Charles
    • Implemented through lsm-get (currently running at UC, IU and Glasgow)
    • pcache.pdf: Notes on pcache
  • Tier 2 storage reporting - Armen
    • Space reported was wrong if more space was used than allocated, as it should be, at XrootD? sites
    • Proposal to provide only total available storage, rather than by space token for sites which have soft limit
  • Obsolete dataset cleanup
    • Charles - new script to clean up a dataset or list of datasets is ready, Wei is testing
    • Charles - also new version of cleanse is available
    • Deletion of obsolete datasets at BNL is ongoing - Hiro
  • Hot issues
    • Saul - datasets at NET2 which are complete in DDM, are missing a few files
    • Hiro - this can only happen if someone deletes the files
    • Action item - run Charles ccc at all Tier 2 sites, and look at results, to decide if we need to take this issue up with DQ2 team
    • Hiro - migration to SCRATCHDISK? Postponed till next week
  • AOB
    • Good news from Pedro - new storage is here, will get 118 TB in next couple of days
    • Total at BNL will be ~4 PB when this additional 1.5PB is fully installed

-- KaushikDe - 14 Jul 2009

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


pdf pcache.pdf (58.7K) | CharlesWaldman, 14 Jul 2009 - 13:50 | Notes on pcache
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback