r2 - 21 Mar 2008 - 13:51:26 - RobertGardnerYou are here: TWiki >  Admins Web > DataPlacementMinutesMar21



Meeting to discuss an interim plan for data placement - management of AOD replications, user requests, etc.
  • Friday, March 21, 1pm EST
  • (605) 475-6000, Access code: 735188
  • Attending: Michael, Kaushik, Hiro, Wensheng, Rob


  • Discussion points, see: Presentation1.ppt
  • Try to improve the replication exercises T1-->T2
  • Take scripts from Alexei and create new monitoring pages by release number.
  • We control replication with the BNL cloud. Process will be: Kaushik will provide scientific oversight of which datasets need replicating. Send these high level requests to the team of Hiro and Wensheng who will manage the replication within the cloud.
  • Hiro is already creating a website that focuses on T1-->T2, but including troubleshooting detail, and automatically re-scanning. Hope to have prototype by Wednesday's meeting. Kaushik will send an initial list of datasets for replication.
  • One issue is how to aggregate views - how to handle very large datasets.
  • Will revisit the issue of dataset deletion. User datasets will be implemented so that they can be managed from pathena.
  • Discussed a fully automated system for managing holes - for the development project. Not practical for site admins to track down missing files by visually scanning webpages. Need for automation.
  • As part of the interim project, Hiro will send test subscriptions to each site, and will provide a manual deletion script that sites can cron.
  • Agreed we would view how the system evolves and revisit if necessary for features/changes.

-- RobertGardner - 19 Mar 2008

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


ppt Presentation1.ppt (29.0K) | RobertGardner, 21 Mar 2008 - 13:43 | discussion points
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback