r2 - 18 Sep 2013 - 01:14:41 - ArmenVartapetianYou are here: TWiki >  Admins Web > MinutesSep17DataManage2013



Minutes of the US ATLAS Data Management meeting, September 17, 2013

  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (605) 475-6150, Access code: 735188; Dial *6 to mute/un-mute.


  • Meeting attendees: Bob, Saul, Wei, Dave, Sarah, Patrick, Hiro, Kaushik, Armen
  • Apologies: Shawn
  • Guests:

Topics for this week

  • Storage Status -
    • Overall space situation and storage reporting looks OK.
    • Change of replication policies for primary data in T1/T2 datadisks. Primary replicas created before 2013/01/01, not used after 2013/01/01, having a replica on TAPE were declared secondary. Positive effect can already be seen as cleanup is in progress for datadisks.
    • DQ2 client version 2.4.1 in production. Contains new tool dq2-list-parent-datasets , which returns dataset(s) for given SURL or GUID.
  • USERDISK cleanup -
    • Next round of the userdisk cleanup is in progress, notification emails went out yesterday. Cleanup date is set for Sep.27
    • From cleanup of remnant datasets in userdisks several datasets were found with "?" mark in the name. The deletion service was not able to process then. Will submit them to dq2 group for manual deletion.
  • Dark data, cleanup methods, script -
    • some recent results from NET2 and MWT2
    • Long discussion on various options on different sites to cleanup dark data in userdisk and other space tokens.
    • Have to limit the discussion at 1 hour mark, as there was a conflict with another meeting. Will need another iteration to converge on final method.
  • PRODDISK cleanup, script -
    • all sites look OK at the moment
    • clean-pm can be used for pandamover files with rucio path. Just need minimal modification to define the new location. Already used in MWT2.
  • Hot issues
  • AOB

-- ArmenVartapetian - 17 Sep 2013

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback