r3 - 05 Jun 2013 - 16:10:49 - ArmenVartapetianYou are here: TWiki >  Admins Web > MinutesJun4DataManage2013



Minutes of the US ATLAS Data Management meeting, June 4, 2013

  • Previous meetings and background : IntegrationProgram
  • Coordinates: Tuesdays, Noon Central
    • (605) 475-6150, Access code: 735188; Dial *6 to mute/un-mute.


  • Meeting attendees: Dave, Patrick, Saul, Sarah, Armen
  • Apologies: Michael, Kaushik
  • Guests:

Topics for this week

  • Dark data - how much dark data is there in facility, and by which areas. Some is expected, but how much, and how much capacity are we wasting?
    • discussed status with dark data, particularly for userdisk
    • possibility of using only storage information for userdisk, and cleaning all the stuff created before a cutoff time
    • some results from AGLT2 and NET2 and discussion of the results
    • looking forward for storage analysis in other sites
    • discussed possible sources of dark data
  • GROUPDISK usage - how much if this data is still in use? Is it actively being managed? Are there quota limitations on some groups?
    • new groupdisk quotas for 2013 are out
    • quite different quota numbers for different sites. Possible factors influencing them, understand all. The dynamics and our position moving forward.
    • groupdisk quota for NET2 too low.
  • LOCALGROUPDISK - are we using it effectively at all Tier 2s?
    • No final usage policy for localgroupdisks
    • Discussion on the current situation in various sites (last year and currently)
    • Will do analysis on MWT2_UC_LOCALGROUPDISK as the one having big size
  • PRODDISK clean-ups - best current methods
    • Usage of proddisk cleaning script, taking into account the factor with pileup production and possible use of the longer cutoff times in the cleanup script
  • USERDISK clean-ups
    • Schedule another cleanup very soon
  • Hot issues
    • NET2 status with deletion, looks good. Still need some small amount of error cleanup to be done in central deletion system (not specific to NET2, not serious). Probably will be finished today. After that will consider closing the savannah ticket and ask for putting back the data distribution for NET2.
  • AOB

-- ArmenVartapetian - 03 Jun 2013

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback