r2 - 14 Oct 2008 - 12:32:24 - MaximPotekhinYou are here: TWiki >  AtlasSoftware Web > PandaExtensionsPlans

Panda Workload Management Extensions: Plans


Workload Management Plans and Milestones

Major milestones are in bold.

2006

Delivery date Description Effort funded by Status
Sep 1 2006 First planning meeting for OSG just-in-time WMS at FNAL (pilot management via factory-based submission to sites) ATLAS, OSG Done
Sep 1 2006 Define initial BNL manpower for pilot factory effort: Barnett Chiu assisted by Torre Wenaus ATLAS Done
Sep 7 2006 Define and initiate prototyping program for Panda generalization to support non-ATLAS usage: TestPilot ATLAS Done
Sep 15 2006 Establish Condor testbed at BNL for pilot factory work ATLAS Done
Oct 16 2006 Demonstrate Panda pilot operation and job processing on generic OSG, LCG sites (no ATLAS specificity) ATLAS Done
Oct 16 2006 Demonstrate ATLAS analysis (pathena) operation on generic OSG, LCG sites ATLAS --
Oct 16 2006 Provide framework for Panda-based execution of non-ATLAS VO workload on generic OSG ATLAS Done
Oct 30 2006 Demonstrate Panda-based execution of non-ATLAS VO workload on generic OSG ATLAS  

2007

Delivery date Description Effort funded by Status
Nov 1 2007 Draft Panda/Condor integration phase 1 (IP1) plan in place (Glide-in based pilot factory) ATLAS, OSG, Condor Done
Dec 7 2007 2nd planning meeting for OSG workload management extensions (at UT Arlington); finalize IP1 plan OSG Done
Dec 14 2007 Final IP1 plan and milestones -- cf Arlington ATLAS, OSG, Condor Done
Jan 1 2007 Dedicated BNL hire(s) for OSG extensions program OSG  
Feb 1 2007 Functionality and performance assessments for Condor-G and Condor glide-in done, with requests fed back to Condor ATLAS, OSG  
Mar 1 2007 Deployment of prototype experiment-neutral Panda as prototype OSG service. In use by CHARMM ATLAS, OSG Done
Mar 1 2007 OSG authentication infrastructure integration based on glexec -- depends on availability OSG  
May 1 2007 Support deployment of OSG just in time workload management for ATLAS production, analysis ATLAS, OSG  
Jun 15 2007 ATLAS validation of OSG extensions in full-chain production challenge ATLAS  
Jul 1 2007 Production deployment of experiment-neutral Panda as supported general OSG service OSG, ATLAS  
Sep 1 2007 Deliver Panda/Condor integration phase 1 (IP1) OSG, ATLAS  
Nov 1 2007 IP1 validated for deployment OSG, ATLAS  
Nov 30 2007 Workload and data management extension performance baseline documentation completed    
Dec 1 2007 IP1 deployed and in production on OSG OSG, ATLAS  

2008

Delivery date Description Effort funded by Status
Feb 1 2008 IP2 plan, milestones, deliverabled defined OSG Done
Sep 1 2008 Deliver Panda/Condor integration phase 2 (IP2) OSG, ATLAS Done
Nov 1 2008 IP2 validated for deployment OSG, ATLAS Done
Dec 1 2008 IP2 deployed and in production on OSG OSG, ATLAS Done

Program for 2009 and beyond

  • Iterative development with lessons from production deployment, OSG community feedback
  • Ongoing middleware evaluation and feedback
  • Integration of newly matured and validated middleware
  • Scaling in support of scale-up by science communities
  • Shift emphasis to hardening and support from integration/development

Major updates:
-- MaximPotekhin - 14 Oct 2008

About This Site

Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.


Attachments

 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback