These pages contain information related to ASCR funded project "Next Generation Workload Management and Analysis System for Big Data".
An important foundation underlying the impressive success of ATLAS Experiment data processing and analysis is the Production and Distributed Analysis (PanDA) workload management system that was designed specifically for the ATLAS at the Large Hadron Collider (LHC) and proved to be highly successful in meeting all the distributed computing needs of the experiment. However, the core design of PanDA is not experiment specific. The PanDA workload management system is capable of meeting the needs of other data intensive scientific applications. PanDA has been used to run CHARMM protein folding code on the Open Science Grid (OSG). Several big data experiments such as Alpha-Magnetic Spectrometer (AMS, an astro-particle experiment on International Space Station) and the Compact Muon Solenoid (CMS, a LHC experiment) are considering the adoption of PanDA.
We proposed generalizing PanDA as meta-application, providing location transparency of processing and data access, for High Energy Physics, other data-intensive sciences, and a wider exascale community.
Project work packages
WP1 (Factorizing the core): Factorizing the core components of PanDA to enable adoption by a wide range of exascale scientific communities (UTA, K.De)
WP2 (Extending the scope): Evolving PanDA to support extreme scale computing clouds and Leadership Computing Facilities (BNL, S.Panitkin)
WP3 (Leveraging intelligent networks): Integrating network services and real-time data access to the PanDA workflow (BNL, D.Yu)
WP4 (Usability and monitoring): Real time monitoring and visualization package for PanDA (BNL, T.Wenaus)
Kick-off Meeting at BNL, September 24, 2012
Face to Face Meeting at BNL, November 30, 2012
Face to Face Meeting at BNL, January 28, 2013
Related Information and Activities (May require authentication)
Recent Improvements in the ATLAS PanDA Pilot. P. Nilsson et al 2012 J. Phys.: Conf. Ser. 396 032080
PanDA: Next Generation Workload Management and Analysis System for Big Data. Flyer for the International Conference for High Performance Computing, Networking, Storage and Analysis 2012, Salt Lake, UT , November 10-16, 2012. http://cdsweb.cern.ch/record/1492076
The ATLAS PanDA Monitoring System and its Evolution. 2011 J. Phys.: Conf. Ser. 331 072058, A.Klimentov, P.Nevski, M.Potekhin and T.Wenaus
PanDA Production and Analysis backend. 17th International Conference on Computing in High Energy and Nuclear Physics (CHEP09), March 2009. Journal of Physics vol. 219, 210. K.De, A.Klimentov, T.Maeno, P.Nilsson and T.Wenaus
PanDA : Distributed Production and Distributed Analysis System for ATLAS. T.Maeno et al. Journal for Physics vol. 119 part 6, 2008
Please note that this site is a content mirror of the BNL US ATLAS TWiki. To edit the content of this page, click the Edit this page button at the top of the page and log in with your US ATLAS computing account name and password.