Open Science Grid middleware extensions activity at BNL

Program overview

The Open Science Grid (OSG) is a consortium that was awarded funding as a follow-on to the Particle Physics Data Grid (PPDG) and other US grid projects, with the broadened objectives of establishing a US computing grid infrastructure serving LHC and other application science needs, and integrating this US infrastructure with international grids such as the Worldwide LHC Computing Grid (WLCG).

The OSG work program is in two principal areas: providing an open distributed computing facility through computing center collaboration and a common middleware foundation, and secondly, extending OSG capability through targeted, science-driven software tools augmenting the foundation middleware that are required by LHC and other demanding science applications. BNL is involved in OSG through ATLAS and STAR and is participating in both OSG activity areas. BNL focus topics in the facility area are in security systems and mass storage interfaces. In the software extensions area we focus principally on workload management and distributed data management and storage issues. The high level BNL tasks are

1. Provide distributed production and data management services at BNL and among US ATLAS collaborating institutions, coherently with international ATLAS via integration with CERN and WLCG services.
2. Provide distributed data management services for STAR between BNL and LBNL.
3. Augment these production-oriented job and data management services with support for ATLAS and STAR distributed analysis.

The purpose of the software component of this effort is to

• work with OSG participants and collaborating projects (particularly Condor) in developing a workload management system supporting US ATLAS distributed production/analysis and wider OSG use, based primarily on integration of existing Condor and experiment software
• support the integration, deployment and operation of this system for ATLAS
• provide support and maintenance of this system for OSG users
• participate in the leadership of the extensions area of OSG

Program Components

• OSG extensions program in Workload Management
  • Pilot submission for non-Atlas VOs
  • Data hosting service for non-Atlas VOs
  • Application of Panda to OSG Integration Testbed
• Pilot Framework Security Program
• OSG-wide program in storage systems (not just BNL)

Current Staff Schedule

High level milestones