Next Generation Workload Management and Analysis System for Big Data
We report on the activities and accomplishments of a four-year project (a three-year grant followed by a one-year no cost extension) to develop a next generation workload management system for Big Data. The new system is based on the highly successful PanDA software developed for High Energy Physics (HEP) in 2005. PanDA is used by the ATLAS experiment at the Large Hadron Collider (LHC), and the AMS experiment at the space station. The program of work described here was carried out by two teams of developers working collaboratively at Brookhaven National Laboratory (BNL) and the University of Texas at Arlington (UTA). These teams worked closely with the original PanDA team – for the sake of clarity the work of the next generation team will be referred to as the BigPanDA project. Their work has led to the adoption of BigPanDA by the COMPASS experiment at CERN, and many other experiments and science projects worldwide.
- Research Organization:
- Univ. of Texas, Arlington, TX (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR)
- DOE Contract Number:
- SC0008635
- OSTI ID:
- 1352908
- Report Number(s):
- DOE-UTA-8635-1
- Country of Publication:
- United States
- Language:
- English
Similar Records
Accelerating Science Impact through Big Data Workflow Management and Supercomputing
BigPanDA: PanDA Workload Management System and its Applications beyond ATLAS