HEP Software Foundation Community White Paper Working Group - Data Processing Frameworks

Journal Article · Wed Dec 19 00:00:00 EST 2018 · TBD

OSTI ID:1490841

Calafiura, Paolo ^[1]; Clemencic, Marco ^[2]; Grasland, Hadrien ^[3]; Green, Chris ^[4]; Hegner, Benedikt ^[5]; Jones, Chris ^[4]; Jouvin, Michel ^[3]; Knoepfel, Kyle ^[4]; Kuhr, Thomas ^[6]; Kowalkowski, Jim ^[4]; Leggett, Charles ^[1]; Lyon, Adam  ^[4]; Malon, David ^[5]; Paterno, Marc  ^[4]; Patton, Simon ^[1]; Sexton-Kennedy, Elizabeth  ^[4]; Stewart, Graeme A ^[2]; Tsulaia, Vakho ^[1]

---

1. LBL, Berkeley
2. CERN
3. Orsay, LAL
4. Fermilab
5. Brookhaven
6. LMU Munich (main)

Data processing frameworks are an essential part of HEP experiments' software stacks. Frameworks provide a means by which code developers can undertake the essential tasks of physics data processing, accessing relevant inputs and storing their outputs, in a coherent way without needing to know the details of other domains. Frameworks provide essential core services for developers and help deliver a configurable working application to the experiments' production systems. Modern HEP processing frameworks are in the process of adapting to a new computing landscape dominated by parallel processing and heterogeneity, which pose many questions regarding enhanced functionality and scaling that must be faced without compromising the maintainability of the code. In this paper we identify a program of work that can help further clarify the key concepts of frameworks for HEP and then spawn R&D activities that can focus the community's efforts in the most efficient manner to address the challenges of the upcoming experimental program.

• Research Organization: Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States); Brookhaven National Lab. (BNL), Upton, NY (United States); Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP)
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 1490841
• Report Number(s): HSF-CWP-2017-08; arXiv:1812.07861; FERMILAB-PUB-18-693-CD; 1710054
• Journal Information: TBD, Journal Name: TBD
• Country of Publication: United States
• Language: English

Related Subjects

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS