skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: ROOT I/O compression improvements for HEP analysis

Abstract

We overview recent changes in the ROOT I/O system, increasing performance and enhancing it and improving its interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly to improve experiment's software performance. The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased during the LHC era. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly: there are significant trade-offs between the increased CPU cost for reading and writing files and the reduce storage space.

Authors:
ORCiD logo [1]; ORCiD logo [2];  [3];  [1];  [4]
  1. U. Nebraska, Lincoln
  2. Fermilab
  3. CERN
  4. Unlisted, US, MA
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP)
OSTI Identifier:
1656647
Report Number(s):
arXiv:2004.10531; FERMILAB-CONF-20-308-SCD
oai:inspirehep.net:1792200
DOE Contract Number:  
AC02-07CH11359
Resource Type:
Conference
Resource Relation:
Conference: 24th International Conference on Computing in High Energy and Nuclear Physics, Adelaide, Australia, 11/04-11/08/2019
Country of Publication:
United States
Language:
English

Citation Formats

Shadura, Oksana, Canal, Philippe, Piparo, Danilo, Zhang, Zhe, and Bockelman, Brian Paul. ROOT I/O compression improvements for HEP analysis. United States: N. p., 2020. Web.
Shadura, Oksana, Canal, Philippe, Piparo, Danilo, Zhang, Zhe, & Bockelman, Brian Paul. ROOT I/O compression improvements for HEP analysis. United States.
Shadura, Oksana, Canal, Philippe, Piparo, Danilo, Zhang, Zhe, and Bockelman, Brian Paul. Wed . "ROOT I/O compression improvements for HEP analysis". United States. https://www.osti.gov/servlets/purl/1656647.
@article{osti_1656647,
title = {ROOT I/O compression improvements for HEP analysis},
author = {Shadura, Oksana and Canal, Philippe and Piparo, Danilo and Zhang, Zhe and Bockelman, Brian Paul},
abstractNote = {We overview recent changes in the ROOT I/O system, increasing performance and enhancing it and improving its interaction with other data analysis ecosystems. Both the newly introduced compression algorithms, the much faster bulk I/O data path, and a few additional techniques have the potential to significantly to improve experiment's software performance. The need for efficient lossless data compression has grown significantly as the amount of HEP data collected, transmitted, and stored has dramatically increased during the LHC era. While compression reduces storage space and, potentially, I/O bandwidth usage, it should not be applied blindly: there are significant trade-offs between the increased CPU cost for reading and writing files and the reduce storage space.},
doi = {},
url = {https://www.osti.gov/biblio/1656647}, journal = {},
number = ,
volume = ,
place = {United States},
year = {2020},
month = {4}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: