skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

This content will become publicly available on May 23, 2020

Title: Data Management at the Advanced Photon Source

Abstract

Data are crucial to the scientific discoveries enabled by experiments performed at the APS. Presently the APS generates approximately 10 PB of raw experimental data per year from its sixty-six operating beamlines that house over 100 unique instruments. This data is generated as a part of over 6,000 annual experiments performed by over 5,500 facility users each year. Similar to other synchrotrons, the amount of data generated at the APS continues to quickly increase due to beamline advances, such as new measurement techniques, technological advances in detectors, high-throughput instrumentation, multi-modal instruments that can acquire several measurements in a single experiment, and advanced data processing algorithms. This trend is expected to continue in the future. The revolutionized high-energy synchrotron facility proposed in the APS-U project will increase brightness and coherence, leading to further increases in data rates. Successful management of data is of vital importance to the current and future scientific productivity of the APS.

Authors:
 [1];  [1];  [1]
  1. Argonne National Lab. (ANL), Lemont, IL (United States)
Publication Date:
Research Org.:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1547296
Grant/Contract Number:  
AC02-06CH11357
Resource Type:
Accepted Manuscript
Journal Name:
Synchrotron Radiation News
Additional Journal Information:
Journal Volume: 32; Journal Issue: 3; Journal ID: ISSN 0894-0886
Publisher:
Taylor & Francis
Country of Publication:
United States
Language:
English
Subject:
96 KNOWLEDGE MANAGEMENT AND PRESERVATION

Citation Formats

Schwarz, Nicholas, Veseli, Siniša, and Jarosz, Dariusz. Data Management at the Advanced Photon Source. United States: N. p., 2019. Web. doi:10.1080/08940886.2019.1608120.
Schwarz, Nicholas, Veseli, Siniša, & Jarosz, Dariusz. Data Management at the Advanced Photon Source. United States. doi:10.1080/08940886.2019.1608120.
Schwarz, Nicholas, Veseli, Siniša, and Jarosz, Dariusz. Thu . "Data Management at the Advanced Photon Source". United States. doi:10.1080/08940886.2019.1608120.
@article{osti_1547296,
title = {Data Management at the Advanced Photon Source},
author = {Schwarz, Nicholas and Veseli, Siniša and Jarosz, Dariusz},
abstractNote = {Data are crucial to the scientific discoveries enabled by experiments performed at the APS. Presently the APS generates approximately 10 PB of raw experimental data per year from its sixty-six operating beamlines that house over 100 unique instruments. This data is generated as a part of over 6,000 annual experiments performed by over 5,500 facility users each year. Similar to other synchrotrons, the amount of data generated at the APS continues to quickly increase due to beamline advances, such as new measurement techniques, technological advances in detectors, high-throughput instrumentation, multi-modal instruments that can acquire several measurements in a single experiment, and advanced data processing algorithms. This trend is expected to continue in the future. The revolutionized high-energy synchrotron facility proposed in the APS-U project will increase brightness and coherence, leading to further increases in data rates. Successful management of data is of vital importance to the current and future scientific productivity of the APS.},
doi = {10.1080/08940886.2019.1608120},
journal = {Synchrotron Radiation News},
number = 3,
volume = 32,
place = {United States},
year = {2019},
month = {5}
}

Journal Article:
Free Publicly Available Full Text
This content will become publicly available on May 23, 2020
Publisher's Version of Record

Save / Share:

Works referenced in this record:

Towards Integrated Facility-Wide Data Acquisition and Analysis at NSLS-II
journal, March 2017


APS Data Management System
journal, August 2018

  • Veseli, Siniša; Schwarz, Nicholas; Schmitz, Collin
  • Journal of Synchrotron Radiation, Vol. 25, Issue 5
  • DOI: 10.1107/S1600577518010056

Linac Coherent Light Source data analysis using psana
journal, March 2016

  • Damiani, D.; Dubrovin, M.; Gaponenko, I.
  • Journal of Applied Crystallography, Vol. 49, Issue 2
  • DOI: 10.1107/S1600576716004349

Data systems for the Linac Coherent Light Source
journal, July 2016


Globus Online: Accelerating and Democratizing Science through Cloud-Based Services
journal, May 2011


Software as a service for data scientists
journal, February 2012

  • Allen, Bryce; Pickett, Karl; Tuecke, Steven
  • Communications of the ACM, Vol. 55, Issue 2
  • DOI: 10.1145/2076450.2076468

Data management and processing workflow for the Materials Physics and Engineering group beamlines at the Advanced Photon Source
journal, February 2019

  • Park, Jun-Sang; Horn, Connor; Ramanathan, Prithvi
  • Journal of Synchrotron Radiation, Vol. 26, Issue 2
  • DOI: 10.1107/S1600577519000584