skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: APS Data Management System

Abstract

As the capabilities of modern X-ray detectors and acquisition technologies increase, so do the data rates and volumes produced at synchrotron beamlines. This brings into focus a number of challenges related to managing data at such facilities, including data transfer, near real-time data processing, automated processing pipelines, data storage, handling metadata and remote user access to data. The Advanced Photon Source Data Management System software is designed to help beamlines deal with these issues. Finally, this paper presents the system architecture and describes its components and functionality; the system's current usage is discussed, examples of its use have been provided and future development plans are outlined.

Authors:
 [1];  [1];  [1]
  1. Argonne National Lab. (ANL), Argonne, IL (United States)
Publication Date:
Research Org.:
Argonne National Lab. (ANL), Argonne, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), Basic Energy Sciences (BES) (SC-22)
OSTI Identifier:
1471503
Grant/Contract Number:  
[AC02-06CH11357]
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Synchrotron Radiation (Online)
Additional Journal Information:
[Journal Name: Journal of Synchrotron Radiation (Online); Journal Volume: 25; Journal Issue: 5]; Journal ID: ISSN 1600-5775
Publisher:
International Union of Crystallography
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; computer software; data management; data processing

Citation Formats

Veseli, Siniša, Schwarz, Nicholas, and Schmitz, Collin. APS Data Management System. United States: N. p., 2018. Web. doi:10.1107/S1600577518010056.
Veseli, Siniša, Schwarz, Nicholas, & Schmitz, Collin. APS Data Management System. United States. doi:10.1107/S1600577518010056.
Veseli, Siniša, Schwarz, Nicholas, and Schmitz, Collin. Wed . "APS Data Management System". United States. doi:10.1107/S1600577518010056. https://www.osti.gov/servlets/purl/1471503.
@article{osti_1471503,
title = {APS Data Management System},
author = {Veseli, Siniša and Schwarz, Nicholas and Schmitz, Collin},
abstractNote = {As the capabilities of modern X-ray detectors and acquisition technologies increase, so do the data rates and volumes produced at synchrotron beamlines. This brings into focus a number of challenges related to managing data at such facilities, including data transfer, near real-time data processing, automated processing pipelines, data storage, handling metadata and remote user access to data. The Advanced Photon Source Data Management System software is designed to help beamlines deal with these issues. Finally, this paper presents the system architecture and describes its components and functionality; the system's current usage is discussed, examples of its use have been provided and future development plans are outlined.},
doi = {10.1107/S1600577518010056},
journal = {Journal of Synchrotron Radiation (Online)},
number = [5],
volume = [25],
place = {United States},
year = {2018},
month = {8}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 1 work
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Real-time data-intensive computing
conference, January 2016

  • Parkinson, Dilworth Y.; Beattie, Keith; Chen, Xian
  • PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON SYNCHROTRON RADIATION INSTRUMENTATION – SRI2015, AIP Conference Proceedings
  • DOI: 10.1063/1.4952921

Towards Integrated Facility-Wide Data Acquisition and Analysis at NSLS-II
journal, March 2017


The Materials Data Facility: Data Services to Advance Materials Science Research
journal, July 2016


Linac Coherent Light Source data analysis using psana
journal, March 2016

  • Damiani, D.; Dubrovin, M.; Gaponenko, I.
  • Journal of Applied Crystallography, Vol. 49, Issue 2
  • DOI: 10.1107/S1600576716004349

Data systems for the Linac Coherent Light Source
journal, July 2016


High performance data management and analysis for tomography
conference, September 2014

  • Blair, Justin; Canon, Richard S.; Deslippe, Jack
  • SPIE Optical Engineering + Applications, SPIE Proceedings
  • DOI: 10.1117/12.2069862