Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Streaming Data from Experimental Facilities to Supercomputers for Real-Time Data Processing

Conference ·

In this paper we demonstrate direct data streaming from instruments and detectors at a large-scale experimental facility to a supercomputer for real-time data processing and feedback. Streaming data to supercomputers introduces the potential for novel scientific applications and workflow models, including the ability to provide real-time feedback from very large datasets during an experiment and the integration of real-time ML training and inference at scale. We discuss a successful demonstration for real-time processing of data from the Advanced Photon Source (APS) on the Polaris supercomputer using an EPICS-based streaming framework. We describe the capabilities of the streaming framework itself, and outline the architecture that allows us to process experimentally derived data on a supercomputer without file-based data transfers. We present throughput measurements that are indicative of system performance capable of sustaining the expected data production rates of the facility, as well as discuss some outstanding challenges and our future directions.

Research Organization:
Argonne National Laboratory (ANL), Argonne, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), Basic Energy Sciences (BES)
DOE Contract Number:
AC02-06CH11357
OSTI ID:
2246622
Resource Relation:
Conference: 5th Annual Workshop on Large-scale Experiment-in-the-Loop Computing in conjunction with SC23 The International Conference for High Performance Computing, Networking, Storage and Analysis - (Denver, CO, US, 11/12/23-11/17/23), 11/12/23 - 11/12/23, Denver, CO, US
Country of Publication:
United States
Language:
English

References (12)

Bridging Data Center AI Systems with Edge Computing for Actionable Information Retrieval conference November 2021
The experimental physics and industrial control system architecture: past, present, and future
  • Dalesio, Leo R.; Hill, Jeffrey O.; Kraimer, Martin
  • Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 352, Issue 1-2 https://doi.org/10.1016/0168-9002(94)91493-1
journal December 1994
Linking scientific instruments and computation: Patterns, technologies, and experiences journal October 2022
Deep learning at the edge enables real-time streaming ptychographic imaging journal November 2023
APS Data Management System journal August 2018
Real-time streaming tomographic reconstruction with on-demand data capturing and 3D zooming to regions of interest journal April 2022
PvaPy: Python API for EPICS PV Access text January 2015
Software as a service for data scientists journal February 2012
Globus Online: Accelerating and Democratizing Science through Cloud-Based Services journal May 2011
Channel access: A software bus for the LAACS journal August 1990
Artifact identification in X-ray diffraction data using machine learning methods journal January 2023
The Upgrade of the Advanced Photon Source text January 2018

Similar Records

Near real-time streaming analysis of big fusion data
Journal Article · 2022 · Plasma Physics and Controlled Fusion · OSTI ID:1855219