skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Real-time data-intensive computing

Abstract

Today users visit synchrotrons as sources of understanding and discovery—not as sources of just light, and not as sources of data. To achieve this, the synchrotron facilities frequently provide not just light but often the entire end station and increasingly, advanced computational facilities that can reduce terabytes of data into a form that can reveal a new key insight. The Advanced Light Source (ALS) has partnered with high performance computing, fast networking, and applied mathematics groups to create a “super-facility”, giving users simultaneous access to the experimental, computational, and algorithmic resources to make this possible. This combination forms an efficient closed loop, where data—despite its high rate and volume—is transferred and processed immediately and automatically on appropriate computing resources, and results are extracted, visualized, and presented to users or to the experimental control system, both to provide immediate insight and to guide decisions about subsequent experiments during beamtime. We will describe our work at the ALS ptychography, scattering, micro-diffraction, and micro-tomography beamlines.

Authors:
; ; ; ; ; ;  [1]; ; ; ; ; ; ;  [2]; ;  [3]; ;  [4]; ;  [5] more »; « less
  1. Advanced Light Source, Lawrence Berkeley National Laboratory, Berkeley, CA 94720 (United States)
  2. Computational Research Division, Lawrence Berkeley National Laboratory Berkeley CA 94720 (United States)
  3. National Energy Research Scientific Computing Center, Berkeley, CA 94720 (United States)
  4. Energy Sciences Network, Berkeley, CA 94720 (United States)
  5. Uppsala University, Uppsala (Sweden)
Publication Date:
OSTI Identifier:
22608429
Resource Type:
Journal Article
Resource Relation:
Journal Name: AIP Conference Proceedings; Journal Volume: 1741; Journal Issue: 1; Conference: SRI2015: 12. international conference on synchrotron radiation instrumentation, New York, NY (United States), 6-10 Jul 2015; Other Information: (c) 2016 Author(s); Country of input: International Atomic Energy Agency (IAEA)
Country of Publication:
United States
Language:
English
Subject:
43 PARTICLE ACCELERATORS; ADVANCED LIGHT SOURCE; CONTROL SYSTEMS; DATA PROCESSING; DIFFRACTION; PERFORMANCE; RESOURCES; SYNCHROTRONS; TOMOGRAPHY

Citation Formats

Parkinson, Dilworth Y., E-mail: dyparkinson@lbl.gov, Chen, Xian, Hexemer, Alexander, MacDowell, Alastair A., Padmore, Howard A., Shapiro, David, Tamura, Nobumichi, Beattie, Keith, Krishnan, Harinarayan, Patton, Simon J., Perciano, Talita, Stromsness, Rune, Tull, Craig E., Ushizima, Daniela, Correa, Joaquin, Deslippe, Jack R., Dart, Eli, Tierney, Brian L., Daurer, Benedikt J., Maia, Filipe R. N. C., and and others. Real-time data-intensive computing. United States: N. p., 2016. Web. doi:10.1063/1.4952921.
Parkinson, Dilworth Y., E-mail: dyparkinson@lbl.gov, Chen, Xian, Hexemer, Alexander, MacDowell, Alastair A., Padmore, Howard A., Shapiro, David, Tamura, Nobumichi, Beattie, Keith, Krishnan, Harinarayan, Patton, Simon J., Perciano, Talita, Stromsness, Rune, Tull, Craig E., Ushizima, Daniela, Correa, Joaquin, Deslippe, Jack R., Dart, Eli, Tierney, Brian L., Daurer, Benedikt J., Maia, Filipe R. N. C., & and others. Real-time data-intensive computing. United States. doi:10.1063/1.4952921.
Parkinson, Dilworth Y., E-mail: dyparkinson@lbl.gov, Chen, Xian, Hexemer, Alexander, MacDowell, Alastair A., Padmore, Howard A., Shapiro, David, Tamura, Nobumichi, Beattie, Keith, Krishnan, Harinarayan, Patton, Simon J., Perciano, Talita, Stromsness, Rune, Tull, Craig E., Ushizima, Daniela, Correa, Joaquin, Deslippe, Jack R., Dart, Eli, Tierney, Brian L., Daurer, Benedikt J., Maia, Filipe R. N. C., and and others. Wed . "Real-time data-intensive computing". United States. doi:10.1063/1.4952921.
@article{osti_22608429,
title = {Real-time data-intensive computing},
author = {Parkinson, Dilworth Y., E-mail: dyparkinson@lbl.gov and Chen, Xian and Hexemer, Alexander and MacDowell, Alastair A. and Padmore, Howard A. and Shapiro, David and Tamura, Nobumichi and Beattie, Keith and Krishnan, Harinarayan and Patton, Simon J. and Perciano, Talita and Stromsness, Rune and Tull, Craig E. and Ushizima, Daniela and Correa, Joaquin and Deslippe, Jack R. and Dart, Eli and Tierney, Brian L. and Daurer, Benedikt J. and Maia, Filipe R. N. C. and and others},
abstractNote = {Today users visit synchrotrons as sources of understanding and discovery—not as sources of just light, and not as sources of data. To achieve this, the synchrotron facilities frequently provide not just light but often the entire end station and increasingly, advanced computational facilities that can reduce terabytes of data into a form that can reveal a new key insight. The Advanced Light Source (ALS) has partnered with high performance computing, fast networking, and applied mathematics groups to create a “super-facility”, giving users simultaneous access to the experimental, computational, and algorithmic resources to make this possible. This combination forms an efficient closed loop, where data—despite its high rate and volume—is transferred and processed immediately and automatically on appropriate computing resources, and results are extracted, visualized, and presented to users or to the experimental control system, both to provide immediate insight and to guide decisions about subsequent experiments during beamtime. We will describe our work at the ALS ptychography, scattering, micro-diffraction, and micro-tomography beamlines.},
doi = {10.1063/1.4952921},
journal = {AIP Conference Proceedings},
number = 1,
volume = 1741,
place = {United States},
year = {Wed Jul 27 00:00:00 EDT 2016},
month = {Wed Jul 27 00:00:00 EDT 2016}
}