Nanosurveyor: a framework for real-time data processing

Daurer, Benedikt J.; Krishnan, Hari; Perciano, Talita; Maia, Filipe R. N. C.; Shapiro, David A.; Sethian, James A.; Marchesini, Stefano

doi:10.1186/s40679-017-0039-0

Title: Nanosurveyor: a framework for real-time data processing

Journal Article · Tue Jan 31 00:00:00 EST 2017 · Advanced Structural and Chemical Imaging

DOI:https://doi.org/10.1186/s40679-017-0039-0· OSTI ID:1344023

Daurer, Benedikt J.; Krishnan, Hari; Perciano, Talita; Maia, Filipe R. N. C.; Shapiro, David A.; Sethian, James A.;

Background: The ever improving brightness of accelerator based sources is enabling novel observations and discoveries with faster frame rates, larger fields of view, higher resolution, and higher dimensionality. Results: Here we present an integrated software/algorithmic framework designed to capitalize on high-throughput experiments through efficient kernels, load-balanced workflows, which are scalable in design. We describe the streamlined processing pipeline of ptychography data analysis. Conclusions: The pipeline provides throughput, compression, and resolution as well as rapid feedback to the microscope operators.

View Journal Article

Cite

Export

Save

Research Organization:: Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)

Sponsoring Organization:: USDOE Office of Science (SC), Basic Energy Sciences (BES); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); Swedish Research Council (SRC); Swedish Foundation for Strategic Research (Sweden)

Grant/Contract Number:: AC03-76SF00098; AC02-05CH11231

OSTI ID:: 1344023

Alternate ID(s):: OSTI ID: 1379699

Journal Information:: Advanced Structural and Chemical Imaging, Journal Name: Advanced Structural and Chemical Imaging Vol. 3 Journal Issue: 1; ISSN 2198-0926

Publisher:: SpringerCopyright Statement

Country of Publication:: Germany

Language:: English

References (25)

Parallel ptychographic reconstruction Nashed, Youssef S. G.; Vine, David J.; Peterka, Tom Optics Express, Vol. 22, Issue 26 https://doi.org/10.1364/OE.22.032082	journal	January 2014
Cheetah : software for high-throughput reduction and analysis of serial femtosecond X-ray diffraction data Barty, Anton; Kirian, Richard A.; Maia, Filipe R. N. C. Journal of Applied Crystallography, Vol. 47, Issue 3 https://doi.org/10.1107/S1600576714007626	journal	May 2014
Hummingbird : monitoring and analyzing flash X-ray imaging experiments in real time Daurer, Benedikt J.; Hantke, Max F.; Nettelblad, Carl Journal of Applied Crystallography, Vol. 49, Issue 3 https://doi.org/10.1107/S1600576716005926	journal	April 2016
Ptychography and Related Diffractive Imaging Methods Rodenburg, J. M. Advances in Imaging and Electron Physics https://doi.org/10.1016/S1076-5670(07)00003-1	book	May 2008
EIGER: Next generation single photon counting detector for X-ray applications Dinapoli, Roberto; Bergamaschi, Anna; Henrich, Beat Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment, Vol. 650, Issue 1 https://doi.org/10.1016/j.nima.2010.12.005	journal	September 2011
Ultimate upgrade for US synchrotron Samuel Reich, Eugenie Nature, Vol. 501, Issue 7466 https://doi.org/10.1038/501148a	journal	September 2013
The Coherent X-ray Imaging Data Bank Maia, Filipe R. N. C. Nature Methods, Vol. 9, Issue 9 https://doi.org/10.1038/nmeth.2110	journal	August 2012
The PILATUS 1M detector Broennimann, Ch.; Eikenberry, E. F.; Henrich, B. Journal of Synchrotron Radiation, Vol. 13, Issue 2 https://doi.org/10.1107/S0909049505038665	journal	February 2006
Development of a compact fast CCD camera and resonant soft x-ray scattering endstation for time-resolved pump-probe experiments Doering, D.; Chuang, Y. -D.; Andresen, N. Review of Scientific Instruments, Vol. 82, Issue 7 https://doi.org/10.1063/1.3609862	journal	July 2011
Emerging Opportunities in High-Energy X-ray Science: The Diffraction-Limited Storage Ring Frontier Almer, Jon; Chupas, Peter; Stephenson, Brian Synchrotron Radiation News, Vol. 29, Issue 1 https://doi.org/10.1080/08940886.2016.1124675	journal	January 2016
Dask: Parallel Computation with Blocked algorithms and Task Scheduling Rocklin, Matthew Proceedings of the Python in Science Conference https://doi.org/10.25080/Majora-7b98e3ed-013	conference	January 2015
Development of coherent scattering and diffractive imaging and the COSMIC facility at the Advanced Light Source Shapiro, D.; Roy, S.; Celestre, R. Journal of Physics: Conference Series, Vol. 425, Issue 19 https://doi.org/10.1088/1742-6596/425/19/192011	journal	March 2013
A hard X-ray nanoprobe beamline for nanoscale microscopy Winarski, Robert P.; Holt, Martin V.; Rose, Volker Journal of Synchrotron Radiation, Vol. 19, Issue 6 https://doi.org/10.1107/S0909049512036783	journal	September 2012
High-Resolution Scanning X-ray Diffraction Microscopy Thibault, P.; Dierolf, M.; Menzel, A. Science, Vol. 321, Issue 5887 https://doi.org/10.1126/science.1158573	journal	July 2008
Design and performance of a scanning ptychography microscope Nazaretski, E.; Huang, X.; Yan, H. Review of Scientific Instruments, Vol. 85, Issue 3 https://doi.org/10.1063/1.4868968	journal	March 2014
Covalent Small Molecule Inhibitors of Ca ²⁺ -Bound S100B Cavalier, Michael C.; Pierce, Adam D.; Wilder, Paul T. Biochemistry, Vol. 53, Issue 42 https://doi.org/10.1021/bi5005552	journal	October 2014
SHARP : a distributed GPU-based ptychographic solver Marchesini, Stefano; Krishnan, Hari; Daurer, Benedikt J. Journal of Applied Crystallography, Vol. 49, Issue 4 https://doi.org/10.1107/S1600576716008074	journal	July 2016
Evidence for interstellar origin of seven dust particles collected by the Stardust spacecraft Westphal, A. J.; Stroud, R. M.; Bechtel, H. A. Science, Vol. 345, Issue 6198 https://doi.org/10.1126/science.1252496	journal	August 2014
A fast, direct x-ray detection charge-coupled device Denes, P.; Doering, D.; Padmore, H. A. Review of Scientific Instruments, Vol. 80, Issue 8 https://doi.org/10.1063/1.3187222	journal	August 2009
Hard-X-Ray Lensless Imaging of Extended Objects Rodenburg, J. M.; Hurst, A. C.; Cullis, A. G. Physical Review Letters, Vol. 98, Issue 3 https://doi.org/10.1103/PhysRevLett.98.034801	journal	January 2007
The NumPy Array: A Structure for Efficient Numerical Computation van der Walt, Stéfan; Colbert, S. Chris; Varoquaux, Gaël Computing in Science & Engineering, Vol. 13, Issue 2 https://doi.org/10.1109/MCSE.2011.37	journal	March 2011
A computational framework for ptychographic reconstructions Enders, B.; Thibault, P. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 472, Issue 2196 https://doi.org/10.1098/rspa.2016.0640	journal	December 2016
Electronic Structure of ${MgB}_{2}$ from Angle-Resolved Photoemission Spectroscopy Uchiyama, H.; Shen, K. M.; Lee, S. Physical Review Letters, Vol. 88, Issue 15 https://doi.org/10.1103/PhysRevLett.88.157002	journal	April 2002
BROCCOLI: Software for fast fMRI analysis on many-core CPUs and GPUs Eklund, Anders; Dufort, Paul; Villani, Mattias Frontiers in Neuroinformatics, Vol. 8 https://doi.org/10.3389/fninf.2014.00024	journal	March 2014
The MAX IV Facility Eriksson, M.; Al-dmour, E.; Ahlbäck, J. Journal of Physics: Conference Series, Vol. 425, Issue 7 https://doi.org/10.1088/1742-6596/425/7/072008	journal	March 2013

Similar Records

Scalable Data-Intensive Geocomputation: A Design for Real-Time Continental Flood Inundation Mapping

Conference · Sat Aug 01 00:00:00 EDT 2020 · OSTI ID:1344023

Liu, Yan; Sanyal, Jibo

Aggregation and Structuring of Materials and Chemicals Data from Diverse Sources

Technical Report · Tue Dec 31 00:00:00 EST 2019 · OSTI ID:1344023

Tassone, Christopher; Mehta, Apurva

Enabling discovery data science through cross-facility workflows

Conference · Wed Dec 01 00:00:00 EST 2021 · OSTI ID:1344023

Antypas, Katerina B.; Bard, Deborah; Blaschke, Johannes P.; +7 more

Related Subjects

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND TECHNOLOGY
streaming
ptychography

Title: Nanosurveyor: a framework for real-time data processing

Citation Formats

References (25)

Similar Records

Related Subjects