Machine learning enabling high-throughput and remote operations at large-scale user facilities

Konstantinova, Tatiana; Maffettone, Phillip M.; Ravel, Bruce; Campbell, Stuart I.; Barbour, Andi M.; Olds, Daniel

doi:10.1039/d2dd00014h

Title: Machine learning enabling high-throughput and remote operations at large-scale user facilities

Journal Article · 19 May 2022 · Digital Discovery

DOI: https://doi.org/10.1039/d2dd00014h · OSTI ID:2543009

^[1];

^[2];

^[1];

^[1]

Brookhaven National Laboratory (BNL), Upton, NY (United States)
National Institute of Standards and Technology, Gaithersburg, MD (United States)

Imaging, scattering, and spectroscopy are fundamental in understanding and discovering new functional materials. Contemporary innovations in automation and experimental techniques have led to these measurements being performed much faster and with higher resolution, thus producing vast amounts of data for analysis. These innovations are particularly pronounced at user facilities and synchrotron light sources. Machine learning (ML) methods are regularly developed to process and interpret large datasets in real-time with measurements. However, there remain conceptual barriers to entry for the facility general user community, whom often lack expertise in ML, and technical barriers for deploying ML models. Herein, we demonstrate a variety of archetypal ML models for on-the-fly analysis at multiple beamlines at the National Synchrotron Light Source II (NSLS-II). We describe these examples instructively, with a focus on integrating the models into existing experimental workflows, such that the reader can easily include their own ML techniques into experiments at NSLS-II or facilities with a common infrastructure. The framework presented here shows how with little effort, diverse ML models operate in conjunction with feedback loops via integration into the existing Bluesky Suite for experimental orchestration and data management.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Brookhaven National Laboratory (BNL), Upton, NY (United States)

Sponsoring Organization:: USDOE Laboratory Directed Research and Development (LDRD) Program; USDOE Office of Science (SC), Basic Energy Sciences (BES). Scientific User Facilities (SUF)

Grant/Contract Number:: SC0012704

OSTI ID:: 2543009

Report Number(s):: BNL--227960-2025-JAAM

Journal Information:: Digital Discovery, Journal Name: Digital Discovery Journal Issue: 4 Vol. 1; ISSN 2635-098X

Publisher:: Royal Society of ChemistryCopyright Statement

Country of Publication:: United States

Language:: English

References (54)

X-ray Photon Correlation Spectroscopy Studies of Surfaces and Thin Films Sinha, Sunil K.; Jiang, Zhang; Lurio, Laurence B. Advanced Materials, Vol. 26, Issue 46 https://doi.org/10.1002/adma.201401094	journal	September 2014
Beyond Ternary OPV: High‐Throughput Experimentation and Self‐Driving Laboratories Optimize Multicomponent Systems Langner, Stefan; Häse, Florian; Perea, José Darío Advanced Materials, Vol. 32, Issue 14 https://doi.org/10.1002/adma.201907801	journal	April 2020
Enabling Scientific Discovery at Next-Generation Light Sources with Advanced AI and HPC Schwarz, Nicholas; Campbell, Stuart; Hexemer, Alexander Communications in Computer and Information Science https://doi.org/10.1007/978-3-030-63393-6_10	book	January 2020
Regularization in statistics Bickel, Peter J.; Li, Bo; Tsybakov, Alexandre B. Test, Vol. 15, Issue 2 https://doi.org/10.1007/BF02607055	journal	September 2006
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis Rousseeuw, Peter J. Journal of Computational and Applied Mathematics, Vol. 20 https://doi.org/10.1016/0377-0427(87)90125-7	journal	November 1987
Autonomous experimentation systems for materials development: A community perspective Stach, Eric; DeCost, Brian; Kusne, A. Gilad Matter, Vol. 4, Issue 9 https://doi.org/10.1016/j.matt.2021.06.036	journal	September 2021
A high-bias, low-variance introduction to Machine Learning for physicists Mehta, Pankaj; Bukov, Marin; Wang, Ching-Hao Physics Reports, Vol. 810 https://doi.org/10.1016/j.physrep.2019.03.001	journal	May 2019
Real-time detection of anomalous power consumption Chou, Jui-Sheng; Telaga, Abdi Suryadinata Renewable and Sustainable Energy Reviews, Vol. 33 https://doi.org/10.1016/j.rser.2014.01.088	journal	May 2014
Robot-Accelerated Perovskite Investigation and Discovery Li, Zhi; Najeeb, Mansoor Ani; Alves, Liana Chemistry of Materials, Vol. 32, Issue 13 https://doi.org/10.1021/acs.chemmater.0c01153	journal	June 2020
Machine Learning for Materials Scientists: An Introductory Guide toward Best Practices Wang, Anthony Yu-Tung; Murdock, Ryan J.; Kauwe, Steven K. Chemistry of Materials, Vol. 32, Issue 12 https://doi.org/10.1021/acs.chemmater.0c01907	journal	May 2020
Complex Structure of Molten NaCl–CrCl ₃ Salt: Cr–Cl Octahedral Network and Intermediate-Range Order Li, Qing-Jie; Sprouster, David; Zheng, Guiqiu ACS Applied Energy Materials, Vol. 4, Issue 4 https://doi.org/10.1021/acsaem.0c02678	journal	March 2021
Optimizing Chemical Reactions with Deep Reinforcement Learning Zhou, Zhenpeng; Li, Xiaocheng; Zare, Richard N. ACS Central Science, Vol. 3, Issue 12 https://doi.org/10.1021/acscentsci.7b00492	journal	November 2017
Random Forests Breiman, Leo Machine Learning, Vol. 45, Issue 1, p. 5-32 https://doi.org/10.1023/A:1010933404324	journal	January 2001
What is principal component analysis? Ringnér, Markus Nature Biotechnology, Vol. 26, Issue 3 https://doi.org/10.1038/nbt0308-303	journal	March 2008
A deep-learning technique for phase identification in multiphase inorganic compounds using synthetic XRD powder patterns Lee, Jin-Woong; Park, Woon Bae; Lee, Jin Hee Nature Communications, Vol. 11, Issue 1 https://doi.org/10.1038/s41467-019-13749-3	journal	January 2020
Comparison of dissimilarity measures for cluster analysis of X-ray diffraction data from combinatorial libraries Iwasaki, Yuma; Kusne, A. Gilad; Takeuchi, Ichiro npj Computational Materials, Vol. 3, Issue 1 https://doi.org/10.1038/s41524-017-0006-2	journal	February 2017
Unsupervised phase mapping of X-ray diffraction data by nonnegative matrix factorization integrated with custom clustering Stanev, Valentin; Vesselinov, Velimir V.; Kusne, A. Gilad npj Computational Materials, Vol. 4, Issue 1 https://doi.org/10.1038/s41524-018-0099-2	journal	August 2018
How to explore chemical space using algorithms and automation Gromski, Piotr S.; Henson, Alon B.; Granda, Jarosław M. Nature Reviews Chemistry, Vol. 3, Issue 2 https://doi.org/10.1038/s41570-018-0066-y	journal	January 2019
Emerging materials intelligence ecosystems propelled by machine learning Batra, Rohit; Song, Le; Ramprasad, Rampi Nature Reviews Materials https://doi.org/10.1038/s41578-020-00255-y	journal	November 2020
Machine learning for molecular and materials science Butler, Keith T.; Davies, Daniel W.; Cartwright, Hugh Nature, Vol. 559, Issue 7715 https://doi.org/10.1038/s41586-018-0337-2	journal	July 2018
Improved protein structure prediction using potentials from deep learning Senior, Andrew W.; Evans, Richard; Jumper, John Nature, Vol. 577, Issue 7792 https://doi.org/10.1038/s41586-019-1923-7	journal	January 2020
A mobile robotic chemist Burger, Benjamin; Maffettone, Phillip M.; Gusev, Vladimir V. Nature, Vol. 583, Issue 7815 https://doi.org/10.1038/s41586-020-2442-2	journal	July 2020
A Kriging-Based Approach to Autonomous Experimentation with Applications to X-Ray Scattering Noack, Marcus M.; Yager, Kevin G.; Fukuto, Masafumi Scientific Reports, Vol. 9, Issue 1 https://doi.org/10.1038/s41598-019-48114-3	journal	August 2019
Noise reduction in X-ray photon correlation spectroscopy with convolutional neural networks encoder–decoder models Konstantinova, Tatiana; Wiegart, Lutz; Rakitin, Maksim Scientific Reports, Vol. 11, Issue 1 https://doi.org/10.1038/s41598-021-93747-y	journal	July 2021
Understanding the molecular information contained in principal component analysis of vibrational spectra of biological systems Bonnier, F.; Byrne, H. J. The Analyst, Vol. 137, Issue 2 https://doi.org/10.1039/C1AN15821J	journal	January 2012
Chimera: enabling hierarchy based multi-objective optimization for self-driving laboratories Häse, Florian; Roch, Loïc M.; Aspuru-Guzik, Alán Chemical Science, Vol. 9, Issue 39 https://doi.org/10.1039/C8SC02239A	journal	January 2018
Structural characterisation of amorphous solid dispersions via metropolis matrix factorisation of pair distribution function data Geddes, Harry S.; Blade, Helen; McCabe, James F. Chemical Communications, Vol. 55, Issue 89 https://doi.org/10.1039/C9CC06753A	journal	January 2019
Constrained non-negative matrix factorization enabling real-time insights of in situ and high-throughput experiments Maffettone, Phillip M.; Daly, Aidan C.; Olds, Daniel Applied Physics Reviews, Vol. 8, Issue 4 https://doi.org/10.1063/5.0052859	journal	December 2021
A Fast Algorithm for the Minimum Covariance Determinant Estimator Rousseeuw, Peter J.; Driessen, Katrien Van Technometrics, Vol. 41, Issue 3 https://doi.org/10.1080/00401706.1999.10485670	journal	August 1999
A survey of image classification methods and techniques for improving classification performance Lu, D.; Weng, Q. International Journal of Remote Sensing, Vol. 28, Issue 5 https://doi.org/10.1080/01431160600746456	journal	March 2007
Hierarchical Grouping to Optimize an Objective Function Ward, Joe H. Journal of the American Statistical Association, Vol. 58, Issue 301 https://doi.org/10.1080/01621459.1963.10500845	journal	March 1963
Bluesky's Ahead: A Multi-Facility Collaboration for an a la Carte Software Project for Data Acquisition and Management Allan, Daniel; Caswell, Thomas; Campbell, Stuart Synchrotron Radiation News, Vol. 32, Issue 3 https://doi.org/10.1080/08940886.2019.1608121	journal	May 2019
Observation of Gravitational Waves from a Binary Black Hole Merger Abbott, B. P.; Abbott, R.; Abbott, T. D. Physical Review Letters, Vol. 116, Issue 6 https://doi.org/10.1103/PhysRevLett.116.061102	journal	February 2016
Bayesian Optimization of a Free-Electron Laser Duris, J.; Kennedy, D.; Hanuka, A. Physical Review Letters, Vol. 124, Issue 12 https://doi.org/10.1103/PhysRevLett.124.124801	journal	March 2020
Machine-Learning X-Ray Absorption Spectra to Quantitative Accuracy Carbone, Matthew R.; Topsakal, Mehmet; Lu, Deyu Physical Review Letters, Vol. 124, Issue 15 https://doi.org/10.1103/PhysRevLett.124.156401	journal	April 2020
Indexing of powder diffraction patterns by iterative use of singular value decomposition Coelho, A. A. Journal of Applied Crystallography, Vol. 36, Issue 1 https://doi.org/10.1107/S0021889802019878	journal	January 2003
Strategies for data collection and calibration with a pinhole-geometry SAXS instrument on a synchrotron beamline Cookson, David; Kirby, Nigel; Knott, Robert Journal of Synchrotron Radiation, Vol. 13, Issue 6 https://doi.org/10.1107/S0909049506030184	journal	October 2006
TOPAS and TOPAS-Academic : an optimization program integrating computer algebra and crystallographic objects written in C++ Coelho, Alan A. Journal of Applied Crystallography, Vol. 51, Issue 1 https://doi.org/10.1107/S1600576718000183	journal	February 2018
X-ray photon correlation spectroscopy Shpyrko, Oleg G. Journal of Synchrotron Radiation, Vol. 21, Issue 5 https://doi.org/10.1107/S1600577514018232	journal	August 2014
Serial crystallography on in vivo grown microcrystals using synchrotron radiation Gati, Cornelius; Bourenkov, Gleb; Klinge, Marco IUCrJ, Vol. 1, Issue 2 https://doi.org/10.1107/S2052252513033939	journal	February 2014
Variational Gaussian process classifiers Mackay, D. J. C.; Gibbs, M. N. IEEE Transactions on Neural Networks, Vol. 11, Issue 6 https://doi.org/10.1109/72.883477	journal	January 2000
Isolation Forest Liu, Fei Tony; Ting, Kai Ming; Zhou, Zhi-Hua 2008 Eighth IEEE International Conference on Data Mining (ICDM) https://doi.org/10.1109/ICDM.2008.17	conference	December 2008
Matplotlib: A 2D Graphics Environment Hunter, John D. Computing in Science & Engineering, Vol. 9, Issue 3 https://doi.org/10.1109/MCSE.2007.55	journal	January 2007
Network Anomaly Detection: Methods, Systems and Tools Bhuyan, Monowar H.; Bhattacharyya, D. K.; Kalita, J. K. IEEE Communications Surveys & Tutorials, Vol. 16, Issue 1 https://doi.org/10.1109/SURV.2013.052213.00046	journal	January 2014
Least squares quantization in PCM Lloyd, S. IEEE Transactions on Information Theory, Vol. 28, Issue 2 https://doi.org/10.1109/TIT.1982.1056489	journal	March 1982
Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experiments Ren, Fang; Ward, Logan; Williams, Travis Science Advances, Vol. 4, Issue 4 https://doi.org/10.1126/sciadv.aaq1566	journal	April 2018
Superhuman AI for multiplayer poker Brown, Noam; Sandholm, Tuomas Science, Vol. 365, Issue 6456 https://doi.org/10.1126/science.aay2400	journal	August 2019
Crystal symmetry determination in electron diffraction using machine learning Kaufmann, Kevin; Zhu, Chaoyi; Rosengarten, Alexander S. Science, Vol. 367, Issue 6477 https://doi.org/10.1126/science.aay3062	journal	January 2020
ChemOS: Orchestrating autonomous experimentation Roch, Loïc M.; Häse, Florian; Kreisbeck, Christoph Science Robotics, Vol. 3, Issue 19 https://doi.org/10.1126/scirobotics.aat5559	journal	June 2018
Real Time Data-Driven Approaches for Credit Card Fraud Detection Tran, Phuong Hanh; Tran, Kim Phuc; Huong, Truong Thu Proceedings of the 2018 International Conference on E-Business and Applications https://doi.org/10.1145/3194188.3194196	conference	February 2018
LOF: identifying density-based local outliers Breunig, Markus M.; Kriegel, Hans-Peter; Ng, Raymond T. Proceedings of the 2000 ACM SIGMOD international conference on Management of data - SIGMOD '00 https://doi.org/10.1145/342009.335388	conference	January 2000
Discriminatory Analysis. Nonparametric Discrimination: Consistency Properties Fix, Evelyn; Hodges, J. L. International Statistical Review / Revue Internationale de Statistique, Vol. 57, Issue 3 https://doi.org/10.2307/1403797	journal	December 1989
Basic Reinforcement Learning Techniques to Control the Intensity of a Seeded Free-Electron Laser Bruchon, Niky; Fenu, Gianfranco; Gaio, Giulio Electronics, Vol. 9, Issue 5 https://doi.org/10.3390/electronics9050781	journal	May 2020
A Review on Optimal Subsampling Methods for Massive Datasets Yao, Yaqiong; Wang, HaiYing Journal of Data Science https://doi.org/10.6339/21-JDS999	journal	January 2021

Similar Records

Facile Integration of Robots into Experimental Orchestration at Scientific User Facilities

Conference · 2024 · 2024 IEEE International Conference on Robotics and Automation (ICRA) · OSTI ID:2549229

Fernando, Chandima; Olds, Daniel; Campbell, Stuart I.; +1 more

Outlook for artificial intelligence and machine learning at the NSLS-II

Journal Article · 2021 · Machine Learning: Science and Technology · OSTI ID:1835323

Campbell, Stuart I.; Allan, Daniel B.; Barbour, Andi M.; +4 more

Combining diagnostics, modeling, and control systems for automated alignment of the TES beamline

Journal Article · 2022 · Journal of Physics. Conference Series · OSTI ID:1924214

Nash, B.; Abell, D. T.; Nagler, R.; +12 more

Related Subjects

36 MATERIALS SCIENCE

Title: Machine learning enabling high-throughput and remote operations at large-scale user facilities

Citation Formats

References (54)

Similar Records

Related Subjects