DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Machine learning for data-driven discovery in solid Earth geoscience

Abstract

Understanding the behavior of Earth through the diverse fields of the solid Earth geosciences is an increasingly important task. It is made challenging by the complex, interacting, and multiscale processes needed to understand Earth’s behavior and by the inaccessibility of nearly all of Earth’s subsurface to direct observation. Substantial increases in data availability and in the increasingly realistic character of computer simulations hold promise for accelerating progress, but developing a deeper understanding based on these capabilities is itself challenging. Machine learning will play a key role in this effort. We review the state of the field and make recommendations for how progress might be broadened and accelerated.

Authors:
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3];  [4]
  1. Institute for Computational and Mathematical Engineering, Stanford University, Stanford, CA 94305, USA., Department of Earth and Planetary Sciences, Harvard University, Cambridge, MA 02138, USA.
  2. Geophysics Group, Los Alamos National Laboratory, Los Alamos, NM 87545, USA.
  3. Department of Computational and Applied Mathematics, Rice University, Houston, TX 77005, USA.
  4. Department of Geophysics, Stanford University, Stanford, CA 94305, USA.
Publication Date:
Sponsoring Org.:
USDOE
OSTI Identifier:
1547596
Grant/Contract Number:  
KC030206
Resource Type:
Published Article
Journal Name:
Science
Additional Journal Information:
Journal Name: Science Journal Volume: 363 Journal Issue: 6433; Journal ID: ISSN 0036-8075
Publisher:
American Association for the Advancement of Science (AAAS)
Country of Publication:
United States
Language:
English

Citation Formats

Bergen, Karianne J., Johnson, Paul A., de Hoop, Maarten V., and Beroza, Gregory C. Machine learning for data-driven discovery in solid Earth geoscience. United States: N. p., 2019. Web. doi:10.1126/science.aau0323.
Bergen, Karianne J., Johnson, Paul A., de Hoop, Maarten V., & Beroza, Gregory C. Machine learning for data-driven discovery in solid Earth geoscience. United States. https://doi.org/10.1126/science.aau0323
Bergen, Karianne J., Johnson, Paul A., de Hoop, Maarten V., and Beroza, Gregory C. Thu . "Machine learning for data-driven discovery in solid Earth geoscience". United States. https://doi.org/10.1126/science.aau0323.
@article{osti_1547596,
title = {Machine learning for data-driven discovery in solid Earth geoscience},
author = {Bergen, Karianne J. and Johnson, Paul A. and de Hoop, Maarten V. and Beroza, Gregory C.},
abstractNote = {Understanding the behavior of Earth through the diverse fields of the solid Earth geosciences is an increasingly important task. It is made challenging by the complex, interacting, and multiscale processes needed to understand Earth’s behavior and by the inaccessibility of nearly all of Earth’s subsurface to direct observation. Substantial increases in data availability and in the increasingly realistic character of computer simulations hold promise for accelerating progress, but developing a deeper understanding based on these capabilities is itself challenging. Machine learning will play a key role in this effort. We review the state of the field and make recommendations for how progress might be broadened and accelerated.},
doi = {10.1126/science.aau0323},
journal = {Science},
number = 6433,
volume = 363,
place = {United States},
year = {Thu Mar 21 00:00:00 EDT 2019},
month = {Thu Mar 21 00:00:00 EDT 2019}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1126/science.aau0323

Citation Metrics:
Cited by: 327 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks
conference, October 2017

  • Zhu, Jun-Yan; Park, Taesung; Isola, Phillip
  • 2017 IEEE International Conference on Computer Vision (ICCV)
  • DOI: 10.1109/ICCV.2017.244

Invariant Scattering Convolution Networks
journal, August 2013

  • Bruna, Joan; Mallat, S.
  • IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, Issue 8
  • DOI: 10.1109/TPAMI.2012.230

P Wave Arrival Picking and First-Motion Polarity Determination With Deep Learning
journal, June 2018

  • Ross, Zachary E.; Meier, Men-Andrin; Hauksson, Egill
  • Journal of Geophysical Research: Solid Earth, Vol. 123, Issue 6
  • DOI: 10.1029/2017JB015251

Deep learning
journal, May 2015

  • LeCun, Yann; Bengio, Yoshua; Hinton, Geoffrey
  • Nature, Vol. 521, Issue 7553
  • DOI: 10.1038/nature14539

Inverse Problems in Geodynamics Using Machine Learning Algorithms
journal, January 2018

  • Shahnas, M. H.; Yuen, D. A.; Pysklywec, R. N.
  • Journal of Geophysical Research: Solid Earth, Vol. 123, Issue 1
  • DOI: 10.1002/2017JB014846

Automatic Discrimination among Landslide, Explosion-Quake, and Microtremor Seismic Signals at Stromboli Volcano Using Neural Networks
journal, August 2006

  • Esposito, A. M.
  • Bulletin of the Seismological Society of America, Vol. 96, Issue 4A
  • DOI: 10.1785/0120050097

Mastering the game of Go with deep neural networks and tree search
journal, January 2016

  • Silver, David; Huang, Aja; Maddison, Chris J.
  • Nature, Vol. 529, Issue 7587
  • DOI: 10.1038/nature16961

Similarity of fast and slow earthquakes illuminated by machine learning
journal, December 2018

  • Hulbert, Claudia; Rouet-Leduc, Bertrand; Johnson, Paul A.
  • Nature Geoscience, Vol. 12, Issue 1
  • DOI: 10.1038/s41561-018-0272-8

Deep-learning tomography
journal, January 2018

  • Araya-Polo, Mauricio; Jennings, Joseph; Adler, Amir
  • The Leading Edge, Vol. 37, Issue 1
  • DOI: 10.1190/tle37010058.1

ObsPy: A Python Toolbox for Seismology
journal, May 2010

  • Beyreuther, M.; Barsch, R.; Krischer, L.
  • Seismological Research Letters, Vol. 81, Issue 3
  • DOI: 10.1785/gssrl.81.3.530

The efficacy of support vector machines (SVM) in robust determination of earthquake early warning magnitudes in central Japan
journal, October 2013


Earthquake detection through computationally efficient similarity search
journal, December 2015

  • Yoon, Clara E.; O’Reilly, Ossian; Bergen, Karianne J.
  • Science Advances, Vol. 1, Issue 11
  • DOI: 10.1126/sciadv.1501057

MyShake: A smartphone seismic network for earthquake early warning and beyond
journal, February 2016

  • Kong, Qingkai; Allen, Richard M.; Schreier, Louis
  • Science Advances, Vol. 2, Issue 2
  • DOI: 10.1126/sciadv.1501055

Geologic pattern recognition from seismic attributes: Principal component analysis and self-organizing maps
journal, November 2015


Chances and limits of single-station seismic event clustering by unsupervised pattern recognition
journal, April 2015

  • Sick, Benjamin; Guggenmos, Matthias; Joswig, Manfred
  • Geophysical Journal International, Vol. 201, Issue 3
  • DOI: 10.1093/gji/ggv126

Ultrastable laser interferometry for earthquake detection with terrestrial and submarine cables
journal, June 2018


Towards fully data driven ground-motion prediction models for Europe
journal, July 2013

  • Derras, Boumédiène; Bard, Pierre Yves; Cotton, Fabrice
  • Bulletin of Earthquake Engineering, Vol. 12, Issue 1
  • DOI: 10.1007/s10518-013-9481-0

ImageNet: A large-scale hierarchical image database
conference, June 2009

  • Deng, Jia; Dong, Wei; Socher, Richard
  • 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPR Workshops), 2009 IEEE Conference on Computer Vision and Pattern Recognition
  • DOI: 10.1109/CVPR.2009.5206848

Machine Learning Predicts Laboratory Earthquakes: MACHINE LEARNING PREDICTS LAB QUAKES
journal, September 2017

  • Rouet-Leduc, Bertrand; Hulbert, Claudia; Lubbers, Nicholas
  • Geophysical Research Letters, Vol. 44, Issue 18
  • DOI: 10.1002/2017GL074677

Neural networks as an intelligence amplification tool: A review of applications
journal, May 2002


Toward the Geoscience Paper of the Future: Best practices for documenting and sharing research from data to software to provenance
journal, October 2016

  • Gil, Yolanda; David, Cédric H.; Demir, Ibrahim
  • Earth and Space Science, Vol. 3, Issue 10
  • DOI: 10.1002/2015EA000136

Essentials of the self-organizing map
journal, January 2013


The Geological Susceptibility of Induced Earthquakes in the Duvernay Play
journal, February 2018

  • Pawley, Steven; Schultz, Ryan; Playter, Tiffany
  • Geophysical Research Letters, Vol. 45, Issue 4
  • DOI: 10.1002/2017GL076100

Long Short-Term Memory
journal, November 1997


Automatic picking of seismic arrivals in local earthquake data using an artificial neural network
journal, March 1995


The Quake-Catcher Network: Citizen Science Expanding Seismic Horizons
journal, January 2009

  • Cochran, E. S.; Lawrence, J. F.; Christensen, C.
  • Seismological Research Letters, Vol. 80, Issue 1
  • DOI: 10.1785/gssrl.80.1.26

Unsupervised pattern recognition in continuous seismic wavefield records using Self-Organizing Maps: Unsupervised seismic pattern recognition
journal, July 2010


Estimating Fault Friction From Seismic Signals in the Laboratory
journal, February 2018

  • Rouet‐Leduc, Bertrand; Hulbert, Claudia; Bolton, David C.
  • Geophysical Research Letters, Vol. 45, Issue 3
  • DOI: 10.1002/2017GL076708

Earthquake shakes Twitter users: real-time event detection by social sensors
conference, January 2010

  • Sakaki, Takeshi; Okazaki, Makoto; Matsuo, Yutaka
  • Proceedings of the 19th international conference on World wide web - WWW '10
  • DOI: 10.1145/1772690.1772777

Machine learning reveals cyclic changes in seismic source spectra in Geysers geothermal field
journal, May 2018

  • Holtzman, Benjamin K.; Paté, Arthur; Paisley, John
  • Science Advances, Vol. 4, Issue 5
  • DOI: 10.1126/sciadv.aao2929

Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data
journal, October 2017

  • Karpatne, Anuj; Atluri, Gowtham; Faghmous, James H.
  • IEEE Transactions on Knowledge and Data Engineering, Vol. 29, Issue 10
  • DOI: 10.1109/TKDE.2017.2720168

Neural networks in geophysical applications
journal, July 2000

  • van der Baan, Mirko; Jutten, Christian
  • GEOPHYSICS, Vol. 65, Issue 4
  • DOI: 10.1190/1.1444797

DeepStack: Expert-level artificial intelligence in heads-up no-limit poker
journal, March 2017


Bayesian inference of Earth's radial seismic structure from body-wave traveltimes using neural networks
journal, June 2013

  • de Wit, Ralph W. L.; Valentine, Andrew P.; Trampert, Jeannot
  • Geophysical Journal International, Vol. 195, Issue 1
  • DOI: 10.1093/gji/ggt220

Mapping geology and volcanic-hosted massive sulfide alteration in the Hellyer–Mt Charter region, Tasmania, using Random Forests™ and Self-Organising Maps
journal, November 2013


Simultaneous dictionary learning and denoising for seismic data
journal, May 2014


Three Steps to Successful Collaboration with Data Scientists
journal, August 2017


3D seismic image processing for faults
journal, March 2016


A survey on deep learning in medical image analysis
journal, December 2017


Gradient-based learning applied to document recognition
journal, January 1998

  • Lecun, Y.; Bottou, L.; Bengio, Y.
  • Proceedings of the IEEE, Vol. 86, Issue 11
  • DOI: 10.1109/5.726791

Searching for exotic particles in high-energy physics with deep learning
journal, July 2014

  • Baldi, P.; Sadowski, P.; Whiteson, D.
  • Nature Communications, Vol. 5, Issue 1
  • DOI: 10.1038/ncomms5308

Strong Correlation between Stress Drop and Peak Ground Acceleration for Recent M 1–4 Earthquakes in the San Francisco Bay Area
journal, March 2018

  • Trugman, Daniel T.; Shearer, Peter M.
  • Bulletin of the Seismological Society of America, Vol. 108, Issue 2
  • DOI: 10.1785/0120170245

Seismic detection using support vector machines
journal, July 2014


Double-sparsity dictionary for seismic noise attenuation
journal, March 2016


How to Grow a Mind: Statistics, Structure, and Abstraction
journal, March 2011


A neural network for noise correlation classification
journal, November 2017

  • Paitz, Patrick; Gokhberg, Alexey; Fichtner, Andreas
  • Geophysical Journal International, Vol. 212, Issue 2
  • DOI: 10.1093/gji/ggx495

Detecting earthquakes over a seismic network using single-station similarity measures
journal, March 2018

  • Bergen, Karianne J.; Beroza, Gregory C.
  • Geophysical Journal International, Vol. 213, Issue 3
  • DOI: 10.1093/gji/ggy100

Data space reduction, quality assessment and searching of seismograms: autoencoder networks for waveform data: Autoencoder networks for waveform data
journal, March 2012


A Deep Neural Networks Approach to Automatic Recognition Systems for Volcano-Seismic Events
journal, May 2018

  • Titos, Manuel; Bueno, Angel; Garcia, Luz
  • IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, Vol. 11, Issue 5
  • DOI: 10.1109/JSTARS.2018.2803198

Supervised machine learning on a network scale: application to seismic event classification and detection
journal, May 2017

  • Reynen, Andrew; Audet, Pascal
  • Geophysical Journal International, Vol. 210, Issue 3
  • DOI: 10.1093/gji/ggx238

A Seismic-Event Spotting System for Volcano Fast-Response Systems
journal, June 2012

  • Hammer, C.; Beyreuther, M.; Ohrnberger, M.
  • Bulletin of the Seismological Society of America, Vol. 102, Issue 3
  • DOI: 10.1785/0120110167

Unsupervised seismic facies analysis via deep convolutional autoencoders
journal, April 2018


SeismOlympics
journal, September 2017

  • Fang, Lihua; Wu, Zhongliang; Song, Kuan
  • Seismological Research Letters, Vol. 88, Issue 6
  • DOI: 10.1785/0220170134

Constructing a Hidden Markov Model based earthquake detector: application to induced seismicity: Constructing a HMM based earthquake detector
journal, February 2012


Continuous chatter of the Cascadia subduction zone revealed by machine learning
journal, December 2018

  • Rouet-Leduc, Bertrand; Hulbert, Claudia; Johnson, Paul A.
  • Nature Geoscience, Vol. 12, Issue 1
  • DOI: 10.1038/s41561-018-0274-6

A Machine Learning Approach for Improving the Detection Capabilities at 3C Seismic Stations
journal, September 2012


Combining Machine Learning and Geophysical Inversion for Applied Geophysics
journal, December 2015

  • Reading, Anya M.; Cracknell, Matthew J.; Bombardieri, Daniel J.
  • ASEG Extended Abstracts, Vol. 2015, Issue 1
  • DOI: 10.1071/ASEG2015ab070

Semiautomated geologic mapping using self-organizing maps and airborne geophysics in the Brazilian Amazon
journal, July 2012

  • Carneiro, Cleyton de Carvalho; Fraser, Stephen James; Crósta, Alvaro Penteado
  • GEOPHYSICS, Vol. 77, Issue 4
  • DOI: 10.1190/geo2011-0302.1

Real-time earthquake monitoring using a search engine method
journal, December 2014

  • Zhang, Jie; Zhang, Haijiang; Chen, Enhong
  • Nature Communications, Vol. 5, Issue 1
  • DOI: 10.1038/ncomms6664

Continuous earthquake detection and classification using discrete Hidden Markov Models
journal, December 2008


ImageNet Large Scale Visual Recognition Challenge
journal, April 2015

  • Russakovsky, Olga; Deng, Jia; Su, Hao
  • International Journal of Computer Vision, Vol. 115, Issue 3
  • DOI: 10.1007/s11263-015-0816-y

Group Invariant Scattering
journal, July 2012

  • Mallat, Stéphane
  • Communications on Pure and Applied Mathematics, Vol. 65, Issue 10
  • DOI: 10.1002/cpa.21413

Seismic features and automatic discrimination of deep and shallow induced-microearthquakes using neural network and logistic regression
journal, July 2016

  • Mousavi, S. Mostafa; Horton, Stephen P.; Langston, Charles A.
  • Geophysical Journal International, Vol. 207, Issue 1
  • DOI: 10.1093/gji/ggw258

A new approach for semi-automatic rock mass joints recognition from 3D point clouds
journal, July 2014


Automatic detection of alpine rockslides in continuous seismic data using hidden Markov models: AUTOMATIC DETECTION OF ALPINE ROCKSLIDES
journal, February 2016

  • Dammeier, Franziska; Moore, Jeffrey R.; Hammer, Conny
  • Journal of Geophysical Research: Earth Surface, Vol. 121, Issue 2
  • DOI: 10.1002/2015JF003647

Fiber-Optic Network Observations of Earthquake Wavefields: FIBER-OPTIC EARTHQUAKE OBSERVATIONS
journal, December 2017

  • Lindsey, Nathaniel J.; Martin, Eileen R.; Dreger, Douglas S.
  • Geophysical Research Letters, Vol. 44, Issue 23
  • DOI: 10.1002/2017GL075722

Convolutional Neural Networks for Inverse Problems in Imaging: A Review
journal, November 2017

  • McCann, Michael T.; Jin, Kyong Hwan; Unser, Michael
  • IEEE Signal Processing Magazine, Vol. 34, Issue 6
  • DOI: 10.1109/MSP.2017.2739299

Reconstruction of three-dimensional porous media using generative adversarial neural networks
journal, October 2017


Convolutional neural network for earthquake detection and location
journal, February 2018

  • Perol, Thibaut; Gharbi, Michaël; Denolle, Marine
  • Science Advances, Vol. 4, Issue 2
  • DOI: 10.1126/sciadv.1700578

NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations
journal, September 2010

  • Valiev, M.; Bylaska, E. J.; Govind, N.
  • Computer Physics Communications, Vol. 181, Issue 9, p. 1477-1489
  • DOI: 10.1016/j.cpc.2010.04.018

Using graph clustering to locate sources within a dense sensor array
journal, March 2017


Deep Blue
journal, January 2002


ObsPy: a bridge for seismology into the scientific Python ecosystem
journal, January 2015


Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experiments
journal, April 2018


A tutorial on hidden Markov models and selected applications in speech recognition
journal, January 1989

  • Rabiner, L. R.
  • Proceedings of the IEEE, Vol. 77, Issue 2
  • DOI: 10.1109/5.18626

Automatic classification of seismic events within a regional seismograph network
journal, February 2016


Internet Users as Seismic Sensors for Improved Earthquake Response
journal, June 2008

  • Bossu, Rémy; Mazet-Roux, Gilles; Douet, Vincent
  • Eos, Transactions American Geophysical Union, Vol. 89, Issue 25
  • DOI: 10.1029/2008EO250001

Fast magnitude determination using a single seismological station record implementing machine learning techniques
journal, January 2018


Machine learning for graph-based representations of three-dimensional discrete fracture networks
journal, January 2018

  • Valera, Manuel; Guo, Zhengyang; Kelly, Priscilla
  • Computational Geosciences, Vol. 22, Issue 3
  • DOI: 10.1007/s10596-018-9720-1

Application of real time recurrent neural network for detection of small natural earthquakes in Poland
journal, October 2013

  • Wiszniowski, Jan; Plesiewicz, Beata M.; Trojanowski, Jacek
  • Acta Geophysica, Vol. 62, Issue 3
  • DOI: 10.2478/s11600-013-0140-2

Identifying Exoplanets with Deep Learning: A Five-planet Resonant Chain around Kepler-80 and an Eighth Planet around Kepler-90
journal, January 2018


The preprint dilemma
journal, September 2017


Broadband Ground Motions from 3D Physics‐Based Numerical Simulations Using Artificial Neural Networks
journal, May 2018

  • Paolucci, Roberto; Gatti, Filippo; Infantino, Maria
  • Bulletin of the Seismological Society of America, Vol. 108, Issue 3A
  • DOI: 10.1785/0120170293

Active learning machine learns to create new quantum experiments
journal, January 2018

  • Melnikov, Alexey A.; Poulsen Nautrup, Hendrik; Krenn, Mario
  • Proceedings of the National Academy of Sciences, Vol. 115, Issue 6
  • DOI: 10.1073/pnas.1714936115

Rapid Seismic Domain Transfer: Seismic Velocity Inversion and Modeling Using Deep Generative Neural Networks
conference, June 2018


Approaches to automated data selection for global seismic tomography: Approaches to automated data selection
journal, May 2010


Unsupervised Neural Analysis of Very-Long-Period Events at Stromboli Volcano Using the Self-Organizing Maps
journal, October 2008

  • Esposito, A. M.; Giudicepietro, F.; D'Auria, L.
  • Bulletin of the Seismological Society of America, Vol. 98, Issue 5
  • DOI: 10.1785/0120070110

Continuous Hidden Markov Models: Application to automatic earthquake detection and classification at Las Canãdas caldera, Tenerife
journal, October 2008

  • Beyreuther, Moritz; Carniel, Roberto; Wassermann, Joachim
  • Journal of Volcanology and Geothermal Research, Vol. 176, Issue 4
  • DOI: 10.1016/j.jvolgeores.2008.04.021

Enabling large-scale viscoelastic calculations via neural network acceleration: Accelerating VISCOELASTIC CALCULATIONS
journal, March 2017

  • DeVries, Phoebe M. R.; Thompson, T. Ben; Meade, Brendan J.
  • Geophysical Research Letters, Vol. 44, Issue 6
  • DOI: 10.1002/2017GL072716

Robust system size reduction of discrete fracture networks: a multi-fidelity method that preserves transport characteristics
journal, September 2018

  • Srinivasan, Shriram; Hyman, Jeffrey; Karra, Satish
  • Computational Geosciences, Vol. 22, Issue 6
  • DOI: 10.1007/s10596-018-9770-4

Machine learning: Trends, perspectives, and prospects
journal, July 2015


PageRank for Earthquakes
journal, March 2014

  • Aguiar, A. C.; Beroza, G. C.
  • Seismological Research Letters, Vol. 85, Issue 2
  • DOI: 10.1785/0220130162

Watson: Beyond Jeopardy!
journal, June 2013


Random Forests
journal, January 2001


PhaseNet: A Deep-Neural-Network-Based Seismic Arrival Time Picking Method
journal, October 2018

  • Zhu, Weiqiang; Beroza, Gregory C.
  • Geophysical Journal International
  • DOI: 10.1093/gji/ggy423

Dynamic Tuning of Seismic Signal Detector Trigger Levels for Local Networks
journal, March 2018

  • Draelos, Timothy J.; Peterson, Matthew G.; Knox, Hunter A.
  • Bulletin of the Seismological Society of America, Vol. 108, Issue 3A
  • DOI: 10.1785/0120170200

Classification of volcanic ash particles using a convolutional neural network and probability
journal, May 2018