Deep Learning for Subsurface Flow: A Comparative Study of U‐Net, Fourier Neural Operators, and Transformers in Underground Hydrogen Storage
Abstract Subsurface flow research is essential for the sustainable management of natural resources and the environment. Deep learning (DL) has significantly advanced this field by developing efficient and accurate surrogate models to replace computationally expensive physics‐based simulations. These surrogate models are commonly used to predict the spatiotemporal evolution of state variables, such as gas saturation and reservoir pressure, in heterogeneous geological formations. Despite the various DL models applied to this task, there is a lack of studies systematically comparing their performance. This absence of comparative analysis leads to somewhat arbitrary DL model selection in subsurface flow research, resulting in suboptimal performance and potentially inaccurate predictions. To bridge this gap, we conduct a systematic comparison study of three popular DL architectures—U‐Net, Fourier Neural Operators (FNO), and Segmentation Transformer (SETR)—in surrogate modeling of underground hydrogen storage (UHS). We focus on UHS due to its promise of enhancing clean energy resilience and its cyclic operational conditions that represent common scenarios in various subsurface applications. We evaluate the models based on accuracy, training cost, and inference speed. The comparison shows that U‐Net achieves the highest accuracy, followed by SETR and FNO. Despite its lower accuracy, FNO has the highest inference speed. SETR offers competitive accuracy with the least training memory usage, demonstrating the potential of transformers in learning subsurface flow. Our results provide guidance for selecting DL models for surrogate modeling in a wide range of subsurface flow problems.
- Research Organization:
- Los Alamos National Laboratory (LANL), Los Alamos, NM (United States)
- Sponsoring Organization:
- LDRD; Los Alamos National Laboratory (LANL), Los Alamos, NM (United States); USDOE
- Grant/Contract Number:
- 89233218CNA000001
- OSTI ID:
- 2530652
- Report Number(s):
- LA-UR-24-28849; e2024JH000401
- Journal Information:
- Journal of Geophysical Research. Machine Learning and Computation (Online), Journal Name: Journal of Geophysical Research. Machine Learning and Computation (Online) Journal Issue: 1 Vol. 2; ISSN 2993-5210
- Publisher:
- American Geophysical Union (AGU)Copyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
Sparsified time-dependent Fourier neural operators for fusion simulations
Efficient and generalizable nested Fourier-DeepONet for three-dimensional geological carbon sequestration