STSR-INR: Spatiotemporal super-resolution for multivariate time-varying volumetric data via implicit neural representation
- University of Notre Dame, IN (United States)
Implicit neural representation (INR) has surfaced as a promising direction for solving different scientific visualization tasks due to its continuous representation and flexible input and output settings. We present STSR-INR, an INR solution for generating simultaneous spatiotemporal super-resolution for multivariate time-varying volumetric data. Inheriting the benefits of the INR-based approach, STSR-INR supports unsupervised learning and permits data upscaling with arbitrary spatial and temporal scale factors. Unlike existing GAN- or INR-based super-resolution methods, STSR-INR focuses on tackling variables or ensembles and enabling joint training across datasets of various spatiotemporal resolutions. Here we achieve this capability via a variable embedding scheme that learns latent vectors for different variables. In conjunction with a modulated structure in the network design, we employ a variational auto-decoder to optimize the learnable latent vectors to enable latent-space interpolation. To combat the slow training of INR, we leverage a multi-head strategy to improve training and inference speed with significant speedup. We demonstrate the effectiveness of STSR-INR with multiple scalar field datasets and compare it with conventional tricubic+linear interpolation and state-of-the-art deep-learning-based solutions (STNet and CoordNet).
- Research Organization:
- University of Notre Dame, IN (United States)
- Sponsoring Organization:
- USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); National Science Foundation (NSF)
- Grant/Contract Number:
- SC0023145; IIS-1955395; IIS-2101696; OAC-2104158
- OSTI ID:
- 2281315
- Alternate ID(s):
- OSTI ID: 2305424
- Journal Information:
- Computers and Graphics, Vol. 119; ISSN 0097-8493
- Publisher:
- ElsevierCopyright Statement
- Country of Publication:
- United States
- Language:
- English
Similar Records
NeRVI: Compressive neural representation of visualization images for communicating volume visualization results
Influence of Vegetation Canopy Architecture on Dynamics of Spatiotemporal Light Distribution and its Effect on Land-Biosphere-Atmosphere Fluxes of Energy, Carbon, and Water