Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

slimTrain---A Stochastic Approximation Method for Training Separable Deep Neural Networks

Journal Article · · SIAM Journal on Scientific Computing
DOI:https://doi.org/10.1137/21m1452512· OSTI ID:1982997

Not provided.

Research Organization:
US Department of Energy (USDOE), Washington, DC (United States). Office of Science, Advanced Scientific Computing Research (ASCR)
Sponsoring Organization:
USDOE
OSTI ID:
1982997
Journal Information:
SIAM Journal on Scientific Computing, Vol. 44, Issue 4; ISSN 1064-8275
Publisher:
Society for Industrial and Applied Mathematics (SIAM)
Country of Publication:
United States
Language:
English

References (36)

Information-Theoretic Lower Bounds on the Oracle Complexity of Stochastic Convex Optimization journal May 2012
On the Convergence of Block Coordinate Descent Type Methods journal January 2013
Some Notes on Alternating Optimization book January 2002
Model Reduction And Neural Networks For Parametric PDEs journal July 2021
Exact and inexact subsampled Newton methods for optimization journal April 2018
Optimization Methods for Large-Scale Machine Learning journal January 2018
A Stochastic Quasi-Newton Method for Large-Scale Optimization journal January 2016
Iterative Sampled Methods for Massive and Separable Nonlinear Inverse Problems book January 2019
Sampled limited memory methods for massive linear inverse problems journal April 2020
An Efficient Iterative Approach for Large-Scale Separable Nonlinear Inverse Problems journal January 2010
Approximation by superpositions of a sigmoidal function journal December 1989
A Proposal on Machine Learning via Dynamical Systems journal March 2017
The Differentiation of Pseudo-Inverses and Nonlinear Least Squares Problems Whose Variables Separate journal April 1973
Separable nonlinear least squares: the variable projection method and its applications journal February 2003
Generalized Cross-Validation as a Method for Choosing a Good Ridge Parameter journal May 1979
Randomized Quasi-Newton Updates Are Linearly Convergent Matrix Inversion Algorithms journal January 2017
Stable architectures for deep neural networks journal December 2017
Rank-Deficient and Discrete Ill-Posed Problems book January 1998
Deep Residual Learning for Image Recognition conference June 2016
TensorFlow.jl: An Idiomatic Julia Front End for TensorFlow journal November 2018
Efficiency of Coordinate Descent Methods on Huge-Scale Optimization Problems journal January 2012
Variable projection for nonlinear least squares problems journal August 2012
LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares journal March 1982
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations journal February 2019
Iteration complexity of randomized block-coordinate descent methods for minimizing a composite function journal December 2012
A Stochastic Approximation Method journal September 1951
U-Net: Convolutional Networks for Biomedical Image Segmentation
  • Ronneberger, Olaf; Fischer, Philipp; Brox, Thomas
  • Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III https://doi.org/10.1007/978-3-319-24574-4_28
book November 2015
Deep Neural Networks Motivated by Partial Differential Equations journal September 2019
Sampled Tikhonov regularization for large linear inverse problems journal October 2019
Deep UQ: Learning deep neural network surrogate models for high dimensional uncertainty quantification journal December 2018
Computational Methods for Inverse Problems book January 2002
Practical Approximate Solutions to Linear Operator Equations When the Data are Noisy journal September 1977
Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimization journal January 2017
Coordinate descent algorithms journal March 2015
Bayesian deep convolutional encoder–decoder networks for surrogate modeling and uncertainty quantification journal August 2018
Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data journal October 2019

Similar Records

Solving inverse problems in stochastic models using deep neural networks and adversarial training
Journal Article · 2021 · Computer Methods in Applied Mechanics and Engineering · OSTI ID:1788294

Solving inverse problems in stochastic models using deep neural networks and adversarial training
Journal Article · 2021 · Computer Methods in Applied Mechanics and Engineering · OSTI ID:2481069

Solving inverse problems in stochastic models using deep neural networks and adversarial training
Journal Article · 2021 · Computer Methods in Applied Mechanics and Engineering · OSTI ID:1976967

Related Subjects