Optimizing neural networks
Abstract
A system and method design and optimize neural networks. The system and method include a data store that stores a plurality of gene vectors that represent diverse and distinct neural networks and an evaluation queue stored with the plurality of gene vectors. Secondary nodes construct, train, and evaluate the neural network and automatically render a plurality of fitness values asynchronously. A primary node executes a gene amplification on a select plurality of gene vectors, a crossing-over of the amplified gene vectors, and a mutation of the crossing-over gene vectors automatically and asynchronously, which are then transmitted to the evaluation queue. The process continuously repeats itself by processing the gene vectors inserted into the evaluation queue until a fitness level is reached, a network's accuracy level plateaus, a processing time period expires, or when some stopping condition or performance metric is met or exceeded.
- Inventors:
- Issue Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1925038
- Patent Number(s):
- 11429865
- Application Number:
- 16/265,252
- Assignee:
- UT-Battelle, LLC (Oak Ridge, TN)
- Patent Classifications (CPCs):
-
G - PHYSICS G06 - COMPUTING G06N - COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
- DOE Contract Number:
- AC05-00OR22725
- Resource Type:
- Patent
- Resource Relation:
- Patent File Date: 02/01/2019
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING
Citation Formats
Patton, Robert M., Young, Steven R., Rose, Derek C., Karnowski, Thomas P., Lim, Seung-Hwan, Potok, Thomas E., and Johnston, J. Travis. Optimizing neural networks. United States: N. p., 2022.
Web.
Patton, Robert M., Young, Steven R., Rose, Derek C., Karnowski, Thomas P., Lim, Seung-Hwan, Potok, Thomas E., & Johnston, J. Travis. Optimizing neural networks. United States.
Patton, Robert M., Young, Steven R., Rose, Derek C., Karnowski, Thomas P., Lim, Seung-Hwan, Potok, Thomas E., and Johnston, J. Travis. Tue .
"Optimizing neural networks". United States. https://www.osti.gov/servlets/purl/1925038.
@article{osti_1925038,
title = {Optimizing neural networks},
author = {Patton, Robert M. and Young, Steven R. and Rose, Derek C. and Karnowski, Thomas P. and Lim, Seung-Hwan and Potok, Thomas E. and Johnston, J. Travis},
abstractNote = {A system and method design and optimize neural networks. The system and method include a data store that stores a plurality of gene vectors that represent diverse and distinct neural networks and an evaluation queue stored with the plurality of gene vectors. Secondary nodes construct, train, and evaluate the neural network and automatically render a plurality of fitness values asynchronously. A primary node executes a gene amplification on a select plurality of gene vectors, a crossing-over of the amplified gene vectors, and a mutation of the crossing-over gene vectors automatically and asynchronously, which are then transmitted to the evaluation queue. The process continuously repeats itself by processing the gene vectors inserted into the evaluation queue until a fitness level is reached, a network's accuracy level plateaus, a processing time period expires, or when some stopping condition or performance metric is met or exceeded.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2022},
month = {8}
}
Works referenced in this record:
Execution of a genetic algorithm with variable evolutionary weights of topological parameters for neural network generation and training
patent-application, March 2019
- Andoni, Sari; Moore, Keith D.; Bonab, Elmira M.
- US Patent Application 15/699353; 20190080240
Evolving Deep Networks Using HPC
conference, January 2017
- Young, Steven R.; Rose, Derek C.; Johnston, Travis
- Proceedings of the Machine Learning on HPC Environments - MLHPC'17
Vertex reconstruction of neutrino interactions using deep learning
conference, May 2017
- Terwilliger, Adam M.; Perdue, Gabriel N.; Isele, David
- 2017 International Joint Conference on Neural Networks (IJCNN)
A New Evolutionary Algorithm for Extracting a Reduced Set of Interesting Association Rules
book, January 2015
- Kabir, Mir Md. Jahangir; Xu, Shuxiang; Kang, Byeong Ho
- Neural Information Processing
GPU-based asynchronous particle swarm optimization
conference, July 2011
- Mussi, Luca; Nashed, Youssef S. G.; Cagnoni, Stefano
- Proceedings of the 13th annual conference on Genetic and evolutionary computation