Neural node network and model, and method of teaching same
The present invention is a fully connected feed forward network that includes at least one hidden layer. The hidden layer includes nodes in which the output of the node is fed back to that node as an input with a unit delay produced by a delay device occurring in the feedback path (local feedback). Each node within each layer also receives a delayed output (crosstalk) produced by a delay unit from all the other nodes within the same layer. The node performs a transfer function operation based on the inputs from the previous layer and the delayed outputs. The network can be implemented as analog or digital or within a general purpose processor. Two teaching methods can be used: (1) back propagation of weight calculation that includes the local feedback and the crosstalk or (2) more preferably a feed forward gradient decent which immediately follows the output computations and which also includes the local feedback and the crosstalk. Subsequent to the gradient propagation, the weights can be normalized, thereby preventing convergence to a local optimum. Education of the network can be incremental both on and off-line. An educated network is suitable for modeling and controlling dynamic nonlinear systems and time series systems and predicting the outputs as well as hidden states and parameters. The educated network can also be further educated during on-line processing. 21 figs.
- Research Organization:
- Texas A & M Univ., College Station, TX (United States). Texas A & M Engineering Experiment Station
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- FG07-89ER12893
- Assignee:
- Texas A and M Univ. System, College Station, TX (United States)
- Patent Number(s):
- US 5,479,571/A/
- Application Number:
- PAN: 8-046,936; CNN: Grant NAG9-491
- OSTI ID:
- 170476
- Resource Relation:
- Other Information: PBD: 26 Dec 1995
- Country of Publication:
- United States
- Language:
- English
Similar Records
Character Recognition Using Genetically Trained Neural Networks
A neural network model to predict lung radiation-induced pneumonitis