Home

About

Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network
FAQHELPSITE MAPCONTACT US


  Advanced Search  

 
Reinforcement Learning, Neural Networks and PI Control Applied to a Heating Coil
 

Summary: Reinforcement Learning, Neural Networks and PI Control Applied to a
Heating Coil
Charles W. Anderson1, Douglas C. Hittle2, Alon D. Katz2, and R. Matt Kretchmar1
1Department of Computer Science
Colorado State University
Fort Collins, CO 80523
fanderson,kretchmag@cs.colostate.edu
2Department of Mechanical Engineering
Colorado State University
Fort Collins, CO 80523
fhittle,along@lamar.colostate.edu
Abstract
An accurate simulation of a heating coil is used to compare the performance of a PI controller, a neural
network trained to predict the steady-state output of the PI controller, a neural network trained to minimize
the n-step ahead error between the coil output and the set point, and a reinforcement learning agent trained
to minimize the sum of the squared error over time. Although the PI controller works very well for this
task, the neural networks do result in improved performance.
1 Introduction
Typical methods for designing fixed feedback controllers results in sub-optimal control performance. In
many situations, the degree of uncertainty in the model of the system being controlled limits the utility of

  

Source: Anderson, Charles W. - Department of Computer Science, Colorado State University
Kretchmar, R. Matthew - Department of Mathematics and Computer Science, Denison University

 

Collections: Computer Technologies and Information Sciences