DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Evolutionary vs imitation learning for neuromorphic control at the edge*

Journal Article · · Neuromorphic Computing and Engineering

Abstract Neuromorphic computing offers the opportunity to implement extremely low power artificial intelligence at the edge. Control applications, such as autonomous vehicles and robotics, are also of great interest for neuromorphic systems at the edge. It is not clear, however, what the best neuromorphic training approaches are for control applications at the edge. In this work, we implement and compare the performance of evolutionary optimization and imitation learning approaches on an autonomous race car control task using an edge neuromorphic implementation. We show that the evolutionary approaches tend to achieve better performing smaller network sizes that are well-suited to edge deployment, but they also take significantly longer to train. We also describe a workflow to allow for future algorithmic comparisons for neuromorphic hardware on control applications at the edge.

Sponsoring Organization:
USDOE
Grant/Contract Number:
AC05-00OR22725
OSTI ID:
1841439
Journal Information:
Neuromorphic Computing and Engineering, Journal Name: Neuromorphic Computing and Engineering Journal Issue: 1 Vol. 2; ISSN 2634-4386
Publisher:
IOP PublishingCopyright Statement
Country of Publication:
United Kingdom
Language:
English

References (23)

A Braitenberg Vehicle Based on Memristive Neuromorphic Circuits journal November 2019
Complex Trajectory Tracking Using PID Control for Autonomous Driving journal September 2019
Smart grid encounters edge computing: opportunities and applications journal February 2021
A historical survey of algorithms and hardware architectures for neural-inspired and neuromorphic computing applications journal January 2017
Recent advances in physical reservoir computing: A review journal July 2019
Life Cycle Assessment of Connected and Automated Vehicles: Sensing and Computing Subsystem and Vehicle Level Effects journal February 2018
Training deep neural networks for binary communication with the Whetstone method journal January 2019
LiDAR-driven spiking neural network for collision avoidance in autonomous driving journal October 2021
Closed-Loop Spiking Control on a Neuromorphic Processor Implemented on the iCub journal December 2020
Advancing Neuromorphic Computing With Loihi: A Survey of Results and Outlook journal May 2021
The TENNLab Exploratory Neuromorphic Computing Framework journal July 2018
Evolved Neuromorphic Control for High Speed Divergence-Based Landings of MAVs journal October 2020
Event-Based Neuromorphic Vision for Autonomous Driving: A Paradigm Shift for Bio-Inspired Visual Sensing and Perception journal July 2020
Nvidia makes it easy to embed AI: The Jetson nano packs a lot of machine-learning power into DIY projects - [Hands on] journal July 2020
Real-Time Ultra-Low Power ECG Anomaly Detection Using an Event-Driven Neuromorphic Processor journal December 2019
A memristor-based hybrid analog-digital computing platform for mobile robotics journal October 2020
Neuromorphic Computing for Autonomous Racing conference October 2021
Imitation learning for agile autonomous driving journal October 2019
Three-dimensional walking of a simulated muscle-driven quadruped robot with neuromorphic two-level central pattern generators journal November 2019
Towards neuromorphic control: A spiking neural network based PID controller for UAV conference July 2020
Event-Based Robotic Grasping Detection With Neuromorphic Vision Sensor and Event-Grasping Dataset journal October 2020
Neuromorphic NEF-Based Inverse Kinematics and PID Control journal February 2021
Demonstrating Advantages of Neuromorphic Computation: A Pilot Study journal March 2019