Safe Model-Based Off-Policy Reinforcement Learning for Eco-Driving in Connected and Automated Hybrid Electric Vehicles

Zhu, Zhaoxuan; Pivaro, Nicola; Gupta, Shobhit; Gupta, Abhishek; Canova, Marcello

doi:10.1109/tiv.2022.3150668

Safe Model-Based Off-Policy Reinforcement Learning for Eco-Driving in Connected and Automated Hybrid Electric Vehicles

Journal Article · 01 June 2022 · IEEE Transactions on Intelligent Vehicles

DOI:https://doi.org/10.1109/tiv.2022.3150668· OSTI ID:1980523

^[1]; Pivaro, Nicola ^[2]; ^[2]; ^[3]; ^[2]

Center for Automotive Research, The Ohio State University, Columbus, OH, USA; OSTI
Center for Automotive Research, The Ohio State University, Columbus, OH, USA
Department of Electrical and Computer Engineering, The Ohio State University, Columbus, OH, USA

Not provided.

Research Organization:: The Ohio State Univ., Columbus, OH (United States)

Sponsoring Organization:: USDOE Advanced Research Projects Agency - Energy (ARPA-E)

DOE Contract Number:: AR0000794

OSTI ID:: 1980523

Journal Information:: IEEE Transactions on Intelligent Vehicles, Journal Name: IEEE Transactions on Intelligent Vehicles Journal Issue: 2 Vol. 7; ISSN 2379-8858

Publisher:: IEEE

Country of Publication:: United States

Language:: English

References (24)

Application and Evaluation of the Reinforcement Learning Approach to Eco-Driving at Intersections under Infrastructure-to-Vehicle Communications Shi, Junqing; Qiao, Fengxiang; Li, Qing Transportation Research Record: Journal of the Transportation Research Board, Vol. 2672, Issue 25 https://doi.org/10.1177/0361198118796939	journal	October 2018
Eco-Driving of Freight Vehicles With Signal Priority on Congested Arterial Roads Guo, Ge; Wang, Yunpeng IEEE Transactions on Vehicular Technology, Vol. 70, Issue 5 https://doi.org/10.1109/TVT.2021.3070445	journal	May 2021
Optimal Energy Management for HEVs in Eco-Driving Applications Using Bi-Level MPC Guo, Lulu; Gao, Bingzhao; Gao, Ying IEEE Transactions on Intelligent Transportation Systems, Vol. 18, Issue 8 https://doi.org/10.1109/TITS.2016.2634019	journal	August 2017
Optimal Ecodriving Control: Energy-Efficient Driving of Road Vehicles as an Optimal Control Problem Sciarretta, Antonio; De Nunzio, Giovanni; Ojeda, Luis Leon IEEE Control Systems, Vol. 35, Issue 5, p. 71-90 https://doi.org/10.1109/MCS.2015.2449688	journal	October 2015
An integrated MPC and deep reinforcement learning approach to trams-priority active signal control Guo, Ge; Wang, Yunpeng Control Engineering Practice, Vol. 110 https://doi.org/10.1016/j.conengprac.2021.104758	journal	May 2021
Ecological Adaptive Cruise Control for Vehicles With Step-Gear Transmission Based on Reinforcement Learning Li, Guoqiang; Gorges, Daniel IEEE Transactions on Intelligent Transportation Systems, Vol. 21, Issue 11 https://doi.org/10.1109/TITS.2019.2947756	journal	November 2020
Fundamentals of energy efficient driving for combustion engine and electric vehicles: An optimal control perspective Han, Jihun; Vahidi, Ardalan; Sciarretta, Antonio Automatica, Vol. 103 https://doi.org/10.1016/j.automatica.2019.02.031	journal	May 2019
Computation of eco-driving cycles for Hybrid Electric Vehicles: Comparative analysis Maamria, D.; Gillet, K.; Colin, G. Control Engineering Practice, Vol. 71 https://doi.org/10.1016/j.conengprac.2017.10.011	journal	February 2018
Predictive Cruise Control: Utilizing Upcoming Traffic Signal Information for Improving Fuel Economy and Reducing Trip Time Asadi, Behrang; Vahidi, Ardalan IEEE Transactions on Control Systems Technology, Vol. 19, Issue 3 https://doi.org/10.1109/TCST.2010.2047860	journal	May 2011
Power-Based Optimal Longitudinal Control for a Connected Eco-Driving System Jin, Qiu; Wu, Guoyuan; Boriboonsomsin, Kanok IEEE Transactions on Intelligent Transportation Systems, Vol. 17, Issue 10 https://doi.org/10.1109/TITS.2016.2535439	journal	October 2016
Vehicle trajectory optimization for hybrid vehicles taking into account battery state-of-charge Mensing, Felicitas; Trigui, Rochdi; Bideaux, Eric 2012 IEEE Vehicle Power and Propulsion Conference (VPPC) https://doi.org/10.1109/VPPC.2012.6422774	conference	October 2012
A GPU Implementation of a Look-Ahead Optimal Controller for Eco-Driving Based on Dynamic Programming Zhu, Zhaoxuan; Gupta, Shobhit; Pivaro, Nicola 2021 European Control Conference (ECC) https://doi.org/10.23919/ECC54610.2021.9655197	conference	June 2021
Ecological Velocity Planning through Signalized Intersections: A Deep Reinforcement Learning Approach Pozzi, Andrea; Bae, Sangjae; Choi, Yongkeun 2020 59th IEEE Conference on Decision and Control (CDC) https://doi.org/10.1109/CDC42340.2020.9304005	conference	December 2020
Cloud-Based Velocity Profile Optimization for Everyday Driving: A Dynamic-Programming-Based Solution Ozatay, Engin; Onori, Simona; Wollaeger, James IEEE Transactions on Intelligent Transportation Systems, Vol. 15, Issue 6 https://doi.org/10.1109/TITS.2014.2319812	journal	December 2014
Optimal Eco-Driving Control of Connected and Autonomous Vehicles Through Signalized Intersections Sun, Chao; Guanetti, Jacopo; Borrelli, Francesco IEEE Internet of Things Journal, Vol. 7, Issue 5 https://doi.org/10.1109/JIOT.2020.2968120	journal	May 2020
Sample-Based Learning Model Predictive Control for Linear Uncertain Systems Rosolia, Ugo; Borrelli, Francesco 2019 IEEE 58th Conference on Decision and Control (CDC) https://doi.org/10.1109/CDC40024.2019.9030270	conference	December 2019
Reducing Fuel Consumption by Using Information from Connected and Automated Vehicle Modules to Optimize Propulsion System Control Olin, Pete; Aggoune, Karim; Tang, Li SAE Technical Paper Series https://doi.org/10.4271/2019-01-1213	conference	April 2019
Energy saving potentials of connected and automated vehicles Vahidi, Ardalan; Sciarretta, Antonio Transportation Research Part C: Emerging Technologies, Vol. 95 https://doi.org/10.1016/j.trc.2018.09.001	journal	October 2018
A generic dynamic programming Matlab function Sundstrom, Olle; Guzzella, Lino 2009 IEEE International Conference on Control Applications https://doi.org/10.1109/CCA.2009.5281131	conference	July 2009
An Enhanced Driver Model for Evaluating Fuel Economy on Real-World Routes Gupta, Shobhit; Deshpande, Shreshta R.; Tulpule, Punit IFAC-PapersOnLine, Vol. 52, Issue 5 https://doi.org/10.1016/j.ifacol.2019.09.091	journal	January 2019
Microscopic Traffic Simulation using SUMO Lopez, Pablo Alvarez; Wiessner, Evamarie; Behrisch, Michael 2018 21st International Conference on Intelligent Transportation Systems (ITSC) https://doi.org/10.1109/ITSC.2018.8569938	conference	November 2018
Real-Time Ecodriving Control in Electrified Connected and Autonomous Vehicles Using Approximate Dynamic Programing Deshpande, Shreshta Rajakumar; Gupta, Shobhit; Gupta, Abhishek Journal of Dynamic Systems, Measurement, and Control, Vol. 144, Issue 1 https://doi.org/10.1115/1.4053292	journal	January 2022
Safety Augmented Value Estimation From Demonstrations (SAVED): Safe Deep Model-Based RL for Sparse Cost Robotic Tasks Thananjeyan, Brijen; Balakrishna, Ashwin; Rosolia, Ugo IEEE Robotics and Automation Letters, Vol. 5, Issue 2 https://doi.org/10.1109/LRA.2020.2976272	journal	April 2020
Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuning Nagabandi, Anusha; Kahn, Gregory; Fearing, Ronald S. 2018 IEEE International Conference on Robotics and Automation (ICRA) https://doi.org/10.1109/ICRA.2018.8463189	conference	May 2018

Similar Records

Integrated Approximate Dynamic Programming and Equivalent Consumption Minimization Strategy for Eco-Driving in a Connected and Automated Vehicle

Journal Article · 2021 · IEEE Transactions on Vehicular Technology · OSTI ID:1980602

Hierarchical MPC for Robust Eco-Cooling of Connected and Automated Vehicles and Its Application to Electric Vehicle Battery Thermal Management

Journal Article · 2020 · IEEE Transactions on Control Systems Technology · OSTI ID:1848259

Safe Off-Policy Deep Reinforcement Learning Algorithm for Volt-VAR Control in Power Distribution Systems

Journal Article · 2020 · IEEE Transactions on Smart Grid · OSTI ID:1801325

Related Subjects

Computer Science
Engineering
Transportation

Safe Model-Based Off-Policy Reinforcement Learning for Eco-Driving in Connected and Automated Hybrid Electric Vehicles

Citation Formats

References (24)

Similar Records

Related Subjects