Development of a Data-Driven Optimal Controller Based on Adaptive Dynamic Programming
Through vehicle-to-vehicle (V2V) communication, both human-driven and autonomous vehicles can actively exchange data, such as velocities and bumper-to-bumper distances. By employing the shared data, control laws with improved performance can be designed for connected and autonomous vehicles (CAVs). The research proposes an adaptive optimal control design method for a platoon mixed with multiple preceding human-driven vehicles and one CAV at the tail, while taking into account human-vehicle interaction and heterogeneous driver behavior. It is shown that, by using reinforcement-based learning and adaptive dynamic programming techniques, a near-optimal controller can be learned from real-time data for CAV with V2V communications, and do so without precise knowledge of car-following parameters of any driver in the platoon. The proposed method allows the CAV controller to adapt to different platoon dynamics caused by unknown and heterogeneous driver-dependent parameters. To improve safety performance during the learning process, our off-policy learning algorithm can leverage both historical data and data collected in real-time, which leads to considerably reduced learning time duration. The effectiveness and efficiency of our proposed method is demonstrated by rigorous proofs and microscopic traffic simulations.
Language
- English
Project
- Status: Completed
-
Contract Numbers:
69A3551747124
-
Sponsor Organizations:
Connected Cities for Smart Mobility towards Accessible and Resilient Transportation Center (C2SMART)
New York University
Tandon School of Engineering
Brooklyn, NY United StatesOffice of the Assistant Secretary for Research and Technology
University Transportation Centers Program
Department of Transportation
Washington, DC United States 20590 -
Managing Organizations:
Connected Cities for Smart Mobility towards Accessible and Resilient Transportation Center (C2SMART)
New York University
Tandon School of Engineering
Brooklyn, NY United States -
Performing Organizations:
New York University Tandon School of Engineering
6 Metrotech Center
Brooklyn, NY United States 11201 -
Principal Investigators:
Ozbay, Kaan
- Start Date: 20180201
- Expected Completion Date: 20191231
- Actual Completion Date: 20191231
- USDOT Program: University Transportation Centers
Subject/Index Terms
- TRT Terms: Autonomous vehicle guidance; Autonomous vehicles; Connected vehicles; Lane changing; Machine learning; Trajectory control
- Subject Areas: Highways; Operations and Traffic Management; Vehicles and Equipment;
Filing Info
- Accession Number: 01712947
- Record Type: Research project
- Source Agency: Connected Cities for Smart Mobility towards Accessible and Resilient Transportation Center (C2SMART)
- Contract Numbers: 69A3551747124
- Files: UTC, RIP
- Created Date: Jul 30 2019 8:15AM