Receding Horizon Markov Game Autonomous Driving Strategy Conference Paper uri icon


  • © 2019 American Automatic Control Council. This paper presents a novel human-like autonomous driving algorithms for lane-changing problem. To this end, we present a multi-agent decision-making scheme by blending game theory with the Markov decision process, forming a Markov game (MG). In this decision-making process, interaction of a subject vehicle (SV) and traffic vehicles (TVs) are captured in a mathematically tractable manner via both a cooperative game (max-max) where vehicles perform their decisions for collective objectives and a noncooperative game (max-min) where vehicles perform their decisions for individual objectives. Strategies of the players are computed via a Receding Horizon (RH) approach where optimal solutions are found through an optimization strategy by taking into account current and future constraints. The proposed approach is evaluated in a human-in-the-Ioop (HIL) environment built around a MATLAB/SimulinkldSPACE realtime simulator where the Markov game-guided SV controller interacts with programmed TV s and one human-driven vehicle (HV). Experimental results show that the Markov game driving strategy is capable of finding a safe gap in multi-move traffic that is consistent with human drivers' behaviours in mandatory lane-changing.

author list (cited authors)

  • Coskun, S., Zhang, Q., Langari, R., & IEEE, ..

publication date

  • January 1, 2019 11:11 AM