Monte-Carlo Tree Search for Behavior Planning in Autonomous Driving (2310.12075v1)
Abstract: The integration of autonomous vehicles into urban and highway environments necessitates the development of robust and adaptable behavior planning systems. This study presents an innovative approach to address this challenge by utilizing a Monte-Carlo Tree Search (MCTS) based algorithm for autonomous driving behavior planning. The core objective is to leverage the balance between exploration and exploitation inherent in MCTS to facilitate intelligent driving decisions in complex scenarios. We introduce an MCTS-based algorithm tailored to the specific demands of autonomous driving. This involves the integration of carefully crafted cost functions, encompassing safety, comfort, and passability metrics, into the MCTS framework. The effectiveness of our approach is demonstrated by enabling autonomous vehicles to navigate intricate scenarios, such as intersections, unprotected left turns, cut-ins, and ramps, even under traffic congestion, in real-time. Qualitative instances illustrate the integration of diverse driving decisions, such as lane changes, acceleration, and deceleration, into the MCTS framework. Moreover, quantitative results, derived from examining the impact of iteration time and look-ahead steps on decision quality and real-time applicability, substantiate the robustness of our approach. This robustness is further underscored by the high success rate of the MCTS algorithm across various scenarios.
- G. Shi, L. Zhou, and P. Tokekar, “Robust multiple-path orienteering problem: Securing against adversarial attacks,” IEEE Transactions on Robotics, 2023.
- S. Fedeler, M. Holzinger, and W. Whitacre, “Sensor tasking in the cislunar regime using monte carlo tree search,” Advances in Space Research, vol. 70, no. 3, pp. 792–811, 2022.
- Z. Zhang, J. M. Smereka, J. Lee, L. Zhou, Y. Sung, and P. Tokekar, “Game tree search for minimizing detectability and maximizing visibility,” Autonomous Robots, vol. 45, pp. 283–297, 2021.
- J. Chen, A. Baskaran, Z. Zhang, and P. Tokekar, “Multi-agent reinforcement learning for visibility-based persistent monitoring,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2021, pp. 2563–2570.
- F. Tian, F.-Y. Wang, and L. Li, “Enhancing feedback steering controllers for autonomous vehicles with deep monte carlo tree search,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 10 438–10 445, 2022.
- T. V. Baby and B. HomChaudhuri, “Monte carlo tree search based trajectory generation for automated vehicles in interactive traffic environments,” in 2023 American Control Conference (ACC). IEEE, 2023, pp. 4431–4436.
- K. Kurzer, M. Bitzer, and J. M. Zöllner, “Learning reward models for cooperative trajectory planning with inverse reinforcement learning and monte carlo tree search,” in 2022 IEEE Intelligent Vehicles Symposium (IV). IEEE, 2022, pp. 22–28.
- J. Chen, C. Zhang, J. Luo, J. Xie, and Y. Wan, “Driving maneuvers prediction based autonomous driving control by deep monte carlo tree search,” IEEE transactions on vehicular technology, vol. 69, no. 7, pp. 7146–7158, 2020.
- S. Karimi and A. Vahidi, “Receding horizon motion planning for automated lane change and merge using monte carlo tree search and level-k game theory,” in 2020 American Control Conference (ACC). IEEE, 2020, pp. 1223–1228.
- H. Fan, F. Zhu, C. Liu, L. Zhang, L. Zhuang, D. Li, W. Zhu, J. Hu, H. Li, and Q. Kong, “Baidu apollo em motion planner,” arXiv preprint arXiv:1807.08048, 2018.
- S. Kato, S. Tokunaga, Y. Maruyama, S. Maeda, M. Hirabayashi, Y. Kitsukawa, A. Monrroy, T. Ando, Y. Fujii, and T. Azumi, “Autoware on board: Enabling autonomous vehicles with embedded systems,” in 2018 ACM/IEEE 9th International Conference on Cyber-Physical Systems (ICCPS). IEEE, 2018, pp. 287–296.
- J. Xu, Q. Luo, K. Xu, X. Xiao, S. Yu, J. Hu, J. Miao, and J. Wang, “An automated learning-based procedure for large-scale vehicle dynamics modeling on baidu apollo platform,” in 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 2019, pp. 5049–5056.
- Y. Zhang, H. Sun, J. Zhou, J. Pan, J. Hu, and J. Miao, “Optimal vehicle path planning using quadratic optimization for baidu apollo open platform,” in 2020 IEEE Intelligent Vehicles Symposium (IV). IEEE, 2020, pp. 978–984.
- H. Ebadi, M. H. Moghadam, M. Borg, G. Gay, A. Fontes, and K. Socha, “Efficient and effective generation of test cases for pedestrian detection-search-based software testing of baidu apollo in svl,” in 2021 IEEE International Conference on Artificial Intelligence Testing (AITest). IEEE, 2021, pp. 103–110.
- V. M. Raju, V. Gupta, and S. Lomate, “Performance of open autonomous vehicle platforms: Autoware and apollo,” in 2019 IEEE 5th International Conference for Convergence in Technology (I2CT). IEEE, 2019, pp. 1–5.
- M. Werling, J. Ziegler, S. Kammel, and S. Thrun, “Optimal trajectory generation for dynamic street scenarios in a frenet frame,” in 2010 IEEE international conference on robotics and automation. IEEE, 2010, pp. 987–993.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
