Game-theoretic Occlusion-Aware Motion Planning: an Efficient Hybrid-Information Approach (2309.10901v2)
Abstract: We present a novel algorithm for game-theoretic trajectory planning, tailored for settings in which agents can only observe one another in specific regions of the state space. Such problems arise naturally in the context of multi-robot navigation, where occlusions due to environment geometry naturally mask agents' view of one another. In this paper, we formalize these settings as dynamic games with a hybrid information structure, which interleaves so-called "open-loop" periods (in which agents cannot observe one another) with "feedback" periods (with full state observability). We present two main contributions. First, we study a canonical variant of these hybrid information games in which agents' dynamics are linear, and objectives are convex and quadratic. Here, we build upon classical solution methods for the open-loop and feedback variants of these games to derive an algorithm for the hybrid information case that matches the cubic runtime of the classical settings. Second, we consider a far broader class of problems in which agents' dynamics are nonlinear, and objectives are nonquadratic; we reduce these problems to sequences of hybrid information linear-quadratic games and empirically demonstrate that iteratively solving these simpler problems with the proposed algorithm yields reliable convergence to approximate Nash equilibria through simulation studies of overtaking and intersection traffic scenarios.
- Steven Michael LaValle “A game-theoretic framework for robot motion planning” University of Illinois at Urbana-Champaign, 1995
- Steven M LaValle and Seth Hutchinson “Game theory as a unifying structure for a variety of robot tasks” In Proceedings of 8th IEEE International Symposium on Intelligent Control, 1993, pp. 429–434 IEEE
- SM LaValle “Visibility-based pursuit-evasion: An extension to curved environments” In Proc. IEEE Int. Conf. on Robotics and Automation, Detroit, MI, 1999, 1999, pp. 1677–1682
- “Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation” In IEEE transactions on robotics and automation 18.5 IEEE, 2002, pp. 662–669
- “Motion strategies for maintaining visibility of a moving target” In Proceedings of international conference on robotics and automation 1, 1997, pp. 731–736 IEEE
- Steven M LaValle and Seth A Hutchinson “Optimal motion planning for multiple robots having independent goals” In IEEE Transactions on Robotics and Automation 14.6 IEEE, 1998, pp. 912–925
- Devesh K Jha, Minghui Zhu and Asok Ray “Game theoretic controller synthesis for multi-robot motion planning-part ii: Policy-based algorithms” In IFAC-PapersOnLine 48.22 Elsevier, 2015, pp. 168–173
- “Game theoretic controller synthesis for multi-robot motion planning Part I: Trajectory based algorithms” In 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 1646–1651 IEEE
- Zixu Zhang and Jaime F Fisac “Safe Occlusion-Aware Autonomous Driving via Game-Theoretic Active Perception” In Proceedings of Robotics: Science and Systems, 2021 DOI: 10.15607/RSS.2021.XVII.066
- Rudolf Emil Kalman “Contributions to the theory of optimal control” In Bol. soc. mat. mexicana 5.2, 1960, pp. 102–119
- Rudolph Emil Kalman “A new approach to linear filtering and prediction problems”, 1960
- David Mayne “A second-order gradient method for determining optimal trajectories of non-linear discrete-time systems” In International Journal of Control 3.1 Taylor & Francis, 1966, pp. 85–95
- David H Jacobson and David Q Mayne “Differential dynamic programming” Elsevier Publishing Company, 1970
- “Iterative linear quadratic regulator design for nonlinear biological movement systems.” In ICINCO (1), 2004, pp. 222–229 Citeseer
- Yuval Tassa, Nicolas Mansard and Emo Todorov “Control-limited differential dynamic programming” In 2014 IEEE International Conference on Robotics and Automation (ICRA), 2014, pp. 1168–1175 IEEE
- “A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems” In Proceedings of the 2005, American Control Conference, 2005., 2005, pp. 300–306 IEEE
- “A mathematical theory of adaptive control processes” In Proceedings of the National Academy of Sciences 45.8 National Acad Sciences, 1959, pp. 1288–1290
- “Efficient iterative linear-quadratic approximations for nonlinear multi-player general-sum differential games” In 2020 IEEE international conference on robotics and automation (ICRA), 2020, pp. 1475–1481 IEEE
- Tamer Başar and Geert Jan Olsder “Dynamic noncooperative game theory” SIAM, 1998
- Lev Semenovich Pontryagin “Mathematical theory of optimal processes” CRC press, 1987
- “Robust benchmarking in noisy environments” In arXiv preprint arXiv:1608.04295, 2016
- Lasse Peters and Zachary N Sunberg “iLQGames. jl: Rapidly Designing and Solving Differential Games in Julia” In arXiv preprint arXiv:2002.10185, 2020