Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Robust MADER: Decentralized Multiagent Trajectory Planner Robust to Communication Delay in Dynamic Environments (2303.06222v6)

Published 10 Mar 2023 in cs.RO and cs.MA

Abstract: Communication delays can be catastrophic for multiagent systems. However, most existing state-of-the-art multiagent trajectory planners assume perfect communication and therefore lack a strategy to rectify this issue in real-world environments. To address this challenge, we propose Robust MADER (RMADER), a decentralized, asynchronous multiagent trajectory planner robust to communication delay. RMADER ensures safety by introducing (1) a Delay Check step, (2) a two-step trajectory publication scheme, and (3) a novel trajectory-storing-and-checking approach. Our primary contributions include: proving recursive feasibility for collision-free trajectory generation in asynchronous decentralized trajectory-sharing, simulation benchmark studies, and hardware experiments with different network topologies and dynamic obstacles. We show that RMADER outperforms existing approaches by achieving a 100% success rate of collision-free trajectory generation, whereas the next best asynchronous decentralized method only achieves 83% success.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (33)
  1. P. Peng, W. Dong, G. Chen, and X. Zhu, “Obstacle avoidance of resilient uav swarm formation with active sensing system in the dense environment,” arXiv preprint arXiv:2202.13381, 2022.
  2. G. Ryou, E. Tal, and S. Karaman, “Cooperative Multi-Agent Trajectory Generation with Modular Bayesian Optimization.”   Robotics: Science and Systems Foundation, Jun. 2022.
  3. A. P. Vinod, S. Safaoui, A. Chakrabarty, R. Quirynen, N. Yoshikawa, and S. Di Cairano, “Safe multi-agent motion planning via filtered reinforcement learning,” in 2022 ICRA, May 2022, pp. 7270–7276.
  4. Y. Kuwata and J. P. How, “Cooperative Distributed Robust Trajectory Optimization Using Receding Horizon MILP,” IEEE Transactions on Control Systems Technology, vol. 19, no. 2, pp. 423–431, Mar. 2011.
  5. R. Van Parys and G. Pipeleers, “Distributed model predictive formation control with inter-vehicle collision avoidance,” in ASCC, 2017.
  6. R. Firoozi, L. Ferranti, X. Zhang, S. Nejadnik, and F. Borrelli, “A distributed multi-robot coordination algorithm for navigation in tight environments,” arXiv preprint arXiv:2006.11492, 2020.
  7. C. E. Luis, M. Vukosavljev, and A. P. Schoellig, “Online trajectory generation with distributed model predictive control for multi-robot motion planning,” IEEE RA-L, vol. 5, no. 2, pp. 604–611, 2020.
  8. Y. Gao, Y. Wang, X. Zhong, T. Yang, M. Wang, Z. Xu, Y. Wang, Y. Lin, C. Xu, and F. Gao, “Meeting-merging-mission: A multi-robot coordinate framework for large-scale communication-limited exploration,” in 2022 IEEE/RSJ IROS, 2022, pp. 13 700–13 707.
  9. B. Sabetghadam, R. Cunha, and A. Pascoal, “A distributed algorithm for real-time multi-drone collision-free trajectory replanning,” 2022.
  10. S. Batra, Z. Huang, A. Petrenko, T. Kumar, A. Molchanov, and G. S. Sukhatme, “Decentralized Control of Quadrotor Swarms with End-to-end Deep Reinforcement Learning,” in CoRL, Jan. 2022, pp. 576–586.
  11. Z. Wang, C. Xu, and F. Gao, “Robust trajectory planning for spatial-temporal multi-drone coordination in large scenes,” in 2022 IROS.
  12. J. Park, J. Kim, I. Jang, and H. J. Kim, “Efficient Multi-Agent Trajectory Planning with Feasibility Guarantee using Relative Bernstein Polynomial,” in 2020 ICRA, 2020, pp. 434–440.
  13. G. Sharon, R. Stern, A. Felner, and N. R. Sturtevant, “Conflict-based search for optimal multi-agent pathfinding,” Artificial Intelligence, 2015.
  14. D. R. Robinson, R. T. Mar, K. Estabridis, and G. Hewer, “An Efficient Algorithm for Optimal Trajectory Generation for Heterogeneous Multi-Agent Systems in Non-Convex Environments,” IEEE RA-L, vol. 3, no. 2, pp. 1215–1222, Apr. 2018.
  15. J. Tordesillas and J. P. How, “Mader: Trajectory planner in multiagent and dynamic environments,” IEEE T-RO, 2022.
  16. X. Zhou, J. Zhu, H. Zhou, C. Xu, and F. Gao, “EGO-Swarm: A Fully Autonomous and Decentralized Quadrotor Swarm System in Cluttered Environments,” 2020.
  17. P. C. Lusk, X. Cai, S. Wadhwania, A. Paris, K. Fathian, and J. P. How, “A Distributed Pipeline for Scalable, Deconflicted Formation Flying,” IEEE RA-L, vol. 5, no. 4, pp. 5213–5220, Oct. 2020.
  18. L. Wang, A. D. Ames, and M. Egerstedt, “Safety barrier certificates for collisions-free multirobot systems,” IEEE T-RO, 2017.
  19. D. Zhou, Z. Wang, S. Bandyopadhyay, and M. Schwager, “Fast, on-line collision avoidance for dynamic vehicles using buffered voronoi cells,” IEEE RA-L, vol. 2, no. 2, pp. 1047–1054, 2017.
  20. T. Fan, P. Long, W. Liu, and J. Pan, “Distributed multi-robot collision avoidance via deep reinforcement learning for navigation in complex scenarios,” The International Journal of Robotics Research, 2020.
  21. S. H. Semnani, H. Liu, M. Everett, A. de Ruiter, and J. P. How, “Multi-agent motion planning for dense and dynamic environments via deep reinforcement learning,” IEEE RA-L, 2020.
  22. Y. F. Chen, M. Liu, M. Everett, and J. P. How, “Decentralized non-communicating multiagent collision avoidance with deep reinforcement learning,” in 2017 IEEE ICRA, 2017, pp. 285–292.
  23. Y. Chen, A. Singletary, and A. D. Ames, “Guaranteed obstacle avoidance for multi-robot operations with limited actuation: A control barrier function approach,” IEEE Control Systems Letters, 2021.
  24. Y. Chen, M. Cutler, and J. P. How, “Decoupled multiagent path planning via incremental sequential convex programming,” in 2015 ICRA, May 2015, pp. 5954–5961, iSSN: 1050-4729.
  25. S. Liu, K. Mohta, N. Atanasov, and V. Kumar, “Towards Search-based Motion Planning for Micro Aerial Vehicles.”
  26. J. Park, D. Kim, G. C. Kim, D. Oh, and H. J. Kim, “Online Distributed Trajectory Planning for Quadrotor Swarm With Feasibility Guarantee Using Linear Safe Corridor,” IEEE RA-L, vol. 7.
  27. C. Toumieh and A. Lambert, “Decentralized Multi-Agent Planning Using Model Predictive Control and Time-Aware Safe Corridors,” IEEE RA-L, vol. 7, no. 4, pp. 11 110–11 117, Oct. 2022.
  28. J. Hou, X. Zhou, Z. Gan, and F. Gao, “Enhanced Decentralized Autonomous Aerial Swarm with Group Planning.” [Online]. Available: http://arxiv.org/abs/2203.01069
  29. M. Cáp, P. Novák, M. Selecký, J. Faigl, and J. Vokffnek, “Asynchronous decentralized prioritized planning for coordination in multi-robot system,” in 2013 IROS.
  30. S. Baskin and G. Sukhatme, “Asynchronous Real-time Decentralized Multi-Robot Trajectory Planning,” IEEE/RSJ IROS, Oct. 2022.
  31. J. Gielis, A. Shankar, and A. Prorok, “A Critical Review of Communications in Multi-robot Systems,” Current Robotics Reports.
  32. J. Tordesillas and J. P. How, “MINVO Basis: Finding Simplexes with Minimum Volume Enclosing Polynomial Curves,” Computer-Aided Design. [Online]. Available: https://doi.org/10.1016/j.cad.2022.103341
  33. K. Kondo, J. Tordesillas, R. Figueroa, J. Rached, J. Merkel, P. C. Lusk, and J. P. How, “Robust mader: Decentralized and asynchronous multiagent trajectory planner robust to communication delay,” in 2023 IEEE International Conference on Robotics and Automation (ICRA), 2023, pp. 1687–1693.
Citations (8)

Summary

  • The paper introduces Robust MADER (RMADER), a decentralized trajectory planner for UAVs robust to communication delays in dynamic multiagent environments.
  • RMADER incorporates unique features like a delay check process and two-step trajectory publication to maintain collision-free planning despite asynchronous communication.
  • Empirical results show RMADER achieved 100% collision avoidance with communication delays up to 300ms, demonstrating its superior safety performance over existing decentralized planners.

Decentralized Multiagent Trajectory Planning in Dynamic Environments with Robust MADER

The paper "Robust MADER: Decentralized Multiagent Trajectory Planner Robust to Communication Delay in Dynamic Environments" introduces RMADER, an advanced trajectory planning framework for unmanned aerial vehicles (UAVs). This framework aims to address the pervasive issue of communication delays in multiagent systems, which most existing planners overlook by presuming ideal communication environments. The authors tackle the dual challenges of asynchronous communication and dynamic obstacles, which are critical for effectively deploying UAV trajectory planners in real-world scenarios.

Core Contributions and Methodology

RMADER enhances the core capabilities of its predecessor, MADER, by incorporating mechanisms explicitly designed to handle communication delay. These include:

  1. Delay Check Process: This introduces a reliable mechanism to verify trajectory feasibility despite potential delays in receiving updated trajectory data from other agents. It involves a sequential checking approach—check, opt, and comm steps—where trajectories are repeatedly evaluated for collision risks.
  2. Two-Step Trajectory Publication: Distinguishing between optimized and committed trajectory phases ensures only trajectories that can be safely executed and synchronized are shared with peers. This separation helps maintain collision-free path generation across the network.
  3. Trajectory Storing and Checking: Agents maintain records of both previously committed and newly optimized trajectories of other agents. This ensures all possible interactions are considered during trajectory optimization, significantly enhancing robustness against communication irregularities.

Empirical Results

The paper delineates extensive empirical evaluations of RMADER against several state-of-the-art decentralized planners, including MADER, EGO-Swarm, and EDG-Team. It successfully demonstrates RMADER's superiority in terms of safety, showcasing a 100% success rate in collision-free trajectory generation, even with introduced communication delays up to 300 ms. While RMADER offers robust safety guarantees, its thorough checking mechanisms may induce conservativeness, leading to higher travel completion times and occasional deadlocks.

Hardware experiments further validate RMADER's practicality, utilizing centralized and decentralized (mesh) network infrastructures. The robustness of RMADER facilitates high-speed UAV operations in complex environments—reaching velocities up to 5.8 m/s—while successfully avoiding collisions with dynamic obstacles.

Implications and Future Perspectives

The advances brought by RMADER are significant for domains where UAV coordination is crucial, such as logistics, surveillance, and disaster response. By ensuring safety even with significant communication delays, RMADER promotes the feasibility of deploying UAV swarms in real-world, uncontrolled environments.

Looking ahead, refining RMADER's mechanisms to reduce conservatism could help balance performance and safety. Further research into dynamic network topologies and enhancing communication protocols can improve the mesh network's performance, thus extending UAV operation limits. Additionally, exploring adaptive methods that dynamically adjust the trajectory checking processes based on real-time network conditions may yield efficiency gains without compromising safety.

In summary, this paper's contribution lies in addressing a critical gap in multiagent trajectory planning by providing a framework that is both robust to real-world communication delays and effective in dynamic environments. RMADER sets a promising direction for future research, paving the way for autonomous UAV operations to become mainstream in various complex applications.

Youtube Logo Streamline Icon: https://streamlinehq.com