Scaling Robust Optimization for Multi-Agent Robotic Systems: A Distributed Perspective (2402.16227v1)
Abstract: This paper presents a novel distributed robust optimization scheme for steering distributions of multi-agent systems under stochastic and deterministic uncertainty. Robust optimization is a subfield of optimization which aims in discovering an optimal solution that remains robustly feasible for all possible realizations of the problem parameters within a given uncertainty set. Such approaches would naturally constitute an ideal candidate for multi-robot control, where in addition to stochastic noise, there might be exogenous deterministic disturbances. Nevertheless, as these methods are usually associated with significantly high computational demands, their application to multi-agent robotics has remained limited. The scope of this work is to propose a scalable robust optimization framework that effectively addresses both types of uncertainties, while retaining computational efficiency and scalability. In this direction, we provide tractable approximations for robust constraints that are relevant in multi-robot settings. Subsequently, we demonstrate how computations can be distributed through an Alternating Direction Method of Multipliers (ADMM) approach towards achieving scalability and communication efficiency. Simulation results highlight the performance of the proposed algorithm in effectively handling both stochastic and deterministic uncertainty in multi-robot systems. The scalability of the method is also emphasized by showcasing tasks with up to 100 agents. The results of this work indicate the promise of blending robust optimization, distribution steering and distributed optimization towards achieving scalable, safe and robust multi-robot control.
- Consensus control for heterogeneous multiagent systems. SIAM Journal on Control and Optimization, 54(3):1719–1738, 2016.
- MOSEK ApS. The MOSEK optimization toolbox for MATLAB manual. Version 9.0., 2019. URL http://docs.mosek.com/9.0/toolbox/index.html.
- Efstathios Bakolas. Finite-horizon covariance control for discrete-time stochastic linear systems subject to input constraints. Automatica, 91:61–68, 2018.
- Constrained covariance steering based tube-mppi. In 2022 American Control Conference (ACC), pages 4197–4202. IEEE, 2022.
- Extending scope of robust optimization: Comprehensive robust counterparts of uncertain problems. Math. Program., 107:63–89, 06 2006a. doi: 10.1007/s10107-005-0679-z.
- Extending scope of robust optimization: Comprehensive robust counterparts of uncertain problems. Mathematical Programming, 107(1-2):63–89, 2006b.
- Convex approach to covariance control with application to stochastic low-thrust trajectory optimization. Journal of Guidance, Control, and Dynamics, 45(11):2061–2075, 2022.
- Adaptive robust optimization for the security constrained unit commitment problem. IEEE Transactions on Power Systems, 28(1):52–63, 2013. doi: 10.1109/TPWRS.2012.2205021.
- Distributed optimization and statistical learning via the alternating direction method of multipliers. Foundations and Trends® in Machine Learning, 3(1):1–122, 2011. ISSN 1935-8237. doi: 10.1561/2200000016.
- Joint trajectory and resource allocation design for energy-efficient secure uav communication systems. IEEE Transactions on Communications, 68(7):4536–4553, 2020. doi: 10.1109/TCOMM.2020.2982152.
- Optimal steering of a linear stochastic system to a final probability distribution, part i. IEEE Trans. Automat. Contr., 61(5):1158–1169, 2015.
- Peter Dorato. A historical review of robust control. IEEE Control Systems Magazine, 7(2):44–47, 1987.
- An overview of collaborative robotic manipulation in multi-robot systems. Annual Reviews in Control, 49:113–127, 2020.
- Real-time stochastic optimal control for multi-agent quadrotor systems. In Proceedings of the International Conference on Automated Planning and Scheduling, volume 26, pages 468–476, 2016.
- CVX: Matlab software for disciplined convex programming, version 2.1. http://cvxr.com/cvx, March 2014.
- Cooperative control of heterogeneous connected vehicle platoons: An adaptive leader-following approach. IEEE Robotics and Automation Letters, 5(2):977–984, 2020. doi: 10.1109/LRA.2020.2966412.
- The MathWorks Inc. Matlab version: 9.13.0 (r2022b), 2022. URL https://www.mathworks.com.
- Differential dynamic programming. Number 24. Elsevier Publishing Company, 1970.
- Convex optimization for finite-horizon robust covariance control of linear stochastic systems. SIAM Journal on Control and Optimization, 59(1):296–319, 2021. doi: 10.1137/20M135090X. URL https://doi.org/10.1137/20M135090X.
- Hierarchical task-space optimal covariance control with chance constraints. IEEE Control Systems Letters, 6:2359–2364, 2022.
- Multi-agent reinforcement learning in stochastic networked systems. Advances in neural information processing systems, 34:7825–7837, 2021.
- Optimal covariance steering for discrete-time linear stochastic systems. arXiv preprint arXiv:2211.00618, 2022.
- Robust mpc with recursive model update. Automatica, 103:461–471, 2019.
- Mean field LQG control in leader-follower stochastic multi-agent systems: Likelihood ratio based adaptation. IEEE Transactions on Automatic Control, 57(11):2801–2816, 2012. doi: 10.1109/TAC.2012.2195797.
- Optimal stochastic vehicle path planning using covariance steering. IEEE Robotics and Automation Letters, 4(3):2276–2281, 2019. doi: 10.1109/LRA.2019.2901546.
- Decentralized Safe Multi-agent Stochastic Optimal Control using Deep FBSDEs and ADMM. In Proceedings of Robotics: Science and Systems, New York City, NY, USA, June 2022. doi: 10.15607/RSS.2022.XVIII.055.
- Introduction, pages 1–18. Springer London, London, 2000. ISBN 978-1-4471-0447-6. doi: 10.1007/978-1-4471-0447-6˙1. URL https://doi.org/10.1007/978-1-4471-0447-6_1.
- Data-driven robust covariance control for uncertain linear systems. arXiv preprint arXiv:2312.05833, 2023.
- A robust optimization approach to closed-loop supply chain network design under uncertainty. Applied mathematical modelling, 35(2):637–649, 2011.
- Robust optimization-based motion planning for high-dof robots under sensing uncertainty. In 2021 IEEE International Conference on Robotics and Automation (ICRA), pages 9724–9730. IEEE, 2021.
- Discrete-time optimal covariance steering via semidefinite programming. arXiv preprint arXiv:2302.14296, 2023.
- Nonlinear uncertainty control with iterative covariance steering. In 2019 IEEE 58th Conference on Decision and Control (CDC), pages 3484–3490, 2019. doi: 10.1109/CDC40024.2019.9029993.
- Distributed Covariance Steering with Consensus ADMM for Stochastic Multi-Agent Systems. In Proceedings of Robotics: Science and Systems, Virtual, July 2021. doi: 10.15607/RSS.2021.XVII.075.
- Distributed model predictive covariance steering. arXiv preprint arXiv:2212.00398, 2022.
- Distributed differential dynamic programming architectures for large-scale multiagent control. IEEE Transactions on Robotics, 39(6):4387–4407, 2023a. doi: 10.1109/TRO.2023.3319894.
- Distributed Hierarchical Distribution Control for Very-Large-Scale Clustered Multi-Agent Systems. In Proceedings of Robotics: Science and Systems, Daegu, Republic of Korea, July 2023b. doi: 10.15607/RSS.2023.XIX.110.
- Swarm robotic behaviors and current applications. Frontiers in Robotics and AI, page 36, 2020.
- Large scale aerial multi-robot coverage path planning. Field Robotics, 2(1), 2022.
- Jeff Shamma. Cooperative control of distributed multi-agent systems. John Wiley & Sons, 2008.
- Towards robust data-driven control synthesis for nonlinear systems with actuation uncertainty. In 2021 60th IEEE Conference on Decision and Control (CDC), pages 6469–6476. IEEE, 2021.
- Direct and indirect methods for trajectory optimization. Annals of operations research, 37(1):357–373, 1992.
- Cooperative path integral control for stochastic multi-agent systems. In 2021 American Control Conference (ACC), pages 1262–1267, 2021. doi: 10.23919/ACC50511.2021.9482942.
- Bridging the gap between optimal trajectory planning and safety-critical control with applications to autonomous vehicles. Automatica, 129:109592, 2021.
- Trajectory distribution control for model predictive path integral control using covariance steering. In 2022 International Conference on Robotics and Automation (ICRA), pages 1478–1484. IEEE, 2022.
- Essentials of robust control, volume 104. Prentice hall Upper Saddle River, NJ, 1998.
- Adaptive online distributed optimal control of very-large-scale robotic systems. IEEE Transactions on Control of Network Systems, 8(2):678–689, 2021. doi: 10.1109/TCNS.2021.3097306.
- Arshiya Taj Abdul (3 papers)
- Augustinos D. Saravanos (13 papers)
- Evangelos A. Theodorou (107 papers)