Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
140 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Safe and Scalable Real-Time Trajectory Planning Framework for Urban Air Mobility (2306.11647v1)

Published 20 Jun 2023 in cs.RO, cs.SY, and eess.SY

Abstract: This paper presents a real-time trajectory planning framework for Urban Air Mobility (UAM) that is both safe and scalable. The proposed framework employs a decentralized, free-flight concept of operation in which each aircraft independently performs separation assurance and conflict resolution, generating safe trajectories by accounting for the future states of nearby aircraft. The framework consists of two main components: a data-driven reachability analysis tool and an efficient Markov Decision Process (MDP) based decision maker. The reachability analysis over-approximates the reachable set of each aircraft through a discrepancy function learned online from simulated trajectories. The decision maker, on the other hand, uses a 6-degrees-of-freedom guidance model of fixed-wing aircraft to ensure collision-free trajectory planning. Additionally, the proposed framework incorporates reward shaping and action shielding techniques to enhance safety performance. The proposed framework is evaluated through simulation experiments involving up to 32 aircraft in a UAM setting, with performance measured by the number of Near Mid Air Collisions (NMAC) and computational time. The results demonstrate the safety and scalability of the proposed framework.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Patterson, M. D., Antcliff, K. R., and Kohlman, L. W., “A proposed approach to studying urban air mobility missions including an initial exploration of mission requirements,” , 2018. URL https://ntrs.nasa.gov/citations/20190000991, accessed on 03.29.2022.
  2. Gipson, L., “NASA Embraces Urban Air Mobility, Calls for Market Study,” , Nov 2017. URL https://www.nasa.gov/aero/nasa-embraces-urban-air-mobility/, accessed on 06.08.2021.
  3. “Uber Elevate | The Future of Urban Air Transport,” , 2017. URL https://www.uber.com/us/en/elevate/, accessed on 06.08.2021.
  4. Holden, J., and Goel, N., “Fast-forwarding to a future of on-demand urban air transportation,” San Francisco, CA, 2016.
  5. “Urban Air Mobility,” , 2018. URL http://publicaffairs.airbus.com/default/public-affairs/int/en/our-topics/Urban-Air-Mobility.html, accessed on 08.13.2018.
  6. Airbus, “Future of urban mobility,” , Apr 2019. URL https://www.airbus.com/newsroom/news/en/2016/12/My-Kind-Of-Flyover.html, accessed on 06.08.2021.
  7. Hoekstra, J. M., van Gent, R. N., and Ruigrok, R. C., “Designing for safety: the ‘free flight’air traffic management concept,” Reliability Engineering & System Safety, Vol. 75, No. 2, 2002, pp. 215–232.
  8. Bilimoria, K., Sheth, K., Lee, H., and Grabbe, S., “Performance evaluation of airborne separation assurance for free flight,” 18th Applied Aerodynamics Conference, 2000, p. 4269.
  9. Valenti Clari, M., Ruigrok, R., and Hoekstra, J., “Cost-benefit study of free flight with airborne separation assurance,” AIAA Guidance, Navigation, and Control Conference and Exhibit, 2001, p. 4361.
  10. Tomlin, C., Pappas, G. J., and Sastry, S., “Conflict resolution for air traffic management: A study in multiagent hybrid systems,” IEEE Transactions on automatic control, Vol. 43, No. 4, 1998, pp. 509–521.
  11. Kahne, S., and Frolow, I., “Air traffic management: Evolution with technology,” IEEE Control Systems Magazine, Vol. 16, No. 4, 1996, pp. 12–21.
  12. Harman, W. H., “TCAS- A system for preventing midair collisions,” The Lincoln Laboratory Journal, Vol. 2, No. 3, 1989, pp. 437–457.
  13. Frazzoli, E., Mao, Z.-H., Oh, J.-H., and Feron, E., “Resolution of conflicts involving many aircraft via semidefinite programming,” Journal of Guidance, Control, and Dynamics, Vol. 24, No. 1, 2001, pp. 79–86.
  14. Raghunathan, A. U., Gopal, V., Subramanian, D., Biegler, L. T., and Samad, T., “Dynamic optimization strategies for three-dimensional conflict resolution of multiple aircraft,” Journal of Guidance, Control, and Dynamics, Vol. 27, No. 4, 2004, pp. 586–594.
  15. Enright, P. J., and Conway, B. A., “Discrete approximations to optimal trajectories using direct transcription and nonlinear programming,” Journal of Guidance, Control, and Dynamics, Vol. 15, No. 4, 1992, pp. 994–1002.
  16. Schouwenaars, T., De Moor, B., Feron, E., and How, J., “Mixed integer programming for multi-vehicle path planning,” 2001 European Control Conference (ECC), IEEE, 2001, pp. 2603–2608.
  17. Richards, A., and How, J. P., “Aircraft trajectory planning with collision avoidance using mixed integer linear programming,” Proceedings of the 2002 American Control Conference (IEEE Cat. No. CH37301), Vol. 3, IEEE, 2002, pp. 1936–1941.
  18. Pallottino, L., Feron, E. M., and Bicchi, A., “Conflict resolution problems for air traffic management systems solved with mixed integer programming,” IEEE Transactions on Intelligent Transportation Systems, Vol. 3, No. 1, 2002, pp. 3–11.
  19. Vela, A., Solak, S., Singhose, W., and Clarke, J.-P., “A mixed integer program for flight-level assignment and speed control for conflict resolution,” Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference, IEEE, 2009, pp. 5219–5226.
  20. Mellinger, D., Kushleyev, A., and Kumar, V., “Mixed-integer quadratic program trajectory generation for heterogeneous quadrotor teams,” 2012 IEEE International Conference on Robotics and Automation, IEEE, 2012, pp. 477–483.
  21. Augugliaro, F., Schoellig, A. P., and D’Andrea, R., “Generation of collision-free trajectories for a quadrocopter fleet: A sequential convex programming approach,” 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, IEEE, 2012, pp. 1917–1922.
  22. Morgan, D., Chung, S.-J., and Hadaegh, F. Y., “Model predictive control of swarms of spacecraft using sequential convex programming,” Journal of Guidance, Control, and Dynamics, Vol. 37, No. 6, 2014, pp. 1725–1740.
  23. Acikmese, B., and Ploen, S. R., “Convex programming approach to powered descent guidance for mars landing,” Journal of Guidance, Control, and Dynamics, Vol. 30, No. 5, 2007, pp. 1353–1366.
  24. Delahaye, D., Peyronne, C., Mongeau, M., and Puechmorel, S., “Aircraft conflict resolution by genetic algorithm and B-spline approximation,” Proceedings of ENRI Int. Workshop on ATM/CNS. Tokyo, Japan, Vol. 4, 2010, pp. 71–77.
  25. Cobano, J. A., Conde, R., Alejo, D., and Ollero, A., “Path planning based on genetic algorithms and the monte-carlo method to avoid aerial vehicle collisions under uncertainties,” 2011 IEEE International Conference on Robotics and Automation, IEEE, 2011, pp. 4429–4434.
  26. Razzaghi, P., Tabrizian, A., Guo, W., Chen, S., Taye, A., Thompson, E., and Wei, P., “A Survey on Reinforcement Learning in Aviation Applications. arXiv 2022,” arXiv preprint arXiv:2211.02147, ????
  27. Pontani, M., and Conway, B. A., “Particle swarm optimization applied to space trajectories,” Journal of Guidance, Control, and Dynamics, Vol. 33, No. 5, 2010, pp. 1429–1441.
  28. Pallottino, L., Scordio, V. G., Frazzoli, E., and Bicchi, A., “Probabilistic verification of a decentralized policy for conflict resolution in multi-agent systems,” Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006., IEEE, 2006, pp. 2448–2453.
  29. Bertram, J., and Wei, P., “Distributed computational guidance for high-density urban air mobility with cooperative and non-cooperative collision avoidance,” AIAA Scitech 2020 Forum, 2020, p. 1371.
  30. Duggirala, P. S., Mitra, S., Viswanathan, M., and Potok, M., “C2E2: A verification tool for stateflow models,” Tools and Algorithms for the Construction and Analysis of Systems: 21st International Conference, TACAS 2015, Held as Part of the European Joint Conferences on Theory and Practice of Software, ETAPS 2015, London, UK, April 11-18, 2015, Proceedings 21, Springer, 2015, pp. 68–82.
  31. Larsen, K. G., Pettersson, P., and Yi, W., “UPPAAL in a nutshell,” International Journal on Software Tools for Technology Transfer, Vol. 1, 1997, pp. 134–152.
  32. Wang, Y., Huang, C., Wang, Z., Wang, Z., and Zhu, Q., “Design-while-verify: correct-by-construction control learning with verification in the loop,” Proceedings of the 59th ACM/IEEE Design Automation Conference, 2022, pp. 925–930.
  33. Fan, C., Qin, Z., Mathur, U., Ning, Q., Mitra, S., and Viswanathan, M., “Controller synthesis for linear system with reach-avoid specifications,” IEEE Transactions on Automatic Control, Vol. 67, No. 4, 2021, pp. 1713–1727.
  34. Fisac, J. F., Chen, M., Tomlin, C. J., and Sastry, S. S., “Reach-avoid problems with time-varying dynamics, targets and constraints,” Proceedings of the 18th International Conference on Hybrid Systems: Computation and Control, 2015, pp. 11–20.
  35. Bansal, S., Chen, M., Herbert, S., and Tomlin, C. J., “Hamilton-Jacobi reachability: A brief overview and recent advances,” 2017 IEEE 56th Annual Conference on Decision and Control (CDC), IEEE, 2017, pp. 2242–2253.
  36. Althoff, M., “An introduction to CORA 2015,” Proc. of the Workshop on Applied Verification for Continuous and Hybrid Systems, 2015.
  37. Frehse, G., Le Guernic, C., Donzé, A., Cotton, S., Ray, R., Lebeltel, O., Ripado, R., Girard, A., Dang, T., and Maler, O., “SpaceEx: Scalable verification of hybrid systems,” International Conference on Computer Aided Verification, Springer, 2011, pp. 379–395.
  38. Chen, X., Ábrahám, E., and Sankaranarayanan, S., “Flow*: An analyzer for non-linear hybrid systems,” International Conference on Computer Aided Verification, Springer, 2013, pp. 258–263.
  39. Fan, C., Qi, B., Mitra, S., and Viswanathan, M., “DryVR: Data-Driven Verification and Compositional Reasoning for Automotive Systems,” Computer Aided Verification, edited by R. Majumdar and V. Kunčak, Springer International Publishing, Cham, 2017, pp. 441–461.
  40. Hsieh, C., Sibai, H., Taylor, H., Ni, Y., and Mitra, S., “SkyTrakx: A Toolkit for Simulation and Verification of Unmanned Air-Traffic Management Systems,” 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), IEEE, 2021, pp. 372–379.
  41. Taye, A. G., Bertram, J., Fan, C., and Wei, P., “Reachability based Online Safety Verification for High-Density Urban Air Mobility Trajectory Planning,” AIAA AVIATION 2022 Forum, 2022, p. 3542.
  42. Jackson, P., Munson, K., Peacock, L., Bushell, S., and Willis, D., “All the world’s aircraft,” Jane’s Information Group Ltd., Surrey, UK, 2004.
  43. Bertram, J., Wei, P., and Zambreno, J., “A Fast Markov Decision Process-Based Algorithm for Collision Avoidance in Urban Air Mobility,” IEEE Transactions on Intelligent Transportation Systems, Vol. 23, No. 9, 2022, pp. 15420–15433. 10.1109/TITS.2022.3140724.
  44. Duggirala, P. S., Mitra, S., and Viswanathan, M., “Verification of annotated models from executions,” 2013 Proceedings of the International Conference on Embedded Software (EMSOFT), IEEE, 2013, pp. 1–10.
  45. Fan, C., and Mitra, S., “Bounded verification with on-the-fly discrepancy computation,” International Symposium on Automated Technology for Verification and Analysis, Springer, 2015, pp. 446–463.
  46. Chen, S., Evans, A., Brittain, M., and Wei, P., “Integrated Conflict Management for UAM with Strategic Demand Capacity Balancing and Learning-based Tactical Deconfliction,” arXiv preprint arXiv:2305.10556, 2023.
  47. Könighofer, B., Lorber, F., Jansen, N., and Bloem, R., “Shield synthesis for reinforcement learning,” Leveraging Applications of Formal Methods, Verification and Validation: Verification Principles: 9th International Symposium on Leveraging Applications of Formal Methods, ISoLA 2020, Rhodes, Greece, October 20–30, 2020, Proceedings, Part I 9, Springer, 2020, pp. 290–306.
  48. Memarian, F., Goo, W., Lioutikov, R., Niekum, S., and Topcu, U., “Self-supervised online reward shaping in sparse-reward environments,” 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, 2021, pp. 2369–2375.
  49. Ng, A. Y., Harada, D., and Russell, S., “Policy invariance under reward transformations: Theory and application to reward shaping,” ICML, Vol. 99, 1999, pp. 278–287.
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now