Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
110 tokens/sec
GPT-4o
56 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
6 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

MOTLEE: Distributed Mobile Multi-Object Tracking with Localization Error Elimination (2304.12175v2)

Published 24 Apr 2023 in cs.RO

Abstract: We present MOTLEE, a distributed mobile multi-object tracking algorithm that enables a team of robots to collaboratively track moving objects in the presence of localization error. Existing approaches to distributed tracking make limiting assumptions regarding the relative spatial relationship of sensors, including assuming a static sensor network or that perfect localization is available. Instead, we develop an algorithm based on the Kalman-Consensus filter for distributed tracking that properly leverages localization uncertainty in collaborative tracking. Further, our method allows the team to maintain an accurate understanding of dynamic objects in the environment by realigning robot frames and incorporating frame alignment uncertainty into our object tracking formulation. We evaluate our method in hardware on a team of three mobile ground robots tracking four people. Compared to previous works that do not account for localization error, we show that MOTLEE is resilient to localization uncertainties, enabling accurate tracking in distributed, dynamic settings with mobile tracking sensors.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (51)
  1. A. Bewley, Z. Ge, L. Ott, F. Ramos, and B. Upcroft, “Simple online and realtime tracking,” in IEEE ICIP, 2016, pp. 3464–3468.
  2. H.-k. Chiu, J. Li, R. Ambruş, and J. Bohg, “Probabilistic 3d multi-modal, multi-object tracking for autonomous driving,” in IEEE ICRA, 2021, pp. 14 227–14 233.
  3. W. Zhang, H. Zhou, S. Sun, Z. Wang, J. Shi, and C. C. Loy, “Robust multi-modality multi-object tracking,” in IEEE/CVF ICCV, 2019.
  4. A. Kim, A. Ošep, and L. Leal-Taixé, “Eagermot: 3d multi-object tracking via sensor fusion,” in IEEE ICRA, 2021, pp. 11 315–11 321.
  5. Y. Wang, V. C. Guizilini, T. Zhang, Y. Wang, H. Zhao, and J. Solomon, “Detr3d: 3d object detection from multi-view images via 3d-to-2d queries,” in Conference on Robot Learning.   PMLR, 2022.
  6. F. Fleuret, J. Berclaz, R. Lengagne, and P. Fua, “Multicamera people tracking with a probabilistic occupancy map,” IEEE TPAMI, 2007.
  7. T. Chavdarova, P. Baqué, S. Bouquet, A. Maksai, C. Jose, T. Bagautdinov, L. Lettry, P. Fua, L. Van Gool, and F. Fleuret, “Wildtrack: A multi-camera hd dataset for dense unscripted pedestrian detection,” in IEEE/CVF CVPR, 2018, pp. 5030–5039.
  8. S. Casao, A. Naya, A. C. Murillo, and E. Montijano, “Distributed multi-target tracking in camera networks,” in IEEE ICRA, 2021.
  9. P. Nguyen, K. G. Quach, C. N. Duong, N. Le, X.-B. Nguyen, and K. Luu, “Multi-camera multiple 3d object tracking on the move for autonomous vehicles,” in IEEE/CVF CVPR, 2022, pp. 2569–2578.
  10. O. Shorinwa, J. Yu, T. Halsted, A. Koufos, and M. Schwager, “Distributed multi-target tracking for autonomous vehicle fleets,” in IEEE ICRA, 2020, pp. 3495–3501.
  11. N. F. Sandell and R. Olfati-Saber, “Distributed data association for multi-target tracking in sensor networks,” in IEEE CDC, 2008.
  12. T. Kroeger, R. Dragon, and L. Van Gool, “Multi-view tracking of multiple targets with dynamic cameras,” in GCPR.   Springer, 2014.
  13. P. Dames and V. Kumar, “Autonomous localization of an unknown number of targets without data association using teams of mobile sensors,” IEEE TASE, vol. 12, no. 3, pp. 850–864, 2015.
  14. P. M. Dames, “Distributed multi-target search and tracking using the phd filter,” Autonomous robots, vol. 44, no. 3-4, pp. 673–689, 2020.
  15. M. E. Liggins, C.-Y. Chong, I. Kadar, M. G. Alford, V. Vannicola, and S. Thomopoulos, “Distributed fusion architectures and algorithms for target tracking,” Proceedings of the IEEE, vol. 85, no. 1, 1997.
  16. M. Taj and A. Cavallaro, “Distributed and decentralized multicamera tracking,” IEEE Signal Processing Magazine, vol. 28, no. 3, 2011.
  17. R. Olfati-Saber, “Distributed kalman filtering for sensor networks,” in IEEE CDC, 2007, pp. 5492–5498.
  18. ——, “Kalman-consensus filter: Optimality, stability, and performance,” in IEEE CDC, 2009, pp. 7036–7042.
  19. S. S. Blackman, “Multiple-target tracking with radar applications,” Dedham, 1986.
  20. W. Luo, J. Xing, A. Milan, X. Zhang, W. Liu, and T.-K. Kim, “Multiple object tracking: A literature review,” Artificial Intelligence, 2021.
  21. L. Zhang, Y. Li, and R. Nevatia, “Global data association for multi-object tracking using network flows,” in IEEE/CVF CVPR, 2008.
  22. M. Yang, Y. Wu, and Y. Jia, “A hybrid data association framework for robust online multi-object tracking,” IEEE TIP, vol. 26, no. 12, 2017.
  23. X. Weng, Y. Wang, Y. Man, and K. M. Kitani, “GNN3DMOT: Graph neural network for 3d multi-object tracking with 2d-3d multi-feature learning,” in IEEE/CVF CVPR, 2020, pp. 6499–6508.
  24. X. Wang, C. Fu, Z. Li, Y. Lai, and J. He, “DeepFusionMOT: A 3d multi-object tracking framework based on camera-lidar fusion with deep association,” IEEE RA-L, vol. 7, no. 3, pp. 8260–8267, 2022.
  25. E. Ristani and C. Tomasi, “Features for multi-target multi-camera tracking and re-identification,” in IEEE/CVF CVPR, June 2018.
  26. Y. T. Tesfaye, E. Zemene, A. Prati, M. Pelillo, and M. Shah, “Multi-target tracking in multiple non-overlapping cameras using fast-constrained dominant sets,” IJCV, vol. 127, pp. 1303–1320, 2019.
  27. C. Soto, B. Song, and A. K. Roy-Chowdhury, “Distributed multi-target tracking in a self-configuring camera network,” in IEEE CVPR, 2009.
  28. H. V. Nguyen, H. Rezatofighi, B.-N. Vo, and D. C. Ranasinghe, “Distributed multi-object tracking under limited field of view sensors,” IEEE Transactions on Signal Processing, pp. 5329–5344, 2021.
  29. L.-L. Ong, B. Upcroft, T. Bailey, M. Ridley, S. Sukkarieh, and H. Durrant-Whyte, “A decentralised particle filtering algorithm for multi-target tracking across multiple flight vehicles,” in IEEE/RSJ IROS, 2006, pp. 4539–4544.
  30. R. Zahroof, J. Liu, L. Zhou, and V. Kumar, “Multi-robot localization and target tracking with connectivity maintenance and collision avoidance,” in IEEE ACC, 2023, pp. 1331–1338.
  31. J. Chen and P. Dames, “Collision-free distributed multi-target tracking using teams of mobile robots with localization uncertainty,” in IEEE/RSJ IROS, 2020, pp. 6968–6974.
  32. C.-C. Wang and C. Thorpe, “Simultaneous localization and mapping with detection and tracking of moving objects,” in IEEE ICRA, 2002.
  33. C.-C. Wang, C. Thorpe, and S. Thrun, “Online simultaneous localization and mapping with detection and tracking of moving objects: Theory and results from a ground vehicle in crowded urban areas,” in IEEE ICRA, 2003, pp. 842–849.
  34. C.-C. Wang, C. Thorpe, S. Thrun, M. Hebert, and H. Durrant-Whyte, “Simultaneous localization, mapping and moving object tracking,” IJRR, vol. 26, no. 9, pp. 889–916, 2007.
  35. W. Choi, C. Pantofaru, and S. Savarese, “A general framework for tracking multiple people from a moving camera,” IEEE TPAMI, vol. 35, no. 7, pp. 1577–1591, 2012.
  36. X. Tian, Z. Zhu, J. Zhao, G. Tian, and C. Ye, “DL-SLOT: Dynamic lidar slam and object tracking based on collaborative graph optimization,” arXiv preprint arXiv:2212.02077, 2022.
  37. H. Zhang, H. Uchiyama, S. Ono, and H. Kawasaki, “Motslam: Mot-assisted monocular dynamic slam using single-view depth estimation,” in IEEE/RSJ IROS, 2022, pp. 4865–4872.
  38. X. Lin, Y. Bar-Shalom, and T. Kirubarajan, “Exact multisensor dynamic bias estimation with local tracks,” IEEE TAES, 2004.
  39. D. Moratuwage, B.-N. Vo, and D. Wang, “Collaborative multi-vehicle slam with moving object tracking,” in IEEE ICRA, 2013.
  40. A. Ahmad, G. D. Tipaldi, P. Lima, and W. Burgard, “Cooperative robot localization and target tracking based on least squares minimization,” in IEEE ICRA, 2013, pp. 5696–5701.
  41. W. Li, Y. Jia, and J. Du, “Event-triggered kalman consensus filter over sensor networks,” IET CTA, pp. 103–110, 2016.
  42. H. W. Kuhn, “The hungarian method for the assignment problem,” Naval Research Logistics Quarterly, vol. 2, no. 1-2, pp. 83–97, 1955.
  43. P. J. Besl and N. D. McKay, “Method for registration of 3-d shapes,” in Sensor fusion IV: control paradigms and data structures, vol. 1611.   Spie, 1992, pp. 586–606.
  44. K. S. Arun, T. S. Huang, and S. D. Blostein, “Least-squares fitting of two 3-d point sets,” IEEE TPAMI, no. 5, pp. 698–700, 1987.
  45. X. Zhou, V. Koltun, and P. Krähenbühl, “Tracking objects as points,” ECCV, 2020.
  46. R. Martίn-Martίn, M. Patel, H. Rezatofighi, A. Shenoi, J. Gwak, E. Frankel, A. Sadeghian, and S. Savarese, “JRDB: A dataset and benchmark of egocentric robot visual perception of humans in built environments,” IEEE TPAMI, vol. 45, no. 6, pp. 6748–6765, 2023.
  47. C. W. Anderson and J. P. How, “Implementation of vision-based navigation for pedestrian environments,” Master’s thesis, MIT, 2022.
  48. K. Bernardin and R. Stiefelhagen, “Evaluating multiple object tracking performance: the CLEAR MOT metrics,” EURASIP Journal on Image and Video Processing, vol. 2008, pp. 1–10, 2008.
  49. C.-Y. Wang, A. Bochkovskiy, and H.-Y. M. Liao, “YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors,” arXiv preprint arXiv:2207.02696, 2022.
  50. M. Krupczak, “Coneslayer: Cone detection weights for yolov7,” [Online]. Available: https://github.com/mkrupczak3/Coneslayer.
  51. P. C. Lusk, K. Fathian, and J. P. How, “CLIPPER: A graph-theoretic framework for robust data association,” in IEEE ICRA, 2021.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (3)
  1. Mason B. Peterson (5 papers)
  2. Parker C. Lusk (14 papers)
  3. Jonathan P. How (159 papers)
Citations (3)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Youtube Logo Streamline Icon: https://streamlinehq.com

YouTube