Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
162 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Generation of skill-specific maps from graph world models for robotic systems (2402.18174v1)

Published 28 Feb 2024 in cs.RO

Abstract: With the increase in the availability of Building Information Models (BIM) and (semi-) automatic tools to generate BIM from point clouds, we propose a world model architecture and algorithms to allow the use of the semantic and geometric knowledge encoded within these models to generate maps for robot localization and navigation. When heterogeneous robots are deployed within an environment, maps obtained from classical SLAM approaches might not be shared between all agents within a team of robots, e.g. due to a mismatch in sensor type, or a difference in physical robot dimensions. Our approach extracts the 3D geometry and semantic description of building elements (e.g. material, element type, color) from BIM, and represents this knowledge in a graph. Based on queries on the graph and knowledge of the skills of the robot, we can generate skill-specific maps that can be used during the execution of localization or navigation tasks. The approach is validated with data from complex build environments and integrated into existing navigation frameworks.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (34)
  1. A. Farinelli, E. Zanotto, E. Pagello et al., “Advanced approaches for multi-robot coordination in logistic scenarios,” Robotics and Autonomous Systems, vol. 90, pp. 34–44, 2017.
  2. S. Fountas, N. Mylonas, I. Malounas, E. Rodias, C. Hellmann Santos, and E. Pekkeriet, “Agricultural robotics for field operations,” Sensors, vol. 20, no. 9, p. 2672, 2020.
  3. M. Tenorth and M. Beetz, “Representations for robot knowledge in the knowrob framework,” Artificial Intelligence, vol. 247, pp. 151–169, 2017.
  4. M. Waibel, M. Beetz, J. Civera, R. d’Andrea, J. Elfring, D. Galvez-Lopez, K. Häussermann, R. Janssen, J. Montiel, A. Perzylo et al., “Roboearth,” IEEE Robotics & Automation Magazine, vol. 18, no. 2, pp. 69–82, 2011.
  5. “Industry Foundation Classes (IFC) - buildingSMART Technical,” (Accessed on 5 Feb., 2024). [Online]. Available: https://technical.buildingsmart.org/standards/ifc/
  6. R. de Koning, E. Torta, P. Pauwels, R. Hendrikx, and M. van de Molengraft, “Queries on semantic building digital twins for robot navigation,” in 9th Linked Data in Architecture and Construction Workshop, LDAC 2021.   CEUR-WS. org, 2021, pp. 32–42.
  7. R. Hendrikx, P. Pauwels, E. Torta, H. P. Bruyninckx, and M. van de Molengraft, “Connecting semantic building information models and robotics: An application to 2d lidar-based localization,” in 2021 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2021, pp. 11 654–11 660.
  8. P. Pauwels, R. de Koning, B. Hendrikx, and E. Torta, “Live semantic data from building digital twins for robot navigation: Overview of data transfer methods,” Advanced Engineering Informatics, vol. 56, p. 101959, 2023.
  9. R. He, M. Li, V. J. Gan, and J. Ma, “Bim-enabled computerized design and digital fabrication of industrialized buildings: A case study,” Journal of Cleaner Production, vol. 278, p. 123505, 2021.
  10. F. Bosché, “Automated recognition of 3d cad model objects in laser scans and calculation of as-built dimensions for dimensional compliance control in construction,” Advanced Engineering Informatics, vol. 24, no. 1, pp. 107–118, 2010, informatics for cognitive robots.
  11. F. Bosché, M. Ahmed, Y. Turkan, C. T. Haas, and R. Haas, “The value of integrating scan-to-bim and scan-vs-bim techniques for construction monitoring using laser scanning and bim: The case of cylindrical mep components,” Automation in Construction, vol. 49, pp. 201–213, 2015, 30th ISARC Special Issue.
  12. M. Soilán, A. Justo, A. Sánchez-Rodríguez, and B. Riveiro, “3d point cloud to bim: Semi-automated framework to define ifc alignment entities from mls-acquired lidar data of highway roads,” Remote Sensing, vol. 12, no. 14, p. 2301, 2020.
  13. T. Qu and W. Sun, “Usage of 3d point cloud data in bim (building information modelling): Current applications and challenges,” Journal of Civil Engineering and Architecture, vol. 9, no. 11, pp. 1269–1278, 2015.
  14. L. Riazuelo, M. Tenorth, D. Di Marco, M. Salas, D. Gálvez-López, L. Mösenlechner, L. Kunze, M. Beetz, J. D. Tardós, L. Montano et al., “Roboearth semantic mapping: A cloud enabled knowledge-based approach,” IEEE Transactions on Automation Science and Engineering, vol. 12, no. 2, pp. 432–443, 2015.
  15. M. Tenorth and M. Beetz, “Knowrob: A knowledge processing infrastructure for cognition-enabled robots,” The International Journal of Robotics Research, vol. 32, no. 5, pp. 566–590, 2013.
  16. M. Beetz, D. Beßler, A. Haidu, M. Pomarlan, A. K. Bozcuoğlu, and G. Bartels, “Know rob 2.0—a 2nd generation knowledge processing framework for cognition-enabled robotic agents,” in 2018 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2018, pp. 512–519.
  17. R. Sakagami, F. S. Lay, A. Dömel, M. J. Schuster, A. Albu-Schäffer, and F. Stulp, “Robotic world models—conceptualization, review, and engineering best practices,” Frontiers in Robotics and AI, vol. 10, 2023.
  18. H. Bruyninckx, “Building blocks for the design of complicated systems featuring situational awareness,” 2021, (Accessed on 5 Feb., 2024). [Online]. Available: https://robmosys.pages.gitlab.kuleuven.be/
  19. P. Pauwels, A. Costin, and M. H. Rasmussen, “Knowledge graphs and linked data for the built environment,” in Industry 4.0 for the Built Environment: Methodologies, Technologies and Skills.   Springer, 2021, pp. 157–183.
  20. A. Olivares-Alarcos, D. Beßler, A. Khamis, P. Goncalves, M. K. Habib, J. Bermejo-Alonso, M. Barreto, M. Diab, J. Rosell, J. Quintas et al., “A review and comparison of ontology-based approaches to robot autonomy,” The Knowledge Engineering Review, vol. 34, p. e29, 2019.
  21. H. Yin, Z. Lin, and J. K. Yeoh, “Semantic localization on bim-generated maps using a 3d lidar sensor,” Automation in Construction, vol. 146, p. 104641, 2023.
  22. M. V. Torres, A. Braun, and A. Borrmann, “Bim-slam: Integrating bim models in multi-session slam for lifelong mapping using 3d lidar,” in Proceedings of the 40th International Symposium on Automation and Robotics in Construction (ISARC 2023), 2023.
  23. K. Kim and M. Peavy, “Bim-based semantic building world modeling for robot task planning and execution in built environments,” Automation in Construction, vol. 138, p. 104247, 2022.
  24. Y. Perez-Perez, M. Golparvar-Fard, and K. El-Rayes, “Scan2bim-net: Deep learning method for segmentation of point clouds for scan-to-bim,” Journal of Construction Engineering and Management, vol. 147, no. 9, p. 04021107, 2021.
  25. W. Jakob, M. Tarini, D. Panozzo, O. Sorkine-Hornung et al., “Instant field-aligned meshes.” ACM Trans. Graph., vol. 34, no. 6, pp. 189–1, 2015.
  26. D. Bolkas and A. Martinez, “Effect of target color and scanning geometry on terrestrial lidar point-cloud noise and plane fitting,” Journal of applied geodesy, vol. 12, no. 1, pp. 109–127, 2018.
  27. H. Tibebu, J. Roche, V. De Silva, and A. Kondoz, “Lidar-based glass detection for improved occupancy grid mapping,” Sensors, vol. 21, no. 7, p. 2263, 2021.
  28. N. Baken, “Linked data for smart homes: Comparing rdf and labeled property graphs,” in LDAC2020—8th Linked Data in Architecture and Construction Workshop, 2020, pp. 23–36.
  29. P. Pauwels, S. Zhang, and Y.-C. Lee, “Semantic web technologies in aec industry: A literature overview,” Automation in Construction, vol. 73, pp. 145–165, 2017.
  30. F. Manola and E. Miller. (2004) RDF Primer. (Accessed on 5. Feb, 2024). [Online]. Available: http://www.w3.org/TR/2004/REC-rdf-primer-20040210/
  31. N. Hichri, C. Stefani, L. De Luca, P. Veron, and G. Hamon, “From point cloud to bim: a survey of existing approaches,” in XXIV International CIPA Symposium.   Proceedings of the XXIV International CIPA Symposium, 2013, p. na.
  32. M. Bassier and M. Vergauwen, “Unsupervised reconstruction of building information modeling wall objects from point cloud data,” Automation in construction, vol. 120, p. 103338, 2020.
  33. S. Pütz, J. S. Simón, and J. Hertzberg, “Move base flex a highly flexible navigation framework for mobile robots,” in 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2018, pp. 3416–3421.
  34. D. Fox, “Kld-sampling: Adaptive particle filters,” Advances in neural information processing systems, vol. 14, 2001.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now