Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Coupled Active Perception and Manipulation Planning for a Mobile Manipulator in Precision Agriculture Applications (2309.16778v1)

Published 28 Sep 2023 in cs.RO

Abstract: A mobile manipulator often finds itself in an application where it needs to take a close-up view before performing a manipulation task. Named this as a coupled active perception and manipulation (CAPM) problem, we model the uncertainty in the perception process and devise a key state/task planning approach that considers reachability conditions as task constraints of both perception and manipulation tasks for the mobile platform. By minimizing the expected energy usage in the body key state planning while satisfying task constraints, our algorithm achieves the best balance between the task success rate and energy usage. We have implemented the algorithm and tested it in both simulation and physical experiments. The results have confirmed that our algorithm has a lower energy consumption compared to a two-stage decoupled approach, while still maintaining a success rate of 100\% for the task.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. J. Qian, V. Chatrath, J. Yang, J. Servos, A. P. Schoellig, and S. L. Waslander, “Pocd: Probabilistic object-level change detection and volumetric mapping in semi-static scenes,” arXiv preprint arXiv:2205.01202, 2022.
  2. J. Dong, J. G. Burnham, B. Boots, G. Rains, and F. Dellaert, “4d crop monitoring: Spatio-temporal reconstruction for agriculture,” in 2017 IEEE International Conference on Robotics and Automation (ICRA), 2017, pp. 3878–3885.
  3. S. Xie, C. Hu, M. Bagavathiannan, and D. Song, “Toward robotic weed control: Detection of nutsedge weed in bermudagrass turf using inaccurate and insufficient training data,” IEEE Robot. Autom. Lett., vol. 6, no. 4, pp. 7365–7372, 2021.
  4. R. Bajcsy, “Active perception,” Proceedings of the IEEE, vol. 76, no. 8, pp. 966–1005, 1988.
  5. R. Bajcsy, Y. Aloimonos, and J. K. Tsotsos, “Revisiting active perception,” Autonomous Robots, vol. 42, pp. 177–196, 2018.
  6. N. Atanasov, B. Sankaran, J. Le Ny, G. J. Pappas, and K. Daniilidis, “Nonmyopic view planning for active object classification and pose estimation,” IEEE Transactions on Robotics, vol. 30, no. 5, pp. 1078–1090, 2014.
  7. E. Safronov, N. Piga, M. Colledanchise, and L. Natale, “Active perception for ambiguous objects classification,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 4437–4444.
  8. L. Bartolomei, L. Teixeira, and M. Chli, “Semantic-aware active perception for uavs using deep reinforcement learning,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 3101–3108.
  9. G. Best, J. Faigl, and R. Fitch, “Multi-robot path planning for budgeted active perception with self-organising maps,” in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2016, pp. 3164–3171.
  10. M. Hegedus, K. Gupta, and M. Mehrandezh, “Towards an integrated autonomous data-driven grasping system with a mobile manipulator,” in 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 1601–1607.
  11. J. Aloimonos, I. Weiss, and A. Bandyopadhyay, “Active vision,” International journal of computer vision, vol. 1, pp. 333–356, 1988.
  12. S. Thakar, P. Rajendran, A. M. Kabir, and S. K. Gupta, “Manipulator motion planning for part pickup and transport operations from a moving base,” IEEE Transactions on Automation Science and Engineering, vol. 19, no. 1, pp. 191–206, 2022.
  13. M. Mittal, D. Hoeller, F. Farshidian, M. Hutter, and A. Garg, “Articulated object interaction in unknown scenes with whole-body mobile manipulation,” 2022.
  14. A. Adu-Bredu, N. Devraj, P.-H. Lin, Z. Zeng, and O. C. Jenkins, “Probabilistic inference in planning for partially observable long horizon problems,” in 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2021, pp. 3154–3161.
  15. C. R. Garrett, C. Paxton, T. Lozano-Pérez, L. P. Kaelbling, and D. Fox, “Online replanning in belief space for partially observable task and motion problems,” in 2020 IEEE International Conference on Robotics and Automation (ICRA).   IEEE, 2020, pp. 5678–5684.
  16. G. V. Nardari, A. Cohen, S. W. Chen, X. Liu, V. Arcot, R. A. F. Romero, and V. Kumar, “Place recognition in forests with urquhart tessellations,” IEEE Robot. Autom. Lett., vol. 6, no. 2, pp. 279–286, 2021.
  17. E. Marks, F. Magistri, and C. Stachniss, “Precise 3d reconstruction of plants from uav imagery combining bundle adjustment and template matching,” in Proc. IEEE Int. Conf. Robot. Autom. (ICRA), Philadelphia, May 2022, pp. 2259–2265.
  18. C. Hu, S. Xie, D. Song, J. A. Thomasson, R. G. H. IV, and M. Bagavathiannan, “Algorithm and system development for robotic micro-volume herbicide spray towards precision weed management,” IEEE Robotics and Automation Letters, vol. 7, no. 4, pp. 11 633–11 640, 2022.
  19. A. N. Sivakumar, S. Modi, M. V. Gasparino, C. Ellis, A. E. Baquero Velasquez, G. Chowdhary, and S. Gupta, “Learned visual navigation for under-canopy agricultural robots,” in Proc. Robot.: Sci. Syst., Virtual, July 2021.
  20. P. Maini, B. M. Gonultas, and V. Isler, “Online coverage planning for an autonomous weed mowing robot with curvature constraints,” IEEE Robot. Autom. Lett., vol. 7, no. 2, pp. 5445–5452, 2022.
  21. X. Liu, G. V. Nardari, F. C. Ojeda, Y. Tao, A. Zhou, T. Donnelly, C. Qu, S. W. Chen, R. A. F. Romero, C. J. Taylor, and V. Kumar, “Large-scale autonomous flight with real-time semantic slam under dense forest canopy,” IEEE Robot. Autom. Lett., vol. 7, no. 2, pp. 5512–5519, 2022.
  22. T. C. Thayer, S. Vougioukas, K. Goldberg, and S. Carpin, “Multirobot routing algorithms for robots operating in vineyards,” IEEE Trans. Autom. Sci. Eng., vol. 17, no. 3, pp. 1184–1194, July 2020.
  23. W. McAllister, J. Whitman, J. Varghese, A. Davis, and G. Chowdhary, “Agbots 3.0: Adaptive weed growth prediction for mechanical weeding agbots,” IEEE Trans. Robot., vol. 38, no. 1, pp. 556–568, 2022.
  24. C. Li, L. Li, H. Jiang, K. Weng, Y. Geng, L. Li, Z. Ke, Q. Li, M. Cheng, W. Nie, Y. Li, B. Zhang, Y. Liang, L. Zhou, X. Xu, X. Chu, X. Wei, and X. Wei, “Yolov6: A single-stage object detection framework for industrial applications,” 2022.
  25. A. Üneri, M. A. Balicki, J. Handa, P. Gehlbach, R. H. Taylor, and I. Iordachita, “New steady-hand eye robot with micro-force sensing for vitreoretinal surgery,” in 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics, 2010, pp. 814–819.
  26. J. J. Kuffner, “Effective sampling and distance metrics for 3d rigid body path planning,” in IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA’04. 2004, vol. 4.   IEEE, 2004, pp. 3993–3998.
  27. A. Mohammed, B. Schmidt, L. Wang, and L. Gao, “Minimizing energy consumption for robot arm movement,” Procedia CIRP, vol. 25, pp. 400–405, 2014, 8th International Conference on Digital Enterprise Technology - DET 2014 Disruptive Innovation in Manufacturing Engineering towards the 4th Industrial Revolution.
  28. R. Diankov, “Automated construction of robotic manipulation programs,” Ph.D. dissertation, Carnegie Mellon University, Robotics Institute, August 2010.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (6)
  1. Shuangyu Xie (8 papers)
  2. Chengsong Hu (4 papers)
  3. Di Wang (408 papers)
  4. Joe Johnson (3 papers)
  5. Muthukumar Bagavathiannan (5 papers)
  6. Dezhen Song (24 papers)
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now