Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Workspace Optimization Techniques to Improve Prediction of Human Motion During Human-Robot Collaboration (2401.12965v1)

Published 23 Jan 2024 in cs.RO

Abstract: Understanding human intentions is critical for safe and effective human-robot collaboration. While state of the art methods for human goal prediction utilize learned models to account for the uncertainty of human motion data, that data is inherently stochastic and high variance, hindering those models' utility for interactions requiring coordination, including safety-critical or close-proximity tasks. Our key insight is that robot teammates can deliberately configure shared workspaces prior to interaction in order to reduce the variance in human motion, realizing classifier-agnostic improvements in goal prediction. In this work, we present an algorithmic approach for a robot to arrange physical objects and project "virtual obstacles" using augmented reality in shared human-robot workspaces, optimizing for human legibility over a given set of tasks. We compare our approach against other workspace arrangement strategies using two human-subjects studies, one in a virtual 2D navigation domain and the other in a live tabletop manipulation domain involving a robotic manipulator arm. We evaluate the accuracy of human motion prediction models learned from each condition, demonstrating that our workspace optimization technique with virtual obstacles leads to higher robot prediction accuracy using less training data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (40)
  1. Supportive actions for manipulation in human-robot coworker teams. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 11261–11267.
  2. Anticipating Many Futures: Online Human Motion Prediction and Generation for Human-Robot Interaction. In 2018 IEEE International Conference on Robotics and Automation (ICRA). 4563–4570. https://doi.org/10.1109/ICRA.2018.8460651
  3. On the utility of learning about humans for human-ai coordination. Advances in neural information processing systems 32 (2019).
  4. Robots that can adapt like animals. Nature 521, 7553 (2015), 503–507.
  5. Legibility and predictability of robot motion. In 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI). 301–308. https://doi.org/10.1109/HRI.2013.6483603
  6. Learning How Pedestrians Navigate: A Deep Inverse Reinforcement Learning Approach. In 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 819–826. https://doi.org/10.1109/IROS.2018.8593438
  7. Matthew Fontaine and Stefanos Nikolaidis. 2021. Differentiable quality diversity. Advances in Neural Information Processing Systems 34 (2021), 10040–10052.
  8. On the importance of environments in human-robot coordination. arXiv preprint arXiv:2106.10853 (2021).
  9. Matthew C Fontaine and Stefanos Nikolaidis. 2022. Evaluating Human–Robot Interaction Algorithms in Shared Autonomy via Quality Diversity Scenario Generation. ACM Transactions on Human-Robot Interaction (THRI) 11, 3 (2022), 1–30.
  10. Confidence-aware motion prediction for real-time collision avoidance. The International Journal of Robotics Research 39, 2-3 (2020), 250–265. https://doi.org/10.1177/0278364919859436 arXiv:https://doi.org/10.1177/0278364919859436
  11. Intention-Aware Navigation in Crowds with Extended-Space POMDP Planning. In Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems. 562–570.
  12. Equi-reward utility maximizing design in stochastic environments. HSDIP 2017 (2017), 19.
  13. Designing environments conducive to interpretable robot behavior. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, 10982–10989.
  14. Przemyslaw A. Lasota and Julie A. Shah. 2015. Analyzing the Effects of Human-Aware Motion Planning on Close-Proximity Human–Robot Collaboration. Human Factors 57, 1 (2015), 21–33. https://doi.org/10.1177/0018720814565188 arXiv:https://doi.org/10.1177/0018720814565188 PMID: 25790568.
  15. Przemyslaw A. Lasota and Julie A. Shah. 2017. A multiple-predictor approach to human motion prediction. In 2017 IEEE International Conference on Robotics and Automation (ICRA). 2300–2307. https://doi.org/10.1109/ICRA.2017.7989265
  16. Joel Lehman and Kenneth O. Stanley. 2011. Evolving a Diversity of Virtual Creatures through Novelty Search and Local Competition. In Proceedings of the 13th Annual Conference on Genetic and Evolutionary Computation (Dublin, Ireland) (GECCO ’11). Association for Computing Machinery, New York, NY, USA, 211–218. https://doi.org/10.1145/2001576.2001606
  17. Data Driven Models for Human Motion Prediction in Human-Robot Collaboration. IEEE Access 8 (2020), 227690–227702. https://doi.org/10.1109/ACCESS.2020.3045994
  18. Ren.C Luo and Licong Mai. 2019. Human Intention Inference and On-Line Human Hand Motion Prediction for Human-Robot Collaboration. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 5958–5964. https://doi.org/10.1109/IROS40897.2019.8968192
  19. Goal Set Inverse Optimal Control and Iterative Replanning for Predicting Human Reaching Motions in Shared Workspaces. IEEE Transactions on Robotics 32, 4 (2016), 897–908. https://doi.org/10.1109/TRO.2016.2581216
  20. Gustav Markkula and Mehmet Dogar. 2022. How accurate models of human behavior are needed for human-robot interaction? For automated driving? arXiv preprint arXiv:2202.06123 (2022).
  21. On Human Motion Prediction Using Recurrent Neural Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  22. Jean-Baptiste Mouret and Jeff Clune. 2015. Illuminating search spaces by mapping elites. arXiv preprint arXiv:1504.04909 (2015). https://arxiv.org/pdf/1504.04909.pdf
  23. Meinard Müller. 2007. Dynamic time warping. Information retrieval for music and motion (2007), 69–84.
  24. Olle Nilsson and Antoine Cully. 2021. Policy gradient assisted map-elites. In Proceedings of the Genetic and Evolutionary Computation Conference. 866–875.
  25. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
  26. Human-robot shared workspace collaboration via hindsight optimization. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 831–838. https://doi.org/10.1109/IROS.2016.7759147
  27. Predicting actions to act predictably: Cooperative partial motion planning with maximum entropy models. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 2096–2101. https://doi.org/10.1109/IROS.2016.7759329
  28. Claudia Pérez-D’Arpino and Julie A. Shah. 2015. Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification. In 2015 IEEE International Conference on Robotics and Automation (ICRA). 6175–6182. https://doi.org/10.1109/ICRA.2015.7140066
  29. Human motion trajectory prediction: A survey. The International Journal of Robotics Research 39, 8 (2020), 895–935.
  30. Thomas B Sheridan. 2016. Human–robot interaction: status and challenges. Human factors 58, 4 (2016), 525–532.
  31. Rainer Storn and Kenneth Price. 1997. Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces. Journal of Global Optimization 11, 4 (01 Dec 1997), 341–359. https://doi.org/10.1023/A:1008202821328
  32. A survey of mental modeling techniques in human–robot teaming. Current Robotics Reports 1 (2020), 259–267.
  33. ”Bilevel Optimization for Just-in-Time Robotic Kitting and Delivery via Adaptive Task Segmentation and Scheduling”. IEEE International Conference on Robot & Human Interactive Communication (2022).
  34. Improving Human Legibility in Collaborative Robot Tasks through Augmented Reality and Workspace Preparation. In 6th International Workshop on Virtual, Augmented, and Mixed-Reality for Human-Robot Interactions (VAM-HRI). ACM.
  35. MediaPipe Hands: On-device Real-time Hand Tracking. https://mixedreality.cs.cornell.edu/workshop.
  36. Milos Vasic and Aude Billard. 2013. Safety issues in human-robot interactions. In 2013 IEEE International Conference on Robotics and Automation. 197–204. https://doi.org/10.1109/ICRA.2013.6630576
  37. Dominik Widmann and Yiannis Karayiannidis. 2018. Human Motion Prediction in Human-Robot Handovers based on Dynamic Movement Primitives. In 2018 European Control Conference (ECC). 2781–2787. https://doi.org/10.23919/ECC.2018.8550170
  38. A general approach to environment design with one agent. In Twenty-First International Joint Conference on Artificial Intelligence. Citeseer.
  39. Multi-Robot Coordination and Layout Design for Automated Warehousing. In Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence, IJCAI-23, Edith Elkind (Ed.). International Joint Conferences on Artificial Intelligence Organization, 5503–5511. https://doi.org/10.24963/ijcai.2023/611 Main Track.
  40. Maximum entropy inverse reinforcement learning.. In AAAI, Vol. 8. Chicago, IL, USA, 1433–1438.
Citations (3)

Summary

We haven't generated a summary for this paper yet.