Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
158 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A pose and shear-based tactile robotic system for object tracking, surface following and object pushing (2306.08560v2)

Published 14 Jun 2023 in cs.RO

Abstract: Tactile perception is a crucial sensing modality in robotics, particularly in scenarios that require precise manipulation and safe interaction with other objects. Previous research in this area has focused extensively on tactile perception of contact poses as this is an important capability needed for tasks such as traversing an object's surface or edge, manipulating an object, or pushing an object along a predetermined path. Another important capability needed for tasks such as object tracking and manipulation is estimation of post-contact shear but this has received much less attention. Indeed, post-contact shear has often been considered a "nuisance variable" and is removed if possible because it can have an adverse effect on other types of tactile perception such as contact pose estimation. This paper proposes a tactile robotic system that can simultaneously estimate both the contact pose and post-contact shear, and use this information to control its interaction with other objects. Moreover, our new system is capable of interacting with other objects in a smooth and continuous manner, unlike the stepwise, position-controlled systems we have used in the past. We demonstrate the capabilities of our new system using several different controller configurations, on tasks including object tracking, surface following, single-arm object pushing, and dual-arm object pushing.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (78)
  1. Advances in neural information processing systems 29.
  2. Barfoot TD (2017) State estimation for robotics. Cambridge University Press.
  3. Barfoot TD and Furgale PT (2014) Associating uncertainty with three-dimensional poses for use in estimation problems. IEEE Transactions on Robotics 30(3): 679–693.
  4. Bauza M, Bronars A and Rodriguez A (2022) Tac2pose: Tactile object pose estimation from the first touch. arXiv preprint arXiv:2204.11701 .
  5. Bauza M, Hogan FR and Rodriguez A (2018) A data-efficient approach to precise and controlled pushing. In: Conference on Robot Learning. PMLR, pp. 336–345.
  6. Berger AD and Khosla PK (1991) Using tactile data for real-time feedback. The International journal of robotics research 10(2): 88–102.
  7. Bicchi A, Salisbury JK and Brock DL (1993) Contact sensing from force measurements. The International Journal of Robotics Research 12(3): 249–262.
  8. Advanced Robotics 29(5): 363–374.
  9. Bishop CM (1994) Mixture density networks. Technical Report NCRG/94/004, Neural Computing Research Group, Aston University, Birmingham.
  10. Bishop CM (2006) Pattern Recognition and Machine Learning. Springer New York.
  11. Bourmaud G (2015) Estimation de paramètres évoluant sur des groupes de Lie: Application à la cartographie et à la localisation d’une caméra monoculaire. PhD Thesis, Université de Bordeaux.
  12. Journal of Mathematical Imaging and Vision 55(3): 284–303.
  13. Bromiley P (2003) Products and convolutions of gaussian probability density functions. Tina-Vision Memo 3(4): 1.
  14. Neural computation 32(5): 969–1017.
  15. Byravan A and Fox D (2017) Se3-nets: Learning rigid body motion using deep neural networks. In: 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 173–180.
  16. arXiv preprint arXiv:2301.13667 .
  17. Chen N, Zhang H and Rink R (1995) Edge tracking using tactile servo. In: Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots, volume 2. IEEE, pp. 84–89.
  18. In: 2009 International Conference on Advanced Robotics. IEEE, pp. 1–6.
  19. Clavera I, Held D and Abbeel P (2017) Policy transfer via modularity and reward guiding. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 1537–1544.
  20. In: 2018 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 2752–2757.
  21. Dengler N, Großklaus D and Bennewitz M (2022) Learning goal-oriented non-prehensile pushing in cluttered scenes. In: 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 1116–1122.
  22. Franka E (2017) Franka control interface (fci) documentation. https://frankaemika.github.io/docs/. Accessed: 2022-11-23.
  23. Gelb A et al. (1974) Applied optimal estimation. MIT press.
  24. Goyal S, Ruina A and Papadopoulos J (1989) Limit surface and moment function descriptions of planar sliding. In: 1989 IEEE International Conference on Robotics and Automation. IEEE Computer Society, pp. 794–795.
  25. Gupta AK, Aitchison L and Lepora NF (2022) Tactile image-to-image disentanglement of contact geometry from motion-induced shear. In: Faust A, Hsu D and Neumann G (eds.) Proceedings of the 5th Conference on Robot Learning, Proceedings of Machine Learning Research, volume 164. PMLR, pp. 14–23. URL https://proceedings.mlr.press/v164/gupta22a.html.
  26. In: 2013 IEEE International Conference on Robotics and Automation. IEEE, pp. 4989–4996.
  27. Hjorth LU and Nabney IT (1999) Regularisation of mixture density networks. In: 1999 Ninth International Conference on Artificial Neural Networks ICANN 99.(Conf. Publ. No. 470), volume 2. IET, pp. 521–526.
  28. Howe RD and Cutkosky MR (1996) Practical force-motion models for sliding manipulation. The International Journal of Robotics Research 15(6): 557–572.
  29. Ioffe S and Szegedy C (2015) Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning. PMLR, pp. 448–456.
  30. Jia YB and Erdmann M (1999) Pose and motion from contact. The International Journal of Robotics Research 18(5): 466–487.
  31. Julier SJ and Uhlmann JK (1997) New extension of the kalman filter to nonlinear systems. In: Signal processing, sensor fusion, and target recognition VI, volume 3068. Spie, pp. 182–193.
  32. Julier SJ, Uhlmann JK and Durrant-Whyte HF (1995) A new approach for filtering nonlinear systems. In: Proceedings of 1995 American Control Conference-ACC’95, volume 3. IEEE, pp. 1628–1632.
  33. Kalman RE (1960) A new approach to linear filtering and prediction problems .
  34. Kalman RE and Bucy RS (1961) New results in linear filtering and prediction theory .
  35. Kappassov Z, Corrales JA and Perdereau V (2020) Touch driven controller and tactile features for physical interactions. Robotics and Autonomous Systems 123: 103332.
  36. Kelestemur T, Platt R and Padir T (2022) Tactile pose estimation and policy learning for unknown object manipulation. arXiv preprint arXiv:2203.10685 .
  37. In: 2011 IEEE international conference on robotics and automation. IEEE, pp. 5722–5729.
  38. Krivic S and Piater J (2019) Pushing corridors for delivering unknown objects with a mobile robot. Autonomous Robots 43: 1435–1452.
  39. Lee SH and Cutkosky MR (1991) Fixture Planning With Friction. Journal of Engineering for Industry 113(3): 320–327. 10.1115/1.2899703. URL https://doi.org/10.1115/1.2899703.
  40. Lepora NF (2021) Soft biomimetic optical tactile sensing with the tactip: a review. IEEE Sensors Journal .
  41. Lepora NF, Aquilina K and Cramphorn L (2017) Exploratory tactile servoing with active touch. IEEE Robotics and Automation Letters 2(2): 1156–1163.
  42. IEEE Robotics and Automation Letters 4(2): 2101–2107.
  43. Lepora NF and Lloyd J (2020) Optimal deep learning for robot touch: Training accurate pose models of 3d surfaces and edges. IEEE Robotics & Automation Magazine 27(2): 66–77.
  44. Lepora NF and Lloyd J (2021) Pose-based tactile servoing: Controlled soft touch using deep learning. IEEE Robotics & Automation Magazine 28(4): 43–55.
  45. Li JK, Lee WS and Hsu D (2018) Push-net: Deep planar pushing for objects with unknown physical properties. In: Robotics: Science and Systems, volume 14. pp. 1–9.
  46. IEEE Transactions on Robotics 36(6): 1619–1634.
  47. In: Robotics: Science and systems. Citeseer.
  48. Lloyd J and Lepora NF (2021) Goal-driven robotic pushing using tactile and proprioceptive feedback. IEEE Transactions on Robotics 38(2): 1201–1212.
  49. Lloyd J, Lin Y and Lepora NF (2021) Probabilistic Discriminative Models address the Tactile Perceptual Aliasing Problem. In: Proceedings of Robotics: Science and Systems. Virtual. 10.15607/RSS.2021.XVII.057.
  50. Robotics: Science and Systems VIII 265.
  51. Mechatronics 48: 54–67.
  52. Lynch K, Maekawa H and Tanie K (1992) Manipulation and active sensing by pushing using tactile feedback. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, volume 1. IEEE, pp. 416–421.
  53. The international journal of robotics research 15(6): 533–556.
  54. Lynch KM and Park FC (2017) Modern robotics. Cambridge University Press.
  55. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 7144–7153.
  56. Mason MT (1986) Mechanics and planning of manipulator pushing operations. The International Journal of Robotics Research 5(3): 53–71.
  57. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp. 5579–5584.
  58. Murray RM, Li Z and Sastry SS (2017) A mathematical introduction to robotic manipulation. CRC press.
  59. Petersen KB, Pedersen MS et al. (2008) The matrix cookbook. Technical University of Denmark 7(15): 510.
  60. Särkkä S (2013) Bayesian filtering and smoothing. 3. Cambridge university press.
  61. Sikka P, Zhang H and Sutphen S (2005) Tactile servo: Control of touch-driven robot motion. In: Experimental Robotics III: The 3rd International Symposium, Kyoto, Japan, October 28–30, 1993. Springer, pp. 219–233.
  62. Silverman BW (2018) Density estimation for statistics and data analysis. Routledge.
  63. Simon C (2015) Generating uniformly distributed numbers on a sphere. http://corysimon.github.io/articles/uniformdistn-on-sphere/. Accessed: 2022-11-23.
  64. In: ICCV. pp. 1275–1282.
  65. Sola J, Deray J and Atchuthan D (2018) A micro lie theory for state estimation in robotics. arXiv preprint arXiv:1812.01537 .
  66. The journal of machine learning research 15(1): 1929–1958.
  67. Stillwell J (2008) Naive lie theory. Springer Science & Business Media.
  68. Stüber J, Zito C and Stolkin R (2020) Let’s push things forward: A survey on robot pushing. Frontiers in Robotics and AI : 8.
  69. In: 2021 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 11322–11328.
  70. In: 2019 International Conference on Robotics and Automation (ICRA). IEEE, pp. 3622–3628.
  71. Taboga M (2012) Lectures on Probability Theory and Mathematical Statistics - 2nd Edition. CreateSpace Independent Publishing Platform. ISBN 9781480215238. URL https://books.google.co.uk/books?id=9h7JkgEACAAJ.
  72. In: Conference on Robot Learning. PMLR, pp. 1015–1029.
  73. Soft robotics 5(2): 216–227.
  74. In: 2016 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp. 30–37.
  75. Yuan W, Dong S and Adelson EH (2017) Gelsight: High-resolution robot tactile sensors for estimating geometry and force. Sensors 17(12): 2762.
  76. In: 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, pp. 304–311.
  77. Zhang H and Chen NN (2000) Control of contact via tactile sensing. IEEE Transactions on Robotics and Automation 16(5): 482–495.
  78. The International Journal of Robotics Research 37(2-3): 249–265.

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Youtube Logo Streamline Icon: https://streamlinehq.com

YouTube