Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
166 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
42 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

ViboPneumo: A Vibratory-Pneumatic Finger-Worn Haptic Device for Altering Perceived Texture Roughness in Mixed Reality (2403.05182v1)

Published 8 Mar 2024 in cs.HC and cs.GR

Abstract: Extensive research has been done in haptic feedback for texture simulation in virtual reality (VR). However, it is challenging to modify the perceived tactile texture of existing physical objects which usually serve as anchors for virtual objects in mixed reality (MR). In this paper, we present ViboPneumo, a finger-worn haptic device that uses vibratory-pneumatic feedback to modulate (i.e., increase and decrease) the perceived roughness of the material surface contacted by the user's fingerpad while supporting the perceived sensation of other haptic properties (e.g., temperature or stickiness) in MR. Our device includes a silicone-based pneumatic actuator that can lift the user's fingerpad on the physical surface to reduce the contact area for roughness decreasing, and an on-finger vibrator for roughness increasing. Our user-perception experimental results showed that the participants could perceive changes in roughness, both increasing and decreasing, compared to the original material surface. We also observed the overlapping roughness ratings among certain haptic stimuli (i.e., vibrotactile and pneumatic) and the originally perceived roughness of some materials without any haptic feedback. This suggests the potential to alter the perceived texture of one type of material to another in terms of roughness (e.g., modifying the perceived texture of ceramics as glass). Lastly, a user study of MR experience showed that ViboPneumo could significantly improve the MR user experience, particularly for visual-haptic matching, compared to the condition of a bare finger. We also demonstrated a few application scenarios for ViboPneumo.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (77)
  1. X. Chen, F. Shao, C. Barnes, T. Childs, and B. Henson, “Exploring relationships between touch perception and surface physical properties,” International Journal of Design, vol. 3, no. 2, pp. 67–76, 2009.
  2. E. Djonov and T. Van Leeuwen, “The semiotics of texture: From tactile to visual,” Visual Communication, vol. 10, no. 4, pp. 541–564, 2011.
  3. X. Yu, Z. Xie, Y. Yu, J. Lee, A. Vazquez-Guardado, H. Luan, J. Ruban, X. Ning, A. Akhtar, D. Li et al., “Skin-integrated wireless haptic interfaces for virtual and augmented reality,” Nature, vol. 575, no. 7783, pp. 473–479, 2019.
  4. O. Bau, I. Poupyrev, A. Israr, and C. Harrison, “Teslatouch: electrovibration for touch surfaces,” in Proceedings of the 23nd annual ACM symposium on User interface software and technology, 2010, pp. 283–292.
  5. K. Nakagaki, L. Vink, J. Counts, D. Windham, D. Leithinger, S. Follmer, and H. Ishii, “Materiable: Rendering dynamic material properties in response to direct physical touch with shape changing interfaces,” in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016, pp. 2764–2772.
  6. S. Bochereau, S. Sinclair, and V. Hayward, “Perceptual constancy in the reproduction of virtual tactile textures with surface displays,” ACM Transactions on Applied Perception (TAP), vol. 15, no. 2, pp. 1–12, 2018.
  7. E. Whitmire, H. Benko, C. Holz, E. Ofek, and M. Sinclair, “Haptic revolver: Touch, shear, texture, and shape rendering on a reconfigurable virtual reality controller,” in Proceedings of the 2018 CHI conference on human factors in computing systems, 2018, pp. 1–12.
  8. D. Degraen, M. Piovarči, B. Bickel, and A. Krüger, “Capturing tactile properties of real surfaces for haptic reproduction,” in The 34th Annual ACM Symposium on User Interface Software and Technology, 2021, pp. 954–971.
  9. S. Cai, P. Ke, T. Narumi, and K. Zhu, “Thermairglove: A pneumatic glove for thermal perception and material identification in virtual reality,” in 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).   IEEE, 2020, pp. 248–257.
  10. L. Zhu, X. Jiang, J. Shen, H. Zhang, Y. Mo, and A. Song, “Tapetouch: A handheld shape-changing device for haptic display of soft objects,” IEEE Transactions on Visualization and Computer Graphics, vol. 28, no. 11, pp. 3928–3938, 2022.
  11. W. M. B. Tiest, “Tactual perception of material properties,” Vision research, vol. 50, no. 24, pp. 2775–2782, 2010.
  12. N. Di Stefano and C. Spence, “Roughness perception: A multisensory/crossmodal perspective,” Attention, Perception, & Psychophysics, vol. 84, no. 7, pp. 2087–2114, 2022.
  13. H. Culbertson, J. Unwin, and K. J. Kuchenbecker, “Modeling and rendering realistic textures from unconstrained tool-surface interactions,” IEEE transactions on haptics, vol. 7, no. 3, pp. 381–393, 2014.
  14. H. Ando, E. Kusachi, and J. Watanabe, “Nail-mounted tactile display for boundary/texture augmentation,” in Proceedings of the international conference on Advances in computer entertainment technology, 2007, pp. 292–293.
  15. P. Preechayasomboon and E. Rombokas, “Haplets: Finger-worn wireless and low-encumbrance vibrotactile haptic feedback for virtual and augmented reality,” Frontiers in Virtual Reality, vol. 2, p. 738613, 2021.
  16. G. Spagnoletti, L. Meli, T. L. Baldi, G. Gioioso, C. Pacchierotti, and D. Prattichizzo, “Rendering of pressure and textures using wearable haptics in immersive vr environments,” in 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).   IEEE, 2018, pp. 691–692.
  17. E. Kwon, G. J. Kim, and S. Lee, “Effects of sizes and shapes of props in tangible augmented reality,” in 2009 8th IEEE International Symposium on Mixed and Augmented Reality.   IEEE, 2009, pp. 201–202.
  18. J. Hochreiter, S. Daher, G. Bruder, and G. Welch, “Cognitive and touch performance effects of mismatched 3d physical and visual perceptions,” in 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).   IEEE, 2018, pp. 1–386.
  19. Q. Zhou, S. Sykes, S. Fels, and K. Kin, “Gripmarks: Using hand grips to transform in-hand objects into mixed reality input,” in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, ser. CHI ’20.   New York, NY, USA: Association for Computing Machinery, 2020, p. 1–11. [Online]. Available: https://doi.org/10.1145/3313831.3376313
  20. M. Azmandian, M. Hancock, H. Benko, E. Ofek, and A. D. Wilson, “Haptic retargeting: Dynamic repurposing of passive haptics for enhanced virtual reality experiences,” in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ser. CHI ’16.   New York, NY, USA: Association for Computing Machinery, 2016, p. 1968–1979. [Online]. Available: https://doi.org/10.1145/2858036.2858226
  21. K. Zhu, T. Chen, F. Han, and Y.-S. Wu, “Haptwist: Creating interactive haptic proxies in virtual reality using low-cost twistable artefacts,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, ser. CHI ’19.   New York, NY, USA: Association for Computing Machinery, 2019, p. 1–13. [Online]. Available: https://doi.org/10.1145/3290605.3300923
  22. S. Asano, S. Okamoto, Y. Matsuura, and Y. Yamada, “Toward quality texture display: vibrotactile stimuli to modify material roughness sensations,” Advanced Robotics, vol. 28, no. 16, pp. 1079–1089, 2014.
  23. C. Pacchierotti, S. Sinclair, M. Solazzi, A. Frisoli, V. Hayward, and D. Prattichizzo, “Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives,” IEEE transactions on haptics, vol. 10, no. 4, pp. 580–600, 2017.
  24. O. Bau and I. Poupyrev, “Revel: tactile feedback technology for augmented reality,” ACM Transactions on Graphics (TOG), vol. 31, no. 4, pp. 1–11, 2012.
  25. S. Asano, S. Okamoto, and Y. Yamada, “Toward augmented reality of textures: Vibrotactile high-frequency stimuli mask texture perception to be rougher or smoother?” in 2013 IEEE International Conference on Systems, Man, and Cybernetics.   IEEE, 2013, pp. 510–515.
  26. S. Yoshimoto, Y. Kuroda, M. Imura, and O. Oshiro, “Material roughness modulation via electrotactile augmentation,” IEEE Transactions on Haptics, vol. 8, no. 2, pp. 199–208, 2015.
  27. T. Maeda, R. Peiris, M. Nakatani, Y. Tanaka, and K. Minamizawa, “Wearable haptic augmentation system using skin vibration sensor,” in Proceedings of the 2016 Virtual Reality International Conference, 2016, pp. 1–4.
  28. R. Etzi, C. Spence, and A. Gallace, “Textures that we like to touch: An experimental study of aesthetic preferences for tactile stimuli,” Consciousness and cognition, vol. 29, pp. 178–188, 2014.
  29. S. Asano, S. Okamoto, and Y. Yamada, “Vibrotactile stimulation to increase and decrease texture roughness,” IEEE Transactions on Human-Machine Systems, vol. 45, no. 3, pp. 393–398, 2014.
  30. J. van Kuilenburg, M. A. Masen, and E. van der Heide, “A review of fingerpad contact mechanics and friction and how this affects tactile perception,” Proceedings of the Institution of Mechanical Engineers, Part J: Journal of engineering tribology, vol. 229, no. 3, pp. 243–258, 2015.
  31. S. J. Lederman and M. M. Taylor, “Fingertip force, surface geometry, and the perception of roughness by active touch,” Perception & psychophysics, vol. 12, pp. 401–408, 1972.
  32. T. Maeda, S. Yoshida, T. Murakami, K. Matsuda, T. Tanikawa, and H. Sakai, “Fingeret: A wearable fingerpad-free haptic device for mixed reality,” in Proceedings of the 2022 ACM Symposium on Spatial User Interaction, 2022, pp. 1–10.
  33. M. Bouzit, G. Burdea, G. Popescu, and R. Boian, “The rutgers master ii-new design force-feedback glove,” IEEE/ASME Transactions on mechatronics, vol. 7, no. 2, pp. 256–263, 2002.
  34. V. Vechev, J. Zarate, D. Lindlbauer, R. Hinchet, H. Shea, and O. Hilliges, “Tactiles: Dual-mode low-power electromagnetic actuators for rendering continuous contact and spatial haptic patterns in vr,” in 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).   IEEE, 2019, pp. 312–320.
  35. A. Withana, D. Groeger, and J. Steimle, “Tacttoo: A thin and feel-through tattoo for on-skin tactile output,” in Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, 2018, pp. 365–378.
  36. T. Han, F. Anderson, P. Irani, and T. Grossman, “Hydroring: Supporting mixed reality haptics using liquid flow,” in Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology, 2018, pp. 913–925.
  37. A. Mazursky, S.-Y. Teng, R. Nith, and P. Lopes, “Magnetio: Passive yet interactive soft haptic patches anywhere,” in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1–15.
  38. S.-Y. Teng, P. Li, R. Nith, J. Fonseca, and P. Lopes, “Touch&fold: A foldable haptic actuator for rendering touch in mixed reality,” in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, 2021, pp. 1–14.
  39. S. Choi and K. J. Kuchenbecker, “Vibrotactile display: Perception, technology, and applications,” Proceedings of the IEEE, vol. 101, no. 9, pp. 2093–2104, 2012.
  40. P. Strohmeier and K. Hornbæk, “Generating haptic textures with a vibrotactile actuator,” in Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017, pp. 4994–5005.
  41. K.-U. Kyung and J.-Y. Lee, “Ubi-pen: a haptic interface with texture and vibrotactile display,” IEEE Computer Graphics and Applications, vol. 29, no. 1, pp. 56–64, 2008.
  42. J. M. Romano and K. J. Kuchenbecker, “Creating realistic virtual textures from contact acceleration data,” IEEE Transactions on haptics, vol. 5, no. 2, pp. 109–119, 2011.
  43. S. B. Schorr and A. M. Okamura, “Fingertip tactile devices for virtual object manipulation and exploration,” in Proceedings of the 2017 CHI conference on human factors in computing systems, 2017, pp. 3115–3119.
  44. D. Chen, A. Song, L. Tian, L. Fu, and H. Zeng, “Fw-touch: A finger wearable haptic interface with an mr foam actuator for displaying surface material properties on a touch screen,” IEEE transactions on haptics, vol. 12, no. 3, pp. 281–294, 2019.
  45. V. Yem and H. Kajimoto, “Wearable tactile device using mechanical and electrical stimulation for fingertip interaction with virtual world,” in 2017 IEEE Virtual Reality (VR).   IEEE, 2017, pp. 99–104.
  46. S. Jeon and S. Choi, “Haptic augmented reality: Taxonomy and an example of stiffness modulation,” Presence, vol. 18, no. 5, pp. 387–408, 2009.
  47. T. Hachisu, M. Sato, S. Fukushima, and H. Kajimoto, “Augmentation of material property by modulating vibration resulting from tapping,” in International conference on human haptic sensing and touch enabled computer applications.   Springer, 2012, pp. 173–180.
  48. Y. Tao, S.-Y. Teng, and P. Lopes, “Altering perceived softness of real rigid objects by restricting fingerpad deformation,” in The 34th Annual ACM Symposium on User Interface Software and Technology, 2021, pp. 985–996.
  49. M. Holliins, R. Faldowski, S. Rao, and F. Young, “Perceptual dimensions of tactile surface texture: A multidimensional scaling analysis,” Perception & psychophysics, vol. 54, pp. 697–705, 1993.
  50. M. Hollins, S. Bensmaïa, K. Karlof, and F. Young, “Individual differences in perceptual space for tactile textures: Evidence from multidimensional scaling,” Perception & Psychophysics, vol. 62, pp. 1534–1544, 2000.
  51. W. M. B. Tiest and A. M. Kappers, “Analysis of haptic perception of materials by multidimensional scaling and physical measurements of roughness and compressibility,” Acta psychologica, vol. 121, no. 1, pp. 1–20, 2006.
  52. S. Asano, S. Okamoto, Y. Matsuura, H. Nagano, and Y. Yamada, “Vibrotactile display approach that modifies roughness sensations of real textures,” in 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.   IEEE, 2012, pp. 1001–1006.
  53. Y. Ochiai, T. Hoshi, J. Rekimoto, and M. Takasaki, “Diminished haptics: Towards digital transformation of real world textures,” in International Conference on Human Haptic Sensing and Touch Enabled Computer Applications.   Springer, 2014, pp. 409–417.
  54. A. S. Nittala, K. Kruttwig, J. Lee, R. Bennewitz, E. Arzt, and J. Steimle, “Like a second skin: Understanding how epidermal devices affect human tactile perception,” in Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 2019, pp. 1–16.
  55. K. B. Shimoga, “A survey of perceptual feedback issues in dexterous telemanipulation. ii. finger touch feedback,” in Proceedings of IEEE Virtual Reality Annual International Symposium.   IEEE, 1993, pp. 271–279.
  56. Y. Tanaka, A. Shen, A. Kong, and P. Lopes, “Full-hand electro-tactile feedback without obstructing palmar side of hand,” in Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems, 2023, pp. 1–15.
  57. A. M. Okamura, J. T. Dennerlein, and R. D. Howe, “Vibration feedback models for virtual environments,” in Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No. 98CH36146), vol. 1.   IEEE, 1998, pp. 674–679.
  58. Y. Ujitoko, Y. Ban, and K. Hirota, “Modulating fine roughness perception of vibrotactile textured surface using pseudo-haptic effect,” IEEE Transactions on Visualization and Computer Graphics, vol. 25, no. 5, pp. 1981–1990, 2019.
  59. A. Brisben, S. Hsiao, and K. Johnson, “Detection of vibration transmitted through an object grasped in the hand,” Journal of neurophysiology, vol. 81, no. 4, pp. 1548–1558, 1999.
  60. N. Landin, J. M. Romano, W. McMahan, and K. J. Kuchenbecker, “Dimensional reduction of high-frequency accelerations for haptic rendering,” in Haptics: Generating and Perceiving Tangible Sensations: International Conference, EuroHaptics 2010, Amsterdam, July 8-10, 2010. Proceedings.   Springer, 2010, pp. 79–86.
  61. G. Bradski, “The opencv library.” Dr. Dobb’s Journal: Software Tools for the Professional Programmer, vol. 25, no. 11, pp. 120–123, 2000.
  62. S. Okamoto, H. Nagano, and Y. Yamada, “Psychophysical dimensions of tactile perception of textures,” IEEE Transactions on Haptics, vol. 6, no. 1, pp. 81–93, 2012.
  63. M. Hollins and S. R. Risner, “Evidence for the duplex theory of tactile texture perception,” Perception & psychophysics, vol. 62, no. 4, pp. 695–705, 2000.
  64. B. G. Witmer and M. J. Singer, “Measuring presence in virtual environments: A presence questionnaire,” Presence, vol. 7, no. 3, pp. 225–240, 1998.
  65. A. Bangor, P. T. Kortum, and J. T. Miller, “An empirical evaluation of the system usability scale,” Intl. Journal of Human–Computer Interaction, vol. 24, no. 6, pp. 574–594, 2008.
  66. D. T. Blake, S. S. Hsiao, and K. O. Johnson, “Neural coding mechanisms in tactile pattern recognition: the relative contributions of slowly and rapidly adapting mechanoreceptors to perceived roughness,” Journal of Neuroscience, vol. 17, no. 19, pp. 7480–7489, 1997.
  67. G. A. Gescheider, S. J. Bolanowski, T. C. Greenfield, and K. E. Brunette, “Perception of the tactile texture of raised-dot patterns: A multidimensional analysis,” Somatosensory & motor research, vol. 22, no. 3, pp. 127–140, 2005.
  68. C. E. Connor and K. O. Johnson, “Neural coding of tactile texture: comparison of spatial and temporal mechanisms for roughness perception,” Journal of Neuroscience, vol. 12, no. 9, pp. 3414–3426, 1992.
  69. L. A. Jones and H.-N. Ho, “Warm or cool, large or small? the challenge of thermal displays,” IEEE Transactions on Haptics, vol. 1, no. 1, pp. 53–70, 2008.
  70. J. D. Greenspan and D. R. Kenshalo, “The primate as a model for the human temperature-sensing system: 2. area of skin receiving thermal stimulation (spatial summation),” Somatosensory research, vol. 2, no. 4, pp. 315–324, 1985.
  71. J. C. Stevens and L. E. Marks, “Spatial summation and the dynamics of warmth sensation,” Perception & Psychophysics, vol. 9, no. 5, pp. 391–398, 1971.
  72. D. A. Lawrence, L. Y. Pao, A. M. Dougherty, M. A. Salada, and Y. Pavlou, “Rate-hardness: A new performance metric for haptic interfaces,” IEEE Transactions on Robotics and Automation, vol. 16, no. 4, pp. 357–371, 2000.
  73. J. Shintake, H. Sonar, E. Piskarev, J. Paik, and D. Floreano, “Soft pneumatic gelatin actuator for edible robotics,” in 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).   IEEE, 2017, pp. 6221–6226.
  74. M. S. Xavier, C. D. Tawk, A. Zolfagharian, J. Pinskier, D. Howard, T. Young, J. Lai, S. M. Harrison, Y. K. Yong, M. Bodaghi et al., “Soft pneumatic actuators: A review of design, fabrication, modeling, sensing, control and applications,” IEEE Access, 2022.
  75. F. Kalantari, D. Gueorguiev, E. Lank, N. Bremard, and L. Grisoni, “Exploring fingers’ limitation of texture density perception on ultrasonic haptic displays,” in Haptics: Science, Technology, and Applications: 11th International Conference, EuroHaptics 2018, Pisa, Italy, June 13-16, 2018, Proceedings, Part I 11.   Springer, 2018, pp. 354–365.
  76. Y.-J. Lue, H.-H. Wang, K.-I. Cheng, C.-H. Chen, and Y.-M. Lu, “Thermal pain tolerance and pain rating in normal subjects: Gender and age effects,” European Journal of Pain, vol. 22, no. 6, pp. 1035–1042, 2018.
  77. I. Blagojevic, “Virtual reality statistics,” 2023. [Online]. Available: https://99firms.com/blog/virtual-reality-statistics/#gref

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets