Hand Gesture Recognition through Reflected Infrared Light Wave Signals (2301.05955v2)
Abstract: In this study, we present a wireless (non-contact) gesture recognition method using only incoherent light wave signals reflected from a human subject. In comparison to existing radar, light shadow, sound and camera-based sensing systems, this technology uses a low-cost ubiquitous light source (e.g., infrared LED) to send light towards the subject's hand performing gestures and the reflected light is collected by a light sensor (e.g., photodetector). This light wave sensing system recognizes different gestures from the variations of the received light intensity within a 20-35cm range. The hand gesture recognition results demonstrate up to 96% accuracy on average. The developed system can be utilized in numerous Human-computer Interaction (HCI) applications as a low-cost and non-contact gesture recognition technology.
- J. Gubbi, R. Buyya, S. Marusic, and M. Palaniswami, “Internet of Things (IoT): A vision, architectural elements, and future directions,” Future Generation Computer Systems, vol. 29, no. 7, pp. 1645–1660, 2013. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0167739X13000241
- C. Zhu and W. Sheng, “Wearable Sensor-Based Hand Gesture and Daily Activity Recognition for Robot-Assisted Living,” IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, vol. 41, no. 3, pp. 569–573, May 2011.
- M. Caputo, K. Denker, B. Dums, G. Umlauf, H. Konstanz, and G. , “3D Hand Gesture Recognition Based on Sensor Fusion of Commodity Hardware,” vol. 2012, 01 2012.
- F. Adib, Z. Kabelac, D. Katabi, and R. C. Miller, “3D Tracking via Body Radio Reflections,” in 11th USENIX Symposium on Networked Systems Design and Implementation (NSDI 14). Seattle, WA: USENIX Association, 2014, pp. 317–329. [Online]. Available: https://www.usenix.org/conference/nsdi14/technical-sessions/presentation/adib
- Y. Zeng, P. H. Pathak, and P. Mohapatra, “Analyzing Shopper’s Behavior Through WiFi Signals,” in Proceedings of the 2Nd Workshop on Workshop on Physical Analytics, ser. WPA ’15. New York, NY, USA: ACM, 2015, pp. 13–18. [Online]. Available: http://doi.acm.org/10.1145/2753497.2753508
- S. Sen, J. Lee, K.-H. Kim, and P. Congdon, “Avoiding multipath to revive inbuilding wifi localization,” in Proceeding of the 11th Annual International Conference on Mobile Systems, Applications, and Services, ser. MobiSys ’13. New York, NY, USA: ACM, 2013, pp. 249–262. [Online]. Available: http://doi.acm.org/10.1145/2462456.2464463
- J. Lien, N. Gillian, M. E. Karagozler, P. Amihood, C. Schwesig, E. Olson, H. Raja, and I. Poupyrev, “Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar,” ACM Transactions on Graphics, vol. 35, no. 4, pp. 1–19, Jul. 2016. [Online]. Available: https://dl.acm.org/doi/10.1145/2897824.2925953
- L. Chen, H. Wei, and J. Ferryman, “A survey of human motion analysis using depth imagery,” Pattern Recognition Letters, vol. 34, no. 15, pp. 1995 – 2006, 2013, smart Approaches for Human Action Recognition.
- M. A. R. Ahad, J. K. Tan, H. Kim, and S. Ishikawa, “Motion history image: Its variants and applications,” Mach. Vision Appl., vol. 23, no. 2, p. 255–281, Mar. 2012. [Online]. Available: https://doi.org/10.1007/s00138-010-0298-4
- R. H. Venkatnarayan and M. Shahzad, “Gesture Recognition Using Ambient Light,” Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, vol. 2, no. 1, pp. 1–28, Mar. 2018. [Online]. Available: https://dl.acm.org/doi/10.1145/3191772
- M. Kaholokula, “Reusing Ambient Light to Recognize Hand Gestures,” Dartmouth College, Tech. Rep., 2016.
- Y. Qifan, T. Hao, Z. Xuebing, L. Yin, and Z. Sanfeng, “Dolphin: Ultrasonic-based gesture recognition on smartphone platform,” in 2014 IEEE 17th International Conference on Computational Science and Engineering, 2014, pp. 1461–1468.
- A. Mujibiya, X. Cao, D. S. Tan, D. Morris, S. N. Patel, and J. Rekimoto, “The sound of touch: On-body touch and gesture sensing based on transdermal ultrasound propagation,” in Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces, ser. ITS ’13. NY, USA: Assoc. for Computing Machinery, 2013, p. 189–198. [Online]. Available: https://doi.org/10.1145/2512349.2512821
- Z. Chi, Y. Yao, T. Xie, X. Liu, Z. Huang, W. Wang, and T. Zhu, “EAR: Exploiting uncontrollable ambient RF signals in heterogeneous networks for gesture recognition,” in SenSys 2018 - Proceedings of the 16th Conference on Embedded Networked Sensor Systems, Nov 2018, pp. 237–249.
- Z. Tian, X. Yang, and M. Zhou, “WiCatch: A Wi-Fi Based Hand Gesture Recognition System,” IEEE Access, vol. 6, pp. 16 911–16 923, Mar 2018.
- J. Geisheimer and E. Greneker, “A non-contact lie detector using radar vital signs monitor (rvsm) technology,” IEEE Aerospace and Electronic Systems Magazine, vol. 16, no. 8, pp. 10–14, 2001.
- T. Masao and S. WATANABE, “Biological and health effects of exposure to electromagnetic field from mobile communications systems,” IATSS research, vol. 25, no. 2, pp. 40–50, 2001.
- S. Oprisescu, C. Rasche, and B. Su, “Automatic static hand gesture recognition using tof cameras,” in 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO), Aug 2012, pp. 2748–2751.
- T. Plotz, C. Chen, N. Y. Hammerla, and G. D. Abowd, “Automatic synchronization of wearable sensors and video-cameras for ground truth annotation – a practical approach,” in 2012 16th International Symposium on Wearable Computers, June 2012, pp. 100–103.
- H. Watanabe, T. Terada, and M. Tsukamoto, “Ultrasound-Based Movement Sensing, Gesture-, and Context-Recognition,” in Proceedings of the 2013 International Symposium on Wearable Computers, ser. ISWC ’13. New York, NY, USA: Association for Computing Machinery, 2013, p. 57–64.
- 940nm IR lamp Board with Light Sensor (48 Black LED Illuminator Array). Amazon.com, Inc. Accessed on: 07-11-2020. [Online]. Available: https://www.amazon.com/gp/product/B0785W2RQQ
- PDA100A. Thorlabs, Inc. Accessed on: 07-11-2020. [Online]. Available: https://www.thorlabs.com/thorproduct.cfm?partnumber=PDA100A
- J. E. Fowler, “The redundant discrete wavelet transform and additive noise,” IEEE Signal Processing Letters, vol. 12, no. 9, pp. 629–632, Sep. 2005.
- E. Alickovic, J. Kevric, and A. Subasi, “Performance evaluation of empirical mode decomposition, discrete wavelet transform, and wavelet packed decomposition for automated epileptic seizure detection and prediction,” Biomedical Signal Processing and Control, vol. 39, pp. 94–102, 2018. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1746809417301544
- N. Pollesch and V. Dale, “Normalization in sustainability assessment: Methods and implications,” Ecological Economics, vol. 130, pp. 195–208, 2016. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0921800915305899
- G. Guo, H. Wang, D. Bell, Y. Bi, and K. Greer, “KNN model-based approach in classification,” in OTM Confederated International Conferences” On the Move to Meaningful Internet Systems”. Springer, 2003, pp. 986–996.
- L. E. Peterson, “K-nearest neighbor,” Scholarpedia, vol. 4, no. 2, p. 1883, 2009.
- S. Amershi, M. Cakmak, W. B. Knox, and T. Kulesza, “Power to the people: The role of humans in interactive machine learning,” AI Magazine, vol. 35, no. 4, pp. 105–120, Dec. 2014. [Online]. Available: https://www.aaai.org/ojs/index.php/aimagazine/article/view/2513
- Si Free-space Gain Detector User Guide. Thorlabs, Inc. Accessed on: 07-05-2022. [Online]. Available: https://www.thorlabs.com/catalogpages/Obsolete/2018/PDA100A.pdf