Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

A Real-time Human Pose Estimation Approach for Optimal Sensor Placement in Sensor-based Human Activity Recognition (2307.02906v1)

Published 6 Jul 2023 in cs.LG, cs.CV, and eess.SP

Abstract: Sensor-based Human Activity Recognition facilitates unobtrusive monitoring of human movements. However, determining the most effective sensor placement for optimal classification performance remains challenging. This paper introduces a novel methodology to resolve this issue, using real-time 2D pose estimations derived from video recordings of target activities. The derived skeleton data provides a unique strategy for identifying the optimal sensor location. We validate our approach through a feasibility study, applying inertial sensors to monitor 13 different activities across ten subjects. Our findings indicate that the vision-based method for sensor placement offers comparable results to the conventional deep learning approach, demonstrating its efficacy. This research significantly advances the field of Human Activity Recognition by providing a lightweight, on-device solution for determining the optimal sensor placement, thereby enhancing data anonymization and supporting a multimodal classification approach.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (30)
  1. Martín Abadi et al. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems.
  2. Ferhat Attal et al. 2015. Physical Human Activity Recognition Using Wearable Sensors. Sensors 15, 12 (2015), 31314–31338.
  3. Z. Cao et al. 2019. OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (2019).
  4. Wenqiang Chen et al. 2021. SenseCollect: We Need Efficient Ways to Collect On-Body Sensor-Based Human Activity Data! Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 3, Article 91 (sep 2021), 27 pages.
  5. Avigyan Das et al. 2020. MMHAR-EnsemNet: A Multi-Modal Human Activity Recognition Model. IEEE Sensors Journal 21, 10 (2020), 11569–11576.
  6. Anis Davoudi et al. 2021. The Effect of Sensor Placement and Number on Physical Activity Recognition and Energy Expenditure Estimation in Older Adults: Validation Study. JMIR Mhealth Uhealth 9, 5 (3 May 2021), e23681.
  7. Biying Fu et al. 2020. Sensing Technology for Human Activity Recognition: A Comprehensive Survey. IEEE Access 8 (2020), 83791–83820.
  8. Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables. arXiv preprint arXiv:1604.08880 (2016).
  9. Shruthi K. Hiremath et al. 2022. Bootstrapping Human Activity Recognition Systems for Smart Homes from Scratch. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 3, Article 119 (sep 2022), 27 pages. https://doi.org/10.1145/3550294
  10. Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long Short-Term Memory. Neural Comput. 9, 8 (nov 1997), 1735–1780.
  11. Yu-Liang Hsu et al. 2018. Human Daily and Sport Activity Recognition Using a Wearable Inertial Sensor Network. IEEE Access 6 (2018), 31715–31728.
  12. Yinghao Huang et al. 2018. Deep Inertial Poser: Learning to Reconstruct Human Pose From Sparse Inertial Measurements in Real Time. ACM Transactions on Graphics (TOG) 37, 6 (2018), 1–15.
  13. Sozo Inoue et al. 2019. Integrating Activity Recognition and Nursing Care Records: The System, Deployment, and a Verification Study. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 3, 3, Article 86 (sep 2019), 24 pages. https://doi.org/10.1145/3351244
  14. MohammadReza Keyvanpour and Fatemeh Serpush. 2019. ESLMT: A New Clustering Method for Biomedical Document Retrieval. Biomedical Engineering/Biomedizinische Technik 64, 6 (2019), 729–741.
  15. Diederik P. Kingma and Jimmy Ba. 2015. Adam: A Method for Stochastic Optimization. CoRR abs/1412.6980 (2015).
  16. Orhan Konak et al. 2022a. SONAR: On-body Sensor-based Human Activity Recognition. https://github.com/HPI-CH/sonar
  17. Orhan Konak et al. 2022b. Study Data: Nursing Activity Recognition. https://nextcloud.hpi.de/s/fSKsgwQ2bx2DRWs
  18. Kai Kunze and Paul Lukowicz. 2014. Sensor Placement Variations in Wearable Activity Recognition. IEEE Pervasive Computing 13, 4 (2014), 32–41.
  19. Activity Recognition Using Cell Phone Accelerometers. SIGKDD Explor. Newsl. 12, 2 (mar 2011), 74–82.
  20. Oscar D Lara and Miguel A Labrador. 2012. A Survey on Human Activity Recognition Using Wearable Sensors. IEEE communications surveys & tutorials 15, 3 (2012), 1192–1209.
  21. Resident Activity Recognition in Smart Homes by Using Artificial Neural Networks. In 2016 4th international istanbul smart grid congress and fair (ICSG). IEEE, 1–5.
  22. Sakorn Mekruksavanich and Anuchit Jitpattanakul. 2022. Multimodal Wearable Sensing for Sport-related Activity Recognition Using Deep Learning Networks. Journal of Advances in Information Technology (2022).
  23. Farzan Majeed Noori et al. 2020. Human Activity Recognition from Multiple Sensors Data Using Multi-Fusion Representations and CNNs. ACM Trans. Multimedia Comput. Commun. Appl. 16, 2, Article 45 (may 2020), 19 pages. https://doi.org/10.1145/3377882
  24. F. Pedregosa et al. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
  25. Sen Qiu et al. 2022. Multi-Sensor Information Fusion Based on Machine Learning for Real Applications in Human Activity Recognition: State-of-the-Art and Research Challenges. Inf. Fusion 80, C (apr 2022), 241–265. https://doi.org/10.1016/j.inffus.2021.11.006
  26. Fatemeh Serpush et al. 2022. Wearable Sensor-Based Human Activity Recognition in the Smart Healthcare System. Computational intelligence and neuroscience 2022 (2022).
  27. Ahmed Taha et al. 2015. Human Activity Recognition for Surveillance Applications. In Proceedings of the 7th International Conference on Information Technology. 577–586.
  28. Chengshuo Xia and Yuta Sugiura. 2021. Optimizing Sensor Position with Virtual Sensors in Human Activity Recognition System Design. Sensors 21, 20 (2021).
  29. Santosh Kumar Yadav et al. 2021. A Review of Multimodal Human Activity Recognition with Special Emphasis on Classification, Applications, Challenges and Future Directions. Knowledge-Based Systems 223 (2021), 106970.
  30. Zhendong Zhuang and Yang Xue. 2019. Sport-Related Human Activity Detection and Recognition Using a Smartwatch. Sensors 19, 22 (2019). https://doi.org/10.3390/s19225001
Citations (2)

Summary

We haven't generated a summary for this paper yet.