Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

EEG-SVRec: An EEG Dataset with User Multidimensional Affective Engagement Labels in Short Video Recommendation (2404.01008v1)

Published 1 Apr 2024 in cs.IR

Abstract: In recent years, short video platforms have gained widespread popularity, making the quality of video recommendations crucial for retaining users. Existing recommendation systems primarily rely on behavioral data, which faces limitations when inferring user preferences due to issues such as data sparsity and noise from accidental interactions or personal habits. To address these challenges and provide a more comprehensive understanding of user affective experience and cognitive activity, we propose EEG-SVRec, the first EEG dataset with User Multidimensional Affective Engagement Labels in Short Video Recommendation. The study involves 30 participants and collects 3,657 interactions, offering a rich dataset that can be used for a deeper exploration of user preference and cognitive activity. By incorporating selfassessment techniques and real-time, low-cost EEG signals, we offer a more detailed understanding user affective experiences (valence, arousal, immersion, interest, visual and auditory) and the cognitive mechanisms behind their behavior. We establish benchmarks for rating prediction by the recommendation algorithm, showing significant improvement with the inclusion of EEG signals. Furthermore, we demonstrate the potential of this dataset in gaining insights into the affective experience and cognitive activity behind user behaviors in recommender systems. This work presents a novel perspective for enhancing short video recommendation by leveraging the rich information contained in EEG signals and multidimensional affective engagement scores, paving the way for future research in short video recommendation systems.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Ricardo Baeza-Yates. 2018. Bias on the web. Commun. ACM 61, 6 (2018), 54–61.
  2. The limits of popularity-based recommendations, and the role of social ties. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 745–754.
  3. Neural attentional rating regression with review-level explanations. In Proceedings of the 2018 world wide web conference. 1583–1592.
  4. Co-attentive multi-task learning for explainable recommendation.. In IJCAI. 2137–2143.
  5. Collaborative filtering with preferences inferred from brain signals. In Proceedings of the Web Conference 2021. 602–611.
  6. Differential entropy feature for EEG-based emotion classification. In 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER). IEEE, 81–84.
  7. Joaquín M Fuster. 2002. Frontal lobe and cognitive development. Journal of neurocytology 31, 3-5 (2002), 373–385.
  8. KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videos. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 3953–3957.
  9. Ast: Audio spectrogram transformer. arXiv preprint arXiv:2104.01778 (2021).
  10. Sfviz: interest-based friends exploration and recommendation in social networks. In Proceedings of the 2011 Visual Information Communication-International Symposium. 1–10.
  11. F Maxwell Harper and Joseph A Konstan. 2015. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) 5, 4 (2015), 1–19.
  12. Ruining He and Julian McAuley. 2016. VBPR: visual bayesian personalized ranking from implicit feedback. In Proceedings of the AAAI conference on artificial intelligence, Vol. 30.
  13. Understanding User Immersion in Online Short Video Interaction. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 731–740.
  14. Cerebral location of international 10–20 system electrode placement. Electroencephalography and clinical neurophysiology 66, 4 (1987), 376–382.
  15. Ten challenges for EEG-based affective computing. Brain Science Advances 5, 1 (2019), 1–20.
  16. Recommending based on implicit feedback. In Social Information Access: Systems and Technologies. Springer, 510–569.
  17. Deap: A database for emotion analysis; using physiological signals. IEEE transactions on affective computing 3, 1 (2011), 18–31.
  18. Towards Ubiquitous Personalized Music Recommendation with Smart Bracelets. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 3 (2022), 1–34.
  19. Mu Li and Bao-Liang Lu. 2009. Emotion classification based on gamma-band EEG. In 2009 Annual International Conference of the IEEE Engineering in medicine and biology society. IEEE, 1223–1226.
  20. EEG based emotion recognition: A tutorial and review. Comput. Surveys 55, 4 (2022), 1–57.
  21. Concept-aware denoising graph neural network for micro-video recommendation. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 1099–1108.
  22. Quality effects on user preferences and behaviorsin mobile news streaming. In The World Wide Web Conference. 1187–1197.
  23. Gamma coherence and conscious perception. Neurology 59, 6 (2002), 847–854.
  24. Amigos: A dataset for affect, personality and mood research on individuals and groups. IEEE Transactions on Affective Computing 12, 2 (2018), 479–493.
  25. Understanding information need: An fMRI study. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 335–344.
  26. A content-driven micro-video recommendation dataset at scale. arXiv preprint arXiv:2309.15379 (2023).
  27. Current status, challenges, and possible solutions of EEG-based brain-computer interface: a comprehensive review. Frontiers in neurorobotics (2020), 25.
  28. Emotion detection in the loop from brain signals and facial images. In Proceedings of the eNTERFACE 2006 Workshop. Citeseer.
  29. The interspeech 2016 computational paralinguistics challenge: Deception, sincerity & native language. In 17TH Annual Conference of the International Speech Communication Association (Interspeech 2016), Vols 1-5, Vol. 8. ISCA, 2001–2005.
  30. Guy Shani and Asela Gunawardana. 2011. Evaluating recommendation systems. Recommender systems handbook (2011), 257–297.
  31. EEG emotion recognition using dynamical graph convolutional neural networks. IEEE Transactions on Affective Computing 11, 3 (2018), 532–541.
  32. Towards Music Imagery Information Retrieval: Introducing the OpenMIIR Dataset of EEG Recordings from Music Perception and Imagination.. In ISMIR. 763–769.
  33. Neighborhood-Enhanced Supervised Contrastive Learning for Collaborative Filtering. IEEE Transactions on Knowledge and Data Engineering (2023).
  34. Dual learning for explainable recommendation: Towards unifying user preference prediction and review generation. In Proceedings of The Web Conference 2020. 837–847.
  35. Michal Teplan et al. 2002. Fundamentals of EEG measurement. Measurement science review 2, 2 (2002), 1–11.
  36. Robert E Thayer. 1990. The biopsychology of mood and arousal. Oxford University Press.
  37. Multi-Modal Self-Supervised Learning for Recommendation. arXiv preprint arXiv:2302.10632 (2023).
  38. MMGCN: Multi-modal graph convolution network for personalized recommendation of micro-video. In Proceedings of the 27th ACM international conference on multimedia. 1437–1445.
  39. Peter Welch. 1967. The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Transactions on audio and electroacoustics 15, 2 (1967), 70–73.
  40. A neural influence diffusion model for social recommendation. In Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval. 235–244.
  41. Analysis of EEG signals and its application to neuromarketing. Multimedia Tools and Applications 76 (2017), 19087–19111.
  42. JungAe Yang. 2016. Effects of popularity-based news recommendations (“most-viewed”) on users’ exposure to online news. Media Psychology 19, 2 (2016), 243–271.
  43. Exploiting geographical influence for collaborative point-of-interest recommendation. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval. 325–334.
  44. Towards a Better Understanding of Human Reading Comprehension with Brain Signals. In Proceedings of the ACM Web Conference 2022. 380–391.
  45. Why Don’t You Click: Understanding Non-Click Results in Web Search with Brain Signals. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval. 633–645.
  46. Tenrec: A Large-scale Multipurpose Benchmark Dataset for Recommender Systems. arXiv preprint arXiv:2210.10629 (2022).
  47. Min Zhang and Yiqun Liu. 2021. A commentary of TikTok recommendation algorithms in MIT Technology Review 2021. Fundamental Research 1, 6 (2021), 846–847.
  48. Recbole: Towards a unified, comprehensive and efficient framework for recommendation algorithms. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management. 4653–4664.
  49. Wei-Long Zheng and Bao-Liang Lu. 2015. Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks. IEEE Transactions on autonomous mental development 7, 3 (2015), 162–175.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now