Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
97 tokens/sec
GPT-4o
53 tokens/sec
Gemini 2.5 Pro Pro
44 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Leveraging Recommender Systems to Reduce Content Gaps on Peer Production Platforms (2307.08669v4)

Published 17 Jul 2023 in cs.CY, cs.HC, and cs.IR

Abstract: Peer production platforms like Wikipedia commonly suffer from content gaps. Prior research suggests recommender systems can help solve this problem, by guiding editors towards underrepresented topics. However, it remains unclear whether this approach would result in less relevant recommendations, leading to reduced overall engagement with recommended items. To answer this question, we first conducted offline analyses (Study 1) on SuggestBot, a task-routing recommender system for Wikipedia, then did a three-month controlled experiment (Study 2). Our results show that presenting users with articles from underrepresented topics increased the proportion of work done on those articles without significantly reducing overall recommendation uptake. We discuss the implications of our results, including how ignoring the article discovery process can artificially narrow recommendations on peer production platforms.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (49)
  1. Gender differences in Wikipedia editing. In Proceedings of the 7th International Symposium on Wikis and Open Collaboration, WikiSym ’11, 11–14. New York, NY, USA: Association for Computing Machinery. ISBN 978-1-4503-0909-7.
  2. Wiki Loves Monuments: crowdsourcing the collective image of the worldwide built heritage. ACM Journal on Computing and Cultural Heritage, 16(1): 1–27.
  3. Exposure to ideologically diverse news and opinion on Facebook. Science, 348(6239): 1130–1132. Publisher: American Association for the Advancement of Science.
  4. Baltz, S. 2021. Wikipedia’s political science coverage is biased. I tried to fix it. Washington Post.
  5. Are We Exposed to the Same “News” in the News Feed?: An empirical analysis of filter bubbles as information similarity for Danish Facebook users. Digital Journalism, 6(8): 990–1002. Publisher: Routledge _eprint: https://doi.org/10.1080/21670811.2018.1510741.
  6. Beytía, P. 2020. The Positioning Matters: Estimating Geographical Bias in the Multilingual Record of Biographies on Wikipedia. In Companion Proceedings of the Web Conference 2020, WWW ’20, 806–810. New York, NY, USA: Association for Computing Machinery. ISBN 978-1-4503-7024-0.
  7. Bjork-James, C. 2021. New maps for an inclusive Wikipedia: decolonial scholarship and strategies to counter systemic bias. New Review of Hypermedia and Multimedia, 0(0): 1–22. Publisher: Taylor & Francis _eprint: https://doi.org/10.1080/13614568.2020.1865463.
  8. Cohen, N. 2011. Define Gender Gap? Look Up Wikipedia’s Contributor List. The New York Times.
  9. SuggestBot: using intelligent task routing to help people find work in wikipedia. In Proceedings of the 12th international conference on Intelligent user interfaces, IUI ’07, 32–41. New York, NY, USA: Association for Computing Machinery. ISBN 978-1-59593-481-9.
  10. Dahlgren, P. M. 2021. A critical review of filter bubbles and a comparison with selective exposure. Nordicom Review, 42(1): 15–33.
  11. Fairness in information access systems. Foundations and Trends® in Information Retrieval, 16(1-2): 1–177.
  12. Letting users choose recommender algorithms: An experimental study. In Proceedings of the 9th ACM Conference on Recommender Systems, 11–18.
  13. Bring on board new enthusiasts! A case study of impact of Wikipedia art+ feminism edit-a-thon events on newcomers. In Social Informatics: 8th International Conference, SocInfo 2016, Bellevue, WA, USA, November 11-14, 2016, Proceedings, Part I 8, 24–40. Springer.
  14. Foundation, W. 2021. 2021 Community Insights Survey.
  15. Multilingual entity linking system for wikipedia with a machine-in-the-loop approach. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management, 3818–3827.
  16. Gleick, J. 2013. Wikipedia’s Women Problem.
  17. How do social media feed algorithms affect attitudes and behavior in an election campaign? Science, 381(6656): 398–404. Publisher: American Association for the Advancement of Science.
  18. Burst of the Filter Bubble?: Effects of personalization on the diversity of Google News. Digital Journalism, 6(3): 330–343. Publisher: Routledge _eprint: https://doi.org/10.1080/21670811.2017.1338145.
  19. Halfaker, A. 2017. Interpolating quality dynamics in Wikipedia and demonstrating the Keilana effect. In Proceedings of the 13th International Symposium on Open Collaboration, 1–9.
  20. Mind the skills gap: the role of Internet know-how and gender in differentiated contributions to Wikipedia. Information, Communication & Society, 18(4): 424–442. Publisher: Routledge _eprint: https://doi.org/10.1080/1369118X.2014.957711.
  21. Measuring self-focus bias in community-maintained knowledge repositories. In Proceedings of the fourth international conference on Communities and technologies - C&T ’09, 11. University Park, PA, USA: ACM Press. ISBN 978-1-60558-713-4.
  22. The evolution of humanitarian mapping within the OpenStreetMap community. Scientific reports, 11(1): 1–15.
  23. ”We Need a Woman in Music”: Exploring Wikipedia’s Values on Article Priority. Proceedings of the ACM on Human-Computer Interaction, 6(CSCW2): 266:1–266:28.
  24. Considerations for Multilingual Wikipedia Research. arXiv preprint arXiv:2204.02483.
  25. The Gender Divide in Wikipedia: Quantifying and Assessing the Impact of Two Feminist Interventions. Journal of Communication, 72(3): 297–321.
  26. Mandiberg, M. 2020. Mapping Wikipedia. Section: Technology.
  27. Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems. In Proceedings of the 27th acm international conference on information and knowledge management, 2243–2251.
  28. WP:NOT, WP:NPOV, and Other Stories Wikipedia Tells Us: A Feminist Critique of Wikipedia’s Epistemology. Science, Technology, & Human Values, 46(3): 455–479. Publisher: SAGE Publications Inc.
  29. What Are Filter Bubbles Really? A Review of the Conceptual and Empirical Work. In Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization, UMAP ’22 Adjunct, 274–279. New York, NY, USA: Association for Computing Machinery. ISBN 978-1-4503-9232-7.
  30. Evaluating the impact of the Wikipedia Teahouse on newcomer socialization and retention. In Proceedings of the 14th International Symposium on Open Collaboration, 1–7.
  31. The Wikipedia Adventure: field evaluation of an interactive tutorial for new users. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, 1785–1799.
  32. Nov, O. 2007. What motivates Wikipedians? Communications of the ACM, 50(11): 60–64.
  33. Pariser, E. 2011. The Filter Bubble: How the New Personalized Web Is Changing What We Read and How We Think. Penguin. ISBN 978-1-101-51512-9. Google-Books-ID: wcalrOI1YbQC.
  34. A Taxonomy of Knowledge Gaps for Wikimedia Projects (Second Draft). ArXiv:2008.12314 [cs].
  35. Resnick, B. 2018. The 2018 Nobel Prize reminds us that women scientists too often go unrecognized.
  36. Wikimedia 2030 movement strategy: How an inclusive open strategy process has placed people at the centre.
  37. Volunteer contributions to Wikipedia increased during COVID-19 mobility restrictions. Scientific reports, 11(1): 21505.
  38. Scott, D. 2018. Why the theme for Wikimania 2018 will be ”Bridging knowledge gaps—the ubuntu way forward”.
  39. The multisided complexity of fairness in recommender systems. AI magazine, 43(2): 164–176.
  40. Opportunistic Multi-aspect Fairness through Personalized Re-ranking. In Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization, UMAP ’20, 239–247. New York, NY, USA: Association for Computing Machinery. ISBN 978-1-4503-6861-2.
  41. Gender equity report 2018.
  42. Geographic Biases are ’Born, not Made’ Exploring Contributors’ Spatiotemporal Behavior in OpenStreetMap. In Proceedings of the 2018 ACM Conference on Supporting Groupwork, 71–82.
  43. Torres, N. 2016. Why Do So Few Women Edit Wikipedia? Harvard Business Review. Section: Gender.
  44. Tripodi, F. 2021. Ms. Categorized: Gender, notability, and inequality on Wikipedia. New Media & Society, 14614448211023772.
  45. Misalignment Between Supply and Demand of Quality Content in Peer Production Communities. Proceedings of the International AAAI Conference on Web and Social Media, 9(1). Number: 1.
  46. Wikimedia Foundation. 2017. Strategy/Wikimedia movement/2017/Direction.
  47. Wikimedia Foundation. 2023. Open the Knowledge.
  48. WikiProject: Women in Red. 2023. Wikipedia:WikiProject Women in Red. Page Version ID: 1150932960.
  49. Growing wikipedia across languages via recommendation. In Proceedings of the 25th International Conference on World Wide Web, 975–985.
User Edit Pencil Streamline Icon: https://streamlinehq.com
Authors (4)
  1. Mo Houtti (5 papers)
  2. Isaac Johnson (22 papers)
  3. Morten Warncke-Wang (3 papers)
  4. Loren Terveen (11 papers)

Summary

We haven't generated a summary for this paper yet.