Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
9 tokens/sec
GPT-4o
12 tokens/sec
Gemini 2.5 Pro Pro
40 tokens/sec
o3 Pro
5 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Guidelines for Integrating Value Sensitive Design in Responsible AI Toolkits (2403.00145v1)

Published 29 Feb 2024 in cs.HC

Abstract: Value Sensitive Design (VSD) is a framework for integrating human values throughout the technology design process. In parallel, Responsible AI (RAI) advocates for the development of systems aligning with ethical values, such as fairness and transparency. In this study, we posit that a VSD approach is not only compatible, but also advantageous to the development of RAI toolkits. To empirically assess this hypothesis, we conducted four workshops involving 17 early-career AI researchers. Our aim was to establish links between VSD and RAI values while examining how existing toolkits incorporate VSD principles in their design. Our findings show that collaborative and educational design features within these toolkits, including illustrative examples and open-ended cues, facilitate an understanding of human and ethical values, and empower researchers to incorporate values into AI systems. Drawing on these insights, we formulated six design guidelines for integrating VSD values into the development of RAI toolkits.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (93)
  1. Design Card Sets: Systematic Literature Survey and Card Sorting Study. Proceedings of the ACM Designing Interactive Systems Conference (DIS). https://doi.org/10.1145/3357236.3395516
  2. “Fairness Toolkits, A Checkbox Culture?” On the Factors That Fragment Developer Practices in Handling Algorithmic Harms. In Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society (Montréal, QC, Canada) (AIES ’23). Association for Computing Machinery, New York, NY, USA, 482–495. https://doi.org/10.1145/3600211.3604674
  3. Accidentally Evil: On Questionable Values in Smart Home Co-Design. Proceedings of the Conference on Human Factors in Computing Systems (CHI). https://doi.org/10.1145/3544548.3581504
  4. S. Bolkan and A. Goodboy. 2019. Examples and the facilitation of student learning: should instructors provide examples or should students generate their own? Communication Education 68, 3 (2019), 287–307. https://doi.org/10.1080/03634523.2019.1602275
  5. Informing Public Deliberation: Value Sensitive Design of Indicators for a Large-Scale Urban Simulation. ECSCW 2005. https://doi.org/10.1007/1-4020-4023-7_23
  6. A. Borning and M. Muller. 2012. Next Steps for Value Sensitive Design, Vol. 2. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). https://doi.org/10.1145/2207676.2208560
  7. K. Boyd. 2022. Designing Up with Value-Sensitive Design: Building a Field Guide for Ethical ML Development. ACM Conference on Fairness, Accountability, and Transparency (FAccT). https://doi.org/10.1145/3531146.3534626
  8. V. Braun and V. Clark. 2019. Reflecting on reflexive thematic analysis. Qualitative Research in Sport, Exercise and Health 11, 4 (2019), 589–597. https://doi.org/10.1080/2159676X.2019.1628806
  9. V. Braun and V. Clark. 2021. To saturate or not to saturate? Questioning data saturation as a useful concept for thematic analysis and sample-size rationales. Qualitative Research in Sport, Exercise and Health 13, 2 (2021), 201–216. https://doi.org/10.1080/2159676X.2019.1704846
  10. V. Braun and V. Clarke. 2012. Thematic analysis. American Psychological Association, 57–71. https://doi.org/10.1037/13620-004
  11. J. Buolamwini and T. Gebru. 2018. Gender shades: Intersectional accuracy disparities in commercial gender classification. Proceedings of the Conference on Fairness, Accountability and Transparency (FAccT).
  12. AI Blindspot: A discovery process for spotting unconscious biases and structural inequalities in AI systems. https://aiblindspot.media.mit.edu/
  13. Shared mental models in expert team decision making. Psychology Press.
  14. Interpretable Machine Learning: Moving from mythos to diagnostics. ACMQueue 19, 6 (2022). https://doi.org/10.1145/3546036
  15. M. Cherubini. [n. d.]. Ethical Autonomous Algorithms. https://medium.com/@mchrbn/ethical-autonomous-algorithms-5ad07c311bcc
  16. M. Constantinides. 2022. Making Responsible AI development simple through prompt cards. https://www.bell-labs.com/institute/blog/making-responsible-ai-development-simple-through-prompt-cards/
  17. C. Custis. 2021. Operationalizing AI Ethics through Documentation: ABOUT ML in 2020 and Beyond. https://partnershiponai.org/about-ml-2021/
  18. An Uncommon Task: Participatory Design in Legal AI. Proceedings of the ACM on Human-Computer Interaction 6, CSCW1 (2022). https://doi.org/10.1145/3512898
  19. Investigating Practices and Opportunities for Cross-Functional Collaboration around AI Fairness in Industry Practice. In Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (Chicago, IL, USA) (FAccT ’23). Association for Computing Machinery, New York, NY, USA, 705–716. https://doi.org/10.1145/3593013.3594037
  20. Towards Increased Transparency with Value Sensitive Design. Springer. https://doi.org/10.1007/978-3-030-50334-5_1
  21. DigitalCatapult. 2020. Lessons in Practical AI Ethics.
  22. M. Dolata and G. Schwabe. 2019. Translation and Adoption: Exploring Vocabulary Work in Expert-Layperson Encounters. Computer Supported Cooperative Work (CSCW) 28 (2019), 685–722. https://doi.org/10.1007/s10606-019-09358-9
  23. Responsible & Inclusive Cards: An Online Card Tool to Promote Critical Reflection in Technology Industry Work Practices. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI.
  24. Principled artificial intelligence: Mapping consensus in ethical and rights-based approaches to principles for AI. Berkman Klein Center Research Publication 2020-1 (2020). https://doi.org/10.2139/ssrn.3518482
  25. Patchwork: The Hidden, Human Labor of AI Integration within Essential Work. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023). https://doi.org/10.1145/3579514
  26. Value Sensitive Design: Theory & Methods.
  27. The Watcher and the Watched: Social Judgments About Privacy in a Public Place. Human-Computer Interaction 21 (2006), 235–272. https://doi.org/10.1207/s15327051hci2102_3
  28. Gender and Participation in Open Source Software Development, Vol. 6. Proceedings of the ACM on Human-Computer Interaction. https://doi.org/10.1145/3555190
  29. Values in Action (ViA): Combining Usability, User Experience and User Acceptance. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). https://doi.org/10.1145/2212776.2223711
  30. I. Gabriel. 2020. Artificial Intelligence, Values, and Alignment. Minds and Machines 30 (2020), 411–437.
  31. From Value Sensitive Design to values absorption – building an instrument to analyze organizational capabilities for value-sensitive innovation. Journal of Responsible Innovation (2022).
  32. T. Hagendorff. 2020. The ethics of AI ethics: an evaluation of guidelines. Minds and Machines 30 (2020), 99–120. https://doi.org/10.1007/s11023-020-09517-8
  33. M. Harbers and A. Overdiek. 2022. Towards a living lab for responsible applied AI. In Proceedings of the Design Research Society Conference (DRS). https://doi.org/10.21606/drs.2022.422
  34. G Harboe and E. Huang. 2015. Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI). https://doi.org/10.1145/2702123.2702561
  35. Situated Data, Situated Systems: A Methodology to Engage with Power Relations in Natural Language Processing Research. Proceedings of the Second Workshop on Gender Bias in Natural Language Processing. https://doi.org/10.48550/arXiv.2011.05911
  36. Beever J. Strobel J. Brightman A.O. Hess, J.L. 2017. Empathic Perspective-Taking and Ethical Decision-Making in Engineering Ethics Education. Philosophy of Engineering and Technology 26 (2017). https://doi.org/10.1007/978-3-319-45193-0_13
  37. J. Holden. 2018. Improving Nursing Student Empathy With Experiential Learning. Proceedings of the Nursing Education Research Conference. http://hdl.handle.net/10755/623970
  38. DEVELOPING ETHICAL ENGINEERS WITH EMPATHY. Proceedings of the Canadian Engineering Education Association (CEEA). https://doi.org/10.24908/pceea.vi0.14856
  39. How Different Groups Prioritize Ethical Values for Responsible AI. In Proceedings of the ACM Conference on Fairness, Accountability, and Transparency (FAccT). https://doi.org/10.1145/3531146.3533097
  40. The global landscape of AI ethics guidelines. Natural Machine Intelligence 1 (2019), 389–399. https://doi.org/10.1038/s42256-019-0088-2
  41. Interpreting Interpretability: Understanding Data Scientists’ Use of Interpretability Tools for Machine Learning. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376219
  42. S. Khan. 2014. Qualitative Research Method: Grounded Theory. International Journal of Business and Management 9 (2014). https://doi.org/10.5539/ijbm.v9n11p224
  43. Stanford Digital Civil Society Lab. n.d.. Digital Impact Toolkit. https://digitalimpact.io/toolkit/
  44. WeBuildAI: Participatory Framework for Algorithmic Governance. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI. https://doi.org/10.1145/3359283
  45. V. Liao and S. Sundar. 2022. Designing for Responsible Trust in AI Systems: A Communication Perspective. Proceedings of the ACM Conference on Fairness, Accountability, and Transparency (FAccT). https://doi.org/10.1145/3531146.3533182
  46. Researching AI Legibility through Design. Proceedings of the CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3313831.3376792
  47. M. Luria. 2018. Designing Robot Personality Based on Fictional Sidekick Characters. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction. https://doi.org/10.1145/3173386.3176912
  48. A. Maillet. 2019. Introducing the Human-Centered AI Canvas. https://medium.com/@albmllt/introducing-the-human-centered-ai-canvas-a4c9d2fc127e
  49. N. Manders-Huits and M. Zimmer. 2009. Values and pragmatic action: The challenges of introducing ethical intelligence in technical design communities. The International Review of Information Ethics 10 (2009), 37–44. https://doi.org/10.29173/irie87
  50. Perspectives about Artificial Moral Agents. AI and Ethics 1 (2021), 477–490. https://doi.org/10.1007/s43681-021-00055-2
  51. B. Martin and B. Hanington. 2012. Universal Methods of Design: 100 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions. Rockport Publishers.
  52. K. Martin. 2019. Ethical implications and accountability of algorithms. Journal of Business Ethics 160, 4 (2019), 835–850.
  53. On designing open-ended interpretations for collaborative design exploration. CoDesign 7, 2 (2011), 79–93. https://doi.org/10.1080/15710882.2011.609891
  54. Does ACM’s code of ethics change ethical decision making in software development? Proceedings of the ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering, 729 – 733. https://doi.org/10.1145/3236024.3264833
  55. Algorithmic Impact Assessments and Accountability: The Co-construction of Impacts. Proceedings of the ACM Conference on Fairness, Accountability, and Transparency (FAccT). https://doi.org/10.1145/3442188.3445935
  56. Microsoft. 2022. Judgment Call. https://learn.microsoft.com/en-us/azure/architecture/guide/responsible-innovation/judgmentcall
  57. C. Miller and R. Coldicott. 2019. People, power and technology: The tech workers’ view. https://doteveryone.org.uk/report/workersview/
  58. Model Cards for Model Reporting. In Proceedings of the Conference on Fairness, Accountability, and Transparency (Atlanta, GA, USA) (FAT* ’19). Association for Computing Machinery, New York, NY, USA, 220–229. https://doi.org/10.1145/3287560.3287596
  59. Tiles: A Card-Based Ideation Toolkit for the Internet of Things. Proceedings of the Conference on Designing Interactive Systems (DIS). https://doi.org/10.1145/3064663.3064699
  60. Operationalising AI ethics: barriers, enablers and next steps. AI & Society (2021). https://doi.org/10.1007/s00146-021-01308-8
  61. Governing with Algorithmic Impact Assessments: Six Observations. Proceedings of the ACM Conference on Artificial Intelligence, Ethics and Society (AIES). https://doi.org/10.1145/3461702.3462580
  62. Metaphors for designers working with AI. In Proceedings of the Design Research Society Conference (DRS). https://doi.org/10.21606/drs.2022.667
  63. NISt. 2016. AI RISK MANAGEMENT FRAMEWORK. Retrieved Dec 2023 from https://www.nist.gov/itl/ai-risk-management-framework
  64. E. Olmsted-Hawala. 2006. Card Sorting, Information Architecture And Usability: Adding in Our Users’ Perspective to Re-Design the Census Bureau Web Site. Proceedings of the International Professional Communication Conference, 27 – 33. https://doi.org/10.1109/IPCC.2006.320360
  65. A. Palmer and D. Schwan. 2023. More Process, Less Principles: The Ethics of Deploying AI and Robotics in Medicine. Cambridge Quarterly of Healthcare Ethics (2023), 1–14. https://doi.org/10.1017/S0963180123000087
  66. Toolkits, cards and games – a review of analogue tools for collaborative ideation. CoDesign 17, 4 (2021), 410–434. https://doi.org/10.1080/15710882.2020.1715444
  67. How AI Developers Overcome Communication Challenges in a Multidisciplinary Team: A Case Study. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 131 (apr 2021), 25 pages. https://doi.org/10.1145/3449205
  68. Towards Requirements Specification for Machine-Learned Components. Proceedings of the IEEE International Requirements Engineering Conference. https://doi.org/10.1109/REW.2019.00049
  69. Lime. https://github.com/marcotcr/lime
  70. R. Roy and J. Warren. 2019. Card-based design tools: a review and analysis of 155 card decks for designers and designing. Design Studies 63 (2019), 125–154. https://doi.org/10.1016/j.destud.2019.04.002
  71. Co-designing conversational agents: A comprehensive review and recommendations for best practices. Design Studies 89 (2023). https://doi.org/10.1016/j.destud.2023.101230
  72. Designing value‐sensitive AI: a critical review and recommendations for socio‐technical design processes. AI & Ethics (2023). https://doi.org/10.1007/s43681-023-00373-7
  73. AI Ethics Principles in Practice: Perspectives of Designers and Developers. IEEE Transactions on Technology and Society 4, 2 (2023), 171–187. https://api.semanticscholar.org/CorpusID:245131189
  74. K. Sekiguchi and K. Hori. 2021. Designing ethical artifacts has resulted in creative design. AI & Society 36 (2021), 101––148. https://doi.org/10.1007/s00146-020-01043-6
  75. Knowledge Center Data & Society. n.d.. Tools. https://data-en-maatschappij.ai/en/tools
  76. N. Stoimenova and M. Kleinsmann. 2020. Identifying and addressing unintended values when designing (with) Artificial Intelligence(with) Artificial Intelligence. Proceedings of the Design Research Society (DRS) International Conference. https://doi.org/10.21606/drs.2020.222
  77. The value sensitive design of a preventive health check app. Ethics and Information Technology 24, 38 (2022).
  78. van Merrienboer J.J.G. & Paas F.G.W.C. Sweller, J. 1998. Cognitive Architecture and Instructional Design. Educational Psychology Review 10 (1998), 251––296. https://doi.org/10.1023/A:1022193728205
  79. Human-Centered Responsible Artificial Intelligence: Current & Future Trends. In Extended Abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI). 1–4. https://doi.org/10.1145/3544549.3583178
  80. S. Umbrello. 2022. The Role of Engineers in Harmonising Human Values for AI Systems Design. Journal of Responsible Technology 10 (2022).
  81. S. Umbrello and O. Gambelin. 2022. Agile as a Vehicle for Values: A Value Sensitive Design Toolkit. Springer.
  82. S. Umbrello and I. Van de Poek. 2021. Mapping value sensitive design onto AI for social good principles. AI and Ethics 1, 3 (2021), 283–296. https://doi.org/10.1007/s43681-021-00038-3
  83. I. van de Poel. 2020. Embedding Values in Artificial Intelligence (AI) Systems. Mind and Machines 30 (2020), 385–409.
  84. Q. Vera and M. Muller. 2019. Enabling Value Sensitive AI Systems through Participatory Design Fictions. arXiv preprint arXiv:1912.07381v1 (2019). https://arxiv.org/abs/1912.07381
  85. AI and Ethics: The Key to a Successful Human-AI Relation. https://www.sginnovate.com/events/ai-and-ethics-key-successful-human-ai-relation
  86. What AI Practitioners Say about Human-AI Trust: Its Role, Importance, and Factors That Affect It. International Conference on Hybrid Human-Artificial Intelligence.
  87. The Role and Limits of Principles in AI Ethics: Towards a Focus on Tensions. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society (AIES). https://doi.org/10.1145/3306618.3314289
  88. Seeing Like a Toolkit: How Toolkits Envision the Work of AI Ethics. Proceedings of the ACM on Human-Computer Interaction 7, CSCW1 (2023). https://doi.org/10.1145/3579621
  89. Investigating How Practitioners Use Human-AI Guidelines: A Case Study on the People + AI Guidebook. In Proceedings of the CHI Conference on Human Factors in Computing Systems,.
  90. A value sensitive action-reflection model: evolving a co-design space with stakeholder and designer prompts. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI). https://doi.org/10.1145/2470654.2470715
  91. L. Yu and Y. Li. 2022. Artificial Intelligence Decision-Making Transparency and Employees Trust: The Parallel Multiple Mediating Effect of Effectiveness and Discomfort. Behavioral Sciences 12, 5 (2022). https://doi.org/10.3390/bs12050127
  92. How Do Data Science Workers Collaborate? Roles, Workflows, and Tools. Proc. ACM Hum.-Comput. Interact. 4, CSCW1, Article 22 (may 2020), 23 pages. https://doi.org/10.1145/3392826
  93. Value-Sensitive Algorithm Design: Method, Case Study, and Lessons, Vol. CSCW2. Proceedings of the ACM Conference on Human-Computer Interactions. https://doi.org/10.1145/3274463
Citations (4)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now