Empathy and the Right to Be an Exception: What LLMs Can and Cannot Do (2401.14523v1)
Abstract: Advances in the performance of LLMs have led some researchers to propose the emergence of theory of mind (ToM) in AI. LLMs can attribute beliefs, desires, intentions, and emotions, and they will improve in their accuracy. Rather than employing the characteristically human method of empathy, they learn to attribute mental states by recognizing linguistic patterns in a dataset that typically do not include that individual. We ask whether LLMs' inability to empathize precludes them from honoring an individual's right to be an exception, that is, from making assessments of character and predictions of behavior that reflect appropriate sensitivity to a person's individuality. Can LLMs seriously consider an individual's claim that their case is different based on internal mental states like beliefs, desires, and intentions, or are they limited to judging that case based on its similarities to others? We propose that the method of empathy has special significance for honoring the right to be an exception that is distinct from the value of predictive accuracy, at which LLMs excel. We conclude by considering whether using empathy to consider exceptional cases has intrinsic or merely practical value and we introduce conceptual and empirical avenues for advancing this investigation.
- GPT-4 Technical Report. arXiv:2303.08774.
- C. Daniel Batson. 2009. These Things Called Empathy: Eight Related But Distinct Phenomena. In The Social Neuroscience of Empathy, Jean Decety and William Ickes (Eds.). MIT Press, 3–15.
- Perspective Taking: Imagining How Another Feels Versus Imaging How You Would Feel. Personality and Social Psychology Bulletin 23, 7 (1997), 751–758.
- Paul Bloom. 2016. Against Empathy: The Case for Rational Compassion. HarperCollins Publishers, New York, NY, USA.
- Empathy is Hard Work: People Choose to Avoid Empathy Because of Its Cognitive Costs. Journal of Experimental Psychology: General 148, 6 (2019), 962–976.
- Sarah H. Cen and Manish Raghavan. 2023. The Right to Be an Exception to a Data-Driven Rule. MIT Case Studies in Social and Ethical Responsibilities of Computing Winter (Feb. 2023).
- Their Pain Gives Us Pleasure: How Intergroup Dynamics Shape Empathic Failures and Counter-Empathic Responses. Journal of Experimental Social Psychology 55 (2014), 110–125.
- Amy Coplan. 2011. Understanding Empathy. In Empathy: Philosophical and Psychological Perspectives, Amy Coplan and Peter Goldie (Eds.). Oxford University Press, 3–18.
- The Empathy Gap: Why AI Can Forecast Behavior But Cannot Assess Trustworthiness. In Proceedings of the AAAI Fall Symposium Series Symposium on Thinking Fast and Slow and Other Cognitive Theories in AI.
- Emotional Contagion and Empathy. In The Social Neuroscience of Empathy, Jean Decety and William Ickes (Eds.). MIT Press, 19–30.
- In Praise of Empathic AI. Trends in Cognitive Sciences (Dec. 2023).
- Michal Kosinski. 2023. Theory of Mind May Have Spontaneously Emerged in Large Language Models. arXiv:2302.02083.
- Judea Pearl. 2019. The Seven Tools of Causal Inference, with Reflections on Machine Learning. Commun. ACM 62, 3 (2019), 54–60.
- Three-Year-Olds’ Difficulty with False Belief: The Case for a Conceptual Deficit. British Journal of Developmental Psychology 5, 2 (June 1987), 125–137.
- Neomi Rao. 2011. Three Concepts of Dignity in Constitutional Law. Notre Dame Law Review 86, 1 (Feb. 2011), 183–271.
- Using Sequences of Life-Events to Predict Human Lives. Nature Computational Science (Dec. 2023).
- Towards Conversational Diagnostic AI.
- Tomer Ullman. 2023. Large Language Models Fail on Trivial Alterations to Theory-of-Mind Tasks. arXiv:2302.08399.
- Heinz Wimmer and Josef Perner. 1983. Beliefs About Beliefs: Representation and Constraining Function of Wrong Beliefs in Young Children’s Understanding of Deception. Cognition 13, 1 (Jan. 1983), 103–128.
- William Kidder (1 paper)
- Jason D'Cruz (3 papers)
- Kush R. Varshney (121 papers)