Pedagogical Demonstrations and Pragmatic Learning in Artificial Tutor-Learner Interactions (2203.00111v2)
Abstract: When demonstrating a task, human tutors pedagogically modify their behavior by either "showing" the task rather than just "doing" it (exaggerating on relevant parts of the demonstration) or by giving demonstrations that best disambiguate the communicated goal. Analogously, human learners pragmatically infer the communicative intent of the tutor: they interpret what the tutor is trying to teach them and deduce relevant information for learning. Without such mechanisms, traditional Learning from Demonstration (LfD) algorithms will consider such demonstrations as sub-optimal. In this paper, we investigate the implementation of such mechanisms in a tutor-learner setup where both participants are artificial agents in an environment with multiple goals. Using pedagogy from the tutor and pragmatism from the learner, we show substantial improvements over standard learning from demonstrations.
- Grounding language to autonomously-acquired skills via goal generation. In ICLR 2021-Ninth International Conference on Learning Representation, pages 1–21, 2021.
- Help me explore: Minimal social interventions for graph-based autotelic agents. arXiv preprint arXiv:XXX, 2022.
- Language as a cognitive tool to imagine goals in curiosity driven exploration. In Hugo Larochelle, Marc’Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, and Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual, 2020.
- Hyowon Gweon. Inferential social learning: cognitive foundations of human social learning and teaching. Trends in Cognitive Sciences, 2021.
- Infants consider both the sample and the sampling process in inductive generalization. Proceedings of the National Academy of Sciences, 107(20):9066–9071, 2010.
- Showing versus doing: Teaching by demonstration. In NeurIPS, 2016.
- Sampling assumptions in inductive generalization. Cognitive Science, 36(2):187–223, 2012.
- Recent advances in robot learning from demonstration. Annual Review of Control, Robotics, and Autonomous Systems, 3(1):297–330, 2020.
- A rational account of pedagogical reasoning: Teaching by, and learning from, examples. Cognitive psychology, 71:55–89, 2014.
- Towards teachable autonomous agents. arXiv preprint arXiv:2105.11977, 2021.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.
