Metamorpheus: Interactive, Affective, and Creative Dream Narration Through Metaphorical Visual Storytelling
(2403.00632)Abstract
Human emotions are essentially molded by lived experiences, from which we construct personalised meaning. The engagement in such meaning-making process has been practiced as an intervention in various psychotherapies to promote wellness. Nevertheless, to support recollecting and recounting lived experiences in everyday life remains under explored in HCI. It also remains unknown how technologies such as generative AI models can facilitate the meaning making process, and ultimately support affective mindfulness. In this paper we present Metamorpheus, an affective interface that engages users in a creative visual storytelling of emotional experiences during dreams. Metamorpheus arranges the storyline based on a dream's emotional arc, and provokes self-reflection through the creation of metaphorical images and text depictions. The system provides metaphor suggestions, and generates visual metaphors and text depictions using generative AI models, while users can apply generations to recolour and re-arrange the interface to be visually affective. Our experience-centred evaluation manifests that, by interacting with Metamorpheus, users can recall their dreams in vivid detail, through which they relive and reflect upon their experiences in a meaningful way.
Overview
-
Metamorpheus is an affective interface that allows users to engage in creative visual storytelling, focusing on the emotional experiences of dreams by utilizing generative AI for metaphor suggestions.
-
The platform aims to facilitate self-reflection and vivid dream recall by encouraging users to narrate their dreams through metaphorical visuals and texts, enhancing emotional expression and mindfulness.
-
It introduces an interactive meaning co-construction between users and AI, with the AI generating metaphorical visuals and texts based on the user's emotional dream scenes, leading to a co-creative process.
-
The study, employing a phenomenological approach, finds that Metamorpheus helps users achieve a deeper awareness of their emotions and a more vivid recollection of dreams, offering potential therapeutic-like benefits.
Interactive Affective Narration with Metamorpheus: A New Avenue for Generative AI in Dream Storytelling
Exploring Metamorpheus: An Interface for Dream Narration
In the realm of human-computer interaction (HCI), exploring the nuances of human emotions through technology has always been a path filled with intrigue and potential. A recent study presents Metamorpheus, an affective interface designed to engage users in a creative visual storytelling process, focusing on emotional experiences during dreams. Metamorpheus stands out by arranging storylines based on the emotional arc of dreams and encouraging the creation of metaphorical images and text depictions. It leverages generative AI models to provide metaphor suggestions, generating visual metaphors and textual narratives that users can further refine. This system enables recoloring and re-arrangement of interfaces to enhance visual affectivity, presenting a unique approach to interactive and affective computing.
The Quest for Emotional Expression and Self-Reflection
The core of Metamorpheus lies in its capability to provoke self-reflection and memory recall regarding dreams. Dreams, often a direct reflection of our unconscious experiences and emotions, provide fertile ground for exploring personal meaning and affective mindfulness. Metamorpheus taps into this by facilitating a creative process where users narrate their dreams through metaphorical visuals and texts. This process not only aids in vivid dream recall but also allows users to relive and reflect upon their experiences in a structured and meaningful manner. The blend of AI-generated suggestions and user creativity forms an intimate space for users to explore and articulate emotions that are otherwise hard to express.
Engaging in Meaning Co-construction
One of the pivotal explorations of this study is the interactive meaning co-construction between the user and the AI. This process begins with the user narrating emotional scenes from dreams, prompting the AI to generate metaphorical visuals and texts. Users iteratively refine these outputs, imbuing them with personal meaning and context. This co-creative process underscores a significant shift from conventional AI roles, positioning the AI as a partner in the creative process rather than merely a tool. It underscores the potential of generative AI models in facilitating a deep exploration of emotional experiences, bridging the gap between technology and the intricate landscape of human emotions.
Methodology and Insights
The study employed a phenomenological approach in its evaluation, focusing on the experiential aspects of interaction with Metamorpheus. Participants reported a heightened awareness of their emotions and a more vivid recollection of their dreams. This points towards the interface's effectiveness in fostering a reflective and mindful engagement with one’s own affective states. Interestingly, the process of creating and interacting with metaphorical representations offered a non-invasive, therapeutic-like experience, enabling participants to revisit emotional experiences from a place of safety and detachment.
Potential Applications and Future Directions
The Metamorpheus study opens several avenues for future research and application. The interface’s approach to dream narration could be extended to other forms of personal informatics and digital journaling, offering a novel method for emotional tracking and reflection. Additionally, the concept of AI-facilitated creative narration holds promise for therapeutic applications, offering a new tool for expressing and processing complex emotional experiences.
Conclusion
Metamorpheus represents an innovative step forward in the field of affective computing and HCI. By combining generative AI with interactive design, it offers a unique platform for individuals to explore and narrate their emotional experiences through the creative storytelling of dreams. This study not only highlights the potential of AI in facilitating meaningful self-exploration but also paves the way for new forms of interaction between humans and technology, centered around the profound and personal realm of emotions and dreams.
Create an account to read this summary for free: