Papers
Topics
Authors
Recent
Search
2000 character limit reached

Freedom to Choose: Understanding Input Modality Preferences of People with Upper-body Motor Impairments for Activities of Daily Living

Published 9 Jul 2022 in cs.HC | (2207.04344v1)

Abstract: Many people with upper-body motor impairments encounter challenges while performing Activities of Daily Living (ADLs) and Instrumental Activities of Daily Living (IADLs), such as toileting, grooming, and managing finances, which have impacts on their Quality of Life (QOL). Although existing assistive technologies enable people with upper-body motor impairments to use different input modalities to interact with computing devices independently (e.g., using voice to interact with a computer), many people still require Personal Care Assistants (PCAs) to perform ADLs. Multimodal input has the potential to enable users to perform ADLs without human assistance. We conducted 12 semi-structured interviews with people who have upper-body motor impairments to capture their existing practices and challenges of performing ADLs, identify opportunities to expand the input possibilities for assistive devices, and understand user preferences for multimodal interaction during everyday tasks. Finally, we discuss implications for the design and use of multimodal input solutions to support user independence and collaborative experiences when performing daily living tasks.

Citations (16)

Summary

  • The paper examines the multimodal input preferences among individuals with upper-body motor impairments for everyday activities, highlighting a strong favor for touch and voice inputs.
  • It utilizes semi-structured interviews with 12 participants to identify challenges with current assistive technologies, including heavy reliance on personal care aides.
  • The findings advocate for adaptive, multimodal systems that can be customized to different contexts, potentially enhancing independence in activities of daily living.

Understanding Input Modality Preferences for Individuals with Upper-body Motor Impairments

Introduction

The paper "Freedom to Choose: Understanding Input Modality Preferences of People with Upper-body Motor Impairments for Activities of Daily Living" (2207.04344) addresses the challenges faced by individuals with upper-body motor impairments when performing Activities of Daily Living (ADLs) and Instrumental Activities of Daily Living (IADLs). While assistive technologies have provided various input modalities, many still rely on Personal Care Assistants (PCAs). This research investigates user preferences for multimodal interaction during daily tasks to design better assistive technologies for independence in ADLs.

Background and Motivation

Upper-body motor impairments often result from conditions such as spinal cord injuries or muscular dystrophy. ADLs, which include tasks such as toileting and grooming, are essential for evaluating an individual's independence and quality of life. Existing assistive technologies (e.g., voice-to-text systems) can aid these tasks, but knowledge gaps remain, particularly in effectively leveraging multimodal input to reduce reliance on human assistance.

Methodology

The study conducted semi-structured interviews with 12 individuals possessing upper-body motor impairments to explore current practices and challenges in ADLs, preferences for assistive technology inputs, and opportunities for multimodal solutions. Figure 1

Figure 1: Activities of Daily Living.

Findings and Results

Current Practices and Challenges:

Participants heavily rely on PCAs for tasks like bathing and dressing. Existing assistive technologies offer limited input options, often requiring personalized installation and causing concerns about privacy, financial costs, and physical reachability.

Input Modality Preferences:

Participants expressed strong favor for touch and voice inputs across various ADLs, citing precision and usability as key factors. However, preferences vary considerably with context, highlighting the need for adaptable solutions.

Multimodal Input Systems:

Participants endorsed multimodal systems for reliability, customization, and efficiency. For instance, combining touch and voice inputs could enhance the usability in noisy environments or offer redundant options when interacting with unresponsive systems.

Implications and Future Directions

The findings suggest that integrating multimodal inputs with assistive technologies can substantially improve user independence and participation in ADLs. Future research should explore collaborative technologies that enable seamless interaction between PCAs and users, consider the design of adaptive and context-aware systems, and investigate the potential of human-robot interaction in enhancing user autonomy in complex ADLs.

Conclusion

This study underscores the importance of understanding user preferences for input modalities in assistive technology design. By advancing multimodal interaction capabilities, researchers and developers can significantly enhance the quality of life and independence of individuals with upper-body motor impairments. High customization, adaptability to various contexts, and consideration of social factors are crucial in the development of future assistive systems.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Explain it Like I'm 14

What this paper is about

This paper looks at how people with upper‑body motor impairments (for example, limited use of arms or hands) want to control tools and devices during everyday tasks like bathing, cooking, or managing money. The big idea is “input modalities,” which just means different ways to give commands to technology—like voice, touch, eye movements, head movements, or switches. The researchers wanted to understand which inputs people prefer, when, and why—especially when combining more than one method (“multimodal input”) could help people be more independent.

What the researchers wanted to find out

The team focused on three simple questions:

  1. What do people with upper‑body motor impairments currently do to handle everyday tasks, and what problems do they face?
  2. How could different input methods (voice, touch, eye, head, etc.) help with these tasks?
  3. How should we combine multiple input methods to better support people during daily activities?

How the study was done

The researchers talked with 12 adults who have upper‑body motor impairments. These were “semi‑structured interviews,” which are guided conversations with open questions. That means the researchers had a plan but also let people describe their real experiences in their own words.

  • First, they asked about daily tasks (called ADLs—Activities of Daily Living) like dressing, bathing, cooking, shopping, and using phones or computers.
  • Next, they showed examples of many input methods (like voice control, touchscreens, hand‑waving, eye‑tracking, head movement, and brain‑computer interfaces) so everyone knew what each one meant.
  • Then they asked which inputs participants would prefer for specific tasks, and why.
  • Afterward, the researchers read the interview transcripts carefully and grouped similar ideas together. This process is called “coding” and “affinity diagramming.” Think of it like sorting lots of sticky notes into piles to find patterns and themes.

What they discovered

Everyday life challenges

  • Many people still rely on Personal Care Assistants (PCAs) or family for basic tasks like toileting, dressing, bathing, and cooking. This can affect privacy, timing (only doing tasks when a helper is available), and money (PCAs can be expensive).
  • Technology helps more with computer‑related tasks (like online banking or using a phone) than with physical tasks (like showering or transferring to a bed).
  • Some customized systems exist (for example, voice‑controlled shower temperature), but they often need special installation and are hard to re‑program if the person’s abilities change over time.
  • Communication with helpers can be tricky (language barriers, or difficulty giving detailed instructions), and many people wish they could do more on their own or help their families more.

Which inputs people prefer (and when)

Participants said they want the freedom to choose different inputs based on the task and situation. In general:

  • Touch and voice were the most popular overall. For example, people wanted:
    • Touch panels or large buttons for shower controls (easier to hit with a palm than turning small knobs).
    • Voice commands for cooking (setting times and temperatures) or driving features.
  • Hand‑only gestures (like waving) were also useful, especially where pressing buttons is hard—like flushing a toilet or scrolling settings on appliances.
  • Eye‑based or head‑movement inputs were attractive for tasks like shopping, especially if paired with a robotic arm to grab items. People imagined looking at a product to select it and having a device fetch it.
  • Biometrics (like fingerprints or face recognition) made sense for secure tasks (like banking).
  • Automatic systems (like doors that open when a person approaches) were helpful for moving around.

Why “multimodal” matters

  • No single input works perfectly all the time. For example, voice might be great in the kitchen, but noisy environments or sore throats make it harder. Touch might be ideal in the shower, but wet hands or reach issues could get in the way.
  • People want systems that let them switch inputs easily—voice plus touch, or hand gestures plus automatic sensing—so they can choose what works best in the moment.
  • Current systems are often “fixed” (one input, one setup, one mapping). That makes life harder when abilities, environments, or preferences change.

Why this matters

This research shows that everyday independence is not just about having assistive tech—it’s about having choices. Giving people multiple, flexible ways to control devices can:

  • Increase privacy and reduce reliance on helpers for sensitive tasks.
  • Make daily life more predictable (no need to wait for someone to be present).
  • Lower costs by reducing the amount of paid assistance needed.
  • Improve dignity, confidence, and the ability to contribute at home.

For designers and engineers, the message is clear:

  • Build multimodal systems that are easy to customize and re‑map over time (so if someone loses strength in a hand, they can switch to voice or eye input without calling a technician).
  • Support collaboration between people and helpers (for example, a PCA can set up a toothbrush, and the person can finish the brushing with a simple input).
  • Go beyond phones and computers to physical tasks like bathing, dressing, doors, and cooking, possibly combining inputs with smart appliances, automatic doors, and even robotic helpers.

In short, the “freedom to choose” how to control technology—using more than one method—can make everyday life safer, simpler, and more independent for people with upper‑body motor impairments.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Collections

Sign up for free to add this paper to one or more collections.