Designing Wearable Augmented Reality Concepts to Support Scalability in Autonomous Vehicle-Pedestrian Interaction (2403.07006v1)
Abstract: Wearable augmented reality (AR) offers new ways for supporting the interaction between autonomous vehicles (AVs) and pedestrians due to its ability to integrate timely and contextually relevant data into the user's field of view. This article presents novel wearable AR concepts that assist crossing pedestrians in multi-vehicle scenarios where several AVs frequent the road from both directions. Three concepts with different communication approaches for signaling responses from multiple AVs to a crossing request, as well as a conventional pedestrian push button, were simulated and tested within a virtual reality environment. The results showed that wearable AR is a promising way to reduce crossing pedestrians' cognitive load when the design offers both individual AV responses and a clear signal to cross. The willingness of pedestrians to adopt a wearable AR solution, however, is subject to different factors, including costs, data privacy, technical defects, liability risks, maintenance duties, and form factors. We further found that all participants favored sending a crossing request to AVs rather than waiting for the vehicles to detect their intentions-pointing to an important gap and opportunity in the current AV-pedestrian interaction literature.
- [Dataset] AutoTrader (2020). Cars of the future
- Azuma, R. T. (2019). The road to ubiquitous consumer augmented reality systems. Human Behavior and Emerging Technologies 1, 26–32
- Determining what individual sus scores mean: Adding an adjective rating scale. Journal of usability studies 4, 114–123
- Crossroads: Modern interactive intersections and accessible pedestrian signals. Journal of Visual Impairment & Blindness 99, 599–610
- Survey on ehmi concepts: The effect of text, color, and perspective. Transportation research part F: traffic psychology and behaviour 67, 175–194
- Billinghurst, M. (2021). Grand challenges for augmented reality. Frontiers in Virtual Reality 2, 12
- Connected roads of the future: Use cases, requirements, and design considerations for vehicle-to-everything communications. IEEE vehicular technology magazine 13, 110–123
- The effect of internal and external fields of view on visually induced motion sickness. Applied ergonomics 41, 516–521
- Using thematic analysis in psychology. Qualitative research in psychology 3, 77–101
- Brooke, J. et al. (1996). Sus-a quick and dirty usability scale. Usability evaluation in industry 189, 4–7
- [Dataset] Cohda Wireless (2017). Australia’s first vehicle-to-pedestrian technology trial
- Cohen, J. (2013). Statistical power analysis for the behavioral sciences (revised edition) (Academic Press)
- Investigating the effects of feedback communication of autonomous vehicles. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 263–273
- A design space for external communication of autonomous vehicles. In 12th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 212–222
- Towards a design space for external communication of autonomous vehicles. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems. 1–8
- Towards inclusive external communication of autonomous vehicles for pedestrians with vision impairments. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14
- Unveiling the lack of scalability in research on external communication of autonomous vehicles. In Extended abstracts of the 2020 chi conference on human factors in computing systems. 1–9
- Ar4vi: Ar as an accessibility tool for people with visual impairments. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct) (IEEE), 288–292
- Taming the ehmi jungle: A classification taxonomy to guide, compare, and assess the design principles of automated vehicles’ external human-machine interfaces. Transportation Research Interdisciplinary Perspectives 7, 100174
- Color and animation preferences for a light band ehmi in interactions between automated vehicles and pedestrians. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13
- The impact of vehicle appearance and vehicle behavior on pedestrian interaction with autonomous vehicles. In Proceedings of the 9th International Conference on Automotive User Interfaces and Interactive Vehicular Applications Adjunct. 158–162
- Towards scalable ehmis: Designing for av-vru communication beyond one pedestrian. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 274–286
- I see your gesture: a vr-based study of bidirectional communication between pedestrians and automated vehicles. Journal of advanced transportation 2021
- Statistical power analyses using g* power 3.1: Tests for correlation and regression analyses. Behavior research methods 41, 1149–1160
- Towards pervasive augmented reality: Context-awareness in augmented reality. IEEE transactions on visualization and computer graphics 23, 1706–1724
- Vroad: Gesture-based interaction between pedestrians and automated vehicles in virtual reality. In Proceedings of the 11th International Conference on Automotive User Interfaces and Interactive Vehicular Applications: Adjunct Proceedings. 399–404
- Development of nasa-tlx (task load index): Results of empirical and theoretical research. In Advances in psychology (Elsevier), vol. 52. 139–183
- The relative frequency of unsafe driving acts in serious traffic crashes. Tech. rep., United States. National Highway Traffic Safety Administration
- Don’t panic! guiding pedestrians in autonomous traffic with augmented reality. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. 261–268
- Save the smombies: App-assisted street crossing. In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–11
- P2v and v2p communication for pedestrian warning on the basis of autonomous vehicles. In 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC) (IEEE), 2034–2039
- Foundations for an empirically determined scale of trust in automated systems. International journal of cognitive ergonomics 4, 53–71
- Why did my car just do that? explaining semi-autonomous driving actions to improve driver understanding, trust, and performance. International Journal on Interactive Design and Manufacturing (IJIDeM) 9, 269–275
- Evaluation of semi-actuated signals and pedestrian push buttons using a microscopic traffic simulation model. KSCE Journal of Civil Engineering 17, 1749–1760
- Pofs: A novel pedestrian-oriented forewarning system for vulnerable pedestrian safety. In 2015 International Conference on Connected Vehicles and Expo (ICCVE) (IEEE), 100–105
- How should automated vehicles interact with pedestrians? a comparative analysis of interaction concepts in virtual reality. In Proceedings of the 11th international conference on automotive user interfaces and interactive vehicular applications. 262–274
- Av-pedestrian interaction design using a pedestrian mixed traffic simulator. In Proceedings of the 2019 on designing interactive systems conference. 475–486
- Communicating awareness and intent in autonomous vehicle-pedestrian interaction. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–12
- Determining the effect of smartphone alerts and warnings on street-crossing behavior in non-mobility-impaired older and younger adults. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12
- The case for implicit external human-machine interfaces for autonomous vehicles. In Proceedings of the 11th international conference on automotive user interfaces and interactive vehicular applications. 295–307
- Designing for projection-based communication between autonomous vehicles and pedestrians. In Proceedings of the 11th international conference on automotive user interfaces and interactive vehicular applications. 284–294
- Explanations in autonomous driving: A survey. arXiv preprint arXiv:2103.05154
- Comparing state-of-the-art and emerging augmented reality interfaces for autonomous vehicle-to-pedestrian communication. IEEE Transactions on Vehicular Technology 70, 1157–1168
- [Dataset] Prisco, J. (2018). Illusion of control: Why the world is full of buttons that don’t work
- Autonomous vehicles that interact with pedestrians: A survey of theory and practice. IEEE transactions on intelligent transportation systems 21, 900–918
- Pedestrian risk analysis at uncontrolled midblock and unsignalised intersections. Journal of traffic and transportation engineering (English edition) 5, 137–147
- Rekimoto, J. (1996). Transvision: A hand-held augmented reality system for collaborative design. In Proceeding of Virtual Systems and Multimedia. vol. 96, 18–20
- A literature review on the prediction of pedestrian behavior in urban scenarios. In 2018 21st International Conference on Intelligent Transportation Systems (ITSC) (IEEE), 3105–3112
- Augmented reality for future mobility: Insights from a literature review and hci workshop. i-com: Vol. 20, No. 3
- Human-vehicle interfaces: the power of vehicle movement gestures in human road user coordination. In Driving Assessment: The Ninth International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design (2017). 186–192
- Robert Jr, L. P. (2019). The future of pedestrian-automated vehicle interactions. XRDS: Crossroads, The ACM Magazine for Students 25, 30–33
- SAE (2021). Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. J3016, SAE International
- Virtually the same? analysing pedestrian behaviour by means of virtual reality. Transportation research part F: traffic psychology and behaviour 68, 231–256
- Augmented reality through wearable computing. Presence: Teleoperators & Virtual Environments 6, 386–398
- Light output system for a self-driving vehicle. US Patent 10,160,378
- Vulnerable road users and the coming wave of automated vehicles: Expert perspectives. Transportation research interdisciplinary perspectives 9, 100293
- Towards future pedestrian-vehicle interactions: Introducing theoretically-supported ar prototypes. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 209–218
- An augmented-reality-based warning interface for pedestrians: User interface design and evaluation. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting (SAGE Publications Sage CA: Los Angeles, CA), vol. 63, 1834–1838
- An augmented warning system for pedestrians: User interface design and algorithm development. Applied Sciences 11, 7197
- Tri-level study of the causes of traffic accidents: final report. Executive summary. Tech. rep., Indiana University, Bloomington, Institute for Research in Public Safety
- [Dataset] Umbrellium (2017). Case study - make roads safer, more responsive & dynamic
- Pedestrian notifications. US Patent 8,954,252
- Pedestrian push-button confirmation increases call button usage and compliance. Transportation research record 1982, 99–103
- Commdisk: A holistic 360 ehmi concept to facilitate scalable, unambiguous interactions between automated vehicles and other road users. In 13th International Conference on Automotive User Interfaces and Interactive Vehicular Applications. 132–136
- Crossing the street across the globe: A study on the effects of ehmi on pedestrians in the us, germany and china. In International Conference on Human-Computer Interaction (Springer), 515–530
- Incarar: A design space towards 3d augmented reality applications in vehicles. In Proceedings of the 11th international conference on automotive user interfaces and interactive vehicular applications. 1–13
- Cars talk to phones: A dsrc based vehicle-pedestrian safety system. In 2014 IEEE 80th Vehicular Technology Conference (VTC2014-Fall) (IEEE), 1–7
- Towards transparency between the autonomous vehicle and the pedestrian. Design and Semantics of Form and Movement, DesForm 2019: Beyond Intelligence , 96–104