Employing emerging technologies to develop and evaluate in-vehicle intelligent systems for driver support: infotainment AR HUD case study

Charissis, Vassilis; Falah, Jannat; Lagoo, Ramesh; Alfalah, Salsabeel F. M.; Khan, Soheeb; Wang, Shu; Altarteer, Samar; Bram Larbi, Kweku; Drikakis, Dimitris

Abstract

The plurality of current infotainment devices within the in-vehicle space produces an unprecedented volume of incoming data that overwhelm the typical driver, leading to higher collision probability. This work presents an investigation to an alternative option which aims to manage the incoming information while offering an uncluttered and timely manner of presenting and interacting with the incoming data safely. The latter is achieved through the use of an augmented reality (AR) head-up display (HUD) system, which projects the information within the driver’s field of view. An uncluttered gesture recognition interface provides the interaction with the AR visuals. For the assessment of the system’s effectiveness, we developed a full-scale virtual reality driving simulator which immerses the drivers in challenging, collision-prone, scenarios. The scenarios unfold within a digital twin model of the surrounding motorways of the city of Glasgow. The proposed system was evaluated in contrast to a typical head-down display (HDD) interface system by 30 users, showing promising results that are discussed in detail.

Citation

Charissis, V., Falah, J., Lagoo, R., Alfalah, S. F. M., Khan, S., Wang, S., Altarteer, S., Bram Larbi, K., & Drikakis, D. (2021). Employing emerging technologies to develop and evaluate in-vehicle intelligent systems for driver support: infotainment AR HUD case study. Applied Sciences, 11(4), Article 1397. https://doi.org/10.3390/app11041397

• Journal Article Type: Article
• Acceptance Date: Jan 28, 2021
• Online Publication Date: Feb 4, 2021
• Publication Date: 2021
• Deposit Date: Apr 4, 2023
• Publicly Available Date: Apr 4, 2023
• Journal: Applied Sciences
• Publisher: MDPI
• Peer Reviewed: Peer Reviewed
• Volume: 11
• Issue: 4
• Article Number: 1397
• DOI: https://doi.org/10.3390/app11041397
• Keywords: augmented reality; human-computer interaction; head-up display; digital twin; artificial intelligence; simulation; driver distraction; gesture recognition; smart city; virtual reality