Remote control by body movement in synchrony with orbiting widgets: an evaluation of TraceMatch

Clarke, Christopher; Bellino, Alessio; Esteves, Augusto; Gellersen, Hans

Abstract

In this work we consider how users can use body movement for remote control with minimal effort and maximum flexibility. TraceMatch is a novel technique where the interface displays available controls as circular widgets with orbiting targets, and where users can trigger a control by mimicking the displayed motion. The technique uses computer vision to detect circular motion as a uniform type of input, but is highly appropriable as users can produce matching motion with any part of their body. We present three studies that investigate input performance with different parts of the body, user preferences, and spontaneous choice of movements for input in realistic application scenarios. The results show that users can provide effective input with their head, hands and while holding objects, that multiple controls can be effectively distinguished by the difference in presented phase and direction of movement, and that users choose and switch modes of input seamlessly.

Citation

Clarke, C., Bellino, A., Esteves, A., & Gellersen, H. (2017). Remote control by body movement in synchrony with orbiting widgets: an evaluation of TraceMatch. PACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 1(3), Article 45. https://doi.org/10.1145/3130910

• Journal Article Type: Article
• Acceptance Date: Jun 27, 2017
• Online Publication Date: Sep 11, 2017
• Publication Date: Sep 11, 2017
• Deposit Date: Jun 28, 2017
• Publicly Available Date: Aug 11, 2017
• Journal: Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)
• Print ISSN: 2474-9567
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Volume: 1
• Issue: 3
• Article Number: 45
• DOI: https://doi.org/10.1145/3130910
• Keywords: User input, input techniques, remote control, movement correlation, motion correlation, motion matching, path mimicry, gesture input, vision-based interfaces, computer vision, user evaluation,
• Public URL: http://researchrepository.napier.ac.uk/Output/953488
• Contract Date: Aug 11, 2017