Motion correlation: selecting objects by matching their movement

Velloso, Eduardo; Carter, Marcus; Newn, Joshua; Esteves, Augusto; Gellersen, Hans; Clarke, Christopher

Abstract

Selection is a canonical task in user interfaces, commonly supported by presenting objects for acquisition by pointing. In this article, we consider motion correlation as an alternative for selection. The principle is to represent available objects by motion in the interface, have users identify a target by mimicking its specific motion, and use the correlation between the system’s output with the user’s input to determine the selection. The resulting interaction has compelling properties, as users are guided by motion feedback, and only need to copy a presented motion. Motion correlation has been explored in earlier work but only recently begun to feature in holistic interface designs. We provide a first comprehensive review of the principle, and present an analysis of five previously published works, in which motion correlation underpinned the design of novel gaze and gesture interfaces for diverse application contexts. We derive guidelines for motion correlation algorithms, motion feedback, choice of modalities, overall design of motion correlation interfaces, and identify opportunities and challenges identified for future research and design.

• Journal Article Type: Article
• Acceptance Date: Nov 26, 2016
• Online Publication Date: May 1, 2017
• Publication Date: May 26, 2017
• Deposit Date: Nov 28, 2016
• Publicly Available Date: Jul 20, 2017
• Journal: ACM Transactions on Computer-human interaction
• Print ISSN: 1073-0516
• Electronic ISSN: 1557-7325
• Publisher: Association for Computing Machinery (ACM)
• Peer Reviewed: Peer Reviewed
• Volume: 24
• Issue: 3
• Article Number: 22
• DOI: https://doi.org/10.1145/3064937
• Keywords: Motion correlation, interaction techniques, gaze interaction, gesture interfaces, eye tracking, motion tracking, natural user interfaces
• Public URL: http://researchrepository.napier.ac.uk/Output/444363
• Additional Information: Previously known as: Movement on the Interface: Selecting Objects through Movement Correlation
• Contract Date: Jul 20, 2017