TraceMatch: a computer vision technique for user input by tracing of animated controls

Esteves>, Augusto; Clarke, Christopher; Bellino, Alessio; Esteves, Augusto; Velloso, Eduardo; Gellersen, Hans

Abstract

Recent works have explored the concept of movement correlation interfaces, in which moving objects can be selected by matching the movement of the input device to that of the desired object. Previous techniques relied on a single modality (e.g. gaze or mid-air gestures) and specific hardware to issue commands. TraceMatch is a computer vision technique that enables input by movement correlation while abstracting from any particular input modality. The technique relies only on a conventional webcam to enable users to produce matching gestures with any given body parts, even whilst holding objects. We describe an implementation of the technique for acquisition of orbiting targets, evaluate algorithm performance for different target sizes and frequencies, and demonstrate use of the technique for remote control of graphical as well as physical objects with different body parts.

Citation

Esteves>, A., Clarke, C., Bellino, A., Esteves, A., Velloso, E., & Gellersen, H. (2016, September). TraceMatch: a computer vision technique for user input by tracing of animated controls. Presented at Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '16

• Presentation Conference Type: Conference Paper (published)
• Conference Name: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing - UbiComp '16
• Start Date: Sep 12, 2016
• End Date: Sep 16, 2016
• Acceptance Date: Jun 17, 2016
• Online Publication Date: Sep 12, 2016
• Publication Date: Sep 12, 2016
• Deposit Date: Jun 5, 2017
• Publicly Available Date: Jun 5, 2017
• Publisher: Association for Computing Machinery (ACM)
• Pages: 298-303
• Book Title: UbiComp '16 Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing
• ISBN: 9781450344616
• DOI: https://doi.org/10.1145/2971648.2971714
• Keywords: User input; Input Techniques; Remote control; Motion matching; Path mimicry; Gesture input; Vision-based interfaces; Ubiquitous computing; Computer vision
• Public URL: http://researchrepository.napier.ac.uk/Output/860058
• Contract Date: Jun 5, 2017