Designing efficient interaction techniques for mid-air gesture interfaces

Waugh, Kieran David (2026) Designing efficient interaction techniques for mid-air gesture interfaces. PhD thesis, University of Glasgow.

Full text available as:
[thumbnail of 2026WaughPhD.pdf] PDF
Download (22MB)

Abstract

Mid-air gesture interaction allows users to control touchless displays without physical contact. Most touchless displays adopt the cursor-based pointing paradigm used with conventional input modalities, which demands a level of precision that is challenging for an unsupported hand in mid-air. Precise cursor targeting is challenging with an unsupported hand due to instability and fatigue. Furthermore, cursor activation suffers from a lack of clear feedback for initiating and confirming state changes. This thesis investigates novel interaction techniques that improve the efficiency of cursor-based touchless interaction without departing from the familiar cursor-and-click paradigm, addressing: the gesture used to activate the cursor (e.g., for target selection), the targeting mechanism used to acquire targets with the cursor, and the control-display gain that determines the rate of hand to cursor movement.
Experiments 1 and 2 compared four activation gestures (push, cursor dwell, and two variations of finger-to-thumb pinch) across single and multi-widget input tasks. These experiments found that pinch acquired targets faster than push, was less vulnerable to target slips, and was the most preferred technique, while dwell was poorly suited to continuous control.
Experiments 2 and 3 investigated targeting with dynamic area cursors, using the proxemic cursor, a Bubble Cursor-style technique which automatically targets the widget closest to the cursor without requiring that the cursor precisely overlap the target. The proxemic cursor reduced widget acquisition and transition times without sacrificing accuracy, and users adapted their targeting strategy to the layout rather than reverting to standard point-cursor selection.
Experiments 4 and 5 characterised the joint effect of area cursor targeting and control-display gain, across different configurations of display size and target density. These experiments found that that increased gain significantly reduced hand travel without reducing accuracy when paired with the proxemic cursor. However, dense layouts left less room for the area cursor to absorb the input noise that increased gain amplifies. The findings show that an area cursor and increased gain form a mutually beneficial combination.
These findings show that by reducing the precision and physical demands of activation, targeting, and traversal on mid-air input, users can interact quicker and with less physical effort, making touchless input a more viable option for everyday computing tasks on planar displays.

Item Type: Thesis (PhD)
Qualification Level: Doctoral
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Colleges/Schools: College of Science and Engineering > School of Computing Science
Supervisor's Name: Freeman, Dr. Euan and McGill, Dr. Mark
Date of Award: 2026
Depositing User: Theses Team
Unique ID: glathesis:2026-86296
Copyright: Copyright of this thesis is held by the author.
Date Deposited: 05 Nov 2026 13:30
Last Modified: 05 Nov 2026 13:36
Thesis DOI: 10.5525/gla.thesis.86296
URI: https://theses.gla.ac.uk/id/eprint/86296
Related URLs:

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year