Home > Research > Publications & Outputs > Exploring Gaze for Assisting Freehand Selection...

Electronic data

Links

Text available via DOI:

View graph of relations

Exploring Gaze for Assisting Freehand Selection-based Text Entry in AR

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Published
Close
Article number141
<mark>Journal publication date</mark>13/05/2022
<mark>Journal</mark>Proceedings of the ACM on Human-Computer Interaction - CSCW
Issue numberETRA
Volume6
Number of pages16
Pages (from-to)1-16
Publication StatusPublished
<mark>Original language</mark>English

Abstract

With eye-tracking increasingly available in Augmented Reality, we explore how gaze can be used to assist freehand gestural text entry. Here the eyes are often coordinated with manual input across the spatial positions of the keys. Inspired by this, we investigate gaze-assisted selection-based text entry through the concept of spatial alignment of both modalities. Users can enter text by aligning both gaze and manual pointer at each key, as a novel alternative to existing dwell-time or explicit manual triggers. We present a text entry user study comparing two of such alignment techniques to a gaze-only and a manual-only baseline. The results show that one alignment technique reduces physical finger movement by more than half compared to standard in-air finger typing, and is faster and exhibits less perceived eye fatigue than an eyes-only dwell-time technique. We discuss trade-offs between uni and multimodal text entry techniques, pointing to novel ways to integrate eye movements to facilitate virtual text entry.