Home > Research > Publications & Outputs > H2E

Research

Electronic data

Links

Text available via DOI:

Keywords

View graph of relations

H2E: Hand, Head, Eye a Multimodal Cascade of Natural Inputs

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review

Published

Standard

H2E: Hand, Head, Eye a Multimodal Cascade of Natural Inputs. / Patel, Khushman; Phadnis, Vrushank; Gonzalez, Eric J et al.
2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 2025. p. 84-89.

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Conference contribution/Paper › peer-review

Harvard

Patel, K, Phadnis, V, Gonzalez, EJ, Gellersen, H, Pfeuffer, K & Gonzalez-Franco, M 2025, H2E: Hand, Head, Eye a Multimodal Cascade of Natural Inputs. in 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, pp. 84-89. https://doi.org/10.1109/VRW66409.2025.00026

APA

Patel, K., Phadnis, V., Gonzalez, E. J., Gellersen, H., Pfeuffer, K., & Gonzalez-Franco, M. (2025). H2E: Hand, Head, Eye a Multimodal Cascade of Natural Inputs. In 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 84-89). IEEE. https://doi.org/10.1109/VRW66409.2025.00026

Vancouver

Patel K, Phadnis V, Gonzalez EJ, Gellersen H, Pfeuffer K, Gonzalez-Franco M. H2E: Hand, Head, Eye a Multimodal Cascade of Natural Inputs. In 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE. 2025. p. 84-89 Epub 2025 Mar 8. doi: 10.1109/VRW66409.2025.00026

Author

Patel, Khushman ; Phadnis, Vrushank ; Gonzalez, Eric J et al. / H2E : Hand, Head, Eye a Multimodal Cascade of Natural Inputs. 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 2025. pp. 84-89

Bibtex

@inproceedings{486f526defca4fa88e1801f30818dd8a,
title = "H2E: Hand, Head, Eye a Multimodal Cascade of Natural Inputs",
abstract = "Eye-based interaction techniques for extended reality, such as gaze and pinch, are simple to use however suffer from input precision issues. We present H2E, an integrated fine and coarse-grained pointing framework that cascades Hand, Head, and Eye inputs. We further introduce the MagicPinch gesture as an example of the framework, which allows for smooth transitioning between fine and coarse-grained pointing. When combined together, after users initiate a pinch gesture, a cursor appears midway during the pinch at the position of the gaze, which can be dragged by head pointing if needed before pinch confirmation. This has the advantage that it can add a precision component without changing the semantics of the technique. In this paper, we describe the design of the H2E framework and implementation of the MagicPinch technique. Furthermore, we present an evaluation of our method in a Fitts-based user study, exploring the speed-accuracy trade-offs against a gaze and pinch interaction baseline.",
keywords = "Hands, Three-dimensional displays, Extended reality, Conferences, Semantics, Augmented reality, Human-centered computing—User interface toolk-its, Human-centered computing—Virtual reality, Human-centered computing—Mixed / augmented reality",
author = "Khushman Patel and Vrushank Phadnis and Gonzalez, {Eric J} and Hans Gellersen and Ken Pfeuffer and Mar Gonzalez-Franco",
year = "2025",
month = apr,
day = "24",
doi = "10.1109/VRW66409.2025.00026",
language = "English",
isbn = "9798331525637",
pages = "84--89",
booktitle = "2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)",
publisher = "IEEE",

}

RIS

TY - GEN

T1 - H2E

T2 - Hand, Head, Eye a Multimodal Cascade of Natural Inputs

AU - Patel, Khushman

AU - Phadnis, Vrushank

AU - Gonzalez, Eric J

AU - Gellersen, Hans

AU - Pfeuffer, Ken

AU - Gonzalez-Franco, Mar

PY - 2025/4/24

Y1 - 2025/4/24

N2 - Eye-based interaction techniques for extended reality, such as gaze and pinch, are simple to use however suffer from input precision issues. We present H2E, an integrated fine and coarse-grained pointing framework that cascades Hand, Head, and Eye inputs. We further introduce the MagicPinch gesture as an example of the framework, which allows for smooth transitioning between fine and coarse-grained pointing. When combined together, after users initiate a pinch gesture, a cursor appears midway during the pinch at the position of the gaze, which can be dragged by head pointing if needed before pinch confirmation. This has the advantage that it can add a precision component without changing the semantics of the technique. In this paper, we describe the design of the H2E framework and implementation of the MagicPinch technique. Furthermore, we present an evaluation of our method in a Fitts-based user study, exploring the speed-accuracy trade-offs against a gaze and pinch interaction baseline.

AB - Eye-based interaction techniques for extended reality, such as gaze and pinch, are simple to use however suffer from input precision issues. We present H2E, an integrated fine and coarse-grained pointing framework that cascades Hand, Head, and Eye inputs. We further introduce the MagicPinch gesture as an example of the framework, which allows for smooth transitioning between fine and coarse-grained pointing. When combined together, after users initiate a pinch gesture, a cursor appears midway during the pinch at the position of the gaze, which can be dragged by head pointing if needed before pinch confirmation. This has the advantage that it can add a precision component without changing the semantics of the technique. In this paper, we describe the design of the H2E framework and implementation of the MagicPinch technique. Furthermore, we present an evaluation of our method in a Fitts-based user study, exploring the speed-accuracy trade-offs against a gaze and pinch interaction baseline.

KW - Hands

KW - Three-dimensional displays

KW - Extended reality

KW - Conferences

KW - Semantics

KW - Augmented reality

KW - Human-centered computing—User interface toolk-its

KW - Human-centered computing—Virtual reality

KW - Human-centered computing—Mixed / augmented reality

U2 - 10.1109/VRW66409.2025.00026

DO - 10.1109/VRW66409.2025.00026

M3 - Conference contribution/Paper

SN - 9798331525637

SP - 84

EP - 89

BT - 2025 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

PB - IEEE

ER -