Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay.

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Chapter

Published

Standard

Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay. / Eger, Nicola; Ball, Linden J.; Stevens, Robert et al.
People and Computers XXI - HCI... but not as we know it: Proceedings of HCI 2007. ed. / Linden J. Ball; M.A. Sasse; C. Sas; Thomas C. Ormerod; A. Dix; P. Bagnall; T. McEwan. Swindon: The Biritish Computer Society, 2007.

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Chapter

Harvard

Eger, N, Ball, LJ, Stevens, R & Dodd, J 2007, Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay. in LJ Ball, MA Sasse, C Sas, TC Ormerod, A Dix, P Bagnall & T McEwan (eds), People and Computers XXI - HCI... but not as we know it: Proceedings of HCI 2007. The Biritish Computer Society, Swindon.

APA

Eger, N., Ball, L. J., Stevens, R., & Dodd, J. (2007). Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay. In L. J. Ball, M. A. Sasse, C. Sas, T. C. Ormerod, A. Dix, P. Bagnall, & T. McEwan (Eds.), People and Computers XXI - HCI... but not as we know it: Proceedings of HCI 2007 The Biritish Computer Society.

Vancouver

Eger N, Ball LJ, Stevens R, Dodd J. Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay. In Ball LJ, Sasse MA, Sas C, Ormerod TC, Dix A, Bagnall P, McEwan T, editors, People and Computers XXI - HCI... but not as we know it: Proceedings of HCI 2007. Swindon: The Biritish Computer Society. 2007

Author

Eger, Nicola ; Ball, Linden J. ; Stevens, Robert et al. / Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay. People and Computers XXI - HCI... but not as we know it: Proceedings of HCI 2007. editor / Linden J. Ball ; M.A. Sasse ; C. Sas ; Thomas C. Ormerod ; A. Dix ; P. Bagnall ; T. McEwan. Swindon : The Biritish Computer Society, 2007.

Bibtex

@inbook{42d0265462444141824eec7165c73770,

title = "Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay.",

abstract = "An experimental validation is presented of a novel method for usability testing that entails the playback of dynamic eyetracking data to cue the elicitation of retrospective verbal reports. Participants in our study produced: (1) think-aloud reports during an online search task, and (2) retrospective reports during another online search task, with reports being cued by the playback of either the screen capture of events or the participant{\textquoteright}s own eye-movements. Task-completion times and response rates were recorded for all reporting methods. Fewer participants completed the search task whilst thinking aloud, indicating the reactivity of this technique. Verbal transcripts were coded for instances of usability problems. The eye-cued method identified more usability problems than the think-aloud or screen-cued methods. A significant interaction between search engine type and retrospective cue type suggests that the value of the eye-cue method for eliciting usability problems may be greatest with more complex search environments. Our results demonstrate that when cued appropriately, retrospective reports may be less reactive and more informative than other verbalisation techniques.",

author = "Nicola Eger and Ball, {Linden J.} and Robert Stevens and Jon Dodd",

year = "2007",

language = "English",

editor = "Ball, {Linden J.} and M.A. Sasse and C. Sas and Ormerod, {Thomas C.} and A. Dix and P. Bagnall and T. McEwan",

booktitle = "People and Computers XXI - HCI... but not as we know it: Proceedings of HCI 2007",

publisher = "The Biritish Computer Society",

}

RIS

TY - CHAP

T1 - Cueing Retrospective Verbal Reports in Usability Testing Through Eye-Movement Replay.

AU - Eger, Nicola

AU - Ball, Linden J.

AU - Stevens, Robert

AU - Dodd, Jon

PY - 2007

Y1 - 2007

N2 - An experimental validation is presented of a novel method for usability testing that entails the playback of dynamic eyetracking data to cue the elicitation of retrospective verbal reports. Participants in our study produced: (1) think-aloud reports during an online search task, and (2) retrospective reports during another online search task, with reports being cued by the playback of either the screen capture of events or the participant’s own eye-movements. Task-completion times and response rates were recorded for all reporting methods. Fewer participants completed the search task whilst thinking aloud, indicating the reactivity of this technique. Verbal transcripts were coded for instances of usability problems. The eye-cued method identified more usability problems than the think-aloud or screen-cued methods. A significant interaction between search engine type and retrospective cue type suggests that the value of the eye-cue method for eliciting usability problems may be greatest with more complex search environments. Our results demonstrate that when cued appropriately, retrospective reports may be less reactive and more informative than other verbalisation techniques.

AB - An experimental validation is presented of a novel method for usability testing that entails the playback of dynamic eyetracking data to cue the elicitation of retrospective verbal reports. Participants in our study produced: (1) think-aloud reports during an online search task, and (2) retrospective reports during another online search task, with reports being cued by the playback of either the screen capture of events or the participant’s own eye-movements. Task-completion times and response rates were recorded for all reporting methods. Fewer participants completed the search task whilst thinking aloud, indicating the reactivity of this technique. Verbal transcripts were coded for instances of usability problems. The eye-cued method identified more usability problems than the think-aloud or screen-cued methods. A significant interaction between search engine type and retrospective cue type suggests that the value of the eye-cue method for eliciting usability problems may be greatest with more complex search environments. Our results demonstrate that when cued appropriately, retrospective reports may be less reactive and more informative than other verbalisation techniques.

M3 - Chapter

BT - People and Computers XXI - HCI... but not as we know it: Proceedings of HCI 2007

A2 - Ball, Linden J.

A2 - Sasse, M.A.

A2 - Sas, C.

A2 - Ormerod, Thomas C.

A2 - Dix, A.

A2 - Bagnall, P.

A2 - McEwan, T.

PB - The Biritish Computer Society

CY - Swindon

ER -

Research