Home > Research > Publications & Outputs > Exploitative and Exploratory Attention in a Fou...
View graph of relations

Exploitative and Exploratory Attention in a Four-Armed Bandit Task

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Published

Standard

Exploitative and Exploratory Attention in a Four-Armed Bandit Task. / Walker, Adrian R.; Le Pelley, Mike E.; Beesley, Tom.
CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition. The Cognitive Science Society, 2017. p. 3484-3489 (CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition).

Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Harvard

Walker, AR, Le Pelley, ME & Beesley, T 2017, Exploitative and Exploratory Attention in a Four-Armed Bandit Task. in CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition. CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition, The Cognitive Science Society, pp. 3484-3489, 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition, CogSci 2017, London, United Kingdom, 26/07/17.

APA

Walker, A. R., Le Pelley, M. E., & Beesley, T. (2017). Exploitative and Exploratory Attention in a Four-Armed Bandit Task. In CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition (pp. 3484-3489). (CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition). The Cognitive Science Society.

Vancouver

Walker AR, Le Pelley ME, Beesley T. Exploitative and Exploratory Attention in a Four-Armed Bandit Task. In CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition. The Cognitive Science Society. 2017. p. 3484-3489. (CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition).

Author

Walker, Adrian R. ; Le Pelley, Mike E. ; Beesley, Tom. / Exploitative and Exploratory Attention in a Four-Armed Bandit Task. CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition. The Cognitive Science Society, 2017. pp. 3484-3489 (CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition).

Bibtex

@inproceedings{c289822fa6034972a71f87140623624c,
title = "Exploitative and Exploratory Attention in a Four-Armed Bandit Task",
abstract = "When making decisions, we are often forced to choose between something safe we have chosen before, and something unknown to us that is inherently risky, but may provide a better long-term outcome. This problem is known as the Exploitation-Exploration (EE) Trade-Off. Most previous studies on the EE Trade-Off have relied on response data, leading to some ambiguity over whether uncertainty leads to true exploratory behavior, or whether the pattern of responding simply reflects a simpler ratio choice rule (such as the Generalized Matching Law (Baum, 1974; Herrnstein, 1961)). Here, we argue that the study of this issue can be enriched by measuring changes in attention (via eye-gaze), with the potential to disambiguate these two accounts. We find that when moving from certainty into uncertainty, the overall level of attention to stimuli in the task increases; a finding we argue is outside of the scope of ratio choice rules.",
keywords = "Attention, Bandit Task, Decision-Making, Exploitation/Exploration Trade-Off, Reinforcement Learning",
author = "Walker, {Adrian R.} and {Le Pelley}, {Mike E.} and Tom Beesley",
note = "Publisher Copyright: {\textcopyright} CogSci 2017.; 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition, CogSci 2017 ; Conference date: 26-07-2017 Through 29-07-2017",
year = "2017",
language = "English",
series = "CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition",
publisher = "The Cognitive Science Society",
pages = "3484--3489",
booktitle = "CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society",

}

RIS

TY - GEN

T1 - Exploitative and Exploratory Attention in a Four-Armed Bandit Task

AU - Walker, Adrian R.

AU - Le Pelley, Mike E.

AU - Beesley, Tom

N1 - Publisher Copyright: © CogSci 2017.

PY - 2017

Y1 - 2017

N2 - When making decisions, we are often forced to choose between something safe we have chosen before, and something unknown to us that is inherently risky, but may provide a better long-term outcome. This problem is known as the Exploitation-Exploration (EE) Trade-Off. Most previous studies on the EE Trade-Off have relied on response data, leading to some ambiguity over whether uncertainty leads to true exploratory behavior, or whether the pattern of responding simply reflects a simpler ratio choice rule (such as the Generalized Matching Law (Baum, 1974; Herrnstein, 1961)). Here, we argue that the study of this issue can be enriched by measuring changes in attention (via eye-gaze), with the potential to disambiguate these two accounts. We find that when moving from certainty into uncertainty, the overall level of attention to stimuli in the task increases; a finding we argue is outside of the scope of ratio choice rules.

AB - When making decisions, we are often forced to choose between something safe we have chosen before, and something unknown to us that is inherently risky, but may provide a better long-term outcome. This problem is known as the Exploitation-Exploration (EE) Trade-Off. Most previous studies on the EE Trade-Off have relied on response data, leading to some ambiguity over whether uncertainty leads to true exploratory behavior, or whether the pattern of responding simply reflects a simpler ratio choice rule (such as the Generalized Matching Law (Baum, 1974; Herrnstein, 1961)). Here, we argue that the study of this issue can be enriched by measuring changes in attention (via eye-gaze), with the potential to disambiguate these two accounts. We find that when moving from certainty into uncertainty, the overall level of attention to stimuli in the task increases; a finding we argue is outside of the scope of ratio choice rules.

KW - Attention

KW - Bandit Task

KW - Decision-Making

KW - Exploitation/Exploration Trade-Off

KW - Reinforcement Learning

M3 - Conference contribution/Paper

AN - SCOPUS:85129301038

T3 - CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition

SP - 3484

EP - 3489

BT - CogSci 2017 - Proceedings of the 39th Annual Meeting of the Cognitive Science Society

PB - The Cognitive Science Society

T2 - 39th Annual Meeting of the Cognitive Science Society: Computational Foundations of Cognition, CogSci 2017

Y2 - 26 July 2017 through 29 July 2017

ER -