Rights statement: The final, definitive version of this article has been published in the Journal, Language Assessment Quarterly, 8 (2), 2011, © Informa Plc
Accepted author manuscript, 650 KB, PDF document
Final published version
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - Assessor decision-making while marking a note-taking listening test
T2 - the case of the OET
AU - Harding, Luke
AU - Pill, John
AU - Ryan, Kerry
N1 - The final, definitive version of this article has been published in the Journal, Language Assessment Quarterly, 8 (2), 2011, © Informa Plc
PY - 2011
Y1 - 2011
N2 - This article investigates assessor decision making when using and applying a marking guide for a note-taking task in a specific purpose English language listening test. In contexts where note-taking items are used, a marking guide is intended to stipulate what kind of response should be accepted as evidence of the ability under test. However, there remains some scope for assessors to apply their own interpretations of the construct in judging responses that fall outside the information provided in a marking guide. From a content analysis of data collected in a stimulated recall group discussion, a taxonomy of the types of decisions made by assessors is derived and the bases on which assessors make such decisions are discussed. The present study is therefore a departure point for further investigations into how assessor decision-making processes while marking open-ended items might be improved.
AB - This article investigates assessor decision making when using and applying a marking guide for a note-taking task in a specific purpose English language listening test. In contexts where note-taking items are used, a marking guide is intended to stipulate what kind of response should be accepted as evidence of the ability under test. However, there remains some scope for assessors to apply their own interpretations of the construct in judging responses that fall outside the information provided in a marking guide. From a content analysis of data collected in a stimulated recall group discussion, a taxonomy of the types of decisions made by assessors is derived and the bases on which assessors make such decisions are discussed. The present study is therefore a departure point for further investigations into how assessor decision-making processes while marking open-ended items might be improved.
U2 - 10.1080/15434303.2011.556770
DO - 10.1080/15434303.2011.556770
M3 - Journal article
VL - 8
SP - 108
EP - 126
JO - Language Assessment Quarterly
JF - Language Assessment Quarterly
SN - 1543-4303
IS - 2
ER -