Home > Research > Publications & Outputs > Interrogating the construct of communicative co...

Electronic data

  • Final version LandC paper

    Rights statement: This is the author’s version of a work that was accepted for publication in Language and Communication. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Language and Communication, 57, 2017 DOI: 10.1016/j.langcom.2016.12.005

    766 KB, PDF document

    Available under license: CC BY-NC-ND: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

Links

Text available via DOI:

View graph of relations

Interrogating the construct of communicative competence in language assessment contexts: What the non-language specialist can tell us

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Published
  • Catherine Elder
  • Tim McNamara
  • Hyejeong Kim
  • John Pill
  • Takanori Sato
Close
<mark>Journal publication date</mark>11/2017
<mark>Journal</mark>Language and Communication
Volume57
Number of pages8
Pages (from-to)14-21
Publication StatusPublished
Early online date1/02/17
<mark>Original language</mark>English

Abstract

Models of communicative competence in a second language invoked in defining the construct of widely used tests of communicative language ability have drawn largely on the work of language specialists. The risk of exclusive reliance on language expertise to conceptualize, design and administer language tests is that test scores may carry meanings that are misaligned with the values of non-language specialists, that is, those without language expertise but perhaps with expert knowledge in the domain of concern. Neglect of the perspective of lay (i.e., non-linguistic) judges on language and communication is a serious validity concern, since they are the ultimate arbiters of what matters for effective communication in the relevant context of language use.

The paper reports on three research studies exploring the validity of rating scales used to assess speaking performance on a number of high-stakes English-language tests developed for professional or general proficiency assessment purposes in Korea, Australia, China, and the UK. Drawing on Jacoby and McNamara's (1999) notion of “indigenous assessment”, each project attempted to identify the values underlying non-language specialists' judgements of spoken communication as they rated test performance or participated in focus-group workshops where they viewed and commented on video- or audio-recorded samples of performance in the relevant real-world domain.

The findings of these studies raise the question of whether language can or should be assessed as object independently of the content which it conveys or without regard for the goal and context of the communication. The studies' findings also cast doubt on the notion that the native speaker should always serve as benchmark for judging communicative effectiveness, especially with tests of language for specific purposes, where native speakers and second-language learners alike may lack the requisite skills for the kind of effective interaction demanded by the context.

Bibliographic note

This is the author’s version of a work that was accepted for publication in Language and Communication. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Language and Communication, 57, 2017 DOI: 10.1016/j.langcom.2016.12.005