Home > Research > Publications & Outputs > The evaluation scale

Electronic data

  • DerrickSamuel_2015_Manuscript_revised

    Rights statement: The final publication is available at Springer via http://dx.doi.org/10.1007/s11024-016-9290-0

    Accepted author manuscript, 259 KB, PDF document

    Available under license: CC BY-NC: Creative Commons Attribution-NonCommercial 4.0 International License

  • DerrickGE_Minerva

    Rights statement: C.The Author(s) 2016. This article is published with open access at Springerlink.com

    Final published version, 465 KB, PDF document

    Available under license: CC BY: Creative Commons Attribution 4.0 International License

Links

Text available via DOI:

View graph of relations

The evaluation scale: exploring decisions about societal impact in peer review panels

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Published

Standard

The evaluation scale: exploring decisions about societal impact in peer review panels. / Derrick, Gemma Elizabeth; Samuel, Gabrielle N.
In: Minerva, Vol. 54, No. 1, 01.03.2016, p. 75-97.

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Harvard

APA

Vancouver

Derrick GE, Samuel GN. The evaluation scale: exploring decisions about societal impact in peer review panels. Minerva. 2016 Mar 1;54(1):75-97. Epub 2016 Feb 9. doi: 10.1007/s11024-016-9290-0

Author

Bibtex

@article{6e06e88fe26a44ce87e94a1d3db32fa0,
title = "The evaluation scale: exploring decisions about societal impact in peer review panels",
abstract = "Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators{\textquoteright} values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes – the “quality-focused” evaluation and “societal impact-focused” evaluation. We show the wide range of evaluator views about impact, and that these views could be conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel.",
keywords = "societal impact, Peer Review, evaluation frameworks, impact, qualitative",
author = "Derrick, {Gemma Elizabeth} and Samuel, {Gabrielle N.}",
note = "C.The Author(s) 2016. This article is published with open access at Springerlink.com The final publication is available at Springer via http://dx.doi.org/10.1007/s11024-016-9290-0 ",
year = "2016",
month = mar,
day = "1",
doi = "10.1007/s11024-016-9290-0",
language = "English",
volume = "54",
pages = "75--97",
journal = "Minerva",
issn = "0026-4695",
publisher = "Springer Netherlands",
number = "1",

}

RIS

TY - JOUR

T1 - The evaluation scale

T2 - exploring decisions about societal impact in peer review panels

AU - Derrick, Gemma Elizabeth

AU - Samuel, Gabrielle N.

N1 - C.The Author(s) 2016. This article is published with open access at Springerlink.com The final publication is available at Springer via http://dx.doi.org/10.1007/s11024-016-9290-0

PY - 2016/3/1

Y1 - 2016/3/1

N2 - Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators’ values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes – the “quality-focused” evaluation and “societal impact-focused” evaluation. We show the wide range of evaluator views about impact, and that these views could be conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel.

AB - Realising the societal gains from publicly funded health and medical research requires a model for a reflexive evaluation precedent for the societal impact of research. This research explores UK Research Excellence Framework evaluators’ values and opinions and assessing societal impact, prior to the assessment taking place. Specifically, we discuss the characteristics of two different impact assessment extremes – the “quality-focused” evaluation and “societal impact-focused” evaluation. We show the wide range of evaluator views about impact, and that these views could be conceptually reflected in a range of different positions along a conceptual evaluation scale. We describe the characteristics of these extremes in detail, and discuss the different beliefs evaluators had which could influence where they positioned themselves along the scale. These decisions, we argue, when considered together, form a dominant definition of societal impact that influences the direction of its evaluation by the panel.

KW - societal impact

KW - Peer Review

KW - evaluation frameworks

KW - impact

KW - qualitative

U2 - 10.1007/s11024-016-9290-0

DO - 10.1007/s11024-016-9290-0

M3 - Journal article

VL - 54

SP - 75

EP - 97

JO - Minerva

JF - Minerva

SN - 0026-4695

IS - 1

ER -