Final published version
Licence: CC BY: Creative Commons Attribution 4.0 International License
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - Exploring the degree of delegated authority for the peer review of societal impact
AU - Derrick, Gemma Elizabeth
AU - Samuel, Samuel
PY - 2018/10/1
Y1 - 2018/10/1
N2 - This article explores how panel expert reviewers’ evaluative practice was influenced by external, political considerations during the assessment of a societal impact criterion. The results showed that prior to the evaluation process, participants demonstrated a strong preconceived, political belief that the results of the evaluation process must ‘showcase’ the value of British research to the public and policymakers as part of a rationale designed to ensure continued public-based research funding. Post-evaluation interviews revealed how, during the societal impact assessment, evaluators drew on these strong beliefs which informed a group-based strategy of ‘generous marking’ of submissions. We discuss the implications of external motivations that influence the direction of research audit exercises where the definition of the criteria is untested, unclear, and unfamiliar to evaluators, as well as discuss the suitability of peer review as an evaluation tool. Both have implications for the future legitimacy of impact assessment as a formalized criterion.
AB - This article explores how panel expert reviewers’ evaluative practice was influenced by external, political considerations during the assessment of a societal impact criterion. The results showed that prior to the evaluation process, participants demonstrated a strong preconceived, political belief that the results of the evaluation process must ‘showcase’ the value of British research to the public and policymakers as part of a rationale designed to ensure continued public-based research funding. Post-evaluation interviews revealed how, during the societal impact assessment, evaluators drew on these strong beliefs which informed a group-based strategy of ‘generous marking’ of submissions. We discuss the implications of external motivations that influence the direction of research audit exercises where the definition of the criteria is untested, unclear, and unfamiliar to evaluators, as well as discuss the suitability of peer review as an evaluation tool. Both have implications for the future legitimacy of impact assessment as a formalized criterion.
U2 - 10.1093/scipol/scx091
DO - 10.1093/scipol/scx091
M3 - Journal article
VL - 45
SP - 673
EP - 682
JO - Science and Public Policy
JF - Science and Public Policy
SN - 0302-3427
IS - 5
ER -