Home > Research > Publications & Outputs > The association between four citation metrics a...
View graph of relations

The association between four citation metrics and peer rankings of research influence of Australian researchers in six fields of public health

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Published

Standard

The association between four citation metrics and peer rankings of research influence of Australian researchers in six fields of public health. / Elizabeth Derrick, Gemma; Haynes, Abby; Chapman, Simon et al.
In: PLoS ONE, Vol. 6, No. 4, 18521, 06.04.2011.

Research output: Contribution to Journal/MagazineJournal articlepeer-review

Harvard

APA

Vancouver

Author

Bibtex

@article{1a53a4cd4a2d4262b1739819ac6cf8bd,
title = "The association between four citation metrics and peer rankings of research influence of Australian researchers in six fields of public health",
abstract = "Doubt about the relevance, appropriateness and transparency of peer review has promoted the use of citation metrics as a viable adjunct or alternative in the assessment of research impact. It is also commonly acknowledged that research metrics will not replace peer review unless they are shown to correspond with the assessment of peers. This paper evaluates the relationship between researchers' influence as evaluated by their peers and various citation metrics representing different aspects of research output in 6 fields of public health in Australia. For four fields, the results showed a modest positive correlation between different research metrics and peer assessments of research influence. However, for two fields, tobacco and injury, negative or no correlations were found. This suggests a peer understanding of research influence within these fields differed from visibility in the mainstream, peer-reviewed scientific literature. This research therefore recommends the use of both peer review and metrics in a combined approach in assessing research influence. Future research evaluation frameworks intent on incorporating metrics should first analyse each field closely to determine what measures of research influence are valued highly by members of that research community. This will aid the development of comprehensive and relevant frameworks with which to fairly and transparently distribute research funds or approve promotion applications.",
keywords = "STANDARD BIBLIOMETRIC MEASURES, H-INDEX, HIRSCH-INDEX, R-INDEX, INDICATORS, VARIANTS",
author = "{Elizabeth Derrick}, Gemma and Abby Haynes and Simon Chapman and Hall, {Wayne D.}",
year = "2011",
month = apr,
day = "6",
doi = "10.1371/journal.pone.0018521",
language = "English",
volume = "6",
journal = "PLoS ONE",
issn = "1932-6203",
publisher = "Public Library of Science",
number = "4",

}

RIS

TY - JOUR

T1 - The association between four citation metrics and peer rankings of research influence of Australian researchers in six fields of public health

AU - Elizabeth Derrick, Gemma

AU - Haynes, Abby

AU - Chapman, Simon

AU - Hall, Wayne D.

PY - 2011/4/6

Y1 - 2011/4/6

N2 - Doubt about the relevance, appropriateness and transparency of peer review has promoted the use of citation metrics as a viable adjunct or alternative in the assessment of research impact. It is also commonly acknowledged that research metrics will not replace peer review unless they are shown to correspond with the assessment of peers. This paper evaluates the relationship between researchers' influence as evaluated by their peers and various citation metrics representing different aspects of research output in 6 fields of public health in Australia. For four fields, the results showed a modest positive correlation between different research metrics and peer assessments of research influence. However, for two fields, tobacco and injury, negative or no correlations were found. This suggests a peer understanding of research influence within these fields differed from visibility in the mainstream, peer-reviewed scientific literature. This research therefore recommends the use of both peer review and metrics in a combined approach in assessing research influence. Future research evaluation frameworks intent on incorporating metrics should first analyse each field closely to determine what measures of research influence are valued highly by members of that research community. This will aid the development of comprehensive and relevant frameworks with which to fairly and transparently distribute research funds or approve promotion applications.

AB - Doubt about the relevance, appropriateness and transparency of peer review has promoted the use of citation metrics as a viable adjunct or alternative in the assessment of research impact. It is also commonly acknowledged that research metrics will not replace peer review unless they are shown to correspond with the assessment of peers. This paper evaluates the relationship between researchers' influence as evaluated by their peers and various citation metrics representing different aspects of research output in 6 fields of public health in Australia. For four fields, the results showed a modest positive correlation between different research metrics and peer assessments of research influence. However, for two fields, tobacco and injury, negative or no correlations were found. This suggests a peer understanding of research influence within these fields differed from visibility in the mainstream, peer-reviewed scientific literature. This research therefore recommends the use of both peer review and metrics in a combined approach in assessing research influence. Future research evaluation frameworks intent on incorporating metrics should first analyse each field closely to determine what measures of research influence are valued highly by members of that research community. This will aid the development of comprehensive and relevant frameworks with which to fairly and transparently distribute research funds or approve promotion applications.

KW - STANDARD BIBLIOMETRIC MEASURES

KW - H-INDEX

KW - HIRSCH-INDEX

KW - R-INDEX

KW - INDICATORS

KW - VARIANTS

U2 - 10.1371/journal.pone.0018521

DO - 10.1371/journal.pone.0018521

M3 - Journal article

VL - 6

JO - PLoS ONE

JF - PLoS ONE

SN - 1932-6203

IS - 4

M1 - 18521

ER -