TY - JOUR

T1 - Detecting structural change in university research systems

T2 - A case study of british research policy

AU - Wang, Jian

AU - Hicks, Diana

PY - 2013/10/31

Y1 - 2013/10/31

N2 - The university research environment has been undergoing profound change in recent decades. Aiming at international competitiveness and excellence, a variety of polices have been designed and implemented in many countries. However, evidence-based analysis of policy effects is scarce. This article develops methods for evaluating the effect of university research policy on university system research input-output dynamics. We assume stable dynamics between inputs and outputs and that effective policy change introduces external interventions and therefore structural changes into the system. Our proposed method involves three steps: modeling system dynamics, detecting structural change, and mapping policy change. Examining the case of the UK, we identified three structural changes in 1990, 1994, and 2001 respectively. The first change corresponds to the second round of the Research Selectivity Exercise and the latter two changes may be caused by the database effect. The British case is a provocative demonstration of this method, which could be further developed to provide evidence-based analysis for policy learning and a foundation for cross-case comparison.

AB - The university research environment has been undergoing profound change in recent decades. Aiming at international competitiveness and excellence, a variety of polices have been designed and implemented in many countries. However, evidence-based analysis of policy effects is scarce. This article develops methods for evaluating the effect of university research policy on university system research input-output dynamics. We assume stable dynamics between inputs and outputs and that effective policy change introduces external interventions and therefore structural changes into the system. Our proposed method involves three steps: modeling system dynamics, detecting structural change, and mapping policy change. Examining the case of the UK, we identified three structural changes in 1990, 1994, and 2001 respectively. The first change corresponds to the second round of the Research Selectivity Exercise and the latter two changes may be caused by the database effect. The British case is a provocative demonstration of this method, which could be further developed to provide evidence-based analysis for policy learning and a foundation for cross-case comparison.

KW - Evidence-based policy-making

KW - Peormance-based research funding systems

KW - Research policy

KW - Structural change detection

KW - UK

U2 - 10.1093/reseval/rvt016

DO - 10.1093/reseval/rvt016

M3 - Journal article

AN - SCOPUS:84887900383

VL - 22

SP - 258

EP - 268

JO - Research Evaluation

JF - Research Evaluation

SN - 0958-2029

IS - 4

ER -