Rights statement: © 2016 The Authors. Published by Elsevier B.V. on behalf of International Institute of Forecasters. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Accepted author manuscript, 494 KB, PDF document
Available under license: CC BY: Creative Commons Attribution 4.0 International License
Final published version
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - Using a rolling training approach to improve judgmental extrapolations elicited from forecasters with technical knowledge
AU - Petropoulos, Fotios
AU - Goodwin, Paul
AU - Fildes, Robert
N1 - © 2016 The Authors. Published by Elsevier B.V. on behalf of International Institute of Forecasters. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
PY - 2017/1
Y1 - 2017/1
N2 - Several biases and inefficiencies are commonly associated with the judgmental extrapolation of time series even when forecasters have technical knowledge about forecasting. This study examines the effectiveness of using a rolling training approach, based on feedback, to improve the accuracy of forecasts elicited from people with such knowledge. In an experiment forecasters were asked to make multiple judgmental extrapolations for a set of time series from different time origins. For each series in turn, the participants were either unaided or they were provided with feedback. In the latter case, following submission of each set of forecasts, the true outcomes and performance feedback were provided. The objective was to provide a training scheme, enabling forecasters to better understand the underlying pattern of the data by learning directly from their forecast errors. Analysis of the results indicated that the rolling training approach is an effective method for enhancing judgmental extrapolations elicited from people with technical knowledge, especially when bias feedback is provided. As such it can be a valuable element in the design of software systems that are intended to support expert knowledge elicitation (EKE) in forecasting.
AB - Several biases and inefficiencies are commonly associated with the judgmental extrapolation of time series even when forecasters have technical knowledge about forecasting. This study examines the effectiveness of using a rolling training approach, based on feedback, to improve the accuracy of forecasts elicited from people with such knowledge. In an experiment forecasters were asked to make multiple judgmental extrapolations for a set of time series from different time origins. For each series in turn, the participants were either unaided or they were provided with feedback. In the latter case, following submission of each set of forecasts, the true outcomes and performance feedback were provided. The objective was to provide a training scheme, enabling forecasters to better understand the underlying pattern of the data by learning directly from their forecast errors. Analysis of the results indicated that the rolling training approach is an effective method for enhancing judgmental extrapolations elicited from people with technical knowledge, especially when bias feedback is provided. As such it can be a valuable element in the design of software systems that are intended to support expert knowledge elicitation (EKE) in forecasting.
KW - Judgmental forecasting
KW - Unaided judgments
KW - Rolling training
KW - Feedback
KW - Time series
KW - Expert knowledge elicitation
U2 - 10.1016/j.ijforecast.2015.12.006
DO - 10.1016/j.ijforecast.2015.12.006
M3 - Journal article
VL - 33
SP - 314
EP - 324
JO - International Journal of Forecasting
JF - International Journal of Forecasting
SN - 0169-2070
IS - 1
ER -