Final published version
Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Chapter
Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSN › Chapter
}
TY - CHAP
T1 - On the Issue of Choosing the Best Predictive Model Based on Bayesian Principles
AU - Svetunkov, Sergey
AU - Svetunkov, Ivan
PY - 2024/6/21
Y1 - 2024/6/21
N2 - One of the most important problems in business forecasting is the problem of variables selection. It arises in many contexts and in many applications and is typically solved either using cross-validation techniques or with information criteria. According to the latter approach, a researcher selects the predictive model that has the smallest information criterion value among the models considered in a pool. This approach showed its efficiency in many contexts, but it is oblivious of the performance of models several steps ahead and on the data the model has not seen (test set). We propose a new method for selecting the best predictive model, based on direct use of Bayes’ theorem. In this method, a priori and a posteriori probabilities of suitability of each model for forecasting are calculated. A coefficient is then calculated using geometric mean of these estimates. The model for which the proposed calculated coefficient has the maximum value is considered to be the most appropriate for the data and can be used for forecasting. A comparative analysis of the main methods for selecting the best forecast model carried out by the authors on the example of one hundred different time series using autoregressive models showed that on average the proposed method for selecting a model works better than the existing ones.
AB - One of the most important problems in business forecasting is the problem of variables selection. It arises in many contexts and in many applications and is typically solved either using cross-validation techniques or with information criteria. According to the latter approach, a researcher selects the predictive model that has the smallest information criterion value among the models considered in a pool. This approach showed its efficiency in many contexts, but it is oblivious of the performance of models several steps ahead and on the data the model has not seen (test set). We propose a new method for selecting the best predictive model, based on direct use of Bayes’ theorem. In this method, a priori and a posteriori probabilities of suitability of each model for forecasting are calculated. A coefficient is then calculated using geometric mean of these estimates. The model for which the proposed calculated coefficient has the maximum value is considered to be the most appropriate for the data and can be used for forecasting. A comparative analysis of the main methods for selecting the best forecast model carried out by the authors on the example of one hundred different time series using autoregressive models showed that on average the proposed method for selecting a model works better than the existing ones.
KW - Autoregression
KW - Forecasting
KW - Information theory
KW - Model building
KW - Regression analysis
U2 - 10.1007/978-3-031-56677-6_8
DO - 10.1007/978-3-031-56677-6_8
M3 - Chapter
SN - 9783031566769
T3 - Lecture Notes in Networks and Systems
SP - 107
EP - 119
BT - Understanding the Digital Transformation of Socio-Economic-Technological Systems
A2 - Campos Devezas, Tessalano
A2 - Berawi, Mohammed Ali
A2 - Barykin, Sergey Evgenievich
A2 - Kudryavtseva, Tatiana
PB - Springer
CY - Cham
ER -