TY - JOUR

T1 - Missing observations in paired comparison data

AU - Dittrich, Regina

AU - Francis, Brian

AU - Hatzinger, Reinhold

AU - Katzenbeisser, Walter

PY - 2012/4

Y1 - 2012/4

N2 - This paper considers the analysis of paired comparison experiments in the presence of missing responses. Various scenarios for how missing data might arise in paired comparisons are considered, and it is suggested that the most common types of missing data mechanism would be either missing completely at random or missing not at random. A new model is then proposed based on the paired comparison set of responses augmented by a set of missing data indicators for each comparison. Taking a sample selection approach, the proposed new method is based on the classical Bradley-Terrymodel for the response outcomes and a multinomial model for the missing indicators. Different models for the two missing data mechanisms—missing completely at random (MCAR) and missing not at random (MNAR)—are then discussed and a blockwise composite link formulation is used to construct the likelihood. Additionally, an extension to account for dependence between the paired comparison items is introduced. The methodology is illustrated by a survey paired comparison experiment on five distinct teaching qualities of teachers. We show that there is little evidence of a MNAR process in this dataset. A discussion on the sizes of problems that can be fitted using this approach concludes the paper.

AB - This paper considers the analysis of paired comparison experiments in the presence of missing responses. Various scenarios for how missing data might arise in paired comparisons are considered, and it is suggested that the most common types of missing data mechanism would be either missing completely at random or missing not at random. A new model is then proposed based on the paired comparison set of responses augmented by a set of missing data indicators for each comparison. Taking a sample selection approach, the proposed new method is based on the classical Bradley-Terrymodel for the response outcomes and a multinomial model for the missing indicators. Different models for the two missing data mechanisms—missing completely at random (MCAR) and missing not at random (MNAR)—are then discussed and a blockwise composite link formulation is used to construct the likelihood. Additionally, an extension to account for dependence between the paired comparison items is introduced. The methodology is illustrated by a survey paired comparison experiment on five distinct teaching qualities of teachers. We show that there is little evidence of a MNAR process in this dataset. A discussion on the sizes of problems that can be fitted using this approach concludes the paper.

KW - Bradley-Terry model

KW - paired comparison data;

KW - multiple multinomial responses

KW - composite link functions

U2 - 10.1177/1471082X1001200201

DO - 10.1177/1471082X1001200201

M3 - Journal article

VL - 12

SP - 117

EP - 143

JO - Statistical Modelling

JF - Statistical Modelling

SN - 1471-082X

IS - 2

ER -