Rights statement: This is the author’s version of a work that was accepted for publication in Social Science & Medicine. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Social Science & Medicine, 190, 2017 DOI: 10.1016/j.socscimed.2017.08.033
Accepted author manuscript, 598 KB, PDF document
Available under license: CC BY-NC-ND: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
Final published version
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - Differential item functioning in quality of life measurement
T2 - an analysis using anchoring vignettes
AU - Knott, Rachel J.
AU - Lorgelly, Paula K.
AU - Black, Nicole
AU - Hollingsworth, Bruce
N1 - This is the author’s version of a work that was accepted for publication in Social Science & Medicine. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Social Science & Medicine, 190, 2017 DOI: 10.1016/j.socscimed.2017.08.033
PY - 2017/10
Y1 - 2017/10
N2 - Systematic differences in the ways that people use and interpret response categories (differential item functioning, DIF) can introduce bias when using self-assessments to compare health or quality of life across heterogeneous groups. This paper reports on an exploratory analysis involving the use of anchoring vignettes to identify differential item functioning (DIF) in a commonly used measure for assessing health-related quality of life - namely the EQ-5D. Using data from a bespoke (i.e. custom) survey that recruited a representative sample of 4300 respondents from the general Australian population in 2014 and 2015, we find that the assumptions of response consistency (RC) and vignette equivalence (VE) hold in a sub-sample of respondents aged 55–65 years (n = 914), which demonstrates that vignettes can appropriately identify DIF in EQ-5D reporting for this age group. We find that the EQ-5D is indeed subject to DIF, and that failure to account for DIF can lead to conclusions that are misleading when using the instrument to compare health or quality of life across heterogeneous groups. We also provide several important insights in terms of the identifying assumptions of RC and VE. We conclude that the implications of DIF could be of considerable importance, not only for outcomes research, but for funding decisions in healthcare more broadly given the strong reliance on patient-reported outcome measures in economic evaluations for health technology assessment.
AB - Systematic differences in the ways that people use and interpret response categories (differential item functioning, DIF) can introduce bias when using self-assessments to compare health or quality of life across heterogeneous groups. This paper reports on an exploratory analysis involving the use of anchoring vignettes to identify differential item functioning (DIF) in a commonly used measure for assessing health-related quality of life - namely the EQ-5D. Using data from a bespoke (i.e. custom) survey that recruited a representative sample of 4300 respondents from the general Australian population in 2014 and 2015, we find that the assumptions of response consistency (RC) and vignette equivalence (VE) hold in a sub-sample of respondents aged 55–65 years (n = 914), which demonstrates that vignettes can appropriately identify DIF in EQ-5D reporting for this age group. We find that the EQ-5D is indeed subject to DIF, and that failure to account for DIF can lead to conclusions that are misleading when using the instrument to compare health or quality of life across heterogeneous groups. We also provide several important insights in terms of the identifying assumptions of RC and VE. We conclude that the implications of DIF could be of considerable importance, not only for outcomes research, but for funding decisions in healthcare more broadly given the strong reliance on patient-reported outcome measures in economic evaluations for health technology assessment.
KW - Australia
KW - Differential item functioning
KW - Anchoring vignettes
KW - EQ-5D
KW - Response consistency
KW - Vignette equivalence
U2 - 10.1016/j.socscimed.2017.08.033
DO - 10.1016/j.socscimed.2017.08.033
M3 - Journal article
VL - 190
SP - 247
EP - 255
JO - Social Science and Medicine
JF - Social Science and Medicine
SN - 0277-9536
ER -