Accepted author manuscript, 572 KB, PDF document
Available under license: CC BY: Creative Commons Attribution 4.0 International License
Final published version
Research output: Contribution to Journal/Magazine › Journal article › peer-review
Research output: Contribution to Journal/Magazine › Journal article › peer-review
}
TY - JOUR
T1 - Effects of Allocation Method and Time Trends on Identification of the Best Arm in Multi-arm Trials
AU - Berry, Lindsay R
AU - Lorenzi, Elizabeth
AU - Berry, Nicholas S
AU - Crawford, Amy M
AU - Jacko, Peter
AU - Viele, Kert
PY - 2024/1/23
Y1 - 2024/1/23
N2 - Many trial designs, such as dose-finding trials, shared-control designs, or adaptive platform trials, investigate multiple therapies simultaneously. Often these trials seek to identify the best arm and compare it to a control. Adaptive trials are commonly considered in this space, focusing on methods that drop arms or adjust allocation in response to accumulating information. These methods continue to be compared in the literature, most recently with an emphasis on the effect of time trends during the experiment. Here we compare several methods, considering their performance with and without time trends present. The four procedures are: (a) fixed allocation, (b) arm dropping based on p-values (two variants), (c) arm dropping based on the posterior probability each arm is best (two variants), and (d) response-adaptive randomization. These procedures are compared in terms of their ability to identify the best arm, statistical power, accuracy of estimation, and potential benefit to participants inside the trial. We find arm dropping based on the probability each arm is best and RAR among the best options from the methods considered. Arm dropping based on p-values performs moderately worse, and fixed allocation is much worse on all metrics within this context.
AB - Many trial designs, such as dose-finding trials, shared-control designs, or adaptive platform trials, investigate multiple therapies simultaneously. Often these trials seek to identify the best arm and compare it to a control. Adaptive trials are commonly considered in this space, focusing on methods that drop arms or adjust allocation in response to accumulating information. These methods continue to be compared in the literature, most recently with an emphasis on the effect of time trends during the experiment. Here we compare several methods, considering their performance with and without time trends present. The four procedures are: (a) fixed allocation, (b) arm dropping based on p-values (two variants), (c) arm dropping based on the posterior probability each arm is best (two variants), and (d) response-adaptive randomization. These procedures are compared in terms of their ability to identify the best arm, statistical power, accuracy of estimation, and potential benefit to participants inside the trial. We find arm dropping based on the probability each arm is best and RAR among the best options from the methods considered. Arm dropping based on p-values performs moderately worse, and fixed allocation is much worse on all metrics within this context.
KW - Pharmaceutical Science
KW - Statistics and Probability
U2 - 10.1080/19466315.2023.2298961
DO - 10.1080/19466315.2023.2298961
M3 - Journal article
VL - 16
SP - 512
EP - 525
JO - Statistics in Biopharmaceutical Research
JF - Statistics in Biopharmaceutical Research
SN - 1946-6315
IS - 4
ER -