Health Care Management Papers
Document Type
Technical Report
Date of this Version
3-2015
Publication Source
Trials
Volume
16
DOI
10.1186/s13063-015-0592-6
Abstract
Background
Determination of comparative effectiveness in a randomized controlled trial requires consideration of an intervention’s comparative uptake (or acceptance) among randomized participants and the intervention’s comparative efficacy among participants who use their assigned intervention. If acceptance differs across interventions, then simple randomization of participants can result in post-randomization losses that introduce bias and limit statistical power.
Methods
We develop a novel preference-adaptive randomization procedure in which the allocation probabilities are updated based on the inverse of the relative acceptance rates among randomized participants in each arm. In simulation studies, we determine the optimal frequency with which to update the allocation probabilities based on the number of participants randomized. We illustrate the development and application of preference-adaptive randomization using a randomized controlled trial comparing the effectiveness of different financial incentive structures on prolonged smoking cessation.
Results
Simulation studies indicated that preference-adaptive randomization performed best with frequent updating, accommodated differences in acceptance across arms, and performed well even if the initial values for the allocation probabilities were not equal to their true values. Updating the allocation probabilities after randomizing each participant minimized imbalances in the number of accepting participants across arms over time. In the smoking cessation trial, unexpectedly large differences in acceptance among arms required us to limit the allocation of participants to less acceptable interventions. Nonetheless, the procedure achieved equal numbers of accepting participants in the more acceptable arms, and balanced the characteristics of participants across assigned interventions.
Conclusions
Preference-adaptive randomization, coupled with analysis methods based on instrumental variables, can enhance the validity and generalizability of comparative effectiveness studies. In particular, preference-adaptive randomization augments statistical power by maintaining balanced sample sizes in efficacy analyses, while retaining the ability of randomization to balance covariates across arms in effectiveness analyses.
Copyright/Permission Statement
© French et al.; licensee BioMed Central. 2015
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Keywords
adaptive design, adherence, comparative effectiveness research, efficacy, instrumental variables
Recommended Citation
French, B., Small, D. S., Novak, J., Saulsgiver, K., Harhay, M. O., Asch, D. A., Volpp, K. G., & Halpern, S. D. (2015). Preference-Adaptive Randomization in Comparative Effectiveness Studies. Trials, 16 http://dx.doi.org/10.1186/s13063-015-0592-6
Date Posted: 27 November 2017
This document has been peer reviewed.