Challenges in NMA Methodology Based on Re-Randomization vs Treat-through Trial Designs

Author(s)

Petersohn S1, Ho M2, Ainsworth C3, Hartz S4, Panni T5
1OPEN Health Evidence & Access, Rotterdam, NH, Netherlands, 2OPEN Health Evidence & Access, York, YOR, UK, 3OPEN Health Evidence & Access, Manchester, LAN, UK, 4Eli Lilly and Company, Bracknell, SRY, UK, 5Lilly Deutschland GmbH, Bad Homburg, Hesse, Germany

OBJECTIVES: Re-randomization (RR) and treat-through (TT) are both recognized and recommended study designs to assess outcomes for treatments with an induction and subsequent maintenance phase such as Crohn’s Disease (CD). Heterogeneity arises when network meta analyses (NMA) include mixed trial designs. This study explores the sources of uncertainty affecting NMAs involving RR and TT trial designs and potential methodological solutions.

METHODS: A review identified indications and recent HTA submissions where TT and RR trials are used. This literature was used to explore key sources of uncertainty and methodological approaches used to address these challenges.

RESULTS: The identified TT studies do not include a comparable placebo arm during maintenance, requiring the use of an active comparator (previously studied in a RR setting) to create a connected network. Once the network is created, individual patient data (IPD) are needed for TT studies to restrict the population to induction responders, to replicate a RR design. When no IPD is available strong assumptions are needed. To mitigate potential confounding from breaking randomization when limiting to responders only, propensity score matching is recommended to estimate the probability of being in each treatment arm. An additional challenge given the nature of RR studies is that only responders in the induction active comparator arm enter the maintenance phase. Those re-randomized to receive placebo, the structure of which may differ between studies, during maintenance may experience a potential carry over effect from their respective active induction treatments, adding a further source of heterogeneity across the studies.

CONCLUSIONS: TT and RR trials differ in their purposes and the treatment goals assessed. As a result they generate maintenance outcomes that are not comparable without prior alignment. Mixed design NMAs currently utilize different methodologies of varying robustness. Methodological guidelines are needed, and detailed reporting of trial data is encouraged.

Conference/Value in Health Info

2024-11, ISPOR Europe 2024, Barcelona, Spain

Value in Health, Volume 27, Issue 12, S2 (December 2024)

Code

MSR180

Topic

Clinical Outcomes, Study Approaches

Topic Subcategory

Comparative Effectiveness or Efficacy, Meta-Analysis & Indirect Comparisons

Disease

Gastrointestinal Disorders, No Additional Disease & Conditions/Specialized Treatment Areas

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×