The Impact of Prior Choice for Between-Study Heterogeneity in Network Meta-Analysis on Model Conclusions

Author(s)

Jenna Ellis, MSc1, Anja Haltner, MSc2, Becky Hooper, .1.
1EVERSANA, Burlington, ON, Canada, 2EVERSANA, New York, NY, USA.
OBJECTIVES: In network meta-analysis (NMA), between-study heterogeneity can arise from differences in study design, biases, or random variation. When heterogeneity is anticipated, random-effects models are often employed, however, these models can become impractical due to the inability to reliably estimate heterogeneity in the presence of a sparse network or weak data. Since heterogeneity contributes to the uncertainty in treatment effect estimates, unreliable heterogeneity estimates can artificially inflate credible intervals. Incorporating informative priors for the between-study heterogeneity parameter offers a potential solution to this challenge in the Bayesian framework. This work aims to demonstrate the impact of using informative priors for between-study heterogeneity on NMA model conclusions.
METHODS: Random-effects models NMAs were conducted on simulated datasets under various networks and data specifications. The impact of incorporating informative priors was assessed and the results were compared to those obtained using non-informative priors.
RESULTS: Informative priors for the between-study heterogeneity parameter provided more stable estimates in the presence of sparse networks leading to tighter credible intervals when compared to results obtained from models employing non-informative priors. The influence of prior choice diminished as the amount of available data increased.
CONCLUSIONS: In NMAs with few studies, the information can fail to overcome vague or non-informative priors, leading to analyses being disproportionately influenced by the chosen distribution. Informative priors offer a practical solution by incorporating external scientific knowledge, ensuring that results remain robust even with sparse data. Defining how few studies is too few is inherently challenging, though the distinction may ultimately be unnecessary as informative priors are unlikely to negatively impact analyses with extensive evidence, underscoring the importance of carefully selecting and justifying the prior distribution for all NMAs, irrespective of size.

Conference/Value in Health Info

2025-05, ISPOR 2025, Montréal, Quebec, CA

Value in Health, Volume 28, Issue S1

Code

MSR79

Topic

Methodological & Statistical Research

Disease

No Additional Disease & Conditions/Specialized Treatment Areas

Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×