UNCERTAINTY QUANTIFICATION OF LARGE-SCALE HEALTH ECONOMIC SIMULATION MODELS

Author(s)

Zheng P, Dinh T* Archimedes Inc., San Francisco, CA, USA

OBJECTIVES: Large scale simulation models (e.g. Archimedes Model, MISCAN) are increasingly used to predict cost-effectiveness of medical interventions and to drive reimbursement decisions. These models are complex and involve hundreds of parameters and inputs. Quantification of parameter uncertainties using traditional sampling-based approaches (e.g., Monte Carlo sampling and its variants) can be prohibitively expensive for these models. METHODS:  We overcome the limitations of traditional probabilistic sensitivity analysis through a 4-step process. First, we conduct a thorough survey of all parameters and their confidence intervals. Second, we use local sensitivity analysis to evaluate the effects of each parameter on the outcome of interest. Third, based on results from single-parameter sensitivity analysis, we rank and identify a group of parameters that have the largest effects on the outcome. We then employ response surface (RS) approximation methods to create a mathematical model of the model predictions for these parameters. We use Latin Hypercube sampling (LHS) to generate data points and multivariate adaptive regression splines (MARS) to build the response surface approximations. Fourth, we sample parameters from their joint distributions, and then use the constructed response surface to calculate the probability distribution of the predicted outcomes. RESULTS: We apply the above methodology to quantify uncertainties in predictions of the Archimedes Model for effectiveness of colorectal cancer (CRC) screening by colonoscopy (COLO) and fecal immunological test (FIT). We started out with 200 parameters and identified 20 parameters that have significant influences on predicted effectiveness of  CRC screening. We conclude that there is a 89% chance that COLO will save more life years FIT, after accounting for parameter uncertainties. Similarly we estimate that there is a 61% probability that FIT is more cost effective than colonoscopy. CONCLUSIONS: We have developed a robust and efficient methodology for quantifying parameter uncertainties of large-scale simulation models used for cost-effectiveness analysis.

Conference/Value in Health Info

2013-11, ISPOR Europe 2013, The Convention Centre Dublin

Value in Health, Vol. 16, No. 7 (November 2013)

Code

PRM113

Topic

Methodological & Statistical Research

Topic Subcategory

Modeling and simulation

Disease

Oncology

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×