The Full Circle: Systematic Evaluation, Replication and Validation of Structural Health Economic Modelling Approaches: Lessons Learned in the Field of Obesity

Author(s)

Schwander B1, Nuijten M2, Evers S3, Hiligsmann M4
1Agency for Health Economic Assessment & Dissemination (AHEAD), Bietigheim-Bissingen, BW, Germany, 2A2M, Amsterdam, Netherlands, 3Maastricht University / Trimbos Institute, Maastricht / Utrecht, Netherlands, 4Maastricht University, Maastricht, LI, Netherlands

OBJECTIVES: This research presents the lessons learned of a 5-year research project aiming to increase trust and confidence in selecting and interpreting results related to commonly applied structural approaches used in health economic obesity models.

METHODS: A three-step process was followed. First a systematic review was performed to determine commonly applied health economic modelling approaches. Second a replication of high-quality health economic models was performed in TreeAge and the reproduction success was evaluated. Third, using the successfully replicated models, we performed an external validation and health economic result comparison using state of the art methods.

RESULTS: Of 87 included papers reflecting health economic obesity models, 69 (79%) applied unique modelling approaches, but only for a minority (14%) an external validation was performed. Most commonly simulated obesity associated events were coronary heart disease (83%), type 2 diabetes (74%) and stroke (65%). The most commonly event simulation approaches were either using specific risk equations (influenced by various risk factors), or simpler body-mass-index (BMI) based approaches, either using BMI-related relative risks (RR) or using risk function that includes BMI as central variable. We were able to successfully reproduce the results of three models reflecting those three main approaches. In the external event validation, the risk function approach showed the best results, followed by the BMI-related RR risk and the BMI-function approaches. Although a variation in the mean incremental cost effectiveness ratio was identified, there was no statistically significant difference identified between the approaches.

CONCLUSIONS: This research identified important aspects related to health economic model reporting, reproduction and validation in general, and key aspects specifically related to obesity associated event simulation. Our research could form a basis for evaluating the strengths and weaknesses of different structural event simulation approaches and identified important areas for further research to improve model reporting, reproducibility and credibility.

Conference/Value in Health Info

2023-11, ISPOR Europe 2023, Copenhagen, Denmark

Value in Health, Volume 26, Issue 11, S2 (December 2023)

Code

EE468

Topic

Economic Evaluation, Health Technology Assessment, Methodological & Statistical Research, Real World Data & Information Systems

Topic Subcategory

Cost-comparison, Effectiveness, Utility, Benefit Analysis, Decision & Deliberative Processes, Reproducibility & Replicability

Disease

Cardiovascular Disorders (including MI, Stroke, Circulatory), Diabetes/Endocrine/Metabolic Disorders (including obesity), Surgery

Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×