Looking Sharp! Applying Cutting-Edge Shapley Additive Explanation (SHAP) Approaches to Cost-Effectiveness Modelling in Contrast to One-Way Sensitivity Analysis

Author(s)

Perni S1, Vanderpuye-Orgle J2, Poirrier JE3
1Parexel, London, London, UK, 2Parexel International, Boston, MA, USA, 3Parexel International, Wavre, WBR, Belgium

OBJECTIVES: Knowledge and understanding of why a model reaches a certain outcome is defined as model explainability; this considers the relative weight of each variable in reaching the final outcome. The explainability of a cost-effectiveness model is often limited to the use of one-way sensitivity analysis (OWSA). However, the OWSA is also limited to the estimation of the variation of the model output based on a certain percentual variation of a single input parameter. By its nature, OWSA does not account for either correlations between input parameters or non-linear relationships between input parameters and model outputs. An optimal alternative to assessing explainability is the SHAP (SHapley Additive exPlanations) approach derived from coalitional game theory. This method is increasingly employed to explain the output of machine learning models. SHAP values represent the individual contribution of each model parameter to the model prediction, similar to the coefficients of each variable in a linear regression.

METHODS: We present the use of SHAP in explaining cost-effectiveness model outcomes. For this purpose, the results of the probabilistic sensitivity analysis (PSA) of the Markov model were used to calculate SHAP for the estimated ICER. SHAP results are visualised through the beeswarm plot to describe the distribution of SHAP for each input variable and force plots to describe the contribution of each input variable to the calculated ICER for a full set of inputs.

RESULTS: Marked differences were observed in the ranking of the variables importance, and relative conclusions drawn, between OWSA and the proposed SHAP approach. Different sets of baseline inputs/model structure led to different outcomes.

CONCLUSIONS: The SHAP approach could provide a new and more appropriate way than OWSA to explain the role of each variable in the calculation of cost-effectiveness model outcomes.

Conference/Value in Health Info

2023-11, ISPOR Europe 2023, Copenhagen, Denmark

Value in Health, Volume 26, Issue 11, S2 (December 2023)

Code

EE300

Topic

Economic Evaluation, Methodological & Statistical Research, Study Approaches

Topic Subcategory

Cost-comparison, Effectiveness, Utility, Benefit Analysis, Decision Modeling & Simulation

Disease

No Additional Disease & Conditions/Specialized Treatment Areas

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×