ELICITING UNCERTAINTY OF COMPLEX MODEL PARAMETERS: A CASE STUDY ON ELICITING THE TEMPORAL CHANGE IN THE TREATMENT EFFECT

Author(s)

Jankovic D1, Bojke L2, Payne K3
1University of York, York, NYK, UK, 2University of York, York, UK, 3The University of Manchester, Manchester, UK

OBJECTIVES

Temporal uncertainty in cost-effectiveness modelling arises when the analysis time horizon exceeds the observed evidence end point. Quantifying the consequences of such uncertainty is often problematic. This study uses structured elicitation of experts’ beliefs to characterise temporal uncertainty in the treatment effect, using a case study of a multifaceted podiatry intervention designed to reduce the rate of falls and fractures in the elderly.

METHODS

An elicitation exercise was designed and conducted to inform the temporal change in the effect of the podiatry intervention on the rate of falls and fractures. The elicited change in treatment effect was applied to the results of a randomised trial, REFORM, that reported at 1-year. The exercise was delivered using an online tool, designed to be completed remotely and independently to encourage experts’ participation.

RESULTS

The study recruited 38 experts (geriatricians, general practitioners, physiotherapists, nurses, and academics) from across the UK. The elicited priors implied that uncertainty around the treatment effect, and thus the predicted outcomes, increased over time - the 95% confidence interval around the predicted rate of falls was 1.4-1.6 falls one year after starting treatment, compared to 0.7-1.6 falls after five years. The majority of experts believed that the treatment effect would depreciate over time, although beliefs varied across professions - geriatricians were least certain that the treatment effect would change, while nurses were the only experts who believed the treatment effect could potentiate. The differences could reflect the heterogeneity in their role in treating patients at risk of falling.

CONCLUSIONS

The elicitation task was somewhat difficult for experts to complete and did rely on assumptions in order to make the exercise deliverable under the time and budget constraints. Nevertheless, the study demonstrates expert elicitation as a plausible method for informing uncertainty around the temporal change in the treatment effect, and illustrates the associated methodological challenges.

Conference/Value in Health Info

2020-05, ISPOR 2020, Orlando, FL, USA

Value in Health, Volume 23, Issue 5, S1 (May 2020)

Code

PMU98

Topic

Clinical Outcomes, Methodological & Statistical Research

Topic Subcategory

Clinical Outcomes Assessment, Comparative Effectiveness or Efficacy, Relating Intermediate to Long-term Outcomes

Disease

Geriatrics, Injury and Trauma, Musculoskeletal Disorders

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×