IS THERE POTENTIAL BIAS IN MODELLING WITH DECISION ANALYTIC SOFTWARE OR MATRIX PROGRAMMING?

Author(s)

Nichol G, Wells GA, University of Ottawa, Ottawa, Canada

BACKGROUND: Decision analytic software is commonly used to estimate long-term costs or effects of treatment by using Markov models. Monte Carlo simulation is used to estimate confidence limits (CL) for costs or effects in decision models. Exact cost or effects may be calculated by matrix inversion. CL for costs and effects may be calculated from matrix inversion by using distributions for each transition probability. OBJECTIVES: The objective of this study was to validate decision analytic software by comparing the bias in decision analytic CL and matrix CL. METHODS: A 3-state Markov model was developed. Transition probabilities, utilities, and costs were assumed. Costs and effects were discounted at 3%. Decision analytic CL and matrix CL were calculated as the interquartile range (IQR) from 10,000 simulations. For each simulated value, over or under was defined relative to the exact value. Bias was defined as the ratio of (??over – ??under)/ (??over + ??under). DATA software was used for decision analysis; S Plus was used for matrix programming. RESULTS: Estimated life years, quality-adjusted life years (QALY), and costs ($) are summarized below: Data Analytic Matrix Inversion Median (IQR) Bias Median Bias Life Years $ $ per Life Year $ per QALY 5.187 (4.812; 5.611) 3.960 (3.669; 4.286) 134,900 (110,900; 160,800) 25,900 (20,900; 31,500) 33,800 (27,400; 41,300) 0.086 0.006 -0.038 5.186 (4.803; 5.605) 3.927 (3.639; 4.251) 133,800 (109,700; 160,000) 25,900 (21,700; 30,300) 34,100 (28,200; 40,600) 0.068 -0.014 -0.017 CONCLUSIONS: Decision analytic software may yield biased estimates of costs and effects. The implications of this must be considered. Analysts and policymakers should carefully validate all decision models prior to using them to determine health policy.

Conference/Value in Health Info

1999-05, ISPOR 1999, Arlington, VA, USA

Value in Health, Vol. 2, No. 3 (May/June 1999)

Code

TPDM3

Topic

Methodological & Statistical Research

Topic Subcategory

Modeling and simulation

Disease

Multiple Diseases

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×