GRP logo
Conceptualizing a Model


Conceptualizing a Model: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-2

The citation for this report is:
Roberts M, Russell LB, Paltiel AD, et al. Conceptualizing a model: A report of the ISPOR-SMDM modeling good research practices task force-2. Value Health 2012;15:804-11.

Webinars Icon » Webinar

For Modeling Good Research Practices – Overview: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-1, please see: http://www.ispor.org/workpaper/Modeling-Good-Research-Practices-Overview.asp

For State-Transition Modeling: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-3, please see: http://www.ispor.org/workpaper/State-Transition-Modeling.asp
Supplementary Material: http://www.valueinhealthjournal.com/cms/attachment/2003877082/2015551317/mmc1.pdf

For Modeling using Discrete Event Simulation: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-4, please see: http://www.ispor.org/workpaper/Modeling-Using-Discrete-Event-Simulation.asp

For Dynamic Transmission Modeling: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-5, please see: http://www.ispor.org/workpaper/Dynamic-Transmission-Modeling.asp

For Model Parameter Estimation and Uncertainty Analysis: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-6, please see: http://www.ispor.org/workpaper/Model-Parameter-Estimation-and-Uncertainty-Analysis.asp

For Model Transparency and Validation: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-7, please see: http://www.ispor.org/workpaper/Model-Transparency-and-Validation.asp

Working Group Chair (Lead author):
Mark Roberts MD, Professor and Chair, Department of Health Policy & Management, University of Pittsburgh, Pittsburgh, PA, USA

Working Group Members (Co-authors):
Michael Chambers MSc, MA, Health Economics, GlaxoSmithKline, Uxbridge, England, United Kingdom
Murray Krahn MD, MSc, Professor, Medicine, University of Toronto, Toronto, Ontario, Canada
Phil McEwan PhD, Managing Director, CRC, Cardiff, England, United Kingdom
A. David Paltiel PhD, Professor and Acting Division Head, Yale University, Yale School of Public Health, New Haven, CT, USA
Louise Russell PhD, Chair, Division on Health Policy and Professor,Department of Economics, Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ USA

Goal:
To ensure that good research practices on modeling techniques remain useful for all current modeling techniques as well as to foster the use of model-based results to inform health care decisions, a Modeling Good Research Practices Task Force was created to address (1) advances in modeling, (2) approaches to evaluating variability in models, and (3) transparency in reporting of models. The development of these modeling good research practices is in collaboration with The Society for Medical Decision Making (SMDM). The ISPOR Board of Directors approved this initiative March 25, 2010 and the SMDM Board approved May 1, 2010.

Background:
The first International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Good Research Practices Task Force on Modeling (2000-2003), chaired by Milton Weinstein, published its report in 2003. See Principles of Good Practice for Decision Analytic Modeling in Health-Care Evaluation: Report of the ISPOR Task Force on Good Research Practices—Modeling Studies (pdf format) [1]. This ISPOR Task Force Report began by defining a model and its purposes, presented an approach to evaluating a model, and then described the consensus of the Task Force regarding the attributes that define a good model, in terms of structure, data and validation.

Developments in three aspects of modeling created a need for a new examination of several issues addressed by the previous Task Force. First, the recommendations were focused on the kinds of models that were in most widespread use in our field at the time, namely state-transition (Markov) and decision-analytic models.  Consideration was given to both deterministic and probabilistic (i.e., individual-level Monte Carlo simulation) approaches to such models.  In the intervening years, with advances in computing capabilities, experience with other types of models has grown in our research community, among these being models that focus on the timing of events rather than transitions between health states.  The roles of deterministic cohort models, as well as individual micro-simulations and other techniques such as SEIR transmission models need to be re-examined. Second, analysis of uncertainty surrounding model results has also advanced with computing capabilities, with new approaches to probabilistic sensitivity analysis becoming available.  Still, deterministic sensitivity analyses have an important role to play because of their transparency for decision makers. Finally, while the U.S. Panel on Cost-Effectiveness in Health and Medicine [2] recommended that models be transparent, with detailed technical reports publicly available, this practice has been followed inconsistently.

Activities:
Modeling Good Research Practices - Everything You Need To Know
May 2011 – ISPOR 16th Annual International Meeting, Third Plenary Session, Baltimore, MD, USA

Modeling Good Research Practices (The Good, The Bad, and The Ambiguous)
November 2010 – ISPOR 13th Annual European Congress, Forum Presentation Prague, Czech Republic
2010 – 32nd Annual Meeting of the Society for Medical Decision Making, Toronto, Canada

The draft final report for member comment is: DRAFT – Conceptualizing a Model: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-2. The reviewer comments and author responses to this draft report are: COMMENTS – Conceptualizing a Model: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force-2.


ISPOR Good Practices For Outcomes Research Index