Join ISPOR  | Sign up for mailing List  | Follow Us: LinkedIn Twitter Facebook YouTube
 

JOINT MODELING GOOD RESEARCH PRACTICES TASK FORCE
 

MODELING TASK FORCE LEADERSHIP

J. Jaime Caro MD, Chair, ISPOR-SMDM Modeling Good Research Practices Task Force

J. Jaime Caro MDCM, FRCPC, FACP, Chair, ISPOR-SMDM Modeling Good Research Practices Task Force
ISPOR and SMDM Member, and  Senior Vice President, Research, United BioSource Corporation, Lexington, MA, USA, and Adjunct Professor of Medicine & Epidemiology & Biostatistics, McGill University, Montreal, QC, Canada

Andrew Briggs DPhil

Andrew Briggs, DPhil, Co-Chair, ISPOR-SMDM Modeling Good Research Practices Task Force
ISPOR and SMDM Member, and William R. Lindsay Chair of Health Economics, Health Economics & Health Technology Assessment, Institute of Health & Wellbeing, University of Glasgow, Glasgow, Scotland UK

Karen Kuntz ScD, Co-Chair, ISPOR-SMDM Modeling Good Research Practices Task Force

Karen Kuntz ScD, Co-Chair, ISPOR-SMDM Modeling Good Research Practices Task Force
SMDM Member, SMDM Issues in Methodology Working Group Chair,
and Professor, University of Minnesota School of Public Health
Minneapolis, MN USA

Uwe Siebert, MD, MPH, MSc, ScD, Co-Chair ISPOR-SMDM Modeling Good Research Practices Task Force

Uwe Siebert, MD, MPH, MSc, ScD, Co-Chair ISPOR-SMDM Modeling Good Research Practices Task Force
ISPOR and SMDM Member, SMDM Board representative-Issues in Methodology Working Group 
and Professor of Public Health, UMIT – Univ. of Health Sciences, Medical Informatics & Technology
Hall i.T, Austria

Goal:
To ensure that good research practices on modeling techniques remain useful for all current modeling techniques as well as to foster the use of model-based results to inform health care decisions, a Modeling Good Research Practices Task Force was created to address (1) advances in modeling, (2) approaches to evaluating variability in models, and (3) transparency in reporting of models. The development of these modeling good research practices is in collaboration with The Society for Medical Decision Making (SMDM). The ISPOR Board of Directors approved this initiative March 25, 2010 and the SMDM Board approved May 1, 2010.

Background:
The first International Society for Pharmacoeconomics and Outcomes Research (ISPOR) Good Research Practices Task Force on Modeling (2000-2003), chaired by Milton Weinstein, published its report in 2003. See Principles of Good Practice for Decision Analytic Modeling in Health-Care Evaluation: Report of the ISPOR Task Force on Good Research Practices—Modeling Studies (pdf format) [1].  This ISPOR Task Force Report began by defining a model and its purposes, presented an approach to evaluating a model, and then described the consensus of the Task Force regarding the attributes that define a good model, in terms of structure, data and validation. 

Developments in three aspects of modeling created a need for a new examination of several issues addressed by the previous Task Force. First, the recommendations were focused on the kinds of models that were in most widespread use in our field at the time, namely state-transition (Markov) and decision-analytic models.  Consideration was given to both deterministic and probabilistic (i.e., individual-level Monte Carlo simulation) approaches to such models.  In the intervening years, with advances in computing capabilities, experience with other types of models has grown in our research community, among these being models that focus on the timing of events rather than transitions between health states.  The roles of deterministic cohort models, as well as individual micro-simulations and other techniques such as SEIR transmission models need to be re-examined. Second, analysis of uncertainty surrounding model results has also advanced with computing capabilities, with new approaches to probabilistic sensitivity analysis becoming available.  Still, deterministic sensitivity analyses have an important role to play because of their transparency for decision makers. Finally, while the U.S. Panel on Cost-Effectiveness in Health and Medicine [2] recommended that models be transparent, with detailed technical reports publicly available, this practice has been followed inconsistently.

Work Product:
This ISPOR-SMDM Joint Modeling Good Research Practices Task Force will provide a guidance for: a) delineating the approach and design of modeling studies and the identification and preparation of required data, b) selecting a modeling technique, c) implementing and validating the model, d) addressing uncertainty around model results, e) reporting the modeling study results to assure transparency, and f) using model-based study results to inform decision-making. Since there are multiple issues to be addressed by this Modeling Task Force, and to assure each issue is adequately addressed including defining preferred practices for different modeling techniques, this Task Force will produce several papers (parts) to this Modeling Task Force Report, similar to the papers published in Medical Decision Making, Primer on Medical Decision Analysis Part 1 – Part 5 [8-12].

Activities:
Modeling Good Research Practices - Everything You Need To Know
May 2011 – ISPOR 16th Annual International Meeting, Third Plenary Session, Baltimore, MD, USA

Modeling Good Research Practices (The Good, The Bad, and The Ambiguous)
November 2010 - ISPOR 13th Annual European Congress, Forum Presentation Prague, Czech Republic
2010 - 32nd Annual Meeting of the Society for Medical Decision Making, Toronto, Canada

Timeline:

Activity:

Date:

Define papers to be included in this Task Force Report, suggested lead authors, and additional members

May 6, 2010

Identify authors for each paper included in the Task Force Report

May 15, 2010

Develop consensus on the content of each paper and a draft detailed outline of each paper

August 1, 2010

Finalize detailed outline of each paper & assign sections of each paper to Task Force member volunteers

September 15, 2010

First draft of each paper completed

October 15, 2010

Overview of papers presented at ISPOR Forum at 13th Annual European Congress (Prague) for comment

November 8, 2010

Second draft of papers prepared and face-to-face meeting to discuss contentious issues

March 2011

Draft papers submitted to Review Group for comments

April 25th 2011

Draft papers presented during Third Plenary Session at ISPOR 16th Annual International Meeting (Baltimore) for comment

May 25, 2011

Draft papers submitted to ISPOR membership for comments

July 2011

Draft papers revised based on comments

October 2011

Papers submitted to Value in Health and Medical Decision Making

March 2012


ISPOR-SMDM Joint Modeling Good Research Practices Task Force Face to Face Meeting
March 3-6, 2011 in Boston, MA, USA

 

Transparency and Validation Working Group

State-Transition Modeling Working Group

State-Transition Modeling Working Group

Task Force Working Dinner

Task Force Working Dinner

Task Force Working Dinner

Task Force Working Dinner

Task Force Working Dinner

Task Force Plenary Sessions

Task Force Plenary Sessions

Task Force Plenary Sessions

Task Force Plenary Sessions

Task Force Plenary Sessions

Dynamic Transmission Modeling Working Group

Dynamic Transmission Modeling Working Group

Discrete Event Simulation Working Group

Task Force Chair: J. Jaime Caro, MDCM, FRCPC, FACP

Boat Ride on Boston Harbor

Boat Ride on Boston Harbor

Boat Ride on Boston Harbor

Conceptual Modeling Working Group

Conceptual Modeling Working Group

Conceptual Modeling Working Group

Discrete Event Simulation Working Group

Transparency and Validation Working Group


Task Forces Index

Contact ISPOR @ info@ispor.org  |  View Legal Disclaimer
©2014 International Society for Pharmacoeconomics and Outcomes Research. All rights reserved under International and Pan-American Copyright Conventions. 
Website design by Eagle Systems USA, Inc.