SESSION
I - Monday 12 November 2001
WW1
PUBLISHING YOUR OWN
PHARMACOECONOMIC AND OUTCOME TOOLS ON THE INTERNET: HOW TO CREATE WEB-BASED
CALCULATORS, SPREADSHEETS, DECISION MODELS, AND INTERACTIVE QUESTIONNAIRES
McGhan WF
University of the
Sciences, Philadelphia, PA, USA
OBJECTIVES:
Participants will learn about designing and coding interactive web-based
tools including: calculators, spreadsheets, decision models, as well as
assessment instruments for conducting time-trade-off, standard gamble and
willingness-to-pay studies.
PARTICIPANTS WHO
WOULD BENEFIT: This session is intended for
individuals who are interested in learning more about creating and using
interactive tools and data collection instruments on the Internet.
Pharmacoeconomic and outcome
tools on the Internet can allow data to be collected and results disseminated
from different policy perspectives: 1) patient, 2) provider, 3) hospital, 4)
managed care organization, 5) government, and 6) society. Interactive
internet models can facilitate the assessment of health care interventions or
services from different quantitative perspectives such as 1) cost of illness,
2) cost effectiveness, and 3) quality of life monitoring. Programming
examples will cover strengths and weaknesses of html, xml, mysql, javascript,
vbscript, cgi, perl, php, asp, wml, and java. Pros and cons of web authoring
software will be discussed. Internet and wireless examples will be presented
that can facilitate shared decision-making and incorporate patient
preferences into treatment pathways at the bedside. Web applications can
assist in maintaining outcome databases, facilitating disease management, and
generating continuous feedback for providers and patients. Internet pages can
now be accessed in patients’ homes, practitioners’ offices and anywhere with
the new handheld computers and web phones. Questions that should be asked in
evaluating Internet applications include: how much of the information is
built on clinical trials, has the web site been peer reviewed, has the
material been rigorously field-tested, are questionnaires valid and reliable,
is the information well referenced?
WW2
NUMBER NEEDED TO
TREAT (NNT): IS IT A USEFUL BENCHMARK FOR THE EFFICIENCY OF THERAPIES?
Caro J, Huybrechts K
Caro Research Institute,
Concord, MA, USA
OBJECTIVES: To
evaluate the usefulness of the Number Needed to Treat (NNT) — the number of
patients who must be treated in order to prevent one adverse event — as a
simple summary statistic to compare the efficiency of various interventions.
PARTICIPANTS WHO
WOULD BENEFIT: Researchers interested in learning
more about the NNT concept which has been referred to as the “currency of
Evidence Based Medicine”, and its potential role in economic evaluations.
The NNT — the reciprocal of
the absolute risk reduction — was introduced in 1988 as an “easily understood
yardstick to describe the harm as well as the benefit of therapy and other
clinical maneuvers”. Although presented as a tool to facilitate clinical
decision-making, its use in public decision-making was already hinted at in
this first publication. The NNT has since been portrayed as a first
approximation to more complex measures such as cost-utility ratios, which are
considered the ultimate goal of Evidence Based Medicine, and NNT-based league
tables have been presented. In this workshop we will review the origin and
properties of the NNT and evaluate whether it indeed meets the criteria of a
useful decision-making tool: comparative, easy to understand and calculate,
standardized. Although the first three criteria appear to be met, we will
demonstrate how the modifications proposed over the years to address the
shortcomings of the original NNT in terms of standardization (i.e., time
horizon, reference risk, comparator and outcome considered) have greatly
increased its complexity while major issues of standardization remain.
Throughout this critical evaluation phase, direct input from the workshop
participants will be solicited. We will conclude by presenting our approach
to calculate an “adjusted” NNT for public health use.
WW3
BEYOND
COST-EFFECTIVENESS: THE STRATEGIC VALUE OF PRODUCTIVITY-RELATED OUTCOMES IN
CLINICAL TRIALS, BURDEN OF ILLNESS STUDIES, AND POST-MARKETING RESEARCH
Ozminkowski RJ1, Goetzel RZ2,
Crown WC3, Long SR2
1The
MEDSTAT Group, Inc, Ann Arbor, MI, USA; 2The MEDSTAT Group, Inc,
Washington, DC, USA; 3The MEDSTAT Group, Inc, Cambridge, MA, USA
OBJECTIVES: This
workshop will describe the need for and value of information on productivity
measures so researchers can provide a more complete assessment of the impact
of interventions covered in clinical trials, burden of illness studies, and
post-marketing research.
PARTICIPANTS WHO
WOULD BENEFIT: Sponsors of clinical trials, burden
of illness studies, and post-marketing research; Employers who offer medical
care benefits and other benefit programs; Outcomes researchers; Drug
formulary developers; Regulators.
Until recently, productivity
at work has been overlooked as a measure of value in clinical trials, burden
of illness studies, and post-marketing research. However, recent advances in
data development capabilities and market pressures to differentiate the
plethora of drugs either under development or on the market have motivated a
concern for a broader set of relevant outcome measures. In addition, concerns
over the ability to document the total impact of drug therapy have emerged as
important issues, as pharmaceutical developers, health care providers,
employers, formulary developers, and policy makers strive to fully understand
their own or society’s return on investment in drug therapy. Recent evidence
suggests that, among leading employers in the U.S., productivity-related
metrics account for more than half (53%) of the cost of employer benefit
programs. In Europe, rigorously developed and supportable claims about the
impact of drugs under development or already marketed can influence the drug
approval process. In the U.S. and elsewhere, such evidence may influence
initial and subsequent formulary decisions, and the appropriate use of
alternative drug therapies. This workshop will illustrate how to 1) identify
productivity-related metrics, 2) collect and process data on these metrics,
and 3) use these data in sophisticated research studies designed for clinical
trials, to document the full burden of illness, or to legitimately support
post-marketing claims of the effectiveness of drug therapy. It will be shown
that better decisions can be made by incorporating a more complete set of
relevant outcome measures.
WW4
THE ROLE OF
EXTRAPOLATION IN ECONOMIC EVALUATION: APPLICATION OF TECHNIQUES TO MEET
EMERGING REQUIREMENTS
Drummond MF1, McGuire A2,
Chancellor JV3
1University
of York, York, UK; 2City University London, London, UK; 3Innovus
Research (UK) Ltd, Amersham, UK
OBJECTIVES: The
workshop will explore the practical implications of the expectation of
technology assessment agencies, such as NICE, for cost effectiveness studies
based on final end-points, such as life years gained or QALYs, when only
intermediate outcomes or survival data collected within a short time-frame
are available. Quantitative methods for the extrapolation of these data to
final outcomes will be described and issues surrounding the acceptability and
use of such data will be explored.
PARTICIPANTS WHO
WOULD BENEFIT: Researchers concerned with the
generation of economic evidence to support the acceptance of new
technologies.
Economic evaluations ideally
require data on final outcomes measured over a reasonable period. This
sentiment is reflected in many of the official guidelines for undertaking
studies. However, at the time of product launch, data are available only for
intermediate outcomes, (e.g. percentage change in cholesterol), or final
outcomes are measured over only a short time period (e.g. months rather than
years). How can those concerned with generating evidence to support early
acceptance of new technologies reconcile this apparent conflict between
expectations and reality? The workshop will explore the calculation of life
years gained through analysis of non-parametric actuarial survival curves,
using two worked examples. One example will use data from a published
epidemiological cohort study of smokers to show how life expectancy varies
according to the age at which smokers successfully quit. The second example,
drawn from clinical trial data, estimates average life expectancy using the
"area under the curve" approach. Methods for extrapolation beyond the end of
the trial period will also be discussed. The workshop will conclude with a
discussion of the guidance about extrapolation offered in various official
guidelines for economic evaluation.
WW5
RESPONSIVENESS OF
PATIENT REPORTED OUTCOMES IN CLINICAL TRIALS: ISSUES, ASSESSMENT STRATEGY,
AND INTERPRETATION
Arnould B, De la Loge C, Marquis P
Mapi Values, Lyon, France
OBJECTIVES:
The objective of the workshop is to present and discuss methods to assess and
interpret the responsiveness of PRO measures and its links with the clinical
validity. The discussion will be put on the specific context of the analysis
of a PRO measure in a Clinical Trial for a claim.
PARTICIPANTS WHO
WOULD BENEFIT: Methodologists, Clinicians and
Researchers designing and/or analysing PRO measures in Clinical Trials.
Recent meetings with Health
Authorities have shown the value of Patients Reported Outcomes (PRO) as end
points in clinical trials (CTs). Nevertheless, application of the proper
analysis strategy is essential to reach the requested level of evidence.
Understanding the relationship between clinical outcomes and PRO in the
treatment of a particular disease is central in this strategy. We will first
review and present the concept of clinical validity and responsiveness and
their relationships. Key references articles will support discussion. We will
then consider concrete issues when moving from theory to practice, with
examples from recent work performed on specific and generic instruments in
different therapeutic areas (Gastroenterology, Central Nervous System,
Cardio-Vascular, Cancer). Successes and failures will be analysed and
discussed. The focus will be put on possible reasons for poor responses or
biases such as true placebo effect, care effect, Hawthorne effect, non-linear
response. The validity of clinical measures to determine responsiveness will
be discussed as well. Based on our experience we will propose a set of
analyses to be conducted on the CT data before unblinding. The potential
interest of different statistical techniques such as structural modeling or
multiple factor analysis will be discussed. In conclusion, a conceptual model
describing the impact of the disease and its treatment on the PRO is a
prerequisite for the interpretation of the changes in scores. This will
increase the credibility and validity of the results when requesting for a
claim.
WW6
HOW TO DEAL WITH
MULTIPLE OUTCOME MEASURES IN CLINICAL STUDIES?
Krabbe PF1, Novák A2
1University
Medical Centre Nijmegen, Nijmegen, Netherlands; 2NV Organon, Oss,
Netherlands
OBJECTIVES: To explain
various strategies to integrate multiple outcome measures in order to express
the overall effect of medical interventions in clinical trials.
PARTICIPANTS WHO
WOULD BENEFIT: All researchers who are involved in
the analysis, interpretation and presentation of outcomes of clinical studies
as well as reviewers of clinical evidence.
Often there is not one
exclusive outcome measure in a clinical trial that is adequate to assess the
global effect of a medical intervention. We are frequently confronted with
several distinct outcome measures (survival, clinical indicators, health
status, adverse events), each providing specific and equally important
information. As an example can be given the combination of two distinct
outcome measures, quantity and quality of life, into a single measure based
on the quality-adjusted life year (QALY). For the computation of QALYs,
individual preference scores expressing health status are used. An
alternative approach is the Q-TWIST method, distinguishing a limited number
of distinct clinical health states. Each of these health states is assigned a
preference score, and the proportion of patients in each health state at a
specific time period is estimated, based on empirical survival curves.
Moreover, depending on the study design and the disease of interest, we have
to deal with dropout, missing values, repeated measurements, confounding
factors and mortality. This workshop will provide an overview of the current
analytic techniques to approach multiple outcome measures in clinical trials
and their effectiveness. Based on the findings, we will demonstrate proposed
analytic strategies to combine health status, survival, dropout and repeated
measurements. In this workshop we will illustrate these analytical strategies
by data from clinical studies in rheumatoid arthritis, psoriasis and heroin
addiction. An interactive part of this workshop will consist of a comparison
between two different analytic strategies on cost-effectiveness analysis.
WW7
WHICH DATA CAN WE
GET? – THE EFFECT OF ELECTRONIC PATIENT RECORDS AND SECURITY REQUIREMENTS ON
DATA AVAILABILITY
Almarsdottir A, Thorhallsdottir I,
Heimisdottir M
deCODE genetics Inc,
Reykjavik, Iceland
OBJECTIVES:
The purpose of this workshop is to further the understanding of data
requirements, security, and privacy issues in health care databases.
PARTICIPANTS WHO
WOULD BENEFIT: All pharmacoeconomics and outcomes
researchers who are interested in new developments in secondary health care
data availability and wish to learn specifically about data requirements,
security and privacy issues in health care databases.
Health care researchers have
increased access to clinical data as electronic patient records (EPRs) are
implemented. The possibilities for linkage of diverse databases enables the
study of complex research questions utilizing new methods. With the advent of
stricter privacy rules globally researchers are increasingly faced with data
security and patient privacy issues. In the first part of the workshop
leaders will provide ideas of data requirements for EPRs. Sophisticated
classification and coding schemas as an integral part of an EPR are a
prerequisite for the successful development of clinical databases as they
enable large scale collection of standardized clinical data suitable for
observational research. The participants will be asked to formulate ideas of
data requirements of pharmacoeconomic and outcomes studies and how EPRs need
to be developed to meet these needs. In the second part, the methods employed
in building a clinical health care database in Iceland are shown. Issues of
database security and patient privacy will be discussed as examples of new
developments in the field of health care databases.

SESSION II - Monday 12
November 2001
WW8
THE AMCP FORMULARY
SUBMISSION FORMAT: IMPLICATIONS FOR PHARMACOECONOMIC RESEARCH PROGRAMS
Mauskopf JA1, Hocker SC2
1RTI
Health Solutions, Research Triangle Park, NC, USA; 2PAREXEL
International, Baltimore, MD, USA
OBJECTIVES: The goal
of this workshop is to review the recently promulgated guidelines for
formulary submissions by the Academy of Managed Care Pharmacy in the US and
to determine the implications for pharmacoeconomic research programs by
companies planning to submit new products to US health plans for
reimbursement.
PARTICIPANTS WHO
WOULD BENEFIT: 1. Health economics personnel
participating in clinical development teams 2. Clinical and marketing
personnel participating in clinical development teams 3. European health
economics academicians interested in keeping abreast of global developments
in the use of health economics for decision making.
The goal of this workshop is
to review the recently promulgated guidelines for formulary submissions by
the Academy of Managed Care Pharmacy in the US and to determine the
implications for pharmacoeconomic research programs by companies planning to
submit new products to US health plans for reimbursement. Although the US has
a fragmented health care system, it is likely that the AMCP guidelines for
formulary submission will be broadly adopted by US health care plans. The
guidelines include requirements for pharmacoeconomic evaluations of new
drugs. Because of the size of the US market, it is important for company
personnel to understand these new guidelines so that they can ensure that
their clinical development program will result in data that will satisfy
these requirements. The review of the guidelines will indicate what type of
economic evaluations are desired (e.g. cost-consequence, cost-effectiveness,
cost-utility), what data sources are preferable (e.g. random controlled
clinical trials, meta-analyses, extrapolation from multiple data sources),
and how different population subgroups should be treated. Examples of changes
in typical pharmacoeconomic research programs will be developed in an
interactive session with the workshop participants using specific disease
examples such as schizophrenia and community acquired pneumonia.
WW9
BUILDING A
PHARMACOECONOMIC STRATEGY FOR A PRODUCT
Chambers MG1, Nuijten MJ2
1MEDTAP
International, London, UK; 2MEDTAP International, Jisp,
Netherlands
OBJECTIVES: By means
of a case study and working in small groups, to explore the process of
developing a pharmacoeconomic strategy for a product under development.
PARTICIPANTS WHO
WOULD BENEFIT: Those wishing to understand more
about the process of defining and commissioning pharmacoeconomic activities
by the pharmaceutical industry.
Pharmacoeconomic and other
health outcomes activities undertaken by pharmaceutical companies are usually
devised to fit into a strategy for development of each product. The selection
and programming of activities depends on the clinical development plan, the
competing products and therapies on or near to market, the potential “value
arguments” which may be supportable for the product and the target audiences
for this information. At an early stage an environmental scan may give
information on the burden of disease and potential market size, and early
“feasibility” modeling may help to explore the economic implications in
different projected levels of effectiveness. Activities undertaken alongside
clinical trials will give information used in submissions for reimbursement
approval and marketing of the product immediately after launch. Modeling may
again be required to project health status and resource use where direct
measurement has not been possible. Post-launch studies may be used to confirm
the value of the product in a real world setting, or to identify patient
groups where cost-effectiveness is particularly favourable. Following a brief
introduction, participants in this workshop will work together in small
groups to plan part of a pharmacoeconomic strategy for a (fictitious) product
being developed to treat cerebrovascular disease. The focus will be on
activities that take place during the later stages of drug development. Tasks
to be undertaken during the workshop will include identification of ‘value
arguments’ based on a briefing to be provided, choosing countries and
audiences for economic messages, justifying data collection activities and
the scheduling of these activities.
WW10
EXPERTS BOARD IN
HEALTH ECONOMICS AND OUTCOMES RESEARCH: INSTRUCTIONS FOR USE
Dinet J, Gabriel S, Cros S, Myon E, Taieb C
Association CRééS,
Fontenay-sous-Bois, France
OBJECTIVES:
The purpose of this workshop is to draw an “instructions for use” of experts
board in health economics and outcomes research. From the definition of an
experts board to the final impact expected, this workshop is the place to
share experiences on this topic between actors, sponsors and the present
audience.
PARTICIPANTS WHO
WOULD BENEFIT: All health economics or outcomes
researchers who wish to ensure to their projects a good credibility with
regard to health authorities and/or scientific or medical community.
Constitution of an
experts board in HEOR has to share common principles between members of the
board, sponsor of the board and future audience of the board. Whatever the
territory where the board plans to work on (local, national or worldwide),
the following items need to be clearly defined to meet objectives initially
targeted. Some of them are proposed thereafter: Definition: experts board is
a way to gather expertise in HEOR and in medical science. This is the place
to orient the HEOR research, to get consensus on responses on key issues of
the project and to gain credibility on the research. Composition: a balance
needs to be found between HEOR experts, public health experts, clinicians and
with regards to the origin of the experts (university, hospital,
institutions, health authorities, CRO, sponsors, patients representative).
Type of Board: Advisory Board, Executive Board, Experts panel or a mix of
each? Scope of work: complete or partial development of HEOR program (HEOR
protocol, analysis plan development, cost of illness studies, economic model
construction, epidemiological data analysis, survival data analysis,
customisation, report development, publication plan). Knowledge of disease
program on management, cost, environment of the disease. Development and/or
interpretation of QoL scale, utility scale, patient/prescriber satisfaction
questionnaire. Communication on these various topics by participation to
publication, symposium, press conference. Organisation: level of implication
of each members (adviser, doer) and decision making process. Moreover, way of
functioning, assets and issues raised by experts board will be presented and
discussed during this workshop: The Association CRééS (Cercle de Réflexion
évaluation économique de la Santé: an association of french speaking
pharmaco-economists) leading the debate.
WW11
THE USE OF
INTEGER/LINEAR PROGRAMMING MODELS IN DECISION MAKING
Earnshaw SR1, Dennett SL2
1RTI
Health Solutions, RTP, NC, USA; 2Eli Lilly, Indianapolis, IN, USA
OBJECTIVES: National, regional, and local health
authorities often need information on efficient health care resource
allocations. Given the multiple factors needing to be considered in an
allocation, this information need can be complex whether allocating a fixed
budget among multiple health interventions in one or several disease areas,
or between health care and non-health care interventions. To evaluate health
care interventions based on factors such as cost effectiveness, and quality
of life, simultaneously, integer and linear programming (ILP/LP) models can
be used. This workshop presents health care decision making using these
concepts.
PARTICIPANTS WHO
WOULD BENEFIT: Health outcomes researchers, health
care decision-makers, and those responsible for resource allocation and
budgeting would benefit from this workshop.
Many types of decision
analytic techniques are used in outcomes research to assist in making health
care resource allocations. ILP/LP models, like decision trees and Markov
processes, are used to make these allocations. Specifically, ILP/LP
complement decision trees and Markov processes in that their outputs can be
used to obtain an optimal resource allocation that considers all feasible
alternatives under all applicable constraints. Proof is in that these models
are used extensively in other industries to achieve objectives such as
minimizing costs and maximizing resource allocation effectiveness. This
workshop presents the use of integer and linear mathematical programs and
their application in health care decision making for health authorities. We
describe their properties, program formulation, and how ILP/LP results can be
applied to various health care decisions. Examples to evaluate and compare
health care and non-health care interventions are presented. The workshop
includes an interactive demonstration of solving these models and
interpreting results.
WW12
BEYOND THE QALY:
USING CONJOINT ANALYSIS TO QUANTIFY HEALTH-CARE PREFERENCES AND EQUIVALENT
MONETARY VALUES
Johnson FR1, Ratcliffe J2
1Research
Triangle Institute, Research Triangle Park, NC, USA; 2Research
Triangle Institute, Manchester, UK
OBJECTIVES:
Participants will learn how to use conjoint analysis to elicit and analyze
patient and public preferences for health-care treatments and how these
estimates relate to QALY measures.
PARTICIPANTS WHO
WOULD BENEFIT: Pharmacoeconomic researchers who are
interested in alternative techniques for measuring the benefits of health
care treatments and products.
Conjoint analysis often is
employed in marketing research, but increasingly also is being used in
outcomes research. This workshop will explore the advantages of conjoint
analysis (CA) approaches in evaluating health outcomes relative to the
standard QALY approach. CA is a stated-preference technique that presents
subjects with a series of scenarios or bundles of treatment characteristics.
Experimental-design considerations guide scenario construction to ensure
statistical independence among characteristics. Subjects then rank, rate or
choose alternatives to indicate their preferences. Unlike other preference
elicitation methods, subjects’ responses can be checked for stability,
consistency, and other utility-theoretic requirements. When correctly
analyzed, these data provide estimates of utility weights useful for
cost-utility analysis and other purposes. If cost is included as a treatment
characteristic, estimated utility weights also can be scaled into monetary
measures of the value to patients. Value to patients is simply the change in
a subject’s income that yields the same increase or decrease in satisfaction.
Selecting appropriate ranges of treatment characteristics in European
health-care systems will be discussed. Participants also will act as subjects
in a simple CA exercise to understand how the method works. Participants will
see examples of applications that illustrate principles of survey design,
show how to cope with subjects’ cognitive limits, demonstrate statistical
analysis, and compare utility and value estimates for pharmaceuticals, health
outcomes, patient satisfaction, longevity, and health delivery mechanisms.
WW13
VISUAL ANALOG
SCALES: DO THEY HAVE A ROLE IN THE MEASUREMENT OF PREFERENCES FOR HEALTH
STATES?
Torrance G1,
Keresteci M2
1McMaster
University, Innovus Research Inc, Burlington, ON, Canada; 2Innovus
Research Inc, Burlington, ON, Canada
OBJECTIVES:
Participants will learn about the visual analog scale (VAS) – theoretical
foundations, measurement biases, bias correction methods, power curve
adjustments, new more restricted and specific roles for the VAS, and a
practical example.
PARTICIPANTS WHO
WOULD BENEFIT: Those who must design, execute,
commission or interpret studies that involve direct utility measurement.
The VAS has long been used
as an instrument for the measurement of health state utilities. It is an
attractive approach because it is simple, quick to administer, and lends
itself to self-completion. Recent findings, however, have raised serious
questions about its validity in all settings. Should its use now be
abandoned? Should its use continue unabated? Or should it be used in more
limited ways? We will argue for the latter. In the workshop we will review
the two theoretical foundations for the VAS – one from decision
sciences/economics and one from psychology/psychophysics. We will review the
three major measurement problems with the VAS – anchor specificity, context
bias and end-aversion bias. Methods of bias correction will be presented.
Power curves to convert VAS scores to utilities will be discussed. Two
appropriate roles for VAS will be suggested – VAS as an introductory task
before standard gamble or time trade-off, and VAS adjusted by a
study-specific power curve with or without debiasing. An example of a VAS in
the latter role will be presented -- a two-stage, self-completion VAS in a
urology application. Participants will be asked to contribute to the workshop
by sharing their own experiences and ideas, and by participating in the
discussion.
WW14
MULTICULTURAL AND
MULTILINGUAL QUALITY OF LIFE INSTRUMENT DEVELOPMENT: A COMPARISON OF
SEQUENTIAL, PARALLEL AND SIMULTANEOUS APPROACHES AND THEIR IMPACT ON
TRANSLATION AND ADAPTATION
Eremenco SL1, Lent L1,
Flood E2
1Evanston
Northwestern Healthcare, Evanston, IL, USA; 2MEDTAP International,
Bethesda, MD, USA
OBJECTIVES: The
purpose of this workshop is to compare three commonly used approaches to
quality of life (QOL) instrument development for cross-cultural studies and
research. An overview of these three approaches to instrument development
will be presented, and examples will be given of development and translation
issues related to each approach.
PARTICIPANTS WHO
WOULD BENEFIT: Pharmacoeconomic researchers who are
interested in multicultural and multilingual instrument development and
translation issues.
Multinational clinical
trials have become a necessity in today's global economy to expedite testing
and approval of new pharmaceutical treatments. As quality of life (QOL)
instruments are used in more clinical trials and research worldwide, the
question of how such instruments were initially developed becomes
increasingly important. Three major questionnaire development approaches have
evolved over the past decades. In the sequential approach, a scale is
developed in one culture and later adapted to other cultures through
translation. In the parallel approach, a scale is developed in multiple
cultures with the goal of deriving a common set of items across countries.
Like the parallel approach, the simultaneous approach begins with
multi-national input in the earliest stages of development but also allows
item content and question format to differ across language versions according
to the cultural and normative experiences of each country. No single approach
is suitable for all situations; therefore the decision of which development
methodology to choose will depend on the purpose of the study and other
practical considerations. Examples of questionnaires developed through each
of these approaches will be presented, along with the impact on the
translation process and on instrument psychometric and equivalence issues.
The interactive portion of this workshop will focus on a discussion of the
advantages and disadvantages of each approach and practical guidelines for
conducting instrument development, translation, adaptation and measurement
across cultures.

SESSION III -
Tuesday 13 November 2001
WW15
IMPLEMENTING THE UK
NICE CONCEPT IN ANOTHER EUROPEAN COUNTRY: NICE TRY OR "SALADE NICOISE"?
Annemans LJ1, Robays H2,
Peys F3
1Ghent
University, HEDM, MEISE, Belgium; 2Ghent
University Hospital, GENT, Belgium; 3BIGE, Zaventem, Belgium
OBJECTIVES: To provide
an overview of the problems that Belgian decision makers faced when deciding
on changing the price and reimbursement policy for pharmaceutical drugs,
inspired by the UK NICE (National Institute of Clinical Excellence)
initiative.
PARTICIPANTS WHO
WOULD BENEFIT: Decision makers on price and
reimbursement, policy makers, researchers conducting studies for price and
reimbursement purposes.
Health economic evaluations
in decisions on price and reimbursement of pharmaceuticals will formally be
applied in Belgium as from January 2002. Belgium has a policy of positive
lists whereby companies must submit a file for decisions on reimbursement.
The preparation of the new policy was inspired by the NICE initiative in the
UK, whereby it was attempted to “learn from the experiences with NICE”.
Several issues occurred: for instance, many of the expected evidence is
predictive and often based on modeling techniques, while the true value of
new drugs can only be assessed in the market. Hence, the decision maker only
wants to adopt new drugs once there is more evidence, while the supplier only
is able to provide real-life evidence once the drug is adopted. An additional
problem is the size of the target population: although, according to priority
setting theory, this size should not play a role in priority decisions, the
budget impact of decisions is obviously affected. Risk sharing and
re-examination after 2-3 years marketing of new drugs were proposed for novel
and improved decision making. Next, it was discussed whether a threshold for
defining cost-effective care must be applied, and whether QALYs were to be
applied. On the procedural level, the issue of independent assessment of the
delivered evidence was raised. The workshop overviews and discusses the
arguments that were used in these and other debates. The participants are
encouraged to suggest alternative scientific and pragmatic arguments.
WW16
ASSESSING
PHARMACOECONOMIC AND QUALITY OF LIFE OUTCOMES IN GLOBAL PATIENT REGISTRIES
Marle C1, Brod M2,
Peeters P1, Sullivan EM3
1Quintiles
Late Phase, Levallois-Perret, France; 2Quintiles Late Phase, San
Francisco, CA, USA; 3Quintiles Late Phase, Boston, MA, USA
OBJECTIVES: The
objective of this workshop is to characterize the challenges associated with
designing, collecting, analyzing and interpreting global pharmacoeconomic and
quality of life (QOL) data collected in outcomes registries. Case examples
from multinational patient registries will be described to discuss these
challenges and potential solutions.
PARTICIPANTS WHO
WOULD BENEFIT: All health outcomes and
pharmacoeconomic researchers interested in learning about design,
methodological, interpretation, and logistical issues associated with
conducting global patient registries.
Pharmacoeconomic and QOL
data are routinely collected in prospective, observational, global outcomes
registries. However, designing global registries to measure health and
pharmacoeconomic outcomes cross culturally poses unique methodological and
logistical challenges to researchers. Standardization of designs and data
collection processes are made difficult due to differences in technologies,
treatment norms, available resources, cultural expectations and
characteristics of the health care system across countries and continents.
Design, methodological and logistical challenges faced by researchers in
implementing global registries will be reviewed in this workshop.
Specifically, cross cultural design issues, methods for handling cultural
variation in perception of disease and treatment-related side effects,
statistical issues regarding pooling of data, and interpretation of QOL
outcomes will be addressed. The measurement and collection of
pharmacoeconomic outcomes from multiple countries also will be discussed. The
guided interactive part of this workshop will focus on designing a
hypothetical global registry that includes QOL and pharmacoeconomic outcomes.
Guidelines for implementing global registries will be presented.
Additionally, real world examples of multinational disease registries will be
reviewed to illustrate potential solutions to global design, measurement,
analytic, interpretation, and logistical challenges.
WW17
COST OF ILLNESS
STUDIES: DO WE STILL NEED THEM?
Chambers MG1, Hutton J2,
Nuijten MJ3
1MEDTAP
International, London, UK; 2MEDTAP International, Inc, London, UK;
3MEDTAP International, Jisp, Netherlands
OBJECTIVES: The
purpose of this workshop is to discuss the continuing popularity of Cost of
Illness (COI) Studies, what value participants attach to them, and how they
are used in practice.
PARTICIPANTS WHO
WOULD BENEFIT: Pharmacoeconomic researchers who
undertake or commission COI studies.
COI studies broadly fall
into two types: ‘prevalence-based’ - where the cost of managing a condition
over a given time period is measured for all those in a given population with
a condition, irrespective of when their treatment started; or
‘incidence-based’ – where the cost of newly treated patients is measured over
a given time-period from treatment initiation. COIs frequently include
estimates of foregone productivity for those suffering from a condition or
undergoing a treatment, as well as direct costs of medical and social care.
COIs have been shown to be of limited value in health care decision making.
By definition they are non-comparative: they do not present information about
the incremental costs of introducing a new therapy, the associated impact on
budgets and changes in health outcomes. In this workshop participants will
explore the reasons why these studies remain popular in the pharmacoeconomic
and clinical literature. Reasons may include: input into drug development
portfolio selection, prioritisation of indications for licensing,
ascertainment of treatment patterns and cost elements for use in future
model-base economic studies; meeting regulatory and local requirements for
burden of disease/care information; creation of ‘noise’ in the market for the
condition of interest. At the outset participants will be asked to complete a
questionnaire asking about their experience and perceptions of the value of
COI studies. Results from this questionnaire will be fed back and used as a
starting point for a structured discussion. Participants will also be asked
if they know of examples where COI analyses have made an important difference
in health care decision-making.
WW18
FATIGUE ASSESSMENT
AS AN OUTCOME IN CANCER CLINICAL TRIALS
Bottomley A,
Flechtner H
On behalf of the EORTC
Quality of Life Group, Brussels, Belgium
OBJECTIVES:
The purpose of this workshop is to provide an overview of fatigue as a
concept of Quality of Life Assessment and explain how it can be integrated
into cancer clinical trials.
PARTICIPANTS WHO
WOULD BENEFIT: All researchers with an interest in
fatigue working in the field of cancer outcome assessment.
Fatigue is undoubtedly one
of the commonest symptoms experienced by cancer patients, presenting a
challenging and complex phenomenon for measurement. The effect of fatigue on
patients’ quality of life (QOL) is considerably influencing most domains.
Repeatedly, studies show that fatigue correlates directly with overall QOL,
greater fatigue often leading to poorer outcomes. Lately a considerable
number of studies stressed the complex problem faced by cancer patients
experiencing fatigue either during or after treatment. Furthermore, fatigue
can continue for many years post treatment and for those patients with
progressive disease, fatigue can lead to a loss of overall QOL that is
extremely limiting. Over the past decade, researchers and clinicians have
become increasingly aware of the negative influence of fatigue on QOL,
devoting considerable time to developing fatigue assessment tools. However,
whatever the reason for the increased interest, researchers are still asking
basic questions "How is fatigue assessed?” “Is there not a gold standard to
measure or compare fatigue?” “What are the key dimensions of fatigue?”
Perhaps researchers should assess fatigue briefly and simply by focusing on a
single question such as "Do you feel tired?" If researchers and clinicians do
choose measures to examine fatigue, should different measures be used with
different cancer patients at different times in the disease cycle? When
information is collected from patients about fatigue, how should researchers
interpret this? For example, what level of score on any given fatigue measure
would suggest clinical intervention? What are the key properties in a fatigue
measurement that researchers should look for? We will explain these issues
and encourage audience involvement in debating fatigue assessment issues.
WW19
MEASURES AND
METHODS FOR ASSESSING PATIENT-REPORTED OUTCOMES
Duffer AP, Fehnel SE
RTI Health Solutions,
Research Triangle Park, NC, USA
OBJECTIVES: The
purpose of this workshop is to provide guidance in instrument selection and
survey design for assessing patient-reported outcomes such as quality of
life, functional status, patient satisfaction, and productivity. A primary
focus will be on helping health outcomes researchers work with clinical
research to design strategies for collecting patient-reported outcomes during
clinical trials that reduce the burden on the sites and clinical monitors.
PARTICIPANTS WHO
WOULD BENEFIT: Anyone who wants to learn more about
developing strategies for the measurement of patient-reported outcomes and
the survey methods used to collect these data could benefit from this
workshop. Health outcomes researchers charged with collecting
patient-reported outcomes, either within or independent of clinical trials,
are likely to benefit most.
This workshop will begin
with an overview of what patient-reported outcomes are and how they are
measured. To illustrate the range of instruments available for assessing just
one such outcome, we will briefly describe the three major categories of
quality of life measures, including disease- or condition-specific
questionnaires, generic health profiles and generic preference-based
measures. Guidelines will then be offered to assist in developing a
measurement strategy that is appropriate for the goals of the research.
Issues for consideration include the type of instrument to be used, the
psychometric properties of the various options, the cognitive complexity of
the items and formatting (if self-administered), the availability of
translations, flexibility regarding the mode of administration, and previous
research involving the population and therapeutic area under study. The
discussion will then shift to techniques for collecting survey data with
special attention to the reduction of missing data that results from item and
survey nonresponse. The benefits and potential drawbacks to collecting
information from patients through mail, telephone, computer-assisted, and
Web-based surveys will be described as well as the use of panel maintenance
and tracking methods to reduce the number of patients lost to follow-up.
Recommendations will then be offered to assist attendees in choosing the
optimal mode of administration, depending on the context and ultimate purpose
of the survey.
WW20
ITEM RESPONSE
THEORY AND ITS APPLICATIONS TO HEALTH OUTCOMES MEASUREMENT
Chang C-H, Cella D
Evanston Northwestern
Healthcare and Northwestern University, Evanston, IL, USA
OBJECTIVES: The
purpose of this workshop is to provide an overview of different item response
theory (IRT) models and their applications in health outcomes research.
IRT-based software outputs for each specific model using empirical data will
be illustrated. Guidelines for model selection will also be provided.
PARTICIPANTS WHO
WOULD BENEFIT: All quality of life and outcomes
researchers who are interested in IRT models and applications.
Although item response
theory (IRT) models have been developed and widely used in educational and
psychological testing for several decades, their use in healthcare settings
has just mushroomed. Theoretical sound IRT models coupled with available
software make it possible for outcomes researchers to develop and refine
outcomes assessment instruments for use in clinical trials and research. This
workshop will provide an overview of IRT models and how they can be
appropriately applied to health outcomes assessment. Specifically, this
workshop will discuss the following topics: 1) dichotomous versus polytomous
models; 2) unidimensional versus multidimensional models; 3) scale
construction; 4) exploratory vs. confirmatory item-level factor analysis; 5)
instrument equating; 6) differential item functioning; 7) item banking and
computerized adaptive testing; and 8) software availability. Examples using
empirical data and annotated computer output will be provided and discussed.
Guidelines to the selection of models and software will also be provided.

SESSION IV-
Tuesday 13 November 2001
WW21
MAXIMIZING THE
SCIENTIFIC AND STRATEGIC VALUE OF PATIENT REGISTRIES
Trotter J, Larson L, Vreeland MG
Ovation Research Group,
Highland Park, IL, USA
OBJECTIVES: This
workshop will establish patient registries’ ability to capture real-world
clinical, economic, and humanistic data, and to demonstrate the need for the
health economics community to play a leading role in these research
initiatives. The workshop will establish the scientific and strategic goals
underlying patient registries, examine the role of registries relative to
other pharmacoeconomic approaches, and present an approach for their
development and implementation.
PARTICIPANTS WHO
WOULD BENEFIT: Health economists seeking to better
understand patient registries and their advantages relative to other outcomes
research initiatives.
The objectives underlying
industry-sponsored patient registries — typically large, observational,
prospective research programs involving data collected from physicians and,
often, directly from patients — vary from safety surveillance to market
penetration. Accordingly, these programs are designed and implemented by
staff with a broad range of responsibilities, from marketing and product
management to clinical research. The most successful patient registries
achieve strategic value for the sponsor while serving as a vehicle for
scientific exploration into the clinical, economic, and humanistic impact of
a drug, device, or disease state. As such, outcomes researchers should — but
seldom do — play a central role in the development of registries. This
workshop will begin with an interactive discussion focusing on the audience’s
knowledge of and experience with patient registries. The workshop will then
present brief case studies of several existing registry programs and their
respective histories, achievements, and successes. A four-step approach for
designing and executing patient registries will be presented, including
techniques employing state-of-the-art technologies for data collection and
communications. The workshop will conclude with suggestions for bringing
coordination of patient registries under the authority of health economics
and outcomes research departments.
WW22
HEALTHCARE DATABASE
AS A SERVICE CONTRACTING TOOL – BETWEEN INFORMATION DESERT AND INFORMATION
FLOOD: EXPERIENCE OF POLISH HEALTH CARE SYSTEM REFORM
Sosnierz A, Jendroszczyk J, Makselon-Jarzabek
A
Silesian Regional Sickness
Fund, Katowice, Poland
OBJECTIVES: The
purpose of the workshop is to present and discuss advantages and possible
risks of computer network database (in this case used to monitor hospital
service market). The question: how close the database “mirror” the reality?
PARTICIPANTS WHO
WOULD BENEFIT: all who use or plan to use
healthcare database (in research or in “practice”), to learn strengths and
weaknesses of the databases.
The health care system
reform that has been introduced in Poland is an attempt to base health
service provision on market competition between service providers. The
pivotal element of the new system is an institution of independent sickness
fund that is responsible for purchasing health service. The Silesian Regional
Sickness Fund (insures 5 million members) established computer network
linking all the contracted hospitals. The information from the database is
used to “watch” the medical services. Hospitals report information on patient
age, gender, place of living, performed procedures, disease (plus
co-morbidity), length of hospitalisation, places of treatment, result of
treatment, etc. Logical and medical coherence of the data is checked. But
coherent information not necessarily means true one. There is danger that
road leading from information desert to information ocean may end up in
virtual reality. The data flows smoothly, the quality of the information is
checked, its coherence controlled but results of the analyses are sometimes
unexpected - enormous mortality rate differences in regions or cardiology
hospitals (from 6% in one university hospital to 14% in the other), patients
“transferred” between hospitals (artificial costs creation), strange stroke
patient population structure, etc. We discover facts or we are too
information greedy and create “own” reality?
WW23
INCONGRUITY BETWEEN
THE USE OF HEALTH ECONOMIC ANALYIS AND BUDGETARY IMPACT ANALYSIS
Hutton J1, Engelfriet P2,
Brown R1, Nuijten M2
1Medtap
International, London, England; 2Medtap International, Jisp,
Netherlands
OBJECTIVES: The
purpose of this workshop is to discuss the implications of the use of health
economic and budgetary impact data in the reimbursement process for
pharmaceuticals.
PARTICIPANTS WHO
WOULD BENEFIT: Those responsible for pricing and
reimbursement of new drugs at local and global offices of pharmaceutical
industry, and decision makers using economic and financial data.
Carrying out studies
according to a pharmacoeconomic guidelines should promote the provision of
reliable, reproducible and verifiable insight into the therapeutic value of a
drug, the costs involved in using the drug and the possible savings that can
be made on other drugs and/or therapies. For policy-making, apart from the
cost-effectiveness of a drug, the consequences for the macro-costs are also
important: for this purpose a financial analysis is used. A financial
analysis must provide insight into all the financial consequences of the
introduction of a new drug. If the financial analysis is going to play a
fundamental role in reimbursement decisions comparable with pharmacoeconomic
analysis, it is vital that the methods and procedures used in such
evaluations are as carefully scrutinised and refined. Finally the weight of
the relationship between the pharmacoeconomic and budgetary impact data in
the decision making process needs to be defined. The workshop will
concentrate on the UK and The Netherlands, but is also relevant for most of
the other West-European countries. We will start with a description of the
differences between health economic and budgetary impact analyses:
(perspective, time horizon, outcomes), which may lead to conflicting
situations. In this workshop following a brief introduction, participants
will discuss the differences between health economic and budgetary impact
analyses. Tasks to be undertaken will be to identify the potential conflict
between both types of data, and explore possible solutions in the light of
participants' experiences with submissions in the absence of detailed budget
impact analysis guidance.
WW24
USING PROPENSITY
SCORES TO ADJUST FOR TREATMENT SELECTION BIAS: REVIEW OF METHODS PLUS AN
EXTENSION FOR USE IN STUDIES WITH THREE OR MORE TREATMENT GROUPS
Irish W, Neighbors D, Lopez R
RTI Health Solutions,
Research Triangle Park, NC, USA
OBJECTIVES: To give
participants an intuitive understanding of treatment selection bias,
propensity scores, and methods to reduce treatment selection bias using
propensity scores; and to present an extension of standard propensity score
methods to comparative studies of three or more interventions.
PARTICIPANTS WHO
WOULD BENEFIT: Pharmacoeconomic researchers who are
responsible for designing non-randomized studies of healthcare interventions
and healthcare decisionmakers who are responsible for evaluating and
interpreting the results of those studies.
In non-randomized studies,
differences in patient characteristics can influence treatment selection
which, in turn, can lead to biased estimates of treatment effects. Propensity
scores are one technique to address treatment selection bias. A propensity
score is the probability that a patient will be assigned to a particular
treatment or intervention. Typically, a logistic regression analysis is used
to estimate a patient’s probability for receiving Intervention A (versus
Intervention B) using observed pre-treatment characteristics. Propensity
scores may be used in at least three ways to reduce treatment selection bias:
(1) matching, (2) stratification; and (3) adjustment in regression analysis.
Most published applications of propensity scores to reduce treatment
selection bias are applied in studies comparing two interventions. Through
the use of multinomial logistic regression analysis, we extend the
two-treatment paradigm to include the evaluation of three interventions on
health outcomes. The guided interactive part of the workshop will use a case
study involving patients with schizophrenia or schizoaffective disorder.
Participants will be invited to brainstorm factors that might influence
selection of an atypical antipsychotic for the treatment of schizophrenia.
Participants will also be asked to critique an actual propensity score model
developed in this disease area.
WW25
HEALTH-RELATED
QUALITY OF LIFE MEASUREMENT: A SYSTEMATIC APPROACH TO SELECTING AN ASSESSMENT
STRATEGY
Erickson P
PSU and The On-Line Guide to
Quality-of-Life Assessment (OLGA), State College, PA, USA
OBJECTIVES:
This workshop develops basic skills for evaluating alternative health status
and quality of life instruments to be used in assessing health outcomes and
health-related quality of life in clinical trials and pharmacoeconomic
studies. Key to the selection of relevant measures is the adoption of a
systematic approach for evaluating questionnaires, rating scales and
classification systems for use, singly or in combination, in different types
of studies. We will present and discuss an approach that includes essential
elements in the instrument selection process, including issues in specifying
purpose of study and target population, identifying relevant domains to
satisfy these study parameters, and evaluating measurement properties to
assure meaningful results.
PARTICIPANTS WHO
WOULD BENEFIT: Pharmacoeconomic and health outcomes
researchers who want to increase their understanding of the issues involved
in selecting meaningful and responsive quality of life instruments for use in
clinical trials and other evaluative studies
Health outcomes and
quality-of-life assessment is becoming increasingly important in the
evaluation of pharmaceutical products, in terms of labeling claims and
product promotion as well as in terms of formulary decisions. Each of these
applications requires an assessment strategy that provides information
relevant for decision-making. How is a successful assessment strategy
developed? What criteria, including reliability, validity and responsiveness,
should be used when evaluating instruments for use in a clinical trial or
pharmacoeconomic study? This workshop will address these questions and
introduce an analytic framework that participants can apply in their daily
experience.
WW26
METHODOLOGICAL
ISSUES OF DESIGNING QUALITY OF LIFE IN CANCER CLINICAL TRIALS
Bottomley A, Flechtner H
On behalf of the EORTC
Quality of Life Group, Brussels, Belgium
OBJECTIVES: To provide
an introduction in designing QL protocols in cancer clinical trials.
PARTICIPANTS WHO
WOULD BENEFIT: All outcomes researchers who have a
limited knowledge of developing cancer clinical trial protocols.
Quality of life (QL) is an
increasingly important outcome in clinical trials. In the future we expect QL
to be regarded as a standard endpoint, both primary and secondary in many
trials and the key to helping prove the value of treatments. Regulatory
authorities are now seeing the value of QL in many therapeutic areas. It is
clear that it will become over the coming years an important aspect of
approval for new drugs as well as in labeling and promotional claims.
However, while this may be the case, the field of QL assessment is fraught
with many challenges, in particular relative to the design and collection of
good quality data. Therefore, the following presentations highlight the
challenges that face researchers when designing clinical trials and
collecting data. The first presentation discusses the definitions of QL and
provides a basic overview of how to design a robust QL study in a cancer
clinical trial, based on developments at the EORTC. Emphasis will be placed
on explaining key issues such as selecting measures, timing of assessment,
dealing with missing data and reporting the results that one must consider
when designing such studies within large Phase III clinical trials. The
second presentation will focus on putting these methodological issues into
practice and reporting on ongoing study protocols undertaken with Hodgkin’s
disease patients on active treatment. After training, we will expect the
audience to be able to contribute to developing a Phase III clinical trial
and have some ideas on how to design the QL component of a cancer clinical
trial.
|