The Official News & Technical Journal Of The International Society For Pharmacoeconomics And Outcomes Research

ISPOR Comments on the Guidance for Industry - Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims

Introduction by Judith Barr ScD, ISPOR Patient Reported Outcomes Special Interest Group Chair and Associate Professor and Director, Northeastern University, National Education and Research Center for Outcomes Assessment, Boston, MA, USA

On February 2, 2006, the U.S. Food and Drug Administration (FDA) issued guidance for industry on “Patient-reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims”. The intent of this Guidance is to provide standards to the pharmaceutical industry concerning the psychometric properties and procedures that will be expected by the FDA as it reviews submitted data to support PRO labeling claims. The Guidance also describes a “Target Product Profile” process by which the sponsor identifies the desired language for the label and then, using psychometrically valid and reliable instruments, links the target label language to a source of data.

ISPOR asked members to comment on this draft guidance. More than 50 comments were received from 12 countries. Thirty-six percent of the responses were from academia, 22% from research institutions, and 42% from pharmaceutical companies. These comments were summarized by members of the Patient- Reported Outcomes Special Interest Group following a series of conference calls.

The ISPOR PRO SIG response was in four parts. The first, the cover letter, applauded the FDA’s definition of “treatment benefit”, but cautions that the proposed “gold standards” for all PRO instruments may paradoxically result in reliance on more limited, uni-dimensional measures. The FDA was requested to clarify its PRO standards, and to apply equal standards to biologic markers and physician/caregiver reports. Additionally the cover letter highlighted three major issue: 1) ideal versus acceptable level of psychometric quality; 2) rigor of requirements for modifying existing PRO instruments; and 3) premature emphasis on minimal important difference, given the current state of the science.

The second through fourth parts of the ISPOR PRO SIG comments insured transparency of the ISPOR response. The second component consists of the working group’s synthesis of all comments organized by section; the third, the 50-plus verbatim responses, anonymized, and organized by Guidance section and line; and the fourth, the name and affiliation of all responders unlinked from their comments.

To view the ISPOR comments, see: http://www.ispor.org/workpaper/ISPOR%20Response%20to%20FDA%20PRO%20Guidance.pdf. The response was coordinated by the Patient-Reported Outcomes Special Interest Group Task Force Working Group Chairs and its PRO/Quality of Life Information in Regulatory and Health Decisions Working Group. Signers of this letter are the members of this group who participated in the response effort. The letter noted that the comments do not necessarily reflect the views of the broader ISPOR membership.

 

Division of Dockets Management (HFA-305)                                                         April 4, 2006
Food and Drug Administration
5630 Fishers Lane, Room 1061
Rockville, MD 20852

Re: Guidance for Industry - Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims [Docket No. 2006D-0044]

Dear Captain Burke:

Thank you for the opportunity to comment on the proposed FDA Guidance for Industry - Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims.

The International Society for Pharmacoeconomics and Outcomes Research (ISPOR) is an international organization pro-moting the science of pharmacoeconomics and health outcomes research and is organized to act as a scientific leader rele-vant to research in pharmacoeconomics, health outcomes assessment including patient-reported outcomes, and related issuesof public policy. The Society represents healthcare researchers and practitioners including pharmacists, physicians, economists, nurses and researchers from academia, pharmaceutical industry, government, managed care, health research organizations, and purchasers of healthcare.

More than 700 ISPOR members are interested in patient-reported outcomes (PRO); and nearly 50 members provided comments and suggestions to this Patient-Reported Outcomes Guidance. The ISPOR members commenting on this guidancecame from academia (36%), research organizations (22%), and pharmaceutical/medical device/diagnostic/biotech industry(42%). Comments were received from 12 countries, indicating the world-wide effect of this FDA PRO guidance on PROresearch. This summary was developed by the ISPOR PRO Special Interest Group (SIG).

Overall, The Guidance is a comprehensive document reflecting the current state of the art of PRO questionnaire development,validation, and implementation in clinical research and analysis. The FDA PRO Guidance makes a major policy statementconcerning the role of the patient, and patient reported outcomes, in the drug approval process. ISPOR applauds the FDA’sdefinition of “treatment benefit” as “An improvement in how a patient survives, feels, or functions as a result of treatment.”This focus will provide a balance between the traditional biologic and physiologic markers and outcomes that directly measure impact to the patient, as reported by the patient.

However, the “gold standard” proposed by the guidance for questionnaire development may be very difficult to achieve forevery instrument, particularly multi-dimensional instruments. The desire to comprehensively collect patient reported out-comes in clinical trials, through the use of developed and validated instruments, may be thwarted when the previous valida-tion procedures do not meet the proposed FDA “gold standard” level. The intent of the guidance to encourage more compre-hensive and careful inclusion of PRO may paradoxically result in a reliance on more limited patient input through the use ofone-dimensional, symptomatic measures.

As the FDA clarifies its standards for PRO measures, ISPOR strongly suggests that it also examine its requirements for the psy-chometric performance of other endpoint measures such as clinical and biologic markers and physician/caregiver reports. In this way consistency of criteria will be ensured across measurement methods.

A summary of comments by section are given in the attached document, which includes specific comments by section, line orpage, and person commenting as well as institution. The following are key issues to be addressed in the FDA PRO Guidance:

  • Issue One: the guidance states ideal requirements which may be difficult to meet in every case. Practical or non-consensual methodological issues such as the determination of the MID are not discussed. We strongly recommend inclusion ofadditional language clarifying that review of PRO data and supporting information about PRO measures will be based onthe body of evidence provided and that the FDA recognizes that an acceptable level of evidence may include less than thefull set of criteria outlined as best practice in the Guidance.
  • Issue Two: considering any modification of an instrument as a new instrument may be too strict in the majority ofcases. Minor modifications or translation of instruments should not be considered as new and therefore should not requirea complete “revalidation. We recommend inclusion in the Guidance of examples of the types of evidence, short of full validation, that could be acceptable for modifications of existing instruments (e.g., cognitive interviews with patients).
  • Issue Three: the determination of the MID is given prominence in the discussion of interpretation of results. The currentlack of consensus in the field regarding the value of MID and the best methods for establishing it make emphasis on MIDwithin the Guidance inappropriate at this time. We recommend inclusion of language to indicate that MID is just one ofmany methods to aid interpretation and that choice of methods should match individual submission requirements.

Finally, we would urge that FDA consider the addition of language to emphasize that the document reflects ideal requirements which have to be evaluated in light of methodological and practical issues.

ISPOR would be interested in providing a forum to address these specific issues.

 


  Issues Index | 2006 Issues Index  

Contact ISPOR @ info@ispor.org  |  View Legal Disclaimer
©2010 International Society for Pharmacoeconomics and Outcomes Research.
All rights reserved under International and Pan-American Copyright Conventions.
 
Website design by Eagle Systems USA, Inc.