EVALUATING AND IMPROVING METHODS FOR COGNITIVE DEBRIEFING PRO QUESTIONNAIRES

Author(s)

Stokes J;Yaworsky A;Galipeau N;Pompilus F;Foley C;Lamoureux R;Iovin R, Shields A* Adelphi Values, Boston, MA, USA

OBJECTIVES: Cognitive debriefing is critical to the content validity of patient-reported outcome (PRO) questionnaires.  The goal of this poster is to evaluate the time needed to adequately debrief PRO questionnaires and to generate a set of questions that could facilitate the timely and successful completion of cognitive debriefing interviews. METHODS:  To evaluate cognitive debriefing methods, two research activities were conducted. First, a time-to-complete analysis was conducted using n=44 audio-recorded patient interviews to understand how much time was required to debrief single PRO items. Next, select studies (n=15) were reviewed to document the researcher stated objectives of their cognitive debriefing activities.  This list of objectives was used to inform a set of questions that could be asked of patients during debriefing to accomplish those objectives.  RESULTS: The time-to-complete analysis showed that single questionnaire items required approximately 5 minutes and 45 seconds to be fully debriefed. Primary objectives of cognitive debriefing interviews included the evaluation of a) patients’ interpretation of the instructions, items, and response options relative to questionnaire developer’s intentions; b) the extent to which item concepts assessed in the questionnaire are comprehensive to the general concept of measurement; c) item language that reflects patient experience, and d) response options as representative of patient health status. CONCLUSIONS: Results suggest that it takes approximately 60 minutes to fully debrief a PRO questionnaire constructed of 10 items. Though longer interviews are possible, interviews lasting longer than 60 minutes may produce data of poor quality due to patient fatigue. Therefore, debriefing studies require clearly stated objectives along with targeted questions to help the interviewer successfully and efficiently meet those objectives.  The interview questions discussed in this poster can be used by researchers to facilitate the timely and targeted completion of cognitive debriefing interviews for the purpose of supporting content validity of a PRO questionnaire.

Conference/Value in Health Info

2013-05, ISPOR 2013, New Orleans, LA, USA

Value in Health, Vol. 16, No. 3 (May 2013)

Code

PRM186

Topic

Economic Evaluation, Methodological & Statistical Research, Study Approaches

Topic Subcategory

Cost-comparison, Effectiveness, Utility, Benefit Analysis, PRO & Related Methods

Disease

Multiple Diseases

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×