EVALUATING AND IMPROVING METHODS FOR COGNITIVE DEBRIEFING PRO QUESTIONNAIRES
Author(s)
Stokes J;Yaworsky A;Galipeau N;Pompilus F;Foley C;Lamoureux R;Iovin R, Shields A* Adelphi Values, Boston, MA, USA
Presentation Documents
OBJECTIVES: Cognitive debriefing is critical to the content validity of patient-reported outcome (PRO) questionnaires. The goal of this poster is to evaluate the time needed to adequately debrief PRO questionnaires and to generate a set of questions that could facilitate the timely and successful completion of cognitive debriefing interviews. METHODS: To evaluate cognitive debriefing methods, two research activities were conducted. First, a time-to-complete analysis was conducted using n=44 audio-recorded patient interviews to understand how much time was required to debrief single PRO items. Next, select studies (n=15) were reviewed to document the researcher stated objectives of their cognitive debriefing activities. This list of objectives was used to inform a set of questions that could be asked of patients during debriefing to accomplish those objectives. RESULTS: The time-to-complete analysis showed that single questionnaire items required approximately 5 minutes and 45 seconds to be fully debriefed. Primary objectives of cognitive debriefing interviews included the evaluation of a) patients’ interpretation of the instructions, items, and response options relative to questionnaire developer’s intentions; b) the extent to which item concepts assessed in the questionnaire are comprehensive to the general concept of measurement; c) item language that reflects patient experience, and d) response options as representative of patient health status. CONCLUSIONS: Results suggest that it takes approximately 60 minutes to fully debrief a PRO questionnaire constructed of 10 items. Though longer interviews are possible, interviews lasting longer than 60 minutes may produce data of poor quality due to patient fatigue. Therefore, debriefing studies require clearly stated objectives along with targeted questions to help the interviewer successfully and efficiently meet those objectives. The interview questions discussed in this poster can be used by researchers to facilitate the timely and targeted completion of cognitive debriefing interviews for the purpose of supporting content validity of a PRO questionnaire.
Conference/Value in Health Info
2013-05, ISPOR 2013, New Orleans, LA, USA
Value in Health, Vol. 16, No. 3 (May 2013)
Code
PRM186
Topic
Economic Evaluation, Methodological & Statistical Research, Study Approaches
Topic Subcategory
Cost-comparison, Effectiveness, Utility, Benefit Analysis, PRO & Related Methods
Disease
Multiple Diseases