EXAMINING VARIATIONS IN ITEM STRUCTURE AND CONTENT IN PRO INSTRUMENTS, OR, THERE MUST BE 50 WAYS TO EXPRESS YOUR DISTRESS

Author(s)

Erickson P1, Willke RJ21O.L.G.A., State College, PA, USA, 2Pfizer, Inc., New York, NY, USA

OBJECTIVES: The content validity of an instrument depends not only on the concepts embodied in the items but also on how the items are structured to elicit responses from patients. This research explores the “grammar” of individual items and how it varies across a number of instruments in selected disease areas.  The goal is to understand how such considerations affect consistency of content and to classify items by concept. METHODS: The structure of each item is characterized as an item stem with a core concept, with an implicit or explicit context (e.g., a disease), event (e.g. “felt frustrated or impatient”), and stimulus (e.g., “about your symptom”), as well as the recall period and response options. Concepts are classified using the WHO International Classification of Functioning (ICF). Similarities and differences across instruments within disease areas are analyzed. RESULTS: We decomposed over 600 items in at least 23 instruments across 5 disease areas and several generic instruments, capturing and classifying each aspect of the structure of each item.  Most physical function items could be matched with specific 3-4 digit ICF codes; most emotional function items could not be matched as specifically. There was considerable variation across instruments regarding the explicit statement of context as well as the presence of a stimulus.  We observed at least 8 different recall periods ranging from an implied present to “in the past year” to “in 10 years” with distinct patterns by disease area. We observed at least 9 types of response options, but the majority of items used 5-point scales. CONCLUSIONS: There are some commonalities but little standardization in how items are structured, within or across diseases. Classification and comparison of items and evaluating comparative content validity is complicated by the variation in most aspects of how the items are phrased. 

Conference/Value in Health Info

2011-11, ISPOR Europe 2011, Madrid, Spain

Value in Health, Vol. 14, No. 7 (November 2011)

Code

PRM34

Topic

Methodological & Statistical Research

Topic Subcategory

PRO & Related Methods

Disease

Multiple Diseases

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×