VALIDITY EVIDENCE AND VALIDATION PRACTICE IN PAPERS PUBLISHED IN VALUE IN HEALTH (1998-2010)- A SYSTEMATIC REVIEW

Author(s)

Chan EKH1, Darmawanti I2, Mulyana OP2, Zumbo BD11University of British Columbia, Vancouver , BC, Canada, 2State University of Surabaya, Surabaya, East Java, Indonesia

OBJECTIVES: Patient-reported outcome (PRO), health-related quality of life (HRQOL), and related instruments are increasingly used in outcomes research. In developing and evaluating PRO, HRQOL, and related instruments, measurement validity is a fundamental consideration. With an eye toward investigating the methodology of validity and uses of validation, we systematically reviewed the reporting of validation practice in papers published in Value in Health, the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) official journal. METHODS: A systematic search using the journal official website was conducted in December 2010 – including papers since its inception (January 1998) to December 2010. Two searches were independently conducted by two of the authors. Keywords used in the search included “development OR measurement OR psychometric OR psychometrics OR valid OR validation OR validity.” We searched both the titles (126 citations) and abstracts (347 citations). Papers reporting empirical results on validity were included. Econometric, opinion, and conference papers were excluded. A coding sheet was developed and each article was double-coded independently by at least two of the authors. RESULTS: Ninety-three articles met the inclusion criteria. The percentage of reports of the broad categories of validity evidence were: construct (39.8%), discriminant (28.0%), convergent (26.9%), content (17.2%), concurrent (14.0%), predictive (5.4%), response processes (4.3%), and consequences (1.1%). A paper may report more than one type of validity evidence. In addition, 95.7% of the papers referred to the validity of the instrument, rather than the modern view of validity of the inferences from the scores. CONCLUSIONS: Findings reveal that validity information is not routinely presented from a modern validity perspective; that is, consider a unitary view of validity, cite recent theoretical papers in validity theory, or distinguish between validity (as a property) and validation (as a process/method). Some sources of validity evidence (e.g., consequences and response processes) are essentially ignored.  

Conference/Value in Health Info

2011-05, ISPOR 2011, Baltimore, MD, USA

Value in Health, Vol. 14, No. 3 (May 2011)

Code

PRM32

Topic

Patient-Centered Research

Topic Subcategory

Patient-reported Outcomes & Quality of Life Outcomes

Disease

Multiple Diseases

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×