METHODS FOR COMPARING AREAS UNDER RECEIVER OPERATING CHARACTERISTIC CURVES- APPLICATION IN SCREENING ACCURACY FOR DEPRESSION

Author(s)

Shaw JW1, Treglia M1, Motheral B2, Coons SJ2, 1Global Health Outcomes Research, Eli Lilly and Company, Indianapolis, IN, USA; 2College of Pharmacy, The University of Arizona, Tucson, AZ, USA

Receiver operating characteristic (ROC) analysis is often used to assess the screening accuracy of continuous measures. Hanley and McNeil (Radiology 1983;148:839-843) developed a method for comparing ROC curves that is widely used in the literature. DeLong et al. (Biometrics 1988;44:837-845) subsequently developed an improved method; however, it has not become popular due to its perceived complexity. OBJECTIVE: This research compared the method of DeLong et al. to that of Hanley and McNeil. METHODS: The data were drawn from a sample of over 1,215 primary care patients participating in the Longitudinal Investigation of Depression Outcomes (LIDO) study. Three continuous measures (i.e., CES-D, MHI-5, and MCS-12) were compared in terms of their ability to detect diagnosis of major depression based on the CIDI. Values for area under the ROC curve (AUC) were computed for the three measures and compared statistically using the DeLong et al. and Hanley and McNeil methods. RESULTS: The two methods yielded entirely different statistical conclusions. Using the DeLong et al. Method, z statistics for difference between AUC values were 15-22% larger. The DeLong et al. method yielded confidence intervals that were 17-25% narrower than those derived using the method of Hanley and McNeil. The statistical efficiency of the Hanley and McNeil method relative to that of DeLong et al. ranged from 64-73%. CONCLUSIONS: The DeLong et al. method is more elegant and precise than that developed by Hanley and McNeil. The results of this investigation indicate that the former would require fewer patients than the latter to achieve a fixed level of statistical power.

Conference/Value in Health Info

2000-05, ISPOR 2000, Arlington, VA, USA

Value in Health, Vol. 3, No. 2 (March/April 2000)

Code

S4

Topic

Clinical Outcomes

Topic Subcategory

Clinical Outcomes Assessment

Disease

Mental Health

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×