The Goal Attainment Scaling Method Is Robust to Violations of Normality in Goal Scales: A Simulation Study

Author(s)

Dunn T, Stanley J, Knox K, Stanojevic S, Howlett SE, Rockwood K
Ardea Outcomes, Halifax, NS, Canada

Presentation Documents

OBJECTIVES

Goal attainment scaling (GAS) is a patient-centric outcome measure that captures meaningful change through personally identified treatment goals. For each goal, a 5-point attainment scale is defined to describe possible outcomes, with the midpoint representing the “expected outcome”. A key assumption in GAS analysis is that the scores on the scale approximate a normal distribution. Using data simulation techniques, we investigated whether GAS performance varied if the assumption of normality was violated.

METHODS

We employed a latent variable model to generate GAS data (Urach et al. 2019). We varied the number of subjects (40, 60, 80; equally assigned to control or treatment), treatment effect size (0.3, 0.5, 0.7, 0.9 and 1.1), and number of goals per subject (1-5 goals). Latent goal scores were discretized into 5-point scales using either: “uniform” intervals that were spaced to return a uniform score distribution, and “normal” intervals that were spaced to approximate a normal distribution. For each set of parameters, 1000 trials were simulated. Two-sided t-tests were performed on summary T-scores. Power was the percentage of simulations detecting a significant treatment effect (α=0.05).

RESULTS

The statistical power did not vary significantly whether using uniform or normal intervals, with less than 1% difference for most parameter combinations. As expected, T-scores were higher when using uniform intervals. However, the standardized effect sizes were equal across small-medium effect sizes (<0.7), as typically seen in most GAS studies. At the higher effect sizes, the uniform intervals underestimated the treatment effect compared to normal intervals (difference of 0.03-0.07). This difference is unlikely to impact interpretation of GAS results.

CONCLUSIONS

Violating the distributional assumptions of GAS data is unlikely to affect the power to detect a treatment effect at effect sizes typically seen in GAS studies. The GAS method is robust to perturbations in normality of goal scores.

Conference/Value in Health Info

2021-11, ISPOR Europe 2021, Copenhagen, Denmark

Value in Health, Volume 24, Issue 12, S2 (December 2021)

Code

POSB322

Topic

Methodological & Statistical Research, Patient-Centered Research

Topic Subcategory

Instrument Development, Validation, & Translation, Patient-reported Outcomes & Quality of Life Outcomes

Disease

No Specific Disease

Explore Related HEOR by Topic


Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×