Validating Restricted Mean Survival Time Estimates From Reconstructed Kaplan-Meier Data Against Original Trial Individual Patient Data From Trials Conducted by the Canadian Cancer Trials Group

Jul 1, 2022, 00:00
10.1016/j.jval.2021.12.004
https://www.valueinhealthjournal.com/article/S1098-3015(22)00004-3/fulltext
Title : Validating Restricted Mean Survival Time Estimates From Reconstructed Kaplan-Meier Data Against Original Trial Individual Patient Data From Trials Conducted by the Canadian Cancer Trials Group
Citation : https://www.valueinhealthjournal.com/action/showCitFormats?pii=S1098-3015(22)00004-3&doi=10.1016/j.jval.2021.12.004
First page : 1157
Section Title : METHODOLOGY
Open access? : No
Section Order : 1157

Objectives

The development of novel cancer therapies, including immuno-oncology agents, has increased interest in reconstructed individual patient data (IPD) based restricted mean survival time (RMST) analyses. Additionally, reconstructed IPD–based RMST is recommended in cost-effectiveness analyses when original trial IPD are not available. Nevertheless, recently concerns regarding potential bias of reconstructed-IPD RMST have been presented, because reconstructed-IPD RMSTs have not been validated and previous validation endpoints may not capture the entire Kaplan-Meier (KM) curve, especially the “tail.” Our study aims to validate the recommended method of IPD reconstruction by comparing reconstructed IPD– and original trial IPD–based RMST.

Methods

Canadian Cancer Trials Group trials from 1990 to 2017 were included. Overall survival and progression-free survival IPD were reconstructed based on published KM curves using the Guyot method. Analysts were blinded to original trial IPD. RMST was calculated at 1 year and over the entire KM curve. Reconstructed-IPD and original trial–IPD (gold-standard) RMSTs were compared for accuracy and predictive error via mean deviation, mean absolute error (MAE), mean percentage bias, and Bland-Altman plots and across KM curve quality (vector traced or bitmapped).

Results

We identified 39 trials. The mean deviation, MAE, and mean percentage bias of RMST between the reconstructed IPD and original trial IPD were small. In particular, the mean deviation was −0.01 months and −0.04 months, MAE was 0.19 months and 0.24 months, and mean percentage bias was 0.82% and 0.84% in overall survival KM curves in control and experimental arms, respectively. Accuracy was generally not associated with KM curve quality.

Conclusions

RMST derived from reconstructed IPD displayed excellent accuracy and predictive error compared with the gold standard. Reconstructed IPD could be used to calculate RMST in lieu of original trial IPD, to facilitate decision making for clinicians, researchers, and policy makers.

Categories :
  • Cost-comparison, Effectiveness, Utility, Benefit Analysis
  • Decision Modeling & Simulation
  • Economic Evaluation
  • Methodological & Statistical Research
  • Modeling and simulation
  • Oncology
  • Specific Diseases & Conditions
  • Study Approaches
Tags :
  • reconstructed individual patient data
  • restricted mean survival time
  • validation
Regions :
  • North America
ViH Article Tags :