A Case Study Using Keynote-024 to Examine the Impact of Cut-Point Selection on Long-Term Survival Estimates from Piecewise Modeling

Author(s)

Davies C, Liu BL
Costello Medical, Boston, MA, USA

OBJECTIVES:

Piecewise models have been suggested as a flexible alternative to standard parametric models for modeling complex hazard profiles, for example of immune-oncology therapies. However, the selection of cut-point(s) is often a point of contention. Therefore, this case study aimed to compare the accuracy of the long-term survival estimates of piecewise models of various cut-points with those of standard parametric models.

METHODS:

Overall survival Kaplan-Meier (KM) data from the 25.2-month data-cut of KEYNOTE-024 for pembrolizumab were digitized and fitted with six standard parametric models and piecewise models with standard parametric tails. For the piecewise models, 3-, 8- and 14-months were chosen as cut-points by inspecting smoothed hazard, cumulative hazard, and log cumulative hazard plots. From the cut-points onwards, parametric tails were fitted to the remaining KM data and adjoined to the KM curves. The realized life years (LYs) from the KEYNOTE-024 59.9-month data-cut were compared with the estimated LYs from each model over the same time horizon to determine long-term survival estimate accuracy.

RESULTS:

The realized LYs from the KEYNOTE-024 59.9-month data-cut were 2.71. Average mean LYs across the standard parametric models were 2.70. Average mean LYs varied across piecewise models with different cut-points; at 3-, 8- and 14-month cut-points, piecewise models produced average mean LYs of 2.72, 2.68, and 2.82, respectively. Accuracy of piecewise models generally decreased at longer cut-points, with the 14-month cut-point performing worst. The top three models ranked by accuracy were the 8-month cut-point log-normal, standard generalized gamma, and standard log-logistic.

CONCLUSIONS:

Despite being more flexible, the piecewise models in this case study did not on average perform better than standard parametric models in estimating long-term survival, although the 3- and 8-month cut-point models performed similarly to standard parametric models. Reduced piecewise model accuracy for later cut-points likely reflected reduced numbers at risk on which to fit the parametric tails.

Conference/Value in Health Info

2023-05, ISPOR 2023, Boston, MA, USA

Value in Health, Volume 26, Issue 6, S2 (June 2023)

Acceptance Code

P14

Topic

Clinical Outcomes, Health Technology Assessment, Methodological & Statistical Research

Topic Subcategory

Clinical Outcomes Assessment, Systems & Structure

Disease

no-additional-disease-conditions-specialized-treatment-areas

Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×