The Framing of Time-Dependent Machine Learning Models Improves Risk Estimation Among Young Individuals with Acute Coronary Syndromes
Author(s)
de Carvalho LS1, Nogueira ACC2, Fernandez M3, Sposito A4
1Clarity Healthcare Intelligence, Brasília, SP, Brazil, 2Aramari Apo Institute, Brasilia, Brazil, 3Clarity Healthcare Intelligence, CAMPINAS, SP, Brazil, 4University of Campinas - UNICAMP, Campinas, SP, Brazil
OBJECTIVES: Although young individuals (<55 years) are less frequently seen with acute coronary syndromes (ACS), this clinical event shows high recurrence rates and triggers considerable economic burden. Young individuals with ACS (yACS) are usually underrepresented and show idiosyncratic epidemiologic features compared to older subjects. These differences may justify why available risk prediction models usually penalize yACS with higher false positive rates compared to older subjects. We hypothesized that exploring temporal framing structures such as prediction time, observation windows and subgroup-specific prediction, could improve time-dependent prediction metrics.
METHODS: Consecutive ACS individuals (nglobal_cohort=6341 and nyACS=2242) undergoing coronarography up-to-48h after hospital admission were included. The observation window in STWm and GFm included the first 48h upon hospital admission, and LTWm included in-hospital information. yACS cohort and global_cohort were divided into train/validation-set (70%), and both were tested in a hold-out sample of 673 yACS individuals (test-set). STWm evaluated the occurrence of in-hospital cardiovascular deaths and recurrent ACS (MACE) with C-statistics and LTWm estimated events occurring post-discharge from index ACS hospitalization considering time-dependent concordance (Ctd-index) with competing risks (MACE versus non-cardiovascular deaths). Models were repeated over five-fold cross-validation, then assessed in test-set.
RESULTS: After median follow-up of 6.67 years, 2008 individuals presented MACE. The best strategy was to design models specifically in yACS individuals combining STWm and LTWm, where best results were, respectively, C-statistics [0.921(95%CI 0.889-0.953)] and Ctd-index [0.722(95%CI 0.678-0.760)], while the best Ctd-index in GFm was 0.681(95%CI 0.654-0.703). There was very low concordance among top predictors of MACE for yACS versus global_cohort, as well as for STWm versus LTWm, reinforcing a need for specific prediction rules.
CONCLUSIONS: The predictive accuracy for adverse clinical events was optimized by using specific rules for yACS and splitting short-term and long-term prediction windows, leading to the detection of 80% of events, compared to 69% by using a rule designed for the global_cohort.
Conference/Value in Health Info
Value in Health, Volume 26, Issue 6, S2 (June 2023)
Code
CO187
Topic
Clinical Outcomes, Methodological & Statistical Research, Study Approaches
Topic Subcategory
Artificial Intelligence, Machine Learning, Predictive Analytics, Clinical Outcomes Assessment, Clinician Reported Outcomes, Prospective Observational Studies
Disease
Cardiovascular Disorders (including MI, Stroke, Circulatory)