Estimating Subgroup- And Individual-Level Treatment Effects Using Machine Learning Methods: A Case Study Using the First-ABC Trial
Author(s)
Hattab Z1, Sadique Z2, O'Neill S3, Ramnarayan P4
1National University of Ireland Galway, Galway, G, Ireland, 2London School of Hygiene and Tropical Medicine, London, UK, 3National University of Ireland, Galway, London, UK, 4Great Ormond Street Hospital For Children NHS Trust, London, UK
OBJECTIVES:
To explore heterogeneity in the effectiveness and cost-effectiveness of high flow nasal cannula therapy (HFNC) compared with continuous positive airway pressure (CPAP) as the first-line mode of noninvasive respiratory support for acute illness in children, using data from the FIRST-ABC Randomized Controlled Trial (RCT) (ISRCTN60048867).METHODS:
Six hundred acutely ill children aged 0-15 years clinically assessed to require noninvasive respiratory support were randomized 1:1 to start either HFNC (n=301), or CPAP (n=299) in FIRST-ABC step down RCT. The primary outcome of the RCT was time from randomization to liberation from all respiratory support (excluding supplemental oxygen), assessed against a noninferiority margin of an adjusted hazard ratio (HR) of 0.75. Causal Machine Learning (ML) approaches, allow for complex interactions between covariates while avoiding overfitting. We apply causal forests (CF), a causal ML method based on modified decision trees that can estimate subgroup- and individual-level treatment effects, without requiring correct pre-specification of the effect model. We consider CF alongside parametric approaches for estimating heterogeneity in Treatment Effects (HTE). We considered pre-specified subgroups defined by age (<12 months vs >=12 months), co-morbidities (none vs neurological vs other), length of prior Invasive Mechanical Ventilation (IMV) (<5 days vs >=5 days), reason for IMV (cardiac vs non-cardiac), reason for respiratory support post-extubation (planned vs indeterminate vs rescue) and SpO2:FiO2 (SF) ratio at randomisation.RESULTS:
HFNC was found to be noninferior to CPAP in the aggregate analysis, with a median time to liberation of 52.9 hours (95% CI, 46.0 to 60.9) versus 47.9 hours (95% CI, 40.5 to 55.7). At an individual level, considerable variation was found in the estimated effects of HFNC on median time to liberation and cost-effectiveness endpoints. Less variation was observed at the subgroup level.CONCLUSIONS:
The ML driven HTE estimates may allow effective and cost-effective targeting of individualised treatments.Conference/Value in Health Info
Value in Health, Volume 25, Issue 12S (December 2022)
Acceptance Code
P31
Topic
Clinical Outcomes, Economic Evaluation, Methodological & Statistical Research, Study Approaches
Topic Subcategory
Artificial Intelligence, Machine Learning, Predictive Analytics, Clinical Outcomes Assessment, Clinical Trials, Cost-comparison, Effectiveness, Utility, Benefit Analysis
Disease
sdc-pediatrics, sdc-respiratory-related-disorders-allergy-asthma-smoking-other-respiratory, sta-personalized-precision-medicine