Acceptance of Real-World Evidence As Comparative Efficacy in Lieu of Trial Evidence: A Review of Past NICE Appraisals in Oncology

Author(s)

Morgan J1, Evans L2, Micallef J3
1Costello Medical, London, LON, UK, 2Costello Medical, Stockport, UK, 3Costello Medical, London, UK

Presentation Documents

OBJECTIVES: Real-world evidence (RWE) has gained increasing attention as a tool to supplement clinical trial data in technology appraisals, particularly in oncology, where single-arm trials are common. Despite publication of a framework on the appropriate use of RWE in appraisals, the extent to which the National Institute for Health and Care Excellence (NICE) is willing to accept RWE as a source of comparative evidence remains unclear. This research investigated the acceptance of RWE in this context in prior oncology appraisals.

METHODS: Oncology appraisals with published final guidance on the NICE website up to 14th June 2023 were manually searched to identify the 10 most recent appraisals in which RWE was used as a source of comparative efficacy. Key information was systematically extracted for analysis relating to the use of RWE, external assessment group (EAG) and committee critique of the RWE, and the outcomes of the appraisal.

RESULTS: Of the 10 appraisals reviewed, 7 received positive recommendations. Overall, the EAG and committee acknowledged the need for RWE, and considered its use appropriate in most cases. However, the presented RWE formed part of the EAG’s key issues in 9 of the reviewed appraisals and represented an important source of committee uncertainty in 8. Opaque reporting of the provenance, identification and quality of RWE sources, and suitable reporting of methods used for statistical adjustments for differences between RWE and trial populations, were commonly reported issues by the EAG.

CONCLUSIONS: This review demonstrates NICE’s willingness to accept the use of RWE as a source of comparative evidence in oncology appraisals. However, clear concerns remain, particularly around generalisability to the relevant population in clinical practice. Whilst such uncertainty associated with RWE as a source of comparative evidence is challenging to fully resolve, practical but important steps to reduce uncertainty were lacking in company submissions.

Conference/Value in Health Info

2023-11, ISPOR Europe 2023, Copenhagen, Denmark

Value in Health, Volume 26, Issue 11, S2 (December 2023)

Code

HTA327

Topic

Health Technology Assessment, Methodological & Statistical Research, Real World Data & Information Systems

Topic Subcategory

Confounding, Selection Bias Correction, Causal Inference, Data Protection, Integrity, & Quality Assurance, Decision & Deliberative Processes

Disease

Drugs, Oncology

Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×