A Non-Systematic Review Evaluating Search Strategies Leveraged in HTA Submissions to NICE

OBJECTIVES: Systematic literature reviews (SLRs) are a key component of health technology assessment (HTA) submissions. This review aimed to understand the use of validated search filters and search strategy considerations highlighted by the Evidence Review Group (ERG) and/or Committee in submissions to the National Institute for Health and Care Excellence (NICE).

METHODS: Documents (i.e. company submission, final appraisal document, and committee papers) from oncology HTAs submitted to NICE in the last two years (03/2022-03/2024) were reviewed to understand whether a validated search filter was used in underlying SLRs and to collate commentary from the ERG and/or Committee on the SLR searches. Relevant data were extracted by a single researcher, with 20% validated by a second, independent researcher.

RESULTS: Overall, 70 submissions in 16 cancer types were identified. While search strategies were generally not publicly available, ERG commentary on search strategies was available for 59/70 (84%) submissions. In 36/59 (61%) submissions, the ERG noted the use of clear and comprehensive searches, 50/59 (85%) submissions used appropriate databases, 39/59 (66%) used appropriate search terms, 41/59 (69%) appropriately leveraged grey literature searches, and 30/59 (51%) used an appropriate search time span. Appropriate search limits were used in around 36% (21/59) of submissions. Use of search filters was reported in 32/59 (54%) submissions, of which 13 reported use of validated search filters. Across the 70 submissions, the NICE committee rarely critiqued searches with commentary in 1 submission noted in available documents relating to the use of appropriate search terms.

CONCLUSIONS: Most submissions included ERG commentary on company submitted search strategies. Searches were found to be generally acceptable with ERG critiques primarily focused on the use of appropriate time spans and search limits. Use of validated search filters was rarely reported.