Assessing the Validity of Observational Filters for Systematic and Rapid Literature Reviews

Author(s)

Smela B1, Świerk K1, Tusińska A1, Clay E2, Boyer L3, Toumi M3
1Assignity, Kraków, Poland, 2Clever-Access, Paris, France, 3Aix-Marseille University, Marseille, France

OBJECTIVES: Search filters are predetermined combinations of phrases that have been developed to obtain a subset of records based on specific topics of interest. The objective was to create and test two filters supporting the identification of observational studies: one that could be used when running rapid reviews (RRs), containing only the main terms related to these types of studies (’basic’), and the second one, more sensitive, that could suit well systematic literature reviews (SLRs), named ‘comprehensive’.

METHODS: The basic filter was created by combining keywords used in the observational search filters published by 3 identified sources: Scottish Intercollegiate Guidelines Network, British Medical Journal Knowledge Center, and OVID expert searches. In the comprehensive filter, keywords published by the Canadian Agency for Drugs and Technologies in Health were additionally included. The filers were tested using Cochrane’s SLRs as a ‘gold standard'.

RESULTS: The performance of the filters was satisfactory – for the comprehensive filter, the coverage of available data was over 92%, while for the basic filter, which could be implemented in RRs aiming to synthesise key trends in a cost-efficient manner, the coverage was 77%, with most of the studies falling in the range between 84-96%. The use of the basic filter was associated with a significantly higher reduction of workload compared to the comprehensive filter – between 2 and 7 workdays. Studies were omitted mostly due to poor indexing and not using relevant keywords in abstracts. 63% of studies missed by the comprehensive filter were published prior to the year 2000.

CONCLUSIONS: Effective evidence retrieval is critical for performing high-quality evidence synthesis to support healthcare decision-making. Implementing the methodological filters into the search strategy significantly reduces the workload, and therefore generates savings in time and costs. However, it is important to underline that restricting the strategy may lead to omitting relevant data sources.

Conference/Value in Health Info

2023-11, ISPOR Europe 2023, Copenhagen, Denmark

Value in Health, Volume 26, Issue 11, S2 (December 2023)

Code

SA16

Topic

Study Approaches

Topic Subcategory

Literature Review & Synthesis, Prospective Observational Studies

Disease

No Additional Disease & Conditions/Specialized Treatment Areas

Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×