Methodological Quality Checklists Used in Systematic Reviews of Health Economic Evaluations, 2022-2024

Author(s)

Stewart F1, Gomez Espinosa E2, Fusco N1, Koufopoulou M3, Szydlowski N1
1Cencora, Conshohocken, PA, USA, 2Cencora, Bishops Stortford, HRT, UK, 3Cencora, Reading, WBK, UK

Presentation Documents

OBJECTIVES: Systematic literature reviews (SLRs) often use quality assessment (QA) tools to aid interpretation of the overall reliability of the study findings. Various QA tools are available specifically for assessing the quality of health economic evaluations (EEs), however, it is crucial to differentiate between evaluating methodological quality (how well an EE was designed and conducted) and reporting quality (the description of the methods and findings). The objective of this study was to analyse the utilisation of QA tools in recent SLRs focusing on EEs.

METHODS: A search was conducted in Embase and Medline to identify SLRs of EEs of health interventions published between 2022 and June 2024. Inclusion criteria were limited to EEs in oncology, cardiovascular disease (CVD), infectious diseases, diabetes, substance use disorder (SUD), and mental disorders. Studies only presented as conference abstracts, methodological studies, or those involving solely children and adolescents were excluded. For each included SLR, we noted which QA tools and checklists were used to assess methodological quality.

RESULTS: The literature searches identified 677 results, of which 145 met our inclusion criteria (oncology 40; CVD 36; infectious diseases 31; mental disorders 22; diabetes 12; SUD 4). The most frequently reported QA tools were the Consolidated Health Economic Evaluation Reporting Standards (CHEERS) (39.3%), Drummond’s checklist (13.1%), and Consensus Health Economic Criteria (10.4%). Twelve studies (8.3%) did not mention using any QA tool, while 4.8% used CHEERS for reporting quality evaluation alongside another tool for methodological quality assessment.

CONCLUSIONS: Despite caution from CHEERS authors about its unsuitability for assessing methodological quality and the potential misinterpretation of study findings, CHEERS remains the most widely employed QA tool in SLRs of EEs. Authors conducting SLRs of EEs should be guided towards utilising appropriate tools designed specifically for assessing methodological quality rather than relying solely on reporting standards like CHEERS.

Conference/Value in Health Info

2024-11, ISPOR Europe 2024, Barcelona, Spain

Value in Health, Volume 27, Issue 12, S2 (December 2024)

Code

EE56

Topic

Organizational Practices, Study Approaches

Topic Subcategory

Best Research Practices, Literature Review & Synthesis

Disease

Cardiovascular Disorders (including MI, Stroke, Circulatory), Diabetes/Endocrine/Metabolic Disorders (including obesity), Infectious Disease (non-vaccine), Mental Health (including addition), No Additional Disease & Conditions/Specialized Treatment Areas

Your browser is out-of-date

ISPOR recommends that you update your browser for more security, speed and the best experience on ispor.org. Update my browser now

×