Consistency of Published Observational/Real-World Studies With the STROBE Guidelines: An Analysis of Three Indications
Author(s)
Huang Y1, Czolk R1, Escudero I1, Milanova I1, Mitra S1, Thomas E2, Vidal M1, van Den Broek R3, Morland R4
1Excerpta Medica, Amstelveen, Netherlands, 2Excerpta Medica, London, UK, 3Adelphi Communications, Amstelveen, North Holland, Netherlands, 4Excerpta Medica, London, London, UK
Presentation Documents
OBJECTIVES: As acknowledged by the ISPOR/ISPE task force, improving transparency in reporting real-world data is essential. However, the compliance of published observational studies with reporting guidelines is unknown. This targeted literature review assessed the transparency of reported data from observational studies in three indications, evaluating published articles using the STROBE guidelines/checklist.
METHODS: Observational studies were identified in EMBASE using conventional search methodology based on ISPOR recommendations in three indications within the fields of dermatology/oncology/genetic disease. Years 2017/2020/2023 were selected to explore longitudinal changes. Open-access publication (itself a transparency goal) in a ‘top25%’ journal (according to Journal Citation ReportsTM) was required for inclusion. Articles were scored 1(yes), 0(no), or not applicable for the presence of each of the 34 STROBE checklist items/sub-items. Scores (range 0–1) were calculated per article section and per article as the proportions of applicable checklist items with 'yes'. Nonparametric Kruskal-Wallis tests compared scores between years and indications.
RESULTS: Among 132 included articles (dermatology 62; oncology 21; genetic disease 49; 2017: 32; 2020: 34; 2023: 66), the mean[SD] overall score was 0.73[0.13]. The mean[SD] overall score was not significantly different across years (2017: 0.74[0.11]; 2020: 0.73[0.14]; 2023: 0.72[0.14]; P=0.66) or therapeutic area (dermatology 0.71[SD]; oncology 0.76[SD]; genetic disease 0.74[SD]; P=0.12). Overall, mean[SD] section scores were title/abstract 0.81[SD]; introduction 0.93[SD]; methods 0.70[SD]; results 0.72[SD]; discussion 0.87[SD]; other information 0.75[SD]. The most frequently reported items/sub-items were ‘title/abstract: informed and balanced’ (126/132[95.5%]), ‘descriptive data: characteristics’ (127/132[96.2%]), ‘key results summary’ (126/132[95.5%]), and ‘interpretation’ (127/132[96.2%]). The least frequently reported items/sub-items included ‘participants flow diagram’ (27/126[21.4%]), ‘bias’ (methods) (30/132[22.7%]), and ‘statistical methods: sensitivity analyses’ (29/98[29.6%]).
CONCLUSIONS: Our review observed frequent transparency deficiencies in methods and results sections of peer-reviewed observational studies across selected indications, with no significant differences overtime or between indications. These results highlight the need for improved adherence to transparency guidelines in real-world data reporting.
Conference/Value in Health Info
Value in Health, Volume 27, Issue 12, S2 (December 2024)
Code
RWD37
Topic
Organizational Practices, Real World Data & Information Systems, Study Approaches
Topic Subcategory
Best Research Practices, Data Protection, Integrity, & Quality Assurance, Literature Review & Synthesis
Disease
No Additional Disease & Conditions/Specialized Treatment Areas