OBJECTIVES: Value and health technology assessment (V/HTA) processes should be “formal, systematic, and transparent.” Currently, little formal guidance exists on how credible and relevant economic-model data sources and inputs should be identified and selected, or how these processes should be made transparent to users.

The objective of this pilot analysis was to examine the selection, use, and reporting of data sources and inputs used to populate economic model parameters to determine if further examination and/or guidance is warranted.

METHODS: Two reports published between October 1, 2016, and September 30, 2020, were randomly selected from each of three prominent, English-language V/HTA organizations: CADTH, ICER, and NICE. Criteria to characterize data sources and inputs used in the reports’ economic models were developed using characteristics identified by the ISPOR-SMDM Modeling Good Research Practices Task Force and the CER Collaborative Initiative.

Reports were evaluated on whether: assessments of data relevance and credibility were provided; sufficient information was provided for a user to independently assess data relevance and credibility; and sources and inputs appeared relevant and credible across all parameters. Then, overall transparency of data sources and inputs based on these criteria was assessed. Two authors independently applied criteria to the reports, and a third served as tiebreaker.

RESULTS: We found substantial variation across organizational approaches to documenting data-source and -input identification and selection decisions, and identified possible transparency, credibility, and relevance issues from a user’s perspective. While almost all reports evaluated provided some information about data sources and inputs used in models, documentation needed for a user to evaluate relevance and credibility was not systematic, detailed, or user-friendly per our criteria. Transparency of data sources and inputs also was limited across the organizations.

CONCLUSIONS: These findings suggest further examination is needed of data-source and -input selection methods and reporting practices in V/HTA economic evaluations.