Presentation (CTI)

OBJECTIVES: A measurement framework is only as good as the goals it can actually capture and the most important goals are often the hardest to measure. This study classified the EU HTA Regulation's objectives by measurability and attribution and examined the implications for honest policy evaluation.
METHODS: A structured policy-analysis framework was developed to classify HTAR objectives according to measurability and attribution. Objectives were extracted from the Regulation, recitals, and supporting legislative materials. Each objective was evaluated against predefined criteria, including availability of indicators, feasibility of measurement, and ability to attribute observed outcomes to HTAR implementation.
RESULTS: The analysis found substantial variation in objective measurability. Objectives relating to procedural performance, assessment production, stakeholder participation, and duplication reduction were highly measurable. Objectives concerning patient access, innovation incentives, and health-system sustainability were only partially measurable because outcomes depend on multiple national and market-level factors. Several objectives were found to be conceptually important but difficult to operationalise without additional policy guidance. The analysis also demonstrated that measurable objectives are not necessarily the most important objectives. Consequently, evaluation frameworks that focus exclusively on readily quantifiable indicators may overlook significant policy outcomes. The findings support a mixed-methods approach combining quantitative indicators with qualitative assessment.
CONCLUSIONS: The easiest things to measure are not the most important things to achieve. Article 31 evaluation should pair quantitative indicators with qualitative judgement, or risk grading the framework on what is convenient rather than what matters.