Health Technology Assessment Reports for Non-Oncology Medications in Canada from 2018 to 2022: Methodological Critiques on Manufacturers' Submissions and a Comparison between Manufacturer and Canadian Agency for Drugs and Technologies in Health (CADTH) Analyses.

Introduction: Identifying key differences between manufacturers' submitted analysis and economic reanalysis by the Canadian Agency for Drugs and Technologies in Health (CADTH) is an important step toward understanding reimbursement recommendations. We compared economic values reported in manufacturers' analysis with the CADTH reanalysis and also assessed methodological critiques.

Methods: Two reviewers extracted data from the clinical and economic reports in publicly available CADTH reports from 2018 to 2022. We used the Wilcoxon rank-sum test to assess the difference between mean economic values, and the Chi-square test to assess the association between the CADTH critique final recommendations.

Results: Of the total submissions, 99.4% included effectiveness critiques, 88.8% included model structure critiques, 69.1% included utility score critiques, and 78.7% included cost critiques. The median incremental cost-utility ratio (ICUR) in the manufacturers' analyses was $138,658/quality-adjusted life-year (QALY), 2.5-fold lower than the CADTH's reanalysis at $380,251/QALY (p < 0.001). The median CADTH reanalysis for 3-year budget impact analysis (BIA) was $4,575,102, which was 27% higher than the manufacturers' submitted 3-year BIA (p < 0.001). CADTH requested a price reduction for 95% of all submissions, and the median price reduction request was 63.5%. In 2021 and 2022, the willingness-to-pay threshold identified in CADTH reports remained constant at $50,000 per QALY gained for all medications.

Conclusion: There was high frequency of CADTH critiques on manufacturers' submissions in all four aspects of economic submissions: effectiveness, cost, utility score and structure. We observed a higher median incremental cost and lower median incremental QALYs in the CADTH reanalysis compared with the manufacturers' submissions. The resulting higher ICUR in the CADTH reanalysis often leads to a recommendation that the manufacturer needs to reduce its price. The 3-year budget impact was higher in the CADTH reanalyses compared with manufacturers' submissions.