Pub Date : 2024-11-20DOI: 10.1017/S026646232400463X
Evi Germeni, Simon Fifer, Mickaël Hiligsmann, Barry Stein, Mandy Tonkinson, Maya Joshi, Alissa Hanna, Barry Liden, Deborah A Marshall
Objectives: The roles and potential value of patient preference (PP) data in health technology assessment (HTA) remain to be fully realized despite an expanding literature and various efforts to establish their utility. This article reports lessons learned through a series of collaborative workshops with HTA representatives, organized by the Health Technology Assessment International's Patient Preferences Project Subcommittee.
Methods: Five online workshops were conducted between June 2022 and June 2023, seeking to facilitate collaborative learning and reflection on ways that PP data can be integrated into HTA. Participants included nine HTA representatives from the United States, Canada, Australia, England, and the Netherlands. Workshops were recorded, transcribed, and thematically analyzed.
Results: Despite appreciating the value of PP data, participants were ambivalent about their use in HTA. Some felt that they were already getting the information they needed from the cost-effectiveness analysis or existing patient involvement processes. Others thought that PP data would be very helpful at the initial and final stage of the decision-making process and, particularly, in the following cases: (a) when technology has important non-health benefits; (b) when the clinical and/or cost-effectiveness evidence is marginal; and (c) when treatment is indicated for a large and heterogeneous population. Issues related to the validity and reliability of PP studies were frequently raised, with preference heterogeneity at the core of these concerns.
Conclusions: Collaborating with HTA representatives in the "co-creation" of PP research can help address their concerns and facilitate mutual learning about how PP data can be used in HTA.
{"title":"A genuine need or nice to have? Understanding HTA representatives' perspectives on the use of patient preference data.","authors":"Evi Germeni, Simon Fifer, Mickaël Hiligsmann, Barry Stein, Mandy Tonkinson, Maya Joshi, Alissa Hanna, Barry Liden, Deborah A Marshall","doi":"10.1017/S026646232400463X","DOIUrl":"10.1017/S026646232400463X","url":null,"abstract":"<p><strong>Objectives: </strong>The roles and potential value of patient preference (PP) data in health technology assessment (HTA) remain to be fully realized despite an expanding literature and various efforts to establish their utility. This article reports lessons learned through a series of collaborative workshops with HTA representatives, organized by the Health Technology Assessment International's Patient Preferences Project Subcommittee.</p><p><strong>Methods: </strong>Five online workshops were conducted between June 2022 and June 2023, seeking to facilitate collaborative learning and reflection on ways that PP data can be integrated into HTA. Participants included nine HTA representatives from the United States, Canada, Australia, England, and the Netherlands. Workshops were recorded, transcribed, and thematically analyzed.</p><p><strong>Results: </strong>Despite appreciating the value of PP data, participants were ambivalent about their use in HTA. Some felt that they were already getting the information they needed from the cost-effectiveness analysis or existing patient involvement processes. Others thought that PP data would be very helpful at the initial and final stage of the decision-making process and, particularly, in the following cases: (a) when technology has important non-health benefits; (b) when the clinical and/or cost-effectiveness evidence is marginal; and (c) when treatment is indicated for a large and heterogeneous population. Issues related to the validity and reliability of PP studies were frequently raised, with preference heterogeneity at the core of these concerns.</p><p><strong>Conclusions: </strong>Collaborating with HTA representatives in the \"co-creation\" of PP research can help address their concerns and facilitate mutual learning about how PP data can be used in HTA.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e60"},"PeriodicalIF":2.6,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579672/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142675759","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objectives: To synthesize the results of cost-effectiveness studies of different triage tests in comparison to repeat cytology for women with atypical squamous cells of undetermined significance (ASC-US) or low-grade squamous intraepithelial lesions (LSIL) results.
Methods: Electronic databases (Medline/PubMed, Lilacs, Embase, The Cochrane Library, Scopus, Web of Science, Scielo, The NHS Economic Evaluation Database, Econlit, and CEA Registry) were searched for cost-effectiveness or cost-utility publications. Per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, two independent reviewers selected eligible publications based on the selection criteria and performed data extraction. Methodological quality was assessed using the Quality of Health Economic Studies tool.
Results: Five cost-effectiveness analyses were included comparing HPV testing, immediate colposcopy, and liquid-based cytology with HPV testing reflex to repeat cytology. The main outcome adopted was cervical intraepithelial neoplasia level 2 or higher (CIN2+) cases detected. In pairwise comparisons, HPV testing was more frequently observed as the most cost-effective strategy. Incremental cost-effectiveness ratios were very sensitive to costs of test kit variation and accuracy estimates with some sensitivity analysis scenarios showing immediate colposcopy more cost-effective than HPV testing depending on the tests' unitary costs and effectiveness.
Conclusions: This systematic review of economic evidence corroborates clinical evidence showing cytology is the least effective, although less costly, triage strategy. Cytology-based triage programs need to be updated to offer timely treatment to women diagnosed with ASC-US/LSIL and better resource allocation.
研究目的综合不同分流检测与重复细胞学检测的成本效益研究结果,并与意义未定的非典型鳞状细胞(ASC-US)或低级别鳞状上皮内病变(LSIL)结果进行比较:在电子数据库(Medline/PubMed、Lilacs、Embase、The Cochrane Library、Scopus、Web of Science、Scielo、The NHS Economic Evaluation Database、Econlit 和 CEA Registry)中检索成本效益或成本效用出版物。根据《系统综述和元分析首选报告项目》(PRISMA)指南,两位独立审稿人根据选择标准选择符合条件的出版物,并进行数据提取。方法学质量采用健康经济研究质量工具进行评估:结果:共纳入了五项成本效益分析,比较了HPV检测、立即阴道镜检查和液基细胞学检查与HPV检测反射重复细胞学检查。采用的主要结果是检测出的宫颈上皮内瘤变 2 级或更高(CIN2+)病例。在配对比较中,HPV 检测更经常被视为最具成本效益的策略。增量成本效益比对检测试剂盒的成本变化和准确性估计非常敏感,一些敏感性分析方案显示,根据检测的单位成本和有效性,立即进行阴道镜检查比HPV检测更具成本效益:这项对经济学证据的系统性审查证实了临床证据显示细胞学是最无效的分诊策略,尽管成本较低。基于细胞学的分流方案需要更新,以便为确诊为ASC-US/LSIL的妇女提供及时的治疗和更好的资源分配。
{"title":"Systematic review of economic evaluations of triage tests for women with atypical squamous cells of undetermined significance (ASC-US) or low-grade squamous intraepithelial lesions (LSIL).","authors":"Isandra Meirelles, Márcia Pinto, Leticia Barros, Fabio Russomano","doi":"10.1017/S0266462324000540","DOIUrl":"10.1017/S0266462324000540","url":null,"abstract":"<p><strong>Objectives: </strong>To synthesize the results of cost-effectiveness studies of different triage tests in comparison to repeat cytology for women with atypical squamous cells of undetermined significance (ASC-US) or low-grade squamous intraepithelial lesions (LSIL) results.</p><p><strong>Methods: </strong>Electronic databases (Medline/PubMed, Lilacs, Embase, The Cochrane Library, Scopus, Web of Science, Scielo, The NHS Economic Evaluation Database, Econlit, and CEA Registry) were searched for cost-effectiveness or cost-utility publications. Per the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, two independent reviewers selected eligible publications based on the selection criteria and performed data extraction. Methodological quality was assessed using the Quality of Health Economic Studies tool.</p><p><strong>Results: </strong>Five cost-effectiveness analyses were included comparing HPV testing, immediate colposcopy, and liquid-based cytology with HPV testing reflex to repeat cytology. The main outcome adopted was cervical intraepithelial neoplasia level 2 or higher (CIN2+) cases detected. In pairwise comparisons, HPV testing was more frequently observed as the most cost-effective strategy. Incremental cost-effectiveness ratios were very sensitive to costs of test kit variation and accuracy estimates with some sensitivity analysis scenarios showing immediate colposcopy more cost-effective than HPV testing depending on the tests' unitary costs and effectiveness.</p><p><strong>Conclusions: </strong>This systematic review of economic evidence corroborates clinical evidence showing cytology is the least effective, although less costly, triage strategy. Cytology-based triage programs need to be updated to offer timely treatment to women diagnosed with ASC-US/LSIL and better resource allocation.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e58"},"PeriodicalIF":2.6,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579666/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142647829","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-18DOI: 10.1017/S0266462324000618
Bryony Dawkins, Bethany Shinkins, Tim Ensor, David Jayne, David Meads
Background: International development agendas increasingly push for access to healthcare for all through universal healthcare coverage. Health economic evaluations and health technology assessment (HTA) could provide evidence to support this but do not routinely incorporate consideration of equitable access.
Methods: We undertook an international scoping review of health economic evaluation and HTA guidelines to examine how well issues of healthcare access and equity are represented, evidence recommendations, and gaps in current guidance to support evidence generation in this area. Guidelines were sourced from guideline repositories and websites of international agencies and organizations providing best practice methods guidance. Articles providing methods guidance for the conduct of HTA, or health economic evaluation, were included, except where they were not available in English and a suitable translation could not be obtained.
Results: The search yielded forty-seven national, four international, and nine independent guidelines, along with eighty-six articles providing specific methods guidance. The inclusion of equity and access considerations in current guidance is extremely limited. Where they do feature, detail on specific methods for providing evidence on these issues is sparse.
Discussion: Economic evaluation could be a valuable tool to provide evidence for the best healthcare strategies that not only maximize health but also ensure equitable access to care for all. Such evidence would be invaluable in supporting progress towards universal healthcare coverage. Clear guidance is required to ensure evaluations provide evidence on the best strategies to support equitable access to healthcare, but such guidance rarely exists in current best practice and guidance documents.
{"title":"Incorporating healthcare access and equity in economic evaluations: a scoping review of guidelines.","authors":"Bryony Dawkins, Bethany Shinkins, Tim Ensor, David Jayne, David Meads","doi":"10.1017/S0266462324000618","DOIUrl":"10.1017/S0266462324000618","url":null,"abstract":"<p><strong>Background: </strong>International development agendas increasingly push for access to healthcare for all through universal healthcare coverage. Health economic evaluations and health technology assessment (HTA) could provide evidence to support this but do not routinely incorporate consideration of equitable access.</p><p><strong>Methods: </strong>We undertook an international scoping review of health economic evaluation and HTA guidelines to examine how well issues of healthcare access and equity are represented, evidence recommendations, and gaps in current guidance to support evidence generation in this area. Guidelines were sourced from guideline repositories and websites of international agencies and organizations providing best practice methods guidance. Articles providing methods guidance for the conduct of HTA, or health economic evaluation, were included, except where they were not available in English and a suitable translation could not be obtained.</p><p><strong>Results: </strong>The search yielded forty-seven national, four international, and nine independent guidelines, along with eighty-six articles providing specific methods guidance. The inclusion of equity and access considerations in current guidance is extremely limited. Where they do feature, detail on specific methods for providing evidence on these issues is sparse.</p><p><strong>Discussion: </strong>Economic evaluation could be a valuable tool to provide evidence for the best healthcare strategies that not only maximize health but also ensure equitable access to care for all. Such evidence would be invaluable in supporting progress towards universal healthcare coverage. Clear guidance is required to ensure evaluations provide evidence on the best strategies to support equitable access to healthcare, but such guidance rarely exists in current best practice and guidance documents.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e59"},"PeriodicalIF":2.6,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579673/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142647819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-15DOI: 10.1017/S0266462324004665
Hanin Farhana Kamaruzaman, Eleanor Grieve, Ku Nurhasni Ku Abd Rahim, Mmg Izzuna, Lee Sit Wai, Erni Zurina Romli, Mohamed Hirman Abdullah, Olivia Wu
Objectives: Healthcare disinvestment requires multi-level decision-making, and early stakeholder engagement is essential to facilitate implementation and acceptance. This study aimed to explore the perceptions of Malaysian healthcare stakeholders to disinvestment initiatives as well as identify disinvestment activities in the country.
Methods: A cross-sectional online survey was conducted from February to March 2023 among Malaysian healthcare stakeholders involved in resource allocation and decision-making at various levels of governance. Response frequencies were analyzed descriptively and cross-tabulation was performed for specific questions to compare the responses of different groups of stakeholders. For free-text replies, content analysis was used with each verbatim response examined and assigned a theme.
Results: A total of 153 complete responses were analyzed and approximately 37 percent of participants had prior involvement in disinvestment initiatives. Clinical effectiveness and cost-effectiveness ranked as the most important criteria in assessment for disinvestment. Surprisingly, equity was rated the lowest priority despite its crucial role in healthcare decision-making. Almost 90 percent of the respondents concurred that a formal disinvestment framework is necessary and the importance of training for the program's successful implementation. Key obstacles to the adoption of disinvestment include insufficient stakeholder support and political will as well as a lack of expertise in executing the process.
Conclusions: While disinvestment is perceived as a priority for efficient resource allocation in Malaysian healthcare, there is a lack of a systematic framework for its implementation. Future research should prioritize methodological analysis in healthcare disinvestment and strategies for integrating equity considerations in evaluating disinvestment candidates.
{"title":"Stakeholders' perspectives on disinvestment of low-value healthcare interventions and practices in Malaysia: an online survey.","authors":"Hanin Farhana Kamaruzaman, Eleanor Grieve, Ku Nurhasni Ku Abd Rahim, Mmg Izzuna, Lee Sit Wai, Erni Zurina Romli, Mohamed Hirman Abdullah, Olivia Wu","doi":"10.1017/S0266462324004665","DOIUrl":"10.1017/S0266462324004665","url":null,"abstract":"<p><strong>Objectives: </strong>Healthcare disinvestment requires multi-level decision-making, and early stakeholder engagement is essential to facilitate implementation and acceptance. This study aimed to explore the perceptions of Malaysian healthcare stakeholders to disinvestment initiatives as well as identify disinvestment activities in the country.</p><p><strong>Methods: </strong>A cross-sectional online survey was conducted from February to March 2023 among Malaysian healthcare stakeholders involved in resource allocation and decision-making at various levels of governance. Response frequencies were analyzed descriptively and cross-tabulation was performed for specific questions to compare the responses of different groups of stakeholders. For free-text replies, content analysis was used with each verbatim response examined and assigned a theme.</p><p><strong>Results: </strong>A total of 153 complete responses were analyzed and approximately 37 percent of participants had prior involvement in disinvestment initiatives. Clinical effectiveness and cost-effectiveness ranked as the most important criteria in assessment for disinvestment. Surprisingly, equity was rated the lowest priority despite its crucial role in healthcare decision-making. Almost 90 percent of the respondents concurred that a formal disinvestment framework is necessary and the importance of training for the program's successful implementation. Key obstacles to the adoption of disinvestment include insufficient stakeholder support and political will as well as a lack of expertise in executing the process.</p><p><strong>Conclusions: </strong>While disinvestment is perceived as a priority for efficient resource allocation in Malaysian healthcare, there is a lack of a systematic framework for its implementation. Future research should prioritize methodological analysis in healthcare disinvestment and strategies for integrating equity considerations in evaluating disinvestment candidates.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e57"},"PeriodicalIF":2.6,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579699/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142620785","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-14DOI: 10.1017/S0266462324004653
Mint Chan, Yi Wang, Tanainan Chuanchaiyakul, Kinanti Khansa Chavarina, Wanrudee Isaranuwatchai, Yot Teerawattananon
Objectives: The primary objectives of this umbrella review were to (a) quantify the relative importance, of "severity" and "rarity" criteria in health resource allocation; and (b) analyze the contextual factors influencing the relative importance. The secondary objective was to examine how "severity" and "rarity" criteria are defined.
Methods: Searches were carried out in PubMed and Embase to identify eligible systematic reviews. Quality appraisal of systematic reviews was undertaken. From identified systematic reviews, primary studies were extracted and further screened for eligibility. The inclusion of severity and rarity criteria and their respective weights in primary studies were examined. Descriptive and regression analyses were performed.
Results: Twenty-nine systematic reviews were screened, of which nine met the inclusion criteria. Primary studies included in these systematic reviews were retrieved and screened, resulting in forty articles included in the final analysis. Disease severity was more frequently considered (n = 29/40) than disease rarity (n = 23/40) as an evaluation criterion. Out of all cases where both were included as evaluation criteria, disease severity was assigned higher weights 84 percent of the time (n = 21/25).
Conclusions: Our review found consistent evidence that disease severity is more relevant and preferred to rarity as a priority-setting criterion albeit constraints in statistical analysis imposed by limited sample size and data availability. Where funding for rare diseases is concerned, we advocate that decision-makers be explicit in clarifying the significance of disease severity and/or rarity as a value driver behind decisions. Our findings also reinforce the relevance of disease severity as a criterion in priority setting.
{"title":"The relative importance of severity and rarity criteria in health resource allocation: an umbrella review.","authors":"Mint Chan, Yi Wang, Tanainan Chuanchaiyakul, Kinanti Khansa Chavarina, Wanrudee Isaranuwatchai, Yot Teerawattananon","doi":"10.1017/S0266462324004653","DOIUrl":"10.1017/S0266462324004653","url":null,"abstract":"<p><strong>Objectives: </strong>The primary objectives of this umbrella review were to (a) quantify the relative importance, of \"severity\" and \"rarity\" criteria in health resource allocation; and (b) analyze the contextual factors influencing the relative importance. The secondary objective was to examine how \"severity\" and \"rarity\" criteria are defined.</p><p><strong>Methods: </strong>Searches were carried out in PubMed and Embase to identify eligible systematic reviews. Quality appraisal of systematic reviews was undertaken. From identified systematic reviews, primary studies were extracted and further screened for eligibility. The inclusion of severity and rarity criteria and their respective weights in primary studies were examined. Descriptive and regression analyses were performed.</p><p><strong>Results: </strong>Twenty-nine systematic reviews were screened, of which nine met the inclusion criteria. Primary studies included in these systematic reviews were retrieved and screened, resulting in forty articles included in the final analysis. Disease severity was more frequently considered <i>(n</i> = 29/40) than disease rarity (<i>n</i> = 23/40) as an evaluation criterion. Out of all cases where both were included as evaluation criteria, disease severity was assigned higher weights 84 percent of the time (<i>n</i> = 21/25).</p><p><strong>Conclusions: </strong>Our review found consistent evidence that disease severity is more relevant and preferred to rarity as a priority-setting criterion albeit constraints in statistical analysis imposed by limited sample size and data availability. Where funding for rare diseases is concerned, we advocate that decision-makers be explicit in clarifying the significance of disease severity and/or rarity as a value driver behind decisions. Our findings also reinforce the relevance of disease severity as a criterion in priority setting.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e54"},"PeriodicalIF":2.6,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579674/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142620791","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-14DOI: 10.1017/S0266462324000576
Agnes Vitry, Joshua Inglis, Cathy Caird
Objectives: To describe the type of evidence and the clinical benefit of cancer medicines assessed for funding in Australia by the Pharmaceutical Benefits Advisory Committee (PBAC) and to assess it with the European Society of Medical Oncology Magnitude of Clinical Benefit Scale version 1.1 (ESMO-MCBS).
Methods: All data on applications submitted to PBAC between 2010 and 2020 were extracted from PBAC Public Summary Documents available online. ESMO-MCBS ratings were retrieved from the ESMO-MCBS website.
Results: Then, 182 cancer indications for 100 cancer medicines were examined by PBAC, including 124 (68.1 percent) for solid tumors and 58 (31.9 percent) for hematological cancers. A total of 137 (75.3 percent) indications were recommended for PBS funding and 40 (21.9 percent) were rejected. Randomized clinical trials (RCTs) were the main source of evidence in 154 indications (84.6 percent), single-arm studies in 28 (15.4 percent) indications. Statistically significant improvement in overall survival (OS) was reported in 80 (44 percent) of the indications, with a median OS gain of 3.0 months (range 0.9-17.0) for solid tumors and 8.2 months (range 1-49.1) for hematological cancers when mature OS data were available. The ESMO-MCBS score was available for 99 solid tumor indications, of which 51 (51.5 percent) showed substantial clinical benefit according to ESMO-MCBS, including 40 (54.1 percent) of PBAC-recommended indications and 9 (42.9 percent) of PBAC-rejected indications. There was no association between the ESMO scoring and PBAC decision.
Conclusions: Most cancer medicines indications considered by PBAC were supported by RCTs. A minority showed a substantial improvement in OS.
{"title":"Evidence of clinical benefit of cancer medicines considered for funding in Australia.","authors":"Agnes Vitry, Joshua Inglis, Cathy Caird","doi":"10.1017/S0266462324000576","DOIUrl":"10.1017/S0266462324000576","url":null,"abstract":"<p><strong>Objectives: </strong>To describe the type of evidence and the clinical benefit of cancer medicines assessed for funding in Australia by the Pharmaceutical Benefits Advisory Committee (PBAC) and to assess it with the European Society of Medical Oncology Magnitude of Clinical Benefit Scale version 1.1 (ESMO-MCBS).</p><p><strong>Methods: </strong>All data on applications submitted to PBAC between 2010 and 2020 were extracted from PBAC Public Summary Documents available online. ESMO-MCBS ratings were retrieved from the ESMO-MCBS website.</p><p><strong>Results: </strong>Then, 182 cancer indications for 100 cancer medicines were examined by PBAC, including 124 (68.1 percent) for solid tumors and 58 (31.9 percent) for hematological cancers. A total of 137 (75.3 percent) indications were recommended for PBS funding and 40 (21.9 percent) were rejected. Randomized clinical trials (RCTs) were the main source of evidence in 154 indications (84.6 percent), single-arm studies in 28 (15.4 percent) indications. Statistically significant improvement in overall survival (OS) was reported in 80 (44 percent) of the indications, with a median OS gain of 3.0 months (range 0.9-17.0) for solid tumors and 8.2 months (range 1-49.1) for hematological cancers when mature OS data were available. The ESMO-MCBS score was available for 99 solid tumor indications, of which 51 (51.5 percent) showed substantial clinical benefit according to ESMO-MCBS, including 40 (54.1 percent) of PBAC-recommended indications and 9 (42.9 percent) of PBAC-rejected indications. There was no association between the ESMO scoring and PBAC decision.</p><p><strong>Conclusions: </strong>Most cancer medicines indications considered by PBAC were supported by RCTs. A minority showed a substantial improvement in OS.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e55"},"PeriodicalIF":2.6,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579664/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142620801","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-14DOI: 10.1017/S0266462324000370
Ashkan Baradaran, Raymond Tolentino, Roland Grad, Isabelle Ganache, Geneviève Gore, Samira Abbasgholizadeh Rahimi, Pierre Pluye
Background: Health technology assessment (HTA) organizations generate guidelines to inform healthcare practices toward improved health outcomes. This review sought to identify and classify outcomes of guidelines from HTA organizations within published research.
Methodology: We performed a systematic mixed studies review of empirical studies that (a) referred to a published guideline from an HTA organization and (b) reported an outcome resulting from a guideline. We searched the published literature in English or French within seven databases. Outcome types were classified within five dimensions of an existing framework for online health information (e.g., relevance, cognitive/affective impact, and use). Subdimensions were inductively developed. A two-phase sequential data synthesis was performed. Phase 1: a hybrid deductive-inductive thematic analysis identified the types of outcomes and displayed their relationships on a concept map. Phase 2: descriptive statistics were tabulated by the type of outcome.
Results: A total of 6,719 records were retrieved through searches on 6 February 2023. After screening, we included 120 observational studies (twenty-one qualitative, ninety-four quantitative, and five mixed methods). Phase 1 identified twenty-nine types of outcomes. The most frequently reported outcomes were within the organizational dimension (reported in ninety-four studies). The most common subdimensions were "Referrals" (thirty-eight occurrences), the "Quality of Prescriptions" (fifteen occurrences), and the "Quality of Diagnosis" (eight occurrences). For Phase 2, we could only generate descriptive statistics on seventeen outcomes. These were almost equally distributed among positive, neutral, and negative effects. Our results contribute to knowledge about the outcomes of HTA guidelines and options for documenting and measuring them in future evaluations.
{"title":"Outcomes of guidelines from health technology assessment organizations in community-based primary care: a systematic mixed studies review.","authors":"Ashkan Baradaran, Raymond Tolentino, Roland Grad, Isabelle Ganache, Geneviève Gore, Samira Abbasgholizadeh Rahimi, Pierre Pluye","doi":"10.1017/S0266462324000370","DOIUrl":"10.1017/S0266462324000370","url":null,"abstract":"<p><strong>Background: </strong>Health technology assessment (HTA) organizations generate guidelines to inform healthcare practices toward improved health outcomes. This review sought to identify and classify outcomes of guidelines from HTA organizations within published research.</p><p><strong>Methodology: </strong>We performed a systematic mixed studies review of empirical studies that (a) referred to a published guideline from an HTA organization and (b) reported an outcome resulting from a guideline. We searched the published literature in English or French within seven databases. Outcome types were classified within five dimensions of an existing framework for online health information (e.g., relevance, cognitive/affective impact, and use). Subdimensions were inductively developed. A two-phase sequential data synthesis was performed. Phase 1: a hybrid deductive-inductive thematic analysis identified the types of outcomes and displayed their relationships on a concept map. Phase 2: descriptive statistics were tabulated by the type of outcome.</p><p><strong>Results: </strong>A total of 6,719 records were retrieved through searches on 6 February 2023. After screening, we included 120 observational studies (twenty-one qualitative, ninety-four quantitative, and five mixed methods). Phase 1 identified twenty-nine types of outcomes. The most frequently reported outcomes were within the organizational dimension (reported in ninety-four studies). The most common subdimensions were \"Referrals\" (thirty-eight occurrences), the \"Quality of Prescriptions\" (fifteen occurrences), and the \"Quality of Diagnosis\" (eight occurrences). For Phase 2, we could only generate descriptive statistics on seventeen outcomes. These were almost equally distributed among positive, neutral, and negative effects. Our results contribute to knowledge about the outcomes of HTA guidelines and options for documenting and measuring them in future evaluations.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e56"},"PeriodicalIF":2.6,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579698/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142620828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-13DOI: 10.1017/S0266462324000369
Marilia Mastrocolla de Almeida Cardoso, Rafael Thomaz Marques, Juliana Machado-Rugolo, Lehana Thabane, Vilanice Alves de Araújo Püschel, Silke Anna Theresa Weber, Rosimary Terezinha Almeida, Graciela Paula do Nascimento Duque, Cristiane Cardoso De Paula, Luciane Cruz Lopes, Mariana Gabriel, Sybelle Drumond, Clarice Maria Rodrigues, Meredith Vanstone
Objectives: Health Technology Assessment (HTA) practitioners recognize the significance of qualitative methodologies that focus on how a technology is feasible, meaningfulness, acceptable, and equitable. This mapping aimed to delineate the frameworks employed to synthesize qualitative evidence and assess the quality of synthesis in HTA .
Methods: Mapping was conducted using Medline, LILACS, CINAHL, Embase, Web of Science, Scopus, PsycINFO, Cochrane Library, JBI, and ScienceDirect databases. Gray literature searches included PROQUEST, Open Grey, Canadian Agency for Drugs and Technologies in Health's Grey Matters, Google Scholar, and HTA agency websites. The inclusion criteria were centered on global qualitative evidence synthesis frameworks. The data are presented in the tables.
Results: Of the 2054 articles, 31 were included, mostly from Europe. Guide was the type of document more cited, and most authors are from HTA agencies and universities. Incorporating both patient and family perspectives is the most cited reason for include qualitative evidence. Regardless of the framework or tool, SPICE was the main acronym, and RETREAT was preferred for approach selection. Thematic synthesis dominated analytic methods, and CASP was the primary quality appraisal tool. GRADE-CERQual graded evidence synthesis, with ENTREQ as the top reporting guidance. The GRADE evidence-to-decision framework was mentioned for recommendations.
Conclusion: This mapping highlights the movement incorporate qualitative evidence in HTA employing specific frameworks. Despite the similarities among documents, most of them describe part of the process to synthesize qualitative evidence. Standardizing procedures to incorporate qualitative evidence into HTA can enhance decision-making. These findings offer essential considerations for HTA practice.
{"title":"Mapping frameworks for synthesizing qualitative evidence in health technology assessment.","authors":"Marilia Mastrocolla de Almeida Cardoso, Rafael Thomaz Marques, Juliana Machado-Rugolo, Lehana Thabane, Vilanice Alves de Araújo Püschel, Silke Anna Theresa Weber, Rosimary Terezinha Almeida, Graciela Paula do Nascimento Duque, Cristiane Cardoso De Paula, Luciane Cruz Lopes, Mariana Gabriel, Sybelle Drumond, Clarice Maria Rodrigues, Meredith Vanstone","doi":"10.1017/S0266462324000369","DOIUrl":"10.1017/S0266462324000369","url":null,"abstract":"<p><strong>Objectives: </strong>Health Technology Assessment (HTA) practitioners recognize the significance of qualitative methodologies that focus on how a technology is feasible, meaningfulness, acceptable, and equitable. This mapping aimed to delineate the frameworks employed to synthesize qualitative evidence and assess the quality of synthesis in HTA .</p><p><strong>Methods: </strong>Mapping was conducted using Medline, LILACS, CINAHL, Embase, Web of Science, Scopus, PsycINFO, Cochrane Library, JBI, and ScienceDirect databases. Gray literature searches included PROQUEST, Open Grey, Canadian Agency for Drugs and Technologies in Health's Grey Matters, Google Scholar, and HTA agency websites. The inclusion criteria were centered on global qualitative evidence synthesis frameworks. The data are presented in the tables.</p><p><strong>Results: </strong>Of the 2054 articles, 31 were included, mostly from Europe. Guide was the type of document more cited, and most authors are from HTA agencies and universities. Incorporating both patient and family perspectives is the most cited reason for include qualitative evidence. Regardless of the framework or tool, SPICE was the main acronym, and RETREAT was preferred for approach selection. Thematic synthesis dominated analytic methods, and CASP was the primary quality appraisal tool. GRADE-CERQual graded evidence synthesis, with ENTREQ as the top reporting guidance. The GRADE evidence-to-decision framework was mentioned for recommendations.</p><p><strong>Conclusion: </strong>This mapping highlights the movement incorporate qualitative evidence in HTA employing specific frameworks. Despite the similarities among documents, most of them describe part of the process to synthesize qualitative evidence. Standardizing procedures to incorporate qualitative evidence into HTA can enhance decision-making. These findings offer essential considerations for HTA practice.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e53"},"PeriodicalIF":2.6,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579671/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142620806","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-11DOI: 10.1017/S0266462324000400
Veronica Lopez Gousset, Aline Silveira Silva, Anke-Peggy Holtorf, Ana Toledo-Chávarri, Ann Single
Objectives: Evaluating the impact of patient involvement in health technology assessments (HTA) may help improve practices and avoid ineffective activities. Evaluation, however, continues to be infrequent, inconsistent, and often only relates to process quantity or quality. The Patient and Citizen Involvement in HTA Interest Group (PCIG) within Health Technology Assessment International set out to contextualize this impact to support evaluation.
Methods: Given the lack of established methodology to measure impact, the team performed a qualitative analysis of first-hand accounts about perceived changes in HTA due to involvement of patient stakeholders. A questionnaire was developed, piloted, and rolled out to collect personal perspectives from stakeholders with relevant experience. The stories were analyzed in the aggregate to identify themes in the data.
Results: From January 2019 to September 2021, twenty-four responses were collected through PCIG's network. Responses (including one joint industry-HTA body submission) came from patient representatives (12), HTA bodies (11), and industry representatives (2) from North America (5), South America (3), Europe (13), and Asia Pacific (3). Based on themes commonly reported, a three-domain framework for evaluating impact is proposed: impact on basis of HTA result or recommendation, impact on HTA body, and impact on patient participants. The framework includes components under each domain to support reporting.
Conclusions: Using the Three-Domain Impact Framework may be useful in identifying, evaluating, and communicating the value of patient involvement in HTA. Enhancing and increasing reporting practices may improve transparency and facilitate process improvements for meaningful integration of patient stakeholders into HTA appraisals across jurisdictions.
{"title":"The three-domain impact framework for characterizing impact of patient involvement in health technology assessment.","authors":"Veronica Lopez Gousset, Aline Silveira Silva, Anke-Peggy Holtorf, Ana Toledo-Chávarri, Ann Single","doi":"10.1017/S0266462324000400","DOIUrl":"10.1017/S0266462324000400","url":null,"abstract":"<p><strong>Objectives: </strong>Evaluating the impact of patient involvement in health technology assessments (HTA) may help improve practices and avoid ineffective activities. Evaluation, however, continues to be infrequent, inconsistent, and often only relates to process quantity or quality. The Patient and Citizen Involvement in HTA Interest Group (PCIG) within Health Technology Assessment International set out to contextualize this impact to support evaluation.</p><p><strong>Methods: </strong>Given the lack of established methodology to measure impact, the team performed a qualitative analysis of first-hand accounts about perceived changes in HTA due to involvement of patient stakeholders. A questionnaire was developed, piloted, and rolled out to collect personal perspectives from stakeholders with relevant experience. The stories were analyzed in the aggregate to identify themes in the data.</p><p><strong>Results: </strong>From January 2019 to September 2021, twenty-four responses were collected through PCIG's network. Responses (including one joint industry-HTA body submission) came from patient representatives (12), HTA bodies (11), and industry representatives (2) from North America (5), South America (3), Europe (13), and Asia Pacific (3). Based on themes commonly reported, a three-domain framework for evaluating impact is proposed: impact on basis of HTA result or recommendation, impact on HTA body, and impact on patient participants. The framework includes components under each domain to support reporting.</p><p><strong>Conclusions: </strong>Using the Three-Domain Impact Framework may be useful in identifying, evaluating, and communicating the value of patient involvement in HTA. Enhancing and increasing reporting practices may improve transparency and facilitate process improvements for meaningful integration of patient stakeholders into HTA appraisals across jurisdictions.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e52"},"PeriodicalIF":2.6,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11579675/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142620810","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-11-05DOI: 10.1017/S0266462324000564
Li Jiu, Junfeng Wang, Jan-Willem Versteeg, Yingying Zhang, Lifang Liu, Francisco Javier Somolinos-Simón, Jose Tapia-Galisteo, Gema García-Sáez, Milou A Hogervorst, Xinyu Li, Aukje K Mantel-Teeuwisse, Wim G Goettsch
Objectives: A conceptual framework, called Innovation of Health Technology Assessment Methods (IHTAM), has been developed to facilitate the understanding of how to innovate methods of health technology assessment (HTA). However, the framework applicability has not been evaluated in practice. Hence, we aimed to explore framework applicability in three cases of method innovation that are part of the HTx project and to develop a roadmap to improve framework applicability.
Methods: The IHTAM framework was applied to three cases of innovating HTA methods. We collected feedback from case study leaders and consortium members after a training session, an approximately 1-year follow-up of periodic case study meetings, and a general assembly meeting where innovation progresses of the three cases were reported through surveys and interviews. Feedback was then summarized using an open-coding technique.
Results: According to feedback, the framework provided a structured way of deliberation and helped to improve collaboration among HTA stakeholders. However, framework applicability could be improved if it was complemented by a roadmap with a loop structure to provide tailored guidance for different cases, and with items to elaborate actions to be taken by stakeholders. Accordingly, a 48-item roadmap was developed.
Conclusions: The IHTAM framework was generally applicable to the three case studies. A roadmap, with loop structure and actionable items, could complement the framework, and may provide HTA stakeholders with tailored guidance on developing new methods. To further examine the framework applicability, we recommend stakeholders to apply the IHTAM framework and its roadmap in future practice.
{"title":"Roadmap to Innovation of HTA Methods (IHTAM): insights from three case studies of quantitative methods.","authors":"Li Jiu, Junfeng Wang, Jan-Willem Versteeg, Yingying Zhang, Lifang Liu, Francisco Javier Somolinos-Simón, Jose Tapia-Galisteo, Gema García-Sáez, Milou A Hogervorst, Xinyu Li, Aukje K Mantel-Teeuwisse, Wim G Goettsch","doi":"10.1017/S0266462324000564","DOIUrl":"10.1017/S0266462324000564","url":null,"abstract":"<p><strong>Objectives: </strong>A conceptual framework, called Innovation of Health Technology Assessment Methods (IHTAM), has been developed to facilitate the understanding of how to innovate methods of health technology assessment (HTA). However, the framework applicability has not been evaluated in practice. Hence, we aimed to explore framework applicability in three cases of method innovation that are part of the HTx project and to develop a roadmap to improve framework applicability.</p><p><strong>Methods: </strong>The IHTAM framework was applied to three cases of innovating HTA methods. We collected feedback from case study leaders and consortium members after a training session, an approximately 1-year follow-up of periodic case study meetings, and a general assembly meeting where innovation progresses of the three cases were reported through surveys and interviews. Feedback was then summarized using an open-coding technique.</p><p><strong>Results: </strong>According to feedback, the framework provided a structured way of deliberation and helped to improve collaboration among HTA stakeholders. However, framework applicability could be improved if it was complemented by a roadmap with a loop structure to provide tailored guidance for different cases, and with items to elaborate actions to be taken by stakeholders. Accordingly, a 48-item roadmap was developed.</p><p><strong>Conclusions: </strong>The IHTAM framework was generally applicable to the three case studies. A roadmap, with loop structure and actionable items, could complement the framework, and may provide HTA stakeholders with tailored guidance on developing new methods. To further examine the framework applicability, we recommend stakeholders to apply the IHTAM framework and its roadmap in future practice.</p>","PeriodicalId":14467,"journal":{"name":"International Journal of Technology Assessment in Health Care","volume":"40 1","pages":"e49"},"PeriodicalIF":2.6,"publicationDate":"2024-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11563180/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142575922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}