Bart-Jan Boverhof , W. Ken Redekop , Jacob J. Visser , Carin A. Uyl-de Groot , Maureen P.M.H. Rutten-van Mölken
{"title":"Broadening the HTA of medical AI: A review of the literature to inform a tailored approach","authors":"Bart-Jan Boverhof , W. Ken Redekop , Jacob J. Visser , Carin A. Uyl-de Groot , Maureen P.M.H. Rutten-van Mölken","doi":"10.1016/j.hlpt.2024.100868","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><p>As current health technology assessment (HTA) frameworks do not provide specific guidance on the assessment of medical artificial intelligence (AI), this study aimed to propose a conceptual framework for a broad HTA of medical AI.</p></div><div><h3>Methods</h3><p>A systematic literature review and a targeted search of policy documents was conducted to distill the relevant medical AI assessment elements. Three exemplary cases were selected to illustrate various elements: (1) An application supporting radiologists in stroke-care (2) A natural language processing application for clinical data abstraction (3) An ICU-discharge decision-making application.</p></div><div><h3>Results</h3><p>A total of 31 policy documents and 9 academic publications were selected, from which a list of 29 issues was distilled. The issues were grouped by four focus areas: (1) Technology & Performance, (2) Human & Organizational, (3) Legal & Ethical and (4) Transparency & Usability. Each assessment element was extensively discussed in the test, and the elements clinical effectiveness, clinical workflow, workforce, interoperability, fairness and explainability were further highlighted through the exemplary cases.</p></div><div><h3>Conclusion</h3><p>The current methodology of HTA requires extension to make it suitable for a broad evaluation of medical AI technologies. The 29-item assessment list that we propose needs a tailored approach for distinct types of medical AI, since the conceptualisation of the issues differs across applications.</p></div>","PeriodicalId":48672,"journal":{"name":"Health Policy and Technology","volume":"13 2","pages":"Article 100868"},"PeriodicalIF":3.4000,"publicationDate":"2024-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2211883724000315/pdfft?md5=04f79e9b441dc321ec2e43d52e5e04eb&pid=1-s2.0-S2211883724000315-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Health Policy and Technology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2211883724000315","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH POLICY & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives
As current health technology assessment (HTA) frameworks do not provide specific guidance on the assessment of medical artificial intelligence (AI), this study aimed to propose a conceptual framework for a broad HTA of medical AI.
Methods
A systematic literature review and a targeted search of policy documents was conducted to distill the relevant medical AI assessment elements. Three exemplary cases were selected to illustrate various elements: (1) An application supporting radiologists in stroke-care (2) A natural language processing application for clinical data abstraction (3) An ICU-discharge decision-making application.
Results
A total of 31 policy documents and 9 academic publications were selected, from which a list of 29 issues was distilled. The issues were grouped by four focus areas: (1) Technology & Performance, (2) Human & Organizational, (3) Legal & Ethical and (4) Transparency & Usability. Each assessment element was extensively discussed in the test, and the elements clinical effectiveness, clinical workflow, workforce, interoperability, fairness and explainability were further highlighted through the exemplary cases.
Conclusion
The current methodology of HTA requires extension to make it suitable for a broad evaluation of medical AI technologies. The 29-item assessment list that we propose needs a tailored approach for distinct types of medical AI, since the conceptualisation of the issues differs across applications.
期刊介绍:
Health Policy and Technology (HPT), is the official journal of the Fellowship of Postgraduate Medicine (FPM), a cross-disciplinary journal, which focuses on past, present and future health policy and the role of technology in clinical and non-clinical national and international health environments.
HPT provides a further excellent way for the FPM to continue to make important national and international contributions to development of policy and practice within medicine and related disciplines. The aim of HPT is to publish relevant, timely and accessible articles and commentaries to support policy-makers, health professionals, health technology providers, patient groups and academia interested in health policy and technology.
Topics covered by HPT will include:
- Health technology, including drug discovery, diagnostics, medicines, devices, therapeutic delivery and eHealth systems
- Cross-national comparisons on health policy using evidence-based approaches
- National studies on health policy to determine the outcomes of technology-driven initiatives
- Cross-border eHealth including health tourism
- The digital divide in mobility, access and affordability of healthcare
- Health technology assessment (HTA) methods and tools for evaluating the effectiveness of clinical and non-clinical health technologies
- Health and eHealth indicators and benchmarks (measure/metrics) for understanding the adoption and diffusion of health technologies
- Health and eHealth models and frameworks to support policy-makers and other stakeholders in decision-making
- Stakeholder engagement with health technologies (clinical and patient/citizen buy-in)
- Regulation and health economics