There is mounting global interest in the revolutionary potential of AI tools. However, its use in healthcare carries certain risks. Some argue that opaque (‘black box’) AI systems in particular undermine patients' informed consent. While interpretable models offer an alternative, this approach may be impossible with generative AI and large language models (LLMs). Thus, we propose that AI tools should be evaluated for clinical use based on their implementation risk, rather than interpretability. We introduce a practical decision algorithm for the clinical implementation of black-box AI by evaluating its risk of implementation. Applied to the case of an LLM for surgical informed consent, we assess a system's implementation risk by evaluating: (1) technical robustness, (2) implementation feasibility and (3) analysis of harms and benefits. Accordingly, the system is categorised as minimal-risk (standard use), moderate-risk (innovative use) or high-risk (experimental use). Recommendations for implementation are proportional to risk, requiring more oversight for higher-risk categories. The algorithm also considers the system's cost-effectiveness and patients' informed consent.
{"title":"When Is It Safe to Introduce an AI System Into Healthcare? A Practical Decision Algorithm for the Ethical Implementation of Black-Box AI in Medicine","authors":"Jemima Winifred Allen, Dominic Wilkinson, Julian Savulescu","doi":"10.1111/bioe.70032","DOIUrl":"10.1111/bioe.70032","url":null,"abstract":"<p>There is mounting global interest in the revolutionary potential of AI tools. However, its use in healthcare carries certain risks. Some argue that opaque (‘black box’) AI systems in particular undermine patients' informed consent. While interpretable models offer an alternative, this approach may be impossible with generative AI and large language models (LLMs). Thus, we propose that AI tools should be evaluated for clinical use based on their implementation risk, rather than interpretability. We introduce a practical decision algorithm for the clinical implementation of black-box AI by evaluating its risk of implementation. Applied to the case of an LLM for surgical informed consent, we assess a system's implementation risk by evaluating: (1) technical robustness, (2) implementation feasibility and (3) analysis of harms and benefits. Accordingly, the system is categorised as minimal-risk (standard use), moderate-risk (innovative use) or high-risk (experimental use). Recommendations for implementation are proportional to risk, requiring more oversight for higher-risk categories. The algorithm also considers the system's cost-effectiveness and patients' informed consent.</p>","PeriodicalId":55379,"journal":{"name":"Bioethics","volume":"40 1","pages":"61-72"},"PeriodicalIF":2.1,"publicationDate":"2025-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12710678/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145082534","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"哲学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study examines the violence inflicted upon Palestinians in Israeli prisons during the initial phase of the "Iron Swords" war, which commenced following a Hamas attack on Israeli civilians on October 7, 2023. It investigates how wartime circumstances can intensify the use of torture and ill-treatment within prisons, with a particular focus on the impact on detainees who were not implicated in activities connected to the attack. Utilizing the case files of Palestinian security prisoners who lodged complaints of mistreatment with Israeli NGOs, the study uses descriptive analysis to categorize and quantify diverse forms of reported violence that could potentially constitute torture. The study's findings reveal a concerning pattern: all 19 subjects reported experiencing violence from prison staff, with 18 of these cases involving physical violence. Multiple claims referenced more than one instance of violence, and eleven claims additionally reported violence against other detainees. The claims of violence spanned seven different prisons, underscoring the systemic nature of the issue. Reported methods of violence encompassed beatings, forced positioning in painful postures, threats, and humiliation, sometimes with sexual undertones, among other forms of abuse. Seven subjects had visible bruises and wounds, two suffered broken limbs, and one sustained a fractured tooth. These findings suggest a correlation between war, a decline in ethical standards, and the abuse of prisoners. By bringing these issues to light, the study advocates for evaluating prison practices and a commitment to upholding human rights standards, even during violent conflict and war.
{"title":"Violence Toward Palestinians in Israeli Prisons During the \"Iron Swords\" War.","authors":"Daniel J N Weishut, Bettina Steiner-Birmanns","doi":"10.1111/bioe.70034","DOIUrl":"https://doi.org/10.1111/bioe.70034","url":null,"abstract":"<p><p>This study examines the violence inflicted upon Palestinians in Israeli prisons during the initial phase of the \"Iron Swords\" war, which commenced following a Hamas attack on Israeli civilians on October 7, 2023. It investigates how wartime circumstances can intensify the use of torture and ill-treatment within prisons, with a particular focus on the impact on detainees who were not implicated in activities connected to the attack. Utilizing the case files of Palestinian security prisoners who lodged complaints of mistreatment with Israeli NGOs, the study uses descriptive analysis to categorize and quantify diverse forms of reported violence that could potentially constitute torture. The study's findings reveal a concerning pattern: all 19 subjects reported experiencing violence from prison staff, with 18 of these cases involving physical violence. Multiple claims referenced more than one instance of violence, and eleven claims additionally reported violence against other detainees. The claims of violence spanned seven different prisons, underscoring the systemic nature of the issue. Reported methods of violence encompassed beatings, forced positioning in painful postures, threats, and humiliation, sometimes with sexual undertones, among other forms of abuse. Seven subjects had visible bruises and wounds, two suffered broken limbs, and one sustained a fractured tooth. These findings suggest a correlation between war, a decline in ethical standards, and the abuse of prisoners. By bringing these issues to light, the study advocates for evaluating prison practices and a commitment to upholding human rights standards, even during violent conflict and war.</p>","PeriodicalId":55379,"journal":{"name":"Bioethics","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145066301","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"哲学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Patrick Schuchter, Sandra Radinger, Stefanie Veronika Rieger, Klaus Wegleitner
This paper argues that philosophical practice can complement existing medical ethics structures by offering a publicly accessible space for discourse and negotiation of basic concepts that are relevant to ethical decision making. The potential of collaboration becomes particularly evident by the example of assisted dying: it raises a wide range of philosophical questions which, however, tend to remain unarticulated where there is urgency for action and focus on ethical dilemma. In this paper, we first provide an analysis of the neglect of profound questions in ethics consultation and why these need to be considered and negotiated within a broader socio-philosophical framework and place. These reflections are grounded in conceptual approaches informed by Immanuel Kant, Charles Taylor, and the tradition of Hellenistic philosophy as interpreted by Pierre Hadot. These frameworks are not presented as final answers, but as productive starting points and historically significant philosophical thought figures for engaging with the complex philosophical dimensions of assisted suicide. Then, we draw upon insights from an ongoing research project on philosophical practice in palliative care and hospice work. Interim results indicate that people experience a need for a kind of dialogue that gives such philosophical considerations a space and a person who is capable of facilitating it. Synthesizing theoretical-philosophical and empirical insights, the paper provides an outlook for fruitful collaboration amongst medical ethics structures and philosophical practice.
{"title":"Thoughtful Accompaniment in Life's Final Stages: Philosophical Practice as a Complement to Ethics Consultation.","authors":"Patrick Schuchter, Sandra Radinger, Stefanie Veronika Rieger, Klaus Wegleitner","doi":"10.1111/bioe.70031","DOIUrl":"https://doi.org/10.1111/bioe.70031","url":null,"abstract":"<p><p>This paper argues that philosophical practice can complement existing medical ethics structures by offering a publicly accessible space for discourse and negotiation of basic concepts that are relevant to ethical decision making. The potential of collaboration becomes particularly evident by the example of assisted dying: it raises a wide range of philosophical questions which, however, tend to remain unarticulated where there is urgency for action and focus on ethical dilemma. In this paper, we first provide an analysis of the neglect of profound questions in ethics consultation and why these need to be considered and negotiated within a broader socio-philosophical framework and place. These reflections are grounded in conceptual approaches informed by Immanuel Kant, Charles Taylor, and the tradition of Hellenistic philosophy as interpreted by Pierre Hadot. These frameworks are not presented as final answers, but as productive starting points and historically significant philosophical thought figures for engaging with the complex philosophical dimensions of assisted suicide. Then, we draw upon insights from an ongoing research project on philosophical practice in palliative care and hospice work. Interim results indicate that people experience a need for a kind of dialogue that gives such philosophical considerations a space and a person who is capable of facilitating it. Synthesizing theoretical-philosophical and empirical insights, the paper provides an outlook for fruitful collaboration amongst medical ethics structures and philosophical practice.</p>","PeriodicalId":55379,"journal":{"name":"Bioethics","volume":" ","pages":""},"PeriodicalIF":2.1,"publicationDate":"2025-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145042289","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"哲学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}