谁在控制谁?重新构建安全领域人工智能系统的“有意义的人类控制”。

IF 3.4 2区 哲学 Q1 ETHICS Ethics and Information Technology Pub Date : 2023-01-01 DOI:10.1007/s10676-023-09686-x
Markus Christen, Thomas Burri, Serhiy Kandul, Pascal Vörös
{"title":"谁在控制谁?重新构建安全领域人工智能系统的“有意义的人类控制”。","authors":"Markus Christen,&nbsp;Thomas Burri,&nbsp;Serhiy Kandul,&nbsp;Pascal Vörös","doi":"10.1007/s10676-023-09686-x","DOIUrl":null,"url":null,"abstract":"<p><p>Decisions in security contexts, including armed conflict, law enforcement, and disaster relief, often need to be taken under circumstances of limited information, stress, and time pressure. Since AI systems are capable of providing a certain amount of relief in such contexts, such systems will become increasingly important, be it as decision-support or decision-making systems. However, given that human life may be at stake in such situations, moral responsibility for such decisions should remain with humans. Hence the idea of \"meaningful human control\" of intelligent systems. In this opinion paper, we outline generic configurations of control of AI and we present an alternative to human control of AI, namely the inverse idea of having AI control humans, and we discuss the normative consequences of this alternative.</p>","PeriodicalId":51495,"journal":{"name":"Ethics and Information Technology","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9918557/pdf/","citationCount":"4","resultStr":"{\"title\":\"Who is controlling whom? Reframing \\\"meaningful human control\\\" of AI systems in security.\",\"authors\":\"Markus Christen,&nbsp;Thomas Burri,&nbsp;Serhiy Kandul,&nbsp;Pascal Vörös\",\"doi\":\"10.1007/s10676-023-09686-x\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Decisions in security contexts, including armed conflict, law enforcement, and disaster relief, often need to be taken under circumstances of limited information, stress, and time pressure. Since AI systems are capable of providing a certain amount of relief in such contexts, such systems will become increasingly important, be it as decision-support or decision-making systems. However, given that human life may be at stake in such situations, moral responsibility for such decisions should remain with humans. Hence the idea of \\\"meaningful human control\\\" of intelligent systems. In this opinion paper, we outline generic configurations of control of AI and we present an alternative to human control of AI, namely the inverse idea of having AI control humans, and we discuss the normative consequences of this alternative.</p>\",\"PeriodicalId\":51495,\"journal\":{\"name\":\"Ethics and Information Technology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9918557/pdf/\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ethics and Information Technology\",\"FirstCategoryId\":\"91\",\"ListUrlMain\":\"https://doi.org/10.1007/s10676-023-09686-x\",\"RegionNum\":2,\"RegionCategory\":\"哲学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ETHICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ethics and Information Technology","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1007/s10676-023-09686-x","RegionNum":2,"RegionCategory":"哲学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ETHICS","Score":null,"Total":0}
引用次数: 4

摘要

安全环境中的决策,包括武装冲突、执法和救灾,通常需要在信息有限、压力和时间压力的情况下做出。由于人工智能系统能够在这种情况下提供一定程度的救济,因此这种系统将变得越来越重要,无论是作为决策支持还是决策系统。然而,鉴于人的生命可能在这种情况下受到威胁,这种决定的道德责任应该由人类承担。因此才有了对智能系统进行“有意义的人类控制”的想法。在这篇观点论文中,我们概述了人工智能控制的一般配置,并提出了人类控制人工智能的替代方案,即让人工智能控制人类的相反想法,我们讨论了这种替代方案的规范后果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。

摘要图片

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Who is controlling whom? Reframing "meaningful human control" of AI systems in security.

Decisions in security contexts, including armed conflict, law enforcement, and disaster relief, often need to be taken under circumstances of limited information, stress, and time pressure. Since AI systems are capable of providing a certain amount of relief in such contexts, such systems will become increasingly important, be it as decision-support or decision-making systems. However, given that human life may be at stake in such situations, moral responsibility for such decisions should remain with humans. Hence the idea of "meaningful human control" of intelligent systems. In this opinion paper, we outline generic configurations of control of AI and we present an alternative to human control of AI, namely the inverse idea of having AI control humans, and we discuss the normative consequences of this alternative.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
8.20
自引率
5.60%
发文量
46
期刊介绍: Ethics and Information Technology is a peer-reviewed journal dedicated to advancing the dialogue between moral philosophy and the field of information and communication technology (ICT). The journal aims to foster and promote reflection and analysis which is intended to make a constructive contribution to answering the ethical, social and political questions associated with the adoption, use, and development of ICT. Within the scope of the journal are also conceptual analysis and discussion of ethical ICT issues which arise in the context of technology assessment, cultural studies, public policy analysis and public administration, cognitive science, social and anthropological studies in technology, mass-communication, and legal studies.
期刊最新文献
Conceptualizing understanding in explainable artificial intelligence (XAI): an abilities-based approach Deconstructing controversies to design a trustworthy AI future Transparency for AI systems: a value-based approach Undisruptable or stable concepts: can we design concepts that can avoid conceptual disruption, normative critique, and counterexamples? Ludic resistance: a new solution to the gamer’s paradox
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1