{"title":"Beyond A Reasonable Doubt? Audiovisual Evidence, AI Manipulation, Deepfakes, and the Law","authors":"Yvonne Apolo;Katina Michael","doi":"10.1109/TTS.2024.3427816","DOIUrl":null,"url":null,"abstract":"THE CAPTURE is a mystery thriller series, that completed its second season on Peacock and BBC One. The British television drama revolves around the alteration of direct audiovisual evidence on the command of a special unit that believes there is enough circumstantial evidence to either convict or acquit an individual of a felony. Based on the plot of the television series, this paper explores the potential for a variety of AI-enabled applications to be used in the course of criminal proceedings. The implications of evidence tampering are considered through AI manipulation toward the realization that deepfake evidence may well be admitted in court dependent on the human decision-maker. Will the future demand the interpolation of visual evidence for high profile criminal cases, and what does the existence of Generative AI and deepfakes mean for the forensic analysis of audiovisual evidence? After contemplating the socio-technical plausibility of the central premise of THE CAPTURE, this paper then turns to its legal implications. Drawing on examples from U.S. and Australian legal frameworks, the paper considers the consequences of AI-corrected, augmented or generated audiovisual evidence on three facets of natural justice: (1) the presumption of innocence; (2) the fair trial; and (3) lawyers’ ethical duties of competence and to the administration of justice. The key takeaways of the paper are that: (1) deepfake evidence will continue to proliferate; (2) that the law will need to address both the substantive and procedural impacts of such evidence, and (3) that the legal profession must continue to educate its lawyers and practitioners, and associated stakeholders, of the nature, uses and risks posed by deepfake audiovisual artefacts to maintain public trust in the legal system.","PeriodicalId":73324,"journal":{"name":"IEEE transactions on technology and society","volume":"5 2","pages":"156-168"},"PeriodicalIF":0.0000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on technology and society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10632877/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
THE CAPTURE is a mystery thriller series, that completed its second season on Peacock and BBC One. The British television drama revolves around the alteration of direct audiovisual evidence on the command of a special unit that believes there is enough circumstantial evidence to either convict or acquit an individual of a felony. Based on the plot of the television series, this paper explores the potential for a variety of AI-enabled applications to be used in the course of criminal proceedings. The implications of evidence tampering are considered through AI manipulation toward the realization that deepfake evidence may well be admitted in court dependent on the human decision-maker. Will the future demand the interpolation of visual evidence for high profile criminal cases, and what does the existence of Generative AI and deepfakes mean for the forensic analysis of audiovisual evidence? After contemplating the socio-technical plausibility of the central premise of THE CAPTURE, this paper then turns to its legal implications. Drawing on examples from U.S. and Australian legal frameworks, the paper considers the consequences of AI-corrected, augmented or generated audiovisual evidence on three facets of natural justice: (1) the presumption of innocence; (2) the fair trial; and (3) lawyers’ ethical duties of competence and to the administration of justice. The key takeaways of the paper are that: (1) deepfake evidence will continue to proliferate; (2) that the law will need to address both the substantive and procedural impacts of such evidence, and (3) that the legal profession must continue to educate its lawyers and practitioners, and associated stakeholders, of the nature, uses and risks posed by deepfake audiovisual artefacts to maintain public trust in the legal system.
THE CAPTURE》是一部悬疑惊悚剧集,第二季已在孔雀和 BBC One 频道播出。这部英国电视剧围绕着一个特别小组在其指挥下篡改直接视听证据的故事展开,该小组认为有足够的间接证据证明某人有罪或无罪。本文以该电视剧的情节为基础,探讨了在刑事诉讼过程中使用各种人工智能应用的可能性。本文通过人工智能的操作来考虑篡改证据的影响,从而认识到深度伪造证据很可能会被法庭采纳,而这取决于人类决策者。未来是否需要在备受瞩目的刑事案件中对视觉证据进行插值处理,以及生成式人工智能和深度伪造的存在对视听证据的法证分析意味着什么?在思考了《捕获》的核心前提在社会技术上的合理性之后,本文转而探讨其法律意义。本文以美国和澳大利亚的法律框架为例,探讨了人工智能校正、增强或生成的视听证据对自然正义三个方面的影响:(1) 无罪推定;(2) 公平审判;(3) 律师的能力道德义务和司法行政。本文的主要观点如下(1) 深度伪造证据将继续扩散;(2) 法律将需要解决此类证据在实体和程序上的影响;(3) 法律界必须继续教育其律师和从业人员以及相关利益方,使其了解深度伪造视听人工制品的性质、用途和风险,以维护公众对法律制度的信任。