对自动化的信任和人类-算法团队执行一对一人脸匹配任务的准确性。

IF 3.4 2区 心理学 Q1 PSYCHOLOGY, EXPERIMENTAL Cognitive Research-Principles and Implications Pub Date : 2024-06-21 DOI:10.1186/s41235-024-00564-8
Daniel J Carragher, Daniel Sturman, Peter J B Hancock
{"title":"对自动化的信任和人类-算法团队执行一对一人脸匹配任务的准确性。","authors":"Daniel J Carragher, Daniel Sturman, Peter J B Hancock","doi":"10.1186/s41235-024-00564-8","DOIUrl":null,"url":null,"abstract":"<p><p>The human face is commonly used for identity verification. While this task was once exclusively performed by humans, technological advancements have seen automated facial recognition systems (AFRS) integrated into many identification scenarios. Although many state-of-the-art AFRS are exceptionally accurate, they often require human oversight or involvement, such that a human operator actions the final decision. Previously, we have shown that on average, humans assisted by a simulated AFRS (sAFRS) failed to reach the level of accuracy achieved by the same sAFRS alone, due to overturning the system's correct decisions and/or failing to correct sAFRS errors. The aim of the current study was to investigate whether participants' trust in automation was related to their performance on a one-to-one face matching task when assisted by a sAFRS. Participants (n = 160) completed a standard face matching task in two phases: an unassisted baseline phase, and an assisted phase where they were shown the identification decision (95% accurate) made by a sAFRS prior to submitting their own decision. While most participants improved with sAFRS assistance, those with greater relative trust in automation achieved larger gains in performance. However, the average aided performance of participants still failed to reach that of the sAFRS alone, regardless of trust status. Nonetheless, further analysis revealed a small sample of participants who achieved 100% accuracy when aided by the sAFRS. Our results speak to the importance of considering individual differences when selecting employees for roles requiring human-algorithm interaction, including identity verification tasks that incorporate facial recognition technologies.</p>","PeriodicalId":46827,"journal":{"name":"Cognitive Research-Principles and Implications","volume":"9 1","pages":"41"},"PeriodicalIF":3.4000,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11190114/pdf/","citationCount":"0","resultStr":"{\"title\":\"Trust in automation and the accuracy of human-algorithm teams performing one-to-one face matching tasks.\",\"authors\":\"Daniel J Carragher, Daniel Sturman, Peter J B Hancock\",\"doi\":\"10.1186/s41235-024-00564-8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The human face is commonly used for identity verification. While this task was once exclusively performed by humans, technological advancements have seen automated facial recognition systems (AFRS) integrated into many identification scenarios. Although many state-of-the-art AFRS are exceptionally accurate, they often require human oversight or involvement, such that a human operator actions the final decision. Previously, we have shown that on average, humans assisted by a simulated AFRS (sAFRS) failed to reach the level of accuracy achieved by the same sAFRS alone, due to overturning the system's correct decisions and/or failing to correct sAFRS errors. The aim of the current study was to investigate whether participants' trust in automation was related to their performance on a one-to-one face matching task when assisted by a sAFRS. Participants (n = 160) completed a standard face matching task in two phases: an unassisted baseline phase, and an assisted phase where they were shown the identification decision (95% accurate) made by a sAFRS prior to submitting their own decision. While most participants improved with sAFRS assistance, those with greater relative trust in automation achieved larger gains in performance. However, the average aided performance of participants still failed to reach that of the sAFRS alone, regardless of trust status. Nonetheless, further analysis revealed a small sample of participants who achieved 100% accuracy when aided by the sAFRS. Our results speak to the importance of considering individual differences when selecting employees for roles requiring human-algorithm interaction, including identity verification tasks that incorporate facial recognition technologies.</p>\",\"PeriodicalId\":46827,\"journal\":{\"name\":\"Cognitive Research-Principles and Implications\",\"volume\":\"9 1\",\"pages\":\"41\"},\"PeriodicalIF\":3.4000,\"publicationDate\":\"2024-06-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11190114/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cognitive Research-Principles and Implications\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1186/s41235-024-00564-8\",\"RegionNum\":2,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, EXPERIMENTAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cognitive Research-Principles and Implications","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1186/s41235-024-00564-8","RegionNum":2,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0

摘要

人脸通常用于身份验证。虽然这项任务曾一度完全由人类完成,但随着技术的进步,自动面部识别系统(AFRS)已被整合到许多身份识别场景中。虽然许多最先进的自动面部识别系统都非常准确,但它们往往需要人类的监督或参与,例如由人类操作员做出最终决定。此前,我们已经证明,由于推翻了系统的正确决定和/或未能纠正 sAFRS 的错误,在模拟 AFRS(sAFRS)的协助下,人类平均无法达到单独使用相同 sAFRS 所达到的准确度水平。本研究的目的是调查参与者对自动化的信任是否与他们在一对一人脸匹配任务中的表现有关。参与者(n = 160)分两个阶段完成了一项标准的人脸匹配任务:无辅助基线阶段和辅助阶段,在辅助阶段,参与者在提交自己的决定之前,会先看到 sAFRS 所做的识别决定(准确率为 95%)。虽然大多数参与者的成绩在 sAFRS 的协助下都有所提高,但那些相对信任自动化的参与者的成绩提高幅度更大。然而,无论信任度如何,参与者的平均辅助绩效仍无法达到单独使用 sAFRS 时的水平。尽管如此,进一步的分析显示,有一小部分参与者在 sAFRS 的帮助下达到了 100% 的准确率。我们的研究结果表明,在为需要人机交互的任务(包括采用面部识别技术的身份验证任务)挑选员工时,考虑个体差异非常重要。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Trust in automation and the accuracy of human-algorithm teams performing one-to-one face matching tasks.

The human face is commonly used for identity verification. While this task was once exclusively performed by humans, technological advancements have seen automated facial recognition systems (AFRS) integrated into many identification scenarios. Although many state-of-the-art AFRS are exceptionally accurate, they often require human oversight or involvement, such that a human operator actions the final decision. Previously, we have shown that on average, humans assisted by a simulated AFRS (sAFRS) failed to reach the level of accuracy achieved by the same sAFRS alone, due to overturning the system's correct decisions and/or failing to correct sAFRS errors. The aim of the current study was to investigate whether participants' trust in automation was related to their performance on a one-to-one face matching task when assisted by a sAFRS. Participants (n = 160) completed a standard face matching task in two phases: an unassisted baseline phase, and an assisted phase where they were shown the identification decision (95% accurate) made by a sAFRS prior to submitting their own decision. While most participants improved with sAFRS assistance, those with greater relative trust in automation achieved larger gains in performance. However, the average aided performance of participants still failed to reach that of the sAFRS alone, regardless of trust status. Nonetheless, further analysis revealed a small sample of participants who achieved 100% accuracy when aided by the sAFRS. Our results speak to the importance of considering individual differences when selecting employees for roles requiring human-algorithm interaction, including identity verification tasks that incorporate facial recognition technologies.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
6.80
自引率
7.30%
发文量
96
审稿时长
25 weeks
期刊最新文献
Fixation durations on familiar items are longer due to attenuation of exploration. Different facets of age perception in people with developmental prosopagnosia and "super-recognisers". Self-evaluations and the language of the beholder: objective performance and language solidarity predict L2 and L1 self-evaluations in bilingual adults. Correction: Distress reactions and susceptibility to misinformation for an analogue trauma event. Jack of all trades, master of one: domain-specific and domain-general contributions to perceptual expertise in visual comparison.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1