首页 > 最新文献

Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting最新文献

英文 中文
Investigating User Preferences for Conversation Design of Voice Assistant Systems using Linguistic Features 使用语言特征调查语音助理系统对话设计的用户偏好
Lilit Sargsyan, Seungju Choi, Sang-Hwan Kim
As the use of voice assistant (VA) systems is increasing, conversation design in the system is important for effective human-system interaction. The objective of the study was to investigate the level of user preference for VA outputs in terms of linguistics. Answers of three VA systems for each of the nine questions were collected and categorized for distinctive linguistic factors such as type of theme, thematic progression, number of predications, and ellipsis. The VA answers were evaluated through an online survey. Results show that linguistic factors and features significantly affect user preference for VA outputs. The results imply that the linguistic features need to be considered for designing voice interaction communications as a natural interaction method.
随着语音助理系统应用的日益广泛,语音助理系统中的会话设计对于实现人机有效交互具有重要意义。该研究的目的是调查用户对语言输出的偏好水平。收集了三个VA系统对九个问题中的每个问题的答案,并根据不同的语言因素(如主题类型、主题进展、谓语数量和省略)进行了分类。退伍军人事务部的回答是通过在线调查进行评估的。结果表明,语言因素和特征显著影响用户对VA输出的偏好。结果表明,在设计语音交互通信作为一种自然交互方式时,需要考虑语言特征。
{"title":"Investigating User Preferences for Conversation Design of Voice Assistant Systems using Linguistic Features","authors":"Lilit Sargsyan, Seungju Choi, Sang-Hwan Kim","doi":"10.1177/21695067231192609","DOIUrl":"https://doi.org/10.1177/21695067231192609","url":null,"abstract":"As the use of voice assistant (VA) systems is increasing, conversation design in the system is important for effective human-system interaction. The objective of the study was to investigate the level of user preference for VA outputs in terms of linguistics. Answers of three VA systems for each of the nine questions were collected and categorized for distinctive linguistic factors such as type of theme, thematic progression, number of predications, and ellipsis. The VA answers were evaluated through an online survey. Results show that linguistic factors and features significantly affect user preference for VA outputs. The results imply that the linguistic features need to be considered for designing voice interaction communications as a natural interaction method.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"46 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135113100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Conditional Variational Auto-encoder Model for Reducing Musculoskeletal Disorder Risk during a Human-Robot Collaboration Task 降低人机协作任务中肌肉骨骼疾病风险的条件变分自编码器模型
Liwei Qing, Bingyi Su, Ziyang Xie, Sehee Jung, Lu Lu, Hanwen Wang, Xu Xu, Edward P. Fitts
In recent years, there has been a trend to adopt human-robot collaboration (HRC) in the industry. In previous studies, computer vision-aided human pose reconstruction is applied to find the optimal position of point of operation in HRC that can reduce workers’ musculoskeletal disorder (MSD) risks due to awkward working postures. However, the reconstruction of human pose through computer-vision may fail due to the complexity of the workplace environment. In this study, we propose a data-driven method for optimizing the position of point of operation during HRC. A conditional variational auto-encoder (cVAE) model-based approach is adopted, which includes three steps. First, a cVAE model was trained using an open-access multimodal human posture dataset. After training, this model can output a simulated worker posture of which the hand position can reach a given position of point of operation. Next, an awkward posture score is calculated to evaluate MSD risks associated with the generated postures with a variety of positions of point of operation. The position of point of operation that is associated with a minimum awkward posture score is then selected for an HRC task. An experiment was conducted to validate the effectiveness of this method. According to the findings, the proposed method produced a point of operation position that was similar to the one chosen by participants through subjective selection, with an average difference of 4.5 cm.
近年来,工业上出现了采用人机协作(HRC)的趋势。在以往的研究中,利用计算机视觉辅助人体姿势重建来寻找HRC中操作点的最佳位置,以降低工人因工作姿势尴尬而导致的肌肉骨骼疾病(MSD)风险。然而,由于工作环境的复杂性,通过计算机视觉重建人体姿势可能会失败。在这项研究中,我们提出了一种数据驱动的方法来优化HRC期间操作点的位置。采用了一种基于条件变分自编码器(cVAE)模型的方法,该方法包括三个步骤。首先,使用开放获取的多模态人体姿态数据集训练cVAE模型。经过训练后,该模型可以输出一个模拟的工人姿势,其中手的位置可以达到给定的操作点位置。其次,计算尴尬姿势得分,以评估不同操作点位置产生的姿势与MSD风险的关系。然后选择与最小尴尬姿势得分相关的操作点位置进行HRC任务。通过实验验证了该方法的有效性。结果表明,所提出的方法产生的操作点位置与参与者主观选择的位置相似,平均相差4.5 cm。
{"title":"A Conditional Variational Auto-encoder Model for Reducing Musculoskeletal Disorder Risk during a Human-Robot Collaboration Task","authors":"Liwei Qing, Bingyi Su, Ziyang Xie, Sehee Jung, Lu Lu, Hanwen Wang, Xu Xu, Edward P. Fitts","doi":"10.1177/21695067231192538","DOIUrl":"https://doi.org/10.1177/21695067231192538","url":null,"abstract":"In recent years, there has been a trend to adopt human-robot collaboration (HRC) in the industry. In previous studies, computer vision-aided human pose reconstruction is applied to find the optimal position of point of operation in HRC that can reduce workers’ musculoskeletal disorder (MSD) risks due to awkward working postures. However, the reconstruction of human pose through computer-vision may fail due to the complexity of the workplace environment. In this study, we propose a data-driven method for optimizing the position of point of operation during HRC. A conditional variational auto-encoder (cVAE) model-based approach is adopted, which includes three steps. First, a cVAE model was trained using an open-access multimodal human posture dataset. After training, this model can output a simulated worker posture of which the hand position can reach a given position of point of operation. Next, an awkward posture score is calculated to evaluate MSD risks associated with the generated postures with a variety of positions of point of operation. The position of point of operation that is associated with a minimum awkward posture score is then selected for an HRC task. An experiment was conducted to validate the effectiveness of this method. According to the findings, the proposed method produced a point of operation position that was similar to the one chosen by participants through subjective selection, with an average difference of 4.5 cm.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"202 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135113446","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Law Enforcement Uniforms and Public Perception: An Overview and Pilot Study 执法制服与公众认知:概览与试点研究
Braden Westby, Richard Stone, Colten Fales, Desmond Bonner
In a delicate balancing act between improving public relations and enhancing functionality and safety, law enforcement agencies often revisit the standards for their uniforms. Many experiments have been conducted over the years in reference to uniform color, but comparatively little research has been conducted relating to the implementation of accessories. In this study, we demonstrate that the use of “formal accessories” (as worn on a Class A uniform) may impact the public’s perception of police, particularly in reference to their perceived professionalism, authority, competence, and approachability.
为了在改善公共关系与加强功能和安全之间取得微妙的平衡,执法机构经常重新审视他们的制服标准。多年来,在统一颜色方面进行了许多实验,但与配件的实施有关的研究相对较少。在这项研究中,我们证明使用“正式配件”(如在a级制服上佩戴)可能会影响公众对警察的看法,特别是在他们的专业精神、权威、能力和可接近性方面。
{"title":"Law Enforcement Uniforms and Public Perception: An Overview and Pilot Study","authors":"Braden Westby, Richard Stone, Colten Fales, Desmond Bonner","doi":"10.1177/21695067231192273","DOIUrl":"https://doi.org/10.1177/21695067231192273","url":null,"abstract":"In a delicate balancing act between improving public relations and enhancing functionality and safety, law enforcement agencies often revisit the standards for their uniforms. Many experiments have been conducted over the years in reference to uniform color, but comparatively little research has been conducted relating to the implementation of accessories. In this study, we demonstrate that the use of “formal accessories” (as worn on a Class A uniform) may impact the public’s perception of police, particularly in reference to their perceived professionalism, authority, competence, and approachability.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"57 10","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135113632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
SpearSim-V2: Synthetic Task Environment for Evaluating Attacker Behaviors SpearSim-V2:用于评估攻击者行为的综合任务环境
Elaheh Mehrabi, Tianhao Xu, Prashanth Rajivan
Despite extensive research on phishing, a severe lack of work centered on attackers has resulted in a limited understanding of the adversarial behaviors conducive to attack success and failures. This work describes a novel method for conducting controlled laboratory studies of cognitive vulnerabilities that attackers experience during the design and execution phases of spear-phishing attacks. Based on the SpearSim platform, the new simulation environment integrates cognitive agents that model and predict end-user responses to spear-phishing attacks. This advancement to SpearSim allows the generation of real-time, automated, “human-like” responses to simulated spear-phishing attacks. This enables the execution of experiments focused on attackers and attacker behaviors. We describe the proposed simulation framework, provide details about the implemented simulation environment, and present results to evaluate the performance of the simulation environment. Compared to the earlier version of SpearSim involving human end-users, the new approach generates responses at a much faster rate (3 times faster than human end-users) and importantly with less variance in the time to respond. The cognitive agents used in the simulation predicted human responses to phishing and spear-phishing attackers with moderate accuracy (about 60%). Our proposed method intends to provide an effective and robust way to conduct laboratory experiments on spear-phishing attacks and further understand attackers' decision-making processes that could be exploited to thwart future attacks.
尽管对网络钓鱼进行了广泛的研究,但严重缺乏以攻击者为中心的工作,导致对有助于攻击成功和失败的对抗行为的理解有限。这项工作描述了一种对攻击者在鱼叉式网络钓鱼攻击的设计和执行阶段所经历的认知漏洞进行受控实验室研究的新方法。基于SpearSim平台,新的仿真环境集成了认知代理,可以模拟和预测最终用户对鱼叉式网络钓鱼攻击的反应。SpearSim的这一进步允许对模拟鱼叉式网络钓鱼攻击生成实时、自动化的“类人”响应。这样就可以执行针对攻击者和攻击者行为的实验。我们描述了提出的仿真框架,提供了有关实现的仿真环境的细节,并给出了评估仿真环境性能的结果。与涉及人类最终用户的早期版本的SpearSim相比,新方法以更快的速度生成响应(比人类最终用户快3倍),重要的是响应时间的变化更小。模拟中使用的认知代理以中等精度(约60%)预测人类对网络钓鱼和鱼叉式网络钓鱼攻击者的反应。我们提出的方法旨在提供一种有效而稳健的方法来对鱼叉式网络钓鱼攻击进行实验室实验,并进一步了解攻击者的决策过程,这些决策过程可以用来挫败未来的攻击。
{"title":"SpearSim-V<sub>2</sub>: Synthetic Task Environment for Evaluating Attacker Behaviors","authors":"Elaheh Mehrabi, Tianhao Xu, Prashanth Rajivan","doi":"10.1177/21695067231192215","DOIUrl":"https://doi.org/10.1177/21695067231192215","url":null,"abstract":"Despite extensive research on phishing, a severe lack of work centered on attackers has resulted in a limited understanding of the adversarial behaviors conducive to attack success and failures. This work describes a novel method for conducting controlled laboratory studies of cognitive vulnerabilities that attackers experience during the design and execution phases of spear-phishing attacks. Based on the SpearSim platform, the new simulation environment integrates cognitive agents that model and predict end-user responses to spear-phishing attacks. This advancement to SpearSim allows the generation of real-time, automated, “human-like” responses to simulated spear-phishing attacks. This enables the execution of experiments focused on attackers and attacker behaviors. We describe the proposed simulation framework, provide details about the implemented simulation environment, and present results to evaluate the performance of the simulation environment. Compared to the earlier version of SpearSim involving human end-users, the new approach generates responses at a much faster rate (3 times faster than human end-users) and importantly with less variance in the time to respond. The cognitive agents used in the simulation predicted human responses to phishing and spear-phishing attackers with moderate accuracy (about 60%). Our proposed method intends to provide an effective and robust way to conduct laboratory experiments on spear-phishing attacks and further understand attackers' decision-making processes that could be exploited to thwart future attacks.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"62 4","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135113912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Classification of Human Driver Distraction Using 3D Convolutional Neural Networks 基于三维卷积神经网络的驾驶员分心分类
Kelvin Kwakye, Armstrong Aboah, Younho Seong, Sun Yi
Distracted driving is a dangerous driving behavior that causes numerous accidents on US roads each year. It is critical to identify distracted drivers in order to prevent such accidents. Previous studies attempted to detect distracted driving using heuristics and machine learning; however, none of these methods could capture the problem's spatiotemporal features. As a result, the purpose of this study was to use a 3D convolutional neural network (CNN) that can capture both spatial and temporal information to classify distracted drivers based on facial features and behavioral cues. We used the Database to Enable Facial Analysis for Driving Studies (DEFADS), an open-source dataset containing 77 human subjects performing scripted driving-related activities, to achieve this goal. The PyTorch video library was used to train the model. The 3D CNN achieved an overall recall and precision of 97.6 and 98.1, respectively, indicating its efficacy in detecting distracted drivers in the real world.
分心驾驶是一种危险的驾驶行为,每年在美国道路上造成无数事故。为了防止此类事故,识别分心的司机是至关重要的。之前的研究试图使用启发式和机器学习来检测分心驾驶;然而,这些方法都无法捕捉到问题的时空特征。因此,本研究的目的是使用3D卷积神经网络(CNN),该网络可以捕获空间和时间信息,根据面部特征和行为线索对分心的驾驶员进行分类。为了实现这一目标,我们使用了数据库来启用驾驶研究面部分析(DEFADS),这是一个包含77名人类受试者执行脚本化驾驶相关活动的开源数据集。PyTorch视频库用于训练模型。3D CNN的总体召回率和准确率分别为97.6和98.1,表明其在检测现实世界中分心司机方面的有效性。
{"title":"Classification of Human Driver Distraction Using 3D Convolutional Neural Networks","authors":"Kelvin Kwakye, Armstrong Aboah, Younho Seong, Sun Yi","doi":"10.1177/21695067231192576","DOIUrl":"https://doi.org/10.1177/21695067231192576","url":null,"abstract":"Distracted driving is a dangerous driving behavior that causes numerous accidents on US roads each year. It is critical to identify distracted drivers in order to prevent such accidents. Previous studies attempted to detect distracted driving using heuristics and machine learning; however, none of these methods could capture the problem's spatiotemporal features. As a result, the purpose of this study was to use a 3D convolutional neural network (CNN) that can capture both spatial and temporal information to classify distracted drivers based on facial features and behavioral cues. We used the Database to Enable Facial Analysis for Driving Studies (DEFADS), an open-source dataset containing 77 human subjects performing scripted driving-related activities, to achieve this goal. The PyTorch video library was used to train the model. The 3D CNN achieved an overall recall and precision of 97.6 and 98.1, respectively, indicating its efficacy in detecting distracted drivers in the real world.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135112658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of Variations in the Tragus Expansion Angle on Users’ Comfort for In-ear Wearables 耳屏展开角度变化对入耳式可穿戴设备用户舒适度的影响
Hao Fan, Mengcheng Wang, Xiao Zhao, Yihui Ren, Chen Chen, Yunjie Dou, Jinlei Shi, Dengkai Chen, Carisa Harris-Adamson, Chunlei Chai
Tragus expansion angle (TEA) is an angular variable that quantifies the degree of outward expansion of the tragus cartilage induced by in-ear wearables worn in the human ear. However, the TEA cannot be measured directly, and the mechanism that explains how expansion variations affect users’ comfort experience is not well understood. The purpose of this study was to establish a quantitative relationship between variations in the tragus expansion angle and users’ comfort experience. TEA was measured on 400 healthy participants and normalized using a measuring device (ATMC prototype) and Tragus Expansion Index (TEI). Our results show that the comfort range across variations in TEA was similar for both sexes, yet compared to females, males could tolerate larger variations both in TEA and TEI. A quantitative relationship was established using TEI values, (dis)comfort ratings and GaussAmp function, which can be employed for ergonomic design purposes.
耳屏扩张角(Tragus expansion angle, TEA)是一个角度变量,用于量化人耳中佩戴入耳式可穿戴设备引起耳屏软骨向外扩张的程度。然而,TEA不能直接测量,并且解释膨胀变化如何影响用户舒适体验的机制尚不清楚。本研究的目的是建立耳屏扩张角变化与使用者舒适体验之间的定量关系。对400名健康受试者进行TEA测量,并使用测量仪(ATMC原型)和Tragus Expansion Index (TEI)进行归一化。我们的研究结果表明,男女对TEA变化的舒适范围是相似的,但与女性相比,男性可以忍受更大的TEA和TEI变化。使用TEI值、(dis)舒适评级和GaussAmp函数建立定量关系,可用于人体工程学设计目的。
{"title":"Effects of Variations in the Tragus Expansion Angle on Users’ Comfort for In-ear Wearables","authors":"Hao Fan, Mengcheng Wang, Xiao Zhao, Yihui Ren, Chen Chen, Yunjie Dou, Jinlei Shi, Dengkai Chen, Carisa Harris-Adamson, Chunlei Chai","doi":"10.1177/21695067231192616","DOIUrl":"https://doi.org/10.1177/21695067231192616","url":null,"abstract":"Tragus expansion angle (TEA) is an angular variable that quantifies the degree of outward expansion of the tragus cartilage induced by in-ear wearables worn in the human ear. However, the TEA cannot be measured directly, and the mechanism that explains how expansion variations affect users’ comfort experience is not well understood. The purpose of this study was to establish a quantitative relationship between variations in the tragus expansion angle and users’ comfort experience. TEA was measured on 400 healthy participants and normalized using a measuring device (ATMC prototype) and Tragus Expansion Index (TEI). Our results show that the comfort range across variations in TEA was similar for both sexes, yet compared to females, males could tolerate larger variations both in TEA and TEI. A quantitative relationship was established using TEI values, (dis)comfort ratings and GaussAmp function, which can be employed for ergonomic design purposes.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"82 10","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135112780","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Controlled Experiment on the Impact of Intrusion Detection False Alarm Rate on Analyst Performance 入侵检测虚警率对分析人员性能影响的对照实验
Lucas Layman, William Roden
Organizations use intrusion detection systems (IDSes) to identify harmful activity among millions of computer network events. Cybersecurity analysts review IDS alarms to verify whether malicious activity occurred and to take remedial action. However, IDS systems exhibit high false alarm rates. This study examines the impact of IDS false alarm rate on human analyst sensitivity (probability of detection), precision (positive predictive value), and time on task when evaluating IDS alarms. A controlled experiment was conducted with participants divided into two treatment groups, 50% IDS false alarm rate and 86% false alarm rate, who classified whether simulated IDS alarms were true or false alarms. Results show statistically significant differences in precision and time on task. The median values for the 86% false alarm rate group were 47% lower precision and 40% slower time on task than the 50% false alarm rate group. No significant difference in analyst sensitivity was observed.
组织使用入侵检测系统(ids)在数百万计算机网络事件中识别有害活动。网络安全分析师审查IDS警报,以验证是否发生恶意活动并采取补救措施。然而,IDS系统显示出很高的误报率。本研究考察了在评估IDS警报时,IDS假警报率对人类分析师灵敏度(检测概率)、精度(阳性预测值)和任务时间的影响。进行对照实验,将参与者分为50%假警率和86%假警率两组,对模拟的IDS报警进行真假分类。结果显示,在完成任务的精确度和时间上存在统计学上的显著差异。假警报率86%组的中位数比假警报率50%组的准确率低47%,任务完成时间慢40%。分析人员的敏感性无显著差异。
{"title":"A Controlled Experiment on the Impact of Intrusion Detection False Alarm Rate on Analyst Performance","authors":"Lucas Layman, William Roden","doi":"10.1177/21695067231192573","DOIUrl":"https://doi.org/10.1177/21695067231192573","url":null,"abstract":"Organizations use intrusion detection systems (IDSes) to identify harmful activity among millions of computer network events. Cybersecurity analysts review IDS alarms to verify whether malicious activity occurred and to take remedial action. However, IDS systems exhibit high false alarm rates. This study examines the impact of IDS false alarm rate on human analyst sensitivity (probability of detection), precision (positive predictive value), and time on task when evaluating IDS alarms. A controlled experiment was conducted with participants divided into two treatment groups, 50% IDS false alarm rate and 86% false alarm rate, who classified whether simulated IDS alarms were true or false alarms. Results show statistically significant differences in precision and time on task. The median values for the 86% false alarm rate group were 47% lower precision and 40% slower time on task than the 50% false alarm rate group. No significant difference in analyst sensitivity was observed.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"432 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135112823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring Trust With the AI Incident Database 用AI事件数据库探索信任
Jeff C. Stanley, Stephen L. Dorton
Engineering trustworthy artificial intelligence (AI) is important to adoption and appropriate use, but there are challenges to implementing trustworthy AI systems. It is difficult to translate trust studies from the laboratory to the field. It is also difficult to operationalize “trustworthy AI” frameworks and principles to inform the actual development of AI. We address these challenges with an approach based in reported incidents of trust loss “in the wild.” We systematically identified 30 cases of trust loss in the AI Incident Database to gain insight into how and why humans lose trust in AI in various contexts. These factors could be codified into the development cycle in various forms such as checklists and design patterns to manage trust in AI systems and avoid similar incidents in the future. Because it is based in real incidents, this approach offers recommendations that are concrete and actionable for teams addressing real use cases with AI systems.
工程可靠的人工智能(AI)对于采用和适当使用非常重要,但实现可靠的人工智能系统存在挑战。很难将信任研究从实验室转化到现场。“值得信赖的人工智能”框架和原则也很难付诸实施,难以为人工智能的实际发展提供信息。我们通过一种基于“野外”信任丧失报告事件的方法来应对这些挑战。我们系统地识别了人工智能事件数据库中的30个信任丧失案例,以深入了解在各种情况下人类如何以及为什么对人工智能失去信任。这些因素可以以各种形式编入开发周期,如清单和设计模式,以管理对人工智能系统的信任,并避免未来发生类似事件。因为它是基于真实事件的,所以这种方法为团队解决AI系统的真实用例提供了具体和可操作的建议。
{"title":"Exploring Trust With the AI Incident Database","authors":"Jeff C. Stanley, Stephen L. Dorton","doi":"10.1177/21695067231198084","DOIUrl":"https://doi.org/10.1177/21695067231198084","url":null,"abstract":"Engineering trustworthy artificial intelligence (AI) is important to adoption and appropriate use, but there are challenges to implementing trustworthy AI systems. It is difficult to translate trust studies from the laboratory to the field. It is also difficult to operationalize “trustworthy AI” frameworks and principles to inform the actual development of AI. We address these challenges with an approach based in reported incidents of trust loss “in the wild.” We systematically identified 30 cases of trust loss in the AI Incident Database to gain insight into how and why humans lose trust in AI in various contexts. These factors could be codified into the development cycle in various forms such as checklists and design patterns to manage trust in AI systems and avoid similar incidents in the future. Because it is based in real incidents, this approach offers recommendations that are concrete and actionable for teams addressing real use cases with AI systems.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"13 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135113270","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Framing Updates: How Framing Influences Trust for Automated Driving Systems 框架更新:框架如何影响自动驾驶系统的信任
Scott Mishler, Jing Chen
The boom of automated driving systems (ADS) promises to change the way humans drive and interact with their vehicle, especially when these systems receive new updates that may change the way they work. Human-automation teams need to ensure proper roles are established for who is in control of the driving task at any given time. The human needs to have properly calibrated trust to know how to properly work with the system during driving. Framing research shows that positive and negative framing can influence how individuals perceive and make decisions, and swift trust shows that trust can be created quickly in newly established teams. We draw from both realms of literature and tested how new updates of the ADS are framed to the driver with the goal of either promoting or dampening trust to ensure the human driver is maintaining proper trust calibration.
自动驾驶系统(ADS)的蓬勃发展有望改变人类驾驶和与车辆互动的方式,尤其是当这些系统获得可能改变其工作方式的新更新时。人类自动化团队需要确保在任何给定的时间为控制驾驶任务的人建立适当的角色。人类需要有适当校准的信任,知道如何在驾驶过程中正确地使用系统。框架研究表明,积极和消极框架可以影响个人的感知和决策方式,快速信任表明,在新成立的团队中,信任可以很快建立起来。我们借鉴了这两个领域的文献,并测试了ADS的新更新是如何以促进或抑制信任为目标向驾驶员提供的,以确保人类驾驶员保持适当的信任校准。
{"title":"Framing Updates: How Framing Influences Trust for Automated Driving Systems","authors":"Scott Mishler, Jing Chen","doi":"10.1177/21695067231192894","DOIUrl":"https://doi.org/10.1177/21695067231192894","url":null,"abstract":"The boom of automated driving systems (ADS) promises to change the way humans drive and interact with their vehicle, especially when these systems receive new updates that may change the way they work. Human-automation teams need to ensure proper roles are established for who is in control of the driving task at any given time. The human needs to have properly calibrated trust to know how to properly work with the system during driving. Framing research shows that positive and negative framing can influence how individuals perceive and make decisions, and swift trust shows that trust can be created quickly in newly established teams. We draw from both realms of literature and tested how new updates of the ADS are framed to the driver with the goal of either promoting or dampening trust to ensure the human driver is maintaining proper trust calibration.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"50 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135217085","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Predicting Automated Vehicle Takeover Decision During the Nighttime 预测夜间自动车辆接管决策
Nade Liang, Chiho Lim, Denny Yu, Kwaku O. Prakah-Asante, Brandon J. Pitts
Conditionally automated vehicles require drivers to take over control occasionally. To date, takeover performance has been mostly evaluated using only re-engagement time and quality metrics. However, the appropriateness of takeover decisions, which has not been considered by previous research, should also be included as a performance indicator as it reflects one’s situation awareness of the takeover scenario. The goal of this study was to use eye-tracking, demographic factors, workload, and non-driving-related task (NDRT) conditions to predict takeover decisions. Forty-three participants drove a simulated conditionally automated vehicle while performing visual NDRTs and needed to decide the most appropriate maneuver around a roadway obstacle. Six classifiers were used to predict takeover decisions. The Random Forest model achieved the best performance, and driving experience and perceived workload were the most influential features. Findings may be used to assist in the design of adaptive algorithms that support drivers taking over from automated vehicles.
有条件的自动驾驶汽车偶尔需要司机接管控制。迄今为止,收购绩效的评估大多只使用重新参与时间和质量指标。然而,收购决策的适当性也应该作为一个绩效指标,因为它反映了一个人对收购情景的情境意识,这一点在以前的研究中没有考虑到。本研究的目的是利用眼动追踪、人口统计因素、工作量和非驾驶相关任务(NDRT)条件来预测收购决策。43名参与者驾驶一辆模拟的条件自动驾驶汽车,同时进行视觉ndrt,并需要在道路障碍物周围决定最合适的机动。六个分类器被用来预测收购决策。随机森林模型取得了最好的性能,驾驶经验和感知工作量是影响最大的特征。研究结果可用于协助设计自适应算法,以支持驾驶员接替自动驾驶车辆。
{"title":"Predicting Automated Vehicle Takeover Decision During the Nighttime","authors":"Nade Liang, Chiho Lim, Denny Yu, Kwaku O. Prakah-Asante, Brandon J. Pitts","doi":"10.1177/21695067231194993","DOIUrl":"https://doi.org/10.1177/21695067231194993","url":null,"abstract":"Conditionally automated vehicles require drivers to take over control occasionally. To date, takeover performance has been mostly evaluated using only re-engagement time and quality metrics. However, the appropriateness of takeover decisions, which has not been considered by previous research, should also be included as a performance indicator as it reflects one’s situation awareness of the takeover scenario. The goal of this study was to use eye-tracking, demographic factors, workload, and non-driving-related task (NDRT) conditions to predict takeover decisions. Forty-three participants drove a simulated conditionally automated vehicle while performing visual NDRTs and needed to decide the most appropriate maneuver around a roadway obstacle. Six classifiers were used to predict takeover decisions. The Random Forest model achieved the best performance, and driving experience and perceived workload were the most influential features. Findings may be used to assist in the design of adaptive algorithms that support drivers taking over from automated vehicles.","PeriodicalId":74544,"journal":{"name":"Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting","volume":"73 1-2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135219064","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Human Factors and Ergonomics Society. Annual meeting
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1