首页 > 最新文献

Journal of Cognitive Engineering and Decision Making最新文献

英文 中文
A Taxonomy for AI Hazard Analysis 人工智能危害分析分类标准
IF 2 Q1 Engineering Pub Date : 2024-01-09 DOI: 10.1177/15553434231224096
M.L Cummings
With the rise of artificial intelligence in safety-critical systems like surface transportation, there is a commensurate need for new hazard analysis approaches to determine if and how AI contributes to accidents, which are also increasing in number and severity. The original Swiss Cheese model widely used for hazard analyses focuses uniquely on human activities that lead to accidents, but cannot address accidents where AI is a possible causal factor. To this end, the Taxonomy for AI Hazard Analysis (TAIHA) is proposed that introduces layers focusing on the oversight, design, maintenance, and testing of AI. TAIHA is illustrated with real-world accidents. TAIHA does not replace the traditional Swiss Cheese model, which should be used in concert when a joint human-AI system exists, such as when people are driving a car with AI-based advanced driving assist features.
随着人工智能在地面运输等安全关键系统中的兴起,人们相应地需要新的危险分析方法来确定人工智能是否以及如何导致事故,而事故的数量和严重程度也在不断增加。最初广泛用于危险分析的 "瑞士奶酪 "模型只关注导致事故的人类活动,但无法解决人工智能可能是致因的事故。为此,我们提出了人工智能危害分析分类标准(TAIHA),引入了人工智能的监督、设计、维护和测试等层面。TAIHA 以现实世界中的事故为例来说明。TAIHA 并不取代传统的瑞士奶酪模型,当存在人类与人工智能联合系统时,例如当人们驾驶一辆带有基于人工智能的高级辅助驾驶功能的汽车时,应协同使用该模型。
{"title":"A Taxonomy for AI Hazard Analysis","authors":"M.L Cummings","doi":"10.1177/15553434231224096","DOIUrl":"https://doi.org/10.1177/15553434231224096","url":null,"abstract":"With the rise of artificial intelligence in safety-critical systems like surface transportation, there is a commensurate need for new hazard analysis approaches to determine if and how AI contributes to accidents, which are also increasing in number and severity. The original Swiss Cheese model widely used for hazard analyses focuses uniquely on human activities that lead to accidents, but cannot address accidents where AI is a possible causal factor. To this end, the Taxonomy for AI Hazard Analysis (TAIHA) is proposed that introduces layers focusing on the oversight, design, maintenance, and testing of AI. TAIHA is illustrated with real-world accidents. TAIHA does not replace the traditional Swiss Cheese model, which should be used in concert when a joint human-AI system exists, such as when people are driving a car with AI-based advanced driving assist features.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139442978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Is the Pull-Down Effect Overstated? An Examination of Trust Propagation Among Fighter Pilots in a High-Fidelity Simulation 拉低效应被夸大了吗?在高仿真模拟中考察战斗机飞行员之间的信任传播
IF 2 Q1 Engineering Pub Date : 2024-01-09 DOI: 10.1177/15553434231225909
Joseph B. Lyons, Janine D. Mator, Tony Orr, Gene M. Alarcon, Kristen Barrera
Research on trust propagation has primarily been conducted with undergraduates using low-fidelity scenarios. It is unclear if the pull-down effect (e.g., system-wide trust) occurs in more applied domains with actual operators. A sample of experienced US Air Force fighter pilots ( n = 13) engaged in six trials using a high-fidelity simulation for Collaborative Combat Aircraft (CCA). The pilots were given command of four CCAs to complete realistic targeting missions. They were asked to monitor the CCAs, report any errors, evaluate a number of potential targets, select a valid target, and select one of the CCAs to perform a strike. One of the CCAs evidenced an error in four of the six trials (17% of all observations), and if the pilots did not report the error, they were prompted to it by an experimenter playing the role of Air Battle Manager. After each trial, reliance intentions and subjective workload were assessed for each of the four CCAs. The presence of an error reduced trust and increased workload for that CCA referent only. There was no evidence of a pull-down effect, nor did the composition of the CCA group (homogenous vs. heterogenous) influence trust propagation. Implications for trust research are discussed.
有关信任传播的研究主要是在本科生中使用低保真场景进行的。目前还不清楚在实际操作人员的更多应用领域中是否会产生下拉效应(如全系统信任)。经验丰富的美国空军战斗机飞行员(n = 13)使用高保真模拟协同作战飞机(CCA)进行了六次试验。飞行员指挥四架 CCA 完成真实的目标任务。他们被要求监控 CCA,报告任何错误,评估一些潜在目标,选择一个有效目标,并选择其中一架 CCA 执行攻击。在六次试验中,有四次(占所有观察结果的 17%)其中一个 CCA 出现错误,如果飞行员没有报告错误,则由扮演空战管理者的实验员提示他们。每次试验后,都会对四项 CCA 的依赖意图和主观工作量进行评估。错误的存在仅降低了对该 CCA 参考的信任度,增加了工作量。没有证据表明存在拉低效应,CCA 组的构成(同质组与异质组)也没有影响信任的传播。本文讨论了信任研究的意义。
{"title":"Is the Pull-Down Effect Overstated? An Examination of Trust Propagation Among Fighter Pilots in a High-Fidelity Simulation","authors":"Joseph B. Lyons, Janine D. Mator, Tony Orr, Gene M. Alarcon, Kristen Barrera","doi":"10.1177/15553434231225909","DOIUrl":"https://doi.org/10.1177/15553434231225909","url":null,"abstract":"Research on trust propagation has primarily been conducted with undergraduates using low-fidelity scenarios. It is unclear if the pull-down effect (e.g., system-wide trust) occurs in more applied domains with actual operators. A sample of experienced US Air Force fighter pilots ( n = 13) engaged in six trials using a high-fidelity simulation for Collaborative Combat Aircraft (CCA). The pilots were given command of four CCAs to complete realistic targeting missions. They were asked to monitor the CCAs, report any errors, evaluate a number of potential targets, select a valid target, and select one of the CCAs to perform a strike. One of the CCAs evidenced an error in four of the six trials (17% of all observations), and if the pilots did not report the error, they were prompted to it by an experimenter playing the role of Air Battle Manager. After each trial, reliance intentions and subjective workload were assessed for each of the four CCAs. The presence of an error reduced trust and increased workload for that CCA referent only. There was no evidence of a pull-down effect, nor did the composition of the CCA group (homogenous vs. heterogenous) influence trust propagation. Implications for trust research are discussed.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139441495","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Understanding Automation Failure 了解自动化故障
IF 2 Q1 Engineering Pub Date : 2024-01-04 DOI: 10.1177/15553434231222059
M. Endsley
The implementation of automation in many domains has led to well-documented accidents and incidents, resulting from reduced situation awareness that occurs when operators are out-of-loop (OOTL), automation confusion, and automation interaction difficulties. Wickens coined the term lumberjack effect to summarize the finding that while automation works well most of the time in typical or normal situations, the performance problems that occur in novel or unexpected situations also increase the likelihood of catastrophic errors. Skraaning and Jamieson have criticized the lumberjack effect due to a study in which they failed to find it. I show that this claim is unsupported due to a number of methodological limitations in their study and conceptual errors. They also provide a model of automation failure that fails to clearly delineate the many barriers to accidents that are available, instead emphasizing the ways in which automation can fail technically and different types of human error. An alternate automation failure model is presented that provides a broader socio-technical perspective emphasizing the design features, processes, capabilities, organizational policies, and training that support people in improving system safety when automation fails.
自动化在许多领域的应用导致了大量有据可查的事故和事件,这些事故和事件是由于操作员脱离回路(OOTL)、自动化混乱和自动化交互困难而导致的情况感知能力下降造成的。Wickens 创造了 "伐木工效应 "一词来概括这一发现,即虽然自动化在典型或正常情况下大部分时间都运行良好,但在新情况或意外情况下出现的性能问题也会增加发生灾难性错误的可能性。Skraaning 和 Jamieson 曾批评伐木工效应,因为他们在一项研究中没有发现这种效应。我的研究表明,由于研究方法上的局限性和概念上的错误,这种说法是站不住脚的。他们还提供了一个自动化失效模型,但该模型未能明确划分事故发生的诸多障碍,而是强调了自动化在技术上可能失效的方式以及不同类型的人为错误。本文提出了另一种自动化失效模型,该模型提供了更广阔的社会技术视角,强调了设计特点、流程、能力、组织政策和培训,当自动化失效时,这些因素可帮助人们改善系统安全。
{"title":"Understanding Automation Failure","authors":"M. Endsley","doi":"10.1177/15553434231222059","DOIUrl":"https://doi.org/10.1177/15553434231222059","url":null,"abstract":"The implementation of automation in many domains has led to well-documented accidents and incidents, resulting from reduced situation awareness that occurs when operators are out-of-loop (OOTL), automation confusion, and automation interaction difficulties. Wickens coined the term lumberjack effect to summarize the finding that while automation works well most of the time in typical or normal situations, the performance problems that occur in novel or unexpected situations also increase the likelihood of catastrophic errors. Skraaning and Jamieson have criticized the lumberjack effect due to a study in which they failed to find it. I show that this claim is unsupported due to a number of methodological limitations in their study and conceptual errors. They also provide a model of automation failure that fails to clearly delineate the many barriers to accidents that are available, instead emphasizing the ways in which automation can fail technically and different types of human error. An alternate automation failure model is presented that provides a broader socio-technical perspective emphasizing the design features, processes, capabilities, organizational policies, and training that support people in improving system safety when automation fails.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2024-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139385107","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Integrating Function Allocation and Operational Event Sequence Diagrams to Support Human-Robot Coordination: Case Study of a Robotic Date Thinning System 整合功能分配和操作事件序列图以支持人机协调:机器人枣树疏伐系统案例研究
IF 2 Q1 Engineering Pub Date : 2023-12-07 DOI: 10.1177/15553434231199727
Yael Salzer, Noy Saraf, A. Bechar, Yuval Cohen, Ze’ev Schmilovitch, Sigal Berman, Y. Yovel, A. Sadowsky, Ellen J. Bass
State-of-the-art robots show promise in supporting but not completely replacing human work in most precision agriculture applications. For many potential agricultural robot applications, there are no comparable systems nor readily available information on the human operator activities to guide the systems engineering process. Such is the situation for Medjool date thinning, a tedious and hazardous manual operation for which technological assistance has yet to be developed. Here we describe using cognitive system engineering methods to develop operational concepts and human-robot coordination requirements for a pioneer system, a Robotic Medjool Date Thinning System (RDTS). We leveraged the abstraction hierarchy to characterize the RDTS’s envisioned goals and functionality. We developed alternative functional allocations to explore the design space based on the availability of different enabling technologies. After downselecting to the function allocation, including the technologies expected to be developed, we created operational event sequence diagrams to visualize the operation flow and to identify requirements related to the human operator and the joint human-robot system. Applying these methods in the early design stages helped to refine the human-robot coordination requirements and to identify gaps in the operational concept—they show great potential to support the introduction of agricultural robots and bring them to fruition.
在大多数精准农业应用中,最先进的机器人有望支持但不会完全取代人类工作。对于许多潜在的农业机器人应用,没有可比较的系统,也没有关于人类操作员活动的现成信息来指导系统工程过程。这就是Medjool削枣的情况,这是一项冗长和危险的手工操作,尚未开发技术援助。在这里,我们描述了使用认知系统工程方法来开发一个先锋系统的操作概念和人机协调要求,一个机器人医疗工具日期细化系统(RDTS)。我们利用抽象层次结构来描述RDTS设想的目标和功能。我们开发了可选的功能分配,以基于不同启用技术的可用性来探索设计空间。在向下选择功能分配后,包括期望开发的技术,我们创建了操作事件序列图,以可视化操作流程,并识别与人类操作员和联合人机系统相关的需求。在早期设计阶段应用这些方法有助于完善人-机器人协调要求,并确定操作概念中的差距——它们显示出支持引入农业机器人并使其取得成果的巨大潜力。
{"title":"Integrating Function Allocation and Operational Event Sequence Diagrams to Support Human-Robot Coordination: Case Study of a Robotic Date Thinning System","authors":"Yael Salzer, Noy Saraf, A. Bechar, Yuval Cohen, Ze’ev Schmilovitch, Sigal Berman, Y. Yovel, A. Sadowsky, Ellen J. Bass","doi":"10.1177/15553434231199727","DOIUrl":"https://doi.org/10.1177/15553434231199727","url":null,"abstract":"State-of-the-art robots show promise in supporting but not completely replacing human work in most precision agriculture applications. For many potential agricultural robot applications, there are no comparable systems nor readily available information on the human operator activities to guide the systems engineering process. Such is the situation for Medjool date thinning, a tedious and hazardous manual operation for which technological assistance has yet to be developed. Here we describe using cognitive system engineering methods to develop operational concepts and human-robot coordination requirements for a pioneer system, a Robotic Medjool Date Thinning System (RDTS). We leveraged the abstraction hierarchy to characterize the RDTS’s envisioned goals and functionality. We developed alternative functional allocations to explore the design space based on the availability of different enabling technologies. After downselecting to the function allocation, including the technologies expected to be developed, we created operational event sequence diagrams to visualize the operation flow and to identify requirements related to the human operator and the joint human-robot system. Applying these methods in the early design stages helped to refine the human-robot coordination requirements and to identify gaps in the operational concept—they show great potential to support the introduction of agricultural robots and bring them to fruition.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138590456","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adapting Cognitive Task Analysis Methods for Use in a Large Sample Simulation Study of High-Risk Healthcare Events. 适应认知任务分析方法用于高风险医疗事件的大样本模拟研究
IF 2 Q1 Engineering Pub Date : 2023-12-01 Epub Date: 2023-08-04 DOI: 10.1177/15553434231192283
Laura G Militello, Megan E Salwei, Carrie Reale, Christen Sushereba, Jason M Slagle, David Gaba, Matthew B Weinger, John Rask, Janelle Faiman, Michael Andreae, Amanda R Burden, Shilo Anders

Cognitive task analysis (CTA) methods are traditionally used to conduct small-sample, in-depth studies. In this case study, CTA methods were adapted for a large multi-site study in which 102 anesthesiologists worked through four different high-fidelity simulated high-consequence incidents. Cognitive interviews were used to elicit decision processes following each simulated incident. In this paper, we highlight three practical challenges that arose: (1) standardizing the interview techniques for use across a large, distributed team of diverse backgrounds; (2) developing effective training; and (3) developing a strategy to analyze the resulting large amount of qualitative data. We reflect on how we addressed these challenges by increasing standardization, developing focused training, overcoming social norms that hindered interview effectiveness, and conducting a staged analysis. We share findings from a preliminary analysis that provides early validation of the strategy employed. Analysis of a subset of 64 interview transcripts using a decompositional analysis approach suggests that interviewers successfully elicited descriptions of decision processes that varied due to the different challenges presented by the four simulated incidents. A holistic analysis of the same 64 transcripts revealed individual differences in how anesthesiologists interpreted and managed the same case.

认知任务分析(CTA)方法传统上用于进行小样本、深入的研究。在本案例研究中,CTA方法适用于一项大型多站点研究,其中102名麻醉师处理了四种不同的高保真度模拟高后果事件。认知访谈被用来引出每个模拟事件后的决策过程。在这篇论文中,我们强调了出现的三个实际挑战:(1)标准化面试技巧,以便在不同背景的大型分布式团队中使用;(2) 开展有效的培训;以及(3)制定分析由此产生的大量定性数据的策略。我们反思了我们是如何通过提高标准化、开展重点培训、克服阻碍面试有效性的社会规范以及进行阶段性分析来应对这些挑战的。我们分享了初步分析的结果,该分析为所采用的策略提供了早期验证。使用分解分析方法对64份面试记录的子集进行分析表明,面试官成功地引出了对决策过程的描述,这些描述因四个模拟事件带来的不同挑战而有所不同。对相同的64份转录本进行的整体分析显示,麻醉师对同一病例的解释和管理方式存在个体差异。
{"title":"Adapting Cognitive Task Analysis Methods for Use in a Large Sample Simulation Study of High-Risk Healthcare Events.","authors":"Laura G Militello, Megan E Salwei, Carrie Reale, Christen Sushereba, Jason M Slagle, David Gaba, Matthew B Weinger, John Rask, Janelle Faiman, Michael Andreae, Amanda R Burden, Shilo Anders","doi":"10.1177/15553434231192283","DOIUrl":"10.1177/15553434231192283","url":null,"abstract":"<p><p>Cognitive task analysis (CTA) methods are traditionally used to conduct small-sample, in-depth studies. In this case study, CTA methods were adapted for a large multi-site study in which 102 anesthesiologists worked through four different high-fidelity simulated high-consequence incidents. Cognitive interviews were used to elicit decision processes following each simulated incident. In this paper, we highlight three practical challenges that arose: (1) standardizing the interview techniques for use across a large, distributed team of diverse backgrounds; (2) developing effective training; and (3) developing a strategy to analyze the resulting large amount of qualitative data. We reflect on how we addressed these challenges by increasing standardization, developing focused training, overcoming social norms that hindered interview effectiveness, and conducting a staged analysis. We share findings from a preliminary analysis that provides early validation of the strategy employed. Analysis of a subset of 64 interview transcripts using a decompositional analysis approach suggests that interviewers successfully elicited descriptions of decision processes that varied due to the different challenges presented by the four simulated incidents. A holistic analysis of the same 64 transcripts revealed individual differences in how anesthesiologists interpreted and managed the same case.</p>","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10630935/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43625878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploratory Analysis of Decision-Making Biases of Professional Red Teamers in a Cyber-Attack Dataset 网络攻击数据集中专业红队人员决策偏差的探索性分析
IF 2 Q1 Engineering Pub Date : 2023-11-28 DOI: 10.1177/15553434231217787
Robert S. Gutzwiller, Hansol Rheem, Kimberly J. Ferguson-Walter, Christina M. Lewis, Chelsea K. Johnson, M. Major
Attacker psychology is currently under-examined in cybersecurity research. A prior, large-scale study sought to understand attackers’ behavior by testing both technological and psychological deception. Professional “red team” members participated over two days in various conditions. This data was examined for further evidence that cognitive biases, a potential disruption for attackers, may be present, and may be affecting the outcome. An applied, novel methodology for measuring confirmation bias and framing effects is presented using this realistic dataset. Both confirmation bias and the framing effect occurred in this interpretation. The framing effect appears to have reduced attacker interactions with systems in the network, which may benefit cyber defenders. These results provide additional, exploratory evidence that biases in the decision-making of cyber attackers could be used as part of a defensive cyber strategy. Limitations to the approach and directions for future study of attackers are discussed.
目前,网络安全研究中对攻击者心理的研究不足。之前的一项大规模研究试图通过测试技术和心理欺骗来了解攻击者的行为。专业 "红队 "成员在各种条件下参加了为期两天的测试。研究人员对这些数据进行了检查,以进一步证明可能存在的认知偏差--攻击者的潜在干扰因素--可能会影响结果。利用这个真实的数据集,介绍了一种测量确认偏差和框架效应的应用新方法。在这次解读中,确认偏差和框架效应都出现了。框架效应似乎减少了攻击者与网络系统的互动,这可能有利于网络防御者。这些结果提供了更多探索性证据,表明网络攻击者决策中的偏差可被用作防御性网络战略的一部分。本文还讨论了该方法的局限性以及未来研究攻击者的方向。
{"title":"Exploratory Analysis of Decision-Making Biases of Professional Red Teamers in a Cyber-Attack Dataset","authors":"Robert S. Gutzwiller, Hansol Rheem, Kimberly J. Ferguson-Walter, Christina M. Lewis, Chelsea K. Johnson, M. Major","doi":"10.1177/15553434231217787","DOIUrl":"https://doi.org/10.1177/15553434231217787","url":null,"abstract":"Attacker psychology is currently under-examined in cybersecurity research. A prior, large-scale study sought to understand attackers’ behavior by testing both technological and psychological deception. Professional “red team” members participated over two days in various conditions. This data was examined for further evidence that cognitive biases, a potential disruption for attackers, may be present, and may be affecting the outcome. An applied, novel methodology for measuring confirmation bias and framing effects is presented using this realistic dataset. Both confirmation bias and the framing effect occurred in this interpretation. The framing effect appears to have reduced attacker interactions with systems in the network, which may benefit cyber defenders. These results provide additional, exploratory evidence that biases in the decision-making of cyber attackers could be used as part of a defensive cyber strategy. Limitations to the approach and directions for future study of attackers are discussed.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":2.0,"publicationDate":"2023-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139217910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Context of Care: Abstraction Hierarchy Modeling of Therapeutic Foster Care Programs 护理情境:治疗性寄养项目的抽象层次模型
Q1 Engineering Pub Date : 2023-11-03 DOI: 10.1177/15553434231211060
Connor Wurst, Huei-Yen Winnie Chen, Ann M. Bisantz, Seventy F. Hall, Laura Maggiulli, Kenneth Joseph, Melanie Sage
Therapeutic foster care agencies provide temporary placements and a range of services to at-risk youth to help ensure their safety, permanency, and wellbeing. The practitioners that plan such care operate under heavy caseloads, limited resources, and high stakes. There is significant interest in supporting these practitioners with various technological interventions, but their work and the context around it is still poorly understood. This study aims to better understand the current assessment and treatment planning work in therapeutic foster care. We used the abstraction hierarchy modeling approach to outline the purposes, values, constraints, processes, and tools that define the workplace ecology encountered by care coordinators and clinicians from therapeutic foster care programs at Hillside, a collaborating human service organization. The resulting abstraction hierarchy was closely examined to identify areas for interventions and design implications.
治疗性寄养机构为有风险的青少年提供临时安置和一系列服务,以帮助确保他们的安全、永久和幸福。计划此类护理的从业人员在大量病例、有限资源和高风险的情况下运作。人们对用各种技术干预来支持这些实践者很感兴趣,但是人们对他们的工作及其背景仍然知之甚少。本研究旨在更好地了解目前治疗性寄养的评估和治疗计划工作。我们使用抽象层次建模方法来概述工作场所生态的目的、价值、约束、过程和工具,这些工作场所生态是由来自Hillside(一个人类合作服务组织)治疗性寄养项目的护理协调员和临床医生所遇到的。所产生的抽象层次被仔细检查,以确定干预和设计含义的领域。
{"title":"The Context of Care: Abstraction Hierarchy Modeling of Therapeutic Foster Care Programs","authors":"Connor Wurst, Huei-Yen Winnie Chen, Ann M. Bisantz, Seventy F. Hall, Laura Maggiulli, Kenneth Joseph, Melanie Sage","doi":"10.1177/15553434231211060","DOIUrl":"https://doi.org/10.1177/15553434231211060","url":null,"abstract":"Therapeutic foster care agencies provide temporary placements and a range of services to at-risk youth to help ensure their safety, permanency, and wellbeing. The practitioners that plan such care operate under heavy caseloads, limited resources, and high stakes. There is significant interest in supporting these practitioners with various technological interventions, but their work and the context around it is still poorly understood. This study aims to better understand the current assessment and treatment planning work in therapeutic foster care. We used the abstraction hierarchy modeling approach to outline the purposes, values, constraints, processes, and tools that define the workplace ecology encountered by care coordinators and clinicians from therapeutic foster care programs at Hillside, a collaborating human service organization. The resulting abstraction hierarchy was closely examined to identify areas for interventions and design implications.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135819806","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
In the Rough: Evaluation of Convergence Across Trust Assessment Techniques Using an Autonomous Golf Cart 粗糙:使用自主高尔夫球车的信任评估技术的收敛性评估
Q1 Engineering Pub Date : 2023-10-17 DOI: 10.1177/15553434231206422
Nathan L. Tenhundfeld, Jason Forsyth, Nathan R. Sprague, Samy El-Tawab, Jenna E. Cotter, Lisa Vangsness
As automated and autonomous systems become more widely available, the ability to integrate them into environments seamlessly becomes more important. One cognitive construct that can predict the use, misuse, and disuse of automated and autonomous systems is trust that a user has in the system. The literature has explored not only the predictive nature of trust but also the ways in which it can be evaluated. As a result, various measures, such as physiological and behavioral measures, have been proposed as ways to evaluate trust in real-time. However, inherent differences in the measurement approaches (e.g., task dependencies and timescales) raise questions about whether the use of these approaches will converge upon each other. If they do, then the selection of any given proven approach to trust assessment may not matter. However, if they do not converge, it raises questions about the ability of these measures to assess trust equally and whether discrepancies are attributable to discriminant validity or other factors. The present study used various trust assessment techniques for passengers in a self-driving golf-cart. We find little to no convergence across measures, raising questions that need to be addressed in future research.
随着自动化和自治系统变得越来越广泛,将它们无缝集成到环境中的能力变得更加重要。一个可以预测自动化和自治系统的使用、误用和废弃的认知结构是用户对系统的信任。文献不仅探讨了信任的预测性,而且还探讨了评估信任的方式。因此,各种措施,如生理和行为措施,已被提出作为实时评估信任的方法。然而,测量方法的内在差异(例如,任务依赖性和时间尺度)提出了这些方法的使用是否会相互收敛的问题。如果他们这样做,那么选择任何给定的经过验证的信任评估方法可能都无关紧要。然而,如果它们不趋同,就会引起对这些措施平等评估信任的能力的质疑,以及差异是否可归因于区别效度或其他因素。本研究对自动驾驶高尔夫球车上的乘客使用了各种信任评估技术。我们发现各种措施之间几乎没有趋同,这提出了需要在未来研究中解决的问题。
{"title":"In the Rough: Evaluation of Convergence Across Trust Assessment Techniques Using an Autonomous Golf Cart","authors":"Nathan L. Tenhundfeld, Jason Forsyth, Nathan R. Sprague, Samy El-Tawab, Jenna E. Cotter, Lisa Vangsness","doi":"10.1177/15553434231206422","DOIUrl":"https://doi.org/10.1177/15553434231206422","url":null,"abstract":"As automated and autonomous systems become more widely available, the ability to integrate them into environments seamlessly becomes more important. One cognitive construct that can predict the use, misuse, and disuse of automated and autonomous systems is trust that a user has in the system. The literature has explored not only the predictive nature of trust but also the ways in which it can be evaluated. As a result, various measures, such as physiological and behavioral measures, have been proposed as ways to evaluate trust in real-time. However, inherent differences in the measurement approaches (e.g., task dependencies and timescales) raise questions about whether the use of these approaches will converge upon each other. If they do, then the selection of any given proven approach to trust assessment may not matter. However, if they do not converge, it raises questions about the ability of these measures to assess trust equally and whether discrepancies are attributable to discriminant validity or other factors. The present study used various trust assessment techniques for passengers in a self-driving golf-cart. We find little to no convergence across measures, raising questions that need to be addressed in future research.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-10-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136032736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Framing Security Under Time Pressure: Brand Familiarity Matters for Mobile Application Choices 在时间压力下构建安全性:品牌熟悉度对移动应用选择的影响
Q1 Engineering Pub Date : 2023-09-22 DOI: 10.1177/15553434231200119
Jing Chen, Cody Parker
The current study examined the effects of security score framing, time pressure, and brand familiarity on mobile application choices. Past research has found the framing of safety versus risk scores affects how potential risks for mobile apps are communicated to users. Both time pressure and brand familiarity have been shown to affect consumers’ purchase behaviors but not yet for app-selection decisions. The current study examined the effects of time pressure and brand familiarity on the effectiveness of risk displays (framed as safety or risk) for mobile apps. Participants were shown screenshots of various apps with these factors manipulated, and they were to choose one out of six apps. Our findings indicate that users rely heavily on brand familiarity when choosing apps, which could lead to insecure decisions. Additionally, security scores guided app choices toward more secure apps when framed as safety than when framed as risk, although this advantage was only evident without time pressure and disappeared under time pressure. The design implications call for more careful screening and user education about the potential risks associated familiar apps, as well as the need of new security design solutions to help users under time pressure.
目前的研究考察了安全评分框架、时间压力和品牌熟悉度对移动应用选择的影响。过去的研究发现,安全与风险评分的框架影响着移动应用程序向用户传达潜在风险的方式。时间压力和品牌熟悉度都会影响消费者的购买行为,但尚未影响到应用程序的选择决策。目前的研究考察了时间压力和品牌熟悉度对移动应用程序风险显示(安全或风险)有效性的影响。研究人员向参与者展示了各种应用程序的截图,并对这些因素进行了处理,让他们从六个应用程序中选择一个。我们的研究结果表明,用户在选择应用程序时严重依赖品牌熟悉度,这可能会导致不安全的决策。此外,安全评分会引导应用选择更安全的应用,而不是风险应用,尽管这种优势只有在没有时间压力的情况下才明显,并且在时间压力下消失。设计的影响需要更仔细的筛选和用户教育,了解与熟悉的应用程序相关的潜在风险,以及需要新的安全设计解决方案来帮助时间紧迫的用户。
{"title":"Framing Security Under Time Pressure: Brand Familiarity Matters for Mobile Application Choices","authors":"Jing Chen, Cody Parker","doi":"10.1177/15553434231200119","DOIUrl":"https://doi.org/10.1177/15553434231200119","url":null,"abstract":"The current study examined the effects of security score framing, time pressure, and brand familiarity on mobile application choices. Past research has found the framing of safety versus risk scores affects how potential risks for mobile apps are communicated to users. Both time pressure and brand familiarity have been shown to affect consumers’ purchase behaviors but not yet for app-selection decisions. The current study examined the effects of time pressure and brand familiarity on the effectiveness of risk displays (framed as safety or risk) for mobile apps. Participants were shown screenshots of various apps with these factors manipulated, and they were to choose one out of six apps. Our findings indicate that users rely heavily on brand familiarity when choosing apps, which could lead to insecure decisions. Additionally, security scores guided app choices toward more secure apps when framed as safety than when framed as risk, although this advantage was only evident without time pressure and disappeared under time pressure. The design implications call for more careful screening and user education about the potential risks associated familiar apps, as well as the need of new security design solutions to help users under time pressure.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136060132","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dynamical Measurement of Team Resilience 团队弹性的动态测量
Q1 Engineering Pub Date : 2023-09-20 DOI: 10.1177/15553434231199729
David A.P. Grimm, Jamie C. Gorman, Nancy J. Cooke, Mustafa Demir, Nathan J. McNeese
Resilient teams overcome sudden, dynamic changes by enacting rapid, adaptive responses that maintain system effectiveness. We analyzed two experiments on human-autonomy teams (HATs) operating a simulated remotely piloted aircraft system (RPAS) and correlated dynamical measures of resilience with measures of team performance. Across both experiments, HATs experienced automation and autonomy failures, using a Wizard of Oz paradigm. Team performance was measured in multiple ways, using a mission-level performance score, a target processing efficiency score, a failure overcome score, and a ground truth resilience score. Novel dynamical systems metrics of resilience measured the timing of system reorganization in response to failures across RPAS layers, including vehicle, controls, communications layers, and the system overall. Time to achieve extreme values of reorganization and novelty of reorganization were consistently correlated with target processing efficiency and ground truth resilience across both studies. Correlations with mission-level performance and the overcome score were apparent but less consistent. Across both studies, teams displayed greater system reorganization during failures compared to routine task conditions. The second experiment revealed differential effects of team training focused on coordination coaching and trust calibration. These results inform the measurement and training of resilience in HATs using objective, real-time resilience analysis.
弹性团队通过制定保持系统有效性的快速适应性响应来克服突然的动态变化。我们分析了人类自主团队(hat)操作模拟遥控飞机系统(RPAS)的两个实验,并将弹性的动态测量与团队绩效的测量相关联。在这两个实验中,HATs使用绿野仙踪范例经历了自动化和自治失败。团队绩效以多种方式测量,使用任务级绩效得分、目标处理效率得分、失败克服得分和基础真相弹性得分。新的动态系统弹性度量测量了系统重组的时间,以响应跨RPAS层的故障,包括车辆、控制、通信层和整个系统。在两项研究中,实现重组极值的时间和重组新颖性与目标处理效率和基础真相弹性一致相关。任务级表现和克服得分之间的相关性是明显的,但不太一致。在这两项研究中,与常规任务条件相比,团队在失败时表现出更大的系统重组。第二个实验揭示了团队训练在协调指导和信任校准方面的差异效应。这些结果为使用客观、实时的弹性分析来测量和训练HATs中的弹性提供了信息。
{"title":"Dynamical Measurement of Team Resilience","authors":"David A.P. Grimm, Jamie C. Gorman, Nancy J. Cooke, Mustafa Demir, Nathan J. McNeese","doi":"10.1177/15553434231199729","DOIUrl":"https://doi.org/10.1177/15553434231199729","url":null,"abstract":"Resilient teams overcome sudden, dynamic changes by enacting rapid, adaptive responses that maintain system effectiveness. We analyzed two experiments on human-autonomy teams (HATs) operating a simulated remotely piloted aircraft system (RPAS) and correlated dynamical measures of resilience with measures of team performance. Across both experiments, HATs experienced automation and autonomy failures, using a Wizard of Oz paradigm. Team performance was measured in multiple ways, using a mission-level performance score, a target processing efficiency score, a failure overcome score, and a ground truth resilience score. Novel dynamical systems metrics of resilience measured the timing of system reorganization in response to failures across RPAS layers, including vehicle, controls, communications layers, and the system overall. Time to achieve extreme values of reorganization and novelty of reorganization were consistently correlated with target processing efficiency and ground truth resilience across both studies. Correlations with mission-level performance and the overcome score were apparent but less consistent. Across both studies, teams displayed greater system reorganization during failures compared to routine task conditions. The second experiment revealed differential effects of team training focused on coordination coaching and trust calibration. These results inform the measurement and training of resilience in HATs using objective, real-time resilience analysis.","PeriodicalId":46342,"journal":{"name":"Journal of Cognitive Engineering and Decision Making","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136314688","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Cognitive Engineering and Decision Making
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1