首页 > 最新文献

2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision最新文献

英文 中文
Fidelity & validity in robotic simulation 机器人仿真中的保真度与有效性
K. E. Schafer, T. Sanders, T. Kessler, Mitchell S. Dunfee, T. Wild, P. Hancock
This work assesses the relationship between common theoretical constructs involved in simulation design and evaluation. Specifically, the degree to which realism is a desired goal in design is examined through a thorough review of the available literature. It was found that, especially for training simulations, high fidelity does not always beget improved outcomes, and this finding was corroborated by the results of an experiment involving a simulated robot. In the within-subjects experiment, participants rated their trust in both live and simulated versions of a robot performing in both reliable and unreliable scenarios. As predicted, strong correlations in both the reliable and unreliable scenarios validate the RIVET simulation engine as a model for trust in HRI and provide further evidence that relatively low-fidelity simulations can sometimes be sufficient or superior to high-fidelity alternatives.
这项工作评估了在模拟设计和评估中涉及的常见理论结构之间的关系。具体来说,通过对现有文献的全面审查,可以检查现实主义在设计中作为期望目标的程度。研究发现,特别是在训练模拟中,高保真度并不总是能带来更好的结果,这一发现被一个模拟机器人的实验结果所证实。在受试者内部实验中,参与者对机器人在可靠和不可靠场景下的真实和模拟版本的信任度进行了评分。正如预测的那样,可靠和不可靠场景中的强相关性验证了RIVET仿真引擎作为HRI信任模型的有效性,并提供了进一步的证据,表明相对低保真度的仿真有时可以足够或优于高保真度的替代方案。
{"title":"Fidelity & validity in robotic simulation","authors":"K. E. Schafer, T. Sanders, T. Kessler, Mitchell S. Dunfee, T. Wild, P. Hancock","doi":"10.1109/COGSIMA.2015.7108184","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7108184","url":null,"abstract":"This work assesses the relationship between common theoretical constructs involved in simulation design and evaluation. Specifically, the degree to which realism is a desired goal in design is examined through a thorough review of the available literature. It was found that, especially for training simulations, high fidelity does not always beget improved outcomes, and this finding was corroborated by the results of an experiment involving a simulated robot. In the within-subjects experiment, participants rated their trust in both live and simulated versions of a robot performing in both reliable and unreliable scenarios. As predicted, strong correlations in both the reliable and unreliable scenarios validate the RIVET simulation engine as a model for trust in HRI and provide further evidence that relatively low-fidelity simulations can sometimes be sufficient or superior to high-fidelity alternatives.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"5 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128851019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 8
Automatic derivation of context descriptions 上下文描述的自动派生
Christian Jung, Denis Feth, Yehia Elrakaiby
Context-awareness in mobile information systems bears a huge potential. However, context-awareness is still in its infancy and its full potential is not yet exploited. One reason is the poorly supported creation and learning of suitable context descriptions. Another problem is the questionable predictive power of context descriptions that makes it difficult to correctly determine the current user context. For applications that depend on the user context, the reliable determination of the context is essential. In this paper, we propose a process to characterize contexts. We correlate raw contextual information with user activities to determine accurate context descriptions. In a case study, we show how different statistical methods can be used to determine correlations, and analyze their applicability.
上下文感知在移动信息系统中具有巨大的潜力。然而,上下文感知仍处于起步阶段,其全部潜力尚未得到开发。一个原因是缺乏对创建和学习合适的上下文描述的支持。另一个问题是上下文描述的预测能力存在问题,这使得正确确定当前用户上下文变得困难。对于依赖于用户上下文的应用程序,可靠地确定上下文是必不可少的。在本文中,我们提出了一个表征上下文的过程。我们将原始上下文信息与用户活动关联起来,以确定准确的上下文描述。在一个案例研究中,我们展示了如何使用不同的统计方法来确定相关性,并分析它们的适用性。
{"title":"Automatic derivation of context descriptions","authors":"Christian Jung, Denis Feth, Yehia Elrakaiby","doi":"10.1109/COGSIMA.2015.7108177","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7108177","url":null,"abstract":"Context-awareness in mobile information systems bears a huge potential. However, context-awareness is still in its infancy and its full potential is not yet exploited. One reason is the poorly supported creation and learning of suitable context descriptions. Another problem is the questionable predictive power of context descriptions that makes it difficult to correctly determine the current user context. For applications that depend on the user context, the reliable determination of the context is essential. In this paper, we propose a process to characterize contexts. We correlate raw contextual information with user activities to determine accurate context descriptions. In a case study, we show how different statistical methods can be used to determine correlations, and analyze their applicability.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"73 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-05-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124268518","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 5
Combining human knowledge and operational data to promote detailed and effective reporting 结合人力知识和业务数据,促进详细有效的报告
Jennifer Danczyk, Paula Jacobs, Stephanie Kane, Michael Farry, W. Thornton
There are many task-related factors that drive the complexity and diversity of submarine operations during a mission, including knowing the correct time to make periscope observations, estimating the correct sea state, and being aware of the proximity of contacts. In addition, there are unpredictable events and circumstances, including equipment failures, environmental factors, and adversary actions, that affect the operation's success or failure. After operations are complete, commanders are tasked with recounting and reporting events of interest. Commanders are asked to recall details of critical incidents, when their perceptual and cognitive resources are likely to be over-tasked, resulting in less accurate recall. In most operations, there is little objective data collection to back up those recollections, especially for critical incidents that had the potential to cause catastrophes but did not. However, instances where catastrophes are narrowly avoided offer valuable teaching moments for crewmembers. Collecting and visualizing objective performance data within a mission reconstruction tool can help commanders account for actual actions and decisions for the purpose of reporting, and also enables resilient planning and optimal execution of future tasks, because commanders are able to analyze alternative courses of action (COAs) and their trade-offs. Most importantly, having a more comprehensive analysis tool can enable more accurate and thorough training, thus improving the mission performance and operational safety of future submarine operations and performance.
在执行任务期间,有许多与任务相关的因素驱动着潜艇操作的复杂性和多样性,包括知道进行潜望镜观察的正确时间,估计正确的海况,以及意识到接触点的接近程度。此外,还存在不可预测的事件和情况,包括设备故障、环境因素和对手行为,这些都会影响操作的成败。行动完成后,指挥官的任务是重述和报告感兴趣的事件。指挥官被要求回忆关键事件的细节,这时他们的感知和认知资源可能会超负荷,导致回忆的准确性降低。在大多数操作中,很少有客观的数据收集来支持这些回忆,特别是对于有可能造成灾难但没有造成灾难的关键事件。然而,侥幸避免灾难的例子为机组人员提供了宝贵的教训。在任务重建工具中收集和可视化客观性能数据可以帮助指挥官为报告目的考虑实际行动和决策,并且还可以实现弹性规划和未来任务的最佳执行,因为指挥官能够分析替代行动方案(coa)及其权衡。最重要的是,拥有更全面的分析工具,可以实现更准确、更彻底的训练,从而提高未来潜艇作战性能的任务性能和操作安全性。
{"title":"Combining human knowledge and operational data to promote detailed and effective reporting","authors":"Jennifer Danczyk, Paula Jacobs, Stephanie Kane, Michael Farry, W. Thornton","doi":"10.1109/COGSIMA.2015.7108201","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7108201","url":null,"abstract":"There are many task-related factors that drive the complexity and diversity of submarine operations during a mission, including knowing the correct time to make periscope observations, estimating the correct sea state, and being aware of the proximity of contacts. In addition, there are unpredictable events and circumstances, including equipment failures, environmental factors, and adversary actions, that affect the operation's success or failure. After operations are complete, commanders are tasked with recounting and reporting events of interest. Commanders are asked to recall details of critical incidents, when their perceptual and cognitive resources are likely to be over-tasked, resulting in less accurate recall. In most operations, there is little objective data collection to back up those recollections, especially for critical incidents that had the potential to cause catastrophes but did not. However, instances where catastrophes are narrowly avoided offer valuable teaching moments for crewmembers. Collecting and visualizing objective performance data within a mission reconstruction tool can help commanders account for actual actions and decisions for the purpose of reporting, and also enables resilient planning and optimal execution of future tasks, because commanders are able to analyze alternative courses of action (COAs) and their trade-offs. Most importantly, having a more comprehensive analysis tool can enable more accurate and thorough training, thus improving the mission performance and operational safety of future submarine operations and performance.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"44 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125199861","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Applying a priming mechanism for intention recognition in shared control 基于启动机制的共享控制意图识别
Benjamin Fonooni, T. Hellström
In many robotics shared control applications, users are forced to focus hard on the robot due to the task's high sensitivity or the robot's misunderstanding of the user's intention. This brings frustration and dissatisfaction to the user and reduces overall efficiency. The user's intention is sometimes unclear and hard to identify without some kind of bias in the identification process. In this paper, we present a solution in which an attentional mechanism helps the robot to recognize the user's intention. The solution uses a priming mechanism and parameterized behavior primitives to support intention recognition and improve shared control for teleoperation tasks.
在许多机器人共享控制应用中,由于任务的高灵敏度或机器人对用户意图的误解,用户不得不将注意力集中在机器人身上。这会给用户带来挫败感和不满,并降低整体效率。用户的意图有时是不明确的,很难在识别过程中没有某种偏见的情况下识别。在本文中,我们提出了一个解决方案,其中注意机制帮助机器人识别用户的意图。该解决方案使用启动机制和参数化行为原语来支持意图识别和改进远程操作任务的共享控制。
{"title":"Applying a priming mechanism for intention recognition in shared control","authors":"Benjamin Fonooni, T. Hellström","doi":"10.1109/COGSIMA.2015.7107972","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7107972","url":null,"abstract":"In many robotics shared control applications, users are forced to focus hard on the robot due to the task's high sensitivity or the robot's misunderstanding of the user's intention. This brings frustration and dissatisfaction to the user and reduces overall efficiency. The user's intention is sometimes unclear and hard to identify without some kind of bias in the identification process. In this paper, we present a solution in which an attentional mechanism helps the robot to recognize the user's intention. The solution uses a priming mechanism and parameterized behavior primitives to support intention recognition and improve shared control for teleoperation tasks.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126997103","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Comparing models for modeling subjective and objective measures for two task types 比较两种任务类型的主观和客观度量建模模型
S. Lackey, Brandon Sollins, L. Reinerman-Jones
Adaptive automation (AA) has emerged as a viable solution to improving human performance in complex environments. However, understanding when to prompt, pause, and terminate AA remains unclear. Augmenting the user with physiological sensors offers new insight into the user's state, and thus, offers insight into when and how to implement AA. The research presented investigates the efficacy of prediction algorithms for modeling physiological and subjective data in AA environments. A comparison of traditional and emerging modeling methods results in recommendations for algorithm selection, generalizability, and risks of over fitting data are provided.
自适应自动化(AA)已成为一种可行的解决方案,以提高人类在复杂环境中的表现。然而,对于何时提示、暂停和终止AA的理解仍然不清楚。增强用户的生理传感器提供了对用户状态的新见解,从而提供了对何时以及如何实现AA的见解。本研究探讨了AA环境中生理和主观数据建模预测算法的有效性。对传统和新兴的建模方法进行比较,给出了算法选择、可泛化性和过度拟合数据风险的建议。
{"title":"Comparing models for modeling subjective and objective measures for two task types","authors":"S. Lackey, Brandon Sollins, L. Reinerman-Jones","doi":"10.1109/COGSIMA.2015.7108175","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7108175","url":null,"abstract":"Adaptive automation (AA) has emerged as a viable solution to improving human performance in complex environments. However, understanding when to prompt, pause, and terminate AA remains unclear. Augmenting the user with physiological sensors offers new insight into the user's state, and thus, offers insight into when and how to implement AA. The research presented investigates the efficacy of prediction algorithms for modeling physiological and subjective data in AA environments. A comparison of traditional and emerging modeling methods results in recommendations for algorithm selection, generalizability, and risks of over fitting data are provided.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126682472","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
The effect of 2-dimensional and 3-dimensional perspective view displays on situation awareness during command and control 二维和三维视角对指挥控制过程中态势感知的影响
J. V. D. Meulen, J. R. Smith
The primary aim of the study was to evaluate the potential of information technologies, specifically 2-dimensional (2D) and 3-dimensional (3D) perspective view displays, on situation awareness (SA) in a command and control environment. Furthermore, the influence of experience on SA while using the displays was investigated. SA of 10 air mission controllers (AMCs) was evaluated while using both displays during a simulated interception scenario. The protocol required each AMC to command two fighter jets in order to complete a successful intercept. The SA requirements for the scenario were extracted using a goal directed task analysis whereby the SA queries were derived. Significant differences (p <; 0.05) were found between the 2D and 3D displays for Level 1 SA while no significant differences were found for Level 2 and Level 3. The experienced AMCs demonstrated higher levels of SA at all 3 levels irrespective of display type but the differences were not significant. It is therefore deemed that experience does not play a major role in gaining SA when using the 3D display. This was expected because neither group had any prior experience with the 3D display. Level 1 SA was significantly higher for both the experienced and less experienced groups when using the 2D display. Level 1 was also significantly higher than Level 3 for both the experienced and less experienced groups when using the 3D display. The implication of these results are that although the AMCs were able to comprehend the mission, they were unable to perceive and project accurately what was going to happen next in the scenario when using the 3D display. Therefore the 3D display did not contribute towards improved SA or provide an advantage to command and control performance above that of the 2D display.
该研究的主要目的是评估信息技术的潜力,特别是2维(2D)和3维(3D)视角显示,在指挥和控制环境中的态势感知(SA)。此外,还研究了使用显示器时经验对SA的影响。在模拟拦截场景中,使用两种显示器对10个空中任务控制器(amc)的SA进行了评估。该协议要求每个AMC指挥两架战斗机,以完成一次成功的拦截。使用目标导向任务分析提取场景的SA需求,从而派生SA查询。显著性差异(p <;1级SA的2D和3D显示差异为0.05),而2级和3级SA的2D和3D显示差异无统计学意义。经验丰富的amc在所有3个水平上均表现出较高的SA水平,而与显示类型无关,但差异不显著。因此,在使用3D显示器时,经验在获得SA方面并不起主要作用。这是意料之中的,因为两组人之前都没有任何3D显示器的经验。当使用2D显示时,有经验组和经验不足组的1级SA均显著较高。在使用3D显示器时,有经验和经验不足的组的1级明显高于3级。这些结果的含义是,尽管amc能够理解任务,但当使用3D显示器时,它们无法准确地感知和预测接下来会发生什么。因此,3D显示器对改进SA没有贡献,也没有提供优于2D显示器的命令和控制性能的优势。
{"title":"The effect of 2-dimensional and 3-dimensional perspective view displays on situation awareness during command and control","authors":"J. V. D. Meulen, J. R. Smith","doi":"10.1109/COGSIMA.2015.7108180","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7108180","url":null,"abstract":"The primary aim of the study was to evaluate the potential of information technologies, specifically 2-dimensional (2D) and 3-dimensional (3D) perspective view displays, on situation awareness (SA) in a command and control environment. Furthermore, the influence of experience on SA while using the displays was investigated. SA of 10 air mission controllers (AMCs) was evaluated while using both displays during a simulated interception scenario. The protocol required each AMC to command two fighter jets in order to complete a successful intercept. The SA requirements for the scenario were extracted using a goal directed task analysis whereby the SA queries were derived. Significant differences (p <; 0.05) were found between the 2D and 3D displays for Level 1 SA while no significant differences were found for Level 2 and Level 3. The experienced AMCs demonstrated higher levels of SA at all 3 levels irrespective of display type but the differences were not significant. It is therefore deemed that experience does not play a major role in gaining SA when using the 3D display. This was expected because neither group had any prior experience with the 3D display. Level 1 SA was significantly higher for both the experienced and less experienced groups when using the 2D display. Level 1 was also significantly higher than Level 3 for both the experienced and less experienced groups when using the 3D display. The implication of these results are that although the AMCs were able to comprehend the mission, they were unable to perceive and project accurately what was going to happen next in the scenario when using the 3D display. Therefore the 3D display did not contribute towards improved SA or provide an advantage to command and control performance above that of the 2D display.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"2009 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125637405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A model-driven approach to the a priori estimation of operator workload 一个模型驱动的方法来先验估计操作员的工作量
D. K. B. Ismail, Olivier Grivard
The measurement, or at least the estimation, of the operators' workload is an important aspect of usage-oriented design of professional systems. Various approaches to the a priori measurement of workload have been proposed. They can be classified into three categories: performance measures, physiological measures and subjective measures. Subjective methods have many advantages such as high `face validity', ease of application and low cost. However, they have failed to take into account some important parameters that can heavily impact the workload estimation: experience, skills, level of training, etc. This paper addresses a new method for the estimation of workload, based on the following parameters: task complexity, time load, experience, knowledge and abilities compared to task requirements. Although these parameters have been identified in the literature as being important, they have not been deeply analyzed. The authors describe their approach and propose to use mental representations of human entities, human roles, tasks, knowledge and abilities. The approach is illustrated on an airborne maritime surveillance usecase, in the context of the French Medusa project.
测量,或至少估计,操作人员的工作量是面向使用的专业系统设计的一个重要方面。已经提出了对工作量进行先验测量的各种方法。它们可以分为三大类:性能测量、生理测量和主观测量。主观方法具有“面效度”高、应用方便、成本低等优点。然而,他们没有考虑到一些可能严重影响工作量估计的重要参数:经验、技能、培训水平等。本文提出了一种新的工作量估算方法,该方法基于以下参数:任务复杂性、时间负荷、与任务需求相比的经验、知识和能力。虽然这些参数在文献中被认为是重要的,但它们并没有被深入分析。作者描述了他们的方法,并建议使用人类实体、人类角色、任务、知识和能力的心理表征。在法国美杜莎项目的背景下,该方法以空中海上监视用例为例进行了说明。
{"title":"A model-driven approach to the a priori estimation of operator workload","authors":"D. K. B. Ismail, Olivier Grivard","doi":"10.1109/COGSIMA.2015.7107967","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7107967","url":null,"abstract":"The measurement, or at least the estimation, of the operators' workload is an important aspect of usage-oriented design of professional systems. Various approaches to the a priori measurement of workload have been proposed. They can be classified into three categories: performance measures, physiological measures and subjective measures. Subjective methods have many advantages such as high `face validity', ease of application and low cost. However, they have failed to take into account some important parameters that can heavily impact the workload estimation: experience, skills, level of training, etc. This paper addresses a new method for the estimation of workload, based on the following parameters: task complexity, time load, experience, knowledge and abilities compared to task requirements. Although these parameters have been identified in the literature as being important, they have not been deeply analyzed. The authors describe their approach and propose to use mental representations of human entities, human roles, tasks, knowledge and abilities. The approach is illustrated on an airborne maritime surveillance usecase, in the context of the French Medusa project.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"328 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115385893","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Supporting common ground across multiple operator perspectives - Creating collaborative solutions for distributed processing, exploitation, and dissemination (PED) 支持跨多个运营商视角的共同点——为分布式处理、开发和传播(PED)创建协作解决方案
Arthur Wollocko, Michael Farry, Martin Voshell, Michael P. Jenkins, Michael Pellicano
This paper describes how a Cognitive Systems Engineering approach was used to design a collaborative work system for the emerging distributed Processing, Exploitation, and Dissemination (PED) enterprise. Working closely with domain practitioners and based on previously identified capability gaps, we designed a prototype system to address key cognitive and collaborative functions not supported in existing chat tools in use by the community. We then extended standard chat functionality with an Asynchronous, Multi-dimensional Chat Client to develop a set of interactive design seeds. The initial design seeds were based on providing: (1) real-time, on-topic contextual cues about collaborators' activities with regard to a shared intelligence picture; (2) automated information gathering assistance; and (3) enhanced functionality using easily developed, modular, external software extensions. Initial results based on feedback from operators are then discussed to shape future design iterations. We conclude that future PED tools based on these enhanced functionalities have significant potential to help personnel easily and effectively access, manage, and monitor multiple shared frames of reference with their analytical, consumer, and collector counterparts, establishing a common ground that is critical for emerging distributed intelligence, surveillance, and reconnaissance (ISR) workflows.
本文描述了如何使用认知系统工程方法为新兴的分布式处理、开发和传播(PED)企业设计协同工作系统。与领域实践者紧密合作,并基于先前确定的能力差距,我们设计了一个原型系统,以解决社区使用的现有聊天工具不支持的关键认知和协作功能。然后,我们使用异步、多维聊天客户端扩展标准聊天功能,以开发一组交互设计种子。最初的设计种子是基于提供:(1)关于合作者的活动的实时、主题上下文线索;(2)自动信息收集协助;(3)使用易于开发的模块化外部软件扩展来增强功能。然后讨论基于操作人员反馈的初步结果,以形成未来的设计迭代。我们的结论是,基于这些增强功能的未来PED工具具有巨大的潜力,可以帮助工作人员轻松有效地访问、管理和监控与其分析、消费者和收集器对应的多个共享参考框架,建立对新兴的分布式情报、监视和侦察(ISR)工作流程至关重要的共同基础。
{"title":"Supporting common ground across multiple operator perspectives - Creating collaborative solutions for distributed processing, exploitation, and dissemination (PED)","authors":"Arthur Wollocko, Michael Farry, Martin Voshell, Michael P. Jenkins, Michael Pellicano","doi":"10.1109/COGSIMA.2015.7108179","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7108179","url":null,"abstract":"This paper describes how a Cognitive Systems Engineering approach was used to design a collaborative work system for the emerging distributed Processing, Exploitation, and Dissemination (PED) enterprise. Working closely with domain practitioners and based on previously identified capability gaps, we designed a prototype system to address key cognitive and collaborative functions not supported in existing chat tools in use by the community. We then extended standard chat functionality with an Asynchronous, Multi-dimensional Chat Client to develop a set of interactive design seeds. The initial design seeds were based on providing: (1) real-time, on-topic contextual cues about collaborators' activities with regard to a shared intelligence picture; (2) automated information gathering assistance; and (3) enhanced functionality using easily developed, modular, external software extensions. Initial results based on feedback from operators are then discussed to shape future design iterations. We conclude that future PED tools based on these enhanced functionalities have significant potential to help personnel easily and effectively access, manage, and monitor multiple shared frames of reference with their analytical, consumer, and collector counterparts, establishing a common ground that is critical for emerging distributed intelligence, surveillance, and reconnaissance (ISR) workflows.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"40 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132884410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ARSCA: a computer tool for tracing the cognitive processes of cyber-attack analysis ARSCA:追踪网络攻击分析认知过程的计算机工具
Chen Zhong, J. Yen, Peng Liu, R. Erbacher, Renee Etoty, C. Garneau
Efficiency and interference shielding are critical factors for conducting successful cognitive task analysis (CTA) of cyber-attack analysis. To achieve this goal, a tool, named ARSCA, is developed to work with an analyst during a cyber-attack analysis task and to capture the main elements in his/her cognitive process. ARSCA conducts process tracing in a way that reduces the study time and the workload needed for analysts and does not distract the analysts from executing their tasks. ARSCA has been tested in an experiment with a simulated cyber-attack analysis task. Thirteen professional analysts and seventeen doctoral students specializing in cyber security are recruited. We evaluate the captured traces and the participants' feedbacks on working with ARSCA.
效率和干扰屏蔽是网络攻击分析中成功进行认知任务分析(CTA)的关键因素。为了实现这一目标,开发了一种名为ARSCA的工具,用于在网络攻击分析任务期间与分析师一起工作,并捕获他/她认知过程中的主要元素。ARSCA以一种减少分析人员所需的研究时间和工作量的方式进行过程跟踪,并且不会分散分析人员执行任务的注意力。ARSCA已在模拟网络攻击分析任务的实验中进行了测试。招收网络安全专业专业分析师13名,博士生17名。我们评估捕获的轨迹和参与者对使用ARSCA的反馈。
{"title":"ARSCA: a computer tool for tracing the cognitive processes of cyber-attack analysis","authors":"Chen Zhong, J. Yen, Peng Liu, R. Erbacher, Renee Etoty, C. Garneau","doi":"10.1109/COGSIMA.2015.7108193","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7108193","url":null,"abstract":"Efficiency and interference shielding are critical factors for conducting successful cognitive task analysis (CTA) of cyber-attack analysis. To achieve this goal, a tool, named ARSCA, is developed to work with an analyst during a cyber-attack analysis task and to capture the main elements in his/her cognitive process. ARSCA conducts process tracing in a way that reduces the study time and the workload needed for analysts and does not distract the analysts from executing their tasks. ARSCA has been tested in an experiment with a simulated cyber-attack analysis task. Thirteen professional analysts and seventeen doctoral students specializing in cyber security are recruited. We evaluate the captured traces and the participants' feedbacks on working with ARSCA.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"8 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126608414","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 17
Risk-driven intent assessment and response generation in maritime surveillance operations 海上监视行动中风险驱动的意图评估和响应生成
R. Falcon, R. Abielmona, Sean Billings
Decision support systems (DSSs) are playing an increasingly important role in the characterization of suspicious activities in an area of interest given their proved ability to turn vast amounts of raw data into actionable intelligence that is easy to understand by human operators. Although risk management is an integral component of the decision making process that directly contributes towards improved situational awareness and response assessment, an active end-to-end consideration of the underlying risk sources in the environment is still an important feature that most DSSs currently lack. Additionally, deciding on an appropriate course of action (COA) to mitigate emerging threats in the system is a challenging task even for domain experts given that (1) the number of potential responses to analyze could be overwhelmingly large; (2) seldom are those responses judged in terms of the risks associated with their enactment and (3) assessing the effectiveness of the potential responses in the real world is usually time-consuming and simulation-driven. In this paper, we formalize the adaptation of a recently proposed Risk Management Framework to account for behavioral intents associated with the objects of interest (OOIs) in the monitoring environment and their link to automatic response generation. The intent of the objects is inferred from high-level cognitive and behavioral knowledge in the form of anomalies. When an OOI has crossed a permissible risk threshold, we demonstrate how responses to that situation can be automatically elicited by the COA recommendation module of a risk-aware DSS. Multicriteria decision analysis (MCDA) is used to judge a diverse set of plausible responses according to different operational objectives. We illustrate the application of the proposed framework in the context of maritime surveillance operations by triggering a corporate search for a missing vessel. To the best of our knowledge, this is the first time that risk features are synthesized from anomalies and integrated into a more comprehensive RMF engine for knowledge (response) elicitation.
决策支持系统(DSSs)已被证明能够将大量原始数据转化为易于操作人员理解的可操作情报,因此在表征感兴趣领域的可疑活动方面发挥着越来越重要的作用。尽管风险管理是决策过程中不可或缺的组成部分,直接有助于改善态势感知和响应评估,但对环境中潜在风险源的主动端到端考虑仍然是大多数决策支持系统目前缺乏的重要特征。此外,决定适当的行动方案(COA)以减轻系统中新出现的威胁是一项具有挑战性的任务,即使对于领域专家来说也是如此,因为(1)要分析的潜在响应的数量可能非常大;(2)这些应对措施很少根据其制定相关的风险来判断;(3)评估现实世界中潜在应对措施的有效性通常是耗时的,并且是模拟驱动的。在本文中,我们对最近提出的风险管理框架进行了形式化调整,以解释与监测环境中感兴趣对象(ooi)相关的行为意图及其与自动响应生成的联系。对象的意图以异常的形式从高级认知和行为知识中推断出来。当OOI超过允许的风险阈值时,我们将演示如何通过风险感知DSS的COA推荐模块自动引出对该情况的响应。多准则决策分析(MCDA)用于根据不同的操作目标判断各种可能的响应。我们通过触发对失踪船只的公司搜索来说明拟议框架在海上监视行动背景下的应用。据我们所知,这是第一次从异常中合成风险特征,并将其集成到一个更全面的RMF引擎中,以获取知识(响应)。
{"title":"Risk-driven intent assessment and response generation in maritime surveillance operations","authors":"R. Falcon, R. Abielmona, Sean Billings","doi":"10.1109/COGSIMA.2015.7108191","DOIUrl":"https://doi.org/10.1109/COGSIMA.2015.7108191","url":null,"abstract":"Decision support systems (DSSs) are playing an increasingly important role in the characterization of suspicious activities in an area of interest given their proved ability to turn vast amounts of raw data into actionable intelligence that is easy to understand by human operators. Although risk management is an integral component of the decision making process that directly contributes towards improved situational awareness and response assessment, an active end-to-end consideration of the underlying risk sources in the environment is still an important feature that most DSSs currently lack. Additionally, deciding on an appropriate course of action (COA) to mitigate emerging threats in the system is a challenging task even for domain experts given that (1) the number of potential responses to analyze could be overwhelmingly large; (2) seldom are those responses judged in terms of the risks associated with their enactment and (3) assessing the effectiveness of the potential responses in the real world is usually time-consuming and simulation-driven. In this paper, we formalize the adaptation of a recently proposed Risk Management Framework to account for behavioral intents associated with the objects of interest (OOIs) in the monitoring environment and their link to automatic response generation. The intent of the objects is inferred from high-level cognitive and behavioral knowledge in the form of anomalies. When an OOI has crossed a permissible risk threshold, we demonstrate how responses to that situation can be automatically elicited by the COA recommendation module of a risk-aware DSS. Multicriteria decision analysis (MCDA) is used to judge a diverse set of plausible responses according to different operational objectives. We illustrate the application of the proposed framework in the context of maritime surveillance operations by triggering a corporate search for a missing vessel. To the best of our knowledge, this is the first time that risk features are synthesized from anomalies and integrated into a more comprehensive RMF engine for knowledge (response) elicitation.","PeriodicalId":373467,"journal":{"name":"2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2015-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125233496","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
期刊
2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1