首页 > 最新文献

ACM Transactions on Interactive Intelligent Systems最新文献

英文 中文
Visual Analytics of Neuron Vulnerability to Adversarial Attacks on Convolutional Neural Networks 卷积神经网络对抗性攻击下神经元脆弱性的可视化分析
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-03-06 DOI: 10.1145/3587470
Yiran Li, Junpeng Wang, Takanori Fujiwara, Kwan-Liu Ma
Adversarial attacks on a convolutional neural network (CNN)—injecting human-imperceptible perturbations into an input image—could fool a high-performance CNN into making incorrect predictions. The success of adversarial attacks raises serious concerns about the robustness of CNNs, and prevents them from being used in safety-critical applications, such as medical diagnosis and autonomous driving. Our work introduces a visual analytics approach to understanding adversarial attacks by answering two questions: (1) which neurons are more vulnerable to attacks and (2) which image features do these vulnerable neurons capture during the prediction? For the first question, we introduce multiple perturbation-based measures to break down the attacking magnitude into individual CNN neurons and rank the neurons by their vulnerability levels. For the second, we identify image features (e.g., cat ears) that highly stimulate a user-selected neuron to augment and validate the neuron’s responsibility. Furthermore, we support an interactive exploration of a large number of neurons by aiding with hierarchical clustering based on the neurons’ roles in the prediction. To this end, a visual analytics system is designed to incorporate visual reasoning for interpreting adversarial attacks. We validate the effectiveness of our system through multiple case studies as well as feedback from domain experts.
对卷积神经网络(CNN)的对抗性攻击——在输入图像中注入人类难以察觉的扰动——可能会欺骗高性能的CNN做出错误的预测。对抗性攻击的成功引发了人们对cnn鲁棒性的严重担忧,并阻碍了它们在医疗诊断和自动驾驶等安全关键应用中的应用。我们的工作引入了一种视觉分析方法,通过回答两个问题来理解对抗性攻击:(1)哪些神经元更容易受到攻击;(2)这些脆弱的神经元在预测过程中捕捉到哪些图像特征?对于第一个问题,我们引入了多个基于微扰的度量,将攻击幅度分解为单个CNN神经元,并根据其脆弱性等级对神经元进行排名。其次,我们识别高度刺激用户选择的神经元的图像特征(例如,猫耳),以增强和验证神经元的职责。此外,我们通过基于神经元在预测中的作用的分层聚类来支持对大量神经元的交互式探索。为此,设计了一个视觉分析系统来结合视觉推理来解释对抗性攻击。我们通过多个案例研究以及来自领域专家的反馈来验证我们系统的有效性。
{"title":"Visual Analytics of Neuron Vulnerability to Adversarial Attacks on Convolutional Neural Networks","authors":"Yiran Li, Junpeng Wang, Takanori Fujiwara, Kwan-Liu Ma","doi":"10.1145/3587470","DOIUrl":"https://doi.org/10.1145/3587470","url":null,"abstract":"Adversarial attacks on a convolutional neural network (CNN)—injecting human-imperceptible perturbations into an input image—could fool a high-performance CNN into making incorrect predictions. The success of adversarial attacks raises serious concerns about the robustness of CNNs, and prevents them from being used in safety-critical applications, such as medical diagnosis and autonomous driving. Our work introduces a visual analytics approach to understanding adversarial attacks by answering two questions: (1) which neurons are more vulnerable to attacks and (2) which image features do these vulnerable neurons capture during the prediction? For the first question, we introduce multiple perturbation-based measures to break down the attacking magnitude into individual CNN neurons and rank the neurons by their vulnerability levels. For the second, we identify image features (e.g., cat ears) that highly stimulate a user-selected neuron to augment and validate the neuron’s responsibility. Furthermore, we support an interactive exploration of a large number of neurons by aiding with hierarchical clustering based on the neurons’ roles in the prediction. To this end, a visual analytics system is designed to incorporate visual reasoning for interpreting adversarial attacks. We validate the effectiveness of our system through multiple case studies as well as feedback from domain experts.","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"3 1","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84144255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Combining the Projective Consciousness Model and Virtual Humans for Immersive Psychological Research: A Proof-of-concept Simulating a ToM Assessment 结合投射意识模型和虚拟人进行沉浸式心理学研究:模拟ToM评估的概念验证
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-02-21 DOI: 10.1145/3583886
D. Rudrauf, Grégoire Sergeant-Perhtuis, Y. Tisserand, Teerawat Monnor, Valentin Durand de Gevigney, Olivier Belli
Relating explicit psychological mechanisms and observable behaviours is a central aim of psychological and behavioural science. One of the challenges is to understand and model the role of consciousness and, in particular, its subjective perspective as an internal level of representation (including for social cognition) in the governance of behaviour. Toward this aim, we implemented the principles of the Projective Consciousness Model (PCM) into artificial agents embodied as virtual humans, extending a previous implementation of the model. Our goal was to offer a proof-of-concept, based purely on simulations, as a basis for a future methodological framework. Its overarching aim is to be able to assess hidden psychological parameters in human participants, based on a model relevant to consciousness research, in the context of experiments in virtual reality. As an illustration of the approach, we focused on simulating the role of Theory of Mind (ToM) in the choice of strategic behaviours of approach and avoidance to optimise the satisfaction of agents’ preferences. We designed a main experiment in a virtual environment that could be used with real humans, allowing us to classify behaviours as a function of order of ToM, up to the second order. We show that agents using the PCM demonstrated expected behaviours with consistent parameters of ToM in this experiment. We also show that the agents could be used to estimate correctly each other’s order of ToM. Furthermore, in a supplementary experiment, we demonstrated how the agents could simultaneously estimate order of ToM and preferences attributed to others to optimize behavioural outcomes. Future studies will empirically assess and fine tune the framework with real humans in virtual reality experiments.
将显性心理机制和可观察的行为联系起来是心理和行为科学的中心目标。其中一个挑战是理解和模拟意识的作用,特别是它的主观视角作为行为治理中的内部表现水平(包括社会认知)。为了实现这一目标,我们将投射意识模型(PCM)的原理应用到虚拟人的人工代理中,扩展了该模型的先前实现。我们的目标是提供一个纯粹基于模拟的概念验证,作为未来方法论框架的基础。它的首要目标是能够在虚拟现实实验的背景下,基于与意识研究相关的模型,评估人类参与者的隐藏心理参数。为了说明这一方法,我们重点模拟了心理理论(ToM)在选择接近和回避的战略行为中所起的作用,以优化代理偏好的满意度。我们在虚拟环境中设计了一个主要的实验,可以用在真人身上,允许我们将行为分类为ToM阶的函数,直到二阶。我们表明,在本实验中,使用PCM的智能体表现出与ToM参数一致的预期行为。我们还证明了代理可以用来正确地估计彼此的ToM的顺序。此外,在一个补充实验中,我们展示了代理如何同时估计ToM的顺序和归因于他人的偏好以优化行为结果。未来的研究将在虚拟现实实验中对真实的人类进行经验评估和微调框架。
{"title":"Combining the Projective Consciousness Model and Virtual Humans for Immersive Psychological Research: A Proof-of-concept Simulating a ToM Assessment","authors":"D. Rudrauf, Grégoire Sergeant-Perhtuis, Y. Tisserand, Teerawat Monnor, Valentin Durand de Gevigney, Olivier Belli","doi":"10.1145/3583886","DOIUrl":"https://doi.org/10.1145/3583886","url":null,"abstract":"Relating explicit psychological mechanisms and observable behaviours is a central aim of psychological and behavioural science. One of the challenges is to understand and model the role of consciousness and, in particular, its subjective perspective as an internal level of representation (including for social cognition) in the governance of behaviour. Toward this aim, we implemented the principles of the Projective Consciousness Model (PCM) into artificial agents embodied as virtual humans, extending a previous implementation of the model. Our goal was to offer a proof-of-concept, based purely on simulations, as a basis for a future methodological framework. Its overarching aim is to be able to assess hidden psychological parameters in human participants, based on a model relevant to consciousness research, in the context of experiments in virtual reality. As an illustration of the approach, we focused on simulating the role of Theory of Mind (ToM) in the choice of strategic behaviours of approach and avoidance to optimise the satisfaction of agents’ preferences. We designed a main experiment in a virtual environment that could be used with real humans, allowing us to classify behaviours as a function of order of ToM, up to the second order. We show that agents using the PCM demonstrated expected behaviours with consistent parameters of ToM in this experiment. We also show that the agents could be used to estimate correctly each other’s order of ToM. Furthermore, in a supplementary experiment, we demonstrated how the agents could simultaneously estimate order of ToM and preferences attributed to others to optimize behavioural outcomes. Future studies will empirically assess and fine tune the framework with real humans in virtual reality experiments.","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"27 1","pages":"1 - 31"},"PeriodicalIF":3.4,"publicationDate":"2023-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82637638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
GRAFS: Graphical Faceted Search System to Support Conceptual Understanding in Exploratory Search 图形面搜索系统,以支持探索性搜索的概念理解
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-02-19 DOI: 10.1145/3588319
Mengtian Guo, Zhilan Zhou, D. Gotz, Yue Wang
When people search for information about a new topic within large document collections, they implicitly construct a mental model of the unfamiliar information space to represent what they currently know and guide their exploration into the unknown. Building this mental model can be challenging as it requires not only finding relevant documents but also synthesizing important concepts and the relationships that connect those concepts both within and across documents. This article describes a novel interactive approach designed to help users construct a mental model of an unfamiliar information space during exploratory search. We propose a new semantic search system to organize and visualize important concepts and their relations for a set of search results. A user study (n=20) was conducted to compare the proposed approach against a baseline faceted search system on exploratory literature search tasks. Experimental results show that the proposed approach is more effective in helping users recognize relationships between key concepts, leading to a more sophisticated understanding of the search topic while maintaining similar functionality and usability as a faceted search system.
当人们在大型文档集合中搜索关于新主题的信息时,他们隐式地构建了一个不熟悉的信息空间的心智模型,以表示他们目前知道的内容,并指导他们探索未知的内容。构建这种心智模型可能具有挑战性,因为它不仅需要找到相关文档,还需要综合重要概念以及在文档内部和跨文档连接这些概念的关系。本文描述了一种新的交互方法,旨在帮助用户在探索性搜索期间构建不熟悉的信息空间的心理模型。我们提出了一个新的语义搜索系统来组织和可视化重要的概念和它们之间的关系,为一组搜索结果。进行了一项用户研究(n=20),将所提出的方法与探索性文献搜索任务的基线分面搜索系统进行比较。实验结果表明,所提出的方法在帮助用户识别关键概念之间的关系方面更有效,从而更复杂地理解搜索主题,同时保持与分面搜索系统相似的功能和可用性。
{"title":"GRAFS: Graphical Faceted Search System to Support Conceptual Understanding in Exploratory Search","authors":"Mengtian Guo, Zhilan Zhou, D. Gotz, Yue Wang","doi":"10.1145/3588319","DOIUrl":"https://doi.org/10.1145/3588319","url":null,"abstract":"When people search for information about a new topic within large document collections, they implicitly construct a mental model of the unfamiliar information space to represent what they currently know and guide their exploration into the unknown. Building this mental model can be challenging as it requires not only finding relevant documents but also synthesizing important concepts and the relationships that connect those concepts both within and across documents. This article describes a novel interactive approach designed to help users construct a mental model of an unfamiliar information space during exploratory search. We propose a new semantic search system to organize and visualize important concepts and their relations for a set of search results. A user study (n=20) was conducted to compare the proposed approach against a baseline faceted search system on exploratory literature search tasks. Experimental results show that the proposed approach is more effective in helping users recognize relationships between key concepts, leading to a more sophisticated understanding of the search topic while maintaining similar functionality and usability as a faceted search system.","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"22 1","pages":"1 - 36"},"PeriodicalIF":3.4,"publicationDate":"2023-02-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72537715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Explaining Recommendations through Conversations: Dialog Model and the Effects of Interface Type and Degree of Interactivity 通过对话解释建议:对话模型和界面类型和交互性程度的影响
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-21 DOI: 10.1145/3579541
Diana C. Hernandez-Bocanegra, J. Ziegler
Explaining system-generated recommendations based on user reviews can foster users’ understanding and assessment of the recommended items and the recommender system (RS) as a whole. While up to now explanations have mostly been static, shown in a single presentation unit, some interactive explanatory approaches have emerged in explainable artificial intelligence (XAI), making it easier for users to examine system decisions and to explore arguments according to their information needs. However, little is known about how interactive interfaces should be conceptualized and designed to meet the explanatory aims of transparency, effectiveness, and trust in RS. Thus, we investigate the potential of interactive, conversational explanations in review-based RS and propose an explanation approach inspired by dialog models and formal argument structures. In particular, we investigate users’ perception of two different interface types for presenting explanations, a graphical user interface (GUI)-based dialog consisting of a sequence of explanatory steps, and a chatbot-like natural-language interface. Since providing explanations by means of natural language conversation is a novel approach, there is a lack of understanding how users would formulate their questions with a corresponding lack of datasets. We thus propose an intent model for explanatory queries and describe the development of ConvEx-DS, a dataset containing intent annotations of 1,806 user questions in the domain of hotels, that can be used to to train intent detection methods as part of the development of conversational agents for explainable RS. We validate the model by measuring user-perceived helpfulness of answers given based on the implemented intent detection. Finally, we report on a user study investigating users’ evaluation of the two types of interactive explanations proposed (GUI and chatbot), and to test the effect of varying degrees of interactivity that result in greater or lesser access to explanatory information. By using Structural Equation Modeling, we reveal details on the relationships between the perceived quality of an explanation and the explanatory objectives of transparency, trust, and effectiveness. Our results show that providing interactive options for scrutinizing explanatory arguments has a significant positive influence on the evaluation by users (compared to low interactive alternatives). Results also suggest that user characteristics such as decision-making style may have a significant influence on the evaluation of different types of interactive explanation interfaces.
解释基于用户评论的系统生成的推荐可以促进用户对推荐项目和推荐系统(RS)作为一个整体的理解和评估。虽然到目前为止,解释大多是静态的,以单个表示单元显示,但在可解释人工智能(XAI)中出现了一些交互式解释方法,使用户更容易检查系统决策并根据他们的信息需求探索论点。然而,对于交互界面应该如何概念化和设计以满足RS中透明度、有效性和信任的解释目标,我们知之甚少。因此,我们研究了基于评论的RS中交互式对话解释的潜力,并提出了一种受对话模型和正式论证结构启发的解释方法。我们特别研究了用户对两种不同界面类型的感知,一种是基于图形用户界面(GUI)的对话框,由一系列解释步骤组成,另一种是类似聊天机器人的自然语言界面。由于通过自然语言对话提供解释是一种新颖的方法,因此缺乏对用户如何在相应缺乏数据集的情况下提出问题的理解。因此,我们提出了一个用于解释性查询的意图模型,并描述了ConvEx-DS的开发,ConvEx-DS是一个包含酒店领域1806个用户问题的意图注释的数据集,可用于训练意图检测方法,作为可解释RS的会话代理开发的一部分。我们通过测量基于实现的意图检测给出的答案的用户感知有用性来验证模型。最后,我们报告了一项用户研究,调查了用户对所提出的两种类型的交互解释(GUI和聊天机器人)的评价,并测试了不同程度的交互性对解释信息访问的影响。通过使用结构方程模型,我们揭示了解释的感知质量与透明度、信任和有效性的解释目标之间关系的细节。我们的研究结果表明,提供交互式选项来审查解释性论点对用户的评价有显著的积极影响(与低交互性替代方案相比)。结果还表明,决策风格等用户特征可能会对不同类型的交互式解释界面的评价产生显著影响。
{"title":"Explaining Recommendations through Conversations: Dialog Model and the Effects of Interface Type and Degree of Interactivity","authors":"Diana C. Hernandez-Bocanegra, J. Ziegler","doi":"10.1145/3579541","DOIUrl":"https://doi.org/10.1145/3579541","url":null,"abstract":"Explaining system-generated recommendations based on user reviews can foster users’ understanding and assessment of the recommended items and the recommender system (RS) as a whole. While up to now explanations have mostly been static, shown in a single presentation unit, some interactive explanatory approaches have emerged in explainable artificial intelligence (XAI), making it easier for users to examine system decisions and to explore arguments according to their information needs. However, little is known about how interactive interfaces should be conceptualized and designed to meet the explanatory aims of transparency, effectiveness, and trust in RS. Thus, we investigate the potential of interactive, conversational explanations in review-based RS and propose an explanation approach inspired by dialog models and formal argument structures. In particular, we investigate users’ perception of two different interface types for presenting explanations, a graphical user interface (GUI)-based dialog consisting of a sequence of explanatory steps, and a chatbot-like natural-language interface. Since providing explanations by means of natural language conversation is a novel approach, there is a lack of understanding how users would formulate their questions with a corresponding lack of datasets. We thus propose an intent model for explanatory queries and describe the development of ConvEx-DS, a dataset containing intent annotations of 1,806 user questions in the domain of hotels, that can be used to to train intent detection methods as part of the development of conversational agents for explainable RS. We validate the model by measuring user-perceived helpfulness of answers given based on the implemented intent detection. Finally, we report on a user study investigating users’ evaluation of the two types of interactive explanations proposed (GUI and chatbot), and to test the effect of varying degrees of interactivity that result in greater or lesser access to explanatory information. By using Structural Equation Modeling, we reveal details on the relationships between the perceived quality of an explanation and the explanatory objectives of transparency, trust, and effectiveness. Our results show that providing interactive options for scrutinizing explanatory arguments has a significant positive influence on the evaluation by users (compared to low interactive alternatives). Results also suggest that user characteristics such as decision-making style may have a significant influence on the evaluation of different types of interactive explanation interfaces.","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"1 1","pages":"1 - 47"},"PeriodicalIF":3.4,"publicationDate":"2023-01-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88162055","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Visual Analytics of Co-Occurrences to Discover Subspaces in Structured Data 结构化数据中发现子空间的共现可视化分析
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-21 DOI: 10.1145/3579031
Wolfgang Jentner, Giuliana Lindholz, H. Hauptmann, Mennatallah El-Assady, K. Ma, D. Keim
We present an approach that shows all relevant subspaces of categorical data condensed in a single picture. We model the categorical values of the attributes as co-occurrences with data partitions generated from structured data using pattern mining. We show that these co-occurrences are a-priori, allowing us to greatly reduce the search space, effectively generating the condensed picture where conventional approaches filter out several subspaces as these are deemed insignificant. The task of identifying interesting subspaces is common but difficult due to exponential search spaces and the curse of dimensionality. One application of such a task might be identifying a cohort of patients defined by attributes such as gender, age, and diabetes type that share a common patient history, which is modeled as event sequences. Filtering the data by these attributes is common but cumbersome and often does not allow a comparison of subspaces. We contribute a powerful multi-dimensional pattern exploration approach (MDPE-approach) agnostic to the structured data type that models multiple attributes and their characteristics as co-occurrences, allowing the user to identify and compare thousands of subspaces of interest in a single picture. In our MDPE-approach, we introduce two methods to dramatically reduce the search space, outputting only the boundaries of the search space in the form of two tables. We implement the MDPE-approach in an interactive visual interface (MDPE-vis) that provides a scalable, pixel-based visualization design allowing the identification, comparison, and sense-making of subspaces in structured data. Our case studies using a gold-standard dataset and external domain experts confirm our approach’s and implementation’s applicability. A third use case sheds light on the scalability of our approach and a user study with 15 participants underlines its usefulness and power.
我们提出了一种方法,显示所有相关的子空间的分类数据浓缩在一个单一的图片。我们将属性的分类值建模为与使用模式挖掘从结构化数据生成的数据分区共现。我们表明,这些共现是先验的,允许我们大大减少搜索空间,有效地生成压缩的图片,而传统的方法过滤掉了几个子空间,因为这些被认为是不重要的。识别感兴趣的子空间是一项常见的任务,但由于指数搜索空间和维度的诅咒,这一任务很困难。这种任务的一个应用程序可能是识别由诸如性别、年龄和糖尿病类型等属性定义的患者队列,这些属性具有共同的患者历史,并将其建模为事件序列。按这些属性过滤数据是很常见的,但很麻烦,而且通常不允许对子空间进行比较。我们提供了一种强大的多维模式探索方法(mdpe方法),该方法与结构化数据类型无关,该数据类型将多个属性及其特征建模为共现,允许用户识别和比较单个图片中感兴趣的数千个子空间。在我们的mdpe方法中,我们引入了两种方法来显著减少搜索空间,仅以两个表的形式输出搜索空间的边界。我们在交互式可视化界面(MDPE-vis)中实现mdpe方法,该界面提供了可扩展的、基于像素的可视化设计,允许对结构化数据中的子空间进行识别、比较和意义构建。我们使用黄金标准数据集和外部领域专家进行的案例研究证实了我们的方法和实现的适用性。第三个用例揭示了我们方法的可扩展性,一个有15个参与者的用户研究强调了它的有用性和强大性。
{"title":"Visual Analytics of Co-Occurrences to Discover Subspaces in Structured Data","authors":"Wolfgang Jentner, Giuliana Lindholz, H. Hauptmann, Mennatallah El-Assady, K. Ma, D. Keim","doi":"10.1145/3579031","DOIUrl":"https://doi.org/10.1145/3579031","url":null,"abstract":"We present an approach that shows all relevant subspaces of categorical data condensed in a single picture. We model the categorical values of the attributes as co-occurrences with data partitions generated from structured data using pattern mining. We show that these co-occurrences are a-priori, allowing us to greatly reduce the search space, effectively generating the condensed picture where conventional approaches filter out several subspaces as these are deemed insignificant. The task of identifying interesting subspaces is common but difficult due to exponential search spaces and the curse of dimensionality. One application of such a task might be identifying a cohort of patients defined by attributes such as gender, age, and diabetes type that share a common patient history, which is modeled as event sequences. Filtering the data by these attributes is common but cumbersome and often does not allow a comparison of subspaces. We contribute a powerful multi-dimensional pattern exploration approach (MDPE-approach) agnostic to the structured data type that models multiple attributes and their characteristics as co-occurrences, allowing the user to identify and compare thousands of subspaces of interest in a single picture. In our MDPE-approach, we introduce two methods to dramatically reduce the search space, outputting only the boundaries of the search space in the form of two tables. We implement the MDPE-approach in an interactive visual interface (MDPE-vis) that provides a scalable, pixel-based visualization design allowing the identification, comparison, and sense-making of subspaces in structured data. Our case studies using a gold-standard dataset and external domain experts confirm our approach’s and implementation’s applicability. A third use case sheds light on the scalability of our approach and a user study with 15 participants underlines its usefulness and power.","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"129 1","pages":"1 - 49"},"PeriodicalIF":3.4,"publicationDate":"2023-01-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79921685","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Directive Explanations for Actionable Explainability in Machine Learning Applications 机器学习应用中可操作解释性的指令解释
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-12 DOI: https://dl.acm.org/doi/10.1145/3579363
Ronal Singh, Tim Miller, Henrietta Lyons, Liz Sonenberg, Eduardo Velloso, Frank Vetere, Piers Howe, Paul Dourish

In this paper, we show that explanations of decisions made by machine learning systems can be improved by not only explaining why a decision was made but also by explaining how an individual could obtain their desired outcome. We formally define the concept of directive explanations (those that offer specific actions an individual could take to achieve their desired outcome), introduce two forms of directive explanations (directive-specific and directive-generic), and describe how these can be generated computationally. We investigate people’s preference for and perception towards directive explanations through two online studies, one quantitative and the other qualitative, each covering two domains (the credit scoring domain and the employee satisfaction domain). We find a significant preference for both forms of directive explanations compared to non-directive counterfactual explanations. However, we also find that preferences are affected by many aspects, including individual preferences and social factors. We conclude that deciding what type of explanation to provide requires information about the recipients and other contextual information. This reinforces the need for a human-centred and context-specific approach to explainable AI.

在本文中,我们证明了机器学习系统对决策的解释不仅可以通过解释为什么做出决策,还可以通过解释个人如何获得他们想要的结果来改进。我们正式定义了指令解释的概念(提供个人可以采取的特定行动以实现其预期结果),介绍了两种形式的指令解释(特定指令和通用指令),并描述了如何通过计算生成这些解释。我们通过两个在线研究调查人们对指导性解释的偏好和感知,一个是定量的,另一个是定性的,每个研究涵盖两个领域(信用评分领域和员工满意度领域)。我们发现,与非指导性反事实解释相比,人们对两种形式的指导性解释都有显著的偏好。然而,我们也发现偏好受到多方面的影响,包括个人偏好和社会因素。我们的结论是,决定提供哪种类型的解释需要有关接收者和其他上下文信息的信息。这加强了对以人为中心和特定于情境的可解释人工智能方法的需求。
{"title":"Directive Explanations for Actionable Explainability in Machine Learning Applications","authors":"Ronal Singh, Tim Miller, Henrietta Lyons, Liz Sonenberg, Eduardo Velloso, Frank Vetere, Piers Howe, Paul Dourish","doi":"https://dl.acm.org/doi/10.1145/3579363","DOIUrl":"https://doi.org/https://dl.acm.org/doi/10.1145/3579363","url":null,"abstract":"<p>In this paper, we show that explanations of decisions made by machine learning systems can be improved by not only explaining <i>why</i> a decision was made but also by explaining <i>how</i> an individual could obtain their desired outcome. We formally define the concept of <i>directive explanations</i> (those that offer specific actions an individual could take to achieve their desired outcome), introduce two forms of directive explanations (directive-specific and directive-generic), and describe how these can be generated computationally. We investigate people’s preference for and perception towards directive explanations through two online studies, one quantitative and the other qualitative, each covering two domains (the credit scoring domain and the employee satisfaction domain). We find a significant preference for both forms of directive explanations compared to non-directive counterfactual explanations. However, we also find that preferences are affected by many aspects, including individual preferences and social factors. We conclude that deciding what type of explanation to provide requires information about the recipients and other contextual information. This reinforces the need for a human-centred and context-specific approach to explainable AI.</p>","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"50 6","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-01-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508030","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enabling Efficient Web Data-Record Interaction for People with Visual Impairments via Proxy Interfaces 通过代理接口为视障人士实现有效的Web数据记录交互
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-10 DOI: https://dl.acm.org/doi/10.1145/3579364
Javedul Ferdous, Hae-Na Lee, Sampath Jayarathna, Vikas Ashok

Web data records are usually accompanied by auxiliary webpage segments, such as filters, sort options, search form, and multi-page links, to enhance interaction efficiency and convenience for end users. However, blind and visually impaired (BVI) persons are presently unable to fully exploit the auxiliary segments like their sighted peers, since these segments are scattered all across the screen, and as such assistive technologies used by BVI users, i.e., screen reader and screen magnifier, are not geared for efficient interaction with such scattered content. Specifically, for blind screen reader users, content navigation is predominantly one-dimensional despite the support for skipping content, and therefore navigating to-and-fro between different parts of the webpage is tedious and frustrating. Similarly, low vision screen magnifier users have to continuously pan back-and-forth between different portions of a webpage, given that only a portion of the screen is viewable at any instant due to content enlargement. The extant techniques to overcome inefficient web interaction for BVI users have mostly focused on general web-browsing activities, and as such they provide little to no support for data record-specific interaction activities such as filtering and sorting – activities that are equally important for facilitating quick and easy access to desired data records. To fill this void, we present InSupport, a browser extension that: (i) employs custom machine learning-based algorithms to automatically extract auxiliary segments on any webpage containing data records; and (ii) provides an instantly accessible proxy one-stop interface for easily navigating the extracted auxiliary segments using either basic keyboard shortcuts or mouse actions. Evaluation studies with 14 blind participants and 16 low vision participants showed significant improvement in web usability with InSupport, driven by increased reduction in interaction time and user effort, compared to the state-of-the-art solutions.

Web数据记录通常伴随着辅助的网页段,例如过滤器、排序选项、搜索表单和多页链接,以提高最终用户的交互效率和便利性。然而,盲人和视障人士(BVI)目前无法像他们的视力正常的同龄人那样充分利用辅助部分,因为这些部分分散在屏幕上,而且BVI用户使用的辅助技术,即屏幕阅读器和屏幕放大镜,无法与这些分散的内容进行有效的交互。具体来说,对于盲人屏幕阅读器用户来说,内容导航主要是一维的,尽管支持跳过内容,因此在网页的不同部分之间来回导航是乏味和令人沮丧的。同样,低视力的屏幕放大镜用户必须不断地在网页的不同部分之间来回移动,因为在任何时候,由于内容放大,只有一部分屏幕是可见的。为英属维尔京群岛用户克服低效的网络交互的现有技术主要集中在一般的网络浏览活动上,因此它们对特定于数据记录的交互活动(如过滤和排序)提供很少或根本没有支持,而这些活动对于促进快速、轻松地访问所需的数据记录同样重要。为了填补这一空白,我们提出了InSupport,一个浏览器扩展:(i)采用基于自定义机器学习的算法来自动提取包含数据记录的任何网页上的辅助段;(ii)提供了一个即时访问的代理一站式界面,可以使用基本的键盘快捷键或鼠标操作轻松导航提取的辅助段。对14名盲人参与者和16名低视力参与者进行的评估研究表明,与最先进的解决方案相比,InSupport显著改善了网络可用性,减少了交互时间和用户的工作量。
{"title":"Enabling Efficient Web Data-Record Interaction for People with Visual Impairments via Proxy Interfaces","authors":"Javedul Ferdous, Hae-Na Lee, Sampath Jayarathna, Vikas Ashok","doi":"https://dl.acm.org/doi/10.1145/3579364","DOIUrl":"https://doi.org/https://dl.acm.org/doi/10.1145/3579364","url":null,"abstract":"<p>Web data records are usually accompanied by auxiliary webpage segments, such as filters, sort options, search form, and multi-page links, to enhance interaction efficiency and convenience for end users. However, blind and visually impaired (BVI) persons are presently unable to fully exploit the auxiliary segments like their sighted peers, since these segments are scattered all across the screen, and as such assistive technologies used by BVI users, i.e., screen reader and screen magnifier, are not geared for efficient interaction with such scattered content. Specifically, for blind screen reader users, content navigation is predominantly one-dimensional despite the support for skipping content, and therefore navigating to-and-fro between different parts of the webpage is tedious and frustrating. Similarly, low vision screen magnifier users have to continuously pan back-and-forth between different portions of a webpage, given that only a portion of the screen is viewable at any instant due to content enlargement. The extant techniques to overcome inefficient web interaction for BVI users have mostly focused on general web-browsing activities, and as such they provide little to no support for data record-specific interaction activities such as filtering and sorting – activities that are equally important for facilitating quick and easy access to <i>desired</i> data records. To fill this void, we present InSupport, a browser extension that: (i) employs custom machine learning-based algorithms to automatically extract auxiliary segments on any webpage containing data records; and (ii) provides an instantly accessible proxy <i>one-stop</i> interface for easily navigating the extracted auxiliary segments using either basic keyboard shortcuts or mouse actions. Evaluation studies with 14 blind participants and 16 low vision participants showed significant improvement in web usability with InSupport, driven by increased reduction in interaction time and user effort, compared to the state-of-the-art solutions.</p>","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"52 3","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508025","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enabling Efficient Web Data-Record Interaction for People with Visual Impairments via Proxy Interfaces 通过代理接口为视障人士实现有效的Web数据记录交互
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-10 DOI: 10.1145/3579364
Javedul Ferdous, H. Lee, S. Jayarathna, V. Ashok
Web data records are usually accompanied by auxiliary webpage segments, such as filters, sort options, search form, and multi-page links, to enhance interaction efficiency and convenience for end users. However, blind and visually impaired (BVI) persons are presently unable to fully exploit the auxiliary segments like their sighted peers, since these segments are scattered all across the screen, and as such assistive technologies used by BVI users, i.e., screen reader and screen magnifier, are not geared for efficient interaction with such scattered content. Specifically, for blind screen reader users, content navigation is predominantly one-dimensional despite the support for skipping content, and therefore navigating to-and-fro between different parts of the webpage is tedious and frustrating. Similarly, low vision screen magnifier users have to continuously pan back-and-forth between different portions of a webpage, given that only a portion of the screen is viewable at any instant due to content enlargement. The extant techniques to overcome inefficient web interaction for BVI users have mostly focused on general web-browsing activities, and as such they provide little to no support for data record-specific interaction activities such as filtering and sorting – activities that are equally important for facilitating quick and easy access to desired data records. To fill this void, we present InSupport, a browser extension that: (i) employs custom machine learning-based algorithms to automatically extract auxiliary segments on any webpage containing data records; and (ii) provides an instantly accessible proxy one-stop interface for easily navigating the extracted auxiliary segments using either basic keyboard shortcuts or mouse actions. Evaluation studies with 14 blind participants and 16 low vision participants showed significant improvement in web usability with InSupport, driven by increased reduction in interaction time and user effort, compared to the state-of-the-art solutions.
Web数据记录通常伴随着辅助的网页段,例如过滤器、排序选项、搜索表单和多页链接,以提高最终用户的交互效率和便利性。然而,盲人和视障人士(BVI)目前无法像他们的视力正常的同龄人那样充分利用辅助部分,因为这些部分分散在屏幕上,而且BVI用户使用的辅助技术,即屏幕阅读器和屏幕放大镜,无法与这些分散的内容进行有效的交互。具体来说,对于盲人屏幕阅读器用户来说,内容导航主要是一维的,尽管支持跳过内容,因此在网页的不同部分之间来回导航是乏味和令人沮丧的。同样,低视力的屏幕放大镜用户必须不断地在网页的不同部分之间来回移动,因为在任何时候,由于内容放大,只有一部分屏幕是可见的。为英属维尔京群岛用户克服低效的网络交互的现有技术主要集中在一般的网络浏览活动上,因此它们对特定于数据记录的交互活动(如过滤和排序)提供很少或根本没有支持,而这些活动对于促进快速、轻松地访问所需的数据记录同样重要。为了填补这一空白,我们提出了InSupport,一个浏览器扩展:(i)采用基于自定义机器学习的算法来自动提取包含数据记录的任何网页上的辅助段;(ii)提供了一个即时访问的代理一站式界面,可以使用基本的键盘快捷键或鼠标操作轻松导航提取的辅助段。对14名盲人参与者和16名低视力参与者进行的评估研究表明,与最先进的解决方案相比,InSupport显著改善了网络可用性,减少了交互时间和用户的工作量。
{"title":"Enabling Efficient Web Data-Record Interaction for People with Visual Impairments via Proxy Interfaces","authors":"Javedul Ferdous, H. Lee, S. Jayarathna, V. Ashok","doi":"10.1145/3579364","DOIUrl":"https://doi.org/10.1145/3579364","url":null,"abstract":"Web data records are usually accompanied by auxiliary webpage segments, such as filters, sort options, search form, and multi-page links, to enhance interaction efficiency and convenience for end users. However, blind and visually impaired (BVI) persons are presently unable to fully exploit the auxiliary segments like their sighted peers, since these segments are scattered all across the screen, and as such assistive technologies used by BVI users, i.e., screen reader and screen magnifier, are not geared for efficient interaction with such scattered content. Specifically, for blind screen reader users, content navigation is predominantly one-dimensional despite the support for skipping content, and therefore navigating to-and-fro between different parts of the webpage is tedious and frustrating. Similarly, low vision screen magnifier users have to continuously pan back-and-forth between different portions of a webpage, given that only a portion of the screen is viewable at any instant due to content enlargement. The extant techniques to overcome inefficient web interaction for BVI users have mostly focused on general web-browsing activities, and as such they provide little to no support for data record-specific interaction activities such as filtering and sorting – activities that are equally important for facilitating quick and easy access to desired data records. To fill this void, we present InSupport, a browser extension that: (i) employs custom machine learning-based algorithms to automatically extract auxiliary segments on any webpage containing data records; and (ii) provides an instantly accessible proxy one-stop interface for easily navigating the extracted auxiliary segments using either basic keyboard shortcuts or mouse actions. Evaluation studies with 14 blind participants and 16 low vision participants showed significant improvement in web usability with InSupport, driven by increased reduction in interaction time and user effort, compared to the state-of-the-art solutions.","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"14 1","pages":"1 - 27"},"PeriodicalIF":3.4,"publicationDate":"2023-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82017819","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
The Impact of Intelligent Pedagogical Agents’ Interventions on Student Behavior and Performance in Open-Ended Game Design Environments 开放式游戏设计环境中智能教学主体干预对学生行为和表现的影响
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-04 DOI: https://dl.acm.org/doi/10.1145/3578523
Özge Nilay Yalçın, Sébastien Lallé, Cristina Conati

Research has shown that free-form Game-Design (GD) environments can be very effective in fostering Computational Thinking (CT) skills at a young age. However, some students can still need some guidance during the learning process due to the highly open-ended nature of these environments. Intelligent Pedagogical Agents (IPAs) can be used to provide personalized assistance in real-time to alleviate this challenge. This paper presents our results in evaluating such an agent deployed in a real-word free-form GD learning environment to foster CT in the early K-12 education, Unity-CT. We focus on the effect of repetition by comparing student behaviors between no intervention, 1-shot, and repeated intervention groups for two different errors that are known to be challenging in the online lessons of Unity-CT. Our findings showed that the agent was perceived very positively by the students and the repeated intervention showed promising results in terms of helping students make less errors and more correct behaviors, albeit only for one of the two target errors. Building from these results, we provide insights on how to provide IPA interventions in free-form GD environments.

研究表明,自由形式的游戏设计(GD)环境可以非常有效地培养儿童的计算思维(CT)技能。然而,由于这些环境的开放性,一些学生在学习过程中仍然需要一些指导。智能教学代理(IPAs)可用于实时提供个性化帮助,以缓解这一挑战。本文介绍了我们在一个真实世界的自由形式的GD学习环境中评估这种智能体的结果,以促进早期K-12教育中的CT, Unity-CT。针对Unity-CT在线课程中已知具有挑战性的两种不同错误,我们通过比较无干预组、单次干预组和重复干预组的学生行为来关注重复的影响。我们的研究结果表明,学生对代理的感知非常积极,反复干预在帮助学生减少错误和更正确的行为方面显示出有希望的结果,尽管只针对两个目标错误中的一个。基于这些结果,我们提供了如何在自由形式的GD环境中提供IPA干预的见解。
{"title":"The Impact of Intelligent Pedagogical Agents’ Interventions on Student Behavior and Performance in Open-Ended Game Design Environments","authors":"Özge Nilay Yalçın, Sébastien Lallé, Cristina Conati","doi":"https://dl.acm.org/doi/10.1145/3578523","DOIUrl":"https://doi.org/https://dl.acm.org/doi/10.1145/3578523","url":null,"abstract":"<p>Research has shown that free-form Game-Design (GD) environments can be very effective in fostering Computational Thinking (CT) skills at a young age. However, some students can still need some guidance during the learning process due to the highly open-ended nature of these environments. Intelligent Pedagogical Agents (IPAs) can be used to provide personalized assistance in real-time to alleviate this challenge. This paper presents our results in evaluating such an agent deployed in a real-word free-form GD learning environment to foster CT in the early K-12 education, Unity-CT. We focus on the effect of repetition by comparing student behaviors between no intervention, 1-shot, and repeated intervention groups for two different errors that are known to be challenging in the online lessons of Unity-CT. Our findings showed that the agent was perceived very positively by the students and the repeated intervention showed promising results in terms of helping students make less errors and more correct behaviors, albeit only for one of the two target errors. Building from these results, we provide insights on how to provide IPA interventions in free-form GD environments.</p>","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"52 4","pages":""},"PeriodicalIF":3.4,"publicationDate":"2023-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138508024","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Impact of Intelligent Pedagogical Agents’ Interventions on Student Behavior and Performance in Open-Ended Game Design Environments 开放式游戏设计环境中智能教学主体干预对学生行为和表现的影响
IF 3.4 4区 计算机科学 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2023-01-04 DOI: 10.1145/3578523
Ö. Yalçın, Sébastien Lallé, C. Conati
Research has shown that free-form Game-Design (GD) environments can be very effective in fostering Computational Thinking (CT) skills at a young age. However, some students can still need some guidance during the learning process due to the highly open-ended nature of these environments. Intelligent Pedagogical Agents (IPAs) can be used to provide personalized assistance in real-time to alleviate this challenge. This paper presents our results in evaluating such an agent deployed in a real-word free-form GD learning environment to foster CT in the early K-12 education, Unity-CT. We focus on the effect of repetition by comparing student behaviors between no intervention, 1-shot, and repeated intervention groups for two different errors that are known to be challenging in the online lessons of Unity-CT. Our findings showed that the agent was perceived very positively by the students and the repeated intervention showed promising results in terms of helping students make fewer errors and more correct behaviors, albeit only for one of the two target errors. Building from these results, we provide insights on how to provide IPA interventions in free-form GD environments.
研究表明,自由形式的游戏设计(GD)环境可以非常有效地培养儿童的计算思维(CT)技能。然而,由于这些环境的开放性,一些学生在学习过程中仍然需要一些指导。智能教学代理(IPAs)可用于实时提供个性化帮助,以缓解这一挑战。本文介绍了我们在一个真实世界的自由形式的GD学习环境中评估这种智能体的结果,以促进早期K-12教育中的CT, Unity-CT。针对Unity-CT在线课程中已知具有挑战性的两种不同错误,我们通过比较无干预组、单次干预组和重复干预组的学生行为来关注重复的影响。我们的研究结果表明,学生对代理的感知非常积极,反复干预在帮助学生减少错误和更正确的行为方面显示出有希望的结果,尽管只针对两个目标错误中的一个。基于这些结果,我们提供了如何在自由形式的GD环境中提供IPA干预的见解。
{"title":"The Impact of Intelligent Pedagogical Agents’ Interventions on Student Behavior and Performance in Open-Ended Game Design Environments","authors":"Ö. Yalçın, Sébastien Lallé, C. Conati","doi":"10.1145/3578523","DOIUrl":"https://doi.org/10.1145/3578523","url":null,"abstract":"Research has shown that free-form Game-Design (GD) environments can be very effective in fostering Computational Thinking (CT) skills at a young age. However, some students can still need some guidance during the learning process due to the highly open-ended nature of these environments. Intelligent Pedagogical Agents (IPAs) can be used to provide personalized assistance in real-time to alleviate this challenge. This paper presents our results in evaluating such an agent deployed in a real-word free-form GD learning environment to foster CT in the early K-12 education, Unity-CT. We focus on the effect of repetition by comparing student behaviors between no intervention, 1-shot, and repeated intervention groups for two different errors that are known to be challenging in the online lessons of Unity-CT. Our findings showed that the agent was perceived very positively by the students and the repeated intervention showed promising results in terms of helping students make fewer errors and more correct behaviors, albeit only for one of the two target errors. Building from these results, we provide insights on how to provide IPA interventions in free-form GD environments.","PeriodicalId":48574,"journal":{"name":"ACM Transactions on Interactive Intelligent Systems","volume":"9 1","pages":"1 - 29"},"PeriodicalIF":3.4,"publicationDate":"2023-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78472784","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
ACM Transactions on Interactive Intelligent Systems
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1