首页 > 最新文献

User Modeling and User-Adapted Interaction最新文献

英文 中文
Linguistics-based dialogue simulations to evaluate argumentative conversational recommender systems 基于语言学的对话模拟,评估论证式对话推荐系统
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-06-22 DOI: 10.1007/s11257-024-09403-3
Martina Di Bratto, Antonio Origlia, Maria Di Maro, Sabrina Mennella

Conversational recommender systems aim at recommending the most relevant information for users based on textual or spoken dialogues, through which users can communicate their preferences to the system more efficiently. Argumentative conversational recommender systems represent a kind of deliberation dialogue in which participants share their specific beliefs in the respective representations of the common ground, to act towards a common goal. The goal of such systems is to present appropriate supporting arguments to their recommendations to show the interlocutor that a specific item corresponds to their manifested interests. Here, we present a cross-disciplinary argumentation-based conversational recommender model based on cognitive pragmatics. We also present a dialogue simulator to investigate the quality of the theoretical background. We produced a set of synthetic dialogues based on a computational model implementing the linguistic theory and we collected human evaluations about the plausibility and efficiency of these dialogues. Our results show that the synthetic dialogues obtain high scores concerning their naturalness and the selection of the supporting arguments.

对话式推荐系统旨在根据文字或口语对话为用户推荐最相关的信息,通过对话,用户可以更有效地向系统传达自己的偏好。论证式对话推荐系统是一种商议式对话,参与者在对话中分享各自对共同点的具体看法,并为实现共同目标而行动。此类系统的目标是为其推荐提出适当的支持论据,以向对话者表明特定项目符合他们所表现出的兴趣。在此,我们介绍一种基于认知语用学的跨学科论证对话推荐模型。我们还提出了一个对话模拟器来研究理论背景的质量。我们根据语言学理论的计算模型制作了一组合成对话,并收集了人类对这些对话的可信度和效率的评价。我们的结果表明,合成对话在自然度和支持论点的选择方面都获得了很高的分数。
{"title":"Linguistics-based dialogue simulations to evaluate argumentative conversational recommender systems","authors":"Martina Di Bratto, Antonio Origlia, Maria Di Maro, Sabrina Mennella","doi":"10.1007/s11257-024-09403-3","DOIUrl":"https://doi.org/10.1007/s11257-024-09403-3","url":null,"abstract":"<p>Conversational recommender systems aim at recommending the most relevant information for users based on textual or spoken dialogues, through which users can communicate their preferences to the system more efficiently. Argumentative conversational recommender systems represent a kind of <i>deliberation</i> dialogue in which participants share their specific <i>beliefs</i> in the respective representations of the <i>common ground</i>, to act towards a common goal. The goal of such systems is to present appropriate supporting arguments to their recommendations to show the interlocutor that a specific item corresponds to their manifested interests. Here, we present a cross-disciplinary argumentation-based conversational recommender model based on cognitive pragmatics. We also present a dialogue simulator to investigate the quality of the theoretical background. We produced a set of synthetic dialogues based on a computational model implementing the linguistic theory and we collected human evaluations about the plausibility and efficiency of these dialogues. Our results show that the synthetic dialogues obtain high scores concerning their naturalness and the selection of the supporting arguments.\u0000</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"23 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546542","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Large-scale evaluation of cold-start mitigation in adaptive fact learning: Knowing “what” matters more than knowing “who” 大规模评估适应性事实学习中的冷启动缓解措施:知道 "什么 "比知道 "谁 "更重要
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-06-21 DOI: 10.1007/s11257-024-09401-5
Maarten van der Velde, Florian Sense, Jelmer P. Borst, Hedderik van Rijn

Adaptive learning systems offer a personalised digital environment that continually adjusts to the learner and the material, with the goal of maximising learning gains. Whenever such a system encounters a new learner, or when a returning learner starts studying new material, the system first has to determine the difficulty of the material for that specific learner. Failing to address this “cold-start” problem leads to suboptimal learning and potential disengagement from the system, as the system may present problems of an inappropriate difficulty or provide unhelpful feedback. In a simulation study conducted on a large educational data set from an adaptive fact learning system (about 100 million trials from almost 140 thousand learners), we predicted individual learning parameters from response data. Using these predicted parameters as starting estimates for the adaptive learning system yielded a more accurate model of learners’ memory performance than using default values. We found that predictions based on the difficulty of the fact (“what”) generally outperformed predictions based on the ability of the learner (“who”), though both contributed to better model estimates. This work extends a previous smaller-scale laboratory-based experiment in which using fact-specific predictions in a cold-start scenario improved learning outcomes. The current findings suggest that similar cold-start alleviation may be possible in real-world educational settings. The improved predictions can be harnessed to increase the efficiency of the learning system, mitigate the negative effects of a cold start, and potentially improve learning outcomes.

自适应学习系统提供了一个个性化的数字环境,能够不断根据学习者和教材进行调整,从而最大限度地提高学习效率。每当这样的系统遇到新的学习者,或者老学习者开始学习新材料时,系统首先必须确定材料对特定学习者的难度。如果不能解决这个 "冷启动 "问题,就会导致学习效果不佳,并有可能脱离系统,因为系统可能会提出难度不合适的问题或提供无益的反馈。在一项对自适应事实学习系统的大型教育数据集(来自近 14 万名学习者的约 1 亿次试验)进行的模拟研究中,我们从响应数据中预测了个人学习参数。使用这些预测参数作为自适应学习系统的起始估计值,可以获得比使用默认值更准确的学习者记忆效果模型。我们发现,基于事实难度("什么")的预测通常优于基于学习者能力("谁")的预测,尽管两者都有助于获得更好的模型估计值。这项工作扩展了之前的一项较小规模的实验室实验,在该实验中,在冷启动情景中使用针对特定事实的预测提高了学习效果。目前的研究结果表明,在现实世界的教育环境中,类似的冷启动缓解也是可能的。可以利用改进后的预测来提高学习系统的效率,减轻冷启动的负面影响,并有可能改善学习效果。
{"title":"Large-scale evaluation of cold-start mitigation in adaptive fact learning: Knowing “what” matters more than knowing “who”","authors":"Maarten van der Velde, Florian Sense, Jelmer P. Borst, Hedderik van Rijn","doi":"10.1007/s11257-024-09401-5","DOIUrl":"https://doi.org/10.1007/s11257-024-09401-5","url":null,"abstract":"<p>Adaptive learning systems offer a personalised digital environment that continually adjusts to the learner and the material, with the goal of maximising learning gains. Whenever such a system encounters a new learner, or when a returning learner starts studying new material, the system first has to determine the difficulty of the material for that specific learner. Failing to address this “cold-start” problem leads to suboptimal learning and potential disengagement from the system, as the system may present problems of an inappropriate difficulty or provide unhelpful feedback. In a simulation study conducted on a large educational data set from an adaptive fact learning system (about 100 million trials from almost 140 thousand learners), we predicted individual learning parameters from response data. Using these predicted parameters as starting estimates for the adaptive learning system yielded a more accurate model of learners’ memory performance than using default values. We found that predictions based on the difficulty of the fact (“what”) generally outperformed predictions based on the ability of the learner (“who”), though both contributed to better model estimates. This work extends a previous smaller-scale laboratory-based experiment in which using fact-specific predictions in a cold-start scenario improved learning outcomes. The current findings suggest that similar cold-start alleviation may be possible in real-world educational settings. The improved predictions can be harnessed to increase the efficiency of the learning system, mitigate the negative effects of a cold start, and potentially improve learning outcomes.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"22 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141516352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design of a conversational recommender system in education 设计教育对话推荐系统
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-06-21 DOI: 10.1007/s11257-024-09397-y
Stefano Valtolina, Ricardo Anibal Matamoros, Francesco Epifania

In recent years, we have seen a significant proliferation of e-learning platforms. E-learning platforms allow teachers to create digital courses in a more effective and time-saving way, but several flaws hinder their actual success. One main problem is that teachers have difficulties finding and combining open-access learning materials that match their specific needs precisely when there are so many to choose from. This paper proposes a new strategy for creating digital courses that use learning objects (LOs) as primary elements. The idea consists of using an intelligent chatbot to assist teachers in their activities. Defined using RASA technology, the chatbot asks for information about the course the teacher has to create based on her/his profile and needs. It suggests the best LOs and how to combine them according to their prerequisites and outcomes. A chatbot-based recommendation system provides suggestions through BERT, a machine-learning model based on Transformers, to define the semantic similarity between the entered data and the LOs metadata. In addition, the chatbot also suggests how to combine the LOs into a final learning path. Finally, the paper presents some preliminary results about tests carried out by teachers in creating their digital courses.

近年来,我们看到电子学习平台大量涌现。电子学习平台可以让教师以更有效、更省时的方式创建数字化课程,但也有一些缺陷阻碍了它们的实际成功。其中一个主要问题是,由于可供选择的开放式学习材料太多,教师很难准确地找到并组合符合其特定需求的学习材料。本文提出了一种创建以学习对象(LOs)为主要元素的数字课程的新策略。这一想法包括使用智能聊天机器人协助教师开展活动。该聊天机器人使用 RASA 技术进行定义,根据教师的个人资料和需求,询问有关教师必须创建的课程的信息。聊天机器人会建议最佳的学习目标,并根据其先决条件和结果来组合它们。基于聊天机器人的推荐系统通过 BERT(一种基于 Transformers 的机器学习模型)提供建议,以确定输入数据与 LO 元数据之间的语义相似性。此外,聊天机器人还建议如何将学习成果组合成最终的学习路径。最后,本文介绍了教师在创建数字课程时进行测试的一些初步结果。
{"title":"Design of a conversational recommender system in education","authors":"Stefano Valtolina, Ricardo Anibal Matamoros, Francesco Epifania","doi":"10.1007/s11257-024-09397-y","DOIUrl":"https://doi.org/10.1007/s11257-024-09397-y","url":null,"abstract":"<p>In recent years, we have seen a significant proliferation of e-learning platforms. E-learning platforms allow teachers to create digital courses in a more effective and time-saving way, but several flaws hinder their actual success. One main problem is that teachers have difficulties finding and combining open-access learning materials that match their specific needs precisely when there are so many to choose from. This paper proposes a new strategy for creating digital courses that use learning objects (LOs) as primary elements. The idea consists of using an intelligent chatbot to assist teachers in their activities. Defined using RASA technology, the chatbot asks for information about the course the teacher has to create based on her/his profile and needs. It suggests the best LOs and how to combine them according to their prerequisites and outcomes. A chatbot-based recommendation system provides suggestions through BERT, a machine-learning model based on Transformers, to define the semantic similarity between the entered data and the LOs metadata. In addition, the chatbot also suggests how to combine the LOs into a final learning path. Finally, the paper presents some preliminary results about tests carried out by teachers in creating their digital courses.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"40 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-06-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141546539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring raw data transformations on inertial sensor data to model user expertise when learning psychomotor skills 探索惯性传感器数据的原始数据转换,为用户学习心理运动技能时的专业知识建模
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-04-17 DOI: 10.1007/s11257-024-09393-2
Miguel Portaz, Alberto Corbi, Alberto Casas-Ortiz, Olga C. Santos

This paper introduces a novel approach for leveraging inertial data to discern expertise levels in motor skill execution, specifically distinguishing between experts and beginners. By implementing inertial data transformation and fusion techniques, we conduct a comprehensive analysis of motor behaviour. Our approach goes beyond conventional assessments, providing nuanced insights into the underlying patterns of movement. Additionally, we explore the potential for utilising this data-driven methodology to aid novice practitioners in enhancing their performance. The findings showcase the efficacy of this approach in accurately identifying proficiency levels and lay the groundwork for personalised interventions to support skill refinement and mastery. This research contributes to the field of motor skill assessment and intervention strategies, with broad implications for sports training, physical rehabilitation, and performance optimisation across various domains.

本文介绍了一种利用惯性数据辨别运动技能执行中的专业水平的新方法,特别是区分专家和初学者。通过实施惯性数据转换和融合技术,我们对运动行为进行了全面分析。我们的方法超越了传统的评估,提供了对运动潜在模式的细微洞察。此外,我们还探索了利用这种数据驱动方法帮助新手提高运动表现的可能性。研究结果展示了这种方法在准确识别熟练水平方面的功效,并为支持技能改进和掌握的个性化干预奠定了基础。这项研究为运动技能评估和干预策略领域做出了贡献,对运动训练、身体康复和各领域的成绩优化具有广泛影响。
{"title":"Exploring raw data transformations on inertial sensor data to model user expertise when learning psychomotor skills","authors":"Miguel Portaz, Alberto Corbi, Alberto Casas-Ortiz, Olga C. Santos","doi":"10.1007/s11257-024-09393-2","DOIUrl":"https://doi.org/10.1007/s11257-024-09393-2","url":null,"abstract":"<p>This paper introduces a novel approach for leveraging inertial data to discern expertise levels in motor skill execution, specifically distinguishing between experts and beginners. By implementing inertial data transformation and fusion techniques, we conduct a comprehensive analysis of motor behaviour. Our approach goes beyond conventional assessments, providing nuanced insights into the underlying patterns of movement. Additionally, we explore the potential for utilising this data-driven methodology to aid novice practitioners in enhancing their performance. The findings showcase the efficacy of this approach in accurately identifying proficiency levels and lay the groundwork for personalised interventions to support skill refinement and mastery. This research contributes to the field of motor skill assessment and intervention strategies, with broad implications for sports training, physical rehabilitation, and performance optimisation across various domains.\u0000</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"49 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140616172","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Personalized recommendations for learning activities in online environments: a modular rule-based approach 在线环境中学习活动的个性化推荐:基于模块规则的方法
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-04-06 DOI: 10.1007/s11257-024-09396-z
Radek Pelánek, Tomáš Effenberger, Petr Jarušek

Personalization in online learning environments has been extensively studied at various levels, ranging from adaptive hints during task-solving to recommending whole courses. In this study, we focus on recommending learning activities (sequences of homogeneous tasks). We argue that this is an important yet insufficiently explored area, particularly when considering the requirements of large-scale online learning environments used in practice. To address this gap, we propose a modular rule-based framework for recommendations and thoroughly explain the rationale behind the proposal. We also discuss a specific application of the framework.

在线学习环境中的个性化已经在不同层面上得到了广泛的研究,从任务解决过程中的自适应提示到整个课程的推荐。在本研究中,我们的重点是推荐学习活动(同质任务序列)。我们认为,这是一个重要但尚未得到充分探索的领域,尤其是在考虑到实际使用的大规模在线学习环境的要求时。为了弥补这一不足,我们提出了一个基于模块规则的推荐框架,并详细解释了该建议背后的原理。我们还讨论了该框架的具体应用。
{"title":"Personalized recommendations for learning activities in online environments: a modular rule-based approach","authors":"Radek Pelánek, Tomáš Effenberger, Petr Jarušek","doi":"10.1007/s11257-024-09396-z","DOIUrl":"https://doi.org/10.1007/s11257-024-09396-z","url":null,"abstract":"<p>Personalization in online learning environments has been extensively studied at various levels, ranging from adaptive hints during task-solving to recommending whole courses. In this study, we focus on recommending learning activities (sequences of homogeneous tasks). We argue that this is an important yet insufficiently explored area, particularly when considering the requirements of large-scale online learning environments used in practice. To address this gap, we propose a modular rule-based framework for recommendations and thoroughly explain the rationale behind the proposal. We also discuss a specific application of the framework.\u0000</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"298 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-04-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140591553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Federated privacy-preserving collaborative filtering for on-device next app prediction 针对设备上的下一个应用程序预测的联合隐私保护协同过滤技术
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-03-28 DOI: 10.1007/s11257-024-09395-0
Albert Saiapin, Gleb Balitskiy, Daniel Bershatsky, Aleksandr Katrutsa, Evgeny Frolov, Alexey Frolov, Ivan Oseledets, Vitaliy Kharin

In this study, we propose a novel SeqMF model to solve the problem of predicting the next app launch during mobile device usage. Although this problem can be represented as a classical collaborative filtering problem, it requires proper modification since the data are sequential, the user feedback is distributed among devices, and the transmission of users’ data to aggregate common patterns must be protected against leakage. According to such requirements, we modify the structure of the classical matrix factorization model and update the training procedure to sequential learning. Since the data about user experience are distributed among devices, the federated learning setup is used to train the proposed sequential matrix factorization model. One more ingredient of our approach is a new privacy mechanism that guarantees the protection of the sent data from the users to the remote server. To demonstrate the efficiency of the proposed model, we use publicly available mobile user behavior data. We compare our model with sequential rules and models based on the frequency of app launches. The comparison is conducted in static and dynamic environments. The static environment evaluates how our model processes sequential data compared to competitors. The dynamic environment emulates the real-world scenario, where users generate new data by running apps on devices. Our experiments show that the proposed model provides comparable quality with other methods in the static environment. However, more importantly, our method achieves a better privacy-utility trade-off than competitors in the dynamic environment, which provides more accurate simulations of real-world usage.

在本研究中,我们提出了一种新颖的 SeqMF 模型,以解决在移动设备使用过程中预测下一个应用程序启动的问题。虽然这个问题可以表示为一个经典的协同过滤问题,但它需要适当的修改,因为数据是连续的,用户的反馈分布在不同的设备上,而且用户数据的传输以聚合共同模式必须防止泄漏。根据这些要求,我们修改了经典矩阵因式分解模型的结构,并将训练过程更新为顺序学习。由于有关用户体验的数据分布在不同的设备上,因此我们使用联合学习设置来训练所提出的序列矩阵因式分解模型。我们方法的另一个要素是一种新的隐私机制,它能确保保护从用户发送到远程服务器的数据。为了证明所提模型的效率,我们使用了公开的移动用户行为数据。我们将我们的模型与顺序规则和基于应用程序启动频率的模型进行了比较。比较在静态和动态环境中进行。静态环境评估我们的模型与竞争对手相比是如何处理顺序数据的。动态环境模拟了真实世界的场景,即用户通过在设备上运行应用程序产生新数据。我们的实验表明,在静态环境下,我们提出的模型能提供与其他方法相当的质量。然而,更重要的是,在动态环境中,我们的方法比竞争对手实现了更好的隐私-效用权衡,从而更准确地模拟了真实世界的使用情况。
{"title":"Federated privacy-preserving collaborative filtering for on-device next app prediction","authors":"Albert Saiapin, Gleb Balitskiy, Daniel Bershatsky, Aleksandr Katrutsa, Evgeny Frolov, Alexey Frolov, Ivan Oseledets, Vitaliy Kharin","doi":"10.1007/s11257-024-09395-0","DOIUrl":"https://doi.org/10.1007/s11257-024-09395-0","url":null,"abstract":"<p>In this study, we propose a novel SeqMF model to solve the problem of predicting the next app launch during mobile device usage. Although this problem can be represented as a classical collaborative filtering problem, it requires proper modification since the data are sequential, the user feedback is distributed among devices, and the transmission of users’ data to aggregate common patterns must be protected against leakage. According to such requirements, we modify the structure of the classical matrix factorization model and update the training procedure to sequential learning. Since the data about user experience are distributed among devices, the federated learning setup is used to train the proposed sequential matrix factorization model. One more ingredient of our approach is a new privacy mechanism that guarantees the protection of the sent data from the users to the remote server. To demonstrate the efficiency of the proposed model, we use publicly available mobile user behavior data. We compare our model with sequential rules and models based on the frequency of app launches. The comparison is conducted in static and dynamic environments. The static environment evaluates how our model processes sequential data compared to competitors. The dynamic environment emulates the real-world scenario, where users generate new data by running apps on devices. Our experiments show that the proposed model provides comparable quality with other methods in the static environment. However, more importantly, our method achieves a better privacy-utility trade-off than competitors in the dynamic environment, which provides more accurate simulations of real-world usage.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"18 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140591629","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Personalization of industrial human–robot communication through domain adaptation based on user feedback 通过基于用户反馈的领域适应,实现工业人机通信的个性化
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-03-22 DOI: 10.1007/s11257-024-09394-1

Abstract

Achieving safe collaboration between humans and robots in an industrial work-cell requires effective communication. This can be achieved through a robot perception system developed using data-driven machine learning. The challenge for human–robot communication is the availability of extensive, labelled datasets for training. Due to the variations in human behaviour and the impact of environmental conditions on the performance of perception models, models trained on standard, publicly available datasets fail to generalize well to domain and application-specific scenarios. Thus, model personalization involving the adaptation of such models to the individual humans involved in the task in the given environment would lead to better model performance. A novel framework is presented that leverages robust modes of communication and gathers feedback from the human partner to auto-label the mode with the sparse dataset. The strength of the contribution lies in using in-commensurable multimodes of inputs for personalizing models with user-specific data. The personalization through feedback-enabled human–robot communication (PF-HRCom) framework is implemented on the use of facial expression recognition as a safety feature to ensure that the human partner is engaged in the collaborative task with the robot. Additionally, PF-HRCom has been applied to a real-time human–robot handover task with a robotic manipulator. The perception module of the manipulator adapts to the user’s facial expressions and personalizes the model using feedback. Having said that, the framework is applicable to other combinations of multimodal inputs in human–robot collaboration applications.

摘要 在工业工作单元中实现人与机器人之间的安全协作需要有效的沟通。这可以通过使用数据驱动的机器学习技术开发的机器人感知系统来实现。人机通信面临的挑战是如何获得大量用于训练的标记数据集。由于人类行为的变化和环境条件对感知模型性能的影响,在标准、公开可用数据集上训练的模型无法很好地泛化到特定领域和应用场景中。因此,对模型进行个性化调整,使其适应特定环境中参与任务的人类个体,将提高模型的性能。本文提出了一个新颖的框架,该框架利用稳健的通信模式,并收集来自人类伙伴的反馈,利用稀疏数据集对模式进行自动标注。这一贡献的优势在于使用不可比拟的多模式输入,利用用户特定数据对模型进行个性化。通过支持反馈的人机交流(PF-HRCom)框架实现个性化,使用面部表情识别作为安全功能,以确保人类伙伴参与到与机器人的协作任务中。此外,PF-HRCom 还应用于机器人操纵器的实时人机交接任务。机械手的感知模块可以适应用户的面部表情,并通过反馈对模型进行个性化处理。此外,该框架还适用于人机协作应用中的其他多模态输入组合。
{"title":"Personalization of industrial human–robot communication through domain adaptation based on user feedback","authors":"","doi":"10.1007/s11257-024-09394-1","DOIUrl":"https://doi.org/10.1007/s11257-024-09394-1","url":null,"abstract":"<h3>Abstract</h3> <p>Achieving safe collaboration between humans and robots in an industrial work-cell requires effective communication. This can be achieved through a robot perception system developed using data-driven machine learning. The challenge for human–robot communication is the availability of extensive, labelled datasets for training. Due to the variations in human behaviour and the impact of environmental conditions on the performance of perception models, models trained on standard, publicly available datasets fail to generalize well to domain and application-specific scenarios. Thus, model personalization involving the adaptation of such models to the individual humans involved in the task in the given environment would lead to better model performance. A novel framework is presented that leverages robust modes of communication and gathers feedback from the human partner to auto-label the mode with the sparse dataset. The strength of the contribution lies in using in-commensurable multimodes of inputs for personalizing models with user-specific data. The personalization through feedback-enabled human–robot communication (PF-HRCom) framework is implemented on the use of facial expression recognition as a safety feature to ensure that the human partner is engaged in the collaborative task with the robot. Additionally, PF-HRCom has been applied to a real-time human–robot handover task with a robotic manipulator. The perception module of the manipulator adapts to the user’s facial expressions and personalizes the model using feedback. Having said that, the framework is applicable to other combinations of multimodal inputs in human–robot collaboration applications.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"1 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140196329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Persuasive strategies and emotional states: towards designing personalized and emotion-adaptive persuasive systems 说服策略和情绪状态:设计个性化和情绪适应型说服系统
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-03-05 DOI: 10.1007/s11257-023-09390-x
Oladapo Oyebode, Darren Steeves, Rita Orji

Persuasive strategies have been widely operationalized in systems or applications to motivate behaviour change across diverse domains. However, no empirical evidence exists on whether or not persuasive strategies lead to certain emotions to inform which strategies are most appropriate for delivering interventions that not only motivate users to perform target behaviour but also help to regulate their current emotional states. We conducted a large-scale study of 660 participants to investigate if and how individuals including those at different stages of change respond emotionally to persuasive strategies and why. Specifically, we examined the relationship between perceived effectiveness of individual strategies operationalized in a system and perceived emotional states for participants at different stages of behaviour change. Our findings established relations between perceived effectiveness of strategies and emotions elicited in individuals at distinct stages of change and that the perceived emotions vary across stages of change for different reasons. For example, the reward strategy is associated with positive emotion only (i.e. happiness) for individuals across distinct stages of change because it induces feelings of personal accomplishment, provides incentives that increase the urge to achieve more goals, and offers gamified experience. Other strategies are associated with mixed emotions. Our work links emotion theory with behaviour change theories and stages of change theory to develop practical guidelines for designing personalized and emotion-adaptive persuasive systems.

说服策略已被广泛应用于系统或应用程序中,以激励不同领域的行为改变。然而,关于说服策略是否会导致特定情绪的实证证据尚不存在,因此无法得知哪些策略最适合用于提供干预,不仅能激励用户执行目标行为,还能帮助调节他们当前的情绪状态。我们对 660 名参与者进行了一项大规模研究,以调查个体(包括处于不同变化阶段的个体)是否以及如何对说服策略产生情绪反应,以及产生反应的原因。具体来说,我们研究了处于行为改变不同阶段的参与者对系统中可操作的个别策略的感知有效性与感知情绪状态之间的关系。我们的研究结果表明,在不同的改变阶段,策略的感知有效性与个体所激发的情绪之间存在关系,并且不同改变阶段的感知情绪因不同原因而异。例如,在不同的改变阶段,奖励策略只与个人的积极情绪(即快乐)相关,因为它能诱发个人成就感,提供激励措施以增加实现更多目标的冲动,并提供游戏化体验。其他策略则与混合情感有关。我们的工作将情感理论与行为变化理论和变化阶段理论联系起来,为设计个性化和情感适应性说服系统制定了实用指南。
{"title":"Persuasive strategies and emotional states: towards designing personalized and emotion-adaptive persuasive systems","authors":"Oladapo Oyebode, Darren Steeves, Rita Orji","doi":"10.1007/s11257-023-09390-x","DOIUrl":"https://doi.org/10.1007/s11257-023-09390-x","url":null,"abstract":"<p>Persuasive strategies have been widely operationalized in systems or applications to motivate behaviour change across diverse domains. However, no empirical evidence exists on whether or not persuasive strategies lead to certain emotions to inform which strategies are most appropriate for delivering interventions that not only motivate users to perform target behaviour but also help to regulate their current emotional states. We conducted a large-scale study of 660 participants to investigate <i>if</i> and <i>how</i> individuals including those at different stages of change respond emotionally to persuasive strategies and <i>why</i>. Specifically, we examined the relationship between perceived effectiveness of individual strategies operationalized in a system and perceived emotional states for participants at different stages of behaviour change. Our findings established relations between perceived effectiveness of strategies and emotions elicited in individuals at distinct stages of change and that the perceived emotions vary across stages of change for different reasons. For example, the <i>reward</i> strategy is associated with positive emotion only (i.e. <i>happiness</i>) for individuals across distinct stages of change because it induces feelings of personal accomplishment, provides incentives that increase the urge to achieve more goals, and offers gamified experience. Other strategies are associated with mixed emotions. Our work links emotion theory with behaviour change theories and stages of change theory to develop practical guidelines for designing personalized and emotion-adaptive persuasive systems.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"15 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140035410","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Improving collaborative problem-solving skills via automated feedback and scaffolding: a quasi-experimental study with CPSCoach 2.0 通过自动反馈和脚手架提高协作解决问题的能力:CPSCoach 2.0 准实验研究
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-02-14 DOI: 10.1007/s11257-023-09387-6
Sidney K. D’Mello, Nicholas Duran, Amanda Michaels, Angela E. B. Stewart

We present CPSCoach 2.0, an automated system that provides feedback, instructional scaffolding, and practice to help individuals improve three collaborative problem-solving (CPS) skills drawn from a theoretical CPS framework: construction of shared knowledge, negotiation/coordination, and maintaining team function. CPSCoach 2.0 was developed and tested in the context of computer-mediated collaboration (video conferencing) with an educational game. It automatically analyzes users’ speech during a round of collaborative gameplay to provide personalized feedback and to select a target CPS skill for improvement. After multiple cycles of iterative testing and refinement, we tested CPSCoach 2.0 in a user study where 21 dyads (n = 42) completed four rounds of feedback and scaffolding embedded within five rounds of game-play in a single session. Using a quasi-experimental matching procedure, we found that the use of CPSCoach 2.0 was associated with improvement in CPS skill development compared to matched controls. Further, users found the automated feedback to be moderately accurate and had positive perceptions of the system, and these impressions were stronger for those who received higher scores overall. Results demonstrate the use of automated feedback and instructional scaffolds to support the development of CPS skills.

我们介绍的 CPSCoach 2.0 是一个自动化系统,它提供反馈、教学支架和练习,帮助个人提高协作解决问题(CPS)理论框架中的三种技能:构建共享知识、协商/协调和维护团队功能。CPSCoach 2.0 是在计算机辅助协作(视频会议)和教育游戏的背景下开发和测试的。它能自动分析用户在一轮协作游戏中的发言,以提供个性化反馈,并选择需要改进的目标 CPS 技能。经过多次反复测试和改进,我们在一项用户研究中对 CPSCoach 2.0 进行了测试,21 个二人组(n = 42)在一次会议中完成了嵌入在五轮游戏中的四轮反馈和支架。通过准实验匹配程序,我们发现与匹配的对照组相比,CPSCoach 2.0 的使用与 CPS 技能发展的提高有关。此外,用户认为自动反馈的准确度适中,并对该系统有积极的看法,而对于那些总分较高的用户来说,这些看法更为强烈。研究结果表明,自动反馈和教学支架可用于支持 CPS 技能的发展。
{"title":"Improving collaborative problem-solving skills via automated feedback and scaffolding: a quasi-experimental study with CPSCoach 2.0","authors":"Sidney K. D’Mello, Nicholas Duran, Amanda Michaels, Angela E. B. Stewart","doi":"10.1007/s11257-023-09387-6","DOIUrl":"https://doi.org/10.1007/s11257-023-09387-6","url":null,"abstract":"<p>We present CPSCoach 2.0, an automated system that provides feedback, instructional scaffolding, and practice to help individuals improve three collaborative problem-solving (CPS) skills drawn from a theoretical CPS framework: construction of shared knowledge, negotiation/coordination, and maintaining team function. CPSCoach 2.0 was developed and tested in the context of computer-mediated collaboration (video conferencing) with an educational game. It automatically analyzes users’ speech during a round of collaborative gameplay to provide personalized feedback and to select a target CPS skill for improvement. After multiple cycles of iterative testing and refinement, we tested CPSCoach 2.0 in a user study where 21 dyads (<i>n</i> = 42) completed four rounds of feedback and scaffolding embedded within five rounds of game-play in a single session. Using a quasi-experimental matching procedure, we found that the use of CPSCoach 2.0 was associated with improvement in CPS skill development compared to matched controls. Further, users found the automated feedback to be moderately accurate and had positive perceptions of the system, and these impressions were stronger for those who received higher scores overall. Results demonstrate the use of automated feedback and instructional scaffolds to support the development of CPS skills.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"1 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139756909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Informative representations for forgetting-robust knowledge tracing 用于健忘知识追踪的信息表征
IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, CYBERNETICS Pub Date : 2024-02-04 DOI: 10.1007/s11257-024-09391-4
Zhiyu Chen, Zhilong Shan, Yanhua Zeng

Tracing a student’s knowledge state is critical for teaching and learning. Knowledge tracing aims to accurately predict student performance by analyzing historical records on online education platforms. Most studies have focused on a student’s skill with interactions sequence to predict the probability of correctly answering the latest question. However, they still suffer from the challenge of information sparsity and student forgetting. Specifically, the relationship between question and skill, and the features related to question texts have not been integrated to enrich information exploration. Besides, modeling forgetting behavior remains a challenge in assessing a student’s learning gains. In this paper, we present a novel model, namely Informative Representations for Forgetting-Robust Knowledge Tracing (IFKT). IFKT utilizes a light graph convolutional network to capture various relational structures via embedding propagation. Then, the embeddings are assembled with rich interaction features separately as the powerful representation. Furthermore, attention weights assignments are individualized using the relative positions, in addition to the relevance between the current question with historical interaction representations. Finally, we compare IFKT against seven knowledge tracing baselines on three real-world benchmark datasets, demonstrating the superiority of the proposed model.

追踪学生的知识状态对教学至关重要。知识追踪旨在通过分析在线教育平台上的历史记录,准确预测学生的学习成绩。大多数研究都侧重于学生的交互序列技能,以预测正确回答最新问题的概率。然而,这些研究仍然面临信息稀疏和学生遗忘的挑战。具体来说,问题与技能之间的关系以及与问题文本相关的特征尚未被整合以丰富信息探索。此外,遗忘行为建模仍是评估学生学习效果的一个难题。在本文中,我们提出了一种新型模型,即 "遗忘-稳健知识追踪的信息表征"(IFKT)。IFKT 利用轻图卷积网络,通过嵌入传播捕捉各种关系结构。然后,将嵌入分别与丰富的交互特征组装在一起,作为强大的表征。此外,除了当前问题与历史交互表征之间的相关性外,还利用相对位置对注意力权重分配进行了个性化处理。最后,我们将 IFKT 与三个真实世界基准数据集上的七个知识追踪基线进行了比较,证明了所提模型的优越性。
{"title":"Informative representations for forgetting-robust knowledge tracing","authors":"Zhiyu Chen, Zhilong Shan, Yanhua Zeng","doi":"10.1007/s11257-024-09391-4","DOIUrl":"https://doi.org/10.1007/s11257-024-09391-4","url":null,"abstract":"<p>Tracing a student’s knowledge state is critical for teaching and learning. Knowledge tracing aims to accurately predict student performance by analyzing historical records on online education platforms. Most studies have focused on a student’s skill with interactions sequence to predict the probability of correctly answering the latest question. However, they still suffer from the challenge of information sparsity and student forgetting. Specifically, the relationship between question and skill, and the features related to question texts have not been integrated to enrich information exploration. Besides, modeling forgetting behavior remains a challenge in assessing a student’s learning gains. In this paper, we present a novel model, namely Informative Representations for Forgetting-Robust Knowledge Tracing (IFKT). IFKT utilizes a light graph convolutional network to capture various relational structures via embedding propagation. Then, the embeddings are assembled with rich interaction features separately as the powerful representation. Furthermore, attention weights assignments are individualized using the relative positions, in addition to the relevance between the current question with historical interaction representations. Finally, we compare IFKT against seven knowledge tracing baselines on three real-world benchmark datasets, demonstrating the superiority of the proposed model.</p>","PeriodicalId":49388,"journal":{"name":"User Modeling and User-Adapted Interaction","volume":"102 1","pages":""},"PeriodicalIF":3.6,"publicationDate":"2024-02-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139756690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
User Modeling and User-Adapted Interaction
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1