首页 > 最新文献

Frontiers in Robotics and AI最新文献

英文 中文
Human intention recognition by deep LSTM and transformer networks for real-time human-robot collaboration. 基于深度LSTM和变压器网络的人机实时协作人类意图识别。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-19 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1708987
Matija Mavsar, Mihael Simonič, Aleš Ude

Collaboration between humans and robots is essential for optimizing the performance of complex tasks in industrial environments, reducing worker strain, and improving safety. This paper presents an integrated human-robot collaboration (HRC) system that leverages advanced intention recognition for real-time task sharing and interaction. By utilizing state-of-the-art human pose estimation combined with deep learning models, we developed a robust framework for detecting and predicting worker intentions. Specifically, we employed LSTM-based and transformer-based neural networks with convolutional and pooling layers to classify human hand trajectories, achieving higher accuracy compared to previous approaches. Additionally, our system integrates dynamic movement primitives (DMPs) for smooth robot motion transitions, collision prevention, and automatic motion onset/cessation detection. We validated the system in a real-world industrial assembly task, demonstrating its effectiveness in enhancing the fluency, safety, and efficiency of human-robot collaboration. The proposed method shows promise in improving real-time decision-making in collaborative environments, offering a safer and more intuitive interaction between humans and robots.

人类和机器人之间的协作对于优化工业环境中复杂任务的性能、减少工人压力和提高安全性至关重要。本文提出了一种集成的人机协作(HRC)系统,该系统利用先进的意图识别进行实时任务共享和交互。通过利用最先进的人体姿势估计与深度学习模型相结合,我们开发了一个强大的框架来检测和预测工人的意图。具体来说,我们采用基于lstm和基于变压器的神经网络,结合卷积和池化层对人手轨迹进行分类,与之前的方法相比,获得了更高的精度。此外,我们的系统集成了动态运动原语(dmp),用于平滑机器人运动转换,碰撞预防和自动运动开始/停止检测。我们在一个真实的工业装配任务中验证了该系统,证明了它在提高人机协作的流畅性、安全性和效率方面的有效性。该方法有望改善协作环境中的实时决策,提供人与机器人之间更安全、更直观的交互。
{"title":"Human intention recognition by deep LSTM and transformer networks for real-time human-robot collaboration.","authors":"Matija Mavsar, Mihael Simonič, Aleš Ude","doi":"10.3389/frobt.2025.1708987","DOIUrl":"10.3389/frobt.2025.1708987","url":null,"abstract":"<p><p>Collaboration between humans and robots is essential for optimizing the performance of complex tasks in industrial environments, reducing worker strain, and improving safety. This paper presents an integrated human-robot collaboration (HRC) system that leverages advanced intention recognition for real-time task sharing and interaction. By utilizing state-of-the-art human pose estimation combined with deep learning models, we developed a robust framework for detecting and predicting worker intentions. Specifically, we employed LSTM-based and transformer-based neural networks with convolutional and pooling layers to classify human hand trajectories, achieving higher accuracy compared to previous approaches. Additionally, our system integrates dynamic movement primitives (DMPs) for smooth robot motion transitions, collision prevention, and automatic motion onset/cessation detection. We validated the system in a real-world industrial assembly task, demonstrating its effectiveness in enhancing the fluency, safety, and efficiency of human-robot collaboration. The proposed method shows promise in improving real-time decision-making in collaborative environments, offering a safer and more intuitive interaction between humans and robots.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1708987"},"PeriodicalIF":3.0,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12757248/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145900997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interactive imitation learning for dexterous robotic manipulation: challenges and perspectives-a survey. 交互式模仿学习在灵巧机器人操作中的应用:挑战与展望。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-19 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1682437
Edgar Welte, Rania Rayyes

Dexterous manipulation is a crucial yet highly complex challenge in humanoid robotics, demanding precise, adaptable, and sample-efficient learning methods. As humanoid robots are usually designed to operate in human-centric environments and interact with everyday objects, mastering dexterous manipulation is critical for real-world deployment. Traditional approaches, such as reinforcement learning and imitation learning, have made significant strides, but they often struggle due to the unique challenges of real-world dexterous manipulation, including high-dimensional control, limited training data, and covariate shift. This survey provides a comprehensive overview of these challenges and reviews existing learning-based methods for real-world dexterous manipulation, spanning imitation learning, reinforcement learning, and hybrid approaches. A promising yet underexplored direction is interactive imitation learning, where human feedback actively refines a robot's behavior during training. While interactive imitation learning has shown success in various robotic tasks, its application to dexterous manipulation remains limited. To address this gap, we examine current interactive imitation learning techniques applied to other robotic tasks and discuss how these methods can be adapted to enhance dexterous manipulation. By synthesizing state-of-the-art research, this paper highlights key challenges, identifies gaps in current methodologies, and outlines potential directions for leveraging interactive imitation learning to improve dexterous robotic skills.

在类人机器人中,灵巧的操作是一个关键而又高度复杂的挑战,它要求精确、适应性强、样本效率高的学习方法。由于类人机器人通常被设计为在以人为中心的环境中工作,并与日常物品进行交互,因此掌握灵巧的操作对于现实世界的部署至关重要。传统的方法,如强化学习和模仿学习,已经取得了重大进展,但由于现实世界灵巧操作的独特挑战,包括高维控制,有限的训练数据和协变量移位,它们经常挣扎。本调查提供了这些挑战的全面概述,并回顾了现有的基于学习的方法,用于现实世界的灵巧操作,跨越模仿学习,强化学习和混合方法。交互式模仿学习是一个很有前途但尚未得到充分开发的方向,在这个方向上,人类的反馈可以在训练过程中积极地改进机器人的行为。虽然交互式模仿学习在各种机器人任务中取得了成功,但它在灵巧操作中的应用仍然有限。为了解决这一差距,我们研究了目前应用于其他机器人任务的交互式模仿学习技术,并讨论了如何适应这些方法来增强灵巧操作。通过综合最新的研究,本文强调了关键挑战,确定了当前方法中的差距,并概述了利用交互式模仿学习来提高灵巧机器人技能的潜在方向。
{"title":"Interactive imitation learning for dexterous robotic manipulation: challenges and perspectives-a survey.","authors":"Edgar Welte, Rania Rayyes","doi":"10.3389/frobt.2025.1682437","DOIUrl":"10.3389/frobt.2025.1682437","url":null,"abstract":"<p><p>Dexterous manipulation is a crucial yet highly complex challenge in humanoid robotics, demanding precise, adaptable, and sample-efficient learning methods. As humanoid robots are usually designed to operate in human-centric environments and interact with everyday objects, mastering dexterous manipulation is critical for real-world deployment. Traditional approaches, such as reinforcement learning and imitation learning, have made significant strides, but they often struggle due to the unique challenges of real-world dexterous manipulation, including high-dimensional control, limited training data, and covariate shift. This survey provides a comprehensive overview of these challenges and reviews existing learning-based methods for real-world dexterous manipulation, spanning imitation learning, reinforcement learning, and hybrid approaches. A promising yet underexplored direction is interactive imitation learning, where human feedback actively refines a robot's behavior during training. While interactive imitation learning has shown success in various robotic tasks, its application to dexterous manipulation remains limited. To address this gap, we examine current interactive imitation learning techniques applied to other robotic tasks and discuss how these methods can be adapted to enhance dexterous manipulation. By synthesizing state-of-the-art research, this paper highlights key challenges, identifies gaps in current methodologies, and outlines potential directions for leveraging interactive imitation learning to improve dexterous robotic skills.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1682437"},"PeriodicalIF":3.0,"publicationDate":"2025-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12757213/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145900952","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Adaptive mapless mobile robot navigation using deep reinforcement learning based improved TD3 algorithm. 基于深度强化学习改进TD3算法的自适应无地图移动机器人导航。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-18 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1625968
Shoaib Mohd Nasti, Zahoor Ahmad Najar, Mohammad Ahsan Chishti

Navigating in unknown environments without prior maps poses a significant challenge for mobile robots due to sparse rewards, dynamic obstacles, and limited prior knowledge. This paper presents an Improved Deep Reinforcement Learning (DRL) framework based on the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm for adaptive mapless navigation. In addition to architectural enhancements, the proposed method offers theoretical benefits byincorporates a latent-state encoder and predictor module to transform high-dimensional sensor inputs into compact embeddings. This compact representation reduces the effective dimensionality of the state space, enabling smoother value-function approximation and mitigating overestimation errors common in actor-critic methods. It uses intrinsic rewards derived from prediction error in the latent space to promote exploration of novel states. The intrinsic reward encourages the agent to prioritize uncertain yet informative regions, improving exploration efficiency under sparse extrinsic reward signals and accelerating convergence. Furthermore, training stability is achieved through regularization of the latent space via maximum mean discrepancy (MMD) loss. By enforcing consistent latent dynamics, the MMD constraint reduces variance in target value estimation and results in more stable policy updates. Experimental results in simulated ROS2/Gazebo environments demonstrate that the proposed framework outperforms standard TD3 and other improved TD3 variants. Our model achieves a 93.1% success rate and a low 6.8% collision rate, reflecting efficient and safe goal-directed navigation. These findings confirm that combining intrinsic motivation, structured representation learning, and regularization-based stabilization produces more robust and generalizable policies for mapless mobile robot navigation.

由于奖励稀疏、动态障碍和有限的先验知识,在没有事先地图的未知环境中导航对移动机器人提出了重大挑战。提出了一种基于双延迟深度确定性策略梯度(TD3)算法的改进深度强化学习(DRL)框架,用于自适应无地图导航。除了架构上的改进,所提出的方法还提供了理论上的好处,它结合了一个潜在状态编码器和预测器模块,将高维传感器输入转换为紧凑的嵌入。这种紧凑的表示减少了状态空间的有效维数,实现了更平滑的值-函数近似,并减轻了actor-critic方法中常见的高估错误。它使用来自潜在空间预测误差的内在奖励来促进对新状态的探索。内在奖励鼓励智能体优先考虑不确定但信息丰富的区域,提高了在稀疏的外部奖励信号下的探索效率,加速了收敛。此外,通过最大平均差异(MMD)损失对潜在空间进行正则化,实现训练稳定性。通过执行一致的潜在动态,MMD约束减少了目标值估计中的方差,并导致更稳定的策略更新。在模拟ROS2/Gazebo环境下的实验结果表明,该框架优于标准TD3和其他改进的TD3变体。我们的模型实现了93.1%的成功率和6.8%的低碰撞率,反映了高效和安全的目标导向导航。这些发现证实,将内在动机、结构化表征学习和基于正则化的稳定化相结合,可以为无地图移动机器人导航提供更强大、更通用的策略。
{"title":"Adaptive mapless mobile robot navigation using deep reinforcement learning based improved TD3 algorithm.","authors":"Shoaib Mohd Nasti, Zahoor Ahmad Najar, Mohammad Ahsan Chishti","doi":"10.3389/frobt.2025.1625968","DOIUrl":"10.3389/frobt.2025.1625968","url":null,"abstract":"<p><p>Navigating in unknown environments without prior maps poses a significant challenge for mobile robots due to sparse rewards, dynamic obstacles, and limited prior knowledge. This paper presents an Improved Deep Reinforcement Learning (DRL) framework based on the Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm for adaptive mapless navigation. In addition to architectural enhancements, the proposed method offers theoretical benefits byincorporates a latent-state encoder and predictor module to transform high-dimensional sensor inputs into compact embeddings. This compact representation reduces the effective dimensionality of the state space, enabling smoother value-function approximation and mitigating overestimation errors common in actor-critic methods. It uses intrinsic rewards derived from prediction error in the latent space to promote exploration of novel states. The intrinsic reward encourages the agent to prioritize uncertain yet informative regions, improving exploration efficiency under sparse extrinsic reward signals and accelerating convergence. Furthermore, training stability is achieved through regularization of the latent space via maximum mean discrepancy (MMD) loss. By enforcing consistent latent dynamics, the MMD constraint reduces variance in target value estimation and results in more stable policy updates. Experimental results in simulated ROS2/Gazebo environments demonstrate that the proposed framework outperforms standard TD3 and other improved TD3 variants. Our model achieves a 93.1% success rate and a low 6.8% collision rate, reflecting efficient and safe goal-directed navigation. These findings confirm that combining intrinsic motivation, structured representation learning, and regularization-based stabilization produces more robust and generalizable policies for mapless mobile robot navigation.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1625968"},"PeriodicalIF":3.0,"publicationDate":"2025-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12756063/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145901283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From AIBO to robosphere. Organizational interdependencies in sustainable robotics. 从AIBO到机器人世界。可持续机器人的组织相互依赖关系。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-18 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1716801
Antonio Fleres, Luisa Damiano

The challenge of sustainability in robotics is usually addressed in terms of materials, energy, and efficiency. Yet the long-term viability of robotic systems also depends on organizational interdependencies that shape how they are maintained, experienced, and integrated into human environments. The present article develops this systemic perspective by advancing the hypothesis that such interdependencies can be understood as self-organizing dynamics. To examine this hypothesis, we analyze the case of Sony's AIBO robotic dogs. Originally designed for social companionship, AIBO units gave rise to a hybrid socio-technical ecosystem in which owners, repair specialists, and ritual practices sustained the robots long after their commercial discontinuation. Building on self-organization theory, we introduce the concept of the "robosphere" as an evolving network of relations in which robotic and human agents co-constitute resilient, sustainability-oriented ecosystems. Extending self-organization beyond its classical biological and technical domains, we argue that robotic sustainability must be framed not as a narrow technical issue but as a complex, multifactorial, and distributed process grounded in organizational interdependencies that integrate technical, cognitive, social, and affective dimensions of human life. Our contribution is twofold. First, we propose a modeling perspective that interprets sustainability in robotics as an emergent property of these interdependencies, exemplified by repair, reuse, and ritual practices that prolonged AIBO's lifecycle. Second, we outline a set of systemic design principles to inform the development of future human-robot ecosystems. By situating the AIBO case within the robospheric framework, this Hypothesis and Theory article advances the view that hybrid socio-technical collectives can generate sustainability from within. It outlines a programmatic horizon for rethinking social robotics not as disposable products, but as integral nodes of co-evolving, sustainable human-robot ecologies.

机器人的可持续性挑战通常是在材料、能源和效率方面解决的。然而,机器人系统的长期生存能力也取决于组织的相互依赖性,这种依赖性决定了它们如何被维护、体验和融入人类环境。本文通过提出这种相互依赖可以被理解为自组织动力学的假设来发展这种系统观点。为了检验这一假设,我们分析了索尼AIBO机器狗的案例。AIBO最初是为了社交而设计的,它产生了一个混合的社会技术生态系统,在这个生态系统中,主人、维修专家和仪式实践在机器人商业停产后很长一段时间内维持着它们。在自组织理论的基础上,我们引入了“机器人圈”的概念,作为一个不断发展的关系网络,在这个网络中,机器人和人类代理人共同构成了有弹性的、面向可持续发展的生态系统。将自组织扩展到经典的生物和技术领域之外,我们认为机器人的可持续性不能被视为一个狭隘的技术问题,而是一个复杂的、多因素的、分布式的过程,这个过程建立在组织相互依赖的基础上,整合了人类生活的技术、认知、社会和情感维度。我们的贡献是双重的。首先,我们提出了一个建模视角,将机器人技术的可持续性解释为这些相互依赖关系的紧急属性,例如修复,重用和延长AIBO生命周期的仪式实践。其次,我们概述了一套系统设计原则,为未来人机生态系统的发展提供信息。通过将AIBO案例置于机器人圈框架内,这篇假设和理论文章提出了混合社会技术集体可以从内部产生可持续性的观点。它概述了一个程序化的视野,重新思考社会机器人不是一次性产品,而是作为共同进化的整体节点,可持续的人-机器人生态。
{"title":"From AIBO to robosphere. Organizational interdependencies in sustainable robotics.","authors":"Antonio Fleres, Luisa Damiano","doi":"10.3389/frobt.2025.1716801","DOIUrl":"10.3389/frobt.2025.1716801","url":null,"abstract":"<p><p>The challenge of sustainability in robotics is usually addressed in terms of materials, energy, and efficiency. Yet the long-term viability of robotic systems also depends on organizational interdependencies that shape how they are maintained, experienced, and integrated into human environments. The present article develops this systemic perspective by advancing the hypothesis that such interdependencies can be understood as self-organizing dynamics. To examine this hypothesis, we analyze the case of Sony's AIBO robotic dogs. Originally designed for social companionship, AIBO units gave rise to a hybrid socio-technical ecosystem in which owners, repair specialists, and ritual practices sustained the robots long after their commercial discontinuation. Building on self-organization theory, we introduce the concept of the \"robosphere\" as an evolving network of relations in which robotic and human agents co-constitute resilient, sustainability-oriented ecosystems. Extending self-organization beyond its classical biological and technical domains, we argue that robotic sustainability must be framed not as a narrow technical issue but as a complex, multifactorial, and distributed process grounded in organizational interdependencies that integrate technical, cognitive, social, and affective dimensions of human life. Our contribution is twofold. First, we propose a modeling perspective that interprets sustainability in robotics as an emergent property of these interdependencies, exemplified by repair, reuse, and ritual practices that prolonged AIBO's lifecycle. Second, we outline a set of systemic design principles to inform the development of future human-robot ecosystems. By situating the AIBO case within the robospheric framework, this Hypothesis and Theory article advances the view that hybrid socio-technical collectives can generate sustainability from within. It outlines a programmatic horizon for rethinking social robotics not as disposable products, but as integral nodes of co-evolving, sustainable human-robot ecologies.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1716801"},"PeriodicalIF":3.0,"publicationDate":"2025-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12756144/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145900511","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Slip detection for compliant robotic hands using inertial signals and deep learning. 基于惯性信号和深度学习的柔顺机械手滑移检测。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-18 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1698591
Miranda Cravetz, Purva Vyas, Cindy Grimm, Joseph R Davidson

When a passively compliant hand grasps an object, slip events are often accompanied by flexion or extension of the finger or finger joints. This paper investigates whether a combination of orientation change and slip-induced vibration at the fingertip, as sensed by an inertial measurement unit (IMU), can be used as a slip indicator. Using a tendon-driven hand, which achieves passive compliance through underactuation, we performed 195 manipulation trials involving both slip and non-slip conditions. We then labeled this data automatically using motion-tracking data, and trained a convolutional neural network (CNN) to detect the slip events. Our results show that slip can be successfully detected from IMU data, even in the presence of other disturbances. This remains the case when deploying the trained network on data from a different gripper performing a new manipulation task on a previously unseen object.

当一只被动顺从的手抓住一个物体时,滑动事件通常伴随着手指或手指关节的弯曲或伸展。本文研究了由惯性测量单元(IMU)感知的指尖方向变化和滑移引起的振动的组合是否可以用作滑移指示器。使用肌腱驱动的手,通过欠驱动实现被动顺应,我们进行了195次涉及滑移和防滑条件的操作试验。然后,我们使用运动跟踪数据自动标记这些数据,并训练卷积神经网络(CNN)来检测滑动事件。我们的结果表明,即使在存在其他干扰的情况下,也可以从IMU数据中成功地检测到滑移。当将训练好的网络部署到来自不同抓取器的数据上时,这种情况仍然存在,这些抓取器对以前未见过的对象执行新的操作任务。
{"title":"Slip detection for compliant robotic hands using inertial signals and deep learning.","authors":"Miranda Cravetz, Purva Vyas, Cindy Grimm, Joseph R Davidson","doi":"10.3389/frobt.2025.1698591","DOIUrl":"10.3389/frobt.2025.1698591","url":null,"abstract":"<p><p>When a passively compliant hand grasps an object, slip events are often accompanied by flexion or extension of the finger or finger joints. This paper investigates whether a combination of orientation change and slip-induced vibration at the fingertip, as sensed by an inertial measurement unit (IMU), can be used as a slip indicator. Using a tendon-driven hand, which achieves passive compliance through underactuation, we performed 195 manipulation trials involving both slip and non-slip conditions. We then labeled this data automatically using motion-tracking data, and trained a convolutional neural network (CNN) to detect the slip events. Our results show that slip can be successfully detected from IMU data, even in the presence of other disturbances. This remains the case when deploying the trained network on data from a different gripper performing a new manipulation task on a previously unseen object.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1698591"},"PeriodicalIF":3.0,"publicationDate":"2025-12-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12756126/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145900958","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating human perceptions of android robot facial expressions based on variations in instruction styles. 基于教学风格的变化评估人类对机器人面部表情的感知。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-16 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1728647
Ayaka Fujii, Carlos Toshinori Ishi, Kurima Sakai, Tomo Funayama, Ritsuko Iwai, Yusuke Takahashi, Takatsune Kumada, Takashi Minato

Robots that interact with humans are required to express emotions in ways that are appropriate to the context. While most prior research has focused primarily on basic emotions, real-life interactions demand more nuanced expressions. In this study, we extended the expressive capabilities of the android robot Nikola by implementing 63 facial expressions, covering not only complex emotions and physical conditions, but also differences in intensity. At Expo 2025 in Japan, more than 600 participants interacted with Nikola by describing situations in which they wanted the robot to perform facial expressions. The robot inferred emotions using a large language model and performed corresponding facial expressions. Questionnaire responses revealed that participants rated the robot's behavior as more appropriate and emotionally expressive when their instructions were abstract, compared to when they explicitly included emotions or physical states. This suggests that abstract instructions enhance perceived agency in the robot. We also investigated and discussed how impressions towards the robot varied depending on the expressions it performed and the personality traits of participants. This study contributes to the research field of human-robot interaction by demonstrating how adaptive facial expressions, in association with instruction styles, are linked to shaping human perceptions of social robots.

与人类互动的机器人被要求以适合情境的方式表达情感。虽然大多数先前的研究主要集中在基本情绪上,但现实生活中的互动需要更微妙的表达。在这项研究中,我们通过实现63种面部表情来扩展机器人Nikola的表达能力,这些表情不仅涵盖了复杂的情绪和身体状况,而且还涵盖了强度的差异。在日本2025年世博会上,600多名参与者通过描述他们希望机器人做出面部表情的情景,与尼古拉进行了互动。机器人使用大型语言模型推断情绪,并做出相应的面部表情。问卷调查结果显示,与明确包含情绪或身体状态的指令相比,当机器人的指令是抽象的时,参与者认为机器人的行为更合适,更能表达情感。这表明抽象指令增强了机器人的感知代理能力。我们还调查并讨论了对机器人的印象是如何根据它的表现和参与者的个性特征而变化的。本研究通过展示与教学风格相关的适应性面部表情如何与塑造人类对社交机器人的看法相关联,为人机交互研究领域做出了贡献。
{"title":"Evaluating human perceptions of android robot facial expressions based on variations in instruction styles.","authors":"Ayaka Fujii, Carlos Toshinori Ishi, Kurima Sakai, Tomo Funayama, Ritsuko Iwai, Yusuke Takahashi, Takatsune Kumada, Takashi Minato","doi":"10.3389/frobt.2025.1728647","DOIUrl":"10.3389/frobt.2025.1728647","url":null,"abstract":"<p><p>Robots that interact with humans are required to express emotions in ways that are appropriate to the context. While most prior research has focused primarily on basic emotions, real-life interactions demand more nuanced expressions. In this study, we extended the expressive capabilities of the android robot Nikola by implementing 63 facial expressions, covering not only complex emotions and physical conditions, but also differences in intensity. At Expo 2025 in Japan, more than 600 participants interacted with Nikola by describing situations in which they wanted the robot to perform facial expressions. The robot inferred emotions using a large language model and performed corresponding facial expressions. Questionnaire responses revealed that participants rated the robot's behavior as more appropriate and emotionally expressive when their instructions were abstract, compared to when they explicitly included emotions or physical states. This suggests that abstract instructions enhance perceived agency in the robot. We also investigated and discussed how impressions towards the robot varied depending on the expressions it performed and the personality traits of participants. This study contributes to the research field of human-robot interaction by demonstrating how adaptive facial expressions, in association with instruction styles, are linked to shaping human perceptions of social robots.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1728647"},"PeriodicalIF":3.0,"publicationDate":"2025-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12747908/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145879310","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From complexity to commercial readiness: industry insights on bridging gaps in human-robot interaction and social robot navigation. 从复杂性到商业就绪:关于弥合人机交互和社交机器人导航差距的行业见解。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-16 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1711675
Lina Moe, Benjamin Greenberg

This paper examines the evolving landscape of mobile robotics, focusing on challenges faced by roboticists working in industry when integrating robots into human-populated environments. Through interviews with sixteen industry professionals specializing in social mobile robotics, we examined two primary research questions: (1) What approaches to person detection and representation are used in industry? and (2) How does the relationship between industry and academia impact the research process? Our findings reveal diverse approaches to human detection, ranging from basic obstacle avoidance to advanced systems that differentiate among classes of humans. We suggest that robotic system design overall and human detection in particular are influenced by whether researchers use a framework of safety or sociality, how they approach building complex systems, and how they develop metrics for success. Additionally, we highlight the gaps and synergies between industry and academic research, particularly regarding commercial readiness and the incorporation of human-robot interaction (HRI) principles into robotic development. This study underscores the importance of addressing the complexities of social navigation in real-world settings and suggests that strengthening avenues of communication between industry and academia will help to shape a sustainable role for robots in the physical and social world.

本文研究了移动机器人的发展前景,重点关注机器人专家在将机器人集成到人类居住的环境中时所面临的挑战。通过对16位专门从事社交移动机器人的行业专业人士的访谈,我们研究了两个主要的研究问题:(1)行业中使用的人员检测和表示方法是什么?(2)产业界和学术界的关系如何影响研究过程?我们的研究结果揭示了人类检测的多种方法,从基本的避障到区分人类类别的高级系统。我们认为,机器人系统的整体设计,尤其是人类检测,受到研究人员是否使用安全或社会性框架、他们如何构建复杂系统以及他们如何制定成功指标的影响。此外,我们强调了工业和学术研究之间的差距和协同作用,特别是在商业准备和将人机交互(HRI)原则纳入机器人开发方面。这项研究强调了在现实世界中解决社会导航复杂性的重要性,并建议加强工业界和学术界之间的沟通渠道,将有助于塑造机器人在物理和社会世界中的可持续角色。
{"title":"From complexity to commercial readiness: industry insights on bridging gaps in human-robot interaction and social robot navigation.","authors":"Lina Moe, Benjamin Greenberg","doi":"10.3389/frobt.2025.1711675","DOIUrl":"10.3389/frobt.2025.1711675","url":null,"abstract":"<p><p>This paper examines the evolving landscape of mobile robotics, focusing on challenges faced by roboticists working in industry when integrating robots into human-populated environments. Through interviews with sixteen industry professionals specializing in social mobile robotics, we examined two primary research questions: (1) What approaches to person detection and representation are used in industry? and (2) How does the relationship between industry and academia impact the research process? Our findings reveal diverse approaches to human detection, ranging from basic obstacle avoidance to advanced systems that differentiate among classes of humans. We suggest that robotic system design overall and human detection in particular are influenced by whether researchers use a framework of safety or sociality, how they approach building complex systems, and how they develop metrics for success. Additionally, we highlight the gaps and synergies between industry and academic research, particularly regarding commercial readiness and the incorporation of human-robot interaction (HRI) principles into robotic development. This study underscores the importance of addressing the complexities of social navigation in real-world settings and suggests that strengthening avenues of communication between industry and academia will help to shape a sustainable role for robots in the physical and social world.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1711675"},"PeriodicalIF":3.0,"publicationDate":"2025-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12747840/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145879261","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Custom UAV with model predictive control for autonomous static and dynamic trajectory tracking in agricultural fields. 基于模型预测控制的无人机在农业领域的自主静态和动态轨迹跟踪。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-16 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1694952
Veera Venkata Ram Murali Krishna Rao Muvva, Kunjan Theodore Joseph, Yogesh Chawla, Santosh Pitla, Marilyn Wolf

Introduction: This study introduces a custom-built uncrewed aerial vehicle (UAV) designed for precision agriculture, emphasizing modularity, adaptability, and affordability. Unlike commercial UAVs restricted by proprietary systems, this platform offers full customization and advanced autonomy capabilities.

Methods: The UAV integrates a Cube Blue flight controller for low-level control with a Raspberry Pi 4 companion computer that runs a Model Predictive Control (MPC) algorithm for high-level trajectory optimization. Instead of conventional PID controllers, this work adopts an optimal control strategy using MPC. The system also incorporates Kalman filtering to enable adaptive mission planning and real-time coordination with a moving uncrewed ground vehicle (UGV). Testing was performed in both simulation and outdoor field environments, covering static and dynamic waypoint tracking as well as complex trajectories.

Results: The UAV performed figure-eight, curved, and wind-disturbed trajectories with root mean square error values consistently between 8 and 20 cm during autonomous operations, with slightly higher errors in more complex trajectories. The system successfully followed a moving UGV along nonlinear, curved paths.

Discussion: These results demonstrate that the proposed UAV platform is capable of precise autonomous navigation and real-time coordination, confirming its suitability for real-world agricultural applications and offering a flexible alternative to commercial UAV systems.

简介:本研究介绍了一种为精准农业设计的定制无人机(UAV),强调模块化、适应性和可负担性。与受专有系统限制的商用无人机不同,该平台提供了完全定制和先进的自主能力。方法:无人机集成了一个Cube Blue飞行控制器进行低级控制,以及一个运行模型预测控制(MPC)算法进行高级轨迹优化的树莓派4配套计算机。本文采用了一种基于MPC的最优控制策略,取代了传统的PID控制器。该系统还集成了卡尔曼滤波,以实现自适应任务规划和与移动无人地面车辆(UGV)的实时协调。测试在模拟和室外现场环境中进行,包括静态和动态航路点跟踪以及复杂的轨迹。结果:无人机在自主操作过程中执行了8字形、曲线和受风干扰的轨迹,均方根误差值始终在8 ~ 20 cm之间,在更复杂的轨迹中误差略高。该系统成功地沿着非线性曲线路径跟踪移动的UGV。讨论:这些结果表明,所提出的无人机平台能够精确自主导航和实时协调,确认其适用于实际农业应用,并为商用无人机系统提供灵活的替代方案。
{"title":"Custom UAV with model predictive control for autonomous static and dynamic trajectory tracking in agricultural fields.","authors":"Veera Venkata Ram Murali Krishna Rao Muvva, Kunjan Theodore Joseph, Yogesh Chawla, Santosh Pitla, Marilyn Wolf","doi":"10.3389/frobt.2025.1694952","DOIUrl":"10.3389/frobt.2025.1694952","url":null,"abstract":"<p><strong>Introduction: </strong>This study introduces a custom-built uncrewed aerial vehicle (UAV) designed for precision agriculture, emphasizing modularity, adaptability, and affordability. Unlike commercial UAVs restricted by proprietary systems, this platform offers full customization and advanced autonomy capabilities.</p><p><strong>Methods: </strong>The UAV integrates a Cube Blue flight controller for low-level control with a Raspberry Pi 4 companion computer that runs a Model Predictive Control (MPC) algorithm for high-level trajectory optimization. Instead of conventional PID controllers, this work adopts an optimal control strategy using MPC. The system also incorporates Kalman filtering to enable adaptive mission planning and real-time coordination with a moving uncrewed ground vehicle (UGV). Testing was performed in both simulation and outdoor field environments, covering static and dynamic waypoint tracking as well as complex trajectories.</p><p><strong>Results: </strong>The UAV performed figure-eight, curved, and wind-disturbed trajectories with root mean square error values consistently between 8 and 20 cm during autonomous operations, with slightly higher errors in more complex trajectories. The system successfully followed a moving UGV along nonlinear, curved paths.</p><p><strong>Discussion: </strong>These results demonstrate that the proposed UAV platform is capable of precise autonomous navigation and real-time coordination, confirming its suitability for real-world agricultural applications and offering a flexible alternative to commercial UAV systems.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1694952"},"PeriodicalIF":3.0,"publicationDate":"2025-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12747843/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145879244","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring companion robots for children with autism spectrum disorder: a reflexive thematic analysis in specialist dental care. 探索陪伴机器人为儿童自闭症谱系障碍:反身性专题分析在专业牙科护理。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-12 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1659784
Sofia Thunberg, Erik Lagerstedt, Anna Jönsson, Anna Lena Sundell

Introduction: As robotic technologies become increasingly integrated into care settings, it is critical to assess their impact within the complexity of real-world contexts. This exploratory study examines the introduction of a robot cat for children with Autism Spectrum Disorder (ASD) in a specialist dental care unit. Children with ASD often face challenges in dental care, including anxiety, sensory sensitivities, and difficulty with collaboration. The study investigates if a robot cat can provide psychosocial support to the patients.

Methods: Ten patients, aged 5-10, participated in the 12-months study, each undergoing one baseline session without the robot and 3-5 subsequent visits with the robot, yielding 37 sessions of video data.

Results: Reflexive thematic analysis revealed three key themes: the robot cat can enhance training and treatment, robot cats can serve as a beneficial but a non-essential tool, and robot cats can sometimes hinder progress in training and treatment. These findings highlight significant individual variation in how the robot was experienced, shaped by context, timing, and emotional state. The robot's role was not universally positive or passive; its effectiveness depended on how it was integrated into personalised care strategies by the dental hygienist, guardians, and the patients themselves.

Discussion: This study underscores the importance of tailoring technological interventions in care, advocating for cautious, context-sensitive use rather than one-size-fits-all solutions. Future work should further explore adaptive, individualised deployment.

导言:随着机器人技术越来越多地融入到护理环境中,评估它们在复杂的现实环境中的影响至关重要。本探索性研究探讨了引入机器猫儿童自闭症谱系障碍(ASD)在专科牙科护理单位。患有ASD的儿童在牙科护理中经常面临挑战,包括焦虑、感觉敏感和合作困难。这项研究调查了机器猫是否能为病人提供心理支持。方法:10例患者,年龄5-10岁,参加为期12个月的研究,每位患者进行1次无机器人基线期和3-5次有机器人随访期,获得37次视频数据。结果:反身性主题分析揭示了三个关键主题:机器猫可以促进训练和治疗,机器猫可以作为有益但非必要的工具,机器猫有时会阻碍训练和治疗的进展。这些发现强调了机器人在经历、环境、时间和情绪状态方面的显著个体差异。机器人的角色并不总是积极或被动;它的有效性取决于它如何被牙科保健师、监护人和患者自己整合到个性化护理策略中。讨论:本研究强调了在护理中定制技术干预的重要性,倡导谨慎、根据具体情况使用技术干预,而不是一刀切的解决方案。未来的工作应进一步探索自适应、个性化部署。
{"title":"Exploring companion robots for children with autism spectrum disorder: a reflexive thematic analysis in specialist dental care.","authors":"Sofia Thunberg, Erik Lagerstedt, Anna Jönsson, Anna Lena Sundell","doi":"10.3389/frobt.2025.1659784","DOIUrl":"10.3389/frobt.2025.1659784","url":null,"abstract":"<p><strong>Introduction: </strong>As robotic technologies become increasingly integrated into care settings, it is critical to assess their impact within the complexity of real-world contexts. This exploratory study examines the introduction of a robot cat for children with Autism Spectrum Disorder (ASD) in a specialist dental care unit. Children with ASD often face challenges in dental care, including anxiety, sensory sensitivities, and difficulty with collaboration. The study investigates if a robot cat can provide psychosocial support to the patients.</p><p><strong>Methods: </strong>Ten patients, aged 5-10, participated in the 12-months study, each undergoing one baseline session without the robot and 3-5 subsequent visits with the robot, yielding 37 sessions of video data.</p><p><strong>Results: </strong>Reflexive thematic analysis revealed three key themes: the robot cat can <i>enhance training and treatment</i>, robot cats can serve as a <i>beneficial but a non-essential tool</i>, and robot cats can sometimes <i>hinder progress in training and treatment</i>. These findings highlight significant individual variation in how the robot was experienced, shaped by context, timing, and emotional state. The robot's role was not universally positive or passive; its effectiveness depended on how it was integrated into personalised care strategies by the dental hygienist, guardians, and the patients themselves.</p><p><strong>Discussion: </strong>This study underscores the importance of tailoring technological interventions in care, advocating for cautious, context-sensitive use rather than one-size-fits-all solutions. Future work should further explore adaptive, individualised deployment.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1659784"},"PeriodicalIF":3.0,"publicationDate":"2025-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12740894/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145851141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editorial: Theory of mind in robots and intelligent systems. 社论:机器人和智能系统中的心智理论。
IF 3 Q2 ROBOTICS Pub Date : 2025-12-11 eCollection Date: 2025-01-01 DOI: 10.3389/frobt.2025.1750134
Nikolos Gurney, Dana Hughes, David V Pynadath, Ning Wang
{"title":"Editorial: Theory of mind in robots and intelligent systems.","authors":"Nikolos Gurney, Dana Hughes, David V Pynadath, Ning Wang","doi":"10.3389/frobt.2025.1750134","DOIUrl":"10.3389/frobt.2025.1750134","url":null,"abstract":"","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":"12 ","pages":"1750134"},"PeriodicalIF":3.0,"publicationDate":"2025-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12738163/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145851205","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Frontiers in Robotics and AI
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1