首页 > 最新文献

Frontiers in Robotics and AI最新文献

英文 中文
Handheld robotic device for endoscopic neurosurgery: system integration and pre-clinical evaluation 用于内窥镜神经外科手术的手持式机器人设备:系统集成和临床前评估
IF 3.4 Q2 Computer Science Pub Date : 2024-06-05 DOI: 10.3389/frobt.2024.1400017
E. Dimitrakakis, G. Dwyer, Nicola Newall, Danyal Z. Khan, Hani J. Marcus, Danail Stoyanov
The Expanded Endoscopic Endonasal Approach, one of the best examples of endoscopic neurosurgery, allows access to the skull base through the natural orifice of the nostril. Current standard instruments lack articulation limiting operative access and surgeon dexterity, and thus, could benefit from robotic articulation. In this study, a handheld robotic system with a series of detachable end-effectors for this approach is presented. This system is comprised of interchangeable articulated 2/3 degrees-of-freedom 3 mm instruments that expand the operative workspace and enhance the surgeon’s dexterity, an ergonomically designed handheld controller with a rotating joystick-body that can be placed at the position most comfortable for the user, and the accompanying control box. The robotic instruments were experimentally evaluated for their workspace, structural integrity, and force-delivery capabilities. The entire system was then tested in a pre-clinical context during a phantom feasibility test, followed up by a cadaveric pilot study by a cohort of surgeons of varied clinical experience. Results from this series of experiments suggested enhanced dexterity and adequate robustness that could be associated with feasibility in a clinical context, as well as improvement over current neurosurgical instruments.
扩展内窥镜鼻内孔入路是内窥镜神经外科手术的最佳范例之一,可通过鼻孔的自然孔道进入颅底。目前的标准器械缺乏衔接,限制了手术通道和外科医生的灵巧性,因此机器人衔接器械可从中受益。本研究介绍了一种手持式机器人系统,该系统带有一系列可拆卸的末端执行器,适用于这种方法。该系统由可互换的铰接式 2/3 自由度 3 毫米器械、符合人体工程学设计的手持控制器和配套的控制盒组成,前者可扩大手术工作空间,提高外科医生的灵活性,后者带有旋转操纵杆主体,可放置在用户最舒适的位置。实验对机器人器械的工作空间、结构完整性和施力能力进行了评估。然后,整个系统在临床前的模型可行性测试中进行了测试,随后由一批具有不同临床经验的外科医生进行了尸体试验研究。这一系列实验的结果表明,该系统具有更高的灵巧性和足够的坚固性,在临床应用中具有可行性,而且与目前的神经外科器械相比也有所改进。
{"title":"Handheld robotic device for endoscopic neurosurgery: system integration and pre-clinical evaluation","authors":"E. Dimitrakakis, G. Dwyer, Nicola Newall, Danyal Z. Khan, Hani J. Marcus, Danail Stoyanov","doi":"10.3389/frobt.2024.1400017","DOIUrl":"https://doi.org/10.3389/frobt.2024.1400017","url":null,"abstract":"The Expanded Endoscopic Endonasal Approach, one of the best examples of endoscopic neurosurgery, allows access to the skull base through the natural orifice of the nostril. Current standard instruments lack articulation limiting operative access and surgeon dexterity, and thus, could benefit from robotic articulation. In this study, a handheld robotic system with a series of detachable end-effectors for this approach is presented. This system is comprised of interchangeable articulated 2/3 degrees-of-freedom 3 mm instruments that expand the operative workspace and enhance the surgeon’s dexterity, an ergonomically designed handheld controller with a rotating joystick-body that can be placed at the position most comfortable for the user, and the accompanying control box. The robotic instruments were experimentally evaluated for their workspace, structural integrity, and force-delivery capabilities. The entire system was then tested in a pre-clinical context during a phantom feasibility test, followed up by a cadaveric pilot study by a cohort of surgeons of varied clinical experience. Results from this series of experiments suggested enhanced dexterity and adequate robustness that could be associated with feasibility in a clinical context, as well as improvement over current neurosurgical instruments.","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141385440","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A systematic review of collaborative robots for nurses: where are we now, and where is the evidence? 护士协作机器人系统综述:现状与证据?
IF 3.4 Q2 Computer Science Pub Date : 2024-06-05 DOI: 10.3389/frobt.2024.1398140
Grace Titilayo Babalola, Jenna-Marie Gaston, Joseph Trombetta, Stephanie Tulk Jesso
Introduction: Robots present an opportunity to enhance healthcare delivery. Rather than targeting complete automation and nurse replacement, collaborative robots, or “cobots”, might be designed to allow nurses to focus on high-value caregiving. While many institutions are now investing in these platforms, there is little publicly available data on how cobots are being developed, implemented, and evaluated to determine if and how they support nursing practice in the real world.Methods: This systematic review investigates the current state of cobotic technologies designed to assist nurses in hospital settings, their intended applications, and impacts on nurses and patient care. A comprehensive database search identified 28 relevant peer-reviewed articles published since 2018 which involve real studies with robotic platforms in simulated or actual clinical contexts.Results: Few cobots were explicitly designed to reduce nursing workload through administrative or logistical assistance. Most included studies were designed as patient-centered rather than nurse-centered, but included assistance for tasks like medication delivery, vital monitoring, and social interaction. Most applications emerged from India, with limited evidence from the United States despite commercial availability of nurse-assistive cobots. Robots ranged from proof-of-concept to commercially deployed systems.Discussion: This review highlights the need for further published studies on cobotic development and evaluation. A larger body of evidence is needed to recognize current limitations and pragmatic opportunities to assist nurses and patients using state-of-the-art robotics. Human-centered design can assist in discovering the right opportunities for cobotic assistance. Committed research-practice partnerships and human-centered design are needed to guide the technical development of nurse-centered cobotic solutions.
简介机器人为改善医疗服务提供了机遇。协作机器人(或称 "cobots")的设计目标不是完全自动化和取代护士,而是让护士能够专注于高价值的护理工作。虽然许多机构现在都在投资这些平台,但关于如何开发、实施和评估协作机器人,以确定它们是否以及如何在现实世界中支持护理实践,公开可用的数据却很少:本系统性综述调查了旨在协助医院护士的协作机器人技术的现状、预期应用以及对护士和患者护理的影响。通过全面的数据库搜索,确定了自 2018 年以来发表的 28 篇相关同行评审文章,这些文章涉及在模拟或实际临床环境中使用机器人平台的真实研究:很少有共同机器人明确旨在通过行政或后勤协助来减少护理工作量。大多数纳入的研究都是以患者为中心而不是以护士为中心设计的,但包括对药物输送、生命体征监测和社交互动等任务的协助。大多数应用出现在印度,美国的证据有限,尽管有商业化的护士辅助机器人。机器人的应用范围从概念验证到商业部署系统不等:讨论:本综述强调了对共生机器人开发和评估进行进一步公开研究的必要性。需要更多的证据来认识当前的局限性以及利用最先进的机器人技术为护士和患者提供帮助的实际机会。以人为本的设计可以帮助我们发现协作机器人辅助的正确机会。需要致力于研究与实践的合作以及以人为本的设计,以指导以护士为中心的协作机器人解决方案的技术开发。
{"title":"A systematic review of collaborative robots for nurses: where are we now, and where is the evidence?","authors":"Grace Titilayo Babalola, Jenna-Marie Gaston, Joseph Trombetta, Stephanie Tulk Jesso","doi":"10.3389/frobt.2024.1398140","DOIUrl":"https://doi.org/10.3389/frobt.2024.1398140","url":null,"abstract":"Introduction: Robots present an opportunity to enhance healthcare delivery. Rather than targeting complete automation and nurse replacement, collaborative robots, or “cobots”, might be designed to allow nurses to focus on high-value caregiving. While many institutions are now investing in these platforms, there is little publicly available data on how cobots are being developed, implemented, and evaluated to determine if and how they support nursing practice in the real world.Methods: This systematic review investigates the current state of cobotic technologies designed to assist nurses in hospital settings, their intended applications, and impacts on nurses and patient care. A comprehensive database search identified 28 relevant peer-reviewed articles published since 2018 which involve real studies with robotic platforms in simulated or actual clinical contexts.Results: Few cobots were explicitly designed to reduce nursing workload through administrative or logistical assistance. Most included studies were designed as patient-centered rather than nurse-centered, but included assistance for tasks like medication delivery, vital monitoring, and social interaction. Most applications emerged from India, with limited evidence from the United States despite commercial availability of nurse-assistive cobots. Robots ranged from proof-of-concept to commercially deployed systems.Discussion: This review highlights the need for further published studies on cobotic development and evaluation. A larger body of evidence is needed to recognize current limitations and pragmatic opportunities to assist nurses and patients using state-of-the-art robotics. Human-centered design can assist in discovering the right opportunities for cobotic assistance. Committed research-practice partnerships and human-centered design are needed to guide the technical development of nurse-centered cobotic solutions.","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141383898","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Visuo-dynamic self-modelling of soft robotic systems 软机器人系统的视觉动态自建模
IF 3.4 Q2 Computer Science Pub Date : 2024-06-05 DOI: 10.3389/frobt.2024.1403733
Richard Marques Monteiro, Jialei Shi, Helge A. Wurdemann, F. Iida, Thomas George Thuruthel
Soft robots exhibit complex nonlinear dynamics with large degrees of freedom, making their modelling and control challenging. Typically, reduced-order models in time or space are used in addressing these challenges, but the resulting simplification limits soft robot control accuracy and restricts their range of motion. In this work, we introduce an end-to-end learning-based approach for fully dynamic modelling of any general robotic system that does not rely on predefined structures, learning dynamic models of the robot directly in the visual space. The generated models possess identical dimensionality to the observation space, resulting in models whose complexity is determined by the sensory system without explicitly decomposing the problem. To validate the effectiveness of our proposed method, we apply it to a fully soft robotic manipulator, and we demonstrate its applicability in controller development through an open-loop optimization-based controller. We achieve a wide range of dynamic control tasks including shape control, trajectory tracking and obstacle avoidance using a model derived from just 90 min of real-world data. Our work thus far provides the most comprehensive strategy for controlling a general soft robotic system, without constraints on the shape, properties, or dimensionality of the system.
软体机器人具有复杂的非线性动力学特性和较大的自由度,因此其建模和控制具有挑战性。在应对这些挑战时,通常会使用时间或空间的降阶模型,但由此产生的简化限制了软体机器人的控制精度,并限制了它们的运动范围。在这项工作中,我们引入了一种基于端到端学习的方法,用于对任何通用机器人系统进行全动态建模,这种方法不依赖于预定义结构,而是直接在视觉空间中学习机器人的动态模型。生成的模型具有与观测空间相同的维度,因此模型的复杂性由感知系统决定,无需明确分解问题。为了验证我们所提方法的有效性,我们将其应用于一个全软机器人机械手,并通过一个基于开环优化的控制器展示了该方法在控制器开发中的适用性。我们利用从仅 90 分钟的真实世界数据中得出的模型实现了广泛的动态控制任务,包括形状控制、轨迹跟踪和避障。迄今为止,我们的工作为控制通用软体机器人系统提供了最全面的策略,而且不受系统形状、属性或维度的限制。
{"title":"Visuo-dynamic self-modelling of soft robotic systems","authors":"Richard Marques Monteiro, Jialei Shi, Helge A. Wurdemann, F. Iida, Thomas George Thuruthel","doi":"10.3389/frobt.2024.1403733","DOIUrl":"https://doi.org/10.3389/frobt.2024.1403733","url":null,"abstract":"Soft robots exhibit complex nonlinear dynamics with large degrees of freedom, making their modelling and control challenging. Typically, reduced-order models in time or space are used in addressing these challenges, but the resulting simplification limits soft robot control accuracy and restricts their range of motion. In this work, we introduce an end-to-end learning-based approach for fully dynamic modelling of any general robotic system that does not rely on predefined structures, learning dynamic models of the robot directly in the visual space. The generated models possess identical dimensionality to the observation space, resulting in models whose complexity is determined by the sensory system without explicitly decomposing the problem. To validate the effectiveness of our proposed method, we apply it to a fully soft robotic manipulator, and we demonstrate its applicability in controller development through an open-loop optimization-based controller. We achieve a wide range of dynamic control tasks including shape control, trajectory tracking and obstacle avoidance using a model derived from just 90 min of real-world data. Our work thus far provides the most comprehensive strategy for controlling a general soft robotic system, without constraints on the shape, properties, or dimensionality of the system.","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141383263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
How did COVID-19 pandemic affect the older adults’ needs for robot technologies in Japan?: comparison of participatory design workshops during versus after the COVID-19 pandemic COVID-19 大流行如何影响日本老年人对机器人技术的需求?
IF 3.4 Q2 Computer Science Pub Date : 2024-06-04 DOI: 10.3389/frobt.2024.1363243
Takanori Komatsu, Marlena R. Fraune, Katherine M. Tsui, Shogo Suda, Mizuki Kobayashi
Social technology can improve the quality of social lives of older adults (OAs) and mitigate negative mental and physical health outcomes. When people engage with technology, they can do so to stimulate social interaction (stimulation hypothesis) or disengage from their real world (disengagement hypothesis), according to Nowland et al.‘s model of the relationship between social Internet use and loneliness. External events, such as large periods of social isolation like during the COVID-19 pandemic, can also affect whether people use technology in line with the stimulation or disengagement hypothesis. We examined how the COVID-19 pandemic affected the social challenges OAs faced and their expectations for robot technology to solve their challenges. We conducted two participatory design (PD) workshops with OAs during and after the COVID-19 pandemic. During the pandemic, OAs’ primary concern was distanced communication with family members, with a prevalent desire to assist them through technology. They also wanted to share experiences socially, as such OA’s attitude toward technology could be explained mostly by the stimulation hypothesis. However, after COVID-19 the pandemic, their focus shifted towards their own wellbeing. Social isolation and loneliness were already significant issues for OAs, and these were exacerbated by the COVID-19 pandemic. Therefore, such OAs’ attitudes toward technology after the pandemic could be explained mostly by the disengagement hypothesis. This clearly reflect the OA’s current situation that they have been getting further digitally excluded due to rapid technological development during the pandemic. Both during and after the pandemic, OAs found it important to have technologies that were easy to use, which would reduce their digital exclusion. After the pandemic, we found this especially in relation to newly developed technologies meant to help people keep at a distance. To effectively integrate these technologies and avoid excluding large parts of the population, society must address the social challenges faced by OAs.
社交技术可以提高老年人(OAs)的社交生活质量,减轻对身心健康的负面影响。根据 Nowland 等人关于社交网络使用与孤独感之间关系的模型,当人们使用技术时,他们可能是为了刺激社交互动(刺激假说),也可能是为了脱离现实世界(脱离假说)。外部事件,如 COVID-19 大流行期间的大规模社会隔离,也会影响人们是按照刺激假说还是脱离假说使用技术。我们研究了 COVID-19 大流行如何影响 OA 所面临的社会挑战以及他们对机器人技术解决其挑战的期望。在 COVID-19 大流行期间和之后,我们与 OA 进行了两次参与式设计(PD)研讨会。在大流行期间,OA们最关心的问题是与家人的沟通距离,普遍希望通过技术来帮助他们。他们还希望在社交场合分享经验,因此 OA 对技术的态度主要可以用刺激假说来解释。然而,在 COVID-19 大流行之后,他们的关注点转向了自身的福祉。对于 OA 来说,社会隔离和孤独感本已是重大问题,而 COVID-19 大流行则加剧了这些问题。因此,这些 OA 在大流行后对科技的态度主要可以用脱离假说来解释。这清楚地反映了 OA 的现状,即在大流行期间,由于科技的快速发展,他们被进一步排除在数字世界之外。无论是在大流行期间还是之后,OA 都认为拥有易于使用的技术非常重要,这将减少他们的数字排斥。在大流行之后,我们发现新开发的旨在帮助人们保持距离的技术尤其如此。为了有效整合这些技术,避免排斥大部分人口,社会必须解决 OA 所面临的社会挑战。
{"title":"How did COVID-19 pandemic affect the older adults’ needs for robot technologies in Japan?: comparison of participatory design workshops during versus after the COVID-19 pandemic","authors":"Takanori Komatsu, Marlena R. Fraune, Katherine M. Tsui, Shogo Suda, Mizuki Kobayashi","doi":"10.3389/frobt.2024.1363243","DOIUrl":"https://doi.org/10.3389/frobt.2024.1363243","url":null,"abstract":"Social technology can improve the quality of social lives of older adults (OAs) and mitigate negative mental and physical health outcomes. When people engage with technology, they can do so to stimulate social interaction (stimulation hypothesis) or disengage from their real world (disengagement hypothesis), according to Nowland et al.‘s model of the relationship between social Internet use and loneliness. External events, such as large periods of social isolation like during the COVID-19 pandemic, can also affect whether people use technology in line with the stimulation or disengagement hypothesis. We examined how the COVID-19 pandemic affected the social challenges OAs faced and their expectations for robot technology to solve their challenges. We conducted two participatory design (PD) workshops with OAs during and after the COVID-19 pandemic. During the pandemic, OAs’ primary concern was distanced communication with family members, with a prevalent desire to assist them through technology. They also wanted to share experiences socially, as such OA’s attitude toward technology could be explained mostly by the stimulation hypothesis. However, after COVID-19 the pandemic, their focus shifted towards their own wellbeing. Social isolation and loneliness were already significant issues for OAs, and these were exacerbated by the COVID-19 pandemic. Therefore, such OAs’ attitudes toward technology after the pandemic could be explained mostly by the disengagement hypothesis. This clearly reflect the OA’s current situation that they have been getting further digitally excluded due to rapid technological development during the pandemic. Both during and after the pandemic, OAs found it important to have technologies that were easy to use, which would reduce their digital exclusion. After the pandemic, we found this especially in relation to newly developed technologies meant to help people keep at a distance. To effectively integrate these technologies and avoid excluding large parts of the population, society must address the social challenges faced by OAs.","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141266913","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Max Well-Being: a modular platform for the gamification of rehabilitation. Max Well-Being:康复游戏化模块平台。
IF 3.4 Q2 Computer Science Pub Date : 2024-05-31 eCollection Date: 2024-01-01 DOI: 10.3389/frobt.2024.1382157
Maxwell Kennard, Modar Hassan, Yukiyo Shimizu, Kenji Suzuki

This study proposes a modular platform to improve the adoption of gamification in conventional physical rehabilitation programs. The effectiveness of rehabilitation is correlated to a patient's adherence to the program. This adherence can be diminished due to factors such as motivation, feedback, and isolation. Gamification is a means of adding game-like elements to a traditionally non-game activity. This has been shown to be effective in providing a more engaging experience and improving adherence. The platform is made of three main parts; a central hardware hub, various wired and wireless sensors, and a software program with a stream-lined user interface. The software interface and hardware peripherals were all designed to be simple to use by either a medical specialist or an end-user patient without the need for technical training. A usability study was performed using a group of university students and a group of medical specialists. Using the System Usability Scale, the system received an average score of 69.25 ± 20.14 and 72.5 ± 17.16 by the students and medical specialists, respectively. We also present a framework that attempts to assist in selecting commercial games that are viable for physical rehabilitation.

本研究提出了一个模块化平台,以改进传统物理康复计划中游戏化的采用。康复的效果与患者对项目的坚持程度相关。由于动机、反馈和隔离等因素,患者的坚持性可能会降低。游戏化是在传统的非游戏活动中加入游戏元素的一种手段。事实证明,这种方法能有效地提供更具吸引力的体验,并提高坚持率。该平台由三个主要部分组成:一个中央硬件枢纽、各种有线和无线传感器以及一个具有精简用户界面的软件程序。软件界面和硬件外围设备都设计得简单易用,无论是医学专家还是最终用户病人都无需接受技术培训。对一组大学生和一组医学专家进行了可用性研究。使用系统可用性量表,学生和医学专家对系统的平均评分分别为 69.25 ± 20.14 和 72.5 ± 17.16。我们还提出了一个框架,试图帮助选择适用于身体康复的商业游戏。
{"title":"Max Well-Being: a modular platform for the gamification of rehabilitation.","authors":"Maxwell Kennard, Modar Hassan, Yukiyo Shimizu, Kenji Suzuki","doi":"10.3389/frobt.2024.1382157","DOIUrl":"10.3389/frobt.2024.1382157","url":null,"abstract":"<p><p>This study proposes a modular platform to improve the adoption of gamification in conventional physical rehabilitation programs. The effectiveness of rehabilitation is correlated to a patient's adherence to the program. This adherence can be diminished due to factors such as motivation, feedback, and isolation. Gamification is a means of adding game-like elements to a traditionally non-game activity. This has been shown to be effective in providing a more engaging experience and improving adherence. The platform is made of three main parts; a central hardware hub, various wired and wireless sensors, and a software program with a stream-lined user interface. The software interface and hardware peripherals were all designed to be simple to use by either a medical specialist or an end-user patient without the need for technical training. A usability study was performed using a group of university students and a group of medical specialists. Using the System Usability Scale, the system received an average score of 69.25 ± 20.14 and 72.5 ± 17.16 by the students and medical specialists, respectively. We also present a framework that attempts to assist in selecting commercial games that are viable for physical rehabilitation.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11176482/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141332279","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Haptic based fundamentals of laparoscopic surgery simulation for training with objective assessments. 以触觉为基础的腹腔镜手术模拟训练与客观评估。
IF 3.4 Q2 Computer Science Pub Date : 2024-05-30 eCollection Date: 2024-01-01 DOI: 10.3389/frobt.2024.1363952
P Abinaya, M Manivannan

Force is crucial for learning psychomotor skills in laparoscopic tissue manipulation. Fundamental laparoscopic surgery (FLS), on the other hand, only measures time and position accuracy. FLS is a commonly used training program for basic laparoscopic training through part tasks. The FLS is employed in most of the laparoscopic training systems, including box trainers and virtual reality (VR) simulators. However, many laparoscopic VR simulators lack force feedback and measure tissue damage solely through visual feedback based on virtual collisions. Few VR simulators that provide force feedback have subjective force metrics. To provide an objective force assessment for haptic skills training in the VR simulators, we extend the FLS part tasks to haptic-based FLS (HFLS), focusing on controlled force exertion. We interface the simulated HFLS part tasks with a customized bi-manual haptic simulator that offers five degrees of freedom (DOF) for force feedback. The proposed tasks are evaluated through face and content validity among laparoscopic surgeons of varying experience levels. The results show that trainees perform better in HFLS tasks. The average Likert score observed for face and content validity is greater than 4.6 ± 0.3 and 4 ± 0.5 for all the part tasks, which indicates the acceptance of the simulator among subjects for its appearance and functionality. Face and content validations show the need to improve haptic realism, which is also observed in existing simulators. To enhance the accuracy of force rendering, we incorporated a laparoscopic tool force model into the simulation. We study the effectiveness of the model through a psychophysical study that measures just noticeable difference (JND) for the laparoscopic gripping task. The study reveals an insignificant decrease in gripping-force JND. A simple linear model could be sufficient for gripper force feedback, and a non-linear LapTool force model does not affect the force perception for the force range of 0.5-2.5 N. Further study is required to understand the usability of the force model in laparoscopic training at a higher force range. Additionally, the construct validity of HFLS will confirm the applicability of the developed simulator to train surgeons with different levels of experience.

力量对于学习腹腔镜组织操作的心理运动技能至关重要。而基础腹腔镜手术(FLS)只测量时间和位置的准确性。FLS 是通过部分任务进行腹腔镜基础训练的常用训练项目。大多数腹腔镜训练系统都采用了 FLS,包括箱式训练器和虚拟现实(VR)模拟器。然而,许多腹腔镜 VR 模拟器缺乏力反馈,仅通过基于虚拟碰撞的视觉反馈来测量组织损伤。提供力反馈的 VR 模拟器很少有主观力指标。为了在 VR 模拟器中为触觉技能培训提供客观的力评估,我们将 FLS 部分任务扩展到基于触觉的 FLS(HFLS),重点关注可控的施力。我们将模拟的 HFLS 零件任务与定制的双手动触觉模拟器连接起来,该模拟器提供五个自由度(DOF)用于力反馈。我们在具有不同经验水平的腹腔镜外科医生中对所提出的任务进行了面效和内容效度评估。结果表明,学员在 HFLS 任务中的表现更好。在所有部分任务中,面效和内容效度的平均 Likert 得分分别大于 4.6 ± 0.3 和 4 ± 0.5,这表明受试者对模拟器的外观和功能都很认可。面效度和内容效度表明,有必要提高触觉真实度,这在现有模拟器中也有体现。为了提高力渲染的准确性,我们在模拟器中加入了腹腔镜工具力模型。我们通过一项心理物理研究来研究该模型的有效性,该研究测量了腹腔镜抓取任务中的明显差异(JND)。研究结果表明,抓取力 JND 的下降并不明显。简单的线性模型足以满足抓取力反馈的要求,而非线性 LapTool 力模型在 0.5-2.5 N 的力范围内不会影响力感知。此外,HFLS 的构造效度将确认所开发的模拟器是否适用于培训具有不同经验水平的外科医生。
{"title":"Haptic based fundamentals of laparoscopic surgery simulation for training with objective assessments.","authors":"P Abinaya, M Manivannan","doi":"10.3389/frobt.2024.1363952","DOIUrl":"10.3389/frobt.2024.1363952","url":null,"abstract":"<p><p>Force is crucial for learning psychomotor skills in laparoscopic tissue manipulation. Fundamental laparoscopic surgery (FLS), on the other hand, only measures time and position accuracy. FLS is a commonly used training program for basic laparoscopic training through part tasks. The FLS is employed in most of the laparoscopic training systems, including box trainers and virtual reality (VR) simulators. However, many laparoscopic VR simulators lack force feedback and measure tissue damage solely through visual feedback based on virtual collisions. Few VR simulators that provide force feedback have subjective force metrics. To provide an objective force assessment for haptic skills training in the VR simulators, we extend the FLS part tasks to haptic-based FLS (HFLS), focusing on controlled force exertion. We interface the simulated HFLS part tasks with a customized bi-manual haptic simulator that offers five degrees of freedom (DOF) for force feedback. The proposed tasks are evaluated through face and content validity among laparoscopic surgeons of varying experience levels. The results show that trainees perform better in HFLS tasks. The average Likert score observed for face and content validity is greater than 4.6 ± 0.3 and 4 ± 0.5 for all the part tasks, which indicates the acceptance of the simulator among subjects for its appearance and functionality. Face and content validations show the need to improve haptic realism, which is also observed in existing simulators. To enhance the accuracy of force rendering, we incorporated a laparoscopic tool force model into the simulation. We study the effectiveness of the model through a psychophysical study that measures just noticeable difference (JND) for the laparoscopic gripping task. The study reveals an insignificant decrease in gripping-force JND. A simple linear model could be sufficient for gripper force feedback, and a non-linear LapTool force model does not affect the force perception for the force range of 0.5-2.5 N. Further study is required to understand the usability of the force model in laparoscopic training at a higher force range. Additionally, the construct validity of HFLS will confirm the applicability of the developed simulator to train surgeons with different levels of experience.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11170034/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141318608","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Flow in human-robot collaboration-multimodal analysis and perceived challenge detection in industrial scenarios. 人机协作中的流程--工业场景中的多模式分析和感知挑战检测。
IF 3.4 Q2 Computer Science Pub Date : 2024-05-30 eCollection Date: 2024-01-01 DOI: 10.3389/frobt.2024.1393795
Pooja Prajod, Matteo Lavit Nicora, Marta Mondellini, Matteo Meregalli Falerni, Rocco Vertechy, Matteo Malosio, Elisabeth André

Introduction: Flow state, the optimal experience resulting from the equilibrium between perceived challenge and skill level, has been extensively studied in various domains. However, its occurrence in industrial settings has remained relatively unexplored. Notably, the literature predominantly focuses on Flow within mentally demanding tasks, which differ significantly from industrial tasks. Consequently, our understanding of emotional and physiological responses to varying challenge levels, specifically in the context of industry-like tasks, remains limited. Methods: To bridge this gap, we investigate how facial emotion estimation (valence, arousal) and Heart Rate Variability (HRV) features vary with the perceived challenge levels during industrial assembly tasks. Our study involves an assembly scenario that simulates an industrial human-robot collaboration task with three distinct challenge levels. As part of our study, we collected video, electrocardiogram (ECG), and NASA-TLX questionnaire data from 37 participants. Results: Our results demonstrate a significant difference in mean arousal and heart rate between the low-challenge (Boredom) condition and the other conditions. We also found a noticeable trend-level difference in mean heart rate between the adaptive (Flow) and high-challenge (Anxiety) conditions. Similar differences were also observed in a few other temporal HRV features like Mean NN and Triangular index. Considering the characteristics of typical industrial assembly tasks, we aim to facilitate Flow by detecting and balancing the perceived challenge levels. Leveraging our analysis results, we developed an HRV-based machine learning model for discerning perceived challenge levels, distinguishing between low and higher-challenge conditions. Discussion: This work deepens our understanding of emotional and physiological responses to perceived challenge levels in industrial contexts and provides valuable insights for the design of adaptive work environments.

导言流状态是由感知到的挑战和技能水平之间的平衡所产生的最佳体验,已在多个领域得到广泛研究。然而,在工业环境中出现这种状态的情况还相对较少。值得注意的是,文献主要关注的是精神要求较高的任务中的 "流",这与工业任务有很大不同。因此,我们对不同挑战水平下的情绪和生理反应的了解仍然有限,特别是在类似工业任务的背景下。研究方法为了弥补这一不足,我们研究了在工业装配任务中,面部情绪估计(情绪价值、唤醒)和心率变异(HRV)特征如何随感知到的挑战水平而变化。我们的研究涉及一个装配场景,该场景模拟了具有三种不同挑战水平的工业人机协作任务。作为研究的一部分,我们收集了 37 名参与者的视频、心电图和 NASA-TLX 问卷数据。研究结果我们的研究结果表明,低挑战(无聊)条件与其他条件下的平均唤醒度和心率存在明显差异。我们还发现,适应(流动)和高挑战(焦虑)条件下的平均心率存在明显的趋势性差异。在其他一些时间心率变异特征(如平均 NN 和三角指数)中也观察到了类似的差异。考虑到典型工业装配任务的特点,我们的目标是通过检测和平衡感知到的挑战水平来促进 "流"。利用我们的分析结果,我们开发了一个基于心率变异的机器学习模型,用于辨别感知挑战水平,区分低挑战和高挑战条件。讨论:这项工作加深了我们对工业环境中感知挑战水平的情绪和生理反应的理解,为设计适应性工作环境提供了宝贵的见解。
{"title":"Flow in human-robot collaboration-multimodal analysis and perceived challenge detection in industrial scenarios.","authors":"Pooja Prajod, Matteo Lavit Nicora, Marta Mondellini, Matteo Meregalli Falerni, Rocco Vertechy, Matteo Malosio, Elisabeth André","doi":"10.3389/frobt.2024.1393795","DOIUrl":"10.3389/frobt.2024.1393795","url":null,"abstract":"<p><p><b>Introduction:</b> Flow state, the optimal experience resulting from the equilibrium between perceived challenge and skill level, has been extensively studied in various domains. However, its occurrence in industrial settings has remained relatively unexplored. Notably, the literature predominantly focuses on Flow within mentally demanding tasks, which differ significantly from industrial tasks. Consequently, our understanding of emotional and physiological responses to varying challenge levels, specifically in the context of industry-like tasks, remains limited. <b>Methods:</b> To bridge this gap, we investigate how facial emotion estimation (valence, arousal) and Heart Rate Variability (HRV) features vary with the perceived challenge levels during industrial assembly tasks. Our study involves an assembly scenario that simulates an industrial human-robot collaboration task with three distinct challenge levels. As part of our study, we collected video, electrocardiogram (ECG), and NASA-TLX questionnaire data from 37 participants. <b>Results:</b> Our results demonstrate a significant difference in mean arousal and heart rate between the low-challenge (Boredom) condition and the other conditions. We also found a noticeable trend-level difference in mean heart rate between the adaptive (Flow) and high-challenge (Anxiety) conditions. Similar differences were also observed in a few other temporal HRV features like Mean NN and Triangular index. Considering the characteristics of typical industrial assembly tasks, we aim to facilitate Flow by detecting and balancing the perceived challenge levels. Leveraging our analysis results, we developed an HRV-based machine learning model for discerning perceived challenge levels, distinguishing between low and higher-challenge conditions. <b>Discussion:</b> This work deepens our understanding of emotional and physiological responses to perceived challenge levels in industrial contexts and provides valuable insights for the design of adaptive work environments.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11169730/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141318607","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Applications of a vacuum-actuated multi-material hybrid soft gripper: lessons learnt from RoboSoft manipulation challenge. 真空驱动多材料混合软抓手的应用:从 RoboSoft 操纵挑战中汲取的经验教训。
IF 3.4 Q2 Computer Science Pub Date : 2024-05-28 eCollection Date: 2024-01-01 DOI: 10.3389/frobt.2024.1356692
Saikrishna Dontu, Elgar Kanhere, Thileepan Stalin, Audelia Gumarus Dharmawan, Chidanand Hegde, Jiangtao Su, Xiaodong Chen, Shlomo Magdassi, Gim Song Soh, Pablo Valdivia Y Alvarado

Soft grippers are garnering increasing attention for their adeptness in conforming to diverse objects, particularly delicate items, without warranting precise force control. This attribute proves especially beneficial in unstructured environments and dynamic tasks such as food handling. Human hands, owing to their elevated dexterity and precise motor control, exhibit the ability to delicately manipulate complex food items, such as small or fragile objects, by dynamically adjusting their grasping configurations. Furthermore, with their rich sensory receptors and hand-eye coordination that provide valuable information involving the texture and form factor, real-time adjustments to avoid damage or spill during food handling appear seamless. Despite numerous endeavors to replicate these capabilities through robotic solutions involving soft grippers, matching human performance remains a formidable engineering challenge. Robotic competitions serve as an invaluable platform for pushing the boundaries of manipulation capabilities, simultaneously offering insights into the adoption of these solutions across diverse domains, including food handling. Serving as a proxy for the future transition of robotic solutions from the laboratory to the market, these competitions simulate real-world challenges. Since 2021, our research group has actively participated in RoboSoft competitions, securing victories in the Manipulation track in 2022 and 2023. Our success was propelled by the utilization of a modified iteration of our Retractable Nails Soft Gripper (RNSG), tailored to meet the specific requirements of each task. The integration of sensors and collaborative manipulators further enhanced the gripper's performance, facilitating the seamless execution of complex grasping tasks associated with food handling. This article encapsulates the experiential insights gained during the application of our highly versatile soft gripper in these competition environments.

软抓手因其善于适应各种物体,尤其是易碎物品,而无需进行精确的力控制而日益受到关注。事实证明,这一特性在非结构化环境和动态任务(如食品处理)中尤其有益。人的双手由于具有较高的灵活性和精确的运动控制能力,因此能够通过动态调整其抓握配置来精细地处理复杂的食品,如小型或易碎物品。此外,它们丰富的感官感受器和手眼协调能力可提供有关质地和形状因素的宝贵信息,因此在处理食物时可进行实时调整,避免食物损坏或溢出。尽管许多人都在努力通过涉及软抓手的机器人解决方案来复制这些能力,但与人类的表现相匹配仍然是一项艰巨的工程挑战。机器人竞赛是推动操纵能力发展的宝贵平台,同时还能让人们深入了解这些解决方案在食品处理等不同领域的应用情况。这些比赛模拟了真实世界的挑战,是未来机器人解决方案从实验室向市场过渡的代表。自 2021 年以来,我们的研究小组一直积极参加 RoboSoft 竞赛,并在 2022 年和 2023 年的操纵赛道上取得了胜利。我们的成功得益于我们对可伸缩式软钉机械手(RNSG)的改进迭代,以满足每项任务的具体要求。传感器和协作机械手的集成进一步提高了机械手的性能,有助于无缝执行与食品处理相关的复杂抓取任务。本文概括了我们的多功能软抓手在这些竞赛环境中的应用经验。
{"title":"Applications of a vacuum-actuated multi-material hybrid soft gripper: lessons learnt from RoboSoft manipulation challenge.","authors":"Saikrishna Dontu, Elgar Kanhere, Thileepan Stalin, Audelia Gumarus Dharmawan, Chidanand Hegde, Jiangtao Su, Xiaodong Chen, Shlomo Magdassi, Gim Song Soh, Pablo Valdivia Y Alvarado","doi":"10.3389/frobt.2024.1356692","DOIUrl":"10.3389/frobt.2024.1356692","url":null,"abstract":"<p><p>Soft grippers are garnering increasing attention for their adeptness in conforming to diverse objects, particularly delicate items, without warranting precise force control. This attribute proves especially beneficial in unstructured environments and dynamic tasks such as food handling. Human hands, owing to their elevated dexterity and precise motor control, exhibit the ability to delicately manipulate complex food items, such as small or fragile objects, by dynamically adjusting their grasping configurations. Furthermore, with their rich sensory receptors and hand-eye coordination that provide valuable information involving the texture and form factor, real-time adjustments to avoid damage or spill during food handling appear seamless. Despite numerous endeavors to replicate these capabilities through robotic solutions involving soft grippers, matching human performance remains a formidable engineering challenge. Robotic competitions serve as an invaluable platform for pushing the boundaries of manipulation capabilities, simultaneously offering insights into the adoption of these solutions across diverse domains, including food handling. Serving as a proxy for the future transition of robotic solutions from the laboratory to the market, these competitions simulate real-world challenges. Since 2021, our research group has actively participated in RoboSoft competitions, securing victories in the Manipulation track in 2022 and 2023. Our success was propelled by the utilization of a modified iteration of our Retractable Nails Soft Gripper (RNSG), tailored to meet the specific requirements of each task. The integration of sensors and collaborative manipulators further enhanced the gripper's performance, facilitating the seamless execution of complex grasping tasks associated with food handling. This article encapsulates the experiential insights gained during the application of our highly versatile soft gripper in these competition environments.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11165351/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141307115","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Impact of politeness and performance quality of android robots on future interaction decisions: a conversational design perspective. 安卓机器人的礼貌和性能质量对未来交互决策的影响:对话设计视角。
IF 3.4 Q2 Computer Science Pub Date : 2024-05-28 eCollection Date: 2024-01-01 DOI: 10.3389/frobt.2024.1393456
Waka Saeki, Yoshiyuki Ueda

Despite robots being applied in various situations of modern society, some people avoid them or do not feel comfortable interacting with them. Designs that allow robots to interact appropriately with people will make a positive impression on them resulting in a better evaluation of robots, which will solve this problem. To establish such a design, this study conducted two scenario-based experiments focusing on the politeness of the robot's conversation and behavior, and examined the impressions caused when the robot succeeds or slightly fails at a task. These two experiments revealed that regardless of whether the partner is a robot or a human, politeness not only affected the impression of interaction but also the expectations for better task results on the next occasion. Although the effect of politeness on preference toward robot agents was smaller than those toward human agents when agents failed a task, people were more likely to interact with polite robots and human agents again because they thought that they would not fail the next time. This study revealed that politeness motivates people to interact with robots repeatedly even if they make minor mistakes, suggesting that the politeness design is important for encouraging human-robot interaction.

尽管机器人已被应用于现代社会的各种场合,但有些人仍对其避而远之,或在与它们互动时感到不自在。能让机器人与人适当互动的设计会给人留下积极的印象,从而提高人们对机器人的评价,从而解决这个问题。为了确立这样一种设计,本研究进行了两个基于场景的实验,重点关注机器人对话和行为的礼貌性,并考察了机器人在完成任务成功或略有失败时给人留下的印象。这两项实验表明,无论对方是机器人还是人类,礼貌不仅会影响互动印象,还会影响对下一次更好任务结果的预期。虽然在机器人代理未能完成任务时,礼貌对机器人代理偏好的影响小于对人类代理的影响,但人们更愿意再次与礼貌的机器人和人类代理互动,因为他们认为下次不会再失败了。这项研究表明,即使机器人犯了小错误,礼貌也会促使人们重复与机器人互动,这表明礼貌设计对于鼓励人机互动非常重要。
{"title":"Impact of politeness and performance quality of android robots on future interaction decisions: a conversational design perspective.","authors":"Waka Saeki, Yoshiyuki Ueda","doi":"10.3389/frobt.2024.1393456","DOIUrl":"10.3389/frobt.2024.1393456","url":null,"abstract":"<p><p>Despite robots being applied in various situations of modern society, some people avoid them or do not feel comfortable interacting with them. Designs that allow robots to interact appropriately with people will make a positive impression on them resulting in a better evaluation of robots, which will solve this problem. To establish such a design, this study conducted two scenario-based experiments focusing on the politeness of the robot's conversation and behavior, and examined the impressions caused when the robot succeeds or slightly fails at a task. These two experiments revealed that regardless of whether the partner is a robot or a human, politeness not only affected the impression of interaction but also the expectations for better task results on the next occasion. Although the effect of politeness on preference toward robot agents was smaller than those toward human agents when agents failed a task, people were more likely to interact with polite robots and human agents again because they thought that they would not fail the next time. This study revealed that politeness motivates people to interact with robots repeatedly even if they make minor mistakes, suggesting that the politeness design is important for encouraging human-robot interaction.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-05-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11165153/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141307116","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Recommendations for designing conversational companion robots with older adults through foundation models. 通过基础模型设计与老年人对话的陪伴机器人的建议。
IF 3.4 Q2 Computer Science Pub Date : 2024-05-27 eCollection Date: 2024-01-01 DOI: 10.3389/frobt.2024.1363713
Bahar Irfan, Sanna Kuoppamäki, Gabriel Skantze

Companion robots are aimed to mitigate loneliness and social isolation among older adults by providing social and emotional support in their everyday lives. However, older adults' expectations of conversational companionship might substantially differ from what current technologies can achieve, as well as from other age groups like young adults. Thus, it is crucial to involve older adults in the development of conversational companion robots to ensure that these devices align with their unique expectations and experiences. The recent advancement in foundation models, such as large language models, has taken a significant stride toward fulfilling those expectations, in contrast to the prior literature that relied on humans controlling robots (i.e., Wizard of Oz) or limited rule-based architectures that are not feasible to apply in the daily lives of older adults. Consequently, we conducted a participatory design (co-design) study with 28 older adults, demonstrating a companion robot using a large language model (LLM), and design scenarios that represent situations from everyday life. The thematic analysis of the discussions around these scenarios shows that older adults expect a conversational companion robot to engage in conversation actively in isolation and passively in social settings, remember previous conversations and personalize, protect privacy and provide control over learned data, give information and daily reminders, foster social skills and connections, and express empathy and emotions. Based on these findings, this article provides actionable recommendations for designing conversational companion robots for older adults with foundation models, such as LLMs and vision-language models, which can also be applied to conversational robots in other domains.

陪伴机器人旨在通过在日常生活中提供社交和情感支持,减轻老年人的孤独感和社会隔离感。然而,老年人对会话陪伴机器人的期望可能与当前技术所能实现的期望以及青壮年等其他年龄组的期望大相径庭。因此,让老年人参与会话陪伴机器人的开发至关重要,以确保这些设备符合他们的独特期望和体验。与之前依赖人类控制机器人(如《绿野仙踪》)或基于规则的有限架构的文献形成鲜明对比的是,最近在基础模型(如大型语言模型)方面取得的进步在实现这些期望方面迈出了一大步,而这些模型在应用于老年人的日常生活中并不可行。因此,我们与 28 位老年人开展了一项参与式设计(共同设计)研究,使用大型语言模型(LLM)演示了陪伴机器人,并设计了代表日常生活场景的情景。对围绕这些场景的讨论进行的主题分析表明,老年人希望会话陪伴机器人能在与世隔绝的情况下主动参与对话,在社交场合被动参与对话,记住以前的对话并进行个性化处理,保护隐私并提供对所学数据的控制,提供信息和日常提醒,培养社交技能和联系,以及表达同理心和情感。基于这些发现,本文为设计具有基础模型(如 LLM 和视觉语言模型)的老年人会话陪伴机器人提供了可行的建议,这些建议也可应用于其他领域的会话机器人。
{"title":"Recommendations for designing conversational companion robots with older adults through foundation models.","authors":"Bahar Irfan, Sanna Kuoppamäki, Gabriel Skantze","doi":"10.3389/frobt.2024.1363713","DOIUrl":"10.3389/frobt.2024.1363713","url":null,"abstract":"<p><p>Companion robots are aimed to mitigate loneliness and social isolation among older adults by providing social and emotional support in their everyday lives. However, older adults' expectations of conversational companionship might substantially differ from what current technologies can achieve, as well as from other age groups like young adults. Thus, it is crucial to involve older adults in the development of conversational companion robots to ensure that these devices align with their unique expectations and experiences. The recent advancement in foundation models, such as large language models, has taken a significant stride toward fulfilling those expectations, in contrast to the prior literature that relied on humans controlling robots (i.e., Wizard of Oz) or limited rule-based architectures that are not feasible to apply in the daily lives of older adults. Consequently, we conducted a participatory design (co-design) study with 28 older adults, demonstrating a companion robot using a large language model (LLM), and design scenarios that represent situations from everyday life. The thematic analysis of the discussions around these scenarios shows that older adults expect a conversational companion robot to engage in conversation actively in isolation and passively in social settings, remember previous conversations and personalize, protect privacy and provide control over learned data, give information and daily reminders, foster social skills and connections, and express empathy and emotions. Based on these findings, this article provides actionable recommendations for designing conversational companion robots for older adults with foundation models, such as LLMs and vision-language models, which can also be applied to conversational robots in other domains.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":3.4,"publicationDate":"2024-05-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11163135/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141301828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Frontiers in Robotics and AI
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1