Dynamic Global/Local multi-layer motion planner architecture for autonomous Cognitive Surgical Robots

IF 4.3 2区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS Robotics and Autonomous Systems Pub Date : 2024-07-19 DOI:10.1016/j.robot.2024.104758
Narcís Sayols , Albert Hernansanz , Alessio Sozzi , Nicola Piccinelli , Fabio Falezza , Saverio Farsoni , Alícia Casals , Marcello Bonfè , Riccardo Muradore
{"title":"Dynamic Global/Local multi-layer motion planner architecture for autonomous Cognitive Surgical Robots","authors":"Narcís Sayols ,&nbsp;Albert Hernansanz ,&nbsp;Alessio Sozzi ,&nbsp;Nicola Piccinelli ,&nbsp;Fabio Falezza ,&nbsp;Saverio Farsoni ,&nbsp;Alícia Casals ,&nbsp;Marcello Bonfè ,&nbsp;Riccardo Muradore","doi":"10.1016/j.robot.2024.104758","DOIUrl":null,"url":null,"abstract":"<div><p>This paper presents a novel dynamic motion planner designed to provide safe motions in the context of the Smart Autonomous Robot Assistant Surgeon (SARAS) surgical platform. SARAS is a multi-robot autonomous platform designed to execute auxiliary tasks in Minimally Invasive Surgeries (MIS) with a high degree of autonomy. The development of robotic systems with a high level of autonomy and reliability requires to perceive the workspace and human actions, to contextualize them with the surgical workflow, and, finally, plan and dynamically control the required motions. The autonomous control relies on a multi-level hierarchical Finite State Machine (hFSM) that decides and supervises all robot actions and their transitions. This approach requires multi-granularity decomposition of the surgical procedure and defines different motion profiles to preserve and safely interacts with the patients’ anatomy. The motion planner is developed under the minimally invasive surgery context since it is an extreme use case where the environment is complex, dynamic and unstructured. Moreover, in the SARAS platform the autonomous robots share workspace as well as collaborate with other human-guided robotic instruments. This creates an even more complex working environment and defines a set of hierarchical relationships in which auxiliary instruments have a lower priority. The presented motion planner acts at two levels: Global and Local. The Global Planner generates an initial spline-based trajectory that, defined by a set of Control Points, follows a certain profile determined by the ongoing surgical action and the interaction with the patient’s anatomy. Then, during the execution of the motion, the Local Planner observes the workspace (anatomy and other tools) and applies different virtual potential fields to the control points to dynamically modify their position to avoid potential collisions or tool blocking while maintaining trajectory coherence. At this level, it reactively modifies the trajectory between the tool position and the next control point applying Dynamical Systems based obstacle avoidance. This approach ensures collision free connections between the spline control points. The proposed motion planner is validated in a realistic surgical scenario. The experimental results are analysed from data collected during various Robotic-Assisted Radical Prostatectomy surgeries on manikins, performed with the SARAS SOLO-SURGERY platform: the main surgeon teleoperates a daVinci Research Kit and two robotic arms autonomously perform different auxiliary surgical tasks.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"180 ","pages":"Article 104758"},"PeriodicalIF":4.3000,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0921889024001428/pdfft?md5=8c5ac0ada5183d95b70db4dc25d3cd7c&pid=1-s2.0-S0921889024001428-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Autonomous Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0921889024001428","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

This paper presents a novel dynamic motion planner designed to provide safe motions in the context of the Smart Autonomous Robot Assistant Surgeon (SARAS) surgical platform. SARAS is a multi-robot autonomous platform designed to execute auxiliary tasks in Minimally Invasive Surgeries (MIS) with a high degree of autonomy. The development of robotic systems with a high level of autonomy and reliability requires to perceive the workspace and human actions, to contextualize them with the surgical workflow, and, finally, plan and dynamically control the required motions. The autonomous control relies on a multi-level hierarchical Finite State Machine (hFSM) that decides and supervises all robot actions and their transitions. This approach requires multi-granularity decomposition of the surgical procedure and defines different motion profiles to preserve and safely interacts with the patients’ anatomy. The motion planner is developed under the minimally invasive surgery context since it is an extreme use case where the environment is complex, dynamic and unstructured. Moreover, in the SARAS platform the autonomous robots share workspace as well as collaborate with other human-guided robotic instruments. This creates an even more complex working environment and defines a set of hierarchical relationships in which auxiliary instruments have a lower priority. The presented motion planner acts at two levels: Global and Local. The Global Planner generates an initial spline-based trajectory that, defined by a set of Control Points, follows a certain profile determined by the ongoing surgical action and the interaction with the patient’s anatomy. Then, during the execution of the motion, the Local Planner observes the workspace (anatomy and other tools) and applies different virtual potential fields to the control points to dynamically modify their position to avoid potential collisions or tool blocking while maintaining trajectory coherence. At this level, it reactively modifies the trajectory between the tool position and the next control point applying Dynamical Systems based obstacle avoidance. This approach ensures collision free connections between the spline control points. The proposed motion planner is validated in a realistic surgical scenario. The experimental results are analysed from data collected during various Robotic-Assisted Radical Prostatectomy surgeries on manikins, performed with the SARAS SOLO-SURGERY platform: the main surgeon teleoperates a daVinci Research Kit and two robotic arms autonomously perform different auxiliary surgical tasks.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于自主认知外科机器人的动态全局/局部多层运动规划器架构
本文介绍了一种新型动态运动规划器,旨在为智能自主机器人助理外科医生(SARAS)手术平台提供安全运动。SARAS 是一个多机器人自主平台,旨在高度自主地执行微创手术(MIS)中的辅助任务。开发具有高度自主性和可靠性的机器人系统需要感知工作空间和人类行动,将其与手术工作流程联系起来,最后规划并动态控制所需的动作。自主控制依赖于多级分层有限状态机(hFSM),它决定并监督所有机器人动作及其转换。这种方法要求对手术过程进行多粒度分解,并定义不同的运动轮廓,以保护并安全地与患者的解剖结构进行交互。运动规划器是在微创手术的背景下开发的,因为微创手术是一个极端的使用案例,环境复杂、动态且无序。此外,在 SARAS 平台中,自主机器人共享工作空间,并与其他人类引导的机器人器械协作。这就创造了一个更加复杂的工作环境,并定义了一系列等级关系,其中辅助仪器的优先级较低。所介绍的运动规划器在两个层面上发挥作用:全局和局部。全局规划器生成基于样条线的初始轨迹,该轨迹由一组控制点定义,并遵循由正在进行的手术操作以及与患者解剖结构的交互作用决定的特定轮廓。然后,在运动执行过程中,本地规划器会观察工作空间(解剖结构和其他工具),并对控制点应用不同的虚拟势场,动态修改其位置,以避免潜在的碰撞或工具阻塞,同时保持轨迹的一致性。在这一层面,它采用基于动态系统的避障技术,对工具位置和下一个控制点之间的轨迹进行反应性修改。这种方法确保了花键控制点之间的无碰撞连接。建议的运动规划器在现实的手术场景中得到了验证。实验结果分析了通过 SARAS SOLO-SURGERY 平台在人体模型上进行各种机器人辅助根治性前列腺切除手术时收集的数据:主刀医生远程操作达芬奇研究套件,两个机械臂自主执行不同的辅助手术任务。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Robotics and Autonomous Systems
Robotics and Autonomous Systems 工程技术-机器人学
CiteScore
9.00
自引率
7.00%
发文量
164
审稿时长
4.5 months
期刊介绍: Robotics and Autonomous Systems will carry articles describing fundamental developments in the field of robotics, with special emphasis on autonomous systems. An important goal of this journal is to extend the state of the art in both symbolic and sensory based robot control and learning in the context of autonomous systems. Robotics and Autonomous Systems will carry articles on the theoretical, computational and experimental aspects of autonomous systems, or modules of such systems.
期刊最新文献
Editorial Board A sensorless approach for cable failure detection and identification in cable-driven parallel robots Learning latent causal factors from the intricate sensor feedback of contact-rich robotic assembly tasks GPS-free autonomous navigation in cluttered tree rows with deep semantic segmentation Robust trajectory tracking for omnidirectional robots by means of anti-peaking linear active disturbance rejection
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1