{"title":"用于自主认知外科机器人的动态全局/局部多层运动规划器架构","authors":"Narcís Sayols , Albert Hernansanz , Alessio Sozzi , Nicola Piccinelli , Fabio Falezza , Saverio Farsoni , Alícia Casals , Marcello Bonfè , Riccardo Muradore","doi":"10.1016/j.robot.2024.104758","DOIUrl":null,"url":null,"abstract":"<div><p>This paper presents a novel dynamic motion planner designed to provide safe motions in the context of the Smart Autonomous Robot Assistant Surgeon (SARAS) surgical platform. SARAS is a multi-robot autonomous platform designed to execute auxiliary tasks in Minimally Invasive Surgeries (MIS) with a high degree of autonomy. The development of robotic systems with a high level of autonomy and reliability requires to perceive the workspace and human actions, to contextualize them with the surgical workflow, and, finally, plan and dynamically control the required motions. The autonomous control relies on a multi-level hierarchical Finite State Machine (hFSM) that decides and supervises all robot actions and their transitions. This approach requires multi-granularity decomposition of the surgical procedure and defines different motion profiles to preserve and safely interacts with the patients’ anatomy. The motion planner is developed under the minimally invasive surgery context since it is an extreme use case where the environment is complex, dynamic and unstructured. Moreover, in the SARAS platform the autonomous robots share workspace as well as collaborate with other human-guided robotic instruments. This creates an even more complex working environment and defines a set of hierarchical relationships in which auxiliary instruments have a lower priority. The presented motion planner acts at two levels: Global and Local. The Global Planner generates an initial spline-based trajectory that, defined by a set of Control Points, follows a certain profile determined by the ongoing surgical action and the interaction with the patient’s anatomy. Then, during the execution of the motion, the Local Planner observes the workspace (anatomy and other tools) and applies different virtual potential fields to the control points to dynamically modify their position to avoid potential collisions or tool blocking while maintaining trajectory coherence. At this level, it reactively modifies the trajectory between the tool position and the next control point applying Dynamical Systems based obstacle avoidance. This approach ensures collision free connections between the spline control points. The proposed motion planner is validated in a realistic surgical scenario. The experimental results are analysed from data collected during various Robotic-Assisted Radical Prostatectomy surgeries on manikins, performed with the SARAS SOLO-SURGERY platform: the main surgeon teleoperates a daVinci Research Kit and two robotic arms autonomously perform different auxiliary surgical tasks.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"180 ","pages":"Article 104758"},"PeriodicalIF":4.3000,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0921889024001428/pdfft?md5=8c5ac0ada5183d95b70db4dc25d3cd7c&pid=1-s2.0-S0921889024001428-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Dynamic Global/Local multi-layer motion planner architecture for autonomous Cognitive Surgical Robots\",\"authors\":\"Narcís Sayols , Albert Hernansanz , Alessio Sozzi , Nicola Piccinelli , Fabio Falezza , Saverio Farsoni , Alícia Casals , Marcello Bonfè , Riccardo Muradore\",\"doi\":\"10.1016/j.robot.2024.104758\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>This paper presents a novel dynamic motion planner designed to provide safe motions in the context of the Smart Autonomous Robot Assistant Surgeon (SARAS) surgical platform. SARAS is a multi-robot autonomous platform designed to execute auxiliary tasks in Minimally Invasive Surgeries (MIS) with a high degree of autonomy. The development of robotic systems with a high level of autonomy and reliability requires to perceive the workspace and human actions, to contextualize them with the surgical workflow, and, finally, plan and dynamically control the required motions. The autonomous control relies on a multi-level hierarchical Finite State Machine (hFSM) that decides and supervises all robot actions and their transitions. This approach requires multi-granularity decomposition of the surgical procedure and defines different motion profiles to preserve and safely interacts with the patients’ anatomy. The motion planner is developed under the minimally invasive surgery context since it is an extreme use case where the environment is complex, dynamic and unstructured. Moreover, in the SARAS platform the autonomous robots share workspace as well as collaborate with other human-guided robotic instruments. This creates an even more complex working environment and defines a set of hierarchical relationships in which auxiliary instruments have a lower priority. The presented motion planner acts at two levels: Global and Local. The Global Planner generates an initial spline-based trajectory that, defined by a set of Control Points, follows a certain profile determined by the ongoing surgical action and the interaction with the patient’s anatomy. Then, during the execution of the motion, the Local Planner observes the workspace (anatomy and other tools) and applies different virtual potential fields to the control points to dynamically modify their position to avoid potential collisions or tool blocking while maintaining trajectory coherence. At this level, it reactively modifies the trajectory between the tool position and the next control point applying Dynamical Systems based obstacle avoidance. This approach ensures collision free connections between the spline control points. The proposed motion planner is validated in a realistic surgical scenario. The experimental results are analysed from data collected during various Robotic-Assisted Radical Prostatectomy surgeries on manikins, performed with the SARAS SOLO-SURGERY platform: the main surgeon teleoperates a daVinci Research Kit and two robotic arms autonomously perform different auxiliary surgical tasks.</p></div>\",\"PeriodicalId\":49592,\"journal\":{\"name\":\"Robotics and Autonomous Systems\",\"volume\":\"180 \",\"pages\":\"Article 104758\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-07-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S0921889024001428/pdfft?md5=8c5ac0ada5183d95b70db4dc25d3cd7c&pid=1-s2.0-S0921889024001428-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Robotics and Autonomous Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0921889024001428\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Autonomous Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0921889024001428","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
This paper presents a novel dynamic motion planner designed to provide safe motions in the context of the Smart Autonomous Robot Assistant Surgeon (SARAS) surgical platform. SARAS is a multi-robot autonomous platform designed to execute auxiliary tasks in Minimally Invasive Surgeries (MIS) with a high degree of autonomy. The development of robotic systems with a high level of autonomy and reliability requires to perceive the workspace and human actions, to contextualize them with the surgical workflow, and, finally, plan and dynamically control the required motions. The autonomous control relies on a multi-level hierarchical Finite State Machine (hFSM) that decides and supervises all robot actions and their transitions. This approach requires multi-granularity decomposition of the surgical procedure and defines different motion profiles to preserve and safely interacts with the patients’ anatomy. The motion planner is developed under the minimally invasive surgery context since it is an extreme use case where the environment is complex, dynamic and unstructured. Moreover, in the SARAS platform the autonomous robots share workspace as well as collaborate with other human-guided robotic instruments. This creates an even more complex working environment and defines a set of hierarchical relationships in which auxiliary instruments have a lower priority. The presented motion planner acts at two levels: Global and Local. The Global Planner generates an initial spline-based trajectory that, defined by a set of Control Points, follows a certain profile determined by the ongoing surgical action and the interaction with the patient’s anatomy. Then, during the execution of the motion, the Local Planner observes the workspace (anatomy and other tools) and applies different virtual potential fields to the control points to dynamically modify their position to avoid potential collisions or tool blocking while maintaining trajectory coherence. At this level, it reactively modifies the trajectory between the tool position and the next control point applying Dynamical Systems based obstacle avoidance. This approach ensures collision free connections between the spline control points. The proposed motion planner is validated in a realistic surgical scenario. The experimental results are analysed from data collected during various Robotic-Assisted Radical Prostatectomy surgeries on manikins, performed with the SARAS SOLO-SURGERY platform: the main surgeon teleoperates a daVinci Research Kit and two robotic arms autonomously perform different auxiliary surgical tasks.
期刊介绍:
Robotics and Autonomous Systems will carry articles describing fundamental developments in the field of robotics, with special emphasis on autonomous systems. An important goal of this journal is to extend the state of the art in both symbolic and sensory based robot control and learning in the context of autonomous systems.
Robotics and Autonomous Systems will carry articles on the theoretical, computational and experimental aspects of autonomous systems, or modules of such systems.