Pub Date : 2024-08-15eCollection Date: 2024-01-01DOI: 10.3389/frobt.2024.1417741
Elham Kowsari, Reza Ghabcheloo
Introduction: The paper introduces a novel optimal feedforward controller for Hydraulic manipulators equipped with a passive grapple, addressing the issue of sway during and after movement. The controller is specifically applied to a forwarder machine used in forestry for log-loading tasks.
Methods: The controller is designed for smooth operation, low computational demands, and efficient sway damping. Customizable parameters allow adjustments to suit operator preferences. The implementation was carried out using the Amesim model of a forwarder.
Results: Simulation results indicate a significant reduction in sway motions, averaging a decrease of more than 60%. This performance was achieved without the need for additional sway-detection sensors, which simplifies the system design and reduces costs.
Discussion: The proposed method demonstrates versatility and broad applicability, offering a new framework for anti-sway controllers in various fields such as construction cranes, forestry vehicles, aerial drones, and other robotic manipulators with passive end-effectors. This adaptability could lead to significant advances in safety and efficiency.
{"title":"Optimal sway motion reduction in forestry cranes.","authors":"Elham Kowsari, Reza Ghabcheloo","doi":"10.3389/frobt.2024.1417741","DOIUrl":"10.3389/frobt.2024.1417741","url":null,"abstract":"<p><strong>Introduction: </strong>The paper introduces a novel optimal feedforward controller for Hydraulic manipulators equipped with a passive grapple, addressing the issue of sway during and after movement. The controller is specifically applied to a forwarder machine used in forestry for log-loading tasks.</p><p><strong>Methods: </strong>The controller is designed for smooth operation, low computational demands, and efficient sway damping. Customizable parameters allow adjustments to suit operator preferences. The implementation was carried out using the Amesim model of a forwarder.</p><p><strong>Results: </strong>Simulation results indicate a significant reduction in sway motions, averaging a decrease of more than 60%. This performance was achieved without the need for additional sway-detection sensors, which simplifies the system design and reduces costs.</p><p><strong>Discussion: </strong>The proposed method demonstrates versatility and broad applicability, offering a new framework for anti-sway controllers in various fields such as construction cranes, forestry vehicles, aerial drones, and other robotic manipulators with passive end-effectors. This adaptability could lead to significant advances in safety and efficiency.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11357902/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142117076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-15eCollection Date: 2024-01-01DOI: 10.3389/frobt.2024.1426206
Lutz Bretschneider, Sven Bollmann, Deborah Houssin-Agbomson, Jacob Shaw, Neil Howes, Linh Nguyen, Rod Robinson, Jon Helmore, Michael Lichtenstern, Javis Nwaboh, Andrea Pogany, Volker Ebert, Astrid Lampert
The quickly developing drone technology can be used efficiently in the field of pipeline leak detection. The aim of this article is to provide drone mission concepts for detecting releases from pipelines. It provides an overview of the current applications of natural gas pipeline surveys, it considers environmental conditions by plume modelling, it discusses suitable commercially available sensors, and develops concepts for routine monitoring of pipelines and short term missions for localising and identifying a known leakage. Suitable platforms depend on the particular mission and requirements concerning sensors and legislation. As an illustration, a feasibility study during a release experiment is introduced. The main challenge of this study was the variability of wind direction on a time scale of minutes, which produces considerable differences to the plume simulations. Nevertheless, the leakage rates derived from the observations are in the same order of magnitude as the emission rates. Finally the results from the modeling, the release experiment and possible drone scenarios are combined and requirements for future application derived.
{"title":"Concepts for drone based pipeline leak detection.","authors":"Lutz Bretschneider, Sven Bollmann, Deborah Houssin-Agbomson, Jacob Shaw, Neil Howes, Linh Nguyen, Rod Robinson, Jon Helmore, Michael Lichtenstern, Javis Nwaboh, Andrea Pogany, Volker Ebert, Astrid Lampert","doi":"10.3389/frobt.2024.1426206","DOIUrl":"https://doi.org/10.3389/frobt.2024.1426206","url":null,"abstract":"<p><p>The quickly developing drone technology can be used efficiently in the field of pipeline leak detection. The aim of this article is to provide drone mission concepts for detecting releases from pipelines. It provides an overview of the current applications of natural gas pipeline surveys, it considers environmental conditions by plume modelling, it discusses suitable commercially available sensors, and develops concepts for routine monitoring of pipelines and short term missions for localising and identifying a known leakage. Suitable platforms depend on the particular mission and requirements concerning sensors and legislation. As an illustration, a feasibility study during a release experiment is introduced. The main challenge of this study was the variability of wind direction on a time scale of minutes, which produces considerable differences to the plume simulations. Nevertheless, the leakage rates derived from the observations are in the same order of magnitude as the emission rates. Finally the results from the modeling, the release experiment and possible drone scenarios are combined and requirements for future application derived.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11357903/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142113337","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-14eCollection Date: 2024-01-01DOI: 10.3389/frobt.2024.1440631
Robert Johansson
This paper presents an interdisciplinary framework, Machine Psychology, which integrates principles from operant learning psychology with a particular Artificial Intelligence model, the Non-Axiomatic Reasoning System (NARS), to advance Artificial General Intelligence (AGI) research. Central to this framework is the assumption that adaptation is fundamental to both biological and artificial intelligence, and can be understood using operant conditioning principles. The study evaluates this approach through three operant learning tasks using OpenNARS for Applications (ONA): simple discrimination, changing contingencies, and conditional discrimination tasks. In the simple discrimination task, NARS demonstrated rapid learning, achieving 100% correct responses during training and testing phases. The changing contingencies task illustrated NARS's adaptability, as it successfully adjusted its behavior when task conditions were reversed. In the conditional discrimination task, NARS managed complex learning scenarios, achieving high accuracy by forming and utilizing complex hypotheses based on conditional cues. These results validate the use of operant conditioning as a framework for developing adaptive AGI systems. NARS's ability to function under conditions of insufficient knowledge and resources, combined with its sensorimotor reasoning capabilities, positions it as a robust model for AGI. The Machine Psychology framework, by implementing aspects of natural intelligence such as continuous learning and goal-driven behavior, provides a scalable and flexible approach for real-world applications. Future research should explore using enhanced NARS systems, more advanced tasks and applying this framework to diverse, complex tasks to further advance the development of human-level AI.
{"title":"Machine Psychology: integrating operant conditioning with the non-axiomatic reasoning system for advancing artificial general intelligence research.","authors":"Robert Johansson","doi":"10.3389/frobt.2024.1440631","DOIUrl":"https://doi.org/10.3389/frobt.2024.1440631","url":null,"abstract":"<p><p>This paper presents an interdisciplinary framework, Machine Psychology, which integrates principles from operant learning psychology with a particular Artificial Intelligence model, the Non-Axiomatic Reasoning System (NARS), to advance Artificial General Intelligence (AGI) research. Central to this framework is the assumption that adaptation is fundamental to both biological and artificial intelligence, and can be understood using operant conditioning principles. The study evaluates this approach through three operant learning tasks using OpenNARS for Applications (ONA): simple discrimination, changing contingencies, and conditional discrimination tasks. In the simple discrimination task, NARS demonstrated rapid learning, achieving 100% correct responses during training and testing phases. The changing contingencies task illustrated NARS's adaptability, as it successfully adjusted its behavior when task conditions were reversed. In the conditional discrimination task, NARS managed complex learning scenarios, achieving high accuracy by forming and utilizing complex hypotheses based on conditional cues. These results validate the use of operant conditioning as a framework for developing adaptive AGI systems. NARS's ability to function under conditions of insufficient knowledge and resources, combined with its sensorimotor reasoning capabilities, positions it as a robust model for AGI. The Machine Psychology framework, by implementing aspects of natural intelligence such as continuous learning and goal-driven behavior, provides a scalable and flexible approach for real-world applications. Future research should explore using enhanced NARS systems, more advanced tasks and applying this framework to diverse, complex tasks to further advance the development of human-level AI.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11349497/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142113428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-13eCollection Date: 2024-01-01DOI: 10.3389/frobt.2024.1439427
Mohamed Sallam, Mohamed A Shamseldin, Fanny Ficuciello
Microparticles are increasingly employed as drug carriers inside the human body. To avoid collision with environment, they reach their destination following a predefined trajectory. However, due to the various disturbances, tracking control of microparticles is still a challenge. In this work, we propose to use an Adaptive Nonlinear PID (A-NPID) controller for trajectory tracking of microparticles. A-NPID allows the gains to be continuously adjusted to satisfy the performance requirements at different operating conditions. An in-vitro study is conducted to verify the proposed controller where a microparticle of 100 m diameter is put to navigate through an open fluidic reservoir with virtual obstacles. Firstly, a collision-free trajectory is generated using a path-planning algorithm. Secondly, the microparticle dynamic model, when moving under the influence of external forces, is derived, and employed to design the A-NPID control law. The proposed controller successfully allowed the particle to navigate autonomously following the reference collision-free trajectory in presence of varying environmental conditions. Moreover, the particle could reach its targeted position with a minimal steady-state error of 4 m. A degradation in the performance was observed when only a PID controller was used in the absence of adaptive terms. The results have been verified by simulation and experimentally.
微粒子越来越多地被用作人体内的药物载体。为了避免与环境发生碰撞,微粒需要按照预定轨迹到达目的地。然而,由于存在各种干扰,微颗粒的跟踪控制仍是一项挑战。在这项工作中,我们建议使用自适应非线性 PID(A-NPID)控制器对微颗粒进行轨迹跟踪。A-NPID 允许不断调整增益,以满足不同操作条件下的性能要求。为了验证所提出的控制器,我们进行了一项体外研究,让直径为 100 μ m 的微颗粒在带有虚拟障碍物的开放式流体容器中航行。首先,使用路径规划算法生成无碰撞轨迹。其次,推导出微颗粒在外力作用下运动时的动态模型,并利用该模型设计出 A-NPID 控制法则。所提出的控制器成功地使粒子在不同的环境条件下按照无碰撞的参考轨迹自主导航。此外,粒子能以 4 μ m 的最小稳态误差到达目标位置。模拟和实验验证了这些结果。
{"title":"Autonomous navigation and control of magnetic microcarriers using potential field algorithm and adaptive non-linear PID.","authors":"Mohamed Sallam, Mohamed A Shamseldin, Fanny Ficuciello","doi":"10.3389/frobt.2024.1439427","DOIUrl":"10.3389/frobt.2024.1439427","url":null,"abstract":"<p><p>Microparticles are increasingly employed as drug carriers inside the human body. To avoid collision with environment, they reach their destination following a predefined trajectory. However, due to the various disturbances, tracking control of microparticles is still a challenge. In this work, we propose to use an Adaptive Nonlinear PID (A-NPID) controller for trajectory tracking of microparticles. A-NPID allows the gains to be continuously adjusted to satisfy the performance requirements at different operating conditions. An <i>in-vitro</i> study is conducted to verify the proposed controller where a microparticle of 100 <math><mi>μ</mi></math> m diameter is put to navigate through an open fluidic reservoir with virtual obstacles. Firstly, a collision-free trajectory is generated using a path-planning algorithm. Secondly, the microparticle dynamic model, when moving under the influence of external forces, is derived, and employed to design the A-NPID control law. The proposed controller successfully allowed the particle to navigate autonomously following the reference collision-free trajectory in presence of varying environmental conditions. Moreover, the particle could reach its targeted position with a minimal steady-state error of 4 <math><mi>μ</mi></math> m. A degradation in the performance was observed when only a PID controller was used in the absence of adaptive terms. The results have been verified by simulation and experimentally.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11347180/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142082185","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-13eCollection Date: 2024-01-01DOI: 10.3389/frobt.2024.1375393
Fatemeh Rekabi Bana, Tomáš Krajník, Farshad Arvin
Cooperative multi-agent systems make it possible to employ miniature robots in order to perform different experiments for data collection in wide open areas to physical interactions with test subjects in confined environments such as a hive. This paper proposes a new multi-agent path-planning approach to determine a set of trajectories where the agents do not collide with each other or any obstacle. The proposed algorithm leverages a risk-aware probabilistic roadmap algorithm to generate a map, employs node classification to delineate exploration regions, and incorporates a customized genetic framework to address the combinatorial optimization, with the ultimate goal of computing safe trajectories for the team. Furthermore, the proposed planning algorithm makes the agents explore all subdomains in the workspace together as a formation to allow the team to perform different tasks or collect multiple datasets for reliable localization or hazard detection. The objective function for minimization includes two major parts, the traveling distance of all the agents in the entire mission and the probability of collisions between the agents or agents with obstacles. A sampling method is used to determine the objective function considering the agents' dynamic behavior influenced by environmental disturbances and uncertainties. The algorithm's performance is evaluated for different group sizes by using a simulation environment, and two different benchmark scenarios are introduced to compare the exploration behavior. The proposed optimization method establishes stable and convergent properties regardless of the group size.
{"title":"Evolutionary optimization for risk-aware heterogeneous multi-agent path planning in uncertain environments.","authors":"Fatemeh Rekabi Bana, Tomáš Krajník, Farshad Arvin","doi":"10.3389/frobt.2024.1375393","DOIUrl":"10.3389/frobt.2024.1375393","url":null,"abstract":"<p><p>Cooperative multi-agent systems make it possible to employ miniature robots in order to perform different experiments for data collection in wide open areas to physical interactions with test subjects in confined environments such as a hive. This paper proposes a new multi-agent path-planning approach to determine a set of trajectories where the agents do not collide with each other or any obstacle. The proposed algorithm leverages a risk-aware probabilistic roadmap algorithm to generate a map, employs node classification to delineate exploration regions, and incorporates a customized genetic framework to address the combinatorial optimization, with the ultimate goal of computing safe trajectories for the team. Furthermore, the proposed planning algorithm makes the agents explore all subdomains in the workspace together as a formation to allow the team to perform different tasks or collect multiple datasets for reliable localization or hazard detection. The objective function for minimization includes two major parts, the traveling distance of all the agents in the entire mission and the probability of collisions between the agents or agents with obstacles. A sampling method is used to determine the objective function considering the agents' dynamic behavior influenced by environmental disturbances and uncertainties. The algorithm's performance is evaluated for different group sizes by using a simulation environment, and two different benchmark scenarios are introduced to compare the exploration behavior. The proposed optimization method establishes stable and convergent properties regardless of the group size.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11347181/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142082137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-12eCollection Date: 2024-01-01DOI: 10.3389/frobt.2024.1403679
M Ege Cansev, Alexandra J Miller, Jeremy D Brown, Philipp Beckerle
In this paper, we discuss the potential contribution of affective touch to the user experience and robot performance in human-robot interaction, with an in-depth look into upper-limb prosthesis use as a well-suited example. Research on providing haptic feedback in human-robot interaction has worked to relay discriminative information during functional activities of daily living, like grasping a cup of tea. However, this approach neglects to recognize the affective information our bodies give and receive during social activities of daily living, like shaking hands. The discussion covers the emotional dimensions of affective touch and its role in conveying distinct emotions. In this work, we provide a human needs-centered approach to human-robot interaction design and argue for an equal emphasis to be placed on providing affective haptic feedback channels to meet the social tactile needs and interactions of human agents. We suggest incorporating affective touch to enhance user experience when interacting with and through semi-autonomous systems such as prosthetic limbs, particularly in fostering trust. Real-time analysis of trust as a dynamic phenomenon can pave the way towards adaptive shared autonomy strategies and consequently enhance the acceptance of prosthetic limbs. Here we highlight certain feasibility considerations, emphasizing practical designs and multi-sensory approaches for the effective implementation of affective touch interfaces.
{"title":"Implementing social and affective touch to enhance user experience in human-robot interaction.","authors":"M Ege Cansev, Alexandra J Miller, Jeremy D Brown, Philipp Beckerle","doi":"10.3389/frobt.2024.1403679","DOIUrl":"10.3389/frobt.2024.1403679","url":null,"abstract":"<p><p>In this paper, we discuss the potential contribution of affective touch to the user experience and robot performance in human-robot interaction, with an in-depth look into upper-limb prosthesis use as a well-suited example. Research on providing haptic feedback in human-robot interaction has worked to relay discriminative information during functional activities of daily living, like grasping a cup of tea. However, this approach neglects to recognize the affective information our bodies give and receive during social activities of daily living, like shaking hands. The discussion covers the emotional dimensions of affective touch and its role in conveying distinct emotions. In this work, we provide a human needs-centered approach to human-robot interaction design and argue for an equal emphasis to be placed on providing affective haptic feedback channels to meet the social tactile needs and interactions of human agents. We suggest incorporating affective touch to enhance user experience when interacting with and through semi-autonomous systems such as prosthetic limbs, particularly in fostering trust. Real-time analysis of trust as a dynamic phenomenon can pave the way towards adaptive shared autonomy strategies and consequently enhance the acceptance of prosthetic limbs. Here we highlight certain feasibility considerations, emphasizing practical designs and multi-sensory approaches for the effective implementation of affective touch interfaces.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345123/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142074168","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-12eCollection Date: 2024-01-01DOI: 10.3389/frobt.2024.1416662
Abdeslem Smahi, Othman Lakhal, Taha Chettibi, Mario Sanz Lopez, David Pasquier, Rochdi Merzouki
Introduction: In this paper, we introduce an advanced robotic system integrated with an adaptive optimization algorithm, tailored for Brachytherapy in prostate cancer treatment. The primary innovation of the system is the algorithm itself, designed to dynamically adjust needle trajectories in response to the real-time movements of the prostate gland during the local intervention.
Methods: The system employs real-time position data extracted from Magnetic Resonance Imaging (MRI) to ensure precise targeting of the prostate, adapting to its constant motion and deformation. This precision is crucial in Brachytherapy, where the accurate placement of radioactive seeds directly impacts the efficacy of the treatment and minimizes damage to surrounding safe tissues.
Results: Our results demonstrate a marked improvement in the accuracy of radiation seed placement, directly correlating to more effective radiation delivery. The adaptive nature of the algorithm significantly reduces the number of needle insertions, leading to a less invasive treatment experience for patients. This reduction in needle insertions also contributes to lower risks of infection and shorter recovery times.
Discussion: This novel robotic system, enhanced by the adaptive optimization algorithm, improves the coverage of targets reached by a traditional combinatorial approach by approximately 15% with fewer required needles. The improved precision and reduced invasiveness highlight the potential of this system to enhance the overall effectiveness and patient experience in prostate cancer Brachytherapy.
{"title":"Adaptive approach for tracking movements of biological targets: application to robot-based intervention for prostate cancer.","authors":"Abdeslem Smahi, Othman Lakhal, Taha Chettibi, Mario Sanz Lopez, David Pasquier, Rochdi Merzouki","doi":"10.3389/frobt.2024.1416662","DOIUrl":"10.3389/frobt.2024.1416662","url":null,"abstract":"<p><strong>Introduction: </strong>In this paper, we introduce an advanced robotic system integrated with an adaptive optimization algorithm, tailored for Brachytherapy in prostate cancer treatment. The primary innovation of the system is the algorithm itself, designed to dynamically adjust needle trajectories in response to the real-time movements of the prostate gland during the local intervention.</p><p><strong>Methods: </strong>The system employs real-time position data extracted from Magnetic Resonance Imaging (MRI) to ensure precise targeting of the prostate, adapting to its constant motion and deformation. This precision is crucial in Brachytherapy, where the accurate placement of radioactive seeds directly impacts the efficacy of the treatment and minimizes damage to surrounding safe tissues.</p><p><strong>Results: </strong>Our results demonstrate a marked improvement in the accuracy of radiation seed placement, directly correlating to more effective radiation delivery. The adaptive nature of the algorithm significantly reduces the number of needle insertions, leading to a less invasive treatment experience for patients. This reduction in needle insertions also contributes to lower risks of infection and shorter recovery times.</p><p><strong>Discussion: </strong>This novel robotic system, enhanced by the adaptive optimization algorithm, improves the coverage of targets reached by a traditional combinatorial approach by approximately 15% with fewer required needles. The improved precision and reduced invasiveness highlight the potential of this system to enhance the overall effectiveness and patient experience in prostate cancer Brachytherapy.</p>","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11345532/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142074167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-09DOI: 10.3389/frobt.2024.1372936
Amirhosein Alian, James Avery, George Mylonas
The integration of soft robots in medical procedures has significantly improved diagnostic and therapeutic interventions, addressing safety concerns and enhancing surgeon dexterity. In conjunction with artificial intelligence, these soft robots hold the potential to expedite autonomous interventions, such as tissue palpation for cancer detection. While cameras are prevalent in surgical instruments, situations with obscured views necessitate palpation. This proof-of-concept study investigates the effectiveness of using a soft robot integrated with Electrical Impedance Tomography (EIT) capabilities for tissue palpation in simulated in vivo inspection of the large intestine. The approach involves classifying tissue samples of varying thickness into healthy and cancerous tissues using the shape changes induced on a hydraulically-driven soft continuum robot during palpation. Shape changes of the robot are mapped using EIT, providing arrays of impedance measurements. Following the fabrication of an in-plane bending soft manipulator, the preliminary tissue phantom design is detailed. The phantom, representing the descending colon wall, considers induced stiffness by surrounding tissues based on a mass-spring model. The shape changes of the manipulator, resulting from interactions with tissues of different stiffness, are measured, and EIT measurements are fed into a Long Short-Term Memory (LSTM) classifier. Train and test datasets are collected as temporal sequences of data from a single training phantom and two test phantoms, namely, A and B, possessing distinctive thickness patterns. The collected dataset from phantom B, which differs in stiffness distribution, remains unseen to the network, thus posing challenges to the classifier. The classifier and proposed method achieve an accuracy of 93% and 88.1% on phantom A and B, respectively. Classification results are presented through confusion matrices and heat maps, visualising the accuracy of the algorithm and corresponding classified tissues.
将软体机器人集成到医疗程序中,大大改善了诊断和治疗干预,解决了安全问题,提高了外科医生的灵巧性。结合人工智能,这些软体机器人有可能加快自主干预的速度,例如用于癌症检测的组织触诊。虽然摄像头在手术器械中很普遍,但在视线不清晰的情况下,必须进行触诊。这项概念验证研究调查了在模拟大肠活体检查中使用集成了电阻抗断层扫描(EIT)功能的软体机器人进行组织触诊的有效性。该方法包括利用软连续机器人在触诊过程中产生的形状变化,将不同厚度的组织样本分为健康组织和癌变组织。使用 EIT 对机器人的形状变化进行映射,提供阻抗测量阵列。在制作了平面弯曲软机械手之后,详细介绍了初步的组织模型设计。该模型代表降结肠壁,根据质量弹簧模型考虑了周围组织的诱导刚度。机械手与不同刚度的组织相互作用后产生的形状变化将被测量,EIT 测量值将被输入长短期记忆(LSTM)分类器。训练和测试数据集是从一个训练模型和两个测试模型(即 A 和 B)收集的数据时间序列,这两个模型具有不同的厚度模式。收集到的幻影 B 的数据集在刚度分布上有所不同,网络仍未看到,因此给分类器带来了挑战。分类器和建议的方法在模型 A 和模型 B 上的准确率分别达到 93% 和 88.1%。分类结果通过混淆矩阵和热图呈现,直观显示了算法的准确性和相应的分类组织。
{"title":"Tissue palpation in endoscopy using EIT and soft actuators","authors":"Amirhosein Alian, James Avery, George Mylonas","doi":"10.3389/frobt.2024.1372936","DOIUrl":"https://doi.org/10.3389/frobt.2024.1372936","url":null,"abstract":"The integration of soft robots in medical procedures has significantly improved diagnostic and therapeutic interventions, addressing safety concerns and enhancing surgeon dexterity. In conjunction with artificial intelligence, these soft robots hold the potential to expedite autonomous interventions, such as tissue palpation for cancer detection. While cameras are prevalent in surgical instruments, situations with obscured views necessitate palpation. This proof-of-concept study investigates the effectiveness of using a soft robot integrated with Electrical Impedance Tomography (EIT) capabilities for tissue palpation in simulated in vivo inspection of the large intestine. The approach involves classifying tissue samples of varying thickness into healthy and cancerous tissues using the shape changes induced on a hydraulically-driven soft continuum robot during palpation. Shape changes of the robot are mapped using EIT, providing arrays of impedance measurements. Following the fabrication of an in-plane bending soft manipulator, the preliminary tissue phantom design is detailed. The phantom, representing the descending colon wall, considers induced stiffness by surrounding tissues based on a mass-spring model. The shape changes of the manipulator, resulting from interactions with tissues of different stiffness, are measured, and EIT measurements are fed into a Long Short-Term Memory (LSTM) classifier. Train and test datasets are collected as temporal sequences of data from a single training phantom and two test phantoms, namely, A and B, possessing distinctive thickness patterns. The collected dataset from phantom B, which differs in stiffness distribution, remains unseen to the network, thus posing challenges to the classifier. The classifier and proposed method achieve an accuracy of 93% and 88.1% on phantom A and B, respectively. Classification results are presented through confusion matrices and heat maps, visualising the accuracy of the algorithm and corresponding classified tissues.","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141924141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-09DOI: 10.3389/frobt.2024.1421697
David Barnhart, Rudranarayan Mukherjee, Mini C. Rai, Nicholas D'Amore, Carl Glen Henshaw
{"title":"Editorial: Robotic in-space servicing, assembly and manufacturing","authors":"David Barnhart, Rudranarayan Mukherjee, Mini C. Rai, Nicholas D'Amore, Carl Glen Henshaw","doi":"10.3389/frobt.2024.1421697","DOIUrl":"https://doi.org/10.3389/frobt.2024.1421697","url":null,"abstract":"","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141922810","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-08-09DOI: 10.3389/frobt.2024.1416360
R. Schuller, Jens Reinecke, Henry Maurenbrecher, Christian Ott, Alin Albu-Schaeffer, Bastian Deutschmann, Fred Buettner, Jens Heim, Frank Benkert, Stefan Glueck
The idea of sensorizing a strain wave gear to measure the transmitted torque has been reported since the 1980s. The strain in the elastic flex spline is typically measured by strain gages attached to it. The resulting voltages relate to the transmitted torque in the gear. However, periodic inaccuracies in the measured torque signal (sensing ripple), resulting from positioning inaccuracies of strain gages on the flex spline, prevented this technology from being used outside a lab environment. Regardless of these difficulties, measuring the torque directly in the strain wave gear would bring many advantages, especially in robotic applications, where design space is highly limited. Traditionally, robotic joints are equipped with link-sided torque sensors, which reduce the available design volume, lower the joint stiffness, and require complex cable routing. This paper presents an experimental study of a novel sensorized strain wave gear named RT1-T, which was developed by Schaeffler Technologies. The study was implemented on a joint testbed, including a high-resolution reference torque sensor at the link side. In addition to the measurement accuracy and linearity, a torque ripple analysis is performed. The joint torque control capabilities are determined along dynamic trajectories and compared to the performance achieved with a link-sided reference sensor. The sensor employed in the testbed has a static torque error of 0.42 Nm and an average closed-loop torque control error of 0.65 Nm above the reference sensor.
{"title":"An experimental study of the sensorized strain wave gear RT1-T and its capabilities for torque control in robotic joints","authors":"R. Schuller, Jens Reinecke, Henry Maurenbrecher, Christian Ott, Alin Albu-Schaeffer, Bastian Deutschmann, Fred Buettner, Jens Heim, Frank Benkert, Stefan Glueck","doi":"10.3389/frobt.2024.1416360","DOIUrl":"https://doi.org/10.3389/frobt.2024.1416360","url":null,"abstract":"The idea of sensorizing a strain wave gear to measure the transmitted torque has been reported since the 1980s. The strain in the elastic flex spline is typically measured by strain gages attached to it. The resulting voltages relate to the transmitted torque in the gear. However, periodic inaccuracies in the measured torque signal (sensing ripple), resulting from positioning inaccuracies of strain gages on the flex spline, prevented this technology from being used outside a lab environment. Regardless of these difficulties, measuring the torque directly in the strain wave gear would bring many advantages, especially in robotic applications, where design space is highly limited. Traditionally, robotic joints are equipped with link-sided torque sensors, which reduce the available design volume, lower the joint stiffness, and require complex cable routing. This paper presents an experimental study of a novel sensorized strain wave gear named RT1-T, which was developed by Schaeffler Technologies. The study was implemented on a joint testbed, including a high-resolution reference torque sensor at the link side. In addition to the measurement accuracy and linearity, a torque ripple analysis is performed. The joint torque control capabilities are determined along dynamic trajectories and compared to the performance achieved with a link-sided reference sensor. The sensor employed in the testbed has a static torque error of 0.42 Nm and an average closed-loop torque control error of 0.65 Nm above the reference sensor.","PeriodicalId":47597,"journal":{"name":"Frontiers in Robotics and AI","volume":null,"pages":null},"PeriodicalIF":2.9,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141924697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}