Pub Date : 2024-07-20DOI: 10.1016/j.robot.2024.104759
Qingjun Song, Chengchun Lu, Qinghui Song, Haiyan Jiang, Bei Liu
Stability of obstacle–crossing and structural optimization are important issues in the research of tracked mobile robots. In this paper, in order to fully understand the obstacle–surmounting ability of the robot, the relationship between the position of the center of gravity and the posture of the front and rear swing arms is analyzed. Based on the motion mechanism of the robot crossing obstacles, the geometric model and the dynamic model are established for the key states in the obstacle crossing process. Based on these models, a multi-objective optimization problem for the maximum obstacle–crossing height and minimum driving torque is established during the obstacle crossing process of the robot, which must meet geometric, slip, and stability constraints. To effectively handle the optimization problem of tracked mobile robots, an improved non–dominated sorting genetic algorithm with elite strategy version II based on adaptive genetic strategy (NSGA-II-AGS) is proposed in this paper. Some meaningful relationships between the objective function and the design variables are obtained through sensitivity analysis. Finally, the robot's obstacle-crossing ability was verified through virtual simulation and prototype experiments. These excellent performances enable the proposed NSGA-II-AGS to be qualified for dealing with the multi-objective optimization problem.
{"title":"Research on extreme obstacle–crossing performance and multi–objective optimization of tracked mobile robot","authors":"Qingjun Song, Chengchun Lu, Qinghui Song, Haiyan Jiang, Bei Liu","doi":"10.1016/j.robot.2024.104759","DOIUrl":"10.1016/j.robot.2024.104759","url":null,"abstract":"<div><p>Stability of obstacle–crossing and structural optimization are important issues in the research of tracked mobile robots. In this paper, in order to fully understand the obstacle–surmounting ability of the robot, the relationship between the position of the center of gravity and the posture of the front and rear swing arms is analyzed. Based on the motion mechanism of the robot crossing obstacles, the geometric model and the dynamic model are established for the key states in the obstacle crossing process. Based on these models, a multi-objective optimization problem for the maximum obstacle–crossing height and minimum driving torque is established during the obstacle crossing process of the robot, which must meet geometric, slip, and stability constraints. To effectively handle the optimization problem of tracked mobile robots, an improved non–dominated sorting genetic algorithm with elite strategy version II based on adaptive genetic strategy (NSGA-II-AGS) is proposed in this paper. Some meaningful relationships between the objective function and the design variables are obtained through sensitivity analysis. Finally, the robot's obstacle-crossing ability was verified through virtual simulation and prototype experiments. These excellent performances enable the proposed NSGA-II-AGS to be qualified for dealing with the multi-objective optimization problem.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"180 ","pages":"Article 104759"},"PeriodicalIF":4.3,"publicationDate":"2024-07-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S092188902400143X/pdfft?md5=cf75de2942464b4261ca7988d24989cb&pid=1-s2.0-S092188902400143X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141851368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-19DOI: 10.1016/j.robot.2024.104760
Gyuree Kang , Hyunki Seong , Daegyu Lee , David Hyunchul Shim
The ability of robots to navigate through doors is crucial for their effective operation in indoor environments. Consequently, extensive research has been conducted to develop robots capable of opening specific doors. However, the diverse combinations of door handles and opening directions necessitate a more versatile door opening system for robots to successfully operate in real-world environments. In this paper, we propose a mobile manipulator system that can autonomously open various doors without prior knowledge. By using convolutional neural networks, point cloud extraction techniques, and external force measurements during exploratory motion, we obtained information regarding handle types, poses, and door characteristics. Through two different approaches, adaptive position-force control and deep reinforcement learning, we successfully opened doors without precise trajectory or excessive external force. The adaptive position-force control method involves moving the end-effector in the direction of the door opening while responding compliantly to external forces, ensuring safety and manipulator workspace. Meanwhile, the deep reinforcement learning policy minimizes applied forces and eliminates unnecessary movements, enabling stable operation across doors with different poses and widths. The RL-based approach outperforms the adaptive position-force control method in terms of compensating for external forces, ensuring smooth motion, and achieving efficient speed. It reduces the maximum force required by 3.27 times and improves motion smoothness by 1.82 times. However, the non-learning-based adaptive position-force control method demonstrates more versatility in opening a wider range of doors, encompassing revolute doors with four distinct opening directions and varying widths.
{"title":"A versatile door opening system with mobile manipulator through adaptive position-force control and reinforcement learning","authors":"Gyuree Kang , Hyunki Seong , Daegyu Lee , David Hyunchul Shim","doi":"10.1016/j.robot.2024.104760","DOIUrl":"10.1016/j.robot.2024.104760","url":null,"abstract":"<div><p>The ability of robots to navigate through doors is crucial for their effective operation in indoor environments. Consequently, extensive research has been conducted to develop robots capable of opening specific doors. However, the diverse combinations of door handles and opening directions necessitate a more versatile door opening system for robots to successfully operate in real-world environments. In this paper, we propose a mobile manipulator system that can autonomously open various doors without prior knowledge. By using convolutional neural networks, point cloud extraction techniques, and external force measurements during exploratory motion, we obtained information regarding handle types, poses, and door characteristics. Through two different approaches, adaptive position-force control and deep reinforcement learning, we successfully opened doors without precise trajectory or excessive external force. The adaptive position-force control method involves moving the end-effector in the direction of the door opening while responding compliantly to external forces, ensuring safety and manipulator workspace. Meanwhile, the deep reinforcement learning policy minimizes applied forces and eliminates unnecessary movements, enabling stable operation across doors with different poses and widths. The RL-based approach outperforms the adaptive position-force control method in terms of compensating for external forces, ensuring smooth motion, and achieving efficient speed. It reduces the maximum force required by 3.27 times and improves motion smoothness by 1.82 times. However, the non-learning-based adaptive position-force control method demonstrates more versatility in opening a wider range of doors, encompassing revolute doors with four distinct opening directions and varying widths.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"180 ","pages":"Article 104760"},"PeriodicalIF":4.3,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141950833","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper presents a novel dynamic motion planner designed to provide safe motions in the context of the Smart Autonomous Robot Assistant Surgeon (SARAS) surgical platform. SARAS is a multi-robot autonomous platform designed to execute auxiliary tasks in Minimally Invasive Surgeries (MIS) with a high degree of autonomy. The development of robotic systems with a high level of autonomy and reliability requires to perceive the workspace and human actions, to contextualize them with the surgical workflow, and, finally, plan and dynamically control the required motions. The autonomous control relies on a multi-level hierarchical Finite State Machine (hFSM) that decides and supervises all robot actions and their transitions. This approach requires multi-granularity decomposition of the surgical procedure and defines different motion profiles to preserve and safely interacts with the patients’ anatomy. The motion planner is developed under the minimally invasive surgery context since it is an extreme use case where the environment is complex, dynamic and unstructured. Moreover, in the SARAS platform the autonomous robots share workspace as well as collaborate with other human-guided robotic instruments. This creates an even more complex working environment and defines a set of hierarchical relationships in which auxiliary instruments have a lower priority. The presented motion planner acts at two levels: Global and Local. The Global Planner generates an initial spline-based trajectory that, defined by a set of Control Points, follows a certain profile determined by the ongoing surgical action and the interaction with the patient’s anatomy. Then, during the execution of the motion, the Local Planner observes the workspace (anatomy and other tools) and applies different virtual potential fields to the control points to dynamically modify their position to avoid potential collisions or tool blocking while maintaining trajectory coherence. At this level, it reactively modifies the trajectory between the tool position and the next control point applying Dynamical Systems based obstacle avoidance. This approach ensures collision free connections between the spline control points. The proposed motion planner is validated in a realistic surgical scenario. The experimental results are analysed from data collected during various Robotic-Assisted Radical Prostatectomy surgeries on manikins, performed with the SARAS SOLO-SURGERY platform: the main surgeon teleoperates a daVinci Research Kit and two robotic arms autonomously perform different auxiliary surgical tasks.
{"title":"Dynamic Global/Local multi-layer motion planner architecture for autonomous Cognitive Surgical Robots","authors":"Narcís Sayols , Albert Hernansanz , Alessio Sozzi , Nicola Piccinelli , Fabio Falezza , Saverio Farsoni , Alícia Casals , Marcello Bonfè , Riccardo Muradore","doi":"10.1016/j.robot.2024.104758","DOIUrl":"10.1016/j.robot.2024.104758","url":null,"abstract":"<div><p>This paper presents a novel dynamic motion planner designed to provide safe motions in the context of the Smart Autonomous Robot Assistant Surgeon (SARAS) surgical platform. SARAS is a multi-robot autonomous platform designed to execute auxiliary tasks in Minimally Invasive Surgeries (MIS) with a high degree of autonomy. The development of robotic systems with a high level of autonomy and reliability requires to perceive the workspace and human actions, to contextualize them with the surgical workflow, and, finally, plan and dynamically control the required motions. The autonomous control relies on a multi-level hierarchical Finite State Machine (hFSM) that decides and supervises all robot actions and their transitions. This approach requires multi-granularity decomposition of the surgical procedure and defines different motion profiles to preserve and safely interacts with the patients’ anatomy. The motion planner is developed under the minimally invasive surgery context since it is an extreme use case where the environment is complex, dynamic and unstructured. Moreover, in the SARAS platform the autonomous robots share workspace as well as collaborate with other human-guided robotic instruments. This creates an even more complex working environment and defines a set of hierarchical relationships in which auxiliary instruments have a lower priority. The presented motion planner acts at two levels: Global and Local. The Global Planner generates an initial spline-based trajectory that, defined by a set of Control Points, follows a certain profile determined by the ongoing surgical action and the interaction with the patient’s anatomy. Then, during the execution of the motion, the Local Planner observes the workspace (anatomy and other tools) and applies different virtual potential fields to the control points to dynamically modify their position to avoid potential collisions or tool blocking while maintaining trajectory coherence. At this level, it reactively modifies the trajectory between the tool position and the next control point applying Dynamical Systems based obstacle avoidance. This approach ensures collision free connections between the spline control points. The proposed motion planner is validated in a realistic surgical scenario. The experimental results are analysed from data collected during various Robotic-Assisted Radical Prostatectomy surgeries on manikins, performed with the SARAS SOLO-SURGERY platform: the main surgeon teleoperates a daVinci Research Kit and two robotic arms autonomously perform different auxiliary surgical tasks.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"180 ","pages":"Article 104758"},"PeriodicalIF":4.3,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0921889024001428/pdfft?md5=8c5ac0ada5183d95b70db4dc25d3cd7c&pid=1-s2.0-S0921889024001428-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141840853","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-18DOI: 10.1016/j.robot.2024.104756
Du Xu , Haijie Mo , Jian Yi , Long Huang , Lairong Yin
This research presents a novel robot system that combines active and passive components to enhance compliance and dependability. The system is based on a continuous variable stiffness wrist. A wrist was created that met the requirements and a combination of active and passive control methods was suggested to insert and regulate forces effectively. The control strategy is based on the Cosserat rod model, with the fundamental concept being calculating the position and orientation of the component using data on the force exerted during contact between the parts and the stiffness of the contact between the shaft and hole components. This process converts the hard assembly into a flexible contact. Compliance is monitored via force and vision sensors, which allows for the shaft-hole assembly operation to be carried out even with attitude alignment problems, resulting in a notable decrease in the precision needed for component alignment. Initially, the camera supplies the first positional data of the shaft component for the robotic system. In addition, the performance of the wrist with variable stiffness is evaluated in terms of stiffness. Additionally, the calculation of relative deformation between components is examined using contact force information. Moreover, a robust active/passive hybrid insertion control technique, which relies on contact force, is proposed. Finally, the shaft-hole assembly task substantiates the necessity for contact force monitoring in the insertion assembly process. This control technique has demonstrated its efficacy in ensuring passive-compliant assembly performance. Furthermore, the variable stiffness wrist has been employed in robotic grinding for surfaces with curved contours to validate its effectiveness.
{"title":"Hybrid compliant control with variable-stiffness wrist for assembly and grinding application","authors":"Du Xu , Haijie Mo , Jian Yi , Long Huang , Lairong Yin","doi":"10.1016/j.robot.2024.104756","DOIUrl":"10.1016/j.robot.2024.104756","url":null,"abstract":"<div><p>This research presents a novel robot system that combines active and passive components to enhance compliance and dependability. The system is based on a continuous variable stiffness wrist. A wrist was created that met the requirements and a combination of active and passive control methods was suggested to insert and regulate forces effectively. The control strategy is based on the Cosserat rod model, with the fundamental concept being calculating the position and orientation of the component using data on the force exerted during contact between the parts and the stiffness of the contact between the shaft and hole components. This process converts the hard assembly into a flexible contact. Compliance is monitored via force and vision sensors, which allows for the shaft-hole assembly operation to be carried out even with attitude alignment problems, resulting in a notable decrease in the precision needed for component alignment. Initially, the camera supplies the first positional data of the shaft component for the robotic system. In addition, the performance of the wrist with variable stiffness is evaluated in terms of stiffness. Additionally, the calculation of relative deformation between components is examined using contact force information. Moreover, a robust active/passive hybrid insertion control technique, which relies on contact force, is proposed. Finally, the shaft-hole assembly task substantiates the necessity for contact force monitoring in the insertion assembly process. This control technique has demonstrated its efficacy in ensuring passive-compliant assembly performance. Furthermore, the variable stiffness wrist has been employed in robotic grinding for surfaces with curved contours to validate its effectiveness.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"180 ","pages":"Article 104756"},"PeriodicalIF":4.3,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141784133","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-14DOI: 10.1016/j.robot.2024.104757
Nicolas Dalmedico , Vinícius de Vargas Terres , Juliano Scholz Slongo , Marco Antônio Simões Teixeira , Flávio Neves Jr. , Lúcia Valéria Ramos de Arruda , Daniel Rodrigues Pipa , Thiago Alberto Rigo Passarin , Carlos Cziulik , Julio Endress Ramos , André Schneider de Oliveira
High-temperature industrial inspection has several challenges, especially if it is an autonomous inspection through mobile robots. This paper introduces the mobile robot CRAS (Climbing Robot for Advanced inSpection) for autonomous non-destructive testing (NDT) of weld beads from industrial super-duplex stainless steel vessels. It covers the design process, previous works, main challenges, and field testing. The main objective of the robot is to perform ultrasonic inspection over a heated separator tank while it operates. The metallic surfaces of the structure to be inspected are under constant high temperatures (80 °C–135 °C) when in operation. CRAS presents magnetic wheels as an adhesion method and a perception system able to identify and follow weld beads. The NDT method uses the phased-array ultrasonic technique. This paper approaches and proposes a solution for three challenges due to the high temperature: the loss of robot adhesion, ultrasound signal deformation, and the risk of damaging sensitive equipment such as sensors, cameras, and any electronic component. The CRAS adopted solutions are detailed and future steps of CRAS development are also addressed.
{"title":"Climbing robot for advanced high-temperature weld bead inspection","authors":"Nicolas Dalmedico , Vinícius de Vargas Terres , Juliano Scholz Slongo , Marco Antônio Simões Teixeira , Flávio Neves Jr. , Lúcia Valéria Ramos de Arruda , Daniel Rodrigues Pipa , Thiago Alberto Rigo Passarin , Carlos Cziulik , Julio Endress Ramos , André Schneider de Oliveira","doi":"10.1016/j.robot.2024.104757","DOIUrl":"10.1016/j.robot.2024.104757","url":null,"abstract":"<div><p>High-temperature industrial inspection has several challenges, especially if it is an autonomous inspection through mobile robots. This paper introduces the mobile robot CRAS (Climbing Robot for Advanced inSpection) for autonomous non-destructive testing (NDT) of weld beads from industrial super-duplex stainless steel vessels. It covers the design process, previous works, main challenges, and field testing. The main objective of the robot is to perform ultrasonic inspection over a heated separator tank while it operates. The metallic surfaces of the structure to be inspected are under constant high temperatures (80 °C–135 °C) when in operation. CRAS presents magnetic wheels as an adhesion method and a perception system able to identify and follow weld beads. The NDT method uses the phased-array ultrasonic technique. This paper approaches and proposes a solution for three challenges due to the high temperature: the loss of robot adhesion, ultrasound signal deformation, and the risk of damaging sensitive equipment such as sensors, cameras, and any electronic component. The CRAS adopted solutions are detailed and future steps of CRAS development are also addressed.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"180 ","pages":"Article 104757"},"PeriodicalIF":4.3,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141697777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-09DOI: 10.1016/j.robot.2024.104753
Ahmed Abdelsalam , Mostafa Mansour , Jari Porras , Ari Happonen
Accurate depth information is crucial for autonomous systems to navigate and interact safely with their surroundings. Passive stereo-vision cameras, such as the ZED 2i, obtain depth information through stereo-image analysis and triangulation. The study measures and assesses the true capabilities of the ZED 2i camera in a real indoor office environment. Furthermore, the study provides a standard test setup to reproduce similar benchmarks with different depth cameras. To achieve the set goals, an experiment was devised and carried out in an office environment to determine the camera depth error and Root Mean Square Error (RMSE) of the depth estimates at different distances using four different image resolutions. The results reveal that the depth error has heavy tails, implying that outliers substantially impact accuracy. Hence, depth errors should not be modeled as normally distributed errors. Moreover, only two out of four resolutions provided the capability of acquiring depth data up to 18 m. These insights provide guidelines for understanding the ZED 2i camera's true capabilities, determining its suitability for different applications and environments, and giving baselines for future tests of other competing sensor units. Furthermore, the study offers a simple, inexpensive, and laboratory space-free, yet effective setup that does not need extensive equipment or complex configurations to facilitate the benchmarking of depth cameras in different working environments.
{"title":"Depth accuracy analysis of the ZED 2i Stereo Camera in an indoor Environment","authors":"Ahmed Abdelsalam , Mostafa Mansour , Jari Porras , Ari Happonen","doi":"10.1016/j.robot.2024.104753","DOIUrl":"10.1016/j.robot.2024.104753","url":null,"abstract":"<div><p>Accurate depth information is crucial for autonomous systems to navigate and interact safely with their surroundings. Passive stereo-vision cameras, such as the ZED 2i, obtain depth information through stereo-image analysis and triangulation. The study measures and assesses the true capabilities of the ZED 2i camera in a real indoor office environment. Furthermore, the study provides a standard test setup to reproduce similar benchmarks with different depth cameras. To achieve the set goals, an experiment was devised and carried out in an office environment to determine the camera depth error and Root Mean Square Error (RMSE) of the depth estimates at different distances using four different image resolutions. The results reveal that the depth error has heavy tails, implying that outliers substantially impact accuracy. Hence, depth errors should not be modeled as normally distributed errors. Moreover, only two out of four resolutions provided the capability of acquiring depth data up to 18 m. These insights provide guidelines for understanding the ZED 2i camera's true capabilities, determining its suitability for different applications and environments, and giving baselines for future tests of other competing sensor units. Furthermore, the study offers a simple, inexpensive, and laboratory space-free, yet effective setup that does not need extensive equipment or complex configurations to facilitate the benchmarking of depth cameras in different working environments.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"179 ","pages":"Article 104753"},"PeriodicalIF":4.3,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0921889024001374/pdfft?md5=78c013418bab605b62edc7c64d077911&pid=1-s2.0-S0921889024001374-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141636731","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-09DOI: 10.1016/j.robot.2024.104752
Khattiya Pongsirijinda , Zhiqiang Cao , Kaushik Bhowmik , Muhammad Shalihan , Billy Pik Lik Lau , Ran Liu , Chau Yuen , U-Xuan Tan
Multi-robot collaboration has become a needed component in unknown environment exploration due to its ability to accomplish various challenging situations. Potential-field-based methods are widely used for autonomous exploration because of their high efficiency and low travel cost. However, exploration speed and collaboration ability are still challenging topics. Therefore, we propose a Distributed Multi-Robot Potential-Field-Based Exploration (DMPF-Explore). In particular, we first present a Distributed Submap-Based Multi-Robot Collaborative Mapping Method (DSMC-Map), which can efficiently estimate the robot trajectories and construct the global map by merging the local maps from each robot. Second, we introduce a Potential-Field-Based Exploration Strategy Augmented with Modified Wave-Front Distance and Colored Noises (MWF-CN), in which the accessible frontier neighborhood is extended, and the colored noise provokes the enhancement of exploration performance. The proposed exploration method is deployed for simulation and real-world scenarios. The results show that our approach outperforms the existing ones regarding exploration speed and collaboration ability.
{"title":"Distributed multi-robot potential-field-based exploration with submap-based mapping and noise-augmented strategy","authors":"Khattiya Pongsirijinda , Zhiqiang Cao , Kaushik Bhowmik , Muhammad Shalihan , Billy Pik Lik Lau , Ran Liu , Chau Yuen , U-Xuan Tan","doi":"10.1016/j.robot.2024.104752","DOIUrl":"10.1016/j.robot.2024.104752","url":null,"abstract":"<div><p>Multi-robot collaboration has become a needed component in unknown environment exploration due to its ability to accomplish various challenging situations. Potential-field-based methods are widely used for autonomous exploration because of their high efficiency and low travel cost. However, exploration speed and collaboration ability are still challenging topics. Therefore, we propose a <u>D</u>istributed <u>M</u>ulti-Robot <u>P</u>otential-<u>F</u>ield-Based Exploration (DMPF-Explore). In particular, we first present a <u>D</u>istributed <u>S</u>ubmap-Based <u>M</u>ulti-Robot <u>C</u>ollaborative Mapping Method (DSMC-Map), which can efficiently estimate the robot trajectories and construct the global map by merging the local maps from each robot. Second, we introduce a Potential-Field-Based Exploration Strategy Augmented with <u>M</u>odified <u>W</u>ave-<u>F</u>ront Distance and <u>C</u>olored <u>N</u>oises (MWF-CN), in which the accessible frontier neighborhood is extended, and the colored noise provokes the enhancement of exploration performance. The proposed exploration method is deployed for simulation and real-world scenarios. The results show that our approach outperforms the existing ones regarding exploration speed and collaboration ability.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"179 ","pages":"Article 104752"},"PeriodicalIF":4.3,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141630666","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article presents GLIM, a 3D range-inertial localization and mapping framework with GPU-accelerated scan matching factors. The odometry estimation module of GLIM employs a combination of fixed-lag smoothing and keyframe-based point cloud matching that makes it possible to deal with a few seconds of completely degenerated range data while efficiently reducing trajectory estimation drift. It also incorporates multi-camera visual feature constraints in a tightly coupled way to further improve the stability and accuracy. The global trajectory optimization module directly minimizes the registration errors between submaps over the entire map. This approach enables us to accurately constrain the relative pose between submaps with a small overlap. Although both the odometry estimation and global trajectory optimization algorithms require much more computation than existing methods, we show that they can be run in real-time due to the careful design of the registration error evaluation algorithm and the entire system to fully leverage GPU parallel processing.
{"title":"GLIM: 3D range-inertial localization and mapping with GPU-accelerated scan matching factors","authors":"Kenji Koide, Masashi Yokozuka, Shuji Oishi, Atsuhiko Banno","doi":"10.1016/j.robot.2024.104750","DOIUrl":"https://doi.org/10.1016/j.robot.2024.104750","url":null,"abstract":"<div><p>This article presents GLIM, a 3D range-inertial localization and mapping framework with GPU-accelerated scan matching factors. The odometry estimation module of GLIM employs a combination of fixed-lag smoothing and keyframe-based point cloud matching that makes it possible to deal with a few seconds of completely degenerated range data while efficiently reducing trajectory estimation drift. It also incorporates multi-camera visual feature constraints in a tightly coupled way to further improve the stability and accuracy. The global trajectory optimization module directly minimizes the registration errors between submaps over the entire map. This approach enables us to accurately constrain the relative pose between submaps with a small overlap. Although both the odometry estimation and global trajectory optimization algorithms require much more computation than existing methods, we show that they can be run in real-time due to the careful design of the registration error evaluation algorithm and the entire system to fully leverage GPU parallel processing.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"179 ","pages":"Article 104750"},"PeriodicalIF":4.3,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141606690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-05DOI: 10.1016/j.robot.2024.104751
Ying Liu , Yuwen Li
Although industrial robots have been successfully used in a wide spectrum of applications for production automation, they still face challenges for many high precision tasks especially in low-volume high-mix production due to their low absolute positioning accuracy. To respond to such rapidly changing production tasks, an efficient means is required to determine the pose relationship between the robot and the workpiece without human intervention such as teaching the robot. For this purpose, the paper proposes the use of the Extended Kalman Filter (EKF) with an optical tracking system to improve the robot positioning accuracy with a particular focus on the target point tracking of the end-of-arm tool, which is an essential part for many robotic tasks. To this end, a comprehensive kinematic error model is first derived for the end-of-arm tool that accounts for the errors in the Denavit-Hartenberg (D-H) parameters, the positioning errors of the robot base and the end-of-arm tool installation. Then, by using the optical tracking system, the pose of the end-of-arm tool relative to the workpiece can be determined in an efficient way. Based on the EKF algorithm, the kinematic parameter errors of the system can be estimated online to compensate the positioning error of the target point during the robot movement. Simulation and experimental tests have been performed to demonstrate the effectiveness of the proposed method. The proposed approach utilizes the given trajectory to design a compensation scheme where the kinematic parameter errors of the robot are estimated during the motion and then the positioning error of the end-of-arm tool is compensated at the target point. As a result, this approach can improve the target point accuracy of the robot without continuous feedback to reduce the tracking error along the trajectory in real time. It is easy to implement and suitable for low-volume, high-mix scenarios to determine the pose relationship between the robot and the workpiece without human intervention.
{"title":"Positioning accuracy improvement for target point tracking of robots based on Extended Kalman Filter with an optical tracking system","authors":"Ying Liu , Yuwen Li","doi":"10.1016/j.robot.2024.104751","DOIUrl":"10.1016/j.robot.2024.104751","url":null,"abstract":"<div><p>Although industrial robots have been successfully used in a wide spectrum of applications for production automation, they still face challenges for many high precision tasks especially in low-volume high-mix production due to their low absolute positioning accuracy. To respond to such rapidly changing production tasks, an efficient means is required to determine the pose relationship between the robot and the workpiece without human intervention such as teaching the robot. For this purpose, the paper proposes the use of the Extended Kalman Filter (EKF) with an optical tracking system to improve the robot positioning accuracy with a particular focus on the target point tracking of the end-of-arm tool, which is an essential part for many robotic tasks. To this end, a comprehensive kinematic error model is first derived for the end-of-arm tool that accounts for the errors in the Denavit-Hartenberg (D-H) parameters, the positioning errors of the robot base and the end-of-arm tool installation. Then, by using the optical tracking system, the pose of the end-of-arm tool relative to the workpiece can be determined in an efficient way. Based on the EKF algorithm, the kinematic parameter errors of the system can be estimated online to compensate the positioning error of the target point during the robot movement. Simulation and experimental tests have been performed to demonstrate the effectiveness of the proposed method. The proposed approach utilizes the given trajectory to design a compensation scheme where the kinematic parameter errors of the robot are estimated during the motion and then the positioning error of the end-of-arm tool is compensated at the target point. As a result, this approach can improve the target point accuracy of the robot without continuous feedback to reduce the tracking error along the trajectory in real time. It is easy to implement and suitable for low-volume, high-mix scenarios to determine the pose relationship between the robot and the workpiece without human intervention.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"179 ","pages":"Article 104751"},"PeriodicalIF":4.3,"publicationDate":"2024-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141696213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-05DOI: 10.1016/j.robot.2024.104749
Sijun Ryu, Jeeho Won, TaeWon Seo
In this paper, the performance criteria for various four-wheeled mobile robots that are crucial for assessing a robot’s fitness for mobility to successfully complete missions are introduced. The seven proposed performance indices, the root mean squared acceleration (RMSA), posture variance index (PVI), static stability margin (SSM), force angle stability margin (FASM), energy stability margin (ESM), friction requirement (), and velocity constraint violation (VCV), address the fluctuation, rollover, and slippage problems in four-wheeled mobile robots. The simulations considered a square bump-shaped obstacle, and the dimensions of the robot were based on nine simulation cases in a 3D environment. Additionally, a methodology for evaluating these seven criteria is outlined. To streamline the simulation process, Taguchi’s catalog of orthogonal arrays (OAs) was used for the experimental design, specifically L9 OA with four factors and three levels was used. Analysis of means (ANOM) was applied to assess the influence of each design factor on the seven criteria, leveraging the OA orthogonality. Finally, the sensitivity analysis and potential for evaluating general mobile robots in the future are discussed.
本文介绍了各种四轮移动机器人的性能标准,这些标准对于评估机器人是否适合移动以成功完成任务至关重要。针对四轮移动机器人的波动、翻滚和打滑问题,提出了七个性能指标,即加速度均方根(RMSA)、姿态方差指数(PVI)、静态稳定裕度(SSM)、力角稳定裕度(FASM)、能量稳定裕度(ESM)、摩擦要求(μr)和速度约束违反(VCV)。模拟考虑了一个正方形凹凸形状的障碍物,机器人的尺寸基于三维环境中的九个模拟案例。此外,还概述了评估这七项标准的方法。为了简化模拟过程,实验设计采用了田口的正交阵列(OA)目录,特别是采用了包含四个因素和三个水平的 L9 OA。利用 OA 的正交性,采用均值分析(ANOM)来评估每个设计因素对七项标准的影响。最后,讨论了敏感性分析和未来评估一般移动机器人的潜力。
{"title":"Simulation study on four-wheeled mobile robot mechanisms using various performance criteria","authors":"Sijun Ryu, Jeeho Won, TaeWon Seo","doi":"10.1016/j.robot.2024.104749","DOIUrl":"https://doi.org/10.1016/j.robot.2024.104749","url":null,"abstract":"<div><p>In this paper, the performance criteria for various four-wheeled mobile robots that are crucial for assessing a robot’s fitness for mobility to successfully complete missions are introduced. The seven proposed performance indices, the root mean squared acceleration (RMSA), posture variance index (PVI), static stability margin (SSM), force angle stability margin (FASM), energy stability margin (ESM), friction requirement (<span><math><msub><mrow><mi>μ</mi></mrow><mrow><mi>r</mi></mrow></msub></math></span>), and velocity constraint violation (VCV), address the fluctuation, rollover, and slippage problems in four-wheeled mobile robots. The simulations considered a square bump-shaped obstacle, and the dimensions of the robot were based on nine simulation cases in a 3D environment. Additionally, a methodology for evaluating these seven criteria is outlined. To streamline the simulation process, Taguchi’s catalog of orthogonal arrays (OAs) was used for the experimental design, specifically L9 OA with four factors and three levels was used. Analysis of means (ANOM) was applied to assess the influence of each design factor on the seven criteria, leveraging the OA orthogonality. Finally, the sensitivity analysis and potential for evaluating general mobile robots in the future are discussed.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":"179 ","pages":"Article 104749"},"PeriodicalIF":4.3,"publicationDate":"2024-07-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141606689","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}