In order to solve the problem of poor performance of traditional point feature algorithm under low texture and poor illumination, this paper presents a new visual SLAM method based on point–line fusion of line structure constraint. This method first uses an algorithm for homogeneity to process the extracted point features, solving the traditional problem of excessive aggregation and overlap of corner points, which makes the visual front end better able to obtain environmental information. In addition, improved line extraction method algorithm by using the strategy of eliminating the line length makes the line extraction performance twice as efficient as the LSD algorithm, the optical flow tracking algorithm is used to replace the traditional matching algorithm to reduce the running time of the system. In particular, the paper proposes a new constraint on the position of the spatially extracted lines, using the parallelism of 3D lines to correct for degraded lines in the projection process, and adding a new constraint on the line structure to the error function of the whole system, the newly constructed error function is optimized by sliding window, which significantly improves the accuracy and completeness of the whole system in constructing maps. Finally, the performance of the algorithm was tested on a publicly available dataset. The experimental results show that our algorithm performs well in point extraction and matching, the proposed point–line fusion system is better than the popular VINS-mono and PL-VINS algorithms in terms of running time, quality of information obtained, and positioning accuracy.
{"title":"Real-time monocular visual–inertial SLAM with structural constraints of line and point–line fusion","authors":"Shaoshao Wang, Aihua Zhang, Zhiqiang Zhang, Xudong Zhao","doi":"10.1007/s11370-023-00492-4","DOIUrl":"https://doi.org/10.1007/s11370-023-00492-4","url":null,"abstract":"<p>In order to solve the problem of poor performance of traditional point feature algorithm under low texture and poor illumination, this paper presents a new visual SLAM method based on point–line fusion of line structure constraint. This method first uses an algorithm for homogeneity to process the extracted point features, solving the traditional problem of excessive aggregation and overlap of corner points, which makes the visual front end better able to obtain environmental information. In addition, improved line extraction method algorithm by using the strategy of eliminating the line length makes the line extraction performance twice as efficient as the LSD algorithm, the optical flow tracking algorithm is used to replace the traditional matching algorithm to reduce the running time of the system. In particular, the paper proposes a new constraint on the position of the spatially extracted lines, using the parallelism of 3D lines to correct for degraded lines in the projection process, and adding a new constraint on the line structure to the error function of the whole system, the newly constructed error function is optimized by sliding window, which significantly improves the accuracy and completeness of the whole system in constructing maps. Finally, the performance of the algorithm was tested on a publicly available dataset. The experimental results show that our algorithm performs well in point extraction and matching, the proposed point–line fusion system is better than the popular VINS-mono and PL-VINS algorithms in terms of running time, quality of information obtained, and positioning accuracy.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"142 ","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138505076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-12-02DOI: 10.1007/s11370-023-00493-3
Rogério S. Gonçalves, Talles M. de Carvalho, Pablo B. dos Santos, Frederico C. Souza, Carlos Alberto Gallo, Daniel E. T. Sudbrack, Paulo Victor Trautmann, Bruno C. Clasen, Rafael Z. Homma
To enhance the safety of our airspace, it is essential to implement devices along overhead power lines that effectively reduce the likelihood of collisions involving aircraft, helicopters, balloons, and other airborne objects. Aerial marker balls, which adhere to technical standards concerning their geometry and characteristics, are commonly used for aerial signaling on power transmission systems. Currently, aerial marker balls are installed by technicians either via helicopter or by utilizing ropes to perform the task manually. This process results in significant expenses and exposes the technicians to considerable risk. While robotic methods have been explored, they often present impractical challenges. Despite the advancements in various techniques, difficulties persist in this field. The primary objective of this paper is to design and develop a robotic module that can be attached to a drone, enabling the semi-automated installation of aerial marker balls. The robot model was designed using Computer Aided Design and Computer Aided Engineering software’s, with a subsequent description of the control system. After constructing the drone-robot, it was tested in a simulated environment, proving to be both efficient and cost-effective. This innovative approach improves not only the cost-effectiveness of aerial marker ball installation but also the safety of technicians involved in the process.
{"title":"Drone-robot to install aerial marker balls for power lines","authors":"Rogério S. Gonçalves, Talles M. de Carvalho, Pablo B. dos Santos, Frederico C. Souza, Carlos Alberto Gallo, Daniel E. T. Sudbrack, Paulo Victor Trautmann, Bruno C. Clasen, Rafael Z. Homma","doi":"10.1007/s11370-023-00493-3","DOIUrl":"https://doi.org/10.1007/s11370-023-00493-3","url":null,"abstract":"<p>To enhance the safety of our airspace, it is essential to implement devices along overhead power lines that effectively reduce the likelihood of collisions involving aircraft, helicopters, balloons, and other airborne objects. Aerial marker balls, which adhere to technical standards concerning their geometry and characteristics, are commonly used for aerial signaling on power transmission systems. Currently, aerial marker balls are installed by technicians either via helicopter or by utilizing ropes to perform the task manually. This process results in significant expenses and exposes the technicians to considerable risk. While robotic methods have been explored, they often present impractical challenges. Despite the advancements in various techniques, difficulties persist in this field. The primary objective of this paper is to design and develop a robotic module that can be attached to a drone, enabling the semi-automated installation of aerial marker balls. The robot model was designed using Computer Aided Design and Computer Aided Engineering software’s, with a subsequent description of the control system. After constructing the drone-robot, it was tested in a simulated environment, proving to be both efficient and cost-effective. This innovative approach improves not only the cost-effectiveness of aerial marker ball installation but also the safety of technicians involved in the process. </p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"29 1","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138543653","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-24DOI: 10.1007/s11370-023-00491-5
Binzhao Xu, Taimur Hassan, Irfan Hussain
Currently, most grasping systems are designed to grasp the static objects only, and grasping dynamic objects has received less attention in the literature. For the traditional manipulation scheme, achieving dynamic grasping requires either a highly precise dynamic model or sophisticated predefined grasping states and gestures, both of which are hard to obtain and tedious to design. In this paper, we develop a novel reinforcement learning (RL)-based dynamic grasping framework with a trajectory prediction module to address these issues. In particular, we divide dynamic grasping into two parts: RL-based grasping strategies learning and trajectory prediction. In the simulation setting, an RL agent is trained to grasp a static object. When this well-trained agent is transferred to the real world, the observation has been augmented with the predicted one from an LSTM-based trajectory prediction module. We validated the proposed method through an experimental setup involving a Baxter manipulator with two finger grippers and an object placed on a moving car. We also evaluated how well RL performs both with and without our intended trajectory prediction. Experiment results demonstrate that our method can grasp the object on different trajectories at various speeds.
{"title":"Improving reinforcement learning based moving object grasping with trajectory prediction","authors":"Binzhao Xu, Taimur Hassan, Irfan Hussain","doi":"10.1007/s11370-023-00491-5","DOIUrl":"https://doi.org/10.1007/s11370-023-00491-5","url":null,"abstract":"<p>Currently, most grasping systems are designed to grasp the static objects only, and grasping dynamic objects has received less attention in the literature. For the traditional manipulation scheme, achieving dynamic grasping requires either a highly precise dynamic model or sophisticated predefined grasping states and gestures, both of which are hard to obtain and tedious to design. In this paper, we develop a novel reinforcement learning (RL)-based dynamic grasping framework with a trajectory prediction module to address these issues. In particular, we divide dynamic grasping into two parts: RL-based grasping strategies learning and trajectory prediction. In the simulation setting, an RL agent is trained to grasp a static object. When this well-trained agent is transferred to the real world, the observation has been augmented with the predicted one from an LSTM-based trajectory prediction module. We validated the proposed method through an experimental setup involving a Baxter manipulator with two finger grippers and an object placed on a moving car. We also evaluated how well RL performs both with and without our intended trajectory prediction. Experiment results demonstrate that our method can grasp the object on different trajectories at various speeds.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"23 10","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138505070","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-11-20DOI: 10.1007/s11370-023-00490-6
Jian Song, Yutian Chen, Xun Liu, Nan Zheng
A rapid and accurate localization scheme is significant for the application of autonomous robots in a prior map. However, this task remains challenging in the real-time requirement due to the complex scan matching. This paper proposes an efficient LiDAR/inertial-based localization method that simplifies the process of scan matching. Firstly, it constructs KD-tree architectures for the prior map in advance and selects sparse point cloud as local map through a novel refined neighborhood search. Then, to ensure the reliability of localization, this method removes the dynamic points in the prior map by the comparison between newly laser scan and the local map. The pose transformation is calculated by the scan matching of edge and planar points from static objects. Finally, this method introduces a uniform motion model to correct the wrong initial guess from incorrect inertial data pre-integration. Three prior maps are collected from typical scenarios through intelligent inspection robot to verify the robustness of proposed method. Experimental results show that the proposed method not only achieves high accuracy of centimeter-level deviation in localization, but takes less than 0.01 s to complete the pose matching when the LiDAR rate is 20 Hz.
{"title":"Efficient LiDAR/inertial-based localization with prior map for autonomous robots","authors":"Jian Song, Yutian Chen, Xun Liu, Nan Zheng","doi":"10.1007/s11370-023-00490-6","DOIUrl":"https://doi.org/10.1007/s11370-023-00490-6","url":null,"abstract":"<p>A rapid and accurate localization scheme is significant for the application of autonomous robots in a prior map. However, this task remains challenging in the real-time requirement due to the complex scan matching. This paper proposes an efficient LiDAR/inertial-based localization method that simplifies the process of scan matching. Firstly, it constructs KD-tree architectures for the prior map in advance and selects sparse point cloud as local map through a novel refined neighborhood search. Then, to ensure the reliability of localization, this method removes the dynamic points in the prior map by the comparison between newly laser scan and the local map. The pose transformation is calculated by the scan matching of edge and planar points from static objects. Finally, this method introduces a uniform motion model to correct the wrong initial guess from incorrect inertial data pre-integration. Three prior maps are collected from typical scenarios through intelligent inspection robot to verify the robustness of proposed method. Experimental results show that the proposed method not only achieves high accuracy of centimeter-level deviation in localization, but takes less than 0.01 s to complete the pose matching when the LiDAR rate is 20 Hz.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"23 6","pages":""},"PeriodicalIF":2.5,"publicationDate":"2023-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138505071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-10-25DOI: 10.1007/s11370-023-00487-1
Altair Coutinho, Sarang Kim, Hugo Rodrigue
{"title":"Reinforced bidirectional artificial muscles: enhancing force and stability for soft robotics","authors":"Altair Coutinho, Sarang Kim, Hugo Rodrigue","doi":"10.1007/s11370-023-00487-1","DOIUrl":"https://doi.org/10.1007/s11370-023-00487-1","url":null,"abstract":"","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"46 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135113696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-27DOI: 10.1007/s11370-023-00483-5
Haeun Park, Jiyeon Lee, Temirlan Dzhoroev, Byounghern Kim, Hui Sung Lee
{"title":"Expanded linear dynamic affect-expression model for lingering emotional expression in social robot","authors":"Haeun Park, Jiyeon Lee, Temirlan Dzhoroev, Byounghern Kim, Hui Sung Lee","doi":"10.1007/s11370-023-00483-5","DOIUrl":"https://doi.org/10.1007/s11370-023-00483-5","url":null,"abstract":"","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"43 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135538071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2023-09-22DOI: 10.1007/s11370-023-00485-3
Lucrezia Grassi, Carmine Tommaso Recchiuto, Antonio Sgorbissa
{"title":"Sustainable cloud services for verbal interaction with embodied agents","authors":"Lucrezia Grassi, Carmine Tommaso Recchiuto, Antonio Sgorbissa","doi":"10.1007/s11370-023-00485-3","DOIUrl":"https://doi.org/10.1007/s11370-023-00485-3","url":null,"abstract":"","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":"84 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-09-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136059007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}