Huijie Dong, Zhipeng Ji, Yan Meng, Di Chen, Tiezhu Qiao, Junzhi Yu
Similar to other underwater robots, bionic robotic fish face entrapment risks when stranded due to wave action or water level drop. In this paper, we propose a locomotion strategy for a whale shark-inspired robotic fish, enabling it to autonomously return to aquatic environments after being stranded on land. This strategy is informed by the terrestrial locomotion capabilities of mudskippers and is particularly significant given the considerable mass of such robotic fish, which compounds the difficulty of land-based movement. First, we introduce a lightweight YOLOv5 model-based algorithm for deep-water area recognition, which identifies the direction for the bionic robot fish to re-enter the water. Subsequently, pectoral fin-based crawling gaits are designed by the innate two degrees of freedom within the existing pectoral fin structure of the robot. These gaits empower the robotic fish to move on a multitude of terrestrial terrains. Extended field experiments have validated the effectiveness of our water recognition algorithm and locomotion strategy, confirming the ability of the whale shark-inspired robotic fish to perform successful water entry maneuvers from the shore. Additionally, the capability to traverse various landforms are also verified. This work provides valuable insights into self-rescue mechanisms for stranding underwater robots and promotes practical applications of bionic robotics.
{"title":"Water entry locomotion strategy for a stranding bionic robotic fish","authors":"Huijie Dong, Zhipeng Ji, Yan Meng, Di Chen, Tiezhu Qiao, Junzhi Yu","doi":"10.1002/rob.22352","DOIUrl":"10.1002/rob.22352","url":null,"abstract":"<p>Similar to other underwater robots, bionic robotic fish face entrapment risks when stranded due to wave action or water level drop. In this paper, we propose a locomotion strategy for a whale shark-inspired robotic fish, enabling it to autonomously return to aquatic environments after being stranded on land. This strategy is informed by the terrestrial locomotion capabilities of mudskippers and is particularly significant given the considerable mass of such robotic fish, which compounds the difficulty of land-based movement. First, we introduce a lightweight YOLOv5 model-based algorithm for deep-water area recognition, which identifies the direction for the bionic robot fish to re-enter the water. Subsequently, pectoral fin-based crawling gaits are designed by the innate two degrees of freedom within the existing pectoral fin structure of the robot. These gaits empower the robotic fish to move on a multitude of terrestrial terrains. Extended field experiments have validated the effectiveness of our water recognition algorithm and locomotion strategy, confirming the ability of the whale shark-inspired robotic fish to perform successful water entry maneuvers from the shore. Additionally, the capability to traverse various landforms are also verified. This work provides valuable insights into self-rescue mechanisms for stranding underwater robots and promotes practical applications of bionic robotics.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 8","pages":"2493-2505"},"PeriodicalIF":4.2,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140630726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Chengxi Wu, Hamid Reza Karimi, Liang Shan, Yuewei Dai
This paper investigates the cooperative trajectory tracking (CTT) control problem of multiple autonomous underwater vehicles (AUVs). The multi-AUV system is characterized by uncertain dynamics, being subjected to the impact about input saturation constraints and unmeasurable disturbances. First, a neural network-based data-driven control algorithm is proposed for the multi-AUV system with unmeasurable disturbances and model parameters uncertain. The radial basis function neural network is employed to estimate the primary pseudo parameters of an equivalent data model, established through dynamic linearization methods. Subsequently, an iterative learning control approach based on adaptive gain is designed to act as a feedforward scheme along the iteration axis to enhance the tracking accuracy within a time constraint. Third, to prove that the resulting CTT control system fulfills the bounded stability under the proposed control approach, a formal stability analysis is provided. Finally, a simulation case study is conducted to illustrate the effectiveness of the proposed CTT control approach.
{"title":"Data-driven iterative learning cooperative trajectory tracking control for multiple autonomous underwater vehicles with input saturation constraints","authors":"Chengxi Wu, Hamid Reza Karimi, Liang Shan, Yuewei Dai","doi":"10.1002/rob.22343","DOIUrl":"10.1002/rob.22343","url":null,"abstract":"<p>This paper investigates the cooperative trajectory tracking (CTT) control problem of multiple autonomous underwater vehicles (AUVs). The multi-AUV system is characterized by uncertain dynamics, being subjected to the impact about input saturation constraints and unmeasurable disturbances. First, a neural network-based data-driven control algorithm is proposed for the multi-AUV system with unmeasurable disturbances and model parameters uncertain. The radial basis function neural network is employed to estimate the primary pseudo parameters of an equivalent data model, established through dynamic linearization methods. Subsequently, an iterative learning control approach based on adaptive gain is designed to act as a feedforward scheme along the iteration axis to enhance the tracking accuracy within a time constraint. Third, to prove that the resulting CTT control system fulfills the bounded stability under the proposed control approach, a formal stability analysis is provided. Finally, a simulation case study is conducted to illustrate the effectiveness of the proposed CTT control approach.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 7","pages":"2475-2487"},"PeriodicalIF":4.2,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140578620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Bryce Doerr, Keenan Albee, Monica Ekal, Rodrigo Ventura, Richard Linares
On-orbit close proximity operations involve robotic spacecraft maneuvering and making decisions for a growing number of mission scenarios demanding autonomy, including on-orbit assembly, repair, and astronaut assistance. Of these scenarios, on-orbit assembly is an enabling technology that will allow large space structures to be built in situ, using smaller building block modules. However, like many of these scenarios, robotic on-orbit assembly involves several technical hurdles, such as changing system models. For instance, grappled modules moved by a free-flying “assembler” robot can cause significant changes in the combined system inertia, which have cascading impacts on motion planning and control portions of the autonomy stack. Further, on-orbit assembly and other scenarios require collision-avoiding motion planning, particularly when operating in a “construction site” scenario of multiple assembler robots and structures. Multiple key technologies that address these complicating factors for autonomous microgravity close proximity operations are detailed in this work, in particular: (1) application of global long-horizon planning, accomplished using offline and online sampling-based planner options that consider the system dynamics; (2) adaptation of the recently proposed RATTLE information-aware planning framework for on-orbit reconfiguration model learning; and (3) connection with robust control tools to provide low-level control robustness using current system knowledge. These approaches were demonstrated for an autonomous on-orbit assembly use case by the RElative Satellite sWarming and Robotic Maneuvering (ReSWARM) experiments using NASA's Astrobee robots on the International Space Station. Results of the ReSWARM experiments are provided along with significant operational and implementation detail discussing the practicalities of hardware implementation and unique aspects of working with the Astrobee free-flyer robots in microgravity. ReSWARM provides a base set of planning and control tools for robotic close proximity operations, demonstrates them in microgravity, and outlines some of the important hardware aspects that future autonomous free-flyers will need to consider.
{"title":"The ReSWARM microgravity flight experiments: Planning, control, and model estimation for on-orbit close proximity operations","authors":"Bryce Doerr, Keenan Albee, Monica Ekal, Rodrigo Ventura, Richard Linares","doi":"10.1002/rob.22308","DOIUrl":"10.1002/rob.22308","url":null,"abstract":"<p>On-orbit close proximity operations involve robotic spacecraft maneuvering and making decisions for a growing number of mission scenarios demanding autonomy, including on-orbit assembly, repair, and astronaut assistance. Of these scenarios, on-orbit assembly is an enabling technology that will allow large space structures to be built in situ, using smaller building block modules. However, like many of these scenarios, robotic on-orbit assembly involves several technical hurdles, such as changing system models. For instance, grappled modules moved by a free-flying “assembler” robot can cause significant changes in the combined system inertia, which have cascading impacts on motion planning and control portions of the autonomy stack. Further, on-orbit assembly and other scenarios require collision-avoiding motion planning, particularly when operating in a “construction site” scenario of multiple assembler robots and structures. Multiple key technologies that address these complicating factors for autonomous microgravity close proximity operations are detailed in this work, in particular: (1) application of global long-horizon planning, accomplished using offline and online sampling-based planner options that consider the system dynamics; (2) adaptation of the recently proposed RATTLE information-aware planning framework for on-orbit reconfiguration model learning; and (3) connection with robust control tools to provide low-level control robustness using current system knowledge. These approaches were demonstrated for an autonomous on-orbit assembly use case by the RElative Satellite sWarming and Robotic Maneuvering (ReSWARM) experiments using NASA's Astrobee robots on the International Space Station. Results of the ReSWARM experiments are provided along with significant operational and implementation detail discussing the practicalities of hardware implementation and unique aspects of working with the Astrobee free-flyer robots in microgravity. ReSWARM provides a base set of planning and control tools for robotic close proximity operations, demonstrates them in microgravity, and outlines some of the important hardware aspects that future autonomous free-flyers will need to consider.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 6","pages":"1645-1679"},"PeriodicalIF":4.2,"publicationDate":"2024-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22308","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This paper focuses on the Light Detection and Ranging (LiDAR)–Inertial Measurement Unit (IMU) simultaneous localization and mapping (SLAM) problem: How to fuse the sensor measurement from the LiDAR and IMU to online estimate robot's poses and build a consistent map of the environment. This paper presents LTA-OM: an efficient, robust, and accurate LiDAR SLAM system. Employing fast direct LiDAR-inertial odometry (FAST-LIO2) and Stable Triangle Descriptor as LiDAR–IMU odometry and the loop detection method, respectively, LTA-OM is implemented to be functionally complete, including loop detection and correction, false-positive loop closure rejection, long-term association (LTA) mapping, and multisession localization and mapping. One novelty of this paper is the real-time LTA mapping, which exploits the direct scan-to-map registration of FAST-LIO2 and employs the corrected history map to provide direct global constraints to the LIO mapping process. LTA mapping also has the notable advantage of achieving drift-free odometry at revisit places. Besides, a multisession mode is designed to allow the user to store the current session's results, including the corrected map points, optimized odometry, and descriptor database for future sessions. The benefits of this mode are additional accuracy improvement and consistent map stitching, which is helpful for life-long mapping. Furthermore, LTA-OM has valuable features for robot control and path planning, including high-frequency and real-time odometry, driftless odometry at revisit places, and fast loop closing convergence. LTA-OM is versatile as it is applicable to both multiline spinning and solid-state LiDARs, mobile robots and handheld platforms. In experiments, we exhaustively benchmark LTA-OM and other state-of-the-art LiDAR systems with 18 data sequences. The results show that LTA-OM steadily outperforms other systems regarding trajectory accuracy, map consistency, and time consumption. The robustness of LTA-OM is validated in a challenging scene—a multilevel building having similar structures at different levels. To demonstrate our system, we created a video which can be found on https://youtu.be/DVwppEKlKps.
{"title":"LTA-OM: Long-term association LiDAR–IMU odometry and mapping","authors":"Zuhao Zou, Chongjian Yuan, Wei Xu, Haotian Li, Shunbo Zhou, Kaiwen Xue, Fu Zhang","doi":"10.1002/rob.22337","DOIUrl":"10.1002/rob.22337","url":null,"abstract":"<p>This paper focuses on the Light Detection and Ranging (LiDAR)–Inertial Measurement Unit (IMU) simultaneous localization and mapping (SLAM) problem: How to fuse the sensor measurement from the LiDAR and IMU to online estimate robot's poses and build a consistent map of the environment. This paper presents LTA-OM: an efficient, robust, and accurate LiDAR SLAM system. Employing fast direct LiDAR-inertial odometry (FAST-LIO2) and Stable Triangle Descriptor as LiDAR–IMU odometry and the loop detection method, respectively, LTA-OM is implemented to be functionally complete, including loop detection and correction, false-positive loop closure rejection, long-term association (LTA) mapping, and multisession localization and mapping. One novelty of this paper is the real-time LTA mapping, which exploits the direct scan-to-map registration of FAST-LIO2 and employs the corrected history map to provide direct global constraints to the LIO mapping process. LTA mapping also has the notable advantage of achieving drift-free odometry at revisit places. Besides, a multisession mode is designed to allow the user to store the current session's results, including the corrected map points, optimized odometry, and descriptor database for future sessions. The benefits of this mode are additional accuracy improvement and consistent map stitching, which is helpful for life-long mapping. Furthermore, LTA-OM has valuable features for robot control and path planning, including high-frequency and real-time odometry, driftless odometry at revisit places, and fast loop closing convergence. LTA-OM is versatile as it is applicable to both multiline spinning and solid-state LiDARs, mobile robots and handheld platforms. In experiments, we exhaustively benchmark LTA-OM and other state-of-the-art LiDAR systems with 18 data sequences. The results show that LTA-OM steadily outperforms other systems regarding trajectory accuracy, map consistency, and time consumption. The robustness of LTA-OM is validated in a challenging scene—a multilevel building having similar structures at different levels. To demonstrate our system, we created a video which can be found on https://youtu.be/DVwppEKlKps.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 7","pages":"2455-2474"},"PeriodicalIF":4.2,"publicationDate":"2024-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22337","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140602368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
While marine animal behavior is often studied in constrained lab setups, a more reliable exploration should be done in their natural environment and without human interference. This task becomes excessively more challenging when quantitative data are needed in large and unconstrained aquatic environments. Toward that end, researchers widely use acoustic positioning telemetry to remotely track their subjects, though this often requires an extensive network of receivers placed in the environment ahead of time. This study proposes a new tracking method that continuously tracks and reports the trajectory of a target in unconstrained marine environments using a single-moving acoustic receiver. Instead of deploying an extensive array of static receivers, we use a single receiver mounted on an autonomous surface vehicle to obtain highly accurate results with much cheaper and simpler means. The receiver position and earlier target location estimations are used to calculate an optimal trajectory for the receiver, which in turn provides subsequent readings and target localizations based on a new variant of the Time Difference of Arrival approach. We demonstrate the performance of the proposed methods using both simulations and field experiments.
{"title":"Acoustic tracking of moving marine targets using a single autonomous surface receiver","authors":"Ilan Git, Matan Samina, Shachar Givon, Ronen Segev, Moshe Kiflawi, Ohad Ben-Shahar","doi":"10.1002/rob.22335","DOIUrl":"10.1002/rob.22335","url":null,"abstract":"<p>While marine animal behavior is often studied in constrained lab setups, a more reliable exploration should be done in their natural environment and without human interference. This task becomes excessively more challenging when quantitative data are needed in large and unconstrained aquatic environments. Toward that end, researchers widely use acoustic positioning telemetry to remotely track their subjects, though this often requires an extensive network of receivers placed in the environment ahead of time. This study proposes a new tracking method that continuously tracks and reports the trajectory of a target in unconstrained marine environments using a <i>single-moving</i> acoustic receiver. Instead of deploying an extensive array of static receivers, we use a single receiver mounted on an autonomous surface vehicle to obtain highly accurate results with much cheaper and simpler means. The receiver position and earlier target location estimations are used to calculate an optimal trajectory for the receiver, which in turn provides subsequent readings and target localizations based on a new variant of the Time Difference of Arrival approach. We demonstrate the performance of the proposed methods using both simulations and field experiments.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 5","pages":"1498-1520"},"PeriodicalIF":4.2,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22335","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Paul Dominick E. Baniqued, Paul Bremner, Melissa Sandison, Samuel Harper, Subham Agrawal, Joseph Bolarinwa, Jamie Blanche, Zhengyi Jiang, Thomas Johnson, Daniel Mitchell, Erwin Jose Lopez Pulgarin, Andrew West, Melissa Willis, Kanzhong Yao, David Flynn, Manuel Giuliani, Keir Groves, Barry Lennox, Simon Watson
The nuclear energy sector can benefit from mobile robots for remote inspection and handling, reducing human exposure to radiation. Advances in cyber–physical systems have improved robotic platforms in this sector through digital twin (DT) technology. DTs enhance situational awareness for robot operators, crucial for safety in the nuclear energy sector, and their value is anticipated to increase with the growing complexity of cyber–physical systems. The primary motivation of this work is to rapidly develop and evaluate a robot fleet interface that accounts for these benefits in the context of nuclear environments. Here, we introduce a multimodal immersive DT platform for cyber–physical robot fleets based on the ROS-Unity 3D framework. The system design enables fleet monitoring and management by integrating building information models, mission parameters, robot sensor data, and multimodal user interaction through traditional and virtual reality interfaces. A modified heuristic evaluation approach, which accounts for the positive and negative aspects of the interface, was introduced to accelerate the iterative design process of our DT platform. Robot operators from leading nuclear research institutions (Sellafield Ltd. and the Japan Atomic Energy Agency) performed a simulated robot inspection mission while providing valuable insights into the design elements of the cyber–physical system. The three usability themes that emerged and inspired our design recommendations for future developers include increasing the interface's flexibility, considering each robot's individuality, and adapting the platform to expand sensor visualization capabilities.
移动机器人可进行远程检查和处理,减少人类暴露于辐射的机会,核能行业可从移动机器人中受益。网络物理系统的进步通过数字孪生(DT)技术改善了该领域的机器人平台。数字孪生技术提高了机器人操作员的态势感知能力,这对核能行业的安全至关重要。这项工作的主要动机是快速开发和评估一个机器人机群界面,该界面应考虑到核环境中的这些优势。在此,我们介绍了基于 ROS-Unity 3D 框架的网络物理机器人机群多模态沉浸式 DT 平台。系统设计通过整合建筑信息模型、任务参数、机器人传感器数据以及通过传统和虚拟现实界面进行的多模态用户交互,实现了对机群的监控和管理。为了加快 DT 平台的迭代设计过程,我们引入了一种经过改进的启发式评估方法,该方法考虑到了界面的积极和消极方面。来自领先核研究机构(塞拉菲尔德有限公司和日本原子能机构)的机器人操作员执行了模拟机器人检查任务,同时为网络物理系统的设计元素提供了宝贵的见解。我们为未来的开发人员提出了三个可用性主题,包括增加界面的灵活性、考虑每个机器人的个性以及调整平台以扩展传感器可视化功能。
{"title":"Multimodal immersive digital twin platform for cyber–physical robot fleets in nuclear environments","authors":"Paul Dominick E. Baniqued, Paul Bremner, Melissa Sandison, Samuel Harper, Subham Agrawal, Joseph Bolarinwa, Jamie Blanche, Zhengyi Jiang, Thomas Johnson, Daniel Mitchell, Erwin Jose Lopez Pulgarin, Andrew West, Melissa Willis, Kanzhong Yao, David Flynn, Manuel Giuliani, Keir Groves, Barry Lennox, Simon Watson","doi":"10.1002/rob.22329","DOIUrl":"10.1002/rob.22329","url":null,"abstract":"<p>The nuclear energy sector can benefit from mobile robots for remote inspection and handling, reducing human exposure to radiation. Advances in cyber–physical systems have improved robotic platforms in this sector through digital twin (DT) technology. DTs enhance situational awareness for robot operators, crucial for safety in the nuclear energy sector, and their value is anticipated to increase with the growing complexity of cyber–physical systems. The primary motivation of this work is to rapidly develop and evaluate a robot fleet interface that accounts for these benefits in the context of nuclear environments. Here, we introduce a multimodal immersive DT platform for cyber–physical robot fleets based on the ROS-Unity 3D framework. The system design enables fleet monitoring and management by integrating building information models, mission parameters, robot sensor data, and multimodal user interaction through traditional and virtual reality interfaces. A modified heuristic evaluation approach, which accounts for the positive and negative aspects of the interface, was introduced to accelerate the iterative design process of our DT platform. Robot operators from leading nuclear research institutions (Sellafield Ltd. and the Japan Atomic Energy Agency) performed a simulated robot inspection mission while providing valuable insights into the design elements of the cyber–physical system. The three usability themes that emerged and inspired our design recommendations for future developers include increasing the interface's flexibility, considering each robot's individuality, and adapting the platform to expand sensor visualization capabilities.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 5","pages":"1521-1540"},"PeriodicalIF":4.2,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22329","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Verdon Crann, Peyman Amiri, Samuel Knox, William Crowther
<p>Projections for future air mobility envisage intensely utilized airspace that does not simply scale up from existing systems with centralized air traffic control. This paper considers the implementation and test of a software and hardware framework for decentralized control of aerial vehicles within intensely used airspace. Up to 10 rotary wing vehicles of maximum all up mass of <span></span><math>