首页 > 最新文献

Journal of Field Robotics最新文献

英文 中文
Water entry locomotion strategy for a stranding bionic robotic fish 搁浅仿生机器鱼的入水运动策略
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-17 DOI: 10.1002/rob.22352
Huijie Dong, Zhipeng Ji, Yan Meng, Di Chen, Tiezhu Qiao, Junzhi Yu

Similar to other underwater robots, bionic robotic fish face entrapment risks when stranded due to wave action or water level drop. In this paper, we propose a locomotion strategy for a whale shark-inspired robotic fish, enabling it to autonomously return to aquatic environments after being stranded on land. This strategy is informed by the terrestrial locomotion capabilities of mudskippers and is particularly significant given the considerable mass of such robotic fish, which compounds the difficulty of land-based movement. First, we introduce a lightweight YOLOv5 model-based algorithm for deep-water area recognition, which identifies the direction for the bionic robot fish to re-enter the water. Subsequently, pectoral fin-based crawling gaits are designed by the innate two degrees of freedom within the existing pectoral fin structure of the robot. These gaits empower the robotic fish to move on a multitude of terrestrial terrains. Extended field experiments have validated the effectiveness of our water recognition algorithm and locomotion strategy, confirming the ability of the whale shark-inspired robotic fish to perform successful water entry maneuvers from the shore. Additionally, the capability to traverse various landforms are also verified. This work provides valuable insights into self-rescue mechanisms for stranding underwater robots and promotes practical applications of bionic robotics.

与其他水下机器人类似,仿生机器鱼在因海浪作用或水位下降而搁浅时也面临着被困的风险。在本文中,我们为受鲸鲨启发的机器鱼提出了一种运动策略,使其能够在陆地搁浅后自主返回水生环境。这一策略借鉴了弹涂鱼的陆地运动能力,由于这种机器鱼的质量相当大,增加了陆地运动的难度,因此这一策略尤为重要。首先,我们引入了基于 YOLOv5 模型的轻量级深水区域识别算法,该算法可识别仿生机器鱼重新入水的方向。随后,我们利用机器人现有胸鳍结构中与生俱来的两个自由度,设计了基于胸鳍的爬行步态。这些步态使机器鱼能够在多种陆地地形上移动。广泛的现场实验验证了我们的水识别算法和运动策略的有效性,证实了受鲸鲨启发的机器鱼能够从岸上成功地执行入水动作。此外,穿越各种地形的能力也得到了验证。这项工作为搁浅水下机器人的自救机制提供了宝贵的见解,促进了仿生机器人技术的实际应用。
{"title":"Water entry locomotion strategy for a stranding bionic robotic fish","authors":"Huijie Dong,&nbsp;Zhipeng Ji,&nbsp;Yan Meng,&nbsp;Di Chen,&nbsp;Tiezhu Qiao,&nbsp;Junzhi Yu","doi":"10.1002/rob.22352","DOIUrl":"10.1002/rob.22352","url":null,"abstract":"<p>Similar to other underwater robots, bionic robotic fish face entrapment risks when stranded due to wave action or water level drop. In this paper, we propose a locomotion strategy for a whale shark-inspired robotic fish, enabling it to autonomously return to aquatic environments after being stranded on land. This strategy is informed by the terrestrial locomotion capabilities of mudskippers and is particularly significant given the considerable mass of such robotic fish, which compounds the difficulty of land-based movement. First, we introduce a lightweight YOLOv5 model-based algorithm for deep-water area recognition, which identifies the direction for the bionic robot fish to re-enter the water. Subsequently, pectoral fin-based crawling gaits are designed by the innate two degrees of freedom within the existing pectoral fin structure of the robot. These gaits empower the robotic fish to move on a multitude of terrestrial terrains. Extended field experiments have validated the effectiveness of our water recognition algorithm and locomotion strategy, confirming the ability of the whale shark-inspired robotic fish to perform successful water entry maneuvers from the shore. Additionally, the capability to traverse various landforms are also verified. This work provides valuable insights into self-rescue mechanisms for stranding underwater robots and promotes practical applications of bionic robotics.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 8","pages":"2493-2505"},"PeriodicalIF":4.2,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140630726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Data-driven iterative learning cooperative trajectory tracking control for multiple autonomous underwater vehicles with input saturation constraints 具有输入饱和约束条件的多自主水下航行器的数据驱动迭代学习合作轨迹跟踪控制
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-16 DOI: 10.1002/rob.22343
Chengxi Wu, Hamid Reza Karimi, Liang Shan, Yuewei Dai

This paper investigates the cooperative trajectory tracking (CTT) control problem of multiple autonomous underwater vehicles (AUVs). The multi-AUV system is characterized by uncertain dynamics, being subjected to the impact about input saturation constraints and unmeasurable disturbances. First, a neural network-based data-driven control algorithm is proposed for the multi-AUV system with unmeasurable disturbances and model parameters uncertain. The radial basis function neural network is employed to estimate the primary pseudo parameters of an equivalent data model, established through dynamic linearization methods. Subsequently, an iterative learning control approach based on adaptive gain is designed to act as a feedforward scheme along the iteration axis to enhance the tracking accuracy within a time constraint. Third, to prove that the resulting CTT control system fulfills the bounded stability under the proposed control approach, a formal stability analysis is provided. Finally, a simulation case study is conducted to illustrate the effectiveness of the proposed CTT control approach.

本文研究了多自主水下航行器(AUV)的合作轨迹跟踪(CTT)控制问题。多自主潜航器系统具有不确定动力学特征,受到输入饱和约束和不可测量干扰的影响。首先,针对不可测干扰和模型参数不确定的多 AUV 系统,提出了一种基于神经网络的数据驱动控制算法。采用径向基函数神经网络来估计等效数据模型的主要伪参数,该模型是通过动态线性化方法建立的。随后,设计了一种基于自适应增益的迭代学习控制方法,作为沿迭代轴的前馈方案,在时间限制内提高跟踪精度。第三,为了证明所产生的 CTT 控制系统在所提出的控制方法下满足有界稳定性,提供了正式的稳定性分析。最后,进行了一项仿真案例研究,以说明所提出的 CTT 控制方法的有效性。
{"title":"Data-driven iterative learning cooperative trajectory tracking control for multiple autonomous underwater vehicles with input saturation constraints","authors":"Chengxi Wu,&nbsp;Hamid Reza Karimi,&nbsp;Liang Shan,&nbsp;Yuewei Dai","doi":"10.1002/rob.22343","DOIUrl":"10.1002/rob.22343","url":null,"abstract":"<p>This paper investigates the cooperative trajectory tracking (CTT) control problem of multiple autonomous underwater vehicles (AUVs). The multi-AUV system is characterized by uncertain dynamics, being subjected to the impact about input saturation constraints and unmeasurable disturbances. First, a neural network-based data-driven control algorithm is proposed for the multi-AUV system with unmeasurable disturbances and model parameters uncertain. The radial basis function neural network is employed to estimate the primary pseudo parameters of an equivalent data model, established through dynamic linearization methods. Subsequently, an iterative learning control approach based on adaptive gain is designed to act as a feedforward scheme along the iteration axis to enhance the tracking accuracy within a time constraint. Third, to prove that the resulting CTT control system fulfills the bounded stability under the proposed control approach, a formal stability analysis is provided. Finally, a simulation case study is conducted to illustrate the effectiveness of the proposed CTT control approach.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 7","pages":"2475-2487"},"PeriodicalIF":4.2,"publicationDate":"2024-04-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140578620","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The ReSWARM microgravity flight experiments: Planning, control, and model estimation for on-orbit close proximity operations ReSWARM 微重力飞行实验:在轨近距离操作的规划、控制和模型估计
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-15 DOI: 10.1002/rob.22308
Bryce Doerr, Keenan Albee, Monica Ekal, Rodrigo Ventura, Richard Linares

On-orbit close proximity operations involve robotic spacecraft maneuvering and making decisions for a growing number of mission scenarios demanding autonomy, including on-orbit assembly, repair, and astronaut assistance. Of these scenarios, on-orbit assembly is an enabling technology that will allow large space structures to be built in situ, using smaller building block modules. However, like many of these scenarios, robotic on-orbit assembly involves several technical hurdles, such as changing system models. For instance, grappled modules moved by a free-flying “assembler” robot can cause significant changes in the combined system inertia, which have cascading impacts on motion planning and control portions of the autonomy stack. Further, on-orbit assembly and other scenarios require collision-avoiding motion planning, particularly when operating in a “construction site” scenario of multiple assembler robots and structures. Multiple key technologies that address these complicating factors for autonomous microgravity close proximity operations are detailed in this work, in particular: (1) application of global long-horizon planning, accomplished using offline and online sampling-based planner options that consider the system dynamics; (2) adaptation of the recently proposed RATTLE information-aware planning framework for on-orbit reconfiguration model learning; and (3) connection with robust control tools to provide low-level control robustness using current system knowledge. These approaches were demonstrated for an autonomous on-orbit assembly use case by the RElative Satellite sWarming and Robotic Maneuvering (ReSWARM) experiments using NASA's Astrobee robots on the International Space Station. Results of the ReSWARM experiments are provided along with significant operational and implementation detail discussing the practicalities of hardware implementation and unique aspects of working with the Astrobee free-flyer robots in microgravity. ReSWARM provides a base set of planning and control tools for robotic close proximity operations, demonstrates them in microgravity, and outlines some of the important hardware aspects that future autonomous free-flyers will need to consider.

在轨近距离操作涉及机器人航天器的操纵和决策,越来越多的任务方案要求自主性,包括在轨组装、维修和宇航员协助。在这些方案中,在轨组装是一项使能技术,可使用较小的积木模块就地建造大型空间结构。然而,与许多这些方案一样,机器人在轨组装也涉及一些技术障碍,如改变系统模型。例如,由自由飞行的 "组装 "机器人移动的抓取模块会导致组合系统惯性发生重大变化,从而对自主堆栈的运动规划和控制部分产生连带影响。此外,在轨装配和其他情况下需要避免碰撞的运动规划,特别是在多个装配机器人和结构的 "建筑工地 "情况下运行时。这项工作详细介绍了解决自主微重力近距离操作中这些复杂因素的多项关键技术,特别是:(1)应用全局长地平线规划,使用考虑系统动态的离线和在线采样规划选项完成;(2)调整最近提出的 RATTLE 信息感知规划框架,用于在轨重新配置模型学习;以及(3)与稳健控制工具连接,使用当前系统知识提供低级控制稳健性。美国国家航空航天局(NASA)在国际空间站上使用 Astrobee 机器人进行的 "Relative Satellite sWarming and Robotic Maneuvering (ReSWARM) "实验针对自主在轨装配用例演示了这些方法。在提供 ReSWARM 实验结果的同时,还提供了重要的操作和实施细节,讨论了硬件实施的实用性以及在微重力环境下与 Astrobee 自由飞行机器人一起工作的独特方面。ReSWARM 为机器人近距离操作提供了一套基本的规划和控制工具,在微重力环境下对其进行了演示,并概述了未来自主自由飞行器需要考虑的一些重要硬件方面。
{"title":"The ReSWARM microgravity flight experiments: Planning, control, and model estimation for on-orbit close proximity operations","authors":"Bryce Doerr,&nbsp;Keenan Albee,&nbsp;Monica Ekal,&nbsp;Rodrigo Ventura,&nbsp;Richard Linares","doi":"10.1002/rob.22308","DOIUrl":"10.1002/rob.22308","url":null,"abstract":"<p>On-orbit close proximity operations involve robotic spacecraft maneuvering and making decisions for a growing number of mission scenarios demanding autonomy, including on-orbit assembly, repair, and astronaut assistance. Of these scenarios, on-orbit assembly is an enabling technology that will allow large space structures to be built in situ, using smaller building block modules. However, like many of these scenarios, robotic on-orbit assembly involves several technical hurdles, such as changing system models. For instance, grappled modules moved by a free-flying “assembler” robot can cause significant changes in the combined system inertia, which have cascading impacts on motion planning and control portions of the autonomy stack. Further, on-orbit assembly and other scenarios require collision-avoiding motion planning, particularly when operating in a “construction site” scenario of multiple assembler robots and structures. Multiple key technologies that address these complicating factors for autonomous microgravity close proximity operations are detailed in this work, in particular: (1) application of global long-horizon planning, accomplished using offline and online sampling-based planner options that consider the system dynamics; (2) adaptation of the recently proposed RATTLE information-aware planning framework for on-orbit reconfiguration model learning; and (3) connection with robust control tools to provide low-level control robustness using current system knowledge. These approaches were demonstrated for an autonomous on-orbit assembly use case by the RElative Satellite sWarming and Robotic Maneuvering (ReSWARM) experiments using NASA's Astrobee robots on the International Space Station. Results of the ReSWARM experiments are provided along with significant operational and implementation detail discussing the practicalities of hardware implementation and unique aspects of working with the Astrobee free-flyer robots in microgravity. ReSWARM provides a base set of planning and control tools for robotic close proximity operations, demonstrates them in microgravity, and outlines some of the important hardware aspects that future autonomous free-flyers will need to consider.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 6","pages":"1645-1679"},"PeriodicalIF":4.2,"publicationDate":"2024-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22308","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
LTA-OM: Long-term association LiDAR–IMU odometry and mapping LTA-OM:长期关联激光雷达-IMU 测距与制图
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-15 DOI: 10.1002/rob.22337
Zuhao Zou, Chongjian Yuan, Wei Xu, Haotian Li, Shunbo Zhou, Kaiwen Xue, Fu Zhang

This paper focuses on the Light Detection and Ranging (LiDAR)–Inertial Measurement Unit (IMU) simultaneous localization and mapping (SLAM) problem: How to fuse the sensor measurement from the LiDAR and IMU to online estimate robot's poses and build a consistent map of the environment. This paper presents LTA-OM: an efficient, robust, and accurate LiDAR SLAM system. Employing fast direct LiDAR-inertial odometry (FAST-LIO2) and Stable Triangle Descriptor as LiDAR–IMU odometry and the loop detection method, respectively, LTA-OM is implemented to be functionally complete, including loop detection and correction, false-positive loop closure rejection, long-term association (LTA) mapping, and multisession localization and mapping. One novelty of this paper is the real-time LTA mapping, which exploits the direct scan-to-map registration of FAST-LIO2 and employs the corrected history map to provide direct global constraints to the LIO mapping process. LTA mapping also has the notable advantage of achieving drift-free odometry at revisit places. Besides, a multisession mode is designed to allow the user to store the current session's results, including the corrected map points, optimized odometry, and descriptor database for future sessions. The benefits of this mode are additional accuracy improvement and consistent map stitching, which is helpful for life-long mapping. Furthermore, LTA-OM has valuable features for robot control and path planning, including high-frequency and real-time odometry, driftless odometry at revisit places, and fast loop closing convergence. LTA-OM is versatile as it is applicable to both multiline spinning and solid-state LiDARs, mobile robots and handheld platforms. In experiments, we exhaustively benchmark LTA-OM and other state-of-the-art LiDAR systems with 18 data sequences. The results show that LTA-OM steadily outperforms other systems regarding trajectory accuracy, map consistency, and time consumption. The robustness of LTA-OM is validated in a challenging scene—a multilevel building having similar structures at different levels. To demonstrate our system, we created a video which can be found on https://youtu.be/DVwppEKlKps.

本文重点讨论光探测与测距(LiDAR)- 惯性测量单元(IMU)同步定位与绘图(SLAM)问题:如何融合来自 LiDAR 和 IMU 的传感器测量,在线估计机器人的姿势并构建一致的环境地图。本文介绍了 LTA-OM:一种高效、稳健、精确的激光雷达 SLAM 系统。LTA-OM 采用快速直接激光雷达-惯性测距法(FAST-LIO2)和稳定三角形描述符(Stable Triangle Descriptor)分别作为激光雷达-IMU 测距法和环路检测法,实现了完整的功能,包括环路检测和校正、假阳性环路闭合剔除、长期关联(LTA)映射以及多会期定位和映射。本文的一个创新点是实时 LTA 映射,它利用了 FAST-LIO2 的直接扫描到映射注册功能,并采用校正历史映射为 LIO 映射过程提供直接的全局约束。LTA 测绘还具有在重访地点实现无漂移里程测量的显著优势。此外,还设计了一个多会话模式,允许用户存储当前会话的结果,包括修正的地图点、优化的里程测量和描述符数据库,供未来会话使用。这种模式的好处是可以提高额外的精度和地图拼接的一致性,有助于终身测绘。此外,LTA-OM 还具有用于机器人控制和路径规划的重要功能,包括高频和实时里程测量、重访地点的无漂移里程测量和快速闭环收敛。LTA-OM 用途广泛,既适用于多线旋转激光雷达,也适用于固态激光雷达、移动机器人和手持平台。在实验中,我们用 18 个数据序列对 LTA-OM 和其他最先进的激光雷达系统进行了详尽的基准测试。实验结果表明,LTA-OM 在轨迹精度、地图一致性和时间消耗方面均稳步超越其他系统。LTA-OM 的鲁棒性在一个具有挑战性的场景中得到了验证--该场景是一座多层建筑,不同楼层的结构相似。为了演示我们的系统,我们制作了一段视频,可在 https://youtu.be/DVwppEKlKps 上找到。
{"title":"LTA-OM: Long-term association LiDAR–IMU odometry and mapping","authors":"Zuhao Zou,&nbsp;Chongjian Yuan,&nbsp;Wei Xu,&nbsp;Haotian Li,&nbsp;Shunbo Zhou,&nbsp;Kaiwen Xue,&nbsp;Fu Zhang","doi":"10.1002/rob.22337","DOIUrl":"10.1002/rob.22337","url":null,"abstract":"<p>This paper focuses on the Light Detection and Ranging (LiDAR)–Inertial Measurement Unit (IMU) simultaneous localization and mapping (SLAM) problem: How to fuse the sensor measurement from the LiDAR and IMU to online estimate robot's poses and build a consistent map of the environment. This paper presents LTA-OM: an efficient, robust, and accurate LiDAR SLAM system. Employing fast direct LiDAR-inertial odometry (FAST-LIO2) and Stable Triangle Descriptor as LiDAR–IMU odometry and the loop detection method, respectively, LTA-OM is implemented to be functionally complete, including loop detection and correction, false-positive loop closure rejection, long-term association (LTA) mapping, and multisession localization and mapping. One novelty of this paper is the real-time LTA mapping, which exploits the direct scan-to-map registration of FAST-LIO2 and employs the corrected history map to provide direct global constraints to the LIO mapping process. LTA mapping also has the notable advantage of achieving drift-free odometry at revisit places. Besides, a multisession mode is designed to allow the user to store the current session's results, including the corrected map points, optimized odometry, and descriptor database for future sessions. The benefits of this mode are additional accuracy improvement and consistent map stitching, which is helpful for life-long mapping. Furthermore, LTA-OM has valuable features for robot control and path planning, including high-frequency and real-time odometry, driftless odometry at revisit places, and fast loop closing convergence. LTA-OM is versatile as it is applicable to both multiline spinning and solid-state LiDARs, mobile robots and handheld platforms. In experiments, we exhaustively benchmark LTA-OM and other state-of-the-art LiDAR systems with 18 data sequences. The results show that LTA-OM steadily outperforms other systems regarding trajectory accuracy, map consistency, and time consumption. The robustness of LTA-OM is validated in a challenging scene—a multilevel building having similar structures at different levels. To demonstrate our system, we created a video which can be found on https://youtu.be/DVwppEKlKps.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 7","pages":"2455-2474"},"PeriodicalIF":4.2,"publicationDate":"2024-04-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22337","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140602368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Acoustic tracking of moving marine targets using a single autonomous surface receiver 使用单个自主表面接收器对移动的海洋目标进行声学跟踪
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-11 DOI: 10.1002/rob.22335
Ilan Git, Matan Samina, Shachar Givon, Ronen Segev, Moshe Kiflawi, Ohad Ben-Shahar

While marine animal behavior is often studied in constrained lab setups, a more reliable exploration should be done in their natural environment and without human interference. This task becomes excessively more challenging when quantitative data are needed in large and unconstrained aquatic environments. Toward that end, researchers widely use acoustic positioning telemetry to remotely track their subjects, though this often requires an extensive network of receivers placed in the environment ahead of time. This study proposes a new tracking method that continuously tracks and reports the trajectory of a target in unconstrained marine environments using a single-moving acoustic receiver. Instead of deploying an extensive array of static receivers, we use a single receiver mounted on an autonomous surface vehicle to obtain highly accurate results with much cheaper and simpler means. The receiver position and earlier target location estimations are used to calculate an optimal trajectory for the receiver, which in turn provides subsequent readings and target localizations based on a new variant of the Time Difference of Arrival approach. We demonstrate the performance of the proposed methods using both simulations and field experiments.

虽然海洋动物行为的研究通常是在受限的实验室环境中进行的,但更可靠的探索应该是在其自然环境中进行,并且不受人为干扰。如果需要在大型、无限制的水生环境中获得定量数据,这项任务就会变得更具挑战性。为此,研究人员广泛使用声学定位遥测技术来远程跟踪研究对象,但这往往需要提前在环境中放置大量的接收器网络。本研究提出了一种新的跟踪方法,利用单个移动声学接收器在无限制的海洋环境中持续跟踪并报告目标的轨迹。我们没有部署大量静态接收器阵列,而是使用安装在自主水面飞行器上的单个接收器,以更便宜、更简单的方法获得高精度结果。接收器位置和早期目标位置估计用于计算接收器的最佳轨迹,而接收器则根据到达时间差方法的新变体提供后续读数和目标定位。我们通过模拟和现场实验展示了所建议方法的性能。
{"title":"Acoustic tracking of moving marine targets using a single autonomous surface receiver","authors":"Ilan Git,&nbsp;Matan Samina,&nbsp;Shachar Givon,&nbsp;Ronen Segev,&nbsp;Moshe Kiflawi,&nbsp;Ohad Ben-Shahar","doi":"10.1002/rob.22335","DOIUrl":"10.1002/rob.22335","url":null,"abstract":"<p>While marine animal behavior is often studied in constrained lab setups, a more reliable exploration should be done in their natural environment and without human interference. This task becomes excessively more challenging when quantitative data are needed in large and unconstrained aquatic environments. Toward that end, researchers widely use acoustic positioning telemetry to remotely track their subjects, though this often requires an extensive network of receivers placed in the environment ahead of time. This study proposes a new tracking method that continuously tracks and reports the trajectory of a target in unconstrained marine environments using a <i>single-moving</i> acoustic receiver. Instead of deploying an extensive array of static receivers, we use a single receiver mounted on an autonomous surface vehicle to obtain highly accurate results with much cheaper and simpler means. The receiver position and earlier target location estimations are used to calculate an optimal trajectory for the receiver, which in turn provides subsequent readings and target localizations based on a new variant of the Time Difference of Arrival approach. We demonstrate the performance of the proposed methods using both simulations and field experiments.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 5","pages":"1498-1520"},"PeriodicalIF":4.2,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22335","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multimodal immersive digital twin platform for cyber–physical robot fleets in nuclear environments 核环境中网络物理机器人群的多模态沉浸式数字孪生平台
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-11 DOI: 10.1002/rob.22329
Paul Dominick E. Baniqued, Paul Bremner, Melissa Sandison, Samuel Harper, Subham Agrawal, Joseph Bolarinwa, Jamie Blanche, Zhengyi Jiang, Thomas Johnson, Daniel Mitchell, Erwin Jose Lopez Pulgarin, Andrew West, Melissa Willis, Kanzhong Yao, David Flynn, Manuel Giuliani, Keir Groves, Barry Lennox, Simon Watson

The nuclear energy sector can benefit from mobile robots for remote inspection and handling, reducing human exposure to radiation. Advances in cyber–physical systems have improved robotic platforms in this sector through digital twin (DT) technology. DTs enhance situational awareness for robot operators, crucial for safety in the nuclear energy sector, and their value is anticipated to increase with the growing complexity of cyber–physical systems. The primary motivation of this work is to rapidly develop and evaluate a robot fleet interface that accounts for these benefits in the context of nuclear environments. Here, we introduce a multimodal immersive DT platform for cyber–physical robot fleets based on the ROS-Unity 3D framework. The system design enables fleet monitoring and management by integrating building information models, mission parameters, robot sensor data, and multimodal user interaction through traditional and virtual reality interfaces. A modified heuristic evaluation approach, which accounts for the positive and negative aspects of the interface, was introduced to accelerate the iterative design process of our DT platform. Robot operators from leading nuclear research institutions (Sellafield Ltd. and the Japan Atomic Energy Agency) performed a simulated robot inspection mission while providing valuable insights into the design elements of the cyber–physical system. The three usability themes that emerged and inspired our design recommendations for future developers include increasing the interface's flexibility, considering each robot's individuality, and adapting the platform to expand sensor visualization capabilities.

移动机器人可进行远程检查和处理,减少人类暴露于辐射的机会,核能行业可从移动机器人中受益。网络物理系统的进步通过数字孪生(DT)技术改善了该领域的机器人平台。数字孪生技术提高了机器人操作员的态势感知能力,这对核能行业的安全至关重要。这项工作的主要动机是快速开发和评估一个机器人机群界面,该界面应考虑到核环境中的这些优势。在此,我们介绍了基于 ROS-Unity 3D 框架的网络物理机器人机群多模态沉浸式 DT 平台。系统设计通过整合建筑信息模型、任务参数、机器人传感器数据以及通过传统和虚拟现实界面进行的多模态用户交互,实现了对机群的监控和管理。为了加快 DT 平台的迭代设计过程,我们引入了一种经过改进的启发式评估方法,该方法考虑到了界面的积极和消极方面。来自领先核研究机构(塞拉菲尔德有限公司和日本原子能机构)的机器人操作员执行了模拟机器人检查任务,同时为网络物理系统的设计元素提供了宝贵的见解。我们为未来的开发人员提出了三个可用性主题,包括增加界面的灵活性、考虑每个机器人的个性以及调整平台以扩展传感器可视化功能。
{"title":"Multimodal immersive digital twin platform for cyber–physical robot fleets in nuclear environments","authors":"Paul Dominick E. Baniqued,&nbsp;Paul Bremner,&nbsp;Melissa Sandison,&nbsp;Samuel Harper,&nbsp;Subham Agrawal,&nbsp;Joseph Bolarinwa,&nbsp;Jamie Blanche,&nbsp;Zhengyi Jiang,&nbsp;Thomas Johnson,&nbsp;Daniel Mitchell,&nbsp;Erwin Jose Lopez Pulgarin,&nbsp;Andrew West,&nbsp;Melissa Willis,&nbsp;Kanzhong Yao,&nbsp;David Flynn,&nbsp;Manuel Giuliani,&nbsp;Keir Groves,&nbsp;Barry Lennox,&nbsp;Simon Watson","doi":"10.1002/rob.22329","DOIUrl":"10.1002/rob.22329","url":null,"abstract":"<p>The nuclear energy sector can benefit from mobile robots for remote inspection and handling, reducing human exposure to radiation. Advances in cyber–physical systems have improved robotic platforms in this sector through digital twin (DT) technology. DTs enhance situational awareness for robot operators, crucial for safety in the nuclear energy sector, and their value is anticipated to increase with the growing complexity of cyber–physical systems. The primary motivation of this work is to rapidly develop and evaluate a robot fleet interface that accounts for these benefits in the context of nuclear environments. Here, we introduce a multimodal immersive DT platform for cyber–physical robot fleets based on the ROS-Unity 3D framework. The system design enables fleet monitoring and management by integrating building information models, mission parameters, robot sensor data, and multimodal user interaction through traditional and virtual reality interfaces. A modified heuristic evaluation approach, which accounts for the positive and negative aspects of the interface, was introduced to accelerate the iterative design process of our DT platform. Robot operators from leading nuclear research institutions (Sellafield Ltd. and the Japan Atomic Energy Agency) performed a simulated robot inspection mission while providing valuable insights into the design elements of the cyber–physical system. The three usability themes that emerged and inspired our design recommendations for future developers include increasing the interface's flexibility, considering each robot's individuality, and adapting the platform to expand sensor visualization capabilities.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 5","pages":"1521-1540"},"PeriodicalIF":4.2,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22329","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587486","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Decentralized deconfliction of aerial robots in high intensity traffic structures 高强度交通结构中空中机器人的分散式解冲突
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-11 DOI: 10.1002/rob.22340
Verdon Crann, Peyman Amiri, Samuel Knox, William Crowther
<p>Projections for future air mobility envisage intensely utilized airspace that does not simply scale up from existing systems with centralized air traffic control. This paper considers the implementation and test of a software and hardware framework for decentralized control of aerial vehicles within intensely used airspace. Up to 10 rotary wing vehicles of maximum all up mass of <span></span><math> <semantics> <mrow> <mrow> <mn>1</mn> <mo> </mo> <mi>kg</mi> </mrow> </mrow> <annotation> <math altimg="urn:x-wiley:15564959:media:rob22340:rob22340-math-0001" wiley:location="equation/rob22340-math-0001.png" xmlns="http://www.w3.org/1998/Math/MathML"><mrow><mrow><mn>1</mn><mo>unicode{x0200A}</mo><mi>kg</mi></mrow></mrow></math></annotation> </semantics></math> are flown in an outdoor volume with length scale of <span></span><math> <semantics> <mrow> <mrow> <mn>100</mn> <mo> </mo> <mi>m</mi> </mrow> </mrow> <annotation> <math altimg="urn:x-wiley:15564959:media:rob22340:rob22340-math-0002" wiley:location="equation/rob22340-math-0002.png" xmlns="http://www.w3.org/1998/Math/MathML"><mrow><mrow><mn>100</mn><mo>unicode{x0200A}</mo><mi mathvariant="normal">m</mi></mrow></mrow></math></annotation> </semantics></math> with GPS and WiFi connectivity. Flight control is implemented using a Pixhawk 4 flight controller running the PX4 firmware with guidance algorithms run on a separate onboard companion computer. Deconfliction is implemented using a simple elastic repulsion model with a guidance update rate of <span></span><math> <semantics> <mrow> <mrow> <mn>10</mn> <mo> </mo> <mi>Hz</mi> </mrow> </mrow> <annotation> <math altimg="urn:x-wiley:15564959:media:rob22340:rob22340-math-0003" wiley:location="equation/rob22340-math-0003.png" xmlns="http://www.w3.org/1998/Math/MathML"><mrow><mrow><mn>10</mn><mo>unicode{x0200A}</mo><mi>Hz</mi></mrow></mrow></math></annotation> </semantics></math>. Traffic structures are constructed from a path of directed waypoints
对未来空中交通的预测表明,使用密集的空域并不能简单地从现有的集中式空中交通管制系统扩展开来。本文探讨了在密集使用的空域内对飞行器进行分散控制的软件和硬件框架的实施和测试。多达 10 架最大质量为 的旋转翼飞行器在长度为 的室外空间中飞行,并与全球定位系统和 WiFi 连接。飞行控制由运行 PX4 固件的 Pixhawk 4 飞行控制器实现,制导算法在单独的机载配套计算机上运行。解冲突是通过一个简单的弹性斥力模型实现的,制导更新率为 0.5%。 交通结构由定向航点路径和相关截面几何图形构建而成。当两条路径汇合成一条或一条路径分叉成两条时,就会出现交汇点。代理通过执行流动、合并和漩涡速度规则与结构相接触。校准实验表明,在最坏的情况下,代理共享位置信息的延迟由有限的制导更新率、WiFi 处理和集中式信息处理造成的延迟组成。选择车辆巡航速度为和冲突半径为,可在测试区域内实验时间效率(速度)和空间效率(分辨率)之间实现可接受的折中。循环交界处的实验结果表明,消除冲突活动的峰值出现在交界处的节点上,但走廊内特工分布的偏差意味着峰值强度被推到了节点之前。使用网状螺旋交界结构可显著降低冲突强度,但交界时间效率却有所降低。
{"title":"Decentralized deconfliction of aerial robots in high intensity traffic structures","authors":"Verdon Crann,&nbsp;Peyman Amiri,&nbsp;Samuel Knox,&nbsp;William Crowther","doi":"10.1002/rob.22340","DOIUrl":"10.1002/rob.22340","url":null,"abstract":"&lt;p&gt;Projections for future air mobility envisage intensely utilized airspace that does not simply scale up from existing systems with centralized air traffic control. This paper considers the implementation and test of a software and hardware framework for decentralized control of aerial vehicles within intensely used airspace. Up to 10 rotary wing vehicles of maximum all up mass of &lt;span&gt;&lt;/span&gt;&lt;math&gt;\u0000 &lt;semantics&gt;\u0000 &lt;mrow&gt;\u0000 \u0000 &lt;mrow&gt;\u0000 &lt;mn&gt;1&lt;/mn&gt;\u0000 \u0000 &lt;mo&gt; &lt;/mo&gt;\u0000 \u0000 &lt;mi&gt;kg&lt;/mi&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;annotation&gt; &lt;math altimg=\"urn:x-wiley:15564959:media:rob22340:rob22340-math-0001\" wiley:location=\"equation/rob22340-math-0001.png\" xmlns=\"http://www.w3.org/1998/Math/MathML\"&gt;&lt;mrow&gt;&lt;mrow&gt;&lt;mn&gt;1&lt;/mn&gt;&lt;mo&gt;unicode{x0200A}&lt;/mo&gt;&lt;mi&gt;kg&lt;/mi&gt;&lt;/mrow&gt;&lt;/mrow&gt;&lt;/math&gt;&lt;/annotation&gt;\u0000 &lt;/semantics&gt;&lt;/math&gt; are flown in an outdoor volume with length scale of &lt;span&gt;&lt;/span&gt;&lt;math&gt;\u0000 &lt;semantics&gt;\u0000 &lt;mrow&gt;\u0000 \u0000 &lt;mrow&gt;\u0000 &lt;mn&gt;100&lt;/mn&gt;\u0000 \u0000 &lt;mo&gt; &lt;/mo&gt;\u0000 \u0000 &lt;mi&gt;m&lt;/mi&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;annotation&gt; &lt;math altimg=\"urn:x-wiley:15564959:media:rob22340:rob22340-math-0002\" wiley:location=\"equation/rob22340-math-0002.png\" xmlns=\"http://www.w3.org/1998/Math/MathML\"&gt;&lt;mrow&gt;&lt;mrow&gt;&lt;mn&gt;100&lt;/mn&gt;&lt;mo&gt;unicode{x0200A}&lt;/mo&gt;&lt;mi mathvariant=\"normal\"&gt;m&lt;/mi&gt;&lt;/mrow&gt;&lt;/mrow&gt;&lt;/math&gt;&lt;/annotation&gt;\u0000 &lt;/semantics&gt;&lt;/math&gt; with GPS and WiFi connectivity. Flight control is implemented using a Pixhawk 4 flight controller running the PX4 firmware with guidance algorithms run on a separate onboard companion computer. Deconfliction is implemented using a simple elastic repulsion model with a guidance update rate of &lt;span&gt;&lt;/span&gt;&lt;math&gt;\u0000 &lt;semantics&gt;\u0000 &lt;mrow&gt;\u0000 \u0000 &lt;mrow&gt;\u0000 &lt;mn&gt;10&lt;/mn&gt;\u0000 \u0000 &lt;mo&gt; &lt;/mo&gt;\u0000 \u0000 &lt;mi&gt;Hz&lt;/mi&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;annotation&gt; &lt;math altimg=\"urn:x-wiley:15564959:media:rob22340:rob22340-math-0003\" wiley:location=\"equation/rob22340-math-0003.png\" xmlns=\"http://www.w3.org/1998/Math/MathML\"&gt;&lt;mrow&gt;&lt;mrow&gt;&lt;mn&gt;10&lt;/mn&gt;&lt;mo&gt;unicode{x0200A}&lt;/mo&gt;&lt;mi&gt;Hz&lt;/mi&gt;&lt;/mrow&gt;&lt;/mrow&gt;&lt;/math&gt;&lt;/annotation&gt;\u0000 &lt;/semantics&gt;&lt;/math&gt;. Traffic structures are constructed from a path of directed waypoints ","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 5","pages":"1541-1557"},"PeriodicalIF":4.2,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22340","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A multi-UAV system for coverage path planning applications with in-flight re-planning capabilities 用于覆盖路径规划应用的多无人机系统,具有飞行中重新规划能力
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-11 DOI: 10.1002/rob.22342
Marco Andrés Luna, Martin Molina, Rodrigo Da-Silva-Gomez, Javier Melero-Deza, Pedro Arias-Perez, Pascual Campoy

This paper presents the development and implementation of a multiple unmanned aerial vehicle system focused on coverage path planning on multiple separated areas capable of re-planning the collective mission in case of unexpected events. For this purpose, we present a distributed-centralized architecture that uses heuristic and computationally efficient methods to perform the planning/re-planning and decision-making tasks during the control of the mission execution. We performed a computational evaluation of the algorithms, comparing them with other proposals, together with experiments in simulated and real flights. The results show that the system can distribute tasks equitably among the aircraft in an efficient way, even in the middle of the flight, when facing unexpected events; and show a higher computational efficiency when compared to multiple proposals in the state of the art.

本文介绍了多无人飞行器系统的开发和实施情况,该系统侧重于多个分离区域的覆盖路径规划,能够在发生突发事件时重新规划集体任务。为此,我们提出了一种分布式集中架构,采用启发式和计算效率高的方法,在任务执行控制期间执行规划/重新规划和决策任务。我们对算法进行了计算评估,与其他建议进行了比较,并在模拟和实际飞行中进行了实验。结果表明,即使在飞行途中遇到突发事件,该系统也能以高效的方式在飞机之间公平地分配任务;与现有的多种方案相比,该系统具有更高的计算效率。
{"title":"A multi-UAV system for coverage path planning applications with in-flight re-planning capabilities","authors":"Marco Andrés Luna,&nbsp;Martin Molina,&nbsp;Rodrigo Da-Silva-Gomez,&nbsp;Javier Melero-Deza,&nbsp;Pedro Arias-Perez,&nbsp;Pascual Campoy","doi":"10.1002/rob.22342","DOIUrl":"10.1002/rob.22342","url":null,"abstract":"<p>This paper presents the development and implementation of a multiple unmanned aerial vehicle system focused on coverage path planning on multiple separated areas capable of re-planning the collective mission in case of unexpected events. For this purpose, we present a distributed-centralized architecture that uses heuristic and computationally efficient methods to perform the planning/re-planning and decision-making tasks during the control of the mission execution. We performed a computational evaluation of the algorithms, comparing them with other proposals, together with experiments in simulated and real flights. The results show that the system can distribute tasks equitably among the aircraft in an efficient way, even in the middle of the flight, when facing unexpected events; and show a higher computational efficiency when compared to multiple proposals in the state of the art.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 5","pages":"1480-1497"},"PeriodicalIF":4.2,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22342","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Leaf-density estimation for fruit-tree canopy based on wind-excited audio 基于风激音频的果树树冠叶片密度估计
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-09 DOI: 10.1002/rob.22336
Wenwei Li, Shijie Jiang, Shenghui Yang, Han Feng, Weihong Liu, Yongjun Zheng, Yu Tan, Daobilige Su

It is important to obtain real-time leaf density of fruit-tree canopies for the precision spray control of plant-protection robots. However, conventional detection techniques for the characteristics of fruit-tree canopies cannot acquire the canopy internal information, which may provide an unsatisfactory accuracy of detection of leaf densities. This paper proposes a method for estimating canopy leaf density of fruit trees based on wind-excited audio. A wind-exciting implement was used to force fruit-tree canopy leaves vibrating to produce audio. Then, some correlation analysis methods were used to extract key characteristic parameters of wind-excited audio that were significantly correlated with leaf density. Finally, based on the data set of wind-excited audio, a few machine-learning methods were used to develop leaf-density estimation models. Test results showed that: (1) there were five key feature parameters of wind-excited audio that were significantly correlated with leaf density: the short-time energy, spectral centroid, the frequency average energy, the peak frequency, and the standard deviation of frequency. (2) the estimation model of leaf density developed based on backpropagation neural network for fruit-tree canopy showed the optimal estimation results, which can achieve the estimation of leaf density of fruit-tree canopies accurately. The overall correlation coefficient (R) of the estimation model was more than 0.84, the root-mean-square error was less than 0.73 m2 m−3, and the mean absolute error was less than 0.53 m2 m−3. This study is expected to provide a technical solution for the leaf-density detection of fruit-tree canopies of plant-protection robots.

实时获取果树树冠的叶片密度对于植物保护机器人的精确喷雾控制非常重要。然而,传统的果树树冠特征检测技术无法获取树冠内部信息,对叶片密度的检测精度可能不尽人意。本文提出了一种基于风激音频的果树树冠叶片密度估计方法。利用风激装置迫使果树树冠叶片振动产生音频。然后,利用一些相关分析方法提取了风激音频中与叶片密度显著相关的关键特征参数。最后,基于风激音频数据集,使用一些机器学习方法建立了叶片密度估算模型。测试结果表明(1) 风激音频有五个关键特征参数与树叶密度显著相关:短时能量、频谱中心点、频率平均能量、峰值频率和频率标准偏差。(2)基于反向传播神经网络建立的果树树冠叶片密度估计模型显示出最优的估计结果,可准确实现果树树冠叶片密度的估计。估计模型的总体相关系数(R)大于 0.84,均方根误差小于 0.73 m2 m-3,平均绝对误差小于 0.53 m2 m-3。该研究有望为植物保护机器人的果树树冠叶密度检测提供技术解决方案。
{"title":"Leaf-density estimation for fruit-tree canopy based on wind-excited audio","authors":"Wenwei Li,&nbsp;Shijie Jiang,&nbsp;Shenghui Yang,&nbsp;Han Feng,&nbsp;Weihong Liu,&nbsp;Yongjun Zheng,&nbsp;Yu Tan,&nbsp;Daobilige Su","doi":"10.1002/rob.22336","DOIUrl":"10.1002/rob.22336","url":null,"abstract":"<p>It is important to obtain real-time leaf density of fruit-tree canopies for the precision spray control of plant-protection robots. However, conventional detection techniques for the characteristics of fruit-tree canopies cannot acquire the canopy internal information, which may provide an unsatisfactory accuracy of detection of leaf densities. This paper proposes a method for estimating canopy leaf density of fruit trees based on wind-excited audio. A wind-exciting implement was used to force fruit-tree canopy leaves vibrating to produce audio. Then, some correlation analysis methods were used to extract key characteristic parameters of wind-excited audio that were significantly correlated with leaf density. Finally, based on the data set of wind-excited audio, a few machine-learning methods were used to develop leaf-density estimation models. Test results showed that: (1) there were five key feature parameters of wind-excited audio that were significantly correlated with leaf density: the short-time energy, spectral centroid, the frequency average energy, the peak frequency, and the standard deviation of frequency. (2) the estimation model of leaf density developed based on backpropagation neural network for fruit-tree canopy showed the optimal estimation results, which can achieve the estimation of leaf density of fruit-tree canopies accurately. The overall correlation coefficient (<i>R</i>) of the estimation model was more than 0.84, the root-mean-square error was less than 0.73 m<sup>2</sup> m<sup>−3</sup>, and the mean absolute error was less than 0.53 m<sup>2</sup> m<sup>−3</sup>. This study is expected to provide a technical solution for the leaf-density detection of fruit-tree canopies of plant-protection robots.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 5","pages":"1469-1479"},"PeriodicalIF":4.2,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Position-based fluid simulation for robotic injection sealing of pavement cracks 基于位置的流体模拟,用于路面裂缝的机器人喷射密封
IF 4.2 2区 计算机科学 Q2 ROBOTICS Pub Date : 2024-04-09 DOI: 10.1002/rob.22339
Samuel D. Schaefer, Jie Xu, Damian Palin, Abir Al-Tabbaa, Fumiya Iida
<p>Automated crack sealing could significantly benefit the maintenance of road pavements, but there is difficulty in depositing the correct volume of sealant material into the hidden crack space. A simulated model of the material flow within a crack space would allow the development of a predictive control scheme, such that the repair robot can apply suitable trajectories and operational parameters to accomplish neatly sealed surfaces. For the first time, the position-based fluid (PBF) method, a computationally cheap and fast but approximate model of fluid flows, is studied for its feasibility for sealant flow simulation in the robotic injection crack sealing scenario. A Real-to-Sim experiment is performed, in which a PBF simulation of sealant in a virtual robotic crack sealing environment is mirrored from the physical lab setup. The fluid simulation is tuned to match the real-world dynamics through comparison with 132 simulation runs, varying the artificial viscosity parameters <span></span><math> <semantics> <mrow> <mrow> <mi>U</mi> </mrow> </mrow> <annotation> <math altimg="urn:x-wiley:15564959:media:rob22339:rob22339-math-0001" wiley:location="equation/rob22339-math-0001.png" xmlns="http://www.w3.org/1998/Math/MathML"><mrow><mrow><mi>U</mi></mrow></mrow></math></annotation> </semantics></math> (fluid–fluid viscous interaction) and <span></span><math> <semantics> <mrow> <mrow> <mi>D</mi> </mrow> </mrow> <annotation> <math altimg="urn:x-wiley:15564959:media:rob22339:rob22339-math-0002" wiley:location="equation/rob22339-math-0002.png" xmlns="http://www.w3.org/1998/Math/MathML"><mrow><mrow><mi>D</mi></mrow></mrow></math></annotation> </semantics></math> (fluid–wall viscous interaction). It was found that <span></span><math> <semantics> <mrow> <mrow> <mi>U</mi> </mrow> </mrow> <annotation> <math altimg="urn:x-wiley:15564959:media:rob22339:rob22339-math-0003" wiley:location="equation/rob22339-math-0003.png" xmlns="http://www.w3.org/1998/Math/MathML"><mrow><mrow><mi>U</mi></mrow></mrow></math></annotation> </semantics></math> had a varied three-stage influence on the simulation error while <span></span><math> <semantics> <mrow> <mrow> <mi>D</mi> </mrow> </mrow>
自动裂缝密封可大大有利于路面的维护,但要将正确量的密封材料注入隐蔽的裂缝空间却存在困难。如果能建立裂缝空间内材料流动的模拟模型,就可以开发出一种预测控制方案,使维修机器人能够应用合适的轨迹和操作参数,从而实现整齐的密封表面。基于位置的流体(PBF)方法是一种计算成本低、速度快但近似的流体流动模型,本文首次研究了该方法在机器人喷射裂缝密封方案中用于密封剂流动模拟的可行性。进行了一次 "真实到模拟 "实验,在虚拟机器人裂缝密封环境中对密封剂进行 PBF 模拟,并与物理实验室设置进行镜像。通过与 132 次模拟运行进行比较,改变人工粘度参数(流体与流体之间的粘滞相互作用)和(流体与墙壁之间的粘滞相互作用),对流体模拟进行调整,使其与真实世界的动态相匹配。结果发现,''对模拟误差的影响分为三个阶段,而''对模拟误差的负面影响仅有效适用于满足''要求的流体。通过比较物理和虚拟裂缝密封结果,仿真得到了验证,沿宽 3.1 毫米、深 16 毫米、长 80 毫米的人工裂缝的平均液位误差为 1.26 毫米,这表明 PBF 方法适用于机器人注塑密封。此外,还讨论了 PBF 方法的精度和计算要求。
{"title":"Position-based fluid simulation for robotic injection sealing of pavement cracks","authors":"Samuel D. Schaefer,&nbsp;Jie Xu,&nbsp;Damian Palin,&nbsp;Abir Al-Tabbaa,&nbsp;Fumiya Iida","doi":"10.1002/rob.22339","DOIUrl":"10.1002/rob.22339","url":null,"abstract":"&lt;p&gt;Automated crack sealing could significantly benefit the maintenance of road pavements, but there is difficulty in depositing the correct volume of sealant material into the hidden crack space. A simulated model of the material flow within a crack space would allow the development of a predictive control scheme, such that the repair robot can apply suitable trajectories and operational parameters to accomplish neatly sealed surfaces. For the first time, the position-based fluid (PBF) method, a computationally cheap and fast but approximate model of fluid flows, is studied for its feasibility for sealant flow simulation in the robotic injection crack sealing scenario. A Real-to-Sim experiment is performed, in which a PBF simulation of sealant in a virtual robotic crack sealing environment is mirrored from the physical lab setup. The fluid simulation is tuned to match the real-world dynamics through comparison with 132 simulation runs, varying the artificial viscosity parameters &lt;span&gt;&lt;/span&gt;&lt;math&gt;\u0000 &lt;semantics&gt;\u0000 &lt;mrow&gt;\u0000 \u0000 &lt;mrow&gt;\u0000 &lt;mi&gt;U&lt;/mi&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;annotation&gt; &lt;math altimg=\"urn:x-wiley:15564959:media:rob22339:rob22339-math-0001\" wiley:location=\"equation/rob22339-math-0001.png\" xmlns=\"http://www.w3.org/1998/Math/MathML\"&gt;&lt;mrow&gt;&lt;mrow&gt;&lt;mi&gt;U&lt;/mi&gt;&lt;/mrow&gt;&lt;/mrow&gt;&lt;/math&gt;&lt;/annotation&gt;\u0000 &lt;/semantics&gt;&lt;/math&gt; (fluid–fluid viscous interaction) and &lt;span&gt;&lt;/span&gt;&lt;math&gt;\u0000 &lt;semantics&gt;\u0000 &lt;mrow&gt;\u0000 \u0000 &lt;mrow&gt;\u0000 &lt;mi&gt;D&lt;/mi&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;annotation&gt; &lt;math altimg=\"urn:x-wiley:15564959:media:rob22339:rob22339-math-0002\" wiley:location=\"equation/rob22339-math-0002.png\" xmlns=\"http://www.w3.org/1998/Math/MathML\"&gt;&lt;mrow&gt;&lt;mrow&gt;&lt;mi&gt;D&lt;/mi&gt;&lt;/mrow&gt;&lt;/mrow&gt;&lt;/math&gt;&lt;/annotation&gt;\u0000 &lt;/semantics&gt;&lt;/math&gt; (fluid–wall viscous interaction). It was found that &lt;span&gt;&lt;/span&gt;&lt;math&gt;\u0000 &lt;semantics&gt;\u0000 &lt;mrow&gt;\u0000 \u0000 &lt;mrow&gt;\u0000 &lt;mi&gt;U&lt;/mi&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;annotation&gt; &lt;math altimg=\"urn:x-wiley:15564959:media:rob22339:rob22339-math-0003\" wiley:location=\"equation/rob22339-math-0003.png\" xmlns=\"http://www.w3.org/1998/Math/MathML\"&gt;&lt;mrow&gt;&lt;mrow&gt;&lt;mi&gt;U&lt;/mi&gt;&lt;/mrow&gt;&lt;/mrow&gt;&lt;/math&gt;&lt;/annotation&gt;\u0000 &lt;/semantics&gt;&lt;/math&gt; had a varied three-stage influence on the simulation error while &lt;span&gt;&lt;/span&gt;&lt;math&gt;\u0000 &lt;semantics&gt;\u0000 &lt;mrow&gt;\u0000 \u0000 &lt;mrow&gt;\u0000 &lt;mi&gt;D&lt;/mi&gt;\u0000 &lt;/mrow&gt;\u0000 &lt;/mrow&gt;\u0000 ","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 5","pages":"1438-1451"},"PeriodicalIF":4.2,"publicationDate":"2024-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/rob.22339","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140587602","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Field Robotics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1