首页 > 最新文献

Intelligent Service Robotics最新文献

英文 中文
A Methodology for end user programming of ROS-based service robots using jigsaw metaphor and ontologies 使用拼图隐喻和本体对基于 ROS 的服务机器人进行终端用户编程的方法论
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-04-03 DOI: 10.1007/s11370-024-00528-3
Övünç Öztürk

This study proposes a methodology to build an interface that will enable end users to interact with ROS-based service robots. The proposed methodology enables building an easy-to-use interface using the jigsaw metaphor. The methodology exploits ontologies to maximize the data sharing and integration among the users of the system. This methodology is verified on a cocktail robot as a case study and an end user-based survey is conducted to evaluate the built interface. The case study proved the feasibility of the methodology. User-based evaluation results provided positive feedback regarding the usability and preferability of the interface built with the proposed methodology.

本研究提出了一种构建界面的方法,使最终用户能够与基于 ROS 的服务机器人进行交互。所提出的方法能够利用拼图隐喻建立一个易于使用的界面。该方法利用本体论最大限度地实现系统用户之间的数据共享和集成。作为案例研究,该方法在鸡尾酒机器人上进行了验证,并开展了基于终端用户的调查,以评估所构建的界面。案例研究证明了该方法的可行性。基于用户的评估结果对采用所提方法构建的界面的可用性和可取性给予了积极反馈。
{"title":"A Methodology for end user programming of ROS-based service robots using jigsaw metaphor and ontologies","authors":"Övünç Öztürk","doi":"10.1007/s11370-024-00528-3","DOIUrl":"https://doi.org/10.1007/s11370-024-00528-3","url":null,"abstract":"<p>This study proposes a methodology to build an interface that will enable end users to interact with ROS-based service robots. The proposed methodology enables building an easy-to-use interface using the jigsaw metaphor. The methodology exploits ontologies to maximize the data sharing and integration among the users of the system. This methodology is verified on a cocktail robot as a case study and an end user-based survey is conducted to evaluate the built interface. The case study proved the feasibility of the methodology. User-based evaluation results provided positive feedback regarding the usability and preferability of the interface built with the proposed methodology.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140602019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Model-aided and vision-based navigation for an aerial robot in real-time application 空中机器人的模型辅助和基于视觉的实时导航应用
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-04-02 DOI: 10.1007/s11370-024-00532-7
M. Alizadeh, A. M. Khoshnood

In this paper, a novel navigation method with the assistance of a vehicle dynamic model (VDM), known as the VDM-aided navigation method, is introduced. This method is specifically designed for a subset of fixed-wing aerial robots within the broader category of unmanned aerial vehicles. Vision-based navigation (VBN) is employed to increase accuracy while maintaining reliability in Global Navigation Satellite System (GNSS) outages. In addition, an unscented Kalman filter (UKF) is used to estimate navigation parameters, including speed, position and attitude. This method uses the dynamic system as a process model and employs VBN, barometric altitude and vertical gyro as measurement inputs. In VBN, the method of scale-invariant feature transform is used as a method for image matching. To ensure the real-time capability of this method with the existing microprocessor, a hardware-in-the-loop (HIL) laboratory has been utilized. According to nonlinear observability methods, one can show the proposed integrated nonlinear navigation is observable under all conditions. Finally, the results of the HIL laboratory demonstrate that the proposed approach can estimate the robot navigation parameters with an acceptable level of precision even in the absence of an Inertial Navigation System (INS) and GNSS. It was validated even when there was an error of up to 20% in VDM parameters. Furthermore, an investigation was carried out regarding the use of Extended Kalman Filter instead of the UKF for the integrated navigation output. In GNSS outage conditions, considering both accuracy and cost, this method can serve as a valuable alternative for aerial robots. In addition, this approach can be recommended for INS fault detection with or without GNSS. Additionally, the integrated navigation provided can substitute the GNSS/INS system during fault conditions.

本文介绍了一种借助飞行器动态模型(VDM)的新型导航方法,即 VDM 辅助导航方法。这种方法是专门为更广泛的无人飞行器类别中的固定翼空中机器人子集而设计的。该方法采用了基于视觉的导航(VBN),以提高精度,同时在全球导航卫星系统(GNSS)中断时保持可靠性。此外,还采用了无特征卡尔曼滤波器(UKF)来估计导航参数,包括速度、位置和姿态。该方法使用动态系统作为过程模型,并采用 VBN、气压高度和垂直陀螺仪作为测量输入。在 VBN 中,采用尺度不变特征变换的方法进行图像匹配。为确保该方法在现有微处理器下的实时性,利用了硬件在环(HIL)实验室。根据非线性可观测性方法,可以证明所提出的集成非线性导航在所有条件下都是可观测的。最后,HIL 实验室的结果表明,即使在没有惯性导航系统(INS)和全球导航卫星系统(GNSS)的情况下,所提出的方法也能以可接受的精度估算机器人的导航参数。即使在 VDM 参数误差高达 20% 的情况下,该方法也得到了验证。此外,还研究了使用扩展卡尔曼滤波器(Extended Kalman Filter)代替UKF进行综合导航输出的问题。在全球导航卫星系统中断的情况下,考虑到精度和成本,这种方法可以作为空中机器人的一种有价值的替代方法。此外,无论是否有全球导航卫星系统,这种方法都可推荐用于 INS 故障检测。此外,在故障情况下,所提供的综合导航可替代 GNSS/INS 系统。
{"title":"Model-aided and vision-based navigation for an aerial robot in real-time application","authors":"M. Alizadeh, A. M. Khoshnood","doi":"10.1007/s11370-024-00532-7","DOIUrl":"https://doi.org/10.1007/s11370-024-00532-7","url":null,"abstract":"<p>In this paper, a novel navigation method with the assistance of a vehicle dynamic model (VDM), known as the VDM-aided navigation method, is introduced. This method is specifically designed for a subset of fixed-wing aerial robots within the broader category of unmanned aerial vehicles. Vision-based navigation (VBN) is employed to increase accuracy while maintaining reliability in Global Navigation Satellite System (GNSS) outages. In addition, an unscented Kalman filter (UKF) is used to estimate navigation parameters, including speed, position and attitude. This method uses the dynamic system as a process model and employs VBN, barometric altitude and vertical gyro as measurement inputs. In VBN, the method of scale-invariant feature transform is used as a method for image matching. To ensure the real-time capability of this method with the existing microprocessor, a hardware-in-the-loop (HIL) laboratory has been utilized. According to nonlinear observability methods, one can show the proposed integrated nonlinear navigation is observable under all conditions. Finally, the results of the HIL laboratory demonstrate that the proposed approach can estimate the robot navigation parameters with an acceptable level of precision even in the absence of an Inertial Navigation System (INS) and GNSS. It was validated even when there was an error of up to 20% in VDM parameters. Furthermore, an investigation was carried out regarding the use of Extended Kalman Filter instead of the UKF for the integrated navigation output. In GNSS outage conditions, considering both accuracy and cost, this method can serve as a valuable alternative for aerial robots. In addition, this approach can be recommended for INS fault detection with or without GNSS. Additionally, the integrated navigation provided can substitute the GNSS/INS system during fault conditions.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-04-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140600591","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Enhanced resampling scheme for Monte Carlo localization 蒙特卡罗定位的增强型重采样方案
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-03-25 DOI: 10.1007/s11370-024-00530-9
Suat Karakaya

The indoor positioning problem is a critical research domain essential for real-time control of mobile robots. Within this field, Monte Carlo-based solutions have been devised, leveraging the processing of diverse sensor data to address numerous challenges in local and global positioning. This study focuses on resampling strategies within the conventional Monte Carlo framework, which directly impact positioning performance. From this perspective, in contrast to the conventional method of employing weight thresholding and full particle scattering when the robot becomes disoriented, this study proposes an alternative approach. It advocates for a localized space resampling strategy, adaptive noise injection guided by likelihood, and the incorporation of beam rejection modifications to address dynamic (unmapped) obstacles effectively. The real-time experimental results, conducted with varying particle counts, demonstrate that the proposed scheme effectively manages the presence of unmapped obstacles while employing fewer particles than the standard Monte Carlo implementation.

室内定位问题是移动机器人实时控制的关键研究领域。在这一领域,人们设计了基于蒙特卡洛的解决方案,利用对各种传感器数据的处理来解决本地和全球定位中的众多难题。本研究的重点是传统蒙特卡罗框架内的重采样策略,它直接影响定位性能。从这个角度来看,与机器人迷失方向时采用权重阈值和全粒子散射的传统方法相比,本研究提出了另一种方法。它主张采用局部空间重采样策略、以似然比为指导的自适应噪声注入以及光束剔除修正,以有效解决动态(未映射)障碍物问题。在不同粒子数下进行的实时实验结果表明,所提出的方案能有效处理未映射障碍物的存在,同时采用的粒子数少于标准蒙特卡洛实施方案。
{"title":"Enhanced resampling scheme for Monte Carlo localization","authors":"Suat Karakaya","doi":"10.1007/s11370-024-00530-9","DOIUrl":"https://doi.org/10.1007/s11370-024-00530-9","url":null,"abstract":"<p>The indoor positioning problem is a critical research domain essential for real-time control of mobile robots. Within this field, Monte Carlo-based solutions have been devised, leveraging the processing of diverse sensor data to address numerous challenges in local and global positioning. This study focuses on resampling strategies within the conventional Monte Carlo framework, which directly impact positioning performance. From this perspective, in contrast to the conventional method of employing weight thresholding and full particle scattering when the robot becomes disoriented, this study proposes an alternative approach. It advocates for a localized space resampling strategy, adaptive noise injection guided by likelihood, and the incorporation of beam rejection modifications to address dynamic (unmapped) obstacles effectively. The real-time experimental results, conducted with varying particle counts, demonstrate that the proposed scheme effectively manages the presence of unmapped obstacles while employing fewer particles than the standard Monte Carlo implementation.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140302640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Feature refinement with DBO: optimizing RFRC method for autonomous vehicle detection 使用 DBO 进行特征细化:优化用于自动车辆检测的 RFRC 方法
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-03-12 DOI: 10.1007/s11370-024-00520-x

Abstract

In today’s world, the utilization of a large number of vehicles has led to congested traffic conditions and an increase in accidents. These issues are considered primary problems in the transportation field. Therefore, there is a pressing need to develop a novel method for monitoring traffic. To address this, we propose a new model called the residual faster recurrent convolutional (RFRC) algorithm. While the proposed model achieves good detection accuracy, it must also meet the demands of real-life scenarios. In this approach, the ResNet-50 model is combined with the faster recurrent-based convolutional neural network (FRCNN) to enable the detection of autonomous vehicles. We utilize the dung beetle optimizer (DBO) with a crossover strategy for feature selection, focusing on selecting relevant features for analysis. To validate the effectiveness of the proposed RFRC method, we conduct experiments using two datasets: the KITTI dataset and the COCO2017 dataset. The evaluation of the RFRC model is performed using various measures, including f1-score, precision, recall, accuracy, and specificity, on both datasets. The proposed RFRC model outperforms both datasets and attains better results in autonomous vehicle detection.

摘要 当今世界,大量车辆的使用导致了交通拥堵和事故增加。这些问题被认为是交通领域的首要问题。因此,迫切需要开发一种新的交通监控方法。为此,我们提出了一种名为残差快速卷积(RFRC)算法的新模型。所提出的模型在实现良好检测精度的同时,还必须满足现实生活场景的需求。在这种方法中,ResNet-50 模型与基于更快递归的卷积神经网络(FRCNN)相结合,实现了对自主车辆的检测。我们利用带有交叉策略的蜣螂优化器(DBO)进行特征选择,重点选择相关特征进行分析。为了验证所提出的 RFRC 方法的有效性,我们使用两个数据集进行了实验:KITTI 数据集和 COCO2017 数据集。在这两个数据集上,我们使用各种指标对 RFRC 模型进行了评估,包括 f1 分数、精确度、召回率、准确度和特异性。所提出的 RFRC 模型优于这两个数据集,在自动车辆检测方面取得了更好的结果。
{"title":"Feature refinement with DBO: optimizing RFRC method for autonomous vehicle detection","authors":"","doi":"10.1007/s11370-024-00520-x","DOIUrl":"https://doi.org/10.1007/s11370-024-00520-x","url":null,"abstract":"<h3>Abstract</h3> <p>In today’s world, the utilization of a large number of vehicles has led to congested traffic conditions and an increase in accidents. These issues are considered primary problems in the transportation field. Therefore, there is a pressing need to develop a novel method for monitoring traffic. To address this, we propose a new model called the residual faster recurrent convolutional (RFRC) algorithm. While the proposed model achieves good detection accuracy, it must also meet the demands of real-life scenarios. In this approach, the ResNet-50 model is combined with the faster recurrent-based convolutional neural network (FRCNN) to enable the detection of autonomous vehicles. We utilize the dung beetle optimizer (DBO) with a crossover strategy for feature selection, focusing on selecting relevant features for analysis. To validate the effectiveness of the proposed RFRC method, we conduct experiments using two datasets: the KITTI dataset and the COCO2017 dataset. The evaluation of the RFRC model is performed using various measures, including f1-score, precision, recall, accuracy, and specificity, on both datasets. The proposed RFRC model outperforms both datasets and attains better results in autonomous vehicle detection.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140127698","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Robots in healthcare as envisioned by care professionals 专业护理人员眼中的医疗保健机器人
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-03-06 DOI: 10.1007/s11370-024-00523-8
Fran Soljacic, Theresa Law , Meia Chita-Tegmark, Matthias Scheutz

As AI-enabled robots enter the realm of healthcare and caregiving, it is important to consider how they will address the dimensions of care and how they will interact not just with the direct receivers of assistance, but also with those who provide it (e.g., caregivers, healthcare providers, etc.). Caregiving in its best form addresses challenges in a multitude of dimensions of a person’s life: from physical to social-emotional and sometimes even existential dimensions (such as issues surrounding life and death). In this study, we use semi-structured qualitative interviews administered to healthcare professionals with multidisciplinary backgrounds (physicians, public health professionals, social workers, and chaplains) to understand their expectations regarding the possible roles robots may play in the healthcare ecosystem in the future. We found that participants drew inspiration in their mental models of robots from both works of science fiction but also from existing commercial robots. Participants envisioned roles for robots in the full spectrum of care, from physical to social-emotional and even existential-spiritual dimensions, but also pointed out numerous limitations that robots have in being able to provide comprehensive humanistic care. While no dimension of care was deemed as exclusively the realm of humans, participants stressed the importance of caregiving humans as the primary providers of comprehensive care, with robots assisting with more narrowly focused tasks. Throughout the paper, we point out the encouraging confluence of ideas between the expectations of healthcare providers and research trends in the human–robot interaction (HRI) literature.

随着人工智能机器人进入医疗保健和护理领域,重要的是要考虑它们将如何处理护理的各个层面,以及它们将如何不仅与援助的直接接受者互动,而且还与提供援助者(如护理人员、医疗保健提供者等)互动。护理的最佳形式是解决一个人生活中多个方面的挑战:从身体到社会情感,有时甚至是存在层面(如围绕生与死的问题)。在这项研究中,我们采用半结构化定性访谈的方式,对具有多学科背景的医疗保健专业人员(医生、公共卫生专业人员、社会工作者和牧师)进行了采访,以了解他们对机器人未来可能在医疗保健生态系统中扮演的角色的期望。我们发现,参与者从科幻小说和现有的商用机器人中汲取了机器人心智模型的灵感。与会者设想了机器人在从身体到社会情感,甚至是存在与精神层面的全方位护理中的作用,但同时也指出了机器人在提供全面人性化护理方面的诸多局限性。虽然没有任何一个护理维度被认为是人类的专属领域,但与会者强调了护理人员作为全面护理的主要提供者的重要性,而机器人则协助完成范围较窄的任务。在整篇论文中,我们指出了医疗保健提供者的期望与人机交互(HRI)文献研究趋势之间令人鼓舞的思想交汇。
{"title":"Robots in healthcare as envisioned by care professionals","authors":"Fran Soljacic, Theresa Law , Meia Chita-Tegmark, Matthias Scheutz","doi":"10.1007/s11370-024-00523-8","DOIUrl":"https://doi.org/10.1007/s11370-024-00523-8","url":null,"abstract":"<p>As AI-enabled robots enter the realm of healthcare and caregiving, it is important to consider how they will address the dimensions of care and how they will interact not just with the direct receivers of assistance, but also with those who provide it (e.g., caregivers, healthcare providers, etc.). Caregiving in its best form addresses challenges in a multitude of dimensions of a person’s life: from physical to social-emotional and sometimes even existential dimensions (such as issues surrounding life and death). In this study, we use semi-structured qualitative interviews administered to healthcare professionals with multidisciplinary backgrounds (physicians, public health professionals, social workers, and chaplains) to understand their expectations regarding the possible roles robots may play in the healthcare ecosystem in the future. We found that participants drew inspiration in their mental models of robots from both works of science fiction but also from existing commercial robots. Participants envisioned roles for robots in the full spectrum of care, from physical to social-emotional and even existential-spiritual dimensions, but also pointed out numerous limitations that robots have in being able to provide comprehensive humanistic care. While no dimension of care was deemed as exclusively the realm of humans, participants stressed the importance of caregiving humans as the primary providers of comprehensive care, with robots assisting with more narrowly focused tasks. Throughout the paper, we point out the encouraging confluence of ideas between the expectations of healthcare providers and research trends in the human–robot interaction (HRI) literature.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140071059","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Pas: a scale-invariant approach to maritime search and rescue object detection using preprocessing and attention scaling Pas:利用预处理和注意力缩放进行海上搜救目标检测的尺度不变方法
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-03-02 DOI: 10.1007/s11370-024-00526-5
Shibao Li, Chen Li, Zhaoyu Wang, Zekun Jia, Jinze Zhu, Xuerong Cui, Jianhang Liu

Object detection is a primary means of unmanned aerial vehicle (UAV) maritime search and rescue. The problem of scale variation caused by UAV flight height changes, shooting angle changes, and giant waves seriously affects the detection performance. However, most work does not explicitly consider the effects of these factors. In this work, we propose an algorithm called Preprocessing and Attention Scaling, which explicitly considers the scale variation problem caused by height, angle changes, and giant waves for the first time and solves it through Preprocessing Scaling and Attention Scaling. The Preprocessing Scaling module scales and perspective changes the images according to each photograph’s recorded flight altitude and shooting angle and crops them to the appropriate size, significantly improving the detection accuracy and shortening the inference time. At the same time, the scale variation caused by the up and down of the object due to the vast swells cannot be solved by the Preprocessing Scaling module, so we designed the Attention Scaling module again to quickly capture the area that needs further scale change by fusing the horizontal attention and vertical attention, and then transform it to the appropriate scale by the affine transformation, further improving detection accuracy. We extensively tested PAS on the well-known SeaDronesSee-DET and the SeaDronesSee-DET v2 (S-ODv2) datasets, significantly improving the detection accuracy. In addition, we successfully tested our method on a height-angle transfer task, where we trained on some height-angle intervals and tested on different height-angle intervals, achieving good results.

物体探测是无人机(UAV)海上搜救的主要手段。无人机飞行高度变化、拍摄角度变化和巨浪造成的尺度变化问题严重影响了探测性能。然而,大多数工作并没有明确考虑这些因素的影响。在这项工作中,我们提出了一种名为 "预处理和注意力缩放 "的算法,首次明确考虑了高度、角度变化和巨浪引起的尺度变化问题,并通过 "预处理缩放 "和 "注意力缩放 "解决了这一问题。预处理缩放模块根据每张照片记录的飞行高度和拍摄角度对图像进行缩放和透视变化,并裁剪成合适的大小,从而显著提高了检测精度,缩短了推理时间。同时,预处理缩放模块无法解决物体因巨大的海浪而上下起伏造成的尺度变化,因此我们又设计了注意力缩放模块,通过融合水平注意力和垂直注意力,快速捕捉到需要进一步改变尺度的区域,然后通过仿射变换将其变换到合适的尺度,进一步提高了检测精度。我们在著名的 SeaDronesSee-DET 和 SeaDronesSee-DET v2(S-ODv2)数据集上对 PAS 进行了广泛测试,显著提高了检测精度。此外,我们还成功地在高度角转移任务中测试了我们的方法,即在某些高度角区间进行训练,在不同高度角区间进行测试,取得了良好的效果。
{"title":"Pas: a scale-invariant approach to maritime search and rescue object detection using preprocessing and attention scaling","authors":"Shibao Li, Chen Li, Zhaoyu Wang, Zekun Jia, Jinze Zhu, Xuerong Cui, Jianhang Liu","doi":"10.1007/s11370-024-00526-5","DOIUrl":"https://doi.org/10.1007/s11370-024-00526-5","url":null,"abstract":"<p>Object detection is a primary means of unmanned aerial vehicle (UAV) maritime search and rescue. The problem of scale variation caused by UAV flight height changes, shooting angle changes, and giant waves seriously affects the detection performance. However, most work does not explicitly consider the effects of these factors. In this work, we propose an algorithm called Preprocessing and Attention Scaling, which explicitly considers the scale variation problem caused by height, angle changes, and giant waves for the first time and solves it through Preprocessing Scaling and Attention Scaling. The Preprocessing Scaling module scales and perspective changes the images according to each photograph’s recorded flight altitude and shooting angle and crops them to the appropriate size, significantly improving the detection accuracy and shortening the inference time. At the same time, the scale variation caused by the up and down of the object due to the vast swells cannot be solved by the Preprocessing Scaling module, so we designed the Attention Scaling module again to quickly capture the area that needs further scale change by fusing the horizontal attention and vertical attention, and then transform it to the appropriate scale by the affine transformation, further improving detection accuracy. We extensively tested PAS on the well-known SeaDronesSee-DET and the SeaDronesSee-DET v2 (S-ODv2) datasets, significantly improving the detection accuracy. In addition, we successfully tested our method on a height-angle transfer task, where we trained on some height-angle intervals and tested on different height-angle intervals, achieving good results.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-03-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140018815","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development of a compact rotary series elastic actuator with neural network-driven model predictive control implementation 利用神经网络驱动的模型预测控制实现紧凑型旋转串联弹性致动器的开发
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-02-29 DOI: 10.1007/s11370-024-00522-9
Anlong Zhang, Zhiyun Lin, Bo Wang, Zhimin Han

The development and control of a rotary series elastic actuator (SEA) are investigated in this paper. First, a rotary SEA is designed with a small volume and is lightweight, where the elastic element can be used as a torque sensor. We improve the structure of this rubber material elastic element, and its characteristics are analyzed. To provide a more comprehensive description of the entire system, motor dynamics are also taken into account while establishing the entire system dynamics model. Second, a neural network-driven model predictive control (NNMPC) method is proposed for the single-link SEA system. Since a real dynamic system for the SEA is hard to establish accurately due to disturbances, uncertainties, and varying mass of the load in different applications, a simple nonlinear autoregressive neural network using the rectified linear unit as the activation function (ReLU-NARX NN) is considered to approximate the system dynamic model, based on which a model predictive controller is developed. Finally, both numerical simulations and experiments are conducted for position and torque control. The simulation and experimental results demonstrate that the proposed method is superior to the conventional PD (proportional differential) method and the traditional MPC method. For position control, the NNMPC method is shown to be more effective, that is, it can suppress residual vibrations, reduce overshoots, arrive at a steady state quickly, and robust to different loads in a range. For torque control, the control performance is also satisfactory.

本文研究了旋转串联弹性致动器(SEA)的开发和控制。首先,我们设计了一种体积小、重量轻的旋转式 SEA,其中的弹性元件可用作扭矩传感器。我们改进了这种橡胶材料弹性元件的结构,并对其特性进行了分析。为了更全面地描述整个系统,在建立整个系统动力学模型时,还考虑了电机动力学。其次,针对单链路 SEA 系统提出了神经网络驱动的模型预测控制(NNMPC)方法。由于扰动、不确定性以及不同应用中负载质量的变化,SEA 的真实动态系统很难准确建立,因此考虑使用整流线性单元作为激活函数的简单非线性自回归神经网络(ReLU-NARX NN)来逼近系统动态模型,并在此基础上开发模型预测控制器。最后,对位置和扭矩控制进行了数值模拟和实验。仿真和实验结果表明,所提出的方法优于传统的 PD(比例微分)方法和传统的 MPC 方法。在位置控制方面,NNMPC 方法更有效,即它能抑制残余振动,减少过冲,快速达到稳定状态,并在一定范围内对不同负载具有鲁棒性。在扭矩控制方面,控制性能也令人满意。
{"title":"Development of a compact rotary series elastic actuator with neural network-driven model predictive control implementation","authors":"Anlong Zhang, Zhiyun Lin, Bo Wang, Zhimin Han","doi":"10.1007/s11370-024-00522-9","DOIUrl":"https://doi.org/10.1007/s11370-024-00522-9","url":null,"abstract":"<p>The development and control of a rotary series elastic actuator (SEA) are investigated in this paper. First, a rotary SEA is designed with a small volume and is lightweight, where the elastic element can be used as a torque sensor. We improve the structure of this rubber material elastic element, and its characteristics are analyzed. To provide a more comprehensive description of the entire system, motor dynamics are also taken into account while establishing the entire system dynamics model. Second, a neural network-driven model predictive control (NNMPC) method is proposed for the single-link SEA system. Since a real dynamic system for the SEA is hard to establish accurately due to disturbances, uncertainties, and varying mass of the load in different applications, a simple nonlinear autoregressive neural network using the rectified linear unit as the activation function (ReLU-NARX NN) is considered to approximate the system dynamic model, based on which a model predictive controller is developed. Finally, both numerical simulations and experiments are conducted for position and torque control. The simulation and experimental results demonstrate that the proposed method is superior to the conventional PD (proportional differential) method and the traditional MPC method. For position control, the NNMPC method is shown to be more effective, that is, it can suppress residual vibrations, reduce overshoots, arrive at a steady state quickly, and robust to different loads in a range. For torque control, the control performance is also satisfactory.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-02-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140011009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Memory-based soft actor–critic with prioritized experience replay for autonomous navigation 基于记忆的软演员评判器与优先级经验重放,用于自主导航
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-02-29 DOI: 10.1007/s11370-024-00514-9
Zhigang Wei, Wendong Xiao, Liang Yuan, Teng Ran, Jianping Cui, Kai Lv

Due to random sampling and the unpredictability of moving obstacles, it remains challenging for mobile robots to effectively learn navigation policies and accomplish obstacle avoidance safely. Overcoming such challenges can reduce the time cost required for navigation model training and validation, improving the safety and credibility of autonomous navigation in medical service and industrial patrol. This article proposes an improved soft actor–critic model to enhance the autonomous navigation performance of robots. We first introduce a prioritized experience replay method to reduce the randomness of sampling. The performance of the navigation policy can be enhanced by prioritizing the learning of high-value experiences. Moreover, we also design a network with long short-term memory abilities to store historical environmental information. In this way, temporal characteristics of obstacle motion can be obtained to optimize obstacle avoidance policy. Experimental results in simulation and real-world show that the proposed model significantly improves learning speed, success rate, and trajectory smoothness while exhibiting excellent obstacle avoidance performance in dynamic environments.

由于随机抽样和移动障碍物的不可预测性,移动机器人要有效地学习导航策略并安全地避开障碍物仍然是一项挑战。克服这些挑战可以减少导航模型训练和验证所需的时间成本,提高医疗服务和工业巡逻中自主导航的安全性和可信度。本文提出了一种改进的软行为批评模型,以提高机器人的自主导航性能。我们首先介绍了一种优先级经验重放方法,以减少抽样的随机性。通过优先学习高价值经验,可以提高导航策略的性能。此外,我们还设计了一个具有长期短期记忆能力的网络,以存储历史环境信息。通过这种方法,可以获得障碍物运动的时间特征,从而优化避障策略。仿真和真实世界的实验结果表明,所提出的模型显著提高了学习速度、成功率和轨迹平滑度,同时在动态环境中表现出优异的避障性能。
{"title":"Memory-based soft actor–critic with prioritized experience replay for autonomous navigation","authors":"Zhigang Wei, Wendong Xiao, Liang Yuan, Teng Ran, Jianping Cui, Kai Lv","doi":"10.1007/s11370-024-00514-9","DOIUrl":"https://doi.org/10.1007/s11370-024-00514-9","url":null,"abstract":"<p>Due to random sampling and the unpredictability of moving obstacles, it remains challenging for mobile robots to effectively learn navigation policies and accomplish obstacle avoidance safely. Overcoming such challenges can reduce the time cost required for navigation model training and validation, improving the safety and credibility of autonomous navigation in medical service and industrial patrol. This article proposes an improved soft actor–critic model to enhance the autonomous navigation performance of robots. We first introduce a prioritized experience replay method to reduce the randomness of sampling. The performance of the navigation policy can be enhanced by prioritizing the learning of high-value experiences. Moreover, we also design a network with long short-term memory abilities to store historical environmental information. In this way, temporal characteristics of obstacle motion can be obtained to optimize obstacle avoidance policy. Experimental results in simulation and real-world show that the proposed model significantly improves learning speed, success rate, and trajectory smoothness while exhibiting excellent obstacle avoidance performance in dynamic environments.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-02-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140011011","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of repetitive ROM exercise training using a patient robot with musculoskeletal symptoms 使用有肌肉骨骼症状的病人机器人进行重复性 ROM 运动训练的效果
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-02-29 DOI: 10.1007/s11370-024-00518-5
Miran Lee

In care and nursing education systems, students lack opportunities for acquiring the necessary skills and experiences from practice with actual patients. In this paper, we present a patient robot with musculoskeletal symptoms that supports efficient care education for caregivers to investigate the effects of repetitive range of motion (ROM) exercises. Four students and four experts (who have had many years of experience in the medical field) participated in the data acquisition process by performing repetitive ROM tasks using a patient robot. Based on the collected data, the results were analyzed and the effectiveness and feasibility of repetitive ROM exercises conducted using the patient robot were discussed. This study may provide a new pathway for developing advanced patient robots for use in care training environments by imitating the symptoms of various muscle and joint diseases such as palsy, contractures, and muscle weakness.

在护理和护理教育系统中,学生缺乏从实际病人的实践中获得必要技能和经验的机会。在本文中,我们介绍了一个具有肌肉骨骼症状的病人机器人,它支持对护理人员进行高效护理教育,以研究重复性动作幅度(ROM)练习的效果。四名学生和四名专家(他们在医疗领域拥有多年经验)参与了数据采集过程,使用病人机器人执行重复性 ROM 任务。根据收集到的数据,对结果进行了分析,并讨论了使用病人机器人进行重复性 ROM 练习的有效性和可行性。这项研究通过模仿各种肌肉和关节疾病(如麻痹、挛缩和肌无力)的症状,为开发用于护理培训环境的先进病人机器人提供了一条新途径。
{"title":"Effects of repetitive ROM exercise training using a patient robot with musculoskeletal symptoms","authors":"Miran Lee","doi":"10.1007/s11370-024-00518-5","DOIUrl":"https://doi.org/10.1007/s11370-024-00518-5","url":null,"abstract":"<p>In care and nursing education systems, students lack opportunities for acquiring the necessary skills and experiences from practice with actual patients. In this paper, we present a patient robot with musculoskeletal symptoms that supports efficient care education for caregivers to investigate the effects of repetitive range of motion (ROM) exercises. Four students and four experts (who have had many years of experience in the medical field) participated in the data acquisition process by performing repetitive ROM tasks using a patient robot. Based on the collected data, the results were analyzed and the effectiveness and feasibility of repetitive ROM exercises conducted using the patient robot were discussed. This study may provide a new pathway for developing advanced patient robots for use in care training environments by imitating the symptoms of various muscle and joint diseases such as palsy, contractures, and muscle weakness.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-02-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140011045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hybrid genetic ant colony optimization algorithm for full-coverage path planning of gardening pruning robots 用于园艺修剪机器人全覆盖路径规划的混合遗传蚁群优化算法
IF 2.5 4区 计算机科学 Q1 Engineering Pub Date : 2024-02-29 DOI: 10.1007/s11370-024-00525-6
Xiaolin Xie, Zixiang Yan, Zhihong Zhang, Yibo Qin, Hang Jin, Man Xu

Gardening pruning robots are widely applied in green space construction. However, increase of green space environment complexity and obstacle number affect the coverage range and work efficiency of robots. To solve this problem, this research proposed a full-coverage path planning algorithm integrating hybrid genetic ant colony and A* algorithm. Specifically tailored to the lawn working environments of horticultural pruning robots, we initially employed visual simultaneous localization and mapping to create a 3D point cloud map, converting it into an occupancy grid map for future path planning. The obtained grid map was partitioned into multiple subareas on the basis of the locations of obstacles. The optimal traversal order of sub-regions was determined using hybrid genetic ant colony method and a new update strategy of heuristic and pheromone factors was developed for improving the ability of global search and probability of jumping out of local optimal solution. Boustrophedon method was applied to fully cover each sub-region, A* algorithm was adopted to connect various sub-regions, and connection strategy was optimized. Simulation results showed that compared with traditional ant colony algorithm and other full-coverage planning algorithms, the algorithm developed in this research presented superior performance in terms of traversal path length, starting distance, coverage rate and turning times on maps with various sizes and complexities.

园艺修剪机器人广泛应用于绿地建设。然而,绿地环境复杂度和障碍物数量的增加会影响机器人的覆盖范围和工作效率。为解决这一问题,本研究提出了一种融合了混合遗传蚁群和 A* 算法的全覆盖路径规划算法。针对园艺修剪机器人的草坪工作环境,我们首先采用视觉同步定位和绘图技术创建三维点云图,并将其转换为占位网格图,用于未来的路径规划。根据障碍物的位置,将获得的网格图划分为多个子区域。利用混合遗传蚁群方法确定了子区域的最佳遍历顺序,并开发了一种新的启发式和信息素更新策略,以提高全局搜索能力和跳出局部最优解的概率。应用 Boustrophedon 方法全面覆盖各个子区域,采用 A* 算法连接各个子区域,并优化了连接策略。仿真结果表明,与传统的蚁群算法和其他全覆盖规划算法相比,本研究开发的算法在不同大小和复杂程度的地图上,在遍历路径长度、起始距离、覆盖率和转弯时间等方面都表现优异。
{"title":"Hybrid genetic ant colony optimization algorithm for full-coverage path planning of gardening pruning robots","authors":"Xiaolin Xie, Zixiang Yan, Zhihong Zhang, Yibo Qin, Hang Jin, Man Xu","doi":"10.1007/s11370-024-00525-6","DOIUrl":"https://doi.org/10.1007/s11370-024-00525-6","url":null,"abstract":"<p>Gardening pruning robots are widely applied in green space construction. However, increase of green space environment complexity and obstacle number affect the coverage range and work efficiency of robots. To solve this problem, this research proposed a full-coverage path planning algorithm integrating hybrid genetic ant colony and A* algorithm. Specifically tailored to the lawn working environments of horticultural pruning robots, we initially employed visual simultaneous localization and mapping to create a 3D point cloud map, converting it into an occupancy grid map for future path planning. The obtained grid map was partitioned into multiple subareas on the basis of the locations of obstacles. The optimal traversal order of sub-regions was determined using hybrid genetic ant colony method and a new update strategy of heuristic and pheromone factors was developed for improving the ability of global search and probability of jumping out of local optimal solution. Boustrophedon method was applied to fully cover each sub-region, A* algorithm was adopted to connect various sub-regions, and connection strategy was optimized. Simulation results showed that compared with traditional ant colony algorithm and other full-coverage planning algorithms, the algorithm developed in this research presented superior performance in terms of traversal path length, starting distance, coverage rate and turning times on maps with various sizes and complexities.</p>","PeriodicalId":48813,"journal":{"name":"Intelligent Service Robotics","volume":null,"pages":null},"PeriodicalIF":2.5,"publicationDate":"2024-02-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140011028","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Intelligent Service Robotics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1