首页 > 最新文献

Drones最新文献

英文 中文
A Live Detecting System for Strain Clamps of Transmission Lines Based on Dual UAVs’ Cooperation 基于双无人机合作的输电线路应变夹钳实时检测系统
Pub Date : 2024-07-19 DOI: 10.3390/drones8070333
Zhiwei Jia, Yongkang Ouyang, Chao Feng, Shaosheng Fan, Zheng Liu, Chenhao Sun
Strain clamps are critical components in high-voltage overhead transmission lines, and detection of their defects becomes an important part of regular inspection of transmission lines. A dual UAV (unmanned aerial vehicle) system was proposed to detect strain clamps in multiple split-phase conductors. The main UAV was equipped with a digital radiography (DR) imaging device, a mechanical arm, and an edge intelligence module with visual sensors. The slave UAV was equipped with a digital imaging board and visual sensors. A workflow was proposed for this dual UAV system. Target detection and distance detection of the strain clamps, as well as detection of the defects of strain clamps in DR images, are the main procedures of this workflow. To satisfy the demands of UAV-borne and real-time deployment, the improved YOLOv8-TR algorithm was proposed for the detection of strain clamps (the mAP@50 was 60.9%), and the KD-ResRPA algorithm is used for detecting defects in DR images (the average AUCROC of the three datasets was 82.7%). Field experiments validated the suitability of our dual UAV-based system for charged detection of strain clamps in double split-phase conductors, demonstrating its potential for practical application in live detecting systems.
应变夹具是高压架空输电线路的关键部件,检测其缺陷成为输电线路定期检查的重要组成部分。我们提出了一种双无人飞行器(UAV)系统,用于检测多根分相导线中的应变夹钳。主无人机配备了数字射线成像(DR)装置、机械臂和带视觉传感器的边缘智能模块。从属无人机配备了数字成像板和视觉传感器。针对这种双无人机系统提出了一套工作流程。目标检测、应变夹具的距离检测以及在 DR 图像中检测应变夹具的缺陷是该工作流程的主要程序。为满足无人机搭载和实时部署的需求,提出了改进的 YOLOv8-TR 算法用于检测应变夹具(mAP@50 为 60.9%),KD-ResRPA 算法用于检测 DR 图像中的缺陷(三个数据集的平均 AUCROC 为 82.7%)。现场实验验证了我们基于双无人机的系统对双分相导线应变夹具带电检测的适用性,证明了其在带电检测系统中的实际应用潜力。
{"title":"A Live Detecting System for Strain Clamps of Transmission Lines Based on Dual UAVs’ Cooperation","authors":"Zhiwei Jia, Yongkang Ouyang, Chao Feng, Shaosheng Fan, Zheng Liu, Chenhao Sun","doi":"10.3390/drones8070333","DOIUrl":"https://doi.org/10.3390/drones8070333","url":null,"abstract":"Strain clamps are critical components in high-voltage overhead transmission lines, and detection of their defects becomes an important part of regular inspection of transmission lines. A dual UAV (unmanned aerial vehicle) system was proposed to detect strain clamps in multiple split-phase conductors. The main UAV was equipped with a digital radiography (DR) imaging device, a mechanical arm, and an edge intelligence module with visual sensors. The slave UAV was equipped with a digital imaging board and visual sensors. A workflow was proposed for this dual UAV system. Target detection and distance detection of the strain clamps, as well as detection of the defects of strain clamps in DR images, are the main procedures of this workflow. To satisfy the demands of UAV-borne and real-time deployment, the improved YOLOv8-TR algorithm was proposed for the detection of strain clamps (the mAP@50 was 60.9%), and the KD-ResRPA algorithm is used for detecting defects in DR images (the average AUCROC of the three datasets was 82.7%). Field experiments validated the suitability of our dual UAV-based system for charged detection of strain clamps in double split-phase conductors, demonstrating its potential for practical application in live detecting systems.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141822744","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Vision-Based Anti-UAV Detection Based on YOLOv7-GS in Complex Backgrounds 复杂背景下基于 YOLOv7-GS 的反无人机视觉检测
Pub Date : 2024-07-18 DOI: 10.3390/drones8070331
Chunjuan Bo, Yuntao Wei, Xiujia Wang, Zhan Shi, Ying Xiao
Unauthorized unmanned aerial vehicles (UAVs) pose threats to public safety and individual privacy. Traditional object-detection approaches often fall short during their application in anti-UAV technologies. To address this issue, we propose the YOLOv7-GS model, which is designed specifically for the identification of small UAVs in complex and low-altitude environments. This research primarily aims to improve the model’s detection capabilities for small UAVs in complex backgrounds. Enhancements were applied to the YOLOv7-tiny model, including adjustments to the sizes of prior boxes, incorporation of the InceptionNeXt module at the end of the neck section, and introduction of the SPPFCSPC-SR and Get-and-Send modules. These modifications aid in the preservation of details about small UAVs and heighten the model’s focus on them. The YOLOv7-GS model achieves commendable results on the DUT Anti-UAV and the Amateur Unmanned Air Vehicle Detection datasets and performs to be competitive against other mainstream algorithms.
未经授权的无人飞行器(UAV)对公共安全和个人隐私构成威胁。传统的物体检测方法在应用于反无人飞行器技术时往往会出现问题。为解决这一问题,我们提出了 YOLOv7-GS 模型,该模型专为识别复杂低空环境中的小型无人机而设计。这项研究的主要目的是提高模型在复杂背景下对小型无人机的探测能力。我们对 YOLOv7-tiny 模型进行了改进,包括调整先前方框的大小,在颈部末端加入 InceptionNeXt 模块,以及引入 SPPFCSPC-SR 和 Get-and-Send 模块。这些修改有助于保留小型无人机的细节,并加强模型对它们的关注。YOLOv7-GS 模型在 DUT 反无人驾驶飞行器和业余无人驾驶飞行器检测数据集上取得了值得称赞的结果,与其他主流算法相比具有很强的竞争力。
{"title":"Vision-Based Anti-UAV Detection Based on YOLOv7-GS in Complex Backgrounds","authors":"Chunjuan Bo, Yuntao Wei, Xiujia Wang, Zhan Shi, Ying Xiao","doi":"10.3390/drones8070331","DOIUrl":"https://doi.org/10.3390/drones8070331","url":null,"abstract":"Unauthorized unmanned aerial vehicles (UAVs) pose threats to public safety and individual privacy. Traditional object-detection approaches often fall short during their application in anti-UAV technologies. To address this issue, we propose the YOLOv7-GS model, which is designed specifically for the identification of small UAVs in complex and low-altitude environments. This research primarily aims to improve the model’s detection capabilities for small UAVs in complex backgrounds. Enhancements were applied to the YOLOv7-tiny model, including adjustments to the sizes of prior boxes, incorporation of the InceptionNeXt module at the end of the neck section, and introduction of the SPPFCSPC-SR and Get-and-Send modules. These modifications aid in the preservation of details about small UAVs and heighten the model’s focus on them. The YOLOv7-GS model achieves commendable results on the DUT Anti-UAV and the Amateur Unmanned Air Vehicle Detection datasets and performs to be competitive against other mainstream algorithms.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141824291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
YOMO-Runwaynet: A Lightweight Fixed-Wing Aircraft Runway Detection Algorithm Combining YOLO and MobileRunwaynet YOMO-Runwaynet:结合 YOLO 和 MobileRunwaynet 的轻量级固定翼飞机跑道检测算法
Pub Date : 2024-07-18 DOI: 10.3390/drones8070330
Wei Dai, Zhengjun Zhai, Dezhong Wang, Zhaozi Zu, Siyuan Shen, Xinlei Lv, Sheng Lu, Lei Wang
The runway detection algorithm for fixed-wing aircraft is a hot topic in the field of aircraft visual navigation. High accuracy, high fault tolerance, and lightweight design are the core requirements in the domain of runway feature detection. This paper aims to address these needs by proposing a lightweight runway feature detection algorithm named YOMO-Runwaynet, designed for edge devices. The algorithm features a lightweight network architecture that follows the YOMO inference framework, combining the advantages of YOLO and MobileNetV3 in feature extraction and operational speed. Firstly, a lightweight attention module is introduced into MnasNet, and the improved MobileNetV3 is employed as the backbone network to enhance the feature extraction efficiency. Then, PANet and SPPnet are incorporated to aggregate the features from multiple effective feature layers. Subsequently, to reduce latency and improve efficiency, YOMO-Runwaynet generates a single optimal prediction for each object, eliminating the need for non-maximum suppression (NMS). Finally, experimental results on embedded devices demonstrate that YOMO-Runwaynet achieves a detection accuracy of over 89.5% on the ATD (Aerovista Runway Dataset), with a pixel error rate of less than 0.003 for runway keypoint detection, and an inference speed exceeding 90.9 FPS. These results indicate that the YOMO-Runwaynet algorithm offers high accuracy and real-time performance, providing effective support for the visual navigation of fixed-wing aircraft.
固定翼飞机的跑道检测算法是飞机目视导航领域的热门话题。高精度、高容错性和轻量级设计是跑道特征检测领域的核心要求。为了满足这些需求,本文提出了一种针对边缘设备设计的轻量级跑道特征检测算法,名为 YOMO-Runwaynet。该算法采用轻量级网络架构,遵循 YOMO 推理框架,结合了 YOLO 和 MobileNetV3 在特征提取和运行速度方面的优势。首先,在 MnasNet 中引入轻量级注意力模块,并采用改进后的 MobileNetV3 作为骨干网络,以提高特征提取效率。然后,加入 PANet 和 SPPnet,以聚合多个有效特征层的特征。随后,为了减少延迟和提高效率,YOMO-Runwaynet 为每个对象生成一个单一的最优预测,从而消除了非最大抑制(NMS)的需要。最后,在嵌入式设备上的实验结果表明,YOMO-Runwaynet 在 ATD(Aerovista 跑道数据集)上的检测准确率超过 89.5%,跑道关键点检测的像素错误率低于 0.003,推理速度超过 90.9 FPS。这些结果表明,YOMO-Runwaynet 算法具有高精度和实时性,可为固定翼飞机的目视导航提供有效支持。
{"title":"YOMO-Runwaynet: A Lightweight Fixed-Wing Aircraft Runway Detection Algorithm Combining YOLO and MobileRunwaynet","authors":"Wei Dai, Zhengjun Zhai, Dezhong Wang, Zhaozi Zu, Siyuan Shen, Xinlei Lv, Sheng Lu, Lei Wang","doi":"10.3390/drones8070330","DOIUrl":"https://doi.org/10.3390/drones8070330","url":null,"abstract":"The runway detection algorithm for fixed-wing aircraft is a hot topic in the field of aircraft visual navigation. High accuracy, high fault tolerance, and lightweight design are the core requirements in the domain of runway feature detection. This paper aims to address these needs by proposing a lightweight runway feature detection algorithm named YOMO-Runwaynet, designed for edge devices. The algorithm features a lightweight network architecture that follows the YOMO inference framework, combining the advantages of YOLO and MobileNetV3 in feature extraction and operational speed. Firstly, a lightweight attention module is introduced into MnasNet, and the improved MobileNetV3 is employed as the backbone network to enhance the feature extraction efficiency. Then, PANet and SPPnet are incorporated to aggregate the features from multiple effective feature layers. Subsequently, to reduce latency and improve efficiency, YOMO-Runwaynet generates a single optimal prediction for each object, eliminating the need for non-maximum suppression (NMS). Finally, experimental results on embedded devices demonstrate that YOMO-Runwaynet achieves a detection accuracy of over 89.5% on the ATD (Aerovista Runway Dataset), with a pixel error rate of less than 0.003 for runway keypoint detection, and an inference speed exceeding 90.9 FPS. These results indicate that the YOMO-Runwaynet algorithm offers high accuracy and real-time performance, providing effective support for the visual navigation of fixed-wing aircraft.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141825957","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An All-Time Detection Algorithm for UAV Images in Urban Low Altitude 城市低空无人机图像的全时检测算法
Pub Date : 2024-07-18 DOI: 10.3390/drones8070332
Yuzhuo Huang, Jingyi Qu, Haoyu Wang, Jun Yang
With the rapid development of urban air traffic, Unmanned Aerial Vehicles (UAVs) are gradually being widely used in cities. Since UAVs are prohibited over important places in Urban Air Mobility (UAM), such as government and airports, it is important to develop air–ground non-cooperative UAV surveillance for air security all day and night. In the paper, an all-time UAV detection algorithm based on visible images during the day and infrared images at night is proposed by our team. We construct a UAV dataset used in urban visible backgrounds (UAV–visible) and a UAV dataset used in urban infrared backgrounds (UAV–infrared). In the daytime, the visible images are less accurate for UAV detection in foggy environments; therefore, we incorporate a defogging algorithm with the detection network that can ensure the undistorted output of images for UAV detection based on the realization of defogging. At night, infrared images have the characteristics of a low-resolution, unclear object contour, and complex image background. We integrate the attention and the transformation of space feature maps into depth feature maps to detect small UAVs in images. The all-time detection algorithm is trained separately on these two datasets, which can achieve 96.3% and 94.7% mAP50 on the UAV–visible and UAV–infrared datasets and perform real-time object detection with an inference speed of 40.16 FPS and 28.57 FPS, respectively.
随着城市空中交通的快速发展,无人机(UAV)逐渐在城市中得到广泛应用。由于在城市空中交通(UAM)中,政府、机场等重要场所上空禁止无人机飞行,因此,发展空地非协同无人机监控,实现全天候空中安全保障就显得尤为重要。在本文中,我们的团队提出了一种基于白天可见光图像和夜间红外图像的全时无人机检测算法。我们构建了一个用于城市可见光背景的无人机数据集(UAV-visible)和一个用于城市红外背景的无人机数据集(UAV-infrared)。在白天,可见光图像对雾环境中的无人机检测精度较低;因此,我们在检测网络中加入了除雾算法,在实现除雾的基础上,确保无人机检测图像的不失真输出。夜间红外图像具有分辨率低、物体轮廓不清晰、图像背景复杂等特点。我们将注意力和空间特征图转化为深度特征图整合在一起,以检测图像中的小型无人机。我们在这两个数据集上分别训练了全时检测算法,该算法在无人机可见光数据集和无人机红外数据集上的 mAP50 分别达到 96.3% 和 94.7%,并能以 40.16 FPS 和 28.57 FPS 的推理速度进行实时物体检测。
{"title":"An All-Time Detection Algorithm for UAV Images in Urban Low Altitude","authors":"Yuzhuo Huang, Jingyi Qu, Haoyu Wang, Jun Yang","doi":"10.3390/drones8070332","DOIUrl":"https://doi.org/10.3390/drones8070332","url":null,"abstract":"With the rapid development of urban air traffic, Unmanned Aerial Vehicles (UAVs) are gradually being widely used in cities. Since UAVs are prohibited over important places in Urban Air Mobility (UAM), such as government and airports, it is important to develop air–ground non-cooperative UAV surveillance for air security all day and night. In the paper, an all-time UAV detection algorithm based on visible images during the day and infrared images at night is proposed by our team. We construct a UAV dataset used in urban visible backgrounds (UAV–visible) and a UAV dataset used in urban infrared backgrounds (UAV–infrared). In the daytime, the visible images are less accurate for UAV detection in foggy environments; therefore, we incorporate a defogging algorithm with the detection network that can ensure the undistorted output of images for UAV detection based on the realization of defogging. At night, infrared images have the characteristics of a low-resolution, unclear object contour, and complex image background. We integrate the attention and the transformation of space feature maps into depth feature maps to detect small UAVs in images. The all-time detection algorithm is trained separately on these two datasets, which can achieve 96.3% and 94.7% mAP50 on the UAV–visible and UAV–infrared datasets and perform real-time object detection with an inference speed of 40.16 FPS and 28.57 FPS, respectively.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141826667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Control and Application of Tree Obstacle-Clearing Coaxial Octocopter with Flexible Suspension Saw 带柔性悬挂锯的树木障碍物清除同轴八旋翼飞行器的控制与应用
Pub Date : 2024-07-17 DOI: 10.3390/drones8070328
Luwei Liao, Zhong Yang, Haoze Zhuo, Nuo Xu, Wei Wang, Kun Tao, Jiabing Liang, Qiuyan Zhang
Aiming at the challenges of clearing tree obstacles along power transmission lines, the control and application of a novel Tree-Obstacle Clearing Coaxial Octocopter with Flexible Suspension Saw (TOCCO-FSS) have been investigated. Firstly, an overall scheme design and modeling of the TOCCO-FSS were conducted, and dynamic modeling of the TOCCO-FSS was performed using the Lagrange equation. Secondly, to address the interference encountered during the operation, a contact operation model was established to estimate the uncertainties and external disturbances during the contact operation process. Further, the Non-Singular Terminal Sliding-Mode Active Disturbance Rejection Control (NTSM-ADRC) method was researched based on the mathematical model of the TOCCO-FSS. Finally, the performance of the controller was verified through simulations and physical experiments. The results demonstrate that the design, control, and application of the entire TOCCO-FSS system are effective.
针对输电线路沿线树木障碍物的清理难题,研究了新型带柔性悬挂锯的树木障碍物清理同轴八旋翼飞行器(TOCCO-FSS)的控制和应用。首先,对 TOCCO-FSS 进行了总体方案设计和建模,并利用拉格朗日方程对 TOCCO-FSS 进行了动态建模。其次,针对运行过程中遇到的干扰,建立了接触运行模型,以估计接触运行过程中的不确定性和外部干扰。然后,根据 TOCCO-FSS 的数学模型,研究了非星形终端滑动模式主动干扰抑制控制(NTSM-ADRC)方法。最后,通过仿真和物理实验验证了控制器的性能。结果表明,整个 TOCCO-FSS 系统的设计、控制和应用都是有效的。
{"title":"Control and Application of Tree Obstacle-Clearing Coaxial Octocopter with Flexible Suspension Saw","authors":"Luwei Liao, Zhong Yang, Haoze Zhuo, Nuo Xu, Wei Wang, Kun Tao, Jiabing Liang, Qiuyan Zhang","doi":"10.3390/drones8070328","DOIUrl":"https://doi.org/10.3390/drones8070328","url":null,"abstract":"Aiming at the challenges of clearing tree obstacles along power transmission lines, the control and application of a novel Tree-Obstacle Clearing Coaxial Octocopter with Flexible Suspension Saw (TOCCO-FSS) have been investigated. Firstly, an overall scheme design and modeling of the TOCCO-FSS were conducted, and dynamic modeling of the TOCCO-FSS was performed using the Lagrange equation. Secondly, to address the interference encountered during the operation, a contact operation model was established to estimate the uncertainties and external disturbances during the contact operation process. Further, the Non-Singular Terminal Sliding-Mode Active Disturbance Rejection Control (NTSM-ADRC) method was researched based on the mathematical model of the TOCCO-FSS. Finally, the performance of the controller was verified through simulations and physical experiments. The results demonstrate that the design, control, and application of the entire TOCCO-FSS system are effective.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141830405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Real-Time Registration of Unmanned Aerial Vehicle Hyperspectral Remote Sensing Images Using an Acousto-Optic Tunable Filter Spectrometer 使用声光可调谐滤波光谱仪实时注册无人机高光谱遥感图像
Pub Date : 2024-07-17 DOI: 10.3390/drones8070329
Hong Liu, Bingliang Hu, Xingsong Hou, Tao Yu, Zhoufeng Zhang, Xiao Liu, Jiacheng Liu, Xueji Wang
Differences in field of view may occur during unmanned aerial remote sensing imaging applications with acousto-optic tunable filter (AOTF) spectral imagers using zoom lenses. These differences may stem from image size deformation caused by the zoom lens, image drift caused by AOTF wavelength switching, and drone platform jitter. However, they can be addressed using hyperspectral image registration. This article proposes a new coarse-to-fine remote sensing image registration framework based on feature and optical flow theory, comparing its performance with that of existing registration algorithms using the same dataset. The proposed method increases the structure similarity index by 5.2 times, reduces the root mean square error by 3.1 times, and increases the mutual information by 1.9 times. To meet the real-time processing requirements of the AOTF spectrometer in remote sensing, a development environment using VS2023+CUDA+OPENCV was established to improve the demons registration algorithm. The registration algorithm for the central processing unit+graphics processing unit (CPU+GPU) achieved an acceleration ratio of ~30 times compared to that of a CPU alone. Finally, the real-time registration effect of spectral data during flight was verified. The proposed method demonstrates that AOTF hyperspectral imagers can be used in real-time remote sensing applications on unmanned aerial vehicles.
在使用变焦镜头的声光可调谐滤波器(AOTF)光谱成像仪进行无人机遥感成像应用时,可能会出现视场差异。这些差异可能源于变焦镜头造成的图像尺寸变形、声光可调谐滤波器波长切换造成的图像漂移以及无人机平台抖动。不过,这些问题可以通过高光谱图像配准来解决。本文基于特征和光流理论提出了一种新的从粗到细的遥感图像配准框架,并使用相同的数据集比较了其与现有配准算法的性能。所提出的方法使结构相似性指数提高了 5.2 倍,均方根误差降低了 3.1 倍,互信息提高了 1.9 倍。为满足 AOTF 光谱仪在遥感领域的实时处理要求,建立了一个使用 VS2023+CUDA+OPENCV 的开发环境,以改进恶魔配准算法。中央处理器+图形处理单元(CPU+GPU)的配准算法比单独使用 CPU 的配准算法加速了约 30 倍。最后,验证了飞行过程中光谱数据的实时注册效果。所提出的方法证明,AOTF 高光谱成像仪可用于无人飞行器上的实时遥感应用。
{"title":"Real-Time Registration of Unmanned Aerial Vehicle Hyperspectral Remote Sensing Images Using an Acousto-Optic Tunable Filter Spectrometer","authors":"Hong Liu, Bingliang Hu, Xingsong Hou, Tao Yu, Zhoufeng Zhang, Xiao Liu, Jiacheng Liu, Xueji Wang","doi":"10.3390/drones8070329","DOIUrl":"https://doi.org/10.3390/drones8070329","url":null,"abstract":"Differences in field of view may occur during unmanned aerial remote sensing imaging applications with acousto-optic tunable filter (AOTF) spectral imagers using zoom lenses. These differences may stem from image size deformation caused by the zoom lens, image drift caused by AOTF wavelength switching, and drone platform jitter. However, they can be addressed using hyperspectral image registration. This article proposes a new coarse-to-fine remote sensing image registration framework based on feature and optical flow theory, comparing its performance with that of existing registration algorithms using the same dataset. The proposed method increases the structure similarity index by 5.2 times, reduces the root mean square error by 3.1 times, and increases the mutual information by 1.9 times. To meet the real-time processing requirements of the AOTF spectrometer in remote sensing, a development environment using VS2023+CUDA+OPENCV was established to improve the demons registration algorithm. The registration algorithm for the central processing unit+graphics processing unit (CPU+GPU) achieved an acceleration ratio of ~30 times compared to that of a CPU alone. Finally, the real-time registration effect of spectral data during flight was verified. The proposed method demonstrates that AOTF hyperspectral imagers can be used in real-time remote sensing applications on unmanned aerial vehicles.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141828711","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Control of Helicopter Using Virtual Swashplate 利用虚拟斜盘控制直升机
Pub Date : 2024-07-16 DOI: 10.3390/drones8070327
J. Flores, Sergio Salazar, I. González-Hernández, Yukio Rosales, Rogelio Lozano, Eduardo Salazar, Benjamin Nicolas
This article presents a virtual swashplate mechanism for a mini helicopter in classic configuration. The propeller bases are part of a passive mechanism driven by main rotor torque modulaton, this mechanism generates a synchronous and opposite change in the propellers angle of attack, then the thrust vector tilts. This approach proposes to control the 6 degrees of freedom of the aircraft using two rotors. The main rotor controls vertical displacement and uses torque modulation and swing-hinged propellers to generate pitch and roll moments and the horizontal displacement while the yaw moment is controlled by the tail rotor. The dynamic model is obtained using the Newton-Euler approach and robust control algorithms are proposed. Experimental results are presented to show the performance of the proposed virtual swashplate in real-time outdoor hover flights.
本文介绍了一种用于经典配置微型直升机的虚拟斜盘机构。螺旋桨基座是由主旋翼扭矩调制驱动的被动机构的一部分,该机构使螺旋桨攻角产生同步和相反的变化,然后推力矢量倾斜。这种方法建议使用两个旋翼控制飞机的 6 个自由度。主旋翼控制垂直位移,利用扭矩调制和摆动铰链螺旋桨产生俯仰力矩、滚转力矩和水平位移,而偏航力矩则由尾旋翼控制。利用牛顿-欧拉方法获得了动态模型,并提出了鲁棒控制算法。实验结果表明了所提出的虚拟斜盘在实时室外悬停飞行中的性能。
{"title":"Control of Helicopter Using Virtual Swashplate","authors":"J. Flores, Sergio Salazar, I. González-Hernández, Yukio Rosales, Rogelio Lozano, Eduardo Salazar, Benjamin Nicolas","doi":"10.3390/drones8070327","DOIUrl":"https://doi.org/10.3390/drones8070327","url":null,"abstract":"This article presents a virtual swashplate mechanism for a mini helicopter in classic configuration. The propeller bases are part of a passive mechanism driven by main rotor torque modulaton, this mechanism generates a synchronous and opposite change in the propellers angle of attack, then the thrust vector tilts. This approach proposes to control the 6 degrees of freedom of the aircraft using two rotors. The main rotor controls vertical displacement and uses torque modulation and swing-hinged propellers to generate pitch and roll moments and the horizontal displacement while the yaw moment is controlled by the tail rotor. The dynamic model is obtained using the Newton-Euler approach and robust control algorithms are proposed. Experimental results are presented to show the performance of the proposed virtual swashplate in real-time outdoor hover flights.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141643206","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multi-UAVs Tracking Non-Cooperative Target Using Constrained Iterative Linear Quadratic Gaussian 使用受限迭代线性二次高斯跟踪非合作目标的多无人机
Pub Date : 2024-07-15 DOI: 10.3390/drones8070326
Can Zhang, Yidi Wang, Wei Zheng
This study considers the problem of controlling multi-unmanned aerial vehicles (UAVs) to consistently track a non-cooperative ground target with uncertain motion in a hostile environment with obstacles. An active information acquisition (AIA) problem is formulated to minimize the uncertainty of the target tracking task. The uncertain motion of the target is represented as a Wiener process. First, we optimize the configuration of the UAV swarm considering the collision avoidance, horizontal field of view (HFOV), and communication radius to calculate the reference trajectories of the UAVs. Next, a novel algorithm called Constrained Iterative Linear Quadratic Gaussian (CILQG) is introduced to track the reference trajectory. The target’s state with uncertainty and the UAV state are described as beliefs. The CILQG algorithm utilizes the Unscented Transform to propagate the belief regarding the UAVs’ motions, while also accounting for the impact of navigation errors on the target tracking process. The estimation error of the target position of the proposed method is under 4 m, and the error of tracking the reference trajectories is under 3 m. The estimation error remains unchanged even in the presence of obstacles. Therefore, this approach effectively deals with the uncertainties involved and ensures accurate tracking of the target.
本研究考虑的问题是控制多无人驾驶飞行器(UAV)在有障碍物的恶劣环境中持续跟踪运动不确定的非合作地面目标。为了最小化目标跟踪任务的不确定性,提出了一个主动信息获取(AIA)问题。目标的不确定运动被表示为一个维纳过程。首先,我们优化了无人机群的配置,考虑了避免碰撞、水平视场(HFOV)和通信半径,从而计算出无人机的参考轨迹。然后,引入一种名为约束迭代线性二次高斯(CILQG)的新算法来跟踪参考轨迹。具有不确定性的目标状态和无人机状态被描述为信念。CILQG 算法利用未增益变换来传播关于无人机运动的信念,同时还考虑了导航误差对目标跟踪过程的影响。该方法对目标位置的估计误差小于 4 米,对参考轨迹的跟踪误差小于 3 米。因此,这种方法能有效地处理所涉及的不确定性,并确保对目标的精确跟踪。
{"title":"Multi-UAVs Tracking Non-Cooperative Target Using Constrained Iterative Linear Quadratic Gaussian","authors":"Can Zhang, Yidi Wang, Wei Zheng","doi":"10.3390/drones8070326","DOIUrl":"https://doi.org/10.3390/drones8070326","url":null,"abstract":"This study considers the problem of controlling multi-unmanned aerial vehicles (UAVs) to consistently track a non-cooperative ground target with uncertain motion in a hostile environment with obstacles. An active information acquisition (AIA) problem is formulated to minimize the uncertainty of the target tracking task. The uncertain motion of the target is represented as a Wiener process. First, we optimize the configuration of the UAV swarm considering the collision avoidance, horizontal field of view (HFOV), and communication radius to calculate the reference trajectories of the UAVs. Next, a novel algorithm called Constrained Iterative Linear Quadratic Gaussian (CILQG) is introduced to track the reference trajectory. The target’s state with uncertainty and the UAV state are described as beliefs. The CILQG algorithm utilizes the Unscented Transform to propagate the belief regarding the UAVs’ motions, while also accounting for the impact of navigation errors on the target tracking process. The estimation error of the target position of the proposed method is under 4 m, and the error of tracking the reference trajectories is under 3 m. The estimation error remains unchanged even in the presence of obstacles. Therefore, this approach effectively deals with the uncertainties involved and ensures accurate tracking of the target.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141644904","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Message Passing Detectors for UAV-Based Uplink Grant-Free NOMA Systems 基于无人机的无上行链路赠送 NOMA 系统的消息传递检测器
Pub Date : 2024-07-14 DOI: 10.3390/drones8070325
Yi Song, Yiwen Zhu, Kun Chen-Hu, Xinhua Lu, Peng Sun, Zhongyong Wang
Utilizing unmanned aerial vehicles (UAVs) as mobile access points or base stations has emerged as a promising solution to address the excessive traffic demands in wireless networks. This paper investigates improving the detector performance at the unmanned aerial vehicle base stations (UAV-BSs) in an uplink grant-free non-orthogonal multiple access (GF-NOMA) system by considering the activity state (AS) temporal correlation of the different user equipments (UEs) in the time domain. The Bernoulli Gaussian-Markov chain (BG-MC) probability model is used for exploiting both the sparsity and slow change characteristic of the AS of the UE. The GAMP Bernoulli Gaussian-Markov chain (GAMP-BG-MC) algorithm is proposed to improve the detector performance, which can utilize the bidirectional message passing between the neighboring time slots to fully exploit the temporally correlated AS of the UE. Furthermore, the parameters of the BG-MC model can be updated adaptively during the estimation procedure with unknown system statistics. Simulation results show that the proposed algorithm can improve the detection accuracy compared to existing methods while keeping the same order complexity.
利用无人飞行器(UAV)作为移动接入点或基站,已成为解决无线网络中过高流量需求的一种有前途的解决方案。本文通过考虑不同用户设备(UE)在时域中的活动状态(AS)时间相关性,研究如何提高无人机基站(UAV-BS)在上行链路免授权非正交多址(GF-NOMA)系统中的检测器性能。伯努利高斯-马尔可夫链(BG-MC)概率模型用于利用 UE 活动状态的稀疏性和缓慢变化特性。为提高检测器性能,提出了 GAMP 伯努利高斯-马尔可夫链(GAMP-BG-MC)算法,该算法可利用相邻时隙之间的双向信息传递,充分利用 UE 的时间相关 AS。此外,在估计过程中,BG-MC 模型的参数可以在未知系统统计的情况下进行自适应更新。仿真结果表明,与现有方法相比,所提出的算法可以提高检测精度,同时保持相同的阶次复杂度。
{"title":"Message Passing Detectors for UAV-Based Uplink Grant-Free NOMA Systems","authors":"Yi Song, Yiwen Zhu, Kun Chen-Hu, Xinhua Lu, Peng Sun, Zhongyong Wang","doi":"10.3390/drones8070325","DOIUrl":"https://doi.org/10.3390/drones8070325","url":null,"abstract":"Utilizing unmanned aerial vehicles (UAVs) as mobile access points or base stations has emerged as a promising solution to address the excessive traffic demands in wireless networks. This paper investigates improving the detector performance at the unmanned aerial vehicle base stations (UAV-BSs) in an uplink grant-free non-orthogonal multiple access (GF-NOMA) system by considering the activity state (AS) temporal correlation of the different user equipments (UEs) in the time domain. The Bernoulli Gaussian-Markov chain (BG-MC) probability model is used for exploiting both the sparsity and slow change characteristic of the AS of the UE. The GAMP Bernoulli Gaussian-Markov chain (GAMP-BG-MC) algorithm is proposed to improve the detector performance, which can utilize the bidirectional message passing between the neighboring time slots to fully exploit the temporally correlated AS of the UE. Furthermore, the parameters of the BG-MC model can be updated adaptively during the estimation procedure with unknown system statistics. Simulation results show that the proposed algorithm can improve the detection accuracy compared to existing methods while keeping the same order complexity.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141649980","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Event-Triggered Collaborative Fault Diagnosis for UAV–UGV Systems 无人机-无人潜航器系统的事件触发协同故障诊断
Pub Date : 2024-07-13 DOI: 10.3390/drones8070324
Runze Li, Bin Jiang, Yan Zong, N. Lu, Li Guo
The heterogeneous unmanned system, which is composed of unmanned aerial vehicles (UAV) and unmanned ground vehicles (UGV), has been broadly applied in many domains. Collaborative fault diagnosis (CFD) among UAVs and UGVs has become a key technology in these unmanned systems. However, collaborative fault diagnosis in unmanned systems faces the challenges of the dynamic environment and limited communication bandwidth. This paper proposes an event-triggered collaborative fault diagnosis framework for the UAV–UGV system. The framework aims to achieve autonomous fault monitoring and cooperative diagnosis among unmanned systems, thus enhancing system security and reliability. Firstly, we propose a fault trigger mechanism based on broad learning systems (BLS), which utilizes sensor data to accurately detect and identify faults. Then, under the dynamic event triggering mechanism, the network communication topology between the UAV–UGV system and BLS is used to achieve cooperative fault diagnosis. To validate the effectiveness of our proposed scheme, we conduct experiments on a software-in-the-loop (SIL) simulation platform. The experimental results demonstrate that our method achieves high diagnosis accuracy for the UAV–UGV system.
由无人飞行器(UAV)和无人地面车辆(UGV)组成的异构无人系统已广泛应用于许多领域。无人飞行器(UAV)和无人地面飞行器(UGV)之间的协同故障诊断(CFD)已成为这些无人系统的一项关键技术。然而,无人系统中的协同故障诊断面临着动态环境和有限通信带宽的挑战。本文为无人机-无人潜航器系统提出了一种事件触发的协同故障诊断框架。该框架旨在实现无人系统间的自主故障监测和协同诊断,从而提高系统的安全性和可靠性。首先,我们提出了基于广义学习系统(BLS)的故障触发机制,利用传感器数据准确检测和识别故障。然后,在动态事件触发机制下,利用 UAV-UGV 系统与 BLS 之间的网络通信拓扑实现协同故障诊断。为了验证所提方案的有效性,我们在软件在环(SIL)仿真平台上进行了实验。实验结果表明,我们的方法为 UAV-UGV 系统实现了较高的诊断精度。
{"title":"Event-Triggered Collaborative Fault Diagnosis for UAV–UGV Systems","authors":"Runze Li, Bin Jiang, Yan Zong, N. Lu, Li Guo","doi":"10.3390/drones8070324","DOIUrl":"https://doi.org/10.3390/drones8070324","url":null,"abstract":"The heterogeneous unmanned system, which is composed of unmanned aerial vehicles (UAV) and unmanned ground vehicles (UGV), has been broadly applied in many domains. Collaborative fault diagnosis (CFD) among UAVs and UGVs has become a key technology in these unmanned systems. However, collaborative fault diagnosis in unmanned systems faces the challenges of the dynamic environment and limited communication bandwidth. This paper proposes an event-triggered collaborative fault diagnosis framework for the UAV–UGV system. The framework aims to achieve autonomous fault monitoring and cooperative diagnosis among unmanned systems, thus enhancing system security and reliability. Firstly, we propose a fault trigger mechanism based on broad learning systems (BLS), which utilizes sensor data to accurately detect and identify faults. Then, under the dynamic event triggering mechanism, the network communication topology between the UAV–UGV system and BLS is used to achieve cooperative fault diagnosis. To validate the effectiveness of our proposed scheme, we conduct experiments on a software-in-the-loop (SIL) simulation platform. The experimental results demonstrate that our method achieves high diagnosis accuracy for the UAV–UGV system.","PeriodicalId":507567,"journal":{"name":"Drones","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2024-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141651950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Drones
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1