Narmilan Amarasingam , Kevin Powell , Juan Sandino , Dmitry Bratanov , Arachchige Surantha Ashan Salgadoe , Felipe Gonzalez
{"title":"Mapping of insect pest infestation for precision agriculture: A UAV-based multispectral imaging and deep learning techniques","authors":"Narmilan Amarasingam , Kevin Powell , Juan Sandino , Dmitry Bratanov , Arachchige Surantha Ashan Salgadoe , Felipe Gonzalez","doi":"10.1016/j.jag.2025.104413","DOIUrl":null,"url":null,"abstract":"<div><div>In recent years, the precise identification of an insect pest infestation has become increasingly critical for effective management in agricultural fields. This research addresses the imperative need for an advanced and integrated approach to mapping insect pest infestation in agricultural crops, utilising unmanned aerial vehicles (UAVs), multispectral (MS) imagery, and deep learning (DL). The existing literature reveals a limited number of studies that harness the potential of UAV-based MS imagery in conjunction with DL models for mapping and managing insect pest infestations. The primary aim is to enhance the precision and efficiency of insect pest infestation mapping through the synergistic analysis of spectral bands, vegetation indices (VIs), and textural features using DL techniques. The aerial imagery and ground truth information were collected in crop field for mapping of insect pest infestation. The investigation comprised three specific analyses; first is about establishing correlations between insect pest pupal count versus spectral bands and VIs. Second, the performance comparison of three DL models including U-Net, DeepLabV3+, Fully Convolutional Network (FCN) to segment three classes including insect pest infestation patches, other vegetation (weeds), and crops. Finally, the third analysis evaluated the efficacy of textural features against spectral features in mapping an insect pest infestation using DL techniques. The results indicate that, concerning the correlation between pupal count in the field and spectral bands or VIs, the Simple Ratio Index (SRI), and Red Edge Chlorophyll Index (RECI) demonstrated a positive correlation of 0.7, whereas the Green Chlorophyll Index (GCI) displayed a positive correlation of 0.6. Another key finding shows that spectral features outperformed textural features across all DL models for insect pest infestation segmentation. The research highlights the effectiveness of spectral features, particularly with the FCN model, which demonstrated best performance metrics for insect pest segmentation in the study field. The FCN model achieved scores with a precision (P) of 93%, recall (R) of 97%, F1-score (F1) of 95%, and Intersection over Union (IoU) of 90%, underscoring its excellence in accurately identifying and delineating pest infestations in the field. The proposed methodology and its findings offer implications such as enhanced pest surveillance, timely intervention, precision pest management, and optimised resource allocation that can be extended to optimise insect pest infestation mapping in various crop lands, enabling precise control strategies aimed at enhancing crop yield.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"137 ","pages":"Article 104413"},"PeriodicalIF":8.6000,"publicationDate":"2025-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843225000603","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/17 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
引用次数: 0
Abstract
In recent years, the precise identification of an insect pest infestation has become increasingly critical for effective management in agricultural fields. This research addresses the imperative need for an advanced and integrated approach to mapping insect pest infestation in agricultural crops, utilising unmanned aerial vehicles (UAVs), multispectral (MS) imagery, and deep learning (DL). The existing literature reveals a limited number of studies that harness the potential of UAV-based MS imagery in conjunction with DL models for mapping and managing insect pest infestations. The primary aim is to enhance the precision and efficiency of insect pest infestation mapping through the synergistic analysis of spectral bands, vegetation indices (VIs), and textural features using DL techniques. The aerial imagery and ground truth information were collected in crop field for mapping of insect pest infestation. The investigation comprised three specific analyses; first is about establishing correlations between insect pest pupal count versus spectral bands and VIs. Second, the performance comparison of three DL models including U-Net, DeepLabV3+, Fully Convolutional Network (FCN) to segment three classes including insect pest infestation patches, other vegetation (weeds), and crops. Finally, the third analysis evaluated the efficacy of textural features against spectral features in mapping an insect pest infestation using DL techniques. The results indicate that, concerning the correlation between pupal count in the field and spectral bands or VIs, the Simple Ratio Index (SRI), and Red Edge Chlorophyll Index (RECI) demonstrated a positive correlation of 0.7, whereas the Green Chlorophyll Index (GCI) displayed a positive correlation of 0.6. Another key finding shows that spectral features outperformed textural features across all DL models for insect pest infestation segmentation. The research highlights the effectiveness of spectral features, particularly with the FCN model, which demonstrated best performance metrics for insect pest segmentation in the study field. The FCN model achieved scores with a precision (P) of 93%, recall (R) of 97%, F1-score (F1) of 95%, and Intersection over Union (IoU) of 90%, underscoring its excellence in accurately identifying and delineating pest infestations in the field. The proposed methodology and its findings offer implications such as enhanced pest surveillance, timely intervention, precision pest management, and optimised resource allocation that can be extended to optimise insect pest infestation mapping in various crop lands, enabling precise control strategies aimed at enhancing crop yield.
近年来,害虫的准确识别对于农业领域的有效管理变得越来越重要。本研究解决了利用无人机(uav)、多光谱(MS)图像和深度学习(DL)来绘制农作物害虫侵染的先进综合方法的迫切需求。现有文献显示,利用基于无人机的MS图像与DL模型相结合的潜力来绘制和管理害虫侵扰的研究数量有限。主要目的是通过对光谱波段、植被指数(VIs)和纹理特征的协同分析,提高害虫侵害制图的精度和效率。利用航拍影像和地物信息对农田进行虫害制图。调查包括三个具体分析;首先,建立了害虫幼虫数与光谱波段和VIs之间的相关性。其次,比较了U-Net、DeepLabV3+、Fully Convolutional Network (FCN)三种深度学习模型在害虫侵染斑块、其他植被(杂草)和作物三大类分类中的性能。最后,第三个分析评估了纹理特征与光谱特征在利用DL技术绘制虫害分布图中的有效性。结果表明,田间蛹数与光谱波段或可见光的相关关系中,简单比值指数(SRI)与红边叶绿素指数(RECI)的正相关为0.7,绿边叶绿素指数(GCI)的正相关为0.6。另一个关键发现表明,光谱特征在所有深度学习模型中都优于纹理特征,用于虫害分割。该研究强调了光谱特征的有效性,特别是FCN模型,该模型在研究领域中展示了最佳的害虫分割性能指标。FCN模型的准确率(P)为93%,召回率(R)为97%,F1-score (F1)为95%,Intersection over Union (IoU)为90%,表明该模型在准确识别和描绘田间害虫侵害方面表现优异。提出的方法及其研究结果提供了诸如加强有害生物监测、及时干预、精确有害生物管理和优化资源分配等意义,这些意义可以扩展到优化各种作物土地上的害虫侵害测绘,从而实现旨在提高作物产量的精确控制策略。
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.