Combining OBIA, CNN, and UAV imagery for automated detection and mapping of individual olive trees

IF 6.3 Q1 AGRICULTURAL ENGINEERING Smart agricultural technology Pub Date : 2024-08-24 DOI:10.1016/j.atech.2024.100546
{"title":"Combining OBIA, CNN, and UAV imagery for automated detection and mapping of individual olive trees","authors":"","doi":"10.1016/j.atech.2024.100546","DOIUrl":null,"url":null,"abstract":"<div><p>The identification of individual trees is an important research topic in forestry, remote sensing and computer vision. It represents a tool for effectively and efficiently managing and maintaining forests and orchards. However, this task is not as simple as it seems; tree detection and counting can be time consuming, cost-prohibitive and accuracy-limited, especially if performed manually on a large scale.The availability of very high-resolution UAV imagery with remote sensing can make the counting process easier, faster and more precise. With the development of technology, this process can be made more automated by using intelligent algorithms such as CNN.</p><p>This work presents an OBIA-CNN (Object Based Image Analysis-Convolution Neural Network) approach that combines CNNs with OBIA to automatically detect and count olive trees from Phantom4 advanced drone imagery. Initially, The CNN-based classifier was created, trained, validated, and applied to generate the Olive trees probability maps on the ortho-photo. The post-classification refinement based on OBIA was then conducted. A super-pixel segmentation and the Excess Green index were performed and a detailed accuracy analysis has been carried out to establish the suitability of the proposed method.</p><p>The application to a RGB ortho-mosaic of an olive grove, in the east region of Morocco was successful using a manually elaborated training dataset of 4500 images of 24×24 pixels. Finally, the CNN detected and counted 2934 olive trees on the ortho-photo, achieving an overall accuracy of 97 % and 99 % after the OBIA refinement. The results of the proposed OBIA-CNN method were also compared with the classification results of using the Template matching technique, CNN method alone, and OBIA analysis alone to evaluate the performance of the approach. Our findings suggest the use of very high resolution images with object-based deep learning is promising for automatic detection and counting of olive trees to support the accurate and sustainable agricultural monitoring.</p></div>","PeriodicalId":74813,"journal":{"name":"Smart agricultural technology","volume":null,"pages":null},"PeriodicalIF":6.3000,"publicationDate":"2024-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772375524001515/pdfft?md5=2aaac2e04ec6af0d19b6c72cbbca5b6d&pid=1-s2.0-S2772375524001515-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Smart agricultural technology","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2772375524001515","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AGRICULTURAL ENGINEERING","Score":null,"Total":0}
引用次数: 0

Abstract

The identification of individual trees is an important research topic in forestry, remote sensing and computer vision. It represents a tool for effectively and efficiently managing and maintaining forests and orchards. However, this task is not as simple as it seems; tree detection and counting can be time consuming, cost-prohibitive and accuracy-limited, especially if performed manually on a large scale.The availability of very high-resolution UAV imagery with remote sensing can make the counting process easier, faster and more precise. With the development of technology, this process can be made more automated by using intelligent algorithms such as CNN.

This work presents an OBIA-CNN (Object Based Image Analysis-Convolution Neural Network) approach that combines CNNs with OBIA to automatically detect and count olive trees from Phantom4 advanced drone imagery. Initially, The CNN-based classifier was created, trained, validated, and applied to generate the Olive trees probability maps on the ortho-photo. The post-classification refinement based on OBIA was then conducted. A super-pixel segmentation and the Excess Green index were performed and a detailed accuracy analysis has been carried out to establish the suitability of the proposed method.

The application to a RGB ortho-mosaic of an olive grove, in the east region of Morocco was successful using a manually elaborated training dataset of 4500 images of 24×24 pixels. Finally, the CNN detected and counted 2934 olive trees on the ortho-photo, achieving an overall accuracy of 97 % and 99 % after the OBIA refinement. The results of the proposed OBIA-CNN method were also compared with the classification results of using the Template matching technique, CNN method alone, and OBIA analysis alone to evaluate the performance of the approach. Our findings suggest the use of very high resolution images with object-based deep learning is promising for automatic detection and counting of olive trees to support the accurate and sustainable agricultural monitoring.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
结合 OBIA、CNN 和无人机图像,自动检测和绘制橄榄树个体地图
单棵树木的识别是林业、遥感和计算机视觉领域的一个重要研究课题。它是切实有效地管理和维护森林和果园的工具。然而,这项任务并不像看起来那么简单;树木检测和计数可能会耗费大量时间、成本高昂且精度有限,尤其是在大规模人工操作的情况下。随着技术的发展,通过使用 CNN 等智能算法,可以使这一过程更加自动化。本作品介绍了一种 OBIA-CNN(基于对象的图像分析-卷积神经网络)方法,该方法将 CNN 与 OBIA 相结合,从 Phantom4 高级无人机图像中自动检测和计数橄榄树。首先,创建、训练、验证并应用基于 CNN 的分类器,以生成正射影像上的橄榄树概率图。然后,基于 OBIA 进行分类后细化。对摩洛哥东部地区橄榄树林的 RGB 正射影像拼接图进行了应用,并成功地使用了由 4500 幅 24×24 像素图像组成的人工精心制作的训练数据集。最后,CNN 在正射影像上检测并计算出 2934 棵橄榄树,总体准确率达到 97%,经过 OBIA 改进后达到 99%。我们还将所提出的 OBIA-CNN 方法的结果与使用模板匹配技术、单独使用 CNN 方法和单独使用 OBIA 分析的分类结果进行了比较,以评估该方法的性能。我们的研究结果表明,利用高分辨率图像和基于对象的深度学习技术自动检测和计算橄榄树数量,为准确和可持续的农业监测提供支持是大有可为的。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
4.20
自引率
0.00%
发文量
0
期刊最新文献
Development of a low-cost smart irrigation system for sustainable water management in the Mediterranean region Cover crop impacts on soil organic matter dynamics and its quantification using UAV and proximal sensing Design and development of machine vision robotic arm for vegetable crops in hydroponics Cybersecurity threats and mitigation measures in agriculture 4.0 and 5.0 Farmer's attitudes towards GHG emissions and adoption to low-cost sensor-driven smart farming for mitigation: The case of Ireland tillage and horticultural farmers
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1