Transferability of a Mask R–CNN model for the delineation and classification of two species of regenerating tree crowns to untrained sites

IF 5.7 Q1 ENVIRONMENTAL SCIENCES Science of Remote Sensing Pub Date : 2023-12-03 DOI:10.1016/j.srs.2023.100109
Andrew J. Chadwick , Nicholas C. Coops , Christopher W. Bater , Lee A. Martens , Barry White
{"title":"Transferability of a Mask R–CNN model for the delineation and classification of two species of regenerating tree crowns to untrained sites","authors":"Andrew J. Chadwick ,&nbsp;Nicholas C. Coops ,&nbsp;Christopher W. Bater ,&nbsp;Lee A. Martens ,&nbsp;Barry White","doi":"10.1016/j.srs.2023.100109","DOIUrl":null,"url":null,"abstract":"<div><p>Following harvest, monitoring reforestation success is a crucial component of sustainable management. In Alberta, Canada, like other jurisdictions, the efficiency of the current plot-based forest regeneration monitoring regime is challenged by the cost of accessibility and the declining availability of qualified field crews. Fine spatial resolution imagery and deep learning have been proposed as alternative monitoring tools and have proven successful under experimental conditions, yet how successfully models can be applied and transferred between a range of untrained sites and conditions remains unclear.</p><p>In this research, we repurposed a mask region-based convolutional neural network (Mask R–CNN) model that was previously trained to delineate coniferous tree crowns to instead segment instances of two species of regenerating conifers. We transferred learned parameters by replacing original single-class labels with photo-interpreted species information and retraining a selection of the network's parameters. We assessed the transferability of the new model by testing on five untrained sites, representing a range of forest types and densities typical of reforestation in the region. Results yielded a mean average precision (mAP) of 72% and average class F1 scores of 69% and 78% for lodgepole pine (<em>Pinus contorta</em>) and white spruce (<em>Picea glauca</em>), respectively, demonstrating successful transferability. We then investigated an additional transfer learning scenario by iteratively adding data from four of the five sites to the training set while reserving data from the remaining site for testing. On average, this improved mAP by 5%, lodgepole pine F1 by 7%, and white spruce F1 by 3%, and demonstrated that trained models can be continuously improved as sufficiently representative data becomes available.</p></div>","PeriodicalId":101147,"journal":{"name":"Science of Remote Sensing","volume":"9 ","pages":"Article 100109"},"PeriodicalIF":5.7000,"publicationDate":"2023-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666017223000342/pdfft?md5=d963dabefedb6b6224d4016cce94dd6a&pid=1-s2.0-S2666017223000342-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Science of Remote Sensing","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666017223000342","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Following harvest, monitoring reforestation success is a crucial component of sustainable management. In Alberta, Canada, like other jurisdictions, the efficiency of the current plot-based forest regeneration monitoring regime is challenged by the cost of accessibility and the declining availability of qualified field crews. Fine spatial resolution imagery and deep learning have been proposed as alternative monitoring tools and have proven successful under experimental conditions, yet how successfully models can be applied and transferred between a range of untrained sites and conditions remains unclear.

In this research, we repurposed a mask region-based convolutional neural network (Mask R–CNN) model that was previously trained to delineate coniferous tree crowns to instead segment instances of two species of regenerating conifers. We transferred learned parameters by replacing original single-class labels with photo-interpreted species information and retraining a selection of the network's parameters. We assessed the transferability of the new model by testing on five untrained sites, representing a range of forest types and densities typical of reforestation in the region. Results yielded a mean average precision (mAP) of 72% and average class F1 scores of 69% and 78% for lodgepole pine (Pinus contorta) and white spruce (Picea glauca), respectively, demonstrating successful transferability. We then investigated an additional transfer learning scenario by iteratively adding data from four of the five sites to the training set while reserving data from the remaining site for testing. On average, this improved mAP by 5%, lodgepole pine F1 by 7%, and white spruce F1 by 3%, and demonstrated that trained models can be continuously improved as sufficiently representative data becomes available.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
用于两种再生树树冠划界和分类的面具 R-CNN 模型在未经训练地点的可移植性
采伐后,监测重新造林的成功与否是可持续管理的重要组成部分。在加拿大艾伯塔省,与其他辖区一样,目前基于地块的森林再生监测制度的效率受到了可访问性成本和合格现场工作人员可用性下降的挑战。精细空间分辨率图像和深度学习已被提出作为替代监测工具,并已在实验条件下证明是成功的,但模型如何在一系列未经训练的地点和条件之间成功应用和转移仍不清楚。在这项研究中,我们重新利用了一个基于掩膜区域的卷积神经网络(Mask R-CNN)模型,该模型以前曾被训练用于划分针叶树冠,现在则用于划分两种再生针叶树的实例。我们用照片解读的物种信息取代了原始的单类标签,并重新训练了网络的部分参数,从而转移了所学参数。我们在五个未经训练的地点进行了测试,评估了新模型的可移植性,这五个地点代表了该地区典型的重新造林的一系列森林类型和密度。结果显示,对落羽松(Pinus contorta)和白云杉(Picea glauca)的平均精确度(mAP)为 72%,平均类 F1 得分分别为 69% 和 78%,证明了成功的可移植性。然后,我们研究了另一种迁移学习方案,即在训练集中反复添加五个地点中四个地点的数据,同时保留其余地点的数据用于测试。平均而言,mAP 提高了 5%,落羽松 F1 提高了 7%,白云杉 F1 提高了 3%,并证明随着有足够代表性的数据可用,经过训练的模型可以不断改进。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
12.20
自引率
0.00%
发文量
0
期刊最新文献
Coastal vertical land motion across Southeast Asia derived from combining tide gauge and satellite altimetry observations Identifying thermokarst lakes using deep learning and high-resolution satellite images A two-stage deep learning architecture for detection global coastal and offshore submesoscale ocean eddy using SDGSAT-1 multispectral imagery A comprehensive evaluation of satellite-based and reanalysis soil moisture products over the upper Blue Nile Basin, Ethiopia A comprehensive review of rice mapping from satellite data: Algorithms, product characteristics and consistency assessment
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1