Andrew J. Chadwick , Nicholas C. Coops , Christopher W. Bater , Lee A. Martens , Barry White
{"title":"用于两种再生树树冠划界和分类的面具 R-CNN 模型在未经训练地点的可移植性","authors":"Andrew J. Chadwick , Nicholas C. Coops , Christopher W. Bater , Lee A. Martens , Barry White","doi":"10.1016/j.srs.2023.100109","DOIUrl":null,"url":null,"abstract":"<div><p>Following harvest, monitoring reforestation success is a crucial component of sustainable management. In Alberta, Canada, like other jurisdictions, the efficiency of the current plot-based forest regeneration monitoring regime is challenged by the cost of accessibility and the declining availability of qualified field crews. Fine spatial resolution imagery and deep learning have been proposed as alternative monitoring tools and have proven successful under experimental conditions, yet how successfully models can be applied and transferred between a range of untrained sites and conditions remains unclear.</p><p>In this research, we repurposed a mask region-based convolutional neural network (Mask R–CNN) model that was previously trained to delineate coniferous tree crowns to instead segment instances of two species of regenerating conifers. We transferred learned parameters by replacing original single-class labels with photo-interpreted species information and retraining a selection of the network's parameters. We assessed the transferability of the new model by testing on five untrained sites, representing a range of forest types and densities typical of reforestation in the region. Results yielded a mean average precision (mAP) of 72% and average class F1 scores of 69% and 78% for lodgepole pine (<em>Pinus contorta</em>) and white spruce (<em>Picea glauca</em>), respectively, demonstrating successful transferability. We then investigated an additional transfer learning scenario by iteratively adding data from four of the five sites to the training set while reserving data from the remaining site for testing. On average, this improved mAP by 5%, lodgepole pine F1 by 7%, and white spruce F1 by 3%, and demonstrated that trained models can be continuously improved as sufficiently representative data becomes available.</p></div>","PeriodicalId":101147,"journal":{"name":"Science of Remote Sensing","volume":"9 ","pages":"Article 100109"},"PeriodicalIF":5.7000,"publicationDate":"2023-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666017223000342/pdfft?md5=d963dabefedb6b6224d4016cce94dd6a&pid=1-s2.0-S2666017223000342-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Transferability of a Mask R–CNN model for the delineation and classification of two species of regenerating tree crowns to untrained sites\",\"authors\":\"Andrew J. Chadwick , Nicholas C. Coops , Christopher W. Bater , Lee A. Martens , Barry White\",\"doi\":\"10.1016/j.srs.2023.100109\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Following harvest, monitoring reforestation success is a crucial component of sustainable management. In Alberta, Canada, like other jurisdictions, the efficiency of the current plot-based forest regeneration monitoring regime is challenged by the cost of accessibility and the declining availability of qualified field crews. Fine spatial resolution imagery and deep learning have been proposed as alternative monitoring tools and have proven successful under experimental conditions, yet how successfully models can be applied and transferred between a range of untrained sites and conditions remains unclear.</p><p>In this research, we repurposed a mask region-based convolutional neural network (Mask R–CNN) model that was previously trained to delineate coniferous tree crowns to instead segment instances of two species of regenerating conifers. We transferred learned parameters by replacing original single-class labels with photo-interpreted species information and retraining a selection of the network's parameters. We assessed the transferability of the new model by testing on five untrained sites, representing a range of forest types and densities typical of reforestation in the region. Results yielded a mean average precision (mAP) of 72% and average class F1 scores of 69% and 78% for lodgepole pine (<em>Pinus contorta</em>) and white spruce (<em>Picea glauca</em>), respectively, demonstrating successful transferability. We then investigated an additional transfer learning scenario by iteratively adding data from four of the five sites to the training set while reserving data from the remaining site for testing. On average, this improved mAP by 5%, lodgepole pine F1 by 7%, and white spruce F1 by 3%, and demonstrated that trained models can be continuously improved as sufficiently representative data becomes available.</p></div>\",\"PeriodicalId\":101147,\"journal\":{\"name\":\"Science of Remote Sensing\",\"volume\":\"9 \",\"pages\":\"Article 100109\"},\"PeriodicalIF\":5.7000,\"publicationDate\":\"2023-12-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2666017223000342/pdfft?md5=d963dabefedb6b6224d4016cce94dd6a&pid=1-s2.0-S2666017223000342-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Science of Remote Sensing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666017223000342\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Science of Remote Sensing","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666017223000342","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0
摘要
采伐后,监测重新造林的成功与否是可持续管理的重要组成部分。在加拿大艾伯塔省,与其他辖区一样,目前基于地块的森林再生监测制度的效率受到了可访问性成本和合格现场工作人员可用性下降的挑战。精细空间分辨率图像和深度学习已被提出作为替代监测工具,并已在实验条件下证明是成功的,但模型如何在一系列未经训练的地点和条件之间成功应用和转移仍不清楚。在这项研究中,我们重新利用了一个基于掩膜区域的卷积神经网络(Mask R-CNN)模型,该模型以前曾被训练用于划分针叶树冠,现在则用于划分两种再生针叶树的实例。我们用照片解读的物种信息取代了原始的单类标签,并重新训练了网络的部分参数,从而转移了所学参数。我们在五个未经训练的地点进行了测试,评估了新模型的可移植性,这五个地点代表了该地区典型的重新造林的一系列森林类型和密度。结果显示,对落羽松(Pinus contorta)和白云杉(Picea glauca)的平均精确度(mAP)为 72%,平均类 F1 得分分别为 69% 和 78%,证明了成功的可移植性。然后,我们研究了另一种迁移学习方案,即在训练集中反复添加五个地点中四个地点的数据,同时保留其余地点的数据用于测试。平均而言,mAP 提高了 5%,落羽松 F1 提高了 7%,白云杉 F1 提高了 3%,并证明随着有足够代表性的数据可用,经过训练的模型可以不断改进。
Transferability of a Mask R–CNN model for the delineation and classification of two species of regenerating tree crowns to untrained sites
Following harvest, monitoring reforestation success is a crucial component of sustainable management. In Alberta, Canada, like other jurisdictions, the efficiency of the current plot-based forest regeneration monitoring regime is challenged by the cost of accessibility and the declining availability of qualified field crews. Fine spatial resolution imagery and deep learning have been proposed as alternative monitoring tools and have proven successful under experimental conditions, yet how successfully models can be applied and transferred between a range of untrained sites and conditions remains unclear.
In this research, we repurposed a mask region-based convolutional neural network (Mask R–CNN) model that was previously trained to delineate coniferous tree crowns to instead segment instances of two species of regenerating conifers. We transferred learned parameters by replacing original single-class labels with photo-interpreted species information and retraining a selection of the network's parameters. We assessed the transferability of the new model by testing on five untrained sites, representing a range of forest types and densities typical of reforestation in the region. Results yielded a mean average precision (mAP) of 72% and average class F1 scores of 69% and 78% for lodgepole pine (Pinus contorta) and white spruce (Picea glauca), respectively, demonstrating successful transferability. We then investigated an additional transfer learning scenario by iteratively adding data from four of the five sites to the training set while reserving data from the remaining site for testing. On average, this improved mAP by 5%, lodgepole pine F1 by 7%, and white spruce F1 by 3%, and demonstrated that trained models can be continuously improved as sufficiently representative data becomes available.