Shijin Yao, Bin Wang, Deli Liu, Xiuliang Jin, Haoming Xia, Qiang Yu
{"title":"利用无人机-多光谱图像和机器学习估算小麦粒重","authors":"Shijin Yao, Bin Wang, Deli Liu, Xiuliang Jin, Haoming Xia, Qiang Yu","doi":"10.36334/modsim.2023.yao674","DOIUrl":null,"url":null,"abstract":": Grain weight (GW) holds significant importance as a crop phenotype parameter, playing a direct role in determining grain yield. As a more stable crop yield parameter (Hamblin et al., 1978), it stands as a pivotal characteristic for crop breeders, agronomists, and farmers alike, serving as a crucial factor for assessing and choosing high-yielding varieties, refining crop management techniques, and projecting crop quality and nutritional composition. Through diligent observation of this parameter, researchers and farmers are empowered to make well-informed choices concerning strategies for enhancing crops, nutrient allocation, irrigation methods, and other elements that impact overall crop productivity. Here we collected red-green-blue (RGB) and multispectral imagery from UAV throughout the entire wheat growth stages in November 2021 – June 2022, covering 300 wheat plots. Diverse crop features were derived from UAV-based imagery, namely vegetable indices (VIs) including NDVI to NDYI, texture indices (GLCM) including contrast to dissimilarity, canopy cover calculated by the ratio of canopy pixels over the total number of pixels within a plot, and canopy height extracted from the digital surface model (DSM) generated from the 3D point cloud model. The crop yield composition parameter of GW was estimated using artificial neural network (ANN) with different types of crop features derived from UAV-imagery. Our machine learning model could estimate GW accurately with R 2 and nRMSE being 0.51 and 14.3%, respectively. We utilized the GW estimation model to predict the GW of various wheat types, including winter wheat, spring wheat, high-gluten wheat, and disease-resistant wheat, across more than 230 test plots. We also examined the stability of GW among repeated plots. Subsequently, we identified and selected wheat varieties with high GW. Furthermore, we analyzed the correlation between the GW of different wheat types and their corresponding yields, highlighting the significance of considering GW as a crucial parameter in the selection of high-yielding varieties. Our study showcased the promising capabilities of utilizing multispectral sensor imagery acquired from UAV-captured data across different spectral bands to forecast the crucial crop phenotype parameter, GW. By harnessing the GW model and integrating GW data with other variables like grain number per unit area and crop-specific characteristics, we envision our model to be a valuable tool in constructing yield prediction models that provide reliable estimates of the final harvest (Bai et al., 2022). Furthermore, the application of our GW model exhibits potential in supporting researchers to identify genetic traits and management practices that influence GW, as well as evaluating the impact of weather conditions on crop productivity. This, in turn, can facilitate the advancement of enhanced crop varieties and cultivation techniques, ultimately benefiting the agricultural industry as a whole.","PeriodicalId":390064,"journal":{"name":"MODSIM2023, 25th International Congress on Modelling and Simulation.","volume":"54 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Estimating wheat grain weight using UAV-multispectral imagery and machine learning\",\"authors\":\"Shijin Yao, Bin Wang, Deli Liu, Xiuliang Jin, Haoming Xia, Qiang Yu\",\"doi\":\"10.36334/modsim.2023.yao674\",\"DOIUrl\":null,\"url\":null,\"abstract\":\": Grain weight (GW) holds significant importance as a crop phenotype parameter, playing a direct role in determining grain yield. As a more stable crop yield parameter (Hamblin et al., 1978), it stands as a pivotal characteristic for crop breeders, agronomists, and farmers alike, serving as a crucial factor for assessing and choosing high-yielding varieties, refining crop management techniques, and projecting crop quality and nutritional composition. Through diligent observation of this parameter, researchers and farmers are empowered to make well-informed choices concerning strategies for enhancing crops, nutrient allocation, irrigation methods, and other elements that impact overall crop productivity. Here we collected red-green-blue (RGB) and multispectral imagery from UAV throughout the entire wheat growth stages in November 2021 – June 2022, covering 300 wheat plots. Diverse crop features were derived from UAV-based imagery, namely vegetable indices (VIs) including NDVI to NDYI, texture indices (GLCM) including contrast to dissimilarity, canopy cover calculated by the ratio of canopy pixels over the total number of pixels within a plot, and canopy height extracted from the digital surface model (DSM) generated from the 3D point cloud model. The crop yield composition parameter of GW was estimated using artificial neural network (ANN) with different types of crop features derived from UAV-imagery. Our machine learning model could estimate GW accurately with R 2 and nRMSE being 0.51 and 14.3%, respectively. We utilized the GW estimation model to predict the GW of various wheat types, including winter wheat, spring wheat, high-gluten wheat, and disease-resistant wheat, across more than 230 test plots. We also examined the stability of GW among repeated plots. Subsequently, we identified and selected wheat varieties with high GW. Furthermore, we analyzed the correlation between the GW of different wheat types and their corresponding yields, highlighting the significance of considering GW as a crucial parameter in the selection of high-yielding varieties. Our study showcased the promising capabilities of utilizing multispectral sensor imagery acquired from UAV-captured data across different spectral bands to forecast the crucial crop phenotype parameter, GW. By harnessing the GW model and integrating GW data with other variables like grain number per unit area and crop-specific characteristics, we envision our model to be a valuable tool in constructing yield prediction models that provide reliable estimates of the final harvest (Bai et al., 2022). Furthermore, the application of our GW model exhibits potential in supporting researchers to identify genetic traits and management practices that influence GW, as well as evaluating the impact of weather conditions on crop productivity. This, in turn, can facilitate the advancement of enhanced crop varieties and cultivation techniques, ultimately benefiting the agricultural industry as a whole.\",\"PeriodicalId\":390064,\"journal\":{\"name\":\"MODSIM2023, 25th International Congress on Modelling and Simulation.\",\"volume\":\"54 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"MODSIM2023, 25th International Congress on Modelling and Simulation.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.36334/modsim.2023.yao674\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"MODSIM2023, 25th International Congress on Modelling and Simulation.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.36334/modsim.2023.yao674","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
籽粒重(GW)作为一种重要的作物表型参数,对籽粒产量起着直接的决定作用。作为一个更稳定的作物产量参数(Hamblin et al., 1978),它是作物育种家、农学家和农民的关键特征,是评估和选择高产品种、改进作物管理技术、预测作物质量和营养成分的关键因素。通过对这一参数的仔细观察,研究人员和农民有权在提高作物产量、养分分配、灌溉方法和其他影响作物整体生产力的因素方面做出明智的选择。在这里,我们收集了2021年11月至2022年6月期间整个小麦生长阶段的无人机红绿蓝(RGB)和多光谱图像,覆盖了300个小麦地块。从基于无人机的图像中获得多种作物特征,即蔬菜指数(VIs)(包括NDVI和NDYI)、纹理指数(GLCM)(包括对比与不相似度)、由地块内冠层像素与总像素之比计算的冠层覆盖度,以及从三维点云模型生成的数字表面模型(DSM)中提取的冠层高度。利用基于无人机影像的不同作物类型特征的人工神经网络估计了GW的作物产量组成参数。我们的机器学习模型可以准确地估计GW, r2和nRMSE分别为0.51和14.3%。在230多个试验小区中,利用该估算模型对冬小麦、春小麦、高筋小麦和抗病小麦等不同小麦品种的小麦产量进行了预测。我们还检查了重复地块中GW的稳定性。随后,我们鉴定和选择了高GW的小麦品种。此外,我们还分析了不同小麦品种的吉瓦数与其产量之间的相关性,强调将吉瓦数作为高产品种选择的关键参数的重要性。我们的研究展示了利用无人机在不同光谱波段捕获数据获得的多光谱传感器图像来预测关键作物表型参数GW的前景。通过利用GW模型并将GW数据与其他变量(如单位面积谷物数和作物特性)相结合,我们设想我们的模型将成为构建产量预测模型的宝贵工具,为最终收获提供可靠的估计(Bai et al., 2022)。此外,我们的全球变暖模型在支持研究人员识别影响全球变暖的遗传性状和管理实践,以及评估天气条件对作物生产力的影响方面显示出潜力。这反过来又可以促进改良作物品种和栽培技术的进步,最终使整个农业产业受益。
Estimating wheat grain weight using UAV-multispectral imagery and machine learning
: Grain weight (GW) holds significant importance as a crop phenotype parameter, playing a direct role in determining grain yield. As a more stable crop yield parameter (Hamblin et al., 1978), it stands as a pivotal characteristic for crop breeders, agronomists, and farmers alike, serving as a crucial factor for assessing and choosing high-yielding varieties, refining crop management techniques, and projecting crop quality and nutritional composition. Through diligent observation of this parameter, researchers and farmers are empowered to make well-informed choices concerning strategies for enhancing crops, nutrient allocation, irrigation methods, and other elements that impact overall crop productivity. Here we collected red-green-blue (RGB) and multispectral imagery from UAV throughout the entire wheat growth stages in November 2021 – June 2022, covering 300 wheat plots. Diverse crop features were derived from UAV-based imagery, namely vegetable indices (VIs) including NDVI to NDYI, texture indices (GLCM) including contrast to dissimilarity, canopy cover calculated by the ratio of canopy pixels over the total number of pixels within a plot, and canopy height extracted from the digital surface model (DSM) generated from the 3D point cloud model. The crop yield composition parameter of GW was estimated using artificial neural network (ANN) with different types of crop features derived from UAV-imagery. Our machine learning model could estimate GW accurately with R 2 and nRMSE being 0.51 and 14.3%, respectively. We utilized the GW estimation model to predict the GW of various wheat types, including winter wheat, spring wheat, high-gluten wheat, and disease-resistant wheat, across more than 230 test plots. We also examined the stability of GW among repeated plots. Subsequently, we identified and selected wheat varieties with high GW. Furthermore, we analyzed the correlation between the GW of different wheat types and their corresponding yields, highlighting the significance of considering GW as a crucial parameter in the selection of high-yielding varieties. Our study showcased the promising capabilities of utilizing multispectral sensor imagery acquired from UAV-captured data across different spectral bands to forecast the crucial crop phenotype parameter, GW. By harnessing the GW model and integrating GW data with other variables like grain number per unit area and crop-specific characteristics, we envision our model to be a valuable tool in constructing yield prediction models that provide reliable estimates of the final harvest (Bai et al., 2022). Furthermore, the application of our GW model exhibits potential in supporting researchers to identify genetic traits and management practices that influence GW, as well as evaluating the impact of weather conditions on crop productivity. This, in turn, can facilitate the advancement of enhanced crop varieties and cultivation techniques, ultimately benefiting the agricultural industry as a whole.