首页 > 最新文献

Plant Phenomics最新文献

英文 中文
From Images to Loci: Applying 3D Deep Learning to Enable Multivariate and Multitemporal Digital Phenotyping and Mapping the Genetics Underlying Nitrogen Use Efficiency in Wheat. 从图像到基因座:应用3D深度学习实现小麦氮素利用效率的多变量和多时间数字表型和遗传图谱
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-12-19 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0270
Jiawei Chen, Qing Li, Dong Jiang

The selection and promotion of high-yielding and nitrogen-efficient wheat varieties can reduce nitrogen fertilizer application while ensuring wheat yield and quality and contribute to the sustainable development of agriculture; thus, the mining and localization of nitrogen use efficiency (NUE) genes is particularly important, but the localization of NUE genes requires a large amount of phenotypic data support. In view of this, we propose the use of low-altitude aerial photography to acquire field images at a large scale, generate 3-dimensional (3D) point clouds and multispectral images of wheat plots, propose a wheat 3D plot segmentation dataset, quantify the plot canopy height via combination with PointNet++, and generate 4 nitrogen utilization-related vegetation indices via index calculations. Six height-related and 24 vegetation-index-related dynamic digital phenotypes were extracted from the digital phenotypes collected at different time points and fitted to generate dynamic curves. We applied height-derived dynamic numerical phenotypes to genome-wide association studies of 160 wheat cultivars (660,000 single-nucleotide polymorphisms) and found that we were able to locate reliable loci associated with height and NUE, some of which were consistent with published studies. Finally, dynamic phenotypes derived from plant indices can also be applied to genome-wide association studies and ultimately locate NUE- and growth-related loci. In conclusion, we believe that our work demonstrates valuable advances in 3D digital dynamic phenotyping for locating genes for NUE in wheat and provides breeders with accurate phenotypic data for the selection and breeding of nitrogen-efficient wheat varieties.

选择和推广高产高效氮肥小麦品种,在保证小麦产量和品质的同时减少氮肥施用量,有利于农业的可持续发展;因此,氮利用效率(NUE)基因的挖掘和定位尤为重要,但NUE基因的定位需要大量表型数据的支持。鉴于此,本文提出利用低空航空摄影获取大尺度野外影像,生成小麦地块三维点云和多光谱影像,构建小麦地块三维分割数据集,结合PointNet++对地块冠层高度进行量化,并通过指数计算生成4个氮利用相关植被指数。从不同时间点采集的数字表型中提取6种与高度相关的动态数字表型和24种与植被指数相关的动态数字表型,并进行拟合生成动态曲线。我们将身高衍生的动态数值表型应用于160个小麦品种(66万个单核苷酸多态性)的全基因组关联研究,发现我们能够定位与身高和NUE相关的可靠位点,其中一些位点与已发表的研究一致。最后,来自植物指数的动态表型也可以应用于全基因组关联研究,最终定位NUE和生长相关位点。综上所述,我们相信我们的工作证明了小麦氮素利用基因定位的3D数字动态表型研究取得了有价值的进展,并为育种者选择和培育氮素高效小麦品种提供了准确的表型数据。
{"title":"From Images to Loci: Applying 3D Deep Learning to Enable Multivariate and Multitemporal Digital Phenotyping and Mapping the Genetics Underlying Nitrogen Use Efficiency in Wheat.","authors":"Jiawei Chen, Qing Li, Dong Jiang","doi":"10.34133/plantphenomics.0270","DOIUrl":"10.34133/plantphenomics.0270","url":null,"abstract":"<p><p>The selection and promotion of high-yielding and nitrogen-efficient wheat varieties can reduce nitrogen fertilizer application while ensuring wheat yield and quality and contribute to the sustainable development of agriculture; thus, the mining and localization of nitrogen use efficiency (NUE) genes is particularly important, but the localization of NUE genes requires a large amount of phenotypic data support. In view of this, we propose the use of low-altitude aerial photography to acquire field images at a large scale, generate 3-dimensional (3D) point clouds and multispectral images of wheat plots, propose a wheat 3D plot segmentation dataset, quantify the plot canopy height via combination with PointNet++, and generate 4 nitrogen utilization-related vegetation indices via index calculations. Six height-related and 24 vegetation-index-related dynamic digital phenotypes were extracted from the digital phenotypes collected at different time points and fitted to generate dynamic curves. We applied height-derived dynamic numerical phenotypes to genome-wide association studies of 160 wheat cultivars (660,000 single-nucleotide polymorphisms) and found that we were able to locate reliable loci associated with height and NUE, some of which were consistent with published studies. Finally, dynamic phenotypes derived from plant indices can also be applied to genome-wide association studies and ultimately locate NUE- and growth-related loci. In conclusion, we believe that our work demonstrates valuable advances in 3D digital dynamic phenotyping for locating genes for NUE in wheat and provides breeders with accurate phenotypic data for the selection and breeding of nitrogen-efficient wheat varieties.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0270"},"PeriodicalIF":7.6,"publicationDate":"2024-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11658601/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142865352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Informed-Learning-Guided Visual Question Answering Model of Crop Disease. 作物病害的知情学习引导视觉问答模型。
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-12-16 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0277
Yunpeng Zhao, Shansong Wang, Qingtian Zeng, Weijian Ni, Hua Duan, Nengfu Xie, Fengjin Xiao

In contemporary agriculture, experts develop preventative and remedial strategies for various disease stages in diverse crops. Decision-making regarding the stages of disease occurrence exceeds the capabilities of single-image tasks, such as image classification and object detection. Consequently, research now focuses on training visual question answering (VQA) models. However, existing studies concentrate on identifying disease species rather than formulating questions that encompass crucial multiattributes. Additionally, model performance is susceptible to the model structure and dataset biases. To address these challenges, we construct the informed-learning-guided VQA model of crop disease (ILCD). ILCD improves model performance by integrating coattention, a multimodal fusion model (MUTAN), and a bias-balancing (BiBa) strategy. To facilitate the investigation of various visual attributes of crop diseases and the determination of disease occurrence stages, we construct a new VQA dataset called the Crop Disease Multi-attribute VQA with Prior Knowledge (CDwPK-VQA). This dataset contains comprehensive information on various visual attributes such as shape, size, status, and color. We expand the dataset by integrating prior knowledge into CDwPK-VQA to address performance challenges. Comparative experiments are conducted by ILCD on the VQA-v2, VQA-CP v2, and CDwPK-VQA datasets, achieving accuracies of 68.90%, 49.75%, and 86.06%, respectively. Ablation experiments are conducted on CDwPK-VQA to evaluate the effectiveness of various modules, including coattention, MUTAN, and BiBa. These experiments demonstrate that ILCD exhibits the highest level of accuracy, performance, and value in the field of agriculture. The source codes can be accessed at https://github.com/SdustZYP/ILCD-master/tree/main.

在当代农业中,专家们针对不同作物的不同病害阶段制定预防和补救策略。有关疾病发生阶段的决策超出了图像分类和物体检测等单一图像任务的能力。因此,目前的研究重点是训练视觉问题解答(VQA)模型。然而,现有的研究集中于识别疾病种类,而不是提出包含关键多属性的问题。此外,模型的性能易受模型结构和数据集偏差的影响。为了应对这些挑战,我们构建了作物病害的知情学习指导 VQA 模型(ILCD)。ILCD 通过整合共注意力、多模态融合模型(MUTAN)和偏差平衡(BiBa)策略来提高模型性能。为便于研究农作物病害的各种视觉属性并确定病害发生阶段,我们构建了一个新的 VQA 数据集,名为 "具有先验知识的农作物病害多属性 VQA(CDwPK-VQA)"。该数据集包含各种视觉属性的综合信息,如形状、大小、状态和颜色。我们通过将先验知识整合到 CDwPK-VQA 中来扩展该数据集,以应对性能挑战。ILCD 在 VQA-v2、VQA-CP v2 和 CDwPK-VQA 数据集上进行了对比实验,准确率分别达到 68.90%、49.75% 和 86.06%。在 CDwPK-VQA 上进行了消融实验,以评估包括 coattention、MUTAN 和 BiBa 在内的各种模块的有效性。这些实验证明,ILCD 在农业领域表现出最高水平的准确性、性能和价值。源代码可通过 https://github.com/SdustZYP/ILCD-master/tree/main 访问。
{"title":"Informed-Learning-Guided Visual Question Answering Model of Crop Disease.","authors":"Yunpeng Zhao, Shansong Wang, Qingtian Zeng, Weijian Ni, Hua Duan, Nengfu Xie, Fengjin Xiao","doi":"10.34133/plantphenomics.0277","DOIUrl":"10.34133/plantphenomics.0277","url":null,"abstract":"<p><p>In contemporary agriculture, experts develop preventative and remedial strategies for various disease stages in diverse crops. Decision-making regarding the stages of disease occurrence exceeds the capabilities of single-image tasks, such as image classification and object detection. Consequently, research now focuses on training visual question answering (VQA) models. However, existing studies concentrate on identifying disease species rather than formulating questions that encompass crucial multiattributes. Additionally, model performance is susceptible to the model structure and dataset biases. To address these challenges, we construct the informed-learning-guided VQA model of crop disease (ILCD). ILCD improves model performance by integrating coattention, a multimodal fusion model (MUTAN), and a bias-balancing (BiBa) strategy. To facilitate the investigation of various visual attributes of crop diseases and the determination of disease occurrence stages, we construct a new VQA dataset called the Crop Disease Multi-attribute VQA with Prior Knowledge (CDwPK-VQA). This dataset contains comprehensive information on various visual attributes such as shape, size, status, and color. We expand the dataset by integrating prior knowledge into CDwPK-VQA to address performance challenges. Comparative experiments are conducted by ILCD on the VQA-v2, VQA-CP v2, and CDwPK-VQA datasets, achieving accuracies of 68.90%, 49.75%, and 86.06%, respectively. Ablation experiments are conducted on CDwPK-VQA to evaluate the effectiveness of various modules, including coattention, MUTAN, and BiBa. These experiments demonstrate that ILCD exhibits the highest level of accuracy, performance, and value in the field of agriculture. The source codes can be accessed at https://github.com/SdustZYP/ILCD-master/tree/main.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0277"},"PeriodicalIF":7.6,"publicationDate":"2024-12-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11649200/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142838643","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Coupling PROSPECT with Prior Estimation of Leaf Structure to Improve the Retrieval of Leaf Nitrogen Content in Ginkgo from Bidirectional Reflectance Factor Spectra. 将 PROSPECT 与叶片结构的事先估计相结合,改进从双向反射因子光谱中检索银杏叶氮含量的工作。
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-12-13 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0282
Kai Zhou, Saiting Qiu, Fuliang Cao, Guibin Wang, Lin Cao

Leaf nitrogen content (LNC) is a crucial indicator for assessing the nitrogen status of forest trees. The LNC retrieval can be achieved with the inversion of the PROSPECT-PRO model. However, the LNC retrieval from the commonly used leaf bidirectional reflectance factor (BRF) spectra remains challenging arising from the confounding effects of mesophyll structure, specular reflection, and other chemicals such as water. To address this issue, this study proposed an advanced BRF spectra-based approach, by alleviating the specular reflection effects and enhancing the leaf nitrogen absorption signals from Ginkgo trees and saplings, using 3 modified ratio indices (i.e., mPrior_800, mPrior_1131, and mPrior_1365) for the prior estimation of the Nstruct structure parameter, combined with different inversion methods (STANDARD, sPROCOSINE, PROSDM, and PROCWT). The results demonstrated that the prior Nstruct estimation strategy using modified ratio indices outperformed standard ratio indices or nonperforming prior Nstruct estimation, especially for mPrior_1131 and mPrior_1365 yielding reliable performance for most constituents. With the use of the optimal approaches (i.e., PROCWT_S3 combined with mPrior_1131 or mPrior_1365), our results also revealed that the optimal estimation of LNCarea (normalized root mean square error [NRMSE] = 12.94% to 14.49%) and LNCmass (NRMSE = 10.11% to 10.75%) can be further achieved, with the selected optimal wavebands concentrated in 5 common main domains of 1440 to 1539 nm, 1580 to 1639 nm, 1900 to 1999 nm, 2020 to 2099 nm, and 2120 to 2179 nm. These findings highlight marked potentials of the novel BRF spectra-based approach to improve the estimation of LNC and enhance the understanding of the impact of Nstruct prior estimation on the LNC retrieval in leaves of Ginkgo trees and saplings.

叶片氮含量(LNC)是评估林木氮状况的重要指标。通过 PROSPECT-PRO 模型的反演可以实现 LNC 检索。然而,从常用的叶片双向反射系数(BRF)光谱中检索 LNC 仍然具有挑战性,因为叶肉结构、镜面反射和其他化学物质(如水)会产生混杂效应。为解决这一问题,本研究提出了一种先进的基于 BRF 光谱的方法,通过使用 3 个修正比值指数(即 mPrior_800、mPrior_1131 和 mPrior_1365)对 Nstruct 结构参数进行先验估计,并结合不同的反演方法(STANDARD、sPROCOSINE、PROSDM 和 PROCWT),减轻镜面反射效应并增强银杏树和树苗的叶片氮吸收信号。结果表明,使用修正比率指数的先验 Nstruct 估计策略优于标准比率指数或非性能先验 Nstruct 估计,尤其是 mPrior_1131 和 mPrior_1365,对大多数成分具有可靠的性能。使用最优方法(即PROCWT_S3 结合 mPrior_1131 或 mPrior_1365),我们的结果还显示,LNCarea(归一化均方根误差 [NRMSE] = 12.94% 至 14.49%)和 LNCmass(NRMSE = 10.11% 至 10.75%),所选的最佳波段集中在 1440 至 1539 nm、1580 至 1639 nm、1900 至 1999 nm、2020 至 2099 nm 和 2120 至 2179 nm 这 5 个常见主域。这些发现凸显了基于 BRF 光谱的新方法在改进 LNC 估算方面的显著潜力,并加深了人们对 Nstruct 先验估算对银杏树叶和树苗 LNC 检索影响的理解。
{"title":"Coupling PROSPECT with Prior Estimation of Leaf Structure to Improve the Retrieval of Leaf Nitrogen Content in <i>Ginkgo</i> from Bidirectional Reflectance Factor Spectra.","authors":"Kai Zhou, Saiting Qiu, Fuliang Cao, Guibin Wang, Lin Cao","doi":"10.34133/plantphenomics.0282","DOIUrl":"10.34133/plantphenomics.0282","url":null,"abstract":"<p><p>Leaf nitrogen content (LNC) is a crucial indicator for assessing the nitrogen status of forest trees. The LNC retrieval can be achieved with the inversion of the PROSPECT-PRO model. However, the LNC retrieval from the commonly used leaf bidirectional reflectance factor (BRF) spectra remains challenging arising from the confounding effects of mesophyll structure, specular reflection, and other chemicals such as water. To address this issue, this study proposed an advanced BRF spectra-based approach, by alleviating the specular reflection effects and enhancing the leaf nitrogen absorption signals from <i>Ginkgo</i> trees and saplings, using 3 modified ratio indices (i.e., mPrior_800, mPrior_1131, and mPrior_1365) for the prior estimation of the N<sub>struct</sub> structure parameter, combined with different inversion methods (STANDARD, sPROCOSINE, PROSDM, and PROCWT). The results demonstrated that the prior N<sub>struct</sub> estimation strategy using modified ratio indices outperformed standard ratio indices or nonperforming prior N<sub>struct</sub> estimation, especially for mPrior_1131 and mPrior_1365 yielding reliable performance for most constituents. With the use of the optimal approaches (i.e., PROCWT_S3 combined with mPrior_1131 or mPrior_1365), our results also revealed that the optimal estimation of LNC<sub>area</sub> (normalized root mean square error [NRMSE] = 12.94% to 14.49%) and LNC<sub>mass</sub> (NRMSE = 10.11% to 10.75%) can be further achieved, with the selected optimal wavebands concentrated in 5 common main domains of 1440 to 1539 nm, 1580 to 1639 nm, 1900 to 1999 nm, 2020 to 2099 nm, and 2120 to 2179 nm. These findings highlight marked potentials of the novel BRF spectra-based approach to improve the estimation of LNC and enhance the understanding of the impact of N<sub>struct</sub> prior estimation on the LNC retrieval in leaves of <i>Ginkgo</i> trees and saplings.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0282"},"PeriodicalIF":7.6,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11641793/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142829579","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Field-to-Parameter Pipeline for Analyzing and Simulating Root System Architecture of Woody Perennials: Application to Grapevine Rootstocks. 木本多年生植物根系结构分析与模拟的田间-参数管道:在葡萄砧木上的应用。
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-12-11 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0280
Lukas Fichtl, Daniel Leitner, Andrea Schnepf, Dominik Schmidt, Katrin Kahlen, Matthias Friedel

Understanding root system architecture (RSA) is essential for improving crop resilience to climate change, yet assessing root systems of woody perennials under field conditions remains a challenge. This study introduces a pipeline that combines field excavation, in situ 3-dimensional digitization, and transformation of RSA data into an interoperable format to analyze and model the growth and water uptake of grapevine rootstock genotypes. Eight root systems of each of 3 grapevine rootstock genotypes ("101-14", "SO4", and "Richter 110") were excavated and digitized 3 and 6 months after planting. We validated the precision of the digitization method, compared in situ and ex situ digitization, and assessed root loss during excavation. The digitized RSA data were converted to root system markup language (RSML) format and imported into the CPlantBox modeling framework, which we adapted to include a static initial root system and a probabilistic tropism function. We then parameterized it to simulate genotype-specific growth patterns of grapevine rootstocks and integrated root hydraulic properties to derive a standard uptake fraction (SUF) for each genotype. Results demonstrated that excavation and in situ digitization accurately reflected the spatial structure of root systems, despite some underestimation of fine root length. Our experiment revealed significant genotypic variations in RSA over time and provided new insights into genotype-specific water acquisition capabilities. Simulated RSA closely resembled the specific features of the field-grown and digitized root systems. This study provides a foundational methodology for future research aimed at utilizing RSA models to improve the sustainability and productivity of woody perennials under changing climatic conditions.

了解根系结构(RSA)对于提高作物对气候变化的适应能力至关重要,但在田间条件下评估多年生木本植物的根系仍然是一个挑战。本研究介绍了一种结合田间挖掘、现场三维数字化和RSA数据转换为可互操作格式的管道,以分析和模拟葡萄砧木基因型的生长和水分吸收。在种植后3个月和6个月,对“101-14”、“SO4”和“Richter 110”3种葡萄砧木基因型各8个根系进行挖掘和数字化。我们验证了数字化方法的精度,比较了原位和非原位数字化,并评估了挖掘过程中的根系损失。将数字化的RSA数据转换为根系标记语言(RSML)格式,并导入到CPlantBox建模框架中,我们对该框架进行了调整,包括静态初始根系和概率向性函数。然后,我们将其参数化,模拟葡萄砧木的基因型特异性生长模式,并综合根系水力特性,得出每个基因型的标准摄取分数(SUF)。结果表明,挖掘和原位数字化能准确反映根系的空间结构,但对细根长度的估计有所低估。我们的实验揭示了RSA随时间的显著基因型变化,并为基因型特异性水获取能力提供了新的见解。模拟的RSA与田间种植和数字化根系的具体特征非常相似。本研究为未来利用RSA模型提高气候变化条件下木本多年生植物的可持续性和生产力提供了基础方法。
{"title":"A Field-to-Parameter Pipeline for Analyzing and Simulating Root System Architecture of Woody Perennials: Application to Grapevine Rootstocks.","authors":"Lukas Fichtl, Daniel Leitner, Andrea Schnepf, Dominik Schmidt, Katrin Kahlen, Matthias Friedel","doi":"10.34133/plantphenomics.0280","DOIUrl":"10.34133/plantphenomics.0280","url":null,"abstract":"<p><p>Understanding root system architecture (RSA) is essential for improving crop resilience to climate change, yet assessing root systems of woody perennials under field conditions remains a challenge. This study introduces a pipeline that combines field excavation, in situ 3-dimensional digitization, and transformation of RSA data into an interoperable format to analyze and model the growth and water uptake of grapevine rootstock genotypes. Eight root systems of each of 3 grapevine rootstock genotypes (\"101-14\", \"SO4\", and \"Richter 110\") were excavated and digitized 3 and 6 months after planting. We validated the precision of the digitization method, compared in situ and ex situ digitization, and assessed root loss during excavation. The digitized RSA data were converted to root system markup language (RSML) format and imported into the CPlantBox modeling framework, which we adapted to include a static initial root system and a probabilistic tropism function. We then parameterized it to simulate genotype-specific growth patterns of grapevine rootstocks and integrated root hydraulic properties to derive a standard uptake fraction (SUF) for each genotype. Results demonstrated that excavation and in situ digitization accurately reflected the spatial structure of root systems, despite some underestimation of fine root length. Our experiment revealed significant genotypic variations in RSA over time and provided new insights into genotype-specific water acquisition capabilities. Simulated RSA closely resembled the specific features of the field-grown and digitized root systems. This study provides a foundational methodology for future research aimed at utilizing RSA models to improve the sustainability and productivity of woody perennials under changing climatic conditions.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0280"},"PeriodicalIF":7.6,"publicationDate":"2024-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11633832/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142814123","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
PanicleNeRF: Low-Cost, High-Precision In-Field Phenotyping of Rice Panicles with Smartphone. PanicleNeRF:低成本、高精度的水稻穗智能手机田间表型分析。
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-12-05 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0279
Xin Yang, Xuqi Lu, Pengyao Xie, Ziyue Guo, Hui Fang, Haowei Fu, Xiaochun Hu, Zhenbiao Sun, Haiyan Cen

The rice panicle traits substantially influence grain yield, making them a primary target for rice phenotyping studies. However, most existing techniques are limited to controlled indoor environments and have difficulty in capturing the rice panicle traits under natural growth conditions. Here, we developed PanicleNeRF, a novel method that enables high-precision and low-cost reconstruction of rice panicle three-dimensional (3D) models in the field based on the video acquired by the smartphone. The proposed method combined the large model Segment Anything Model (SAM) and the small model You Only Look Once version 8 (YOLOv8) to achieve high-precision segmentation of rice panicle images. The neural radiance fields (NeRF) technique was then employed for 3D reconstruction using the images with 2D segmentation. Finally, the resulting point clouds are processed to successfully extract panicle traits. The results show that PanicleNeRF effectively addressed the 2D image segmentation task, achieving a mean F1 score of 86.9% and a mean Intersection over Union (IoU) of 79.8%, with nearly double the boundary overlap (BO) performance compared to YOLOv8. As for point cloud quality, PanicleNeRF significantly outperformed traditional SfM-MVS (structure-from-motion and multi-view stereo) methods, such as COLMAP and Metashape. The panicle length was then accurately extracted with the rRMSE of 2.94% for indica and 1.75% for japonica rice. The panicle volume estimated from 3D point clouds strongly correlated with the grain number (R 2 = 0.85 for indica and 0.82 for japonica) and grain mass (0.80 for indica and 0.76 for japonica). This method provides a low-cost solution for high-throughput in-field phenotyping of rice panicles, accelerating the efficiency of rice breeding.

水稻穗部性状对水稻产量有重要影响,是水稻表型研究的主要目标。然而,现有的技术大多局限于受控的室内环境,难以捕捉自然生长条件下的水稻穗部性状。在这里,我们开发了PanicleNeRF,这是一种基于智能手机获取的视频在田间高精度和低成本重建水稻穗三维(3D)模型的新方法。该方法结合大模型Segment Anything model (SAM)和小模型You Only Look Once version 8 (YOLOv8),实现了水稻穗图像的高精度分割。然后利用神经辐射场(NeRF)技术对二维分割后的图像进行三维重建。最后,对得到的点云进行处理,成功提取出圆锥花序特征。结果表明,PanicleNeRF有效地解决了2D图像分割任务,平均F1得分为86.9%,平均交集比(IoU)为79.8%,边界重叠(BO)性能比YOLOv8提高了近一倍。在点云质量方面,PanicleNeRF显著优于传统的SfM-MVS (structure-from-motion and multi-view stereo)方法,如COLMAP和Metashape。结果表明,籼稻穗长和粳稻穗长的rRMSE分别为2.94%和1.75%。三维点云估算的穗体积与籼稻粒数(r2 = 0.85,粳稻为0.82)和籽粒质量(r2 = 0.80,粳稻为0.76)密切相关。该方法为水稻穗高通量田间表型分析提供了一种低成本的解决方案,提高了水稻育种效率。
{"title":"PanicleNeRF: Low-Cost, High-Precision In-Field Phenotyping of Rice Panicles with Smartphone.","authors":"Xin Yang, Xuqi Lu, Pengyao Xie, Ziyue Guo, Hui Fang, Haowei Fu, Xiaochun Hu, Zhenbiao Sun, Haiyan Cen","doi":"10.34133/plantphenomics.0279","DOIUrl":"10.34133/plantphenomics.0279","url":null,"abstract":"<p><p>The rice panicle traits substantially influence grain yield, making them a primary target for rice phenotyping studies. However, most existing techniques are limited to controlled indoor environments and have difficulty in capturing the rice panicle traits under natural growth conditions. Here, we developed PanicleNeRF, a novel method that enables high-precision and low-cost reconstruction of rice panicle three-dimensional (3D) models in the field based on the video acquired by the smartphone. The proposed method combined the large model Segment Anything Model (SAM) and the small model You Only Look Once version 8 (YOLOv8) to achieve high-precision segmentation of rice panicle images. The neural radiance fields (NeRF) technique was then employed for 3D reconstruction using the images with 2D segmentation. Finally, the resulting point clouds are processed to successfully extract panicle traits. The results show that PanicleNeRF effectively addressed the 2D image segmentation task, achieving a mean F1 score of 86.9% and a mean Intersection over Union (IoU) of 79.8%, with nearly double the boundary overlap (BO) performance compared to YOLOv8. As for point cloud quality, PanicleNeRF significantly outperformed traditional SfM-MVS (structure-from-motion and multi-view stereo) methods, such as COLMAP and Metashape. The panicle length was then accurately extracted with the rRMSE of 2.94% for <i>indica</i> and 1.75% for <i>japonica</i> rice. The panicle volume estimated from 3D point clouds strongly correlated with the grain number (<i>R</i> <sup>2</sup> = 0.85 for <i>indica</i> and 0.82 for <i>japonica</i>) and grain mass (0.80 for <i>indica</i> and 0.76 for <i>japonica</i>). This method provides a low-cost solution for high-throughput in-field phenotyping of rice panicles, accelerating the efficiency of rice breeding.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0279"},"PeriodicalIF":7.6,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11617619/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142786754","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimating Leaf Nitrogen Accumulation Considering Vertical Heterogeneity Using Multiangular Unmanned Aerial Vehicle Remote Sensing in Wheat. 考虑垂直异质性的多角度无人机遥感估算小麦叶片氮积累量
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-12-05 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0276
Yuanyuan Pan, Jingyu Li, Jiayi Zhang, Jiaoyang He, Zhihao Zhang, Xia Yao, Tao Cheng, Yan Zhu, Weixing Cao, Yongchao Tian

The accuracy of leaf nitrogen accumulation (LNA) estimation is often compromised by the vertical heterogeneity of crop nitrogen. In this study, an estimation model of LNA considering vertical heterogeneity of wheat was developed based on unmanned aerial vehicle (UAV) multispectral data and near-ground hyperspectral data, both collected at different view zenith angles (e.g., 0°, -30°, and -45°). Winter wheat plants were evenly divided into 3 layers from top to bottom, and LNA was obtained for the upper, middle, and lower leaf layers, as well as for various combinations of these layers (upper and middle, middle and lower, and the entire canopy, referred to as LNACanopy). The linear regression (LR) and random forest regression (RF) models were constructed to estimate the LNA for each individual leaf layer. Subsequently, models for estimating LNACanopy that considered the impact of vertical heterogeneity (namely, LR-LNASum and RF-LNASum) were established based on the relationships between LNACanopy and LNA in different leaf layers. Meanwhile, LNA models that did not consider the effect of vertical heterogeneity (LR-LNAnon and RF-LNAnon) were used for comparative validation. The validation datasets consisted of UAV-simulated data from hyperspectral reflectance and UAV-measured data. Results showed that LNASum models had markedly higher accuracy compared to LNAnon. The optimal scheme for estimating LNACanopy was the combination of the upper, middle, and lower layers based on the normalized difference red edge index. Among these models, RF-LNASum demonstrated higher accuracy than LR-LNASum, with a validation relative root mean square error of 19.3% and 17.8% for the UAV-measured and simulated dataset, respectively.

叶片氮素积累(LNA)估算的准确性经常受到作物氮素垂直异质性的影响。基于不同视角天顶角(0°、-30°和-45°)下的无人机多光谱数据和近地高光谱数据,建立了考虑小麦垂直异质性的LNA估算模型。将冬小麦植株从上到下均匀分为3层,分别获得上、中、下叶层及其不同组合(上中层、中下层和整个冠层,简称LNACanopy)的LNA。建立了线性回归(LR)和随机森林回归(RF)模型来估计每个叶层的LNA。随后,基于不同叶层LNACanopy与LNA的关系,建立了考虑垂直异质性影响的LNACanopy估算模型(即LR-LNASum和RF-LNASum)。同时,采用不考虑垂直异质性影响的LNA模型(LR-LNAnon和RF-LNAnon)进行对比验证。验证数据集包括来自高光谱反射率的无人机模拟数据和无人机测量数据。结果表明,与LNAnon相比,LNASum模型具有更高的精度。最优方案是基于归一化差分红边指数的上、中、下三层组合。在这些模型中,RF-LNASum的精度高于LR-LNASum,在无人机实测和模拟数据集上的验证相对均方根误差分别为19.3%和17.8%。
{"title":"Estimating Leaf Nitrogen Accumulation Considering Vertical Heterogeneity Using Multiangular Unmanned Aerial Vehicle Remote Sensing in Wheat.","authors":"Yuanyuan Pan, Jingyu Li, Jiayi Zhang, Jiaoyang He, Zhihao Zhang, Xia Yao, Tao Cheng, Yan Zhu, Weixing Cao, Yongchao Tian","doi":"10.34133/plantphenomics.0276","DOIUrl":"10.34133/plantphenomics.0276","url":null,"abstract":"<p><p>The accuracy of leaf nitrogen accumulation (LNA) estimation is often compromised by the vertical heterogeneity of crop nitrogen. In this study, an estimation model of LNA considering vertical heterogeneity of wheat was developed based on unmanned aerial vehicle (UAV) multispectral data and near-ground hyperspectral data, both collected at different view zenith angles (e.g., 0°, -30°, and -45°). Winter wheat plants were evenly divided into 3 layers from top to bottom, and LNA was obtained for the upper, middle, and lower leaf layers, as well as for various combinations of these layers (upper and middle, middle and lower, and the entire canopy, referred to as LNA<sub>Canopy</sub>). The linear regression (LR) and random forest regression (RF) models were constructed to estimate the LNA for each individual leaf layer. Subsequently, models for estimating LNA<sub>Canopy</sub> that considered the impact of vertical heterogeneity (namely, LR-LNA<sub>Sum</sub> and RF-LNA<sub>Sum</sub>) were established based on the relationships between LNA<sub>Canopy</sub> and LNA in different leaf layers. Meanwhile, LNA models that did not consider the effect of vertical heterogeneity (LR-LNA<sub>non</sub> and RF-LNA<sub>non</sub>) were used for comparative validation. The validation datasets consisted of UAV-simulated data from hyperspectral reflectance and UAV-measured data. Results showed that LNA<sub>Sum</sub> models had markedly higher accuracy compared to LNA<sub>non</sub>. The optimal scheme for estimating LNA<sub>Canopy</sub> was the combination of the upper, middle, and lower layers based on the normalized difference red edge index. Among these models, RF-LNA<sub>Sum</sub> demonstrated higher accuracy than LR-LNA<sub>Sum</sub>, with a validation relative root mean square error of 19.3% and 17.8% for the UAV-measured and simulated dataset, respectively.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0276"},"PeriodicalIF":7.6,"publicationDate":"2024-12-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11617620/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142786748","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
One to All: Toward a Unified Model for Counting Cereal Crop Heads Based on Few-Shot Learning. 从一个到所有:基于少镜头学习的谷物作物头数计数统一模型。
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-11-28 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0271
Qiang Wang, Xijian Fan, Ziqing Zhuang, Tardi Tjahjadi, Shichao Jin, Honghua Huan, Qiaolin Ye

Accurate counting of cereals crops, e.g., maize, rice, sorghum, and wheat, is crucial for estimating grain production and ensuring food security. However, existing methods for counting cereal crops focus predominantly on building models for specific crop head; thus, they lack generalizability to different crop varieties. This paper presents Counting Heads of Cereal Crops Net (CHCNet), which is a unified model designed for counting multiple cereal crop heads by few-shot learning, which effectively reduces labeling costs. Specifically, a refined vision encoder is developed to enhance feature embedding, where a foundation model, namely, the segment anything model (SAM), is employed to emphasize the marked crop heads while mitigating complex background effects. Furthermore, a multiscale feature interaction module is proposed for integrating a similarity metric to facilitate automatic learning of crop-specific features across varying scales, which enhances the ability to describe crop heads of various sizes and shapes. The CHCNet model adopts a 2-stage training procedure. The initial stage focuses on latent feature mining to capture common feature representations of cereal crops. In the subsequent stage, inference is performed without additional training, by extracting domain-specific features of the target crop from selected exemplars to accomplish the counting task. In extensive experiments on 6 diverse crop datasets captured from ground cameras and drones, CHCNet substantially outperformed state-of-the-art counting methods in terms of cross-crop generalization ability, achieving mean absolute errors (MAEs) of 9.96 and 9.38 for maize, 13.94 for sorghum, 7.94 for rice, and 15.62 for mixed crops. A user-friendly interactive demo is available at http://cerealcropnet.com/, where researchers are invited to personally evaluate the proposed CHCNet. The source code for implementing CHCNet is available at https://github.com/Small-flyguy/CHCNet.

玉米、水稻、高粱和小麦等谷物作物的准确计数对于估计粮食产量和确保粮食安全至关重要。然而,现有的谷物作物计数方法主要集中在为特定的作物头建立模型;因此,它们缺乏对不同作物品种的通用性。CHCNet是一种采用少射学习的方法对多个谷类作物进行计数的统一模型,有效地降低了标注成本。具体而言,开发了一种改进的视觉编码器来增强特征嵌入,其中使用基础模型即分割任意模型(SAM)来强调标记的作物头,同时减轻复杂的背景影响。在此基础上,提出了一种多尺度特征交互模块,用于整合相似性度量,实现不同尺度作物特征的自动学习,增强了对不同尺寸和形状的作物头的描述能力。CHCNet模型采用两阶段训练程序。初始阶段侧重于潜在特征挖掘,以捕获谷类作物的共同特征表示。在随后的阶段,通过从选定的样本中提取目标作物的特定领域特征来完成计数任务,无需额外的训练即可执行推理。在地面摄像机和无人机采集的6种不同作物数据集上进行的大量实验中,CHCNet在跨作物泛化能力方面大大优于最先进的统计方法,玉米的平均绝对误差(MAEs)为9.96和9.38,高粱为13.94,水稻为7.94,混合作物为15.62。一个用户友好的交互式演示可以在http://cerealcropnet.com/上获得,研究人员被邀请亲自评估拟议的CHCNet。实现CHCNet的源代码可在https://github.com/Small-flyguy/CHCNet获得。
{"title":"One to All: Toward a Unified Model for Counting Cereal Crop Heads Based on Few-Shot Learning.","authors":"Qiang Wang, Xijian Fan, Ziqing Zhuang, Tardi Tjahjadi, Shichao Jin, Honghua Huan, Qiaolin Ye","doi":"10.34133/plantphenomics.0271","DOIUrl":"10.34133/plantphenomics.0271","url":null,"abstract":"<p><p>Accurate counting of cereals crops, e.g., maize, rice, sorghum, and wheat, is crucial for estimating grain production and ensuring food security. However, existing methods for counting cereal crops focus predominantly on building models for specific crop head; thus, they lack generalizability to different crop varieties. This paper presents Counting Heads of Cereal Crops Net (CHCNet), which is a unified model designed for counting multiple cereal crop heads by few-shot learning, which effectively reduces labeling costs. Specifically, a refined vision encoder is developed to enhance feature embedding, where a foundation model, namely, the segment anything model (SAM), is employed to emphasize the marked crop heads while mitigating complex background effects. Furthermore, a multiscale feature interaction module is proposed for integrating a similarity metric to facilitate automatic learning of crop-specific features across varying scales, which enhances the ability to describe crop heads of various sizes and shapes. The CHCNet model adopts a 2-stage training procedure. The initial stage focuses on latent feature mining to capture common feature representations of cereal crops. In the subsequent stage, inference is performed without additional training, by extracting domain-specific features of the target crop from selected exemplars to accomplish the counting task. In extensive experiments on 6 diverse crop datasets captured from ground cameras and drones, CHCNet substantially outperformed state-of-the-art counting methods in terms of cross-crop generalization ability, achieving mean absolute errors (MAEs) of 9.96 and 9.38 for maize, 13.94 for sorghum, 7.94 for rice, and 15.62 for mixed crops. A user-friendly interactive demo is available at http://cerealcropnet.com/, where researchers are invited to personally evaluate the proposed CHCNet. The source code for implementing CHCNet is available at https://github.com/Small-flyguy/CHCNet.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0271"},"PeriodicalIF":7.6,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11639208/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142829642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Seasonal Fluctuations and Vertical Heterogeneity of Biochemical-Structural Parameters in Wetland Emergent Aquatic Vegetation. 湿地新兴水生植被生化结构参数的季节波动和垂直异质性
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-11-28 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0275
Huaijing Wang, Yunmei Li, Jianguang Wen, Gaolun Wang, Huaiqing Liu, Heng Lyu

Accurate understanding of vertical patterns of canopy structure characteristics and solar radiation distribution patterns of aquatic vegetation is pivotal in formulating a bidirectional reflection model and comprehending the ecological dynamics of wetlands. Further, physiological and biochemical stratified structural properties of aquatic vegetation in wetlands remain unexplored due to more inherent investigation challenges than terrestrial vegetation. This study evaluated the structural characteristics of vegetation communities and the regulation of direct solar radiation variations within the canopy across seasons of Phragmites australis (P. australis) and Typha orientalis (T. orientalis), 2 typical emergent aquatic vegetations (EAVs), based on radiative transfer theory. Observations revealed that physiological and biochemical metrics varied at different growth stages with canopy height, the stratified leaf area index in the middle being higher than at the top and bottom of the P. australis cluster. Moreover, the vertical profiles of direct solar radiation decrease with depth, showing a bowl-shaped and V-shaped curve in the P. australis and T. orientalis clusters, respectively. Interestingly, the sensitivity of layered solar direct radiation transmittance to canopy structural parameters is obviously higher than that of canopy pigments, suggesting considerable potential for estimating layered structural parameters. The transmittance of direct solar radiation decreases with increasing leaf area index at different heights, and stratified transmittance in the cluster can be accurately described by a negative binomial function with a deviation of less than 2%.

准确认识水生植被冠层结构特征的垂直格局和太阳辐射分布格局,对建立湿地双向反射模型和理解湿地生态动态具有重要意义。与陆地植被相比,湿地水生植被的生理生化分层结构特性面临着更多的内在挑战,因此湿地水生植被的生理生化分层结构特性尚未得到深入研究。基于辐射传输理论,研究了典型的水生植被芦苇(Phragmites australis, P. australis)和热带风铃草(Typha orientalis, T. orientalis)的植被群落结构特征和冠层内太阳直接辐射的季节变化规律。在不同生长阶段,生理生化指标随冠层高度的变化而变化,中部分层叶面积指数高于顶部和底部。此外,太阳直接辐射垂直剖面随深度的增加而减小,在南方柽柳和东方柽柳群落中分别呈碗形和v形曲线。有趣的是,层状太阳直接辐射透过率对冠层结构参数的敏感性明显高于冠层色素,表明在估算层状结构参数方面具有很大的潜力。在不同高度,太阳直接辐射的透过率随叶面积指数的增加而降低,用负二项式函数可以准确地描述簇内的分层透过率,偏差小于2%。
{"title":"Seasonal Fluctuations and Vertical Heterogeneity of Biochemical-Structural Parameters in Wetland Emergent Aquatic Vegetation.","authors":"Huaijing Wang, Yunmei Li, Jianguang Wen, Gaolun Wang, Huaiqing Liu, Heng Lyu","doi":"10.34133/plantphenomics.0275","DOIUrl":"10.34133/plantphenomics.0275","url":null,"abstract":"<p><p>Accurate understanding of vertical patterns of canopy structure characteristics and solar radiation distribution patterns of aquatic vegetation is pivotal in formulating a bidirectional reflection model and comprehending the ecological dynamics of wetlands. Further, physiological and biochemical stratified structural properties of aquatic vegetation in wetlands remain unexplored due to more inherent investigation challenges than terrestrial vegetation. This study evaluated the structural characteristics of vegetation communities and the regulation of direct solar radiation variations within the canopy across seasons of <i>Phragmites australis (P. australis)</i> and <i>Typha orientalis (T. orientalis)</i>, 2 typical emergent aquatic vegetations (EAVs), based on radiative transfer theory. Observations revealed that physiological and biochemical metrics varied at different growth stages with canopy height, the stratified leaf area index in the middle being higher than at the top and bottom of the <i>P. australis</i> cluster. Moreover, the vertical profiles of direct solar radiation decrease with depth, showing a bowl-shaped and V-shaped curve in the <i>P. australis</i> and <i>T. orientalis</i> clusters, respectively. Interestingly, the sensitivity of layered solar direct radiation transmittance to canopy structural parameters is obviously higher than that of canopy pigments, suggesting considerable potential for estimating layered structural parameters. The transmittance of direct solar radiation decreases with increasing leaf area index at different heights, and stratified transmittance in the cluster can be accurately described by a negative binomial function with a deviation of less than 2%.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0275"},"PeriodicalIF":7.6,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11602876/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142751329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (Phaseolus vulgaris L.). 基于无人机的干豆(Phaseolus vulgaris L.)相对成熟度、林分数和株高的数字表型评价
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-11-28 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0278
Leonardo Volpato, Evan M Wright, Francisco E Gomez

Substantial effort has been made in manually tracking plant maturity and to measure early-stage plant density and crop height in experimental fields. In this study, RGB drone imagery and deep learning (DL) approaches are explored to measure relative maturity (RM), stand count (SC), and plant height (PH), potentially offering higher throughput, accuracy, and cost-effectiveness than traditional methods. A time series of drone images was utilized to estimate dry bean RM employing a hybrid convolutional neural network (CNN) and long short-term memory (LSTM) model. For early-stage SC assessment, Faster RCNN object detection algorithm was evaluated. Flight frequencies, image resolution, and data augmentation techniques were investigated to enhance DL model performance. PH was obtained using a quantile method from digital surface model (DSM) and point cloud (PC) data sources. The CNN-LSTM model showed high accuracy in RM prediction across various conditions, outperforming traditional image preprocessing approaches. The inclusion of growing degree days (GDD) data improved the model's performance under specific environmental stresses. The Faster R-CNN model effectively identified early-stage bean plants, demonstrating superior accuracy over traditional methods and consistency across different flight altitudes. For PH estimation, moderate correlations with ground-truth data were observed across both datasets analyzed. The choice between PC and DSM source data may depend on specific environmental and flight conditions. Overall, the CNN-LSTM and Faster R-CNN models proved more effective than conventional techniques in quantifying RM and SC. The subtraction method proposed for estimating PH without accurate ground elevation data yielded results comparable to the difference-based method. Additionally, the pipeline and open-source software developed hold potential to significantly benefit the phenotyping community.

在试验田,人工跟踪植物成熟期、测定早期植株密度和作物高度已经做了大量的工作。本研究探索了RGB无人机图像和深度学习(DL)方法来测量相对成熟度(RM)、林分数(SC)和植物高度(PH),可能提供比传统方法更高的吞吐量、准确性和成本效益。利用无人机图像的时间序列,采用卷积神经网络(CNN)和长短期记忆(LSTM)混合模型估计干豆RM。对于早期SC评估,评估了更快的RCNN目标检测算法。研究了飞行频率、图像分辨率和数据增强技术来增强DL模型的性能。PH值采用分位数法从数字曲面模型(DSM)和点云(PC)数据源中获得。CNN-LSTM模型在各种条件下的RM预测精度较高,优于传统的图像预处理方法。加入生长日数(GDD)数据提高了模型在特定环境胁迫下的性能。Faster R-CNN模型有效地识别了早期豆类植物,比传统方法具有更高的准确性和不同飞行高度的一致性。对于PH估计,在分析的两个数据集中观察到与真实数据的适度相关性。PC和DSM源数据的选择可能取决于具体的环境和飞行条件。总体而言,CNN-LSTM和Faster R-CNN模型在量化RM和SC方面比传统技术更有效。在没有精确地面高程数据的情况下,用于估算PH的减法方法的结果与基于差分的方法相当。此外,开发的管道和开源软件具有显著造福表型社区的潜力。
{"title":"Drone-Based Digital Phenotyping to Evaluating Relative Maturity, Stand Count, and Plant Height in Dry Beans (<i>Phaseolus vulgaris</i> L.).","authors":"Leonardo Volpato, Evan M Wright, Francisco E Gomez","doi":"10.34133/plantphenomics.0278","DOIUrl":"10.34133/plantphenomics.0278","url":null,"abstract":"<p><p>Substantial effort has been made in manually tracking plant maturity and to measure early-stage plant density and crop height in experimental fields. In this study, RGB drone imagery and deep learning (DL) approaches are explored to measure relative maturity (RM), stand count (SC), and plant height (PH), potentially offering higher throughput, accuracy, and cost-effectiveness than traditional methods. A time series of drone images was utilized to estimate dry bean RM employing a hybrid convolutional neural network (CNN) and long short-term memory (LSTM) model. For early-stage SC assessment, Faster RCNN object detection algorithm was evaluated. Flight frequencies, image resolution, and data augmentation techniques were investigated to enhance DL model performance. PH was obtained using a quantile method from digital surface model (DSM) and point cloud (PC) data sources. The CNN-LSTM model showed high accuracy in RM prediction across various conditions, outperforming traditional image preprocessing approaches. The inclusion of growing degree days (GDD) data improved the model's performance under specific environmental stresses. The Faster R-CNN model effectively identified early-stage bean plants, demonstrating superior accuracy over traditional methods and consistency across different flight altitudes. For PH estimation, moderate correlations with ground-truth data were observed across both datasets analyzed. The choice between PC and DSM source data may depend on specific environmental and flight conditions. Overall, the CNN-LSTM and Faster R-CNN models proved more effective than conventional techniques in quantifying RM and SC. The subtraction method proposed for estimating PH without accurate ground elevation data yielded results comparable to the difference-based method. Additionally, the pipeline and open-source software developed hold potential to significantly benefit the phenotyping community.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0278"},"PeriodicalIF":7.6,"publicationDate":"2024-11-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11602537/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142751325","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
PlanText: Gradually Masked Guidance to Align Image Phenotypes with Trait Descriptions for Plant Disease Texts. PlanText:为植物病害文本的图像表型与性状描述对齐提供渐进式遮蔽引导。
IF 7.6 1区 农林科学 Q1 AGRONOMY Pub Date : 2024-11-26 eCollection Date: 2024-01-01 DOI: 10.34133/plantphenomics.0272
Kejun Zhao, Xingcai Wu, Yuanyuan Xiao, Sijun Jiang, Peijia Yu, Yazhou Wang, Qi Wang

Plant diseases are a critical driver of the global food crisis. The integration of advanced artificial intelligence technologies can substantially enhance plant disease diagnostics. However, current methods for early and complex detection remain challenging. Employing multimodal technologies, akin to medical artificial intelligence diagnostics that combine diverse data types, may offer a more effective solution. Presently, the reliance on single-modal data predominates in plant disease research, which limits the scope for early and detailed diagnosis. Consequently, developing text modality generation techniques is essential for overcoming the limitations in plant disease recognition. To this end, we propose a method for aligning plant phenotypes with trait descriptions, which diagnoses text by progressively masking disease images. First, for training and validation, we annotate 5,728 disease phenotype images with expert diagnostic text and provide annotated text and trait labels for 210,000 disease images. Then, we propose a PhenoTrait text description model, which consists of global and heterogeneous feature encoders as well as switching-attention decoders, for accurate context-aware output. Next, to generate a more phenotypically appropriate description, we adopt 3 stages of embedding image features into semantic structures, which generate characterizations that preserve trait features. Finally, our experimental results show that our model outperforms several frontier models in multiple trait descriptions, including the larger models GPT-4 and GPT-4o. Our code and dataset are available at https://plantext.samlab.cn/.

植物病害是全球粮食危机的一个重要驱动因素。整合先进的人工智能技术可以大大提高植物病害诊断水平。然而,目前的早期和复杂检测方法仍然具有挑战性。采用多模态技术,类似于结合多种数据类型的医学人工智能诊断,可能会提供更有效的解决方案。目前,植物病害研究主要依赖单一模式数据,这限制了早期和详细诊断的范围。因此,开发文本模态生成技术对于克服植物病害识别的局限性至关重要。为此,我们提出了一种将植物表型与性状描述对齐的方法,该方法通过逐步遮蔽病害图像来诊断文本。首先,为了训练和验证,我们用专家诊断文本注释了 5,728 幅病害表型图像,并为 210,000 幅病害图像提供了注释文本和性状标签。然后,我们提出了一个 PhenoTrait 文本描述模型,该模型由全局和异构特征编码器以及切换注意力解码器组成,可实现准确的上下文感知输出。接下来,为了生成更适合表型的描述,我们采用了将图像特征嵌入语义结构的 3 个阶段,从而生成保留了性状特征的描述。最后,我们的实验结果表明,我们的模型在多个性状描述方面优于多个前沿模型,包括较大的模型 GPT-4 和 GPT-4o。我们的代码和数据集可在 https://plantext.samlab.cn/ 上获取。
{"title":"PlanText: Gradually Masked Guidance to Align Image Phenotypes with Trait Descriptions for Plant Disease Texts.","authors":"Kejun Zhao, Xingcai Wu, Yuanyuan Xiao, Sijun Jiang, Peijia Yu, Yazhou Wang, Qi Wang","doi":"10.34133/plantphenomics.0272","DOIUrl":"10.34133/plantphenomics.0272","url":null,"abstract":"<p><p>Plant diseases are a critical driver of the global food crisis. The integration of advanced artificial intelligence technologies can substantially enhance plant disease diagnostics. However, current methods for early and complex detection remain challenging. Employing multimodal technologies, akin to medical artificial intelligence diagnostics that combine diverse data types, may offer a more effective solution. Presently, the reliance on single-modal data predominates in plant disease research, which limits the scope for early and detailed diagnosis. Consequently, developing text modality generation techniques is essential for overcoming the limitations in plant disease recognition. To this end, we propose a method for aligning plant phenotypes with trait descriptions, which diagnoses text by progressively masking disease images. First, for training and validation, we annotate 5,728 disease phenotype images with expert diagnostic text and provide annotated text and trait labels for 210,000 disease images. Then, we propose a PhenoTrait text description model, which consists of global and heterogeneous feature encoders as well as switching-attention decoders, for accurate context-aware output. Next, to generate a more phenotypically appropriate description, we adopt 3 stages of embedding image features into semantic structures, which generate characterizations that preserve trait features. Finally, our experimental results show that our model outperforms several frontier models in multiple trait descriptions, including the larger models GPT-4 and GPT-4o. Our code and dataset are available at https://plantext.samlab.cn/.</p>","PeriodicalId":20318,"journal":{"name":"Plant Phenomics","volume":"6 ","pages":"0272"},"PeriodicalIF":7.6,"publicationDate":"2024-11-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11589250/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142732084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"农林科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Plant Phenomics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1