Plant Phenomics最新文献

Plant phenotype detection plays a crucial role in understanding and studying plant biology, agriculture, and ecology. It involves the quantification and analysis of various physical traits and characteristics of plants, such as plant height, leaf shape, angle, number, and growth trajectory. By accurately detecting and measuring these phenotypic traits, researchers can gain insights into plant growth, development, stress tolerance, and the influence of environmental factors, which has important implications for crop breeding. Among these phenotypic characteristics, the number of leaves and growth trajectory of the plant are most accessible. Nonetheless, obtaining these phenotypes is labor intensive and financially demanding. With the rapid development of computer vision technology and artificial intelligence, using maize field images to fully analyze plant-related information can greatly eliminate repetitive labor and enhance the efficiency of plant breeding. However, it is still difficult to apply deep learning methods in field environments to determine the number and growth trajectory of leaves and stalks due to the complex backgrounds and serious occlusion problems of crops in field environments. To preliminarily explore the application of deep learning technology to the acquisition of the number of leaves and stalks and the tracking of growth trajectories in field agriculture, in this study, we developed a deep learning method called Point-Line Net, which is based on the Mask R-CNN framework, to automatically recognize maize field RGB images and determine the number and growth trajectory of leaves and stalks. The experimental results demonstrate that the object detection accuracy (mAP50) of our Point-Line Net can reach 81.5%. Moreover, to describe the position and growth of leaves and stalks, we introduced a new lightweight "keypoint" detection branch that achieved a magnitude of 33.5 using our custom distance verification index. Overall, these findings provide valuable insights for future field plant phenotype detection, particularly for datasets with dot and line annotations.

Efficient and accurate acquisition of the rice grain protein content (GPC) is important for selecting high-quality rice varieties, and remote sensing technology is an attractive potential method for this task. However, the majority of multispectral sensors are poor predictors of GPC due to their broad spectral bands. Hyperspectral technology provides a new analytical technology for bridging the gap between phenomics and genomics. However, the small size of typical datasets is a constraint for model construction for estimating GPC, limiting their accuracy and reducing their ability to generalize to a wide range of varieties. In this study, we used hyperspectral data of rice grains from 515 japonica varieties and deep convolution generative adversarial networks (DCGANs) to generate simulated data to improve the model accuracy. Features sensitive to GPC were extracted after applying a continuous wavelet transform (CWT), and the estimated GPC model was constructed by partial least squares regression (PLSR). Finally, a genome-wide association study (GWAS) was applied to the measured and generated datasets to detect GPC loci. The results demonstrated that the simulated GPC values generated after 8,000 epochs were closest to the measured values. The wavelet feature (WF_{1743, 2}), obtained from the data with the addition of 200 simulated samples, exhibited the highest GPC estimation accuracy (R ² = 0.58 and RRMSE = 6.70%). The GWAS analysis showed that the estimated values based on the simulated data detected the same loci as the measured values, including the OsmtSSB1L gene related to grain storage protein. This study provides a new technique for the efficient genetic study of phenotypic traits in rice based on hyperspectral technology.

The pod and seed counts are important yield-related traits in soybean. High-precision soybean breeders face the major challenge of accurately phenotyping the number of pods and seeds in a high-throughput manner. Recent advances in artificial intelligence, especially deep learning (DL) models, have provided new avenues for high-throughput phenotyping of crop traits with increased precision. However, the available DL models are less effective for phenotyping pods that are densely packed and overlap in in situ soybean plants; thus, accurate phenotyping of the number of pods and seeds in soybean plant is an important challenge. To address this challenge, the present study proposed a bottom-up model, DEKR-SPrior (disentangled keypoint regression with structural prior), for in situ soybean pod phenotyping, which considers soybean pods and seeds analogous to human people and joints, respectively. In particular, we designed a novel structural prior (SPrior) module that utilizes cosine similarity to improve feature discrimination, which is important for differentiating closely located seeds from highly similar seeds. To further enhance the accuracy of pod location, we cropped full-sized images into smaller and high-resolution subimages for analysis. The results on our image datasets revealed that DEKR-SPrior outperformed multiple bottom-up models, viz., Lightweight-OpenPose, OpenPose, HigherHRNet, and DEKR, reducing the mean absolute error from 25.81 (in the original DEKR) to 21.11 (in the DEKR-SPrior) in pod phenotyping. This paper demonstrated the great potential of DEKR-SPrior for plant phenotyping, and we hope that DEKR-SPrior will help future plant phenotyping.

Grape cluster architecture and compactness are complex traits influencing disease susceptibility, fruit quality, and yield. Evaluation methods for these traits include visual scoring, manual methodologies, and computer vision, with the latter being the most scalable approach. Most of the existing computer vision approaches for processing cluster images often rely on conventional segmentation or machine learning with extensive training and limited generalization. The Segment Anything Model (SAM), a novel foundation model trained on a massive image dataset, enables automated object segmentation without additional training. This study demonstrates out-of-the-box SAM's high accuracy in identifying individual berries in 2-dimensional (2D) cluster images. Using this model, we managed to segment approximately 3,500 cluster images, generating over 150,000 berry masks, each linked with spatial coordinates within their clusters. The correlation between human-identified berries and SAM predictions was very strong (Pearson's r² = 0.96). Although the visible berry count in images typically underestimates the actual cluster berry count due to visibility issues, we demonstrated that this discrepancy could be adjusted using a linear regression model (adjusted R ² = 0.87). We emphasized the critical importance of the angle at which the cluster is imaged, noting its substantial effect on berry counts and architecture. We proposed different approaches in which berry location information facilitated the calculation of complex features related to cluster architecture and compactness. Finally, we discussed SAM's potential integration into currently available pipelines for image generation and processing in vineyard conditions.

Deep learning and multimodal remote and proximal sensing are widely used for analyzing plant and crop traits, but many of these deep learning models are supervised and necessitate reference datasets with image annotations. Acquiring these datasets often demands experiments that are both labor-intensive and time-consuming. Furthermore, extracting traits from remote sensing data beyond simple geometric features remains a challenge. To address these challenges, we proposed a radiative transfer modeling framework based on the Helios 3-dimensional (3D) plant modeling software designed for plant remote and proximal sensing image simulation. The framework has the capability to simulate RGB, multi-/hyperspectral, thermal, and depth cameras, and produce associated plant images with fully resolved reference labels such as plant physical traits, leaf chemical concentrations, and leaf physiological traits. Helios offers a simulated environment that enables generation of 3D geometric models of plants and soil with random variation, and specification or simulation of their properties and function. This approach differs from traditional computer graphics rendering by explicitly modeling radiation transfer physics, which provides a critical link to underlying plant biophysical processes. Results indicate that the framework is capable of generating high-quality, labeled synthetic plant images under given lighting scenarios, which can lessen or remove the need for manually collected and annotated data. Two example applications are presented that demonstrate the feasibility of using the model to enable unsupervised learning by training deep learning models exclusively with simulated images and performing prediction tasks using real images.

Plants encounter a variety of beneficial and harmful insects during their growth cycle. Accurate identification (i.e., detecting insects' presence) and classification (i.e., determining the type or class) of these insect species is critical for implementing prompt and suitable mitigation strategies. Such timely actions carry substantial economic and environmental implications. Deep learning-based approaches have produced models with good insect classification accuracy. Researchers aim to implement identification and classification models in agriculture, facing challenges when input images markedly deviate from the training distribution (e.g., images like vehicles, humans, or a blurred image or insect class that is not yet trained on). Out-of-distribution (OOD) detection algorithms provide an exciting avenue to overcome these challenges as they ensure that a model abstains from making incorrect classification predictions on images that belong to non-insect and/or untrained insect classes. As far as we know, no prior in-depth exploration has been conducted on the role of the OOD detection algorithms in addressing agricultural issues. Here, we generate and evaluate the performance of state-of-the-art OOD algorithms on insect detection classifiers. These algorithms represent a diversity of methods for addressing an OOD problem. Specifically, we focus on extrusive algorithms, i.e., algorithms that wrap around a well-trained classifier without the need for additional co-training. We compared three OOD detection algorithms: (a) maximum softmax probability, which uses the softmax value as a confidence score; (b) Mahalanobis distance (MAH)-based algorithm, which uses a generative classification approach; and (c) energy-based algorithm, which maps the input data to a scalar value, called energy. We performed an extensive series of evaluations of these OOD algorithms across three performance axes: (a) Base model accuracy: How does the accuracy of the classifier impact OOD performance? (b) How does the level of dissimilarity to the domain impact OOD performance? (c) Data imbalance: How sensitive is OOD performance to the imbalance in per-class sample size? Evaluating OOD algorithms across these performance axes provides practical guidelines to ensure the robust performance of well-trained models in the wild, which is a key consideration for agricultural applications. Based on this analysis, we proposed the most effective OOD algorithm as wrapper for the insect classifier with highest accuracy. We presented the results of its OOD detection performance in the paper. Our results indicate that OOD detection algorithms can significantly enhance user trust in insect pest classification by abstaining classification under uncertain conditions.

The periderm is a vital protective tissue found in the roots, stems, and woody elements of diverse plant species. It plays an important function in these plants by assuming the role of the epidermis as the outermost layer. Despite its critical role for protecting plants from environmental stresses and pathogens, research on root periderm development has been limited due to its late formation during root development, its presence only in mature root regions, and its impermeability. One of the most straightforward measurements for comparing periderm formation between different genotypes and treatments is periderm (phellem) length. We have developed PAT (Periderm Assessment Toolkit), a high-throughput user-friendly pipeline that integrates an efficient staining protocol, automated imaging, and a deep-learning-based image analysis approach to accurately detect and measure periderm length in the roots of Arabidopsis thaliana. The reliability and reproducibility of our method was evaluated using a diverse set of 20 Arabidopsis natural accessions. Our automated measurements exhibited a strong correlation with human-expert-generated measurements, achieving a 94% efficiency in periderm length quantification. This robust PAT pipeline streamlines large-scale periderm measurements, thereby being able to facilitate comprehensive genetic studies and screens. Although PAT proves highly effective with automated digital microscopes in Arabidopsis roots, its application may pose challenges with nonautomated microscopy. Although the workflow and principles could be adapted for other plant species, additional optimization would be necessary. While we show that periderm length can be used to distinguish a mutant impaired in periderm development from wild type, we also find it is a plastic trait. Therefore, care must be taken to include sufficient repeats and controls, to minimize variation, and to ensure comparability of periderm length measurements between different genotypes and growth conditions.

Inefficient nitrogen (N) utilization in agricultural production has led to many negative impacts such as excessive use of N fertilizers, redundant plant growth, greenhouse gases, long-lasting toxicity in ecosystem, and even effect on human health, indicating the importance to optimize N applications in cropping systems. Here, we present a multiseasonal study that focused on measuring phenotypic changes in wheat plants when they were responding to different N treatments under field conditions. Powered by drone-based aerial phenotyping and the AirMeasurer platform, we first quantified 6 N response-related traits as targets using plot-based morphological, spectral, and textural signals collected from 54 winter wheat varieties. Then, we developed dynamic phenotypic analysis using curve fitting to establish profile curves of the traits during the season, which enabled us to compute static phenotypes at key growth stages and dynamic phenotypes (i.e., phenotypic changes) during N response. After that, we combine 12 yield production and N-utilization indices manually measured to produce N efficiency comprehensive scores (NECS), based on which we classified the varieties into 4 N responsiveness (i.e., N-dependent yield increase) groups. The NECS ranking facilitated us to establish a tailored machine learning model for N responsiveness-related varietal classification just using N-response phenotypes with high accuracies. Finally, we employed the Wheat55K SNP Array to map single-nucleotide polymorphisms using N response-related static and dynamic phenotypes, helping us explore genetic components underlying N responsiveness in wheat. In summary, we believe that our work demonstrates valuable advances in N response-related plant research, which could have major implications for improving N sustainability in wheat breeding and production.

Root system architecture (RSA) is an important measure of how plants navigate and interact with the soil environment. However, current methods in studying RSA must make tradeoffs between precision of data and proximity to natural conditions, with root growth in germination papers providing accessibility and high data resolution. Functional-structural plant models (FSPMs) can overcome this tradeoff, though parameterization and evaluation of FSPMs are traditionally based in manual measurements and visual comparison. Here, we applied a germination paper system to study the adventitious RSA and root phenology of Populus trichocarpa stem cuttings using time-series image-based phenotyping augmented by FSPM. We found a significant correlation between timing of root initiation and thermal time at cutting collection (P value = 0.0061, R² = 0.875), but little correlation with RSA. We also present a use of RhizoVision [1] for automatically extracting FSPM parameters from time series images and evaluating FSPM simulations. A high accuracy of the parameterization was achieved in predicting 2D growth with a sensitivity rate of 83.5%. This accuracy was lost when predicting 3D growth with sensitivity rates of 38.5% to 48.7%, while overall accuracy varied with phenotyping methods. Despite this loss in accuracy, the new method is amenable to high throughput FSPM parameterization and bridges the gap between advances in time-series phenotyping and FSPMs.