Ahmed Mohammed;Nisar Ali;Abdul Bais;Yuefeng Ruan;Richard D. Cuthbert;Jatinder S. Sangha
{"title":"从田野到像素:用于高通量小麦穗粒计数的无人机多光谱和田间采集 RGB 成像技术","authors":"Ahmed Mohammed;Nisar Ali;Abdul Bais;Yuefeng Ruan;Richard D. Cuthbert;Jatinder S. Sangha","doi":"10.1109/JSTARS.2024.3463432","DOIUrl":null,"url":null,"abstract":"Wheat breeding enhances wheat crops for better environmental resistance and higher yield potential. Experimental breeding lines are evaluated based on their yield potential, where quantifying spikes per unit area and kernels per spike is crucial for assessment. This study introduces SPINEL (SPIke and kerNEL), a framework that combines unmanned aerial vehicle (UAV)-captured multispectral imaging and field-captured RGB camera imaging for spike and kernel quantification. This approach utilizes YOLOv8 models, each tailored for a specific detection task. The first model detects plots in UAV-captured multispectral images with a mean average precision (mAP) score of 95%, while the second model, trained to detect spikes in the same dataset, demonstrates an mAP score of 86%. The third model detects spikes and kernels in field-captured RGB images with an 85% mAP score. The first two models aid in estimating the spike density in each field plot. The third model provides the estimated number of kernels in spikes of each unique breeding line. Spikes per field plot and kernels per spike serve as key quantification metrics. The SPINEL framework utilizes the geolocation information of the multispectral images and associates these metrics with breeding lines at the field level. This integration provides a clear visual representation of spike count and average kernels per spike for each field plot. SPINEL offers a precise, automated solution for phenotyping in wheat breeding, promising significant advancements in crop improvement strategies.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":null,"pages":null},"PeriodicalIF":4.7000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10682791","citationCount":"0","resultStr":"{\"title\":\"From Fields to Pixels: UAV Multispectral and Field-Captured RGB Imaging for High-Throughput Wheat Spike and Kernel Counting\",\"authors\":\"Ahmed Mohammed;Nisar Ali;Abdul Bais;Yuefeng Ruan;Richard D. Cuthbert;Jatinder S. Sangha\",\"doi\":\"10.1109/JSTARS.2024.3463432\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Wheat breeding enhances wheat crops for better environmental resistance and higher yield potential. Experimental breeding lines are evaluated based on their yield potential, where quantifying spikes per unit area and kernels per spike is crucial for assessment. This study introduces SPINEL (SPIke and kerNEL), a framework that combines unmanned aerial vehicle (UAV)-captured multispectral imaging and field-captured RGB camera imaging for spike and kernel quantification. This approach utilizes YOLOv8 models, each tailored for a specific detection task. The first model detects plots in UAV-captured multispectral images with a mean average precision (mAP) score of 95%, while the second model, trained to detect spikes in the same dataset, demonstrates an mAP score of 86%. The third model detects spikes and kernels in field-captured RGB images with an 85% mAP score. The first two models aid in estimating the spike density in each field plot. The third model provides the estimated number of kernels in spikes of each unique breeding line. Spikes per field plot and kernels per spike serve as key quantification metrics. The SPINEL framework utilizes the geolocation information of the multispectral images and associates these metrics with breeding lines at the field level. This integration provides a clear visual representation of spike count and average kernels per spike for each field plot. SPINEL offers a precise, automated solution for phenotyping in wheat breeding, promising significant advancements in crop improvement strategies.\",\"PeriodicalId\":13116,\"journal\":{\"name\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2024-09-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10682791\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10682791/\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10682791/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
From Fields to Pixels: UAV Multispectral and Field-Captured RGB Imaging for High-Throughput Wheat Spike and Kernel Counting
Wheat breeding enhances wheat crops for better environmental resistance and higher yield potential. Experimental breeding lines are evaluated based on their yield potential, where quantifying spikes per unit area and kernels per spike is crucial for assessment. This study introduces SPINEL (SPIke and kerNEL), a framework that combines unmanned aerial vehicle (UAV)-captured multispectral imaging and field-captured RGB camera imaging for spike and kernel quantification. This approach utilizes YOLOv8 models, each tailored for a specific detection task. The first model detects plots in UAV-captured multispectral images with a mean average precision (mAP) score of 95%, while the second model, trained to detect spikes in the same dataset, demonstrates an mAP score of 86%. The third model detects spikes and kernels in field-captured RGB images with an 85% mAP score. The first two models aid in estimating the spike density in each field plot. The third model provides the estimated number of kernels in spikes of each unique breeding line. Spikes per field plot and kernels per spike serve as key quantification metrics. The SPINEL framework utilizes the geolocation information of the multispectral images and associates these metrics with breeding lines at the field level. This integration provides a clear visual representation of spike count and average kernels per spike for each field plot. SPINEL offers a precise, automated solution for phenotyping in wheat breeding, promising significant advancements in crop improvement strategies.
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.