{"title":"基于失真构建、特征筛选和机器学习的无人机高光谱图像 NR-IQA","authors":"","doi":"10.1016/j.jag.2024.104130","DOIUrl":null,"url":null,"abstract":"<div><p>Assessing the quality of UAV-HSIs (Unmanned aerial vehicle hyperspectral images) is crucial for evaluating sensor performance, identifying distortion types, and measuring data inversion accuracy. Due to the absence of reference images, UAV-HSI quality assessment leans towards no-reference image quality assessment (NR-IQA), offering versatile applications. NR-IQA methods of remote sensing images using machine learning techniques have emerged, however, NR-IQA methods for UAV-HSIs containing multi-type and multiple distortions have not been developed. This paper introduces an NR-IQA method for UAV-HSI, employing machine learning techniques. We summarize and simulate distortion types in UAV-HSIs, constructing a quality assessment dataset based on 23 original high-quality and 806 simulated degraded UAV-HSIs. Extracting 129 features encompassing texture, color, transform domain, structural, and statistical aspects, we form seven feature sets through random and filtered feature selection algorithms. Ten machine learning quality assessment models are trained using this dataset and feature sets. The results showed that the model with the highest evaluation accuracy was extra trees (ET) (<em>R</em><sup>2</sup> = 0.928, RMSE = 0.326, RPD = 3.601), using feature set 1 that fuses Tamura texture, color, wavelet transform, and mean subtracted contrast normalized (MSCN) coefficient for a total of 11 features, the PLCC and SROCC of its predicted and true quality scores reached 0.963 and 0.925, respectively. In addition, the random forest (RF), gradient boosting decision tree (GBDT), generalized regression neural network (GRNN), and extreme learning machine (ELM) also had high evaluation accuracies (<em>R</em><sup>2</sup> > 0.9 and RPD > 2.5). These findings underscore the applicability of our proposed machine learning-based NR-IQA method to assess the quality of the UAV-HSIs containing noise, blur, strip noise, and multiple distortions. Additionally, this study serves as a reference for selecting features and models for other hyperspectral image quality assessments.</p></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":null,"pages":null},"PeriodicalIF":7.6000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1569843224004849/pdfft?md5=b03c80f0029295d7bcf7e784fffb2f9d&pid=1-s2.0-S1569843224004849-main.pdf","citationCount":"0","resultStr":"{\"title\":\"NR-IQA for UAV hyperspectral image based on distortion constructing, feature screening, and machine learning\",\"authors\":\"\",\"doi\":\"10.1016/j.jag.2024.104130\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Assessing the quality of UAV-HSIs (Unmanned aerial vehicle hyperspectral images) is crucial for evaluating sensor performance, identifying distortion types, and measuring data inversion accuracy. Due to the absence of reference images, UAV-HSI quality assessment leans towards no-reference image quality assessment (NR-IQA), offering versatile applications. NR-IQA methods of remote sensing images using machine learning techniques have emerged, however, NR-IQA methods for UAV-HSIs containing multi-type and multiple distortions have not been developed. This paper introduces an NR-IQA method for UAV-HSI, employing machine learning techniques. We summarize and simulate distortion types in UAV-HSIs, constructing a quality assessment dataset based on 23 original high-quality and 806 simulated degraded UAV-HSIs. Extracting 129 features encompassing texture, color, transform domain, structural, and statistical aspects, we form seven feature sets through random and filtered feature selection algorithms. Ten machine learning quality assessment models are trained using this dataset and feature sets. The results showed that the model with the highest evaluation accuracy was extra trees (ET) (<em>R</em><sup>2</sup> = 0.928, RMSE = 0.326, RPD = 3.601), using feature set 1 that fuses Tamura texture, color, wavelet transform, and mean subtracted contrast normalized (MSCN) coefficient for a total of 11 features, the PLCC and SROCC of its predicted and true quality scores reached 0.963 and 0.925, respectively. In addition, the random forest (RF), gradient boosting decision tree (GBDT), generalized regression neural network (GRNN), and extreme learning machine (ELM) also had high evaluation accuracies (<em>R</em><sup>2</sup> > 0.9 and RPD > 2.5). These findings underscore the applicability of our proposed machine learning-based NR-IQA method to assess the quality of the UAV-HSIs containing noise, blur, strip noise, and multiple distortions. Additionally, this study serves as a reference for selecting features and models for other hyperspectral image quality assessments.</p></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2024-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1569843224004849/pdfft?md5=b03c80f0029295d7bcf7e784fffb2f9d&pid=1-s2.0-S1569843224004849-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843224004849\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224004849","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
NR-IQA for UAV hyperspectral image based on distortion constructing, feature screening, and machine learning
Assessing the quality of UAV-HSIs (Unmanned aerial vehicle hyperspectral images) is crucial for evaluating sensor performance, identifying distortion types, and measuring data inversion accuracy. Due to the absence of reference images, UAV-HSI quality assessment leans towards no-reference image quality assessment (NR-IQA), offering versatile applications. NR-IQA methods of remote sensing images using machine learning techniques have emerged, however, NR-IQA methods for UAV-HSIs containing multi-type and multiple distortions have not been developed. This paper introduces an NR-IQA method for UAV-HSI, employing machine learning techniques. We summarize and simulate distortion types in UAV-HSIs, constructing a quality assessment dataset based on 23 original high-quality and 806 simulated degraded UAV-HSIs. Extracting 129 features encompassing texture, color, transform domain, structural, and statistical aspects, we form seven feature sets through random and filtered feature selection algorithms. Ten machine learning quality assessment models are trained using this dataset and feature sets. The results showed that the model with the highest evaluation accuracy was extra trees (ET) (R2 = 0.928, RMSE = 0.326, RPD = 3.601), using feature set 1 that fuses Tamura texture, color, wavelet transform, and mean subtracted contrast normalized (MSCN) coefficient for a total of 11 features, the PLCC and SROCC of its predicted and true quality scores reached 0.963 and 0.925, respectively. In addition, the random forest (RF), gradient boosting decision tree (GBDT), generalized regression neural network (GRNN), and extreme learning machine (ELM) also had high evaluation accuracies (R2 > 0.9 and RPD > 2.5). These findings underscore the applicability of our proposed machine learning-based NR-IQA method to assess the quality of the UAV-HSIs containing noise, blur, strip noise, and multiple distortions. Additionally, this study serves as a reference for selecting features and models for other hyperspectral image quality assessments.
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.