基于失真构建、特征筛选和机器学习的无人机高光谱图像 NR-IQA

{"title":"基于失真构建、特征筛选和机器学习的无人机高光谱图像 NR-IQA","authors":"","doi":"10.1016/j.jag.2024.104130","DOIUrl":null,"url":null,"abstract":"<div><p>Assessing the quality of UAV-HSIs (Unmanned aerial vehicle hyperspectral images) is crucial for evaluating sensor performance, identifying distortion types, and measuring data inversion accuracy. Due to the absence of reference images, UAV-HSI quality assessment leans towards no-reference image quality assessment (NR-IQA), offering versatile applications. NR-IQA methods of remote sensing images using machine learning techniques have emerged, however, NR-IQA methods for UAV-HSIs containing multi-type and multiple distortions have not been developed. This paper introduces an NR-IQA method for UAV-HSI, employing machine learning techniques. We summarize and simulate distortion types in UAV-HSIs, constructing a quality assessment dataset based on 23 original high-quality and 806 simulated degraded UAV-HSIs. Extracting 129 features encompassing texture, color, transform domain, structural, and statistical aspects, we form seven feature sets through random and filtered feature selection algorithms. Ten machine learning quality assessment models are trained using this dataset and feature sets. The results showed that the model with the highest evaluation accuracy was extra trees (ET) (<em>R</em><sup>2</sup> = 0.928, RMSE = 0.326, RPD = 3.601), using feature set 1 that fuses Tamura texture, color, wavelet transform, and mean subtracted contrast normalized (MSCN) coefficient for a total of 11 features, the PLCC and SROCC of its predicted and true quality scores reached 0.963 and 0.925, respectively. In addition, the random forest (RF), gradient boosting decision tree (GBDT), generalized regression neural network (GRNN), and extreme learning machine (ELM) also had high evaluation accuracies (<em>R</em><sup>2</sup> &gt; 0.9 and RPD &gt; 2.5). These findings underscore the applicability of our proposed machine learning-based NR-IQA method to assess the quality of the UAV-HSIs containing noise, blur, strip noise, and multiple distortions. Additionally, this study serves as a reference for selecting features and models for other hyperspectral image quality assessments.</p></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":null,"pages":null},"PeriodicalIF":7.6000,"publicationDate":"2024-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1569843224004849/pdfft?md5=b03c80f0029295d7bcf7e784fffb2f9d&pid=1-s2.0-S1569843224004849-main.pdf","citationCount":"0","resultStr":"{\"title\":\"NR-IQA for UAV hyperspectral image based on distortion constructing, feature screening, and machine learning\",\"authors\":\"\",\"doi\":\"10.1016/j.jag.2024.104130\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Assessing the quality of UAV-HSIs (Unmanned aerial vehicle hyperspectral images) is crucial for evaluating sensor performance, identifying distortion types, and measuring data inversion accuracy. Due to the absence of reference images, UAV-HSI quality assessment leans towards no-reference image quality assessment (NR-IQA), offering versatile applications. NR-IQA methods of remote sensing images using machine learning techniques have emerged, however, NR-IQA methods for UAV-HSIs containing multi-type and multiple distortions have not been developed. This paper introduces an NR-IQA method for UAV-HSI, employing machine learning techniques. We summarize and simulate distortion types in UAV-HSIs, constructing a quality assessment dataset based on 23 original high-quality and 806 simulated degraded UAV-HSIs. Extracting 129 features encompassing texture, color, transform domain, structural, and statistical aspects, we form seven feature sets through random and filtered feature selection algorithms. Ten machine learning quality assessment models are trained using this dataset and feature sets. The results showed that the model with the highest evaluation accuracy was extra trees (ET) (<em>R</em><sup>2</sup> = 0.928, RMSE = 0.326, RPD = 3.601), using feature set 1 that fuses Tamura texture, color, wavelet transform, and mean subtracted contrast normalized (MSCN) coefficient for a total of 11 features, the PLCC and SROCC of its predicted and true quality scores reached 0.963 and 0.925, respectively. In addition, the random forest (RF), gradient boosting decision tree (GBDT), generalized regression neural network (GRNN), and extreme learning machine (ELM) also had high evaluation accuracies (<em>R</em><sup>2</sup> &gt; 0.9 and RPD &gt; 2.5). These findings underscore the applicability of our proposed machine learning-based NR-IQA method to assess the quality of the UAV-HSIs containing noise, blur, strip noise, and multiple distortions. Additionally, this study serves as a reference for selecting features and models for other hyperspectral image quality assessments.</p></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2024-09-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1569843224004849/pdfft?md5=b03c80f0029295d7bcf7e784fffb2f9d&pid=1-s2.0-S1569843224004849-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843224004849\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224004849","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
引用次数: 0

摘要

评估无人飞行器高光谱图像(UAV-HSIs)的质量对于评价传感器性能、识别失真类型和测量数据反演精度至关重要。由于缺乏参考图像,无人飞行器高光谱图像质量评估倾向于无参考图像质量评估(NR-IQA),从而提供了多种应用。利用机器学习技术对遥感图像进行 NR-IQA 的方法已经出现,但针对包含多类型和多畸变的无人机-恒星成像的 NR-IQA 方法尚未开发。本文介绍了一种采用机器学习技术的 UAV-HSI NR-IQA 方法。我们总结并模拟了 UAV-HSI 中的失真类型,基于 23 个原始高质量 UAV-HSI 和 806 个模拟退化 UAV-HSI 构建了质量评估数据集。通过随机和过滤特征选择算法,我们提取了 129 个特征,包括纹理、颜色、变换域、结构和统计方面,形成了七个特征集。利用该数据集和特征集训练了 10 个机器学习质量评估模型。结果表明,评价准确率最高的模型是额外树(ET)(R2 = 0.928,RMSE = 0.326,RPD = 3.601),其特征集 1 融合了田村纹理、颜色、小波变换和均值减对比度归一化(MSCN)系数共 11 个特征,其预测质量得分和真实质量得分的 PLCC 和 SROCC 分别达到了 0.963 和 0.925。此外,随机森林(RF)、梯度提升决策树(GBDT)、广义回归神经网络(GRNN)和极端学习机(ELM)也具有很高的评估精度(R2 > 0.9 和 RPD > 2.5)。这些发现突出表明,我们提出的基于机器学习的 NR-IQA 方法适用于评估包含噪声、模糊、条状噪声和多重失真的无人机人机界面质量。此外,本研究还可为其他高光谱图像质量评估选择特征和模型提供参考。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
NR-IQA for UAV hyperspectral image based on distortion constructing, feature screening, and machine learning

Assessing the quality of UAV-HSIs (Unmanned aerial vehicle hyperspectral images) is crucial for evaluating sensor performance, identifying distortion types, and measuring data inversion accuracy. Due to the absence of reference images, UAV-HSI quality assessment leans towards no-reference image quality assessment (NR-IQA), offering versatile applications. NR-IQA methods of remote sensing images using machine learning techniques have emerged, however, NR-IQA methods for UAV-HSIs containing multi-type and multiple distortions have not been developed. This paper introduces an NR-IQA method for UAV-HSI, employing machine learning techniques. We summarize and simulate distortion types in UAV-HSIs, constructing a quality assessment dataset based on 23 original high-quality and 806 simulated degraded UAV-HSIs. Extracting 129 features encompassing texture, color, transform domain, structural, and statistical aspects, we form seven feature sets through random and filtered feature selection algorithms. Ten machine learning quality assessment models are trained using this dataset and feature sets. The results showed that the model with the highest evaluation accuracy was extra trees (ET) (R2 = 0.928, RMSE = 0.326, RPD = 3.601), using feature set 1 that fuses Tamura texture, color, wavelet transform, and mean subtracted contrast normalized (MSCN) coefficient for a total of 11 features, the PLCC and SROCC of its predicted and true quality scores reached 0.963 and 0.925, respectively. In addition, the random forest (RF), gradient boosting decision tree (GBDT), generalized regression neural network (GRNN), and extreme learning machine (ELM) also had high evaluation accuracies (R2 > 0.9 and RPD > 2.5). These findings underscore the applicability of our proposed machine learning-based NR-IQA method to assess the quality of the UAV-HSIs containing noise, blur, strip noise, and multiple distortions. Additionally, this study serves as a reference for selecting features and models for other hyperspectral image quality assessments.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International journal of applied earth observation and geoinformation : ITC journal
International journal of applied earth observation and geoinformation : ITC journal Global and Planetary Change, Management, Monitoring, Policy and Law, Earth-Surface Processes, Computers in Earth Sciences
CiteScore
12.00
自引率
0.00%
发文量
0
审稿时长
77 days
期刊介绍: The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.
期刊最新文献
Experimental observations of marginally detectable floating plastic targets in Sentinel-2 and Planet Super Dove imagery Mitigating terrain shadows in very high-resolution satellite imagery for accurate evergreen conifer detection using bi-temporal image fusion Optimizing UAV-based uncooled thermal cameras in field conditions for precision agriculture UAV measurements and AI-driven algorithms fusion for real estate good governance principles support Advancing complex urban traffic forecasting: A fully attentional spatial-temporal network enhanced by graph representation
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1