Combining KAN with CNN: KonvNeXt’s Performance in Remote Sensing and Patent Insights

IF 4.2 2区 地球科学 Q2 ENVIRONMENTAL SCIENCES Remote Sensing Pub Date : 2024-09-14 DOI:10.3390/rs16183417
Minjong Cheon, Changbae Mun
{"title":"Combining KAN with CNN: KonvNeXt’s Performance in Remote Sensing and Patent Insights","authors":"Minjong Cheon, Changbae Mun","doi":"10.3390/rs16183417","DOIUrl":null,"url":null,"abstract":"Rapid advancements in satellite technology have led to a significant increase in high-resolution remote sensing (RS) images, necessitating the use of advanced processing methods. Additionally, patent analysis revealed a substantial increase in deep learning and machine learning applications in remote sensing, highlighting the growing importance of these technologies. Therefore, this paper introduces the Kolmogorov-Arnold Network (KAN) model to remote sensing to enhance efficiency and performance in RS applications. We conducted several experiments to validate KAN’s applicability, starting with the EuroSAT dataset, where we combined the KAN layer with multiple pre-trained CNN models. Optimal performance was achieved using ConvNeXt, leading to the development of the KonvNeXt model. KonvNeXt was evaluated on the Optimal-31, AID, and Merced datasets for validation and achieved accuracies of 90.59%, 94.1%, and 98.1%, respectively. The model also showed fast processing speed, with the Optimal-31 and Merced datasets completed in 107.63 s each, while the bigger and more complicated AID dataset took 545.91 s. This result is meaningful since it achieved faster speeds and comparable accuracy compared to the existing study, which utilized VIT and proved KonvNeXt’s applicability for remote sensing classification tasks. Furthermore, we investigated the model’s interpretability by utilizing Occlusion Sensitivity, and by displaying the influential regions, we validated its potential use in a variety of domains, including medical imaging and weather forecasting. This paper is meaningful in that it is the first to use KAN in remote sensing classification, proving its adaptability and efficiency.","PeriodicalId":48993,"journal":{"name":"Remote Sensing","volume":null,"pages":null},"PeriodicalIF":4.2000,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.3390/rs16183417","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0

Abstract

Rapid advancements in satellite technology have led to a significant increase in high-resolution remote sensing (RS) images, necessitating the use of advanced processing methods. Additionally, patent analysis revealed a substantial increase in deep learning and machine learning applications in remote sensing, highlighting the growing importance of these technologies. Therefore, this paper introduces the Kolmogorov-Arnold Network (KAN) model to remote sensing to enhance efficiency and performance in RS applications. We conducted several experiments to validate KAN’s applicability, starting with the EuroSAT dataset, where we combined the KAN layer with multiple pre-trained CNN models. Optimal performance was achieved using ConvNeXt, leading to the development of the KonvNeXt model. KonvNeXt was evaluated on the Optimal-31, AID, and Merced datasets for validation and achieved accuracies of 90.59%, 94.1%, and 98.1%, respectively. The model also showed fast processing speed, with the Optimal-31 and Merced datasets completed in 107.63 s each, while the bigger and more complicated AID dataset took 545.91 s. This result is meaningful since it achieved faster speeds and comparable accuracy compared to the existing study, which utilized VIT and proved KonvNeXt’s applicability for remote sensing classification tasks. Furthermore, we investigated the model’s interpretability by utilizing Occlusion Sensitivity, and by displaying the influential regions, we validated its potential use in a variety of domains, including medical imaging and weather forecasting. This paper is meaningful in that it is the first to use KAN in remote sensing classification, proving its adaptability and efficiency.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
将 KAN 与 CNN 相结合:KonvNeXt 在遥感领域的表现和专利启示
卫星技术的快速发展导致高分辨率遥感(RS)图像大幅增加,这就需要使用先进的处理方法。此外,专利分析显示,遥感领域的深度学习和机器学习应用大幅增加,凸显了这些技术日益增长的重要性。因此,本文将柯尔莫哥洛夫-阿诺德网络(KAN)模型引入遥感领域,以提高遥感应用的效率和性能。我们进行了多项实验来验证 KAN 的适用性,首先从 EuroSAT 数据集开始,将 KAN 层与多个预先训练好的 CNN 模型相结合。使用 ConvNeXt 实现了最佳性能,从而开发出了 KonvNeXt 模型。KonvNeXt 在 Optimal-31、AID 和 Merced 数据集上进行了验证评估,准确率分别达到 90.59%、94.1% 和 98.1%。该模型的处理速度也很快,Optimal-31 和 Merced 数据集的处理时间分别为 107.63 秒,而更大更复杂的 AID 数据集的处理时间则为 545.91 秒。这一结果很有意义,因为与利用 VIT 的现有研究相比,它实现了更快的速度和相当的准确率,证明了 KonvNeXt 在遥感分类任务中的适用性。此外,我们还利用遮挡灵敏度研究了模型的可解释性,并通过显示有影响的区域,验证了其在医学成像和天气预报等多个领域的潜在用途。本文的意义在于首次将 KAN 应用于遥感分类,证明了其适应性和高效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Remote Sensing
Remote Sensing REMOTE SENSING-
CiteScore
8.30
自引率
24.00%
发文量
5435
审稿时长
20.66 days
期刊介绍: Remote Sensing (ISSN 2072-4292) publishes regular research papers, reviews, letters and communications covering all aspects of the remote sensing process, from instrument design and signal processing to the retrieval of geophysical parameters and their application in geosciences. Our aim is to encourage scientists to publish experimental, theoretical and computational results in as much detail as possible so that results can be easily reproduced. There is no restriction on the length of the papers. The full experimental details must be provided so that the results can be reproduced.
期刊最新文献
Mapping Field-Level Maize Yields in Ethiopian Smallholder Systems Using Sentinel-2 Imagery Development of a Background Filtering Algorithm to Improve the Accuracy of Determining Underground Cavities Using Multi-Channel Ground-Penetrating Radar and Deep Learning Enhancing Digital Twins with Human Movement Data: A Comparative Study of Lidar-Based Tracking Methods Development of a UAS-Based Multi-Sensor Deep Learning Model for Predicting Napa Cabbage Fresh Weight and Determining Optimal Harvest Time Mini-Satellite Fucheng 1 SAR: Interferometry to Monitor Mining-Induced Subsidence and Comparative Analysis with Sentinel-1
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1