{"title":"A Lightweight Conditional Convolutional Neural Network for Hyperspectral Image Classification","authors":"Linfeng Wu, Huajun Wang, Huiqing Wang","doi":"10.14358/pers.22-00130r2","DOIUrl":null,"url":null,"abstract":"Deep learning (dl), especially convolutional neural networks (cnns), has been proven to be an excellent feature extractor and widely applied to hyperspectral image (hsi) classification. However, dl is a computationally demanding algorithm with many parameters and a high computational\n burden, which seriously restricts the deployment of dl-based hsi classification algorithms on mobile and embedded systems. In this paper, we propose an extremely lightweight conditional three-dimensional (3D) hsi with a double-branch structure to solve these problems. Specifically,\n we introduce a lightweight conditional 3D convolution to replace the conventional 3D convolution to reduce the computational and memory cost of the network and achieve flexible hsi feature extraction. Then, based on lightweight conditional 3D convolution, we build two parallel paths\n to independently exploit and optimize the diverse spatial and spectral features. Furthermore, to precisely locate the key information, which is conducive to classification, a lightweight attention mechanism is carefully designed to refine extracted spatial and spectral features, and improve\n the classification accuracy with less computation and memory costs. Experiments on three public hsi data sets show that the proposed model can effectively reduce the cost of computation and memory, achieve high execution speed, and better classification performance compared with several\n recent dl-based models.","PeriodicalId":211256,"journal":{"name":"Photogrammetric Engineering & Remote Sensing","volume":"119 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Photogrammetric Engineering & Remote Sensing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.14358/pers.22-00130r2","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Deep learning (dl), especially convolutional neural networks (cnns), has been proven to be an excellent feature extractor and widely applied to hyperspectral image (hsi) classification. However, dl is a computationally demanding algorithm with many parameters and a high computational
burden, which seriously restricts the deployment of dl-based hsi classification algorithms on mobile and embedded systems. In this paper, we propose an extremely lightweight conditional three-dimensional (3D) hsi with a double-branch structure to solve these problems. Specifically,
we introduce a lightweight conditional 3D convolution to replace the conventional 3D convolution to reduce the computational and memory cost of the network and achieve flexible hsi feature extraction. Then, based on lightweight conditional 3D convolution, we build two parallel paths
to independently exploit and optimize the diverse spatial and spectral features. Furthermore, to precisely locate the key information, which is conducive to classification, a lightweight attention mechanism is carefully designed to refine extracted spatial and spectral features, and improve
the classification accuracy with less computation and memory costs. Experiments on three public hsi data sets show that the proposed model can effectively reduce the cost of computation and memory, achieve high execution speed, and better classification performance compared with several
recent dl-based models.