{"title":"ConvBLS:结合深度和广度表征的高效增量卷积广度学习系统","authors":"Chunyu Lei;Jifeng Guo;C. L. Philip Chen","doi":"10.1109/TAI.2024.3403953","DOIUrl":null,"url":null,"abstract":"Broad learning system (BLS) has to undergo a vectorization operation before modeling image data, which makes it challenging for BLS to learn local semantic features. Thus, various convolutional-based broad learning systems (C-BLSs) have been introduced to address these challenges. Regrettably, the existing C-BLS variants either lack an efficient training algorithm and incremental learning capability or suffer from poor performance. To this end, we propose a novel convolutional broad learning system (ConvBLS) based on the spherical K-means (SKM) algorithm and two-stage multiscale (TSMS) feature fusion, which consists of the convolutional feature layer (CFL), convolutional enhancement layer (CEL), TSMS feature fusion layer, and output layer. First, unlike the current C-BLS, the simple yet efficient SKM algorithm is utilized to learn the weights of CFLs. Compared with random filters, the SKM algorithm enables the CFL to learn more comprehensive spatial features. Second, to further mine the local semantic features, CELs are established to expand the feature space. Third, the TSMS feature fusion layer is proposed to extract more effective multiscale features by integrating deep and broad representations. Thanks to the above elaborate design and the pseudoinverse calculation of the output layer weights, our proposed ConvBLS method is unprecedentedly efficient and effective. Finally, the corresponding incremental learning algorithms are presented for rapid remodeling if the model deems to expand. Experiments and comparisons demonstrate the superiority of our method.","PeriodicalId":73305,"journal":{"name":"IEEE transactions on artificial intelligence","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"ConvBLS: An Effective and Efficient Incremental Convolutional Broad Learning System Combining Deep and Broad Representations\",\"authors\":\"Chunyu Lei;Jifeng Guo;C. L. Philip Chen\",\"doi\":\"10.1109/TAI.2024.3403953\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Broad learning system (BLS) has to undergo a vectorization operation before modeling image data, which makes it challenging for BLS to learn local semantic features. Thus, various convolutional-based broad learning systems (C-BLSs) have been introduced to address these challenges. Regrettably, the existing C-BLS variants either lack an efficient training algorithm and incremental learning capability or suffer from poor performance. To this end, we propose a novel convolutional broad learning system (ConvBLS) based on the spherical K-means (SKM) algorithm and two-stage multiscale (TSMS) feature fusion, which consists of the convolutional feature layer (CFL), convolutional enhancement layer (CEL), TSMS feature fusion layer, and output layer. First, unlike the current C-BLS, the simple yet efficient SKM algorithm is utilized to learn the weights of CFLs. Compared with random filters, the SKM algorithm enables the CFL to learn more comprehensive spatial features. Second, to further mine the local semantic features, CELs are established to expand the feature space. Third, the TSMS feature fusion layer is proposed to extract more effective multiscale features by integrating deep and broad representations. Thanks to the above elaborate design and the pseudoinverse calculation of the output layer weights, our proposed ConvBLS method is unprecedentedly efficient and effective. Finally, the corresponding incremental learning algorithms are presented for rapid remodeling if the model deems to expand. Experiments and comparisons demonstrate the superiority of our method.\",\"PeriodicalId\":73305,\"journal\":{\"name\":\"IEEE transactions on artificial intelligence\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-03-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE transactions on artificial intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10536023/\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on artificial intelligence","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10536023/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
ConvBLS: An Effective and Efficient Incremental Convolutional Broad Learning System Combining Deep and Broad Representations
Broad learning system (BLS) has to undergo a vectorization operation before modeling image data, which makes it challenging for BLS to learn local semantic features. Thus, various convolutional-based broad learning systems (C-BLSs) have been introduced to address these challenges. Regrettably, the existing C-BLS variants either lack an efficient training algorithm and incremental learning capability or suffer from poor performance. To this end, we propose a novel convolutional broad learning system (ConvBLS) based on the spherical K-means (SKM) algorithm and two-stage multiscale (TSMS) feature fusion, which consists of the convolutional feature layer (CFL), convolutional enhancement layer (CEL), TSMS feature fusion layer, and output layer. First, unlike the current C-BLS, the simple yet efficient SKM algorithm is utilized to learn the weights of CFLs. Compared with random filters, the SKM algorithm enables the CFL to learn more comprehensive spatial features. Second, to further mine the local semantic features, CELs are established to expand the feature space. Third, the TSMS feature fusion layer is proposed to extract more effective multiscale features by integrating deep and broad representations. Thanks to the above elaborate design and the pseudoinverse calculation of the output layer weights, our proposed ConvBLS method is unprecedentedly efficient and effective. Finally, the corresponding incremental learning algorithms are presented for rapid remodeling if the model deems to expand. Experiments and comparisons demonstrate the superiority of our method.