首页 > 最新文献

IEEE Transactions on Emerging Topics in Computational Intelligence最新文献

英文 中文
An Emerging Incremental Fuzzy Concept-Cognitive Learning Model Based on Granular Computing and Conceptual Knowledge Clustering 基于粒度计算和概念知识聚类的新兴增量式模糊概念认知学习模型
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-13 DOI: 10.1109/TETCI.2024.3360336
Xiaoyuan Deng;Jinhai Li;Yuhua Qian;Junmin Liu
Fuzzy granular concepts are fundamental units in developing computational intelligence approaches based on fuzzy concept-cognitive learning. However, existing models in this field merely focus on the information provided by fuzzy granular concepts induced by objects, ignoring that of those induced by attributes. Consequently, these models underutilize the information provided by fuzzy granular concepts and weaken classification ability. To solve this problem, we propose an effective fuzzy granular concept-cognitive learning model, which incorporates fuzzy attribute granular concepts on the basis of the fuzzy object granular concepts. To be concrete, we firstly introduce the notion of a fuzzy attribute granular concept and construct a fuzzy granular concept space. Secondly, we obtain a fuzzy granular concept clustering space by optimizing the threshold which is used to fuse similar fuzzy granular concepts, and then form lower and upper approximation spaces through set approximation. In addition, we explain the mechanism of new incremental fuzzy concept-cognitive learning model for label prediction by integrating the fuzzy granular concept clustering space and the lower and upper approximation spaces. Finally, we show the classification performance of the proposed model on 28 datasets by comparing it with 10 classical machine learning classification algorithms and 17 fuzzy similarity-based classification algorithms, and evaluate incremental learning ability of our model. The experimental results demonstrate the feasibility and effectiveness of our method.
模糊粒度概念是开发基于模糊概念认知学习的计算智能方法的基本单元。然而,该领域的现有模型仅仅关注由对象引起的模糊粒度概念所提供的信息,而忽略了由属性引起的模糊粒度概念所提供的信息。因此,这些模型未能充分利用模糊粒度概念提供的信息,削弱了分类能力。为了解决这个问题,我们提出了一种有效的模糊粒度概念-认知学习模型,它在模糊对象粒度概念的基础上加入了模糊属性粒度概念。具体来说,我们首先引入了模糊属性粒度概念的概念,并构建了一个模糊粒度概念空间。其次,我们通过优化用于融合相似模糊粒度概念的阈值来获得模糊粒度概念聚类空间,然后通过集合逼近形成下近似空间和上近似空间。此外,我们还解释了通过整合模糊粒度概念聚类空间和上下近似空间来实现标签预测的新增量模糊概念认知学习模型的机制。最后,通过与 10 种经典机器学习分类算法和 17 种基于模糊相似性的分类算法进行比较,展示了所提模型在 28 个数据集上的分类性能,并评估了模型的增量学习能力。实验结果证明了我们方法的可行性和有效性。
{"title":"An Emerging Incremental Fuzzy Concept-Cognitive Learning Model Based on Granular Computing and Conceptual Knowledge Clustering","authors":"Xiaoyuan Deng;Jinhai Li;Yuhua Qian;Junmin Liu","doi":"10.1109/TETCI.2024.3360336","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3360336","url":null,"abstract":"Fuzzy granular concepts are fundamental units in developing computational intelligence approaches based on fuzzy concept-cognitive learning. However, existing models in this field merely focus on the information provided by fuzzy granular concepts induced by objects, ignoring that of those induced by attributes. Consequently, these models underutilize the information provided by fuzzy granular concepts and weaken classification ability. To solve this problem, we propose an effective fuzzy granular concept-cognitive learning model, which incorporates fuzzy attribute granular concepts on the basis of the fuzzy object granular concepts. To be concrete, we firstly introduce the notion of a fuzzy attribute granular concept and construct a fuzzy granular concept space. Secondly, we obtain a fuzzy granular concept clustering space by optimizing the threshold which is used to fuse similar fuzzy granular concepts, and then form lower and upper approximation spaces through set approximation. In addition, we explain the mechanism of new incremental fuzzy concept-cognitive learning model for label prediction by integrating the fuzzy granular concept clustering space and the lower and upper approximation spaces. Finally, we show the classification performance of the proposed model on 28 datasets by comparing it with 10 classical machine learning classification algorithms and 17 fuzzy similarity-based classification algorithms, and evaluate incremental learning ability of our model. The experimental results demonstrate the feasibility and effectiveness of our method.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141096309","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A New Multitask Joint Learning Framework for Expensive Multi-Objective Optimization Problems 针对昂贵的多目标优化问题的新型多任务联合学习框架
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-12 DOI: 10.1109/TETCI.2024.3359042
Jianping Luo;Yongfei Dong;Qiqi Liu;Zexuan Zhu;Wenming Cao;Kay Chen Tan;Yaochu Jin
In this paper, we propose a multi-objective optimization algorithm based on multitask conditional neural processes (MTCNPs) to deal with expensive multi-objective optimization problems (MOPs). In the proposed algorithm, an MOP is decomposed into several subproblems. Several related subproblems are assigned to a task group and jointly handled using an MTCNPs surrogate model, in which multi-task learning is incorporated to exploit the similarity across the subproblems via joint surrogate model learning. Each subproblem in a task group is modeled by a conditional neural processes (CNPs) instead of a Gaussian Process (GP), thus avoiding the calculation of the GP covariance matrix. In addition, multiple subproblems are jointly learned through a multi-layer similarity network with activation function, which can measure and utilize the similarity and useful information among subproblems more effectively and improve the accuracy and robustness of the surrogate model. Experimental studies under several scenarios indicate that the proposed algorithm performs better than several state-of-the-art multi-objective evolutionary algorithms for expensive MOPs. The parameter sensitivity and effectiveness of the proposed algorithm are analyzed in detail.
本文提出了一种基于多任务条件神经过程(MTCNPs)的多目标优化算法,用于处理昂贵的多目标优化问题(MOPs)。在提议的算法中,一个 MOP 被分解成几个子问题。几个相关的子问题被分配到一个任务组,并使用 MTCNPs 代理模型进行联合处理,其中包含多任务学习,通过联合代理模型学习来利用各子问题之间的相似性。任务组中的每个子问题都采用条件神经过程(CNPs)建模,而不是高斯过程(GP),从而避免了计算 GP 协方差矩阵。此外,通过带激活函数的多层相似性网络对多个子问题进行联合学习,可以更有效地测量和利用子问题之间的相似性和有用信息,提高代用模型的准确性和鲁棒性。多种场景下的实验研究表明,针对昂贵的澳门威尼斯人官网程,所提出的算法比几种最先进的多目标进化算法性能更好。本文详细分析了所提算法的参数敏感性和有效性。
{"title":"A New Multitask Joint Learning Framework for Expensive Multi-Objective Optimization Problems","authors":"Jianping Luo;Yongfei Dong;Qiqi Liu;Zexuan Zhu;Wenming Cao;Kay Chen Tan;Yaochu Jin","doi":"10.1109/TETCI.2024.3359042","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3359042","url":null,"abstract":"In this paper, we propose a multi-objective optimization algorithm based on multitask conditional neural processes (MTCNPs) to deal with expensive multi-objective optimization problems (MOPs). In the proposed algorithm, an MOP is decomposed into several subproblems. Several related subproblems are assigned to a task group and jointly handled using an MTCNPs surrogate model, in which multi-task learning is incorporated to exploit the similarity across the subproblems via joint surrogate model learning. Each subproblem in a task group is modeled by a conditional neural processes (CNPs) instead of a Gaussian Process (GP), thus avoiding the calculation of the GP covariance matrix. In addition, multiple subproblems are jointly learned through a multi-layer similarity network with activation function, which can measure and utilize the similarity and useful information among subproblems more effectively and improve the accuracy and robustness of the surrogate model. Experimental studies under several scenarios indicate that the proposed algorithm performs better than several state-of-the-art multi-objective evolutionary algorithms for expensive MOPs. The parameter sensitivity and effectiveness of the proposed algorithm are analyzed in detail.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140309936","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
VTST: Efficient Visual Tracking With a Stereoscopic Transformer VTST: 利用立体变压器进行高效视觉跟踪
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-12 DOI: 10.1109/TETCI.2024.3360303
Fengwei Gu;Jun Lu;Chengtao Cai;Qidan Zhu;Zhaojie Ju
Although Siamese trackers have become increasingly prevalent in the visual tracking domain, they are easily interfered by semantic distractors in complex environments, which results in the underutilization of feature information. Especially when multiple disturbances work together, the performance of many trackers often suffers severe degradation. To solve the above problem, this paper presents a robust Stereoscopic Transformer network for improving tracking performance. Using a hybrid attention mechanism, our method is composed of a channel feature awareness network (CFAN), a global channel attention network (GCAN), and a multi-level feature enhancement unit (MFEU). Concretely, CFAN focuses on specific channel information, while highlighting the contained target features and weakening the semantic distractor features. As an intermediate hub, GCAN is mainly responsible for establishing the global feature dependencies between the search region and the template, while selecting the concerned channel features to improve the distinguishing ability of the model. In particular, MFEU is used to enhance multi-level feature information to facilitate feature representation learning for our method. Finally, a Transformer-based Siamese tracker (named VTST) is proposed to present an efficient tracking representation, which can gain advantages over a variety of challenging attributes. Experiments show that our method outperforms the state-of-the-art trackers on multiple benchmarks with a real-time running speed of 56.0 fps.
虽然连体跟踪器在视觉跟踪领域越来越普遍,但在复杂环境中,它们很容易受到语义干扰因素的干扰,从而导致特征信息利用不足。特别是当多种干扰因素共同作用时,许多跟踪器的性能往往会严重下降。为了解决上述问题,本文提出了一种用于提高跟踪性能的鲁棒性立体变压器网络。我们的方法采用混合注意机制,由通道特征感知网络(CFAN)、全局通道注意网络(GCAN)和多级特征增强单元(MFEU)组成。具体来说,CFAN 专注于特定的通道信息,同时突出所包含的目标特征,弱化语义干扰特征。作为中间枢纽,GCAN 主要负责建立搜索区域与模板之间的全局特征依赖关系,同时选择相关的通道特征,以提高模型的区分能力。其中,MFEU 用于增强多层次特征信息,以促进我们方法的特征表示学习。最后,我们提出了一种基于变换器的连体跟踪器(命名为 VTST),它是一种高效的跟踪表示,可以在各种具有挑战性的属性中获得优势。实验表明,我们的方法在多个基准测试中都优于最先进的跟踪器,实时运行速度达到 56.0 fps。
{"title":"VTST: Efficient Visual Tracking With a Stereoscopic Transformer","authors":"Fengwei Gu;Jun Lu;Chengtao Cai;Qidan Zhu;Zhaojie Ju","doi":"10.1109/TETCI.2024.3360303","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3360303","url":null,"abstract":"Although Siamese trackers have become increasingly prevalent in the visual tracking domain, they are easily interfered by semantic distractors in complex environments, which results in the underutilization of feature information. Especially when multiple disturbances work together, the performance of many trackers often suffers severe degradation. To solve the above problem, this paper presents a robust Stereoscopic Transformer network for improving tracking performance. Using a hybrid attention mechanism, our method is composed of a channel feature awareness network (CFAN), a global channel attention network (GCAN), and a multi-level feature enhancement unit (MFEU). Concretely, CFAN focuses on specific channel information, while highlighting the contained target features and weakening the semantic distractor features. As an intermediate hub, GCAN is mainly responsible for establishing the global feature dependencies between the search region and the template, while selecting the concerned channel features to improve the distinguishing ability of the model. In particular, MFEU is used to enhance multi-level feature information to facilitate feature representation learning for our method. Finally, a Transformer-based Siamese tracker (named VTST) is proposed to present an efficient tracking representation, which can gain advantages over a variety of challenging attributes. Experiments show that our method outperforms the state-of-the-art trackers on multiple benchmarks with a real-time running speed of 56.0 fps.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141094880","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DUNet: Dual U-Net Architecture for Ocean Eddies Detection and Tracking DUNet:用于海洋涡流探测和跟踪的双 U-Net 架构
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-12 DOI: 10.1109/TETCI.2024.3359099
Shaik John Saida;Samit Ari
The accurate and consistent detection of ocean eddies significantly improves the monitoring of ocean surface dynamics and the identification of regional hydrographic and biological characteristics. The study of marine ecosystems and climate change requires an understanding of ocean eddies. Data from multi-satellite altimeters, which track sea surface height, are used in eddy detection. Altimeter measurements provide an accurate representation of the sea surface height. The existing deep learning-based eddy detection approaches suffer from high model and computational complexity. The fact that there are eddies of different diameters makes eddy identification more challenging. In this paper, the detection of ocean eddies using a dual encoder and decoder architecture is proposed to address these inadequacies. An attention mechanism is developed to comprehend the pixel-level context of the semantic segmentation. A series connection of separable convolutions is proposed to adequately describe the context of multi-scale fusion. Further, the tracking of eddies is also proposed using a novel tracking method. The experimental outcomes demonstrate that the proposed approach achieved mean intersection of union score, F-beta score, and mean pixel accuracy of 89.98 %, 94.47%, 95.13% and 89.66%, 94.54%, 95.51% on the Southern Atlantic Ocean and the South China Sea datasets.
对海洋漩涡进行准确和持续的探测,可极大地改善对海洋表面动态的监测以及对区域水文和生物特征的识别。研究海洋生态系统和气候变化需要了解海洋漩涡。多卫星高度计跟踪海面高度,其数据可用于漩涡探测。高度计的测量结果能准确地反映海面高度。现有的基于深度学习的漩涡探测方法存在模型和计算复杂度高的问题。不同直径的漩涡使得漩涡识别更具挑战性。本文提出使用双编码器和解码器架构检测海洋涡流,以解决这些不足。本文开发了一种注意力机制,用于理解像素级的语义分割上下文。提出了可分离卷积的系列连接,以充分描述多尺度融合的背景。此外,还提出使用一种新颖的跟踪方法来跟踪涡流。实验结果表明,所提出的方法在南大西洋和中国南海数据集上实现了平均交叉联合得分、F-beta得分和平均像素准确率,分别为 89.98%、94.47%、95.13% 和 89.66%、94.54%、95.51%。
{"title":"DUNet: Dual U-Net Architecture for Ocean Eddies Detection and Tracking","authors":"Shaik John Saida;Samit Ari","doi":"10.1109/TETCI.2024.3359099","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3359099","url":null,"abstract":"The accurate and consistent detection of ocean eddies significantly improves the monitoring of ocean surface dynamics and the identification of regional hydrographic and biological characteristics. The study of marine ecosystems and climate change requires an understanding of ocean eddies. Data from multi-satellite altimeters, which track sea surface height, are used in eddy detection. Altimeter measurements provide an accurate representation of the sea surface height. The existing deep learning-based eddy detection approaches suffer from high model and computational complexity. The fact that there are eddies of different diameters makes eddy identification more challenging. In this paper, the detection of ocean eddies using a dual encoder and decoder architecture is proposed to address these inadequacies. An attention mechanism is developed to comprehend the pixel-level context of the semantic segmentation. A series connection of separable convolutions is proposed to adequately describe the context of multi-scale fusion. Further, the tracking of eddies is also proposed using a novel tracking method. The experimental outcomes demonstrate that the proposed approach achieved mean intersection of union score, F-beta score, and mean pixel accuracy of 89.98 %, 94.47%, 95.13% and 89.66%, 94.54%, 95.51% on the Southern Atlantic Ocean and the South China Sea datasets.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140310223","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Variational Inference Network for Single Image Reflection Removal 用于去除单幅图像反射的深度变量推理网络
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-12 DOI: 10.1109/TETCI.2024.3359063
Ya-Nan Zhang;Qiufu Li;Linlin Shen;Ailian He;Song Wu
Reflection removal from an image with undesirable reflections is a challenging and ill-posed problem in low-level vision. In recent years, several deep learning approaches have been proposed to tackle the task of single image reflection removal (SIRR). These methods, however, do not fully utilize the fundamental image priors of reflection and lack interpretability. In this paper, we propose a deep variational inference reflection removal (VIRR) method for the SIRR problem, which has good interpretability and good generalization ability. Based on the proposed VIRR method, the posterior distributions of the latent transmission and reflection images can be estimated jointly through variational inference, using deep neural networks. Furthermore, the proposed network framework can be trained by the supervision of data-driven priors for the transmission image and reflection image, which is produced by the variational lower bound objective of marginal data likelihood. Our proposed method outperforms previous state-of-the-art approaches on four benchmark datasets, as demonstrated by extensive subjective and objective evaluations.
从有不良反射的图像中去除反射是低级视觉中一个具有挑战性且难以解决的问题。近年来,人们提出了几种深度学习方法来解决单幅图像反射去除(SIRR)任务。然而,这些方法没有充分利用反射的基本图像前验,缺乏可解释性。本文针对 SIRR 问题提出了一种深度变分推理反射去除(VIRR)方法,该方法具有良好的可解释性和泛化能力。基于所提出的 VIRR 方法,可以利用深度神经网络,通过变分推理联合估计潜在传输图像和反射图像的后验分布。此外,所提出的网络框架可以在数据驱动的传输图像和反射图像前验的监督下进行训练,而数据驱动的前验是由边际数据似然的变分下界目标产生的。通过广泛的主观和客观评估,我们提出的方法在四个基准数据集上的表现优于之前最先进的方法。
{"title":"Deep Variational Inference Network for Single Image Reflection Removal","authors":"Ya-Nan Zhang;Qiufu Li;Linlin Shen;Ailian He;Song Wu","doi":"10.1109/TETCI.2024.3359063","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3359063","url":null,"abstract":"Reflection removal from an image with undesirable reflections is a challenging and ill-posed problem in low-level vision. In recent years, several deep learning approaches have been proposed to tackle the task of single image reflection removal (SIRR). These methods, however, do not fully utilize the fundamental image priors of reflection and lack interpretability. In this paper, we propose a deep variational inference reflection removal (VIRR) method for the SIRR problem, which has good interpretability and good generalization ability. Based on the proposed VIRR method, the posterior distributions of the latent transmission and reflection images can be estimated jointly through variational inference, using deep neural networks. Furthermore, the proposed network framework can be trained by the supervision of data-driven priors for the transmission image and reflection image, which is produced by the variational lower bound objective of marginal data likelihood. Our proposed method outperforms previous state-of-the-art approaches on four benchmark datasets, as demonstrated by extensive subjective and objective evaluations.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140309998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Design and Analysis of Reciprocal Zhang Neuronet Handling Temporally-Variant Linear Matrix-Vector Equations Applied to Mobile Localization 应用于移动定位的处理时变线性矩阵-矢量方程的互张神经元网络的设计与分析
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-12 DOI: 10.1109/TETCI.2024.3359512
Jielong Chen;Yan Pan;Shuai Li;Yunong Zhang
Linear matrix-vector equations (LMVE) problem is widely encountered in science and engineering. Numerous methods have been proposed and studied to solve static (i.e., temporally-invariant) LMVE problem. However, many practical LMVE problems are temporally-variant. The static methods are not efficient and accurate enough. Originated from the research of Hopfield neuronet (HN), Zhang neuronet (ZN) is widely used to solve temporally-variant problems, but the traditional continuous ZN (TCZN) model needs to compute the inverse or pseudoinverse of the coefficient matrix, being less efficient. In this paper, a novel reciprocal ZN (RZN) model that does not need to compute the inverse or pseudoinverse of the coefficient matrix is proposed, and the detailed derivation procedure is first given. In addition, theoretical analyses show the global convergence performance of the RZN model. Moreover, the comparative numerical experiments with gradient neuronet (GN) model and TCZN model show the correctness and efficiency of RZN. Finally, the application of mobile localization further validates the superiority of RZN model over TCZN and GN models.
线性矩阵-向量方程(LMVE)问题在科学和工程领域广泛存在。人们提出并研究了许多方法来解决静态(即时间不变)的 LMVE 问题。然而,许多实际的 LMVE 问题是时变的。静态方法不够高效和准确。起源于 Hopfield 神经元网络(HN)研究的张神经元网络(ZN)被广泛用于解决时变问题,但传统的连续 ZN(TCZN)模型需要计算系数矩阵的逆或伪逆,效率较低。本文提出了一种无需计算系数矩阵逆或伪逆的新型倒易 ZN(RZN)模型,并首先给出了详细的推导过程。此外,理论分析表明了 RZN 模型的全局收敛性能。此外,与梯度神经网络(GN)模型和 TCZN 模型的数值对比实验表明了 RZN 的正确性和高效性。最后,移动定位的应用进一步验证了 RZN 模型优于 TCZN 和 GN 模型。
{"title":"Design and Analysis of Reciprocal Zhang Neuronet Handling Temporally-Variant Linear Matrix-Vector Equations Applied to Mobile Localization","authors":"Jielong Chen;Yan Pan;Shuai Li;Yunong Zhang","doi":"10.1109/TETCI.2024.3359512","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3359512","url":null,"abstract":"Linear matrix-vector equations (LMVE) problem is widely encountered in science and engineering. Numerous methods have been proposed and studied to solve static (i.e., temporally-invariant) LMVE problem. However, many practical LMVE problems are temporally-variant. The static methods are not efficient and accurate enough. Originated from the research of Hopfield neuronet (HN), Zhang neuronet (ZN) is widely used to solve temporally-variant problems, but the traditional continuous ZN (TCZN) model needs to compute the inverse or pseudoinverse of the coefficient matrix, being less efficient. In this paper, a novel reciprocal ZN (RZN) model that does not need to compute the inverse or pseudoinverse of the coefficient matrix is proposed, and the detailed derivation procedure is first given. In addition, theoretical analyses show the global convergence performance of the RZN model. Moreover, the comparative numerical experiments with gradient neuronet (GN) model and TCZN model show the correctness and efficiency of RZN. Finally, the application of mobile localization further validates the superiority of RZN model over TCZN and GN models.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140321689","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hierarchical Multivariate Representation Learning for Face Sketch Recognition 人脸素描识别的分层多元表征学习
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-12 DOI: 10.1109/TETCI.2024.3359090
Jiahao Zheng;Yu Tang;Anthony Huang;Dapeng Wu
Face Sketch Recognition (FSR) is extremely challenging because of the heterogeneous gap between sketches and images. Relying on the ability to generative models, prior generation-based works have dominated FSR for a long time by decomposing FSR into two steps, namely, heterogeneous data synthesis and homogeneous data matching. However, decomposing FSR into two steps introduces noise and uncertainty, and the first step, heterogeneous data synthesis, is an even general and challenging problem. Solving a specific problem requires solving a more general one is to put the cart before the horse. In order to solve FSR smoothly and circumvent the above problems of generation-based methods, we propose a multi-view representation learning (MRL) framework based on Multivariate Loss and Hierarchical Loss (MvHi). Specifically, by using triplet loss as a bridge to connect the augmented representations generated by InfoNCE, we propose Multivariate Loss (Mv) to construct a more robust common feature subspace between sketches and images and directly solve FSR in this subspace. Moreover, Hierarchical Loss (Hi) is proposed to improve the training stability by utilizing the hidden states of the feature extractor. Comprehensive experiments on two commonly used datasets, CUFS and CUFSF, show that the proposed approach outperforms state-of-the-art methods by more than 7%. In addition, visualization experiments show that the proposed approach can extract the common representations among multi-view data compared to the baseline methods.
人脸草图识别(FSR)是一项极具挑战性的工作,因为草图与图像之间存在异质差距。依靠生成模型的能力,之前基于生成的工作将人脸草图识别分解为两个步骤,即异质数据合成和同质数据匹配,从而在很长一段时间内主导了人脸草图识别。然而,将 FSR 分解为两个步骤会带来噪声和不确定性,而第一步,即异构数据合成,更是一个具有挑战性的通用问题。解决一个具体问题需要解决一个更普遍的问题,这是本末倒置。为了顺利解决 FSR 问题,规避基于生成的方法存在的上述问题,我们提出了一种基于多变量损失和层次损失(MvHi)的多视图表示学习(MRL)框架。具体来说,通过使用三重损失(triplet loss)作为连接 InfoNCE 生成的增强表示的桥梁,我们提出了多变量损失(Multivariate Loss,Mv)来构建草图和图像之间更稳健的共同特征子空间,并直接解决该子空间中的 FSR 问题。此外,我们还提出了层次损失法(Hi),通过利用特征提取器的隐藏状态来提高训练的稳定性。在两个常用数据集 CUFS 和 CUFSF 上进行的综合实验表明,所提出的方法比最先进的方法优越 7% 以上。此外,可视化实验表明,与基线方法相比,所提出的方法可以提取多视角数据的共同表征。
{"title":"Hierarchical Multivariate Representation Learning for Face Sketch Recognition","authors":"Jiahao Zheng;Yu Tang;Anthony Huang;Dapeng Wu","doi":"10.1109/TETCI.2024.3359090","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3359090","url":null,"abstract":"Face Sketch Recognition (FSR) is extremely challenging because of the heterogeneous gap between sketches and images. Relying on the ability to generative models, prior generation-based works have dominated FSR for a long time by decomposing FSR into two steps, namely, heterogeneous data synthesis and homogeneous data matching. However, decomposing FSR into two steps introduces noise and uncertainty, and the first step, heterogeneous data synthesis, is an even general and challenging problem. Solving a specific problem requires solving a more general one is to put the cart before the horse. In order to solve FSR smoothly and circumvent the above problems of generation-based methods, we propose a multi-view representation learning (MRL) framework based on Multivariate Loss and Hierarchical Loss (MvHi). Specifically, by using triplet loss as a bridge to connect the augmented representations generated by InfoNCE, we propose Multivariate Loss (Mv) to construct a more robust common feature subspace between sketches and images and directly solve FSR in this subspace. Moreover, Hierarchical Loss (Hi) is proposed to improve the training stability by utilizing the hidden states of the feature extractor. Comprehensive experiments on two commonly used datasets, CUFS and CUFSF, show that the proposed approach outperforms state-of-the-art methods by more than 7%. In addition, visualization experiments show that the proposed approach can extract the common representations among multi-view data compared to the baseline methods.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140321737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fuzzy Ranking-Based Preference Completion via Graph Pattern Matching and Rematching 通过图模式匹配和重匹配实现基于模糊排序的偏好补全
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-12 DOI: 10.1109/TETCI.2024.3359096
Lei Li;Pan Liu;Chenyang Bu;Zan Zhang;Xindong Wu
As an emerging topic on preference learning, aiming at deducting the linear order of alternatives from the partial ranking, preference completion is to complete the preference of the target agent to form a linear order from the preferences of other agents under certain complex requirements. In order to improve the effectiveness and efficiency of preference completion in Big Data environments, firstly the preference graph is introduced to represent the collective preference of the agents over the alternatives with a certain consensus algorithm following the preference of the target agent. This preference graph can preserve rich information between agents. In addition, with the introduction of fuzzy ranking, it can illustrate the fuzziness of the target agent that can include several ranking options of the target agent over alternatives. Then, the satisfied preference can be matched from the preference graph with the fuzzy ranking requested by the target agent via isomorphism-based graph pattern matching. With the matched preference, the preference of the target agent can be completed. If the completed preference is not satisfied, the target agent can modify the fuzzy ranking, process the graph pattern rematching and complete the preference again. The experimental results show that with several real datasets the effectiveness and efficiency of the fuzzy ranking-based preference completion via graph pattern matching can be validated.
作为偏好学习的一个新兴课题,偏好补全旨在从部分排序中演绎出备选方案的线性顺序,是在一定的复杂要求下,将目标代理的偏好补全,从而从其他代理的偏好中形成线性顺序。为了提高大数据环境下偏好补全的效果和效率,首先引入偏好图来表示代理对备选方案的集体偏好,并按照目标代理的偏好采用一定的共识算法。这种偏好图可以保留代理之间的丰富信息。此外,由于引入了模糊排序,它可以说明目标代理的模糊性,可以包含目标代理对备选方案的多个排序选项。然后,通过基于同构的图模式匹配,可将偏好图中的满意偏好与目标代理要求的模糊排序进行匹配。有了匹配的偏好,目标代理的偏好就可以完成。如果完成的偏好不满意,目标代理可以修改模糊排序,进行图模式重匹配,并再次完成偏好。实验结果表明,在多个真实数据集上,通过图模式匹配完成基于模糊排序的偏好的有效性和效率得到了验证。
{"title":"Fuzzy Ranking-Based Preference Completion via Graph Pattern Matching and Rematching","authors":"Lei Li;Pan Liu;Chenyang Bu;Zan Zhang;Xindong Wu","doi":"10.1109/TETCI.2024.3359096","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3359096","url":null,"abstract":"As an emerging topic on preference learning, aiming at deducting the linear order of alternatives from the partial ranking, preference completion is to complete the preference of the target agent to form a linear order from the preferences of other agents under certain complex requirements. In order to improve the effectiveness and efficiency of preference completion in Big Data environments, firstly the preference graph is introduced to represent the collective preference of the agents over the alternatives with a certain consensus algorithm following the preference of the target agent. This preference graph can preserve rich information between agents. In addition, with the introduction of fuzzy ranking, it can illustrate the fuzziness of the target agent that can include several ranking options of the target agent over alternatives. Then, the satisfied preference can be matched from the preference graph with the fuzzy ranking requested by the target agent via isomorphism-based graph pattern matching. With the matched preference, the preference of the target agent can be completed. If the completed preference is not satisfied, the target agent can modify the fuzzy ranking, process the graph pattern rematching and complete the preference again. The experimental results show that with several real datasets the effectiveness and efficiency of the fuzzy ranking-based preference completion via graph pattern matching can be validated.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140310137","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Sparse Hyperspectral Unmixing With Preference-Based Evolutionary Multiobjective Multitasking Optimization 基于偏好的多目标进化多任务优化的稀疏高光谱解混技术
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-12 DOI: 10.1109/TETCI.2024.3359070
Hao Li;Dezhong Li;Maoguo Gong;Jianzhao Li;A. K. Qin;Lining Xing;Fei Xie
The traditional sparse unmixing methods based on multiobjective evolutionary algorithms (MOEAs) only deal with a single mixed pixel, without considering the spatial structure relationship between different mixed pixels. In addition, these methods suffer from the curse of dimensionality caused by the large number of pixels in hyperspectral image and spectra in library. In this paper, an evolutionary multitasking unmixing based on weakly nondominated sorting (EMTU-WNS) algorithm is proposed to alleviate these existing issues. First, a hyperspectral image is classified into multiple homogeneous regions, and the unmixing of pixels in the same region is constructed as a multiobjective optimization task. Then all the tasks are optimized simultaneously by using a population in the design of genetic transfer of intra-task and inter-task. In comparison with the original unmixing task with all pixels, these tasks in multiple homogeneous regions are relatively simple in term of dimensionality. Furthermore, it is inefficient for individuals to explore the whole search space. Therefore sparsity-constrained genetic operators are designed to evolve individuals towards the preference sparsity region. Finally, a preference-based weakly nondominated sorting is proposed to increase the number of nondominated solutions and maintain the diversity. The experimental results on three hyperspectral data sets demonstrate the effectiveness of EMTU-WNS with better convergence characteristics and unmixing accuracy.
传统的基于多目标进化算法(MOEAs)的稀疏解混合方法只处理单个混合像素,而不考虑不同混合像素之间的空间结构关系。此外,这些方法还受到高光谱图像中大量像素和库中光谱所带来的维度诅咒的困扰。本文提出了一种基于弱非支配排序的进化多任务解混合算法(EMTU-WNS)来缓解这些现有问题。首先,将高光谱图像划分为多个同质区域,并将同一区域内像素的解混合构建为多目标优化任务。然后,通过设计任务内和任务间遗传转移的种群,同时优化所有任务。与原始的所有像素的解混合任务相比,多个同质区域的这些任务在维度上相对简单。此外,个体探索整个搜索空间的效率很低。因此,设计了稀疏性约束遗传算子,使个体向偏好稀疏性区域进化。最后,提出了一种基于偏好的弱非支配排序法,以增加非支配解的数量并保持多样性。在三个高光谱数据集上的实验结果表明,EMTU-WNS 具有更好的收敛特性和解混合精度。
{"title":"Sparse Hyperspectral Unmixing With Preference-Based Evolutionary Multiobjective Multitasking Optimization","authors":"Hao Li;Dezhong Li;Maoguo Gong;Jianzhao Li;A. K. Qin;Lining Xing;Fei Xie","doi":"10.1109/TETCI.2024.3359070","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3359070","url":null,"abstract":"The traditional sparse unmixing methods based on multiobjective evolutionary algorithms (MOEAs) only deal with a single mixed pixel, without considering the spatial structure relationship between different mixed pixels. In addition, these methods suffer from the curse of dimensionality caused by the large number of pixels in hyperspectral image and spectra in library. In this paper, an evolutionary multitasking unmixing based on weakly nondominated sorting (EMTU-WNS) algorithm is proposed to alleviate these existing issues. First, a hyperspectral image is classified into multiple homogeneous regions, and the unmixing of pixels in the same region is constructed as a multiobjective optimization task. Then all the tasks are optimized simultaneously by using a population in the design of genetic transfer of intra-task and inter-task. In comparison with the original unmixing task with all pixels, these tasks in multiple homogeneous regions are relatively simple in term of dimensionality. Furthermore, it is inefficient for individuals to explore the whole search space. Therefore sparsity-constrained genetic operators are designed to evolve individuals towards the preference sparsity region. Finally, a preference-based weakly nondominated sorting is proposed to increase the number of nondominated solutions and maintain the diversity. The experimental results on three hyperspectral data sets demonstrate the effectiveness of EMTU-WNS with better convergence characteristics and unmixing accuracy.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140310167","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Neural Network-Based Optimal Fault-Tolerant Control for Interconnected Nonlinear Systems With Actuator Failures 基于神经网络的执行器故障互联非线性系统最佳容错控制
IF 5.3 3区 计算机科学 Q1 Mathematics Pub Date : 2024-02-09 DOI: 10.1109/TETCI.2024.3358981
Yujia Wang;Tong Wang;Chuang Li;Jiae Yang
In this study, we present a decentralized optimal fault-tolerant control (FTC) framework using neural networks (NNs) for interconnected nonlinear systems. This approach addresses challenges arising from unknown drift functions, interconnections, and multiple faults, including lock-in-place, loss of effectiveness, and float. Specifically, we propose a novel NN-based approximation scheme that utilizes a learning algorithm and a differentiator to estimate unknown information within the system. Additionally, our developed optimal control framework, in contrast to the conventional adaptive dynamic programming (ADP) approach, eliminates the need to separately design the optimal tracking controller into two parts, i.e., the steady-state controller and the feedback controller. Moreover, in the simulation section, control parameters are designed using the presented search algorithm, which demonstrates advantages in terms of both time efficiency and convenience. Finally, comparative simulations are conducted to illustrate the effectiveness of the proposed decentralized optimal fault-tolerant tracking control strategy.
在本研究中,我们针对互连非线性系统提出了一种使用神经网络(NN)的分散优化容错控制(FTC)框架。这种方法可以解决未知漂移函数、互连和多重故障(包括锁定、失效和浮动)带来的挑战。具体来说,我们提出了一种新颖的基于 NN 的近似方案,利用学习算法和微分器来估计系统内的未知信息。此外,与传统的自适应动态编程(ADP)方法相比,我们开发的最优控制框架无需将最优跟踪控制器分为稳态控制器和反馈控制器两部分进行设计。此外,在仿真部分,利用所介绍的搜索算法设计了控制参数,该算法在时间效率和便利性方面都具有优势。最后,通过对比仿真说明了所提出的分散式最优容错跟踪控制策略的有效性。
{"title":"Neural Network-Based Optimal Fault-Tolerant Control for Interconnected Nonlinear Systems With Actuator Failures","authors":"Yujia Wang;Tong Wang;Chuang Li;Jiae Yang","doi":"10.1109/TETCI.2024.3358981","DOIUrl":"https://doi.org/10.1109/TETCI.2024.3358981","url":null,"abstract":"In this study, we present a decentralized optimal fault-tolerant control (FTC) framework using neural networks (NNs) for interconnected nonlinear systems. This approach addresses challenges arising from unknown drift functions, interconnections, and multiple faults, including lock-in-place, loss of effectiveness, and float. Specifically, we propose a novel NN-based approximation scheme that utilizes a learning algorithm and a differentiator to estimate unknown information within the system. Additionally, our developed optimal control framework, in contrast to the conventional adaptive dynamic programming (ADP) approach, eliminates the need to separately design the optimal tracking controller into two parts, i.e., the steady-state controller and the feedback controller. Moreover, in the simulation section, control parameters are designed using the presented search algorithm, which demonstrates advantages in terms of both time efficiency and convenience. Finally, comparative simulations are conducted to illustrate the effectiveness of the proposed decentralized optimal fault-tolerant tracking control strategy.","PeriodicalId":13135,"journal":{"name":"IEEE Transactions on Emerging Topics in Computational Intelligence","volume":null,"pages":null},"PeriodicalIF":5.3,"publicationDate":"2024-02-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140310082","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IEEE Transactions on Emerging Topics in Computational Intelligence
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1