Zhonghua Liu , Fa Zhu , Hao Xiong , Xingchi Chen , Danilo Pelusi , Athanasios V. Vasilakos
{"title":"图形正则化鉴别非负矩阵因式分解","authors":"Zhonghua Liu , Fa Zhu , Hao Xiong , Xingchi Chen , Danilo Pelusi , Athanasios V. Vasilakos","doi":"10.1016/j.engappai.2024.109629","DOIUrl":null,"url":null,"abstract":"<div><div>It is well known that both the label information and the local geometry structure information are very important for image data clustering and classification. However, nonnegative matrix factorization (NMF) and its variants do not fully utilize the information or only use one of them. This paper presents a graph regularized discriminative nonnegative matrix factorization (GDNMF) for image data clustering, in which the local geometrical structure and label information of the observed samples are thoroughly considered. In the objective function of NMF, two constraint terms are added to preserve the above information. One is a sparse graph, which is adaptively constructed to obtain the local geometrical structure information. The other is data label information, which is used to capture discriminative information of the original data. By using local and label information, the proposed regularized discriminative nonnegative matrix factorization indeed improves the discrimination power of matrix decomposition. In addition, the <em>F</em>-norm formulation based cost function of regularized discriminative nonnegative matrix factorization is given, and the update rules for the optimization function of regularized discriminative nonnegative matrix factorization are proved. The experiment results on several public image datasets demonstrate the effectiveness of GDNMF algorithm. The innovation of this paper lies in extending unsupervised NMF to semi-supervised case and adaptively capturing the local structure of data based on sparse graph. However, the proposed method does not take into account the challenges of multiview data processing.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"139 ","pages":"Article 109629"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Graph regularized discriminative nonnegative matrix factorization\",\"authors\":\"Zhonghua Liu , Fa Zhu , Hao Xiong , Xingchi Chen , Danilo Pelusi , Athanasios V. Vasilakos\",\"doi\":\"10.1016/j.engappai.2024.109629\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>It is well known that both the label information and the local geometry structure information are very important for image data clustering and classification. However, nonnegative matrix factorization (NMF) and its variants do not fully utilize the information or only use one of them. This paper presents a graph regularized discriminative nonnegative matrix factorization (GDNMF) for image data clustering, in which the local geometrical structure and label information of the observed samples are thoroughly considered. In the objective function of NMF, two constraint terms are added to preserve the above information. One is a sparse graph, which is adaptively constructed to obtain the local geometrical structure information. The other is data label information, which is used to capture discriminative information of the original data. By using local and label information, the proposed regularized discriminative nonnegative matrix factorization indeed improves the discrimination power of matrix decomposition. In addition, the <em>F</em>-norm formulation based cost function of regularized discriminative nonnegative matrix factorization is given, and the update rules for the optimization function of regularized discriminative nonnegative matrix factorization are proved. The experiment results on several public image datasets demonstrate the effectiveness of GDNMF algorithm. The innovation of this paper lies in extending unsupervised NMF to semi-supervised case and adaptively capturing the local structure of data based on sparse graph. However, the proposed method does not take into account the challenges of multiview data processing.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"139 \",\"pages\":\"Article 109629\"},\"PeriodicalIF\":7.5000,\"publicationDate\":\"2024-11-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197624017871\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197624017871","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
众所周知,标签信息和局部几何结构信息对于图像数据的聚类和分类非常重要。然而,非负矩阵因式分解(NMF)及其变体并不能充分利用这些信息,或者只能利用其中之一。本文提出了一种用于图像数据聚类的图正则化判别非负矩阵因式分解(GDNMF),其中充分考虑了观察样本的局部几何结构和标签信息。在 NMF 的目标函数中,添加了两个约束项以保留上述信息。一个是稀疏图,通过自适应构建来获取局部几何结构信息。另一个是数据标签信息,用于捕捉原始数据的判别信息。通过使用局部信息和标签信息,所提出的正则化判别非负矩阵因式分解确实提高了矩阵分解的判别能力。此外,还给出了正则化判别非负矩阵因式分解的基于 F 准则公式的代价函数,并证明了正则化判别非负矩阵因式分解优化函数的更新规则。在多个公共图像数据集上的实验结果证明了 GDNMF 算法的有效性。本文的创新之处在于将无监督 NMF 扩展到半监督情况,并基于稀疏图自适应地捕捉数据的局部结构。然而,所提出的方法并没有考虑到多视图数据处理所面临的挑战。
It is well known that both the label information and the local geometry structure information are very important for image data clustering and classification. However, nonnegative matrix factorization (NMF) and its variants do not fully utilize the information or only use one of them. This paper presents a graph regularized discriminative nonnegative matrix factorization (GDNMF) for image data clustering, in which the local geometrical structure and label information of the observed samples are thoroughly considered. In the objective function of NMF, two constraint terms are added to preserve the above information. One is a sparse graph, which is adaptively constructed to obtain the local geometrical structure information. The other is data label information, which is used to capture discriminative information of the original data. By using local and label information, the proposed regularized discriminative nonnegative matrix factorization indeed improves the discrimination power of matrix decomposition. In addition, the F-norm formulation based cost function of regularized discriminative nonnegative matrix factorization is given, and the update rules for the optimization function of regularized discriminative nonnegative matrix factorization are proved. The experiment results on several public image datasets demonstrate the effectiveness of GDNMF algorithm. The innovation of this paper lies in extending unsupervised NMF to semi-supervised case and adaptively capturing the local structure of data based on sparse graph. However, the proposed method does not take into account the challenges of multiview data processing.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.