一种基于拉普拉斯平滑的投影降噪算法

Guanghua Zhao, Tao Yang, Dongmei Fu
{"title":"一种基于拉普拉斯平滑的投影降噪算法","authors":"Guanghua Zhao, Tao Yang, Dongmei Fu","doi":"10.1109/ICCSMT54525.2021.00051","DOIUrl":null,"url":null,"abstract":"In order to avoid the curse of dimensionality, which is often encountered in big data analysis, manifold learning assumes that high-dimensional data is embedded in a low-dimensional smooth manifold. However, in practical applications, the data sets often contain inevitable noise, and the manifold learning algorithm itself is often sensitive to noise. Therefore, in order to reduce the interference of noise to the manifold learning algorithm, we propose a new projective noise reduction algorithm based on Laplacian smoothing. The main idea of this algorithm is to perform Laplacian smoothing on a data set before projection of the sample points, so that the data set can present expected manifold structure, which solves the problem that the sample points are too scattered and deviated from the main manifold well. In avoid of the over-smoothing problem caused by Laplacian smoothing algorithm, we propose to control the number of iterations based on the variance reduction. The experimental results show that the proposed algorithm can reduce the noise as well as maintain the manifold structure, and the noise reduction effect is superior to the traditional noise reduction algorithm.","PeriodicalId":304337,"journal":{"name":"2021 2nd International Conference on Computer Science and Management Technology (ICCSMT)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Projective Noise Reduction Algorithm Based on Laplacian Smoothing\",\"authors\":\"Guanghua Zhao, Tao Yang, Dongmei Fu\",\"doi\":\"10.1109/ICCSMT54525.2021.00051\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In order to avoid the curse of dimensionality, which is often encountered in big data analysis, manifold learning assumes that high-dimensional data is embedded in a low-dimensional smooth manifold. However, in practical applications, the data sets often contain inevitable noise, and the manifold learning algorithm itself is often sensitive to noise. Therefore, in order to reduce the interference of noise to the manifold learning algorithm, we propose a new projective noise reduction algorithm based on Laplacian smoothing. The main idea of this algorithm is to perform Laplacian smoothing on a data set before projection of the sample points, so that the data set can present expected manifold structure, which solves the problem that the sample points are too scattered and deviated from the main manifold well. In avoid of the over-smoothing problem caused by Laplacian smoothing algorithm, we propose to control the number of iterations based on the variance reduction. The experimental results show that the proposed algorithm can reduce the noise as well as maintain the manifold structure, and the noise reduction effect is superior to the traditional noise reduction algorithm.\",\"PeriodicalId\":304337,\"journal\":{\"name\":\"2021 2nd International Conference on Computer Science and Management Technology (ICCSMT)\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 2nd International Conference on Computer Science and Management Technology (ICCSMT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCSMT54525.2021.00051\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 2nd International Conference on Computer Science and Management Technology (ICCSMT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCSMT54525.2021.00051","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

为了避免在大数据分析中经常遇到的维数诅咒,流形学习假设高维数据嵌入在低维光滑流形中。然而,在实际应用中,数据集往往包含不可避免的噪声,而流形学习算法本身往往对噪声敏感。因此,为了减少噪声对流形学习算法的干扰,我们提出了一种新的基于拉普拉斯平滑的投影降噪算法。该算法的主要思想是在样本点投影前对数据集进行拉普拉斯平滑处理,使数据集呈现出预期的流形结构,很好地解决了样本点过于分散和偏离主流形的问题。为了避免拉普拉斯平滑算法造成的过度平滑问题,我们提出了基于方差缩减的迭代次数控制方法。实验结果表明,该算法能够在保持流形结构的同时降低噪声,降噪效果优于传统的降噪算法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A Projective Noise Reduction Algorithm Based on Laplacian Smoothing
In order to avoid the curse of dimensionality, which is often encountered in big data analysis, manifold learning assumes that high-dimensional data is embedded in a low-dimensional smooth manifold. However, in practical applications, the data sets often contain inevitable noise, and the manifold learning algorithm itself is often sensitive to noise. Therefore, in order to reduce the interference of noise to the manifold learning algorithm, we propose a new projective noise reduction algorithm based on Laplacian smoothing. The main idea of this algorithm is to perform Laplacian smoothing on a data set before projection of the sample points, so that the data set can present expected manifold structure, which solves the problem that the sample points are too scattered and deviated from the main manifold well. In avoid of the over-smoothing problem caused by Laplacian smoothing algorithm, we propose to control the number of iterations based on the variance reduction. The experimental results show that the proposed algorithm can reduce the noise as well as maintain the manifold structure, and the noise reduction effect is superior to the traditional noise reduction algorithm.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Research on the evaluation of innovation ability of high-tech industry from the perspective of integrated development of Yangtze River Delta Based on Entropy Weight-TOPSIS Method Foreign matter detection of coal conveying belt based on machine vision Research on Performance Evaluation of Fiscal Expenditure Efficiency in Old Industrial Cities Detection of Cassava Leaf Diseases Using Self-supervised Learning Research on the Innovation of Online Recruitment mode of small and medium-sized enterprises - Statistical analysis based on recruitment information
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1