Enhancing CluStream Algorithm for Clustering Big Data Streaming over Sliding Window

D. Sayed, S. Rady, M. Aref
{"title":"Enhancing CluStream Algorithm for Clustering Big Data Streaming over Sliding Window","authors":"D. Sayed, S. Rady, M. Aref","doi":"10.1109/ICEENG45378.2020.9171705","DOIUrl":null,"url":null,"abstract":"Data stream mining becomes a hot research issue in the ongoing time. The main challenge in data stream mining is the knowledge extraction in real-time from an immense, data stream in only one scan. Data stream clustering demonstrates an significant task in data stream processing. This paper introduces SCluStream an algorithm for determining clusters over a sliding window to manage such challenges. The algorithm is an improvement over CluStream which does not involve this sliding window concept. In the sliding window model, only the most recent data is utilized while the old data is eliminated, which allows for faster execution. A better clustering technique is also involved which managed to contribute to accuracy improvement. The proposed algorithm has been tested on two real datasets; charitable donation data set and forest cover type data set. The results showed that comparing SCluStream to CluStream has proven that the former algorithm is more efficient for clustering big data streams in regard to the accuracy as well as the utilized time and memory usages.","PeriodicalId":346636,"journal":{"name":"2020 12th International Conference on Electrical Engineering (ICEENG)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 12th International Conference on Electrical Engineering (ICEENG)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICEENG45378.2020.9171705","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

Abstract

Data stream mining becomes a hot research issue in the ongoing time. The main challenge in data stream mining is the knowledge extraction in real-time from an immense, data stream in only one scan. Data stream clustering demonstrates an significant task in data stream processing. This paper introduces SCluStream an algorithm for determining clusters over a sliding window to manage such challenges. The algorithm is an improvement over CluStream which does not involve this sliding window concept. In the sliding window model, only the most recent data is utilized while the old data is eliminated, which allows for faster execution. A better clustering technique is also involved which managed to contribute to accuracy improvement. The proposed algorithm has been tested on two real datasets; charitable donation data set and forest cover type data set. The results showed that comparing SCluStream to CluStream has proven that the former algorithm is more efficient for clustering big data streams in regard to the accuracy as well as the utilized time and memory usages.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
基于滑动窗口的大数据流聚类改进CluStream算法
数据流挖掘是当前研究的热点问题。数据流挖掘的主要挑战是如何在一次扫描中从巨大的数据流中实时提取知识。数据流聚类是数据流处理中的一项重要任务。本文介绍了scclustream算法,该算法用于在滑动窗口上确定集群以应对此类挑战。该算法是对CluStream的改进,后者不涉及滑动窗口的概念。在滑动窗口模型中,只有最近的数据被利用,而旧的数据被消除,这允许更快的执行。本文还采用了一种更好的聚类技术来提高准确率。该算法在两个真实数据集上进行了测试;慈善捐赠数据集和森林覆盖类型数据集。结果表明,将CluStream算法与CluStream算法进行比较,可以证明前者算法在准确率、使用时间和内存占用方面对大数据流的聚类效率更高。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Land Vehicle Navigation Algorithm Implementation on Cortex-M4 Embedded Processor Design and Control Strategy of PEM Fuel Cell for a Small Scale Rainwater Harvesting System Economic Dispatch of 500 kV Java-Bali Power System using Hybrid Particle Swarm-Ant Colony Optimization Method Optimally Weighted Wavelet Variance-based Estimation for Inertial Sensor Stochastic Calibration A Road Map for Optimizing Smeared-Spectrum Jamming Against Pulse Compression Radars
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1