使用fp增长实现频繁项集挖掘的并行架构

Amna Tehreem, S. G. Khawaja, M. Akram, S. Khan, Muhammad G. Ali
{"title":"使用fp增长实现频繁项集挖掘的并行架构","authors":"Amna Tehreem, S. G. Khawaja, M. Akram, S. Khan, Muhammad G. Ali","doi":"10.1109/ICSIGSYS.2017.7967077","DOIUrl":null,"url":null,"abstract":"Frequent itemset mining is a fundamental step in analysis of big data where correlation among the raw data in deemed necessary. In modern era the amount of data available for processing has grown exponentially, making it a stepper task for mining algorithms to provide solution in a timely manner. The software implementations are normally not efficient in handling such datasets thus focus on parallel architecture seems imminent. In this paper we propose a Multi-Processor based sequentially unfolded architecture for implementation of FP-Growth algorithm. The proposed framework exploits the inherent parallelism available in the FP-Growth algorithm such that N-processing entities (PEs) can work in a collaborative environment. The processing entities work in an independent manner in parallel and largely interchange data at the close of each iteration. The overall architecture is modular which permits scalability of the design with regards to the number of parallel processing entities. The performance of the framework is evaluated using benchmark datasets and their results show a linear increase in the speedup of our proposed framework with increase in PEs.","PeriodicalId":212068,"journal":{"name":"2017 International Conference on Signals and Systems (ICSigSys)","volume":"26 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2017-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Parallel architecture for implementation of frequent itemset mining using FP-growth\",\"authors\":\"Amna Tehreem, S. G. Khawaja, M. Akram, S. Khan, Muhammad G. Ali\",\"doi\":\"10.1109/ICSIGSYS.2017.7967077\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Frequent itemset mining is a fundamental step in analysis of big data where correlation among the raw data in deemed necessary. In modern era the amount of data available for processing has grown exponentially, making it a stepper task for mining algorithms to provide solution in a timely manner. The software implementations are normally not efficient in handling such datasets thus focus on parallel architecture seems imminent. In this paper we propose a Multi-Processor based sequentially unfolded architecture for implementation of FP-Growth algorithm. The proposed framework exploits the inherent parallelism available in the FP-Growth algorithm such that N-processing entities (PEs) can work in a collaborative environment. The processing entities work in an independent manner in parallel and largely interchange data at the close of each iteration. The overall architecture is modular which permits scalability of the design with regards to the number of parallel processing entities. The performance of the framework is evaluated using benchmark datasets and their results show a linear increase in the speedup of our proposed framework with increase in PEs.\",\"PeriodicalId\":212068,\"journal\":{\"name\":\"2017 International Conference on Signals and Systems (ICSigSys)\",\"volume\":\"26 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2017-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2017 International Conference on Signals and Systems (ICSigSys)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSIGSYS.2017.7967077\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2017 International Conference on Signals and Systems (ICSigSys)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSIGSYS.2017.7967077","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

频繁项集挖掘是大数据分析的一个基本步骤,其中原始数据之间的相关性被认为是必要的。在当今时代,可用于处理的数据量呈指数级增长,使得挖掘算法能够及时提供解决方案成为一项艰巨的任务。软件实现通常在处理此类数据集方面效率不高,因此关注并行架构似乎迫在眉睫。本文提出了一种基于多处理器的顺序展开架构来实现FP-Growth算法。提出的框架利用FP-Growth算法中固有的并行性,使n个处理实体(pe)可以在协作环境中工作。处理实体以独立的方式并行工作,并在每次迭代结束时大量交换数据。整体架构是模块化的,这使得设计可以根据并行处理实体的数量进行扩展。使用基准数据集对框架的性能进行了评估,结果表明,随着pe的增加,我们提出的框架的加速率呈线性增长。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Parallel architecture for implementation of frequent itemset mining using FP-growth
Frequent itemset mining is a fundamental step in analysis of big data where correlation among the raw data in deemed necessary. In modern era the amount of data available for processing has grown exponentially, making it a stepper task for mining algorithms to provide solution in a timely manner. The software implementations are normally not efficient in handling such datasets thus focus on parallel architecture seems imminent. In this paper we propose a Multi-Processor based sequentially unfolded architecture for implementation of FP-Growth algorithm. The proposed framework exploits the inherent parallelism available in the FP-Growth algorithm such that N-processing entities (PEs) can work in a collaborative environment. The processing entities work in an independent manner in parallel and largely interchange data at the close of each iteration. The overall architecture is modular which permits scalability of the design with regards to the number of parallel processing entities. The performance of the framework is evaluated using benchmark datasets and their results show a linear increase in the speedup of our proposed framework with increase in PEs.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Modeling of massive MIMO transceiver antenna for full-duplex single-channel system (in case of self interference effect) The development of IoT LoRa: A performance evaluation on LoS and Non-LoS environment at 915 MHz ISM frequency On the design of LDPC-based Raptor codes for single carrier Internet of Things (SC-IoT) Benchmark data set for glaucoma detection with annotated cup to disc ratio Design of LDGM-based Raptor Codes for broadband Internet of Things using EXIT chart
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1