高维数据集使用hadoop mahout机器学习算法

A. Srinivasulu, C. SubbaRao, K. Y. Jeevan
{"title":"高维数据集使用hadoop mahout机器学习算法","authors":"A. Srinivasulu, C. SubbaRao, K. Y. Jeevan","doi":"10.1109/ICCCT2.2014.7066727","DOIUrl":null,"url":null,"abstract":"Summary only from given. High dimensional data concerns large-volume, complex, growing data sets with multiple, and autonomous sources. As the Data increasing very drastically day-to-day, it is a major issue to manage and organize the data very efficiently. This emerged the necessity of machine learning techniques. With the Fast development of Networking, data storage and the data collection capacity, Machine learning cluster algorithms are now rapidly expanding in all science and engineering domains such as Pattern recognition, data mining, bioinformatics, and recommendation systems. So as to support the scalable machine learning framework with MapReduce and Hadoop support, we are using Apache Mahout to manage the High Voluminous data. Various Cluster problems such as Cluster Tendency, Partitioning, Cluster Validity, and Cluster Performance can be easily overcome by Mahout clustering algorithms. Mahout manages data in four steps i.e., fetching data, text mining, clustering, classification and collaborative filtering. In the proposed approach, various datatypes such as Numeric, Characters and Image datasets are classified in the several categories i.e., Collaborative Filtering, Clustering, Classification or Frequent Item set Mining. Some of the Pre-clustering techniques are also implemented such as EDBE, ECCE, and Extended Co-VAT. A non-Hadoop Clusternamed Taste recommendation Frame work is also implemented.","PeriodicalId":6860,"journal":{"name":"2021 RIVF International Conference on Computing and Communication Technologies (RIVF)","volume":"15 1","pages":"1-1"},"PeriodicalIF":0.0000,"publicationDate":"2014-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"7","resultStr":"{\"title\":\"High dimensional datasets using hadoop mahout machine learning algorithms\",\"authors\":\"A. Srinivasulu, C. SubbaRao, K. Y. Jeevan\",\"doi\":\"10.1109/ICCCT2.2014.7066727\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Summary only from given. High dimensional data concerns large-volume, complex, growing data sets with multiple, and autonomous sources. As the Data increasing very drastically day-to-day, it is a major issue to manage and organize the data very efficiently. This emerged the necessity of machine learning techniques. With the Fast development of Networking, data storage and the data collection capacity, Machine learning cluster algorithms are now rapidly expanding in all science and engineering domains such as Pattern recognition, data mining, bioinformatics, and recommendation systems. So as to support the scalable machine learning framework with MapReduce and Hadoop support, we are using Apache Mahout to manage the High Voluminous data. Various Cluster problems such as Cluster Tendency, Partitioning, Cluster Validity, and Cluster Performance can be easily overcome by Mahout clustering algorithms. Mahout manages data in four steps i.e., fetching data, text mining, clustering, classification and collaborative filtering. In the proposed approach, various datatypes such as Numeric, Characters and Image datasets are classified in the several categories i.e., Collaborative Filtering, Clustering, Classification or Frequent Item set Mining. Some of the Pre-clustering techniques are also implemented such as EDBE, ECCE, and Extended Co-VAT. A non-Hadoop Clusternamed Taste recommendation Frame work is also implemented.\",\"PeriodicalId\":6860,\"journal\":{\"name\":\"2021 RIVF International Conference on Computing and Communication Technologies (RIVF)\",\"volume\":\"15 1\",\"pages\":\"1-1\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2014-12-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"7\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 RIVF International Conference on Computing and Communication Technologies (RIVF)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCCT2.2014.7066727\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 RIVF International Conference on Computing and Communication Technologies (RIVF)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCCT2.2014.7066727","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 7

摘要

仅从给定的摘要。高维数据涉及具有多个自治源的大容量、复杂、不断增长的数据集。随着每天数据的急剧增长,如何有效地管理和组织数据是一个主要问题。这就产生了机器学习技术的必要性。随着网络、数据存储和数据收集能力的快速发展,机器学习聚类算法正在模式识别、数据挖掘、生物信息学和推荐系统等科学和工程领域迅速扩展。为了支持具有MapReduce和Hadoop支持的可扩展机器学习框架,我们使用Apache Mahout来管理高容量数据。Mahout聚类算法可以很容易地克服各种聚类问题,如聚类倾向、聚类划分、聚类有效性和聚类性能。Mahout管理数据分为四个步骤,即获取数据、文本挖掘、聚类、分类和协同过滤。在该方法中,各种数据类型(如数字、字符和图像数据集)被分为协同过滤、聚类、分类或频繁项集挖掘几个类别。还实现了一些预聚类技术,如EDBE、ECCE和Extended Co-VAT。还实现了一个名为Taste推荐框架的非hadoop clusterwork。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
High dimensional datasets using hadoop mahout machine learning algorithms
Summary only from given. High dimensional data concerns large-volume, complex, growing data sets with multiple, and autonomous sources. As the Data increasing very drastically day-to-day, it is a major issue to manage and organize the data very efficiently. This emerged the necessity of machine learning techniques. With the Fast development of Networking, data storage and the data collection capacity, Machine learning cluster algorithms are now rapidly expanding in all science and engineering domains such as Pattern recognition, data mining, bioinformatics, and recommendation systems. So as to support the scalable machine learning framework with MapReduce and Hadoop support, we are using Apache Mahout to manage the High Voluminous data. Various Cluster problems such as Cluster Tendency, Partitioning, Cluster Validity, and Cluster Performance can be easily overcome by Mahout clustering algorithms. Mahout manages data in four steps i.e., fetching data, text mining, clustering, classification and collaborative filtering. In the proposed approach, various datatypes such as Numeric, Characters and Image datasets are classified in the several categories i.e., Collaborative Filtering, Clustering, Classification or Frequent Item set Mining. Some of the Pre-clustering techniques are also implemented such as EDBE, ECCE, and Extended Co-VAT. A non-Hadoop Clusternamed Taste recommendation Frame work is also implemented.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
A Novel Image Watermarking Scheme Using LU Decomposition Streaming Algorithm for Submodular Cover Problem Under Noise Hand part segmentations in hand mask of egocentric images using Distance Transformation Map and SVM Classifier Multiple Imputation by Generative Adversarial Networks for Classification with Incomplete Data MC-OCR Challenge 2021: Simple approach for receipt information extraction and quality evaluation
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1