使用Terraform在Aws云上自动化Hadoop集群

Yadvi Bhalla, V. Hemamalini, Shashwat Mishra
{"title":"使用Terraform在Aws云上自动化Hadoop集群","authors":"Yadvi Bhalla, V. Hemamalini, Shashwat Mishra","doi":"10.1109/ICNWC57852.2023.10127568","DOIUrl":null,"url":null,"abstract":"Nowadays, companies need a lot of storage to store their data. Massive amounts of data can be stored with Hadoop. Studies show that by 2023, 90% of all Fortune 500 companies will have adopted Hadoop. However, it may take hours or even days to set up a Hadoop Cluster for storing data. When businesses manage their time well, they can consistently deliver their products and services on time. To make smart and calculated decisions, they need this data. Business forecasting is a practice that has been around for a long time, but in the past, it was often done with limited data. However, in today’s data-driven world, businesses must utilize data to make informed decisions and stay ahead of their competitors. By analyzing large amounts of data, businesses can make more accurate predictions and decisions about consumer preferences, market trends, and potential fraud activities. The insights gained from data analysis can benefit professionals across all industries, allowing them to make better decisions and improve their business outcomes.The main objective is to automate the formation of a Hadoop Cluster on AWS Cloud with the help of Terraform. The Hadoop Cluster will have the following nodes: Master Node, Slave Nodes, Client Nodes","PeriodicalId":197525,"journal":{"name":"2023 International Conference on Networking and Communications (ICNWC)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Automating Hadoop Cluster On Aws Cloud Using Terraform\",\"authors\":\"Yadvi Bhalla, V. Hemamalini, Shashwat Mishra\",\"doi\":\"10.1109/ICNWC57852.2023.10127568\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Nowadays, companies need a lot of storage to store their data. Massive amounts of data can be stored with Hadoop. Studies show that by 2023, 90% of all Fortune 500 companies will have adopted Hadoop. However, it may take hours or even days to set up a Hadoop Cluster for storing data. When businesses manage their time well, they can consistently deliver their products and services on time. To make smart and calculated decisions, they need this data. Business forecasting is a practice that has been around for a long time, but in the past, it was often done with limited data. However, in today’s data-driven world, businesses must utilize data to make informed decisions and stay ahead of their competitors. By analyzing large amounts of data, businesses can make more accurate predictions and decisions about consumer preferences, market trends, and potential fraud activities. The insights gained from data analysis can benefit professionals across all industries, allowing them to make better decisions and improve their business outcomes.The main objective is to automate the formation of a Hadoop Cluster on AWS Cloud with the help of Terraform. The Hadoop Cluster will have the following nodes: Master Node, Slave Nodes, Client Nodes\",\"PeriodicalId\":197525,\"journal\":{\"name\":\"2023 International Conference on Networking and Communications (ICNWC)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 International Conference on Networking and Communications (ICNWC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICNWC57852.2023.10127568\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 International Conference on Networking and Communications (ICNWC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICNWC57852.2023.10127568","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

如今,公司需要大量的存储空间来存储他们的数据。大量的数据可以用Hadoop存储。研究表明,到2023年,90%的财富500强企业将采用Hadoop。然而,建立一个Hadoop集群来存储数据可能需要几个小时甚至几天的时间。当企业管理好他们的时间时,他们可以始终如一地按时提供产品和服务。为了做出明智而明智的决定,他们需要这些数据。商业预测是一种已经存在很长时间的做法,但在过去,它通常是在有限的数据下完成的。然而,在当今数据驱动的世界中,企业必须利用数据做出明智的决策,并保持领先于竞争对手。通过分析大量数据,企业可以对消费者偏好、市场趋势和潜在的欺诈活动做出更准确的预测和决策。从数据分析中获得的见解可以使所有行业的专业人士受益,使他们能够做出更好的决策并改善业务成果。主要目标是在Terraform的帮助下在AWS云上自动形成Hadoop集群。Hadoop集群将有以下节点:主节点、从节点、客户节点
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Automating Hadoop Cluster On Aws Cloud Using Terraform
Nowadays, companies need a lot of storage to store their data. Massive amounts of data can be stored with Hadoop. Studies show that by 2023, 90% of all Fortune 500 companies will have adopted Hadoop. However, it may take hours or even days to set up a Hadoop Cluster for storing data. When businesses manage their time well, they can consistently deliver their products and services on time. To make smart and calculated decisions, they need this data. Business forecasting is a practice that has been around for a long time, but in the past, it was often done with limited data. However, in today’s data-driven world, businesses must utilize data to make informed decisions and stay ahead of their competitors. By analyzing large amounts of data, businesses can make more accurate predictions and decisions about consumer preferences, market trends, and potential fraud activities. The insights gained from data analysis can benefit professionals across all industries, allowing them to make better decisions and improve their business outcomes.The main objective is to automate the formation of a Hadoop Cluster on AWS Cloud with the help of Terraform. The Hadoop Cluster will have the following nodes: Master Node, Slave Nodes, Client Nodes
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
An Approach For Short Term Electricity Load Forecasting Real-time regional road sign detection and identification using Raspberry Pi ICNWC 2023 Cover Page A novel hybrid automatic intrusion detection system using machine learning technique for anomalous detection based on traffic prediction Towards Enhanced Deep CNN For Early And Precise Skin Cancer Diagnosis
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1