基于微服务和Spark Streaming的多租户车辆监控架构设计与实现

Chen Chen, Jianjun Cai, N. Ren, Xu Cheng
{"title":"基于微服务和Spark Streaming的多租户车辆监控架构设计与实现","authors":"Chen Chen, Jianjun Cai, N. Ren, Xu Cheng","doi":"10.1109/CISCE50729.2020.00040","DOIUrl":null,"url":null,"abstract":"Aiming at reducing the costs for customers and making full use of software and hardware resources, this article propose a vehicle monitoring cloud architecture for multi-tenant in this paper which could provide customers with rent-and-use cloud services. This architecture is based on the springcloud microservice framework, any microservice module could be packaged into docker images and managed by kubernetes. When the system concurrency increases or decreases, the container can be dynamically expanded and recycled to rationally allocate hardware resources to solve the bottleneck of service access load. This architecture also recommends kafka message queues to decouple front-end data collection components and back-end data processing components that could achieve greater throughput. The MapReduce programming model is used to group chaotic data sent by all tenants’ vehicle terminal by tenant id, and statistical analysis is performed on the data of each tenant.","PeriodicalId":101777,"journal":{"name":"2020 International Conference on Communications, Information System and Computer Engineering (CISCE)","volume":"27 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Design and Implementation of Multi-tenant Vehicle Monitoring Architecture Based on Microservices and Spark Streaming\",\"authors\":\"Chen Chen, Jianjun Cai, N. Ren, Xu Cheng\",\"doi\":\"10.1109/CISCE50729.2020.00040\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aiming at reducing the costs for customers and making full use of software and hardware resources, this article propose a vehicle monitoring cloud architecture for multi-tenant in this paper which could provide customers with rent-and-use cloud services. This architecture is based on the springcloud microservice framework, any microservice module could be packaged into docker images and managed by kubernetes. When the system concurrency increases or decreases, the container can be dynamically expanded and recycled to rationally allocate hardware resources to solve the bottleneck of service access load. This architecture also recommends kafka message queues to decouple front-end data collection components and back-end data processing components that could achieve greater throughput. The MapReduce programming model is used to group chaotic data sent by all tenants’ vehicle terminal by tenant id, and statistical analysis is performed on the data of each tenant.\",\"PeriodicalId\":101777,\"journal\":{\"name\":\"2020 International Conference on Communications, Information System and Computer Engineering (CISCE)\",\"volume\":\"27 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 International Conference on Communications, Information System and Computer Engineering (CISCE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CISCE50729.2020.00040\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 International Conference on Communications, Information System and Computer Engineering (CISCE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CISCE50729.2020.00040","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

为了降低客户成本,充分利用软硬件资源,本文提出了一种多租户车辆监控云架构,为客户提供租赁使用的云服务。该架构基于springcloud微服务框架,任何微服务模块都可以打包成docker镜像并由kubernetes管理。当系统并发增加或减少时,可以动态扩展和回收容器,合理分配硬件资源,解决业务访问负载瓶颈。该架构还推荐kafka消息队列来解耦前端数据收集组件和后端数据处理组件,从而实现更高的吞吐量。使用MapReduce编程模型,将所有租户车载终端发送的混沌数据按租户id进行分组,并对每个租户的数据进行统计分析。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Design and Implementation of Multi-tenant Vehicle Monitoring Architecture Based on Microservices and Spark Streaming
Aiming at reducing the costs for customers and making full use of software and hardware resources, this article propose a vehicle monitoring cloud architecture for multi-tenant in this paper which could provide customers with rent-and-use cloud services. This architecture is based on the springcloud microservice framework, any microservice module could be packaged into docker images and managed by kubernetes. When the system concurrency increases or decreases, the container can be dynamically expanded and recycled to rationally allocate hardware resources to solve the bottleneck of service access load. This architecture also recommends kafka message queues to decouple front-end data collection components and back-end data processing components that could achieve greater throughput. The MapReduce programming model is used to group chaotic data sent by all tenants’ vehicle terminal by tenant id, and statistical analysis is performed on the data of each tenant.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Health Management for Next-gen Blockchain: Smart Construction, Dynamic Evolution and Stochastic Transformation A Survey on GAT-like Graph Neural Networks Semantic-based early warning system for equipment maintenance Intelligent Management Strategy of Power Wireless Heterogeneous Network Link Based on Traffic Balance Improvement of information System Audit to Deal With Network Information Security
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1