首页 > 最新文献

2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)最新文献

英文 中文
Autonomous Provisioning of Preemptive Instances in Google Cloud for Maximum Performance Per Dollar 在Google Cloud中自主配置先发制人的实例,以实现每美元的最大性能
H. Haugerud, J. Svensson, A. Yazidi
Cloud computing and its popularity has boomed over the last decade, enabling anyone to rent computing power on demand. Cloud providers such as Amazon and Google rent out surplus computing power for a discounted price according to demand in their data centers, but with the trade off that it is revocable and can only be rented for a short amount of time.This paper investigates the use of surplus computing power in order to reduce the cost of batch computing. We rely on a simple economical principle, the most cost-efficient Virtual Machine (VM) in a public cloud is the one that offers the highest performance per dollar. Therefore by rescheduling the workloads to the most cost-efficient location in terms of performance per dollar our solution dynamically provisions preemptible VMs in Google Cloud while continuously monitoring the performance per dollar of all available resources in every region. The algorithm automatically relocates workloads to a less expensive location if any appears and handles revoked access of the resources. Our algorithm views the cost reduction problem as a linear optimization problem with constraints and solves it using a greedy procedure. In the experiment we spawn Docker containers to mine cryptocurrency. The experimental results show that 67% of the cost is saved compared to renting on-demand VMs. The system can readily be extended to containers processing similar types of workloads and more generally to applications where the performance per dollar is easy to measure.
云计算及其普及在过去十年中蓬勃发展,使任何人都可以按需租用计算能力。像亚马逊和谷歌这样的云计算提供商根据其数据中心的需求以折扣价出租多余的计算能力,但作为交换,它是可撤销的,只能租用很短的时间。为了降低批量计算的成本,本文研究了剩余计算能力的利用。我们依靠一个简单的经济原则,公共云中最具成本效益的虚拟机(VM)是每美元提供最高性能的虚拟机。因此,通过将工作负载重新调度到最具成本效益的位置,我们的解决方案在Google Cloud中动态地提供可抢占的vm,同时持续监控每个区域中所有可用资源的每美元性能。如果出现工作负载,该算法会自动将其重新定位到成本较低的位置,并处理对资源的撤销访问。我们的算法将成本降低问题视为一个带约束的线性优化问题,并使用贪心过程求解。在实验中,我们生成Docker容器来挖掘加密货币。实验结果表明,与按需租用虚拟机相比,节省了67%的成本。该系统可以很容易地扩展到处理类似工作负载类型的容器,以及更一般地扩展到易于度量单位成本性能的应用程序。
{"title":"Autonomous Provisioning of Preemptive Instances in Google Cloud for Maximum Performance Per Dollar","authors":"H. Haugerud, J. Svensson, A. Yazidi","doi":"10.1109/CloudTech49835.2020.9365879","DOIUrl":"https://doi.org/10.1109/CloudTech49835.2020.9365879","url":null,"abstract":"Cloud computing and its popularity has boomed over the last decade, enabling anyone to rent computing power on demand. Cloud providers such as Amazon and Google rent out surplus computing power for a discounted price according to demand in their data centers, but with the trade off that it is revocable and can only be rented for a short amount of time.This paper investigates the use of surplus computing power in order to reduce the cost of batch computing. We rely on a simple economical principle, the most cost-efficient Virtual Machine (VM) in a public cloud is the one that offers the highest performance per dollar. Therefore by rescheduling the workloads to the most cost-efficient location in terms of performance per dollar our solution dynamically provisions preemptible VMs in Google Cloud while continuously monitoring the performance per dollar of all available resources in every region. The algorithm automatically relocates workloads to a less expensive location if any appears and handles revoked access of the resources. Our algorithm views the cost reduction problem as a linear optimization problem with constraints and solves it using a greedy procedure. In the experiment we spawn Docker containers to mine cryptocurrency. The experimental results show that 67% of the cost is saved compared to renting on-demand VMs. The system can readily be extended to containers processing similar types of workloads and more generally to applications where the performance per dollar is easy to measure.","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"35 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122148921","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
CloudTech 2020 Authors Index CloudTech 2020作者索引
{"title":"CloudTech 2020 Authors Index","authors":"","doi":"10.1109/cloudtech49835.2020.9365882","DOIUrl":"https://doi.org/10.1109/cloudtech49835.2020.9365882","url":null,"abstract":"","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123923839","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep Learning and Approach for Tracking People’s Movements in a Video 视频中人物运动的深度学习与跟踪方法
Jemai Bornia, A. Frihida, Olivier Debauche, S. Mahmoudi, P. Manneback
Everyday, a large amount of data is produced thanks to technological advances in the field of multimedia, associated with the generalization of their use in many applications. The need to keep control over this content, in terms of data analysis, classification, accurate AI (Artificial Intelligence) algorithms are required to perform this task efficiently and quickly. In this article, we propose an approach using deep learning technologies for the analysis of movement in video sequences. The suggested approach uses images from video splitting to detect objects / entities present and store their descriptions in a standard XML file. As result, we provide a Deep Learning algorithm using TensorFlow for tracking motion and animated entities in video sequences.
由于多媒体领域的技术进步,每天都会产生大量的数据,这与多媒体在许多应用中的广泛使用有关。需要保持对这些内容的控制,在数据分析、分类方面,需要准确的AI(人工智能)算法来高效、快速地执行这项任务。在本文中,我们提出一种方法使用深度学习技术分析视频序列的运动。建议的方法使用来自视频分割的图像来检测存在的对象/实体,并将其描述存储在标准XML文件中。因此,我们提供了一种使用TensorFlow的深度学习算法来跟踪视频序列中的运动和动画实体。
{"title":"Deep Learning and Approach for Tracking People’s Movements in a Video","authors":"Jemai Bornia, A. Frihida, Olivier Debauche, S. Mahmoudi, P. Manneback","doi":"10.1109/CloudTech49835.2020.9365886","DOIUrl":"https://doi.org/10.1109/CloudTech49835.2020.9365886","url":null,"abstract":"Everyday, a large amount of data is produced thanks to technological advances in the field of multimedia, associated with the generalization of their use in many applications. The need to keep control over this content, in terms of data analysis, classification, accurate AI (Artificial Intelligence) algorithms are required to perform this task efficiently and quickly. In this article, we propose an approach using deep learning technologies for the analysis of movement in video sequences. The suggested approach uses images from video splitting to detect objects / entities present and store their descriptions in a standard XML file. As result, we provide a Deep Learning algorithm using TensorFlow for tracking motion and animated entities in video sequences.","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"13 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125315451","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Business Process Modeling Notation Extension for Real Time Handling - Application to Novel Coronavirus (2019-nCoV) management process 实时处理的业务流程建模符号扩展-应用于新型冠状病毒(2019-nCoV)管理流程
A. Ouarhim, Jihane Lakhrouit, Karim Baïna
the need of real-time enterprises increases according to our life style and customers’ satisfaction goal. Real-time business process is one of the important components of a real-time enterprise. For that, a formal definition of real-time concept and real-time process was indispensable. This work presents a formal definition of real-time concept, real-time ontology and a proposition of a real-time component with real-time attributes. This new dimension of time contains three components: latency time, acceptance interval and theoretical time. This definition gives a new vision of time, not just an ordinary vision as periods and calendar but as a response to our needs in real-time enterprises: real-time. Before the proposition of a real-time component for BPMN language, which we applicate to Novel Coronavirus (2019-nCoV) management process, as case study.
随着人们的生活方式和客户满意度的提高,企业对实时服务的需求也在不断增加。实时业务流程是实时企业的重要组成部分之一。为此,必须对实时概念和实时过程进行正式定义。本文提出了实时概念的形式化定义、实时本体和具有实时属性的实时组件的命题。这个新的时间维度包含三个组成部分:潜伏期时间、接受间隔时间和理论时间。这个定义给出了时间的新视角,不仅仅是周期和日历的普通视角,而是对我们在实时企业中的需求的响应:实时。在提出BPMN语言的实时组件之前,我们将其作为案例研究应用于新型冠状病毒(2019-nCoV)的管理流程。
{"title":"Business Process Modeling Notation Extension for Real Time Handling - Application to Novel Coronavirus (2019-nCoV) management process","authors":"A. Ouarhim, Jihane Lakhrouit, Karim Baïna","doi":"10.1109/CloudTech49835.2020.9365900","DOIUrl":"https://doi.org/10.1109/CloudTech49835.2020.9365900","url":null,"abstract":"the need of real-time enterprises increases according to our life style and customers’ satisfaction goal. Real-time business process is one of the important components of a real-time enterprise. For that, a formal definition of real-time concept and real-time process was indispensable. This work presents a formal definition of real-time concept, real-time ontology and a proposition of a real-time component with real-time attributes. This new dimension of time contains three components: latency time, acceptance interval and theoretical time. This definition gives a new vision of time, not just an ordinary vision as periods and calendar but as a response to our needs in real-time enterprises: real-time. Before the proposition of a real-time component for BPMN language, which we applicate to Novel Coronavirus (2019-nCoV) management process, as case study.","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"127 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122512736","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Block Sizes Control For an Efficient Real Time Record Linkage 块大小控制为一个有效的实时记录链接
Hamid Naceur Benkhaled, Djamel Berrabah, F. Boufarès
Record Linkage (RL) is the process of detecting duplicates in one or several datasets. The main important phase during the RL process is blocking, it reduces the quadratic complexity of the RL process by dividing the data into several blocks, in which, matching between the records is done. Several blocking techniques were proposed in the literature, but most of them do not have a mechanism of controlling the generated block sizes, which is a very important condition in the field of real-time RL or privacy-preserving RL. In this paper, we propose a mechanism to control the block sizes generated by the K-Modes based Record Linkage. The experiments done on three real-world datasets show satisfying results where most of the duplicates records were detected while respecting the specified block sizes.
RL (Record Linkage)是在一个或多个数据集中检测重复数据的过程。在RL过程中主要的重要阶段是阻塞,它通过将数据分成几个块来降低RL过程的二次复杂度,在这些块中完成记录之间的匹配。文献中提出了几种块技术,但大多数都没有控制生成块大小的机制,而块大小是实时RL或隐私保护RL领域的一个非常重要的条件。在本文中,我们提出了一种机制来控制由基于k模式的记录链接产生的块大小。在三个真实数据集上进行的实验显示了令人满意的结果,其中大多数重复记录在尊重指定块大小的情况下被检测到。
{"title":"Block Sizes Control For an Efficient Real Time Record Linkage","authors":"Hamid Naceur Benkhaled, Djamel Berrabah, F. Boufarès","doi":"10.1109/CloudTech49835.2020.9365866","DOIUrl":"https://doi.org/10.1109/CloudTech49835.2020.9365866","url":null,"abstract":"Record Linkage (RL) is the process of detecting duplicates in one or several datasets. The main important phase during the RL process is blocking, it reduces the quadratic complexity of the RL process by dividing the data into several blocks, in which, matching between the records is done. Several blocking techniques were proposed in the literature, but most of them do not have a mechanism of controlling the generated block sizes, which is a very important condition in the field of real-time RL or privacy-preserving RL. In this paper, we propose a mechanism to control the block sizes generated by the K-Modes based Record Linkage. The experiments done on three real-world datasets show satisfying results where most of the duplicates records were detected while respecting the specified block sizes.","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"65 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130425479","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Model Of A Biometric Recognition System Based On The Hough Transform Of Libor Masek and 1-D Log-Gabor Filter 基于Libor mask的Hough变换和一维Log-Gabor滤波器的生物特征识别系统模型
Hammou Djalal Rafik, S. Mahmoudi, A. Reda, Mechab Boubaker
Biometric iris recognition is a very advanced technology for the data protection and identification of individuals. This technology is widely used by multi-national society in terms of data protection and security. A biometric iris recognition system requires an adapted architecture and specific because it generally recommends 5 steps. The acquisition step consists of getting a good quality iris image by digital cameras of high resolution. The segmentation can use an algorithm and mathematical methods such as John Daugman’s Interro Differential Operator [3] or Richard Paul Wildes’s Hough Transform [4]. The normalization phase projects to transform the relevant information from the circular iris image into the rectangular shape. The feature extraction step requires the use of specific filters (1-D Log-Gabor). The end step is the matching that allows us to compare the descriptor of the user with that of the database to determine if the person is authentic or not and this is done using Hamming Distance. The objective of this article is the use of our approach to improving results. The experiments were tested on the Casia V1 [16], MMU1 [17] iris biometric database, which gave very good and encouraging results. We found an accuracy rate of 99.9263 % for Casia V1 and 99.4168 % for MMU1.
生物特征虹膜识别是一项非常先进的个人数据保护和身份识别技术。该技术在数据保护和安全方面被多国社会广泛使用。生物特征虹膜识别系统需要一个适应的架构和特定的,因为它通常建议5个步骤。采集步骤是通过高分辨率的数码相机获得高质量的虹膜图像。分割可以使用John Daugman的Interro Differential Operator[3]或Richard Paul Wildes的Hough Transform[4]等算法和数学方法。归一化阶段是将圆形虹膜图像的相关信息转化为矩形虹膜图像。特征提取步骤需要使用特定的过滤器(1-D Log-Gabor)。最后一步是匹配,它允许我们将用户的描述符与数据库的描述符进行比较,以确定该人是否真实,这是使用汉明距离完成的。本文的目的是使用我们的方法来改进结果。实验在Casia V1[16]、MMU1[17]虹膜生物特征数据库上进行了测试,得到了非常好的令人鼓舞的结果。我们发现Casia V1和MMU1的准确率分别为99.9263%和99.4168%。
{"title":"A Model Of A Biometric Recognition System Based On The Hough Transform Of Libor Masek and 1-D Log-Gabor Filter","authors":"Hammou Djalal Rafik, S. Mahmoudi, A. Reda, Mechab Boubaker","doi":"10.1109/CloudTech49835.2020.9365917","DOIUrl":"https://doi.org/10.1109/CloudTech49835.2020.9365917","url":null,"abstract":"Biometric iris recognition is a very advanced technology for the data protection and identification of individuals. This technology is widely used by multi-national society in terms of data protection and security. A biometric iris recognition system requires an adapted architecture and specific because it generally recommends 5 steps. The acquisition step consists of getting a good quality iris image by digital cameras of high resolution. The segmentation can use an algorithm and mathematical methods such as John Daugman’s Interro Differential Operator [3] or Richard Paul Wildes’s Hough Transform [4]. The normalization phase projects to transform the relevant information from the circular iris image into the rectangular shape. The feature extraction step requires the use of specific filters (1-D Log-Gabor). The end step is the matching that allows us to compare the descriptor of the user with that of the database to determine if the person is authentic or not and this is done using Hamming Distance. The objective of this article is the use of our approach to improving results. The experiments were tested on the Casia V1 [16], MMU1 [17] iris biometric database, which gave very good and encouraging results. We found an accuracy rate of 99.9263 % for Casia V1 and 99.4168 % for MMU1.","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"138 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"121330558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
[CloudTech 2020 Front cover] 【CloudTech 2020年封面】
{"title":"[CloudTech 2020 Front cover]","authors":"","doi":"10.1109/cloudtech49835.2020.9365880","DOIUrl":"https://doi.org/10.1109/cloudtech49835.2020.9365880","url":null,"abstract":"","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128659914","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation of NDVI and NDWI parameters in CPU-GPU Heterogeneous Platforms based CUDA 基于CUDA的CPU-GPU异构平台NDVI和NDWI参数评估
Fatima Zahra Guerrouj, R. Latif, A. Saddik
Artificial intelligence is a field in full development, from facial recognition to autonomous vehicles and referral systems for online shopping, passing by smart farming, these new technologies are invading our daily lives.Nowadays, agricultural applications require more and more computer vision technologies for continuous monitoring and analysis of crop health and yield. That is why machine learning has become one of the mechanisms that make farming more efficient by using high-precision algorithms. This article deals with the Normalized Difference Vegetation Index (NDVI) and the Normalized Difference Water Index (NDWI), which are the most widely used indices in precision agriculture. In this work, we adopt GPU-based heterogeneous architecture using parallel programming with the CUDA language. The algorithm is evaluated on several platforms: NVIDIA Jetson TX1, DELL-desktop, and XU4 board. It has been discovered that the execution time of the two NDVI and NDWI indices on the embedded TX1 card is more optimized and improved compared to the execution time on the XU4 card and the Desktop.
人工智能是一个全面发展的领域,从面部识别到自动驾驶汽车和网上购物的推荐系统,经过智能农业,这些新技术正在侵入我们的日常生活。如今,农业应用越来越需要计算机视觉技术来连续监测和分析作物健康和产量。这就是为什么机器学习已经成为通过使用高精度算法提高农业效率的机制之一。本文讨论了在精准农业中应用最广泛的归一化植被指数(NDVI)和归一化水指数(NDWI)。在这项工作中,我们采用基于gpu的异构架构,使用CUDA语言并行编程。该算法在多个平台上进行了评估:NVIDIA Jetson TX1, DELL-desktop和XU4板。研究发现,在嵌入式TX1卡上,NDVI和NDWI两个指标的执行时间比在XU4卡和Desktop上的执行时间更加优化和提高。
{"title":"Evaluation of NDVI and NDWI parameters in CPU-GPU Heterogeneous Platforms based CUDA","authors":"Fatima Zahra Guerrouj, R. Latif, A. Saddik","doi":"10.1109/CloudTech49835.2020.9365888","DOIUrl":"https://doi.org/10.1109/CloudTech49835.2020.9365888","url":null,"abstract":"Artificial intelligence is a field in full development, from facial recognition to autonomous vehicles and referral systems for online shopping, passing by smart farming, these new technologies are invading our daily lives.Nowadays, agricultural applications require more and more computer vision technologies for continuous monitoring and analysis of crop health and yield. That is why machine learning has become one of the mechanisms that make farming more efficient by using high-precision algorithms. This article deals with the Normalized Difference Vegetation Index (NDVI) and the Normalized Difference Water Index (NDWI), which are the most widely used indices in precision agriculture. In this work, we adopt GPU-based heterogeneous architecture using parallel programming with the CUDA language. The algorithm is evaluated on several platforms: NVIDIA Jetson TX1, DELL-desktop, and XU4 board. It has been discovered that the execution time of the two NDVI and NDWI indices on the embedded TX1 card is more optimized and improved compared to the execution time on the XU4 card and the Desktop.","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"87 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116010186","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Big Data Storage and Analysis for Smart Farming 智慧农业大数据存储与分析
Fabrice Nolack Fote, Saïd Mahmoudi, Amine Roukh, S. Mahmoudi
Smart Farming has always been referred to as agriculture, but nowadays, that is no longer the case. Today, Smart farming is made up of Precision Agriculture (PA) and Precision Livestock Farming (PLF). Big Data technologies and algorithms can be relevant for managing and monitoring data related to any farm. Precision livestock farming concerns genetics, animal welfare, animal nutrition, reproduction, species protection and animal health. This paper presents a general overview of Big Data tools that can be applied in a smart farming application. New Technologies are offering many tools used to facilitate the management of data collection, risk minimization, climate change anticipation, secure storage and analysis, etc. The main purpose of Big Data tools is to increase productions in order to offer higher quantities while ensuring higher quality products. However, they remain some issues that need to be accomplished.
智能农业一直被称为农业,但如今,情况已不再如此。如今,智能农业由精准农业(PA)和精准畜牧业(PLF)组成。大数据技术和算法可以用于管理和监控与任何农场相关的数据。精准畜牧业涉及遗传、动物福利、动物营养、繁殖、物种保护和动物健康。本文介绍了可用于智能农业应用的大数据工具的总体概述。新技术提供了许多工具,用于促进数据收集管理、风险最小化、气候变化预测、安全存储和分析等。大数据工具的主要目的是提高产量,以提供更高数量的产品,同时确保更高质量的产品。然而,仍有一些问题需要解决。
{"title":"Big Data Storage and Analysis for Smart Farming","authors":"Fabrice Nolack Fote, Saïd Mahmoudi, Amine Roukh, S. Mahmoudi","doi":"10.1109/CloudTech49835.2020.9365869","DOIUrl":"https://doi.org/10.1109/CloudTech49835.2020.9365869","url":null,"abstract":"Smart Farming has always been referred to as agriculture, but nowadays, that is no longer the case. Today, Smart farming is made up of Precision Agriculture (PA) and Precision Livestock Farming (PLF). Big Data technologies and algorithms can be relevant for managing and monitoring data related to any farm. Precision livestock farming concerns genetics, animal welfare, animal nutrition, reproduction, species protection and animal health. This paper presents a general overview of Big Data tools that can be applied in a smart farming application. New Technologies are offering many tools used to facilitate the management of data collection, risk minimization, climate change anticipation, secure storage and analysis, etc. The main purpose of Big Data tools is to increase productions in order to offer higher quantities while ensuring higher quality products. However, they remain some issues that need to be accomplished.","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116055661","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
Bloom filter and its variants for the optimization of MapReduce’s algorithms: A review 用于优化MapReduce算法的Bloom过滤器及其变体:综述
F. Ezzaki, N. Abghour, A. Elomri, K. Moussaid, M. Rida
The bloom filter is a probabilistic data model used to test the existence of an element in a set, i.e., for any given item, the bloom filter could test the membership query on this candidate. The bloom filter has many advantages due to its simplicity and efficiency in highly solving the issue of data representation in many fields and to support membership queries, it has been known as space and time-efficient randomized data structure, by filtering out redundant data and optimizing the memory consumption. However, bloom filters are limited to membership tests and don’t support the deletion of elements. They also generate the false positive probability as they are based on a probabilistic model, this error rate is generated when an element that doesn’t belong to a set is considered as a member of this set by the bloom filter. Our goal is to compare a number of well- existed algorithms related to the boom filter for future work on the optimization of the join’s algorithms in MapReduce. This paper provides an overview of the different variants of the bloom filter and analyses the studies that have been interested in this area of research.
布隆过滤器是一种概率数据模型,用于测试集合中某个元素的存在性,也就是说,对于任何给定的项目,布隆过滤器可以测试该候选项目的成员查询。布隆过滤器具有简单、高效的优点,能够很好地解决许多领域的数据表示问题,支持成员查询,通过过滤冗余数据和优化内存消耗,被称为空间和时间高效的随机数据结构。但是,布隆过滤器仅限于成员测试,不支持删除元素。它们也会产生假阳性概率,因为它们是基于概率模型的,这个错误率是当一个不属于集合的元素被布隆过滤器认为是这个集合的成员时产生的。我们的目标是比较一些现有的与boom filter相关的算法,以便将来在MapReduce中优化join算法。本文概述了布隆过滤器的不同变体,并分析了对这一研究领域感兴趣的研究。
{"title":"Bloom filter and its variants for the optimization of MapReduce’s algorithms: A review","authors":"F. Ezzaki, N. Abghour, A. Elomri, K. Moussaid, M. Rida","doi":"10.1109/CloudTech49835.2020.9365876","DOIUrl":"https://doi.org/10.1109/CloudTech49835.2020.9365876","url":null,"abstract":"The bloom filter is a probabilistic data model used to test the existence of an element in a set, i.e., for any given item, the bloom filter could test the membership query on this candidate. The bloom filter has many advantages due to its simplicity and efficiency in highly solving the issue of data representation in many fields and to support membership queries, it has been known as space and time-efficient randomized data structure, by filtering out redundant data and optimizing the memory consumption. However, bloom filters are limited to membership tests and don’t support the deletion of elements. They also generate the false positive probability as they are based on a probabilistic model, this error rate is generated when an element that doesn’t belong to a set is considered as a member of this set by the bloom filter. Our goal is to compare a number of well- existed algorithms related to the boom filter for future work on the optimization of the join’s algorithms in MapReduce. This paper provides an overview of the different variants of the bloom filter and analyses the studies that have been interested in this area of research.","PeriodicalId":272860,"journal":{"name":"2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)","volume":"93 1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2020-11-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122065462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
2020 5th International Conference on Cloud Computing and Artificial Intelligence: Technologies and Applications (CloudTech)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1