首页 > 最新文献

Big Data Mining and Analytics最新文献

英文 中文
MAGAN: Unsupervised low-light image enhancement guided by mixed-attention MAGAN:混合注意力引导下的无监督微光图像增强
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-01-25 DOI: 10.26599/BDMA.2021.9020020
Renjun Wang;Bin Jiang;Chao Yang;Qiao Li;Bolin Zhang
Most learning-based low-light image enhancement methods typically suffer from two problems. First, they require a large amount of paired data for training, which are difficult to acquire in most cases. Second, in the process of enhancement, image noise is difficult to be removed and may even be amplified. In other words, performing denoising and illumination enhancement at the same time is difficult. As an alternative to supervised learning strategies that use a large amount of paired data, as presented in previous work, this paper presents an mixed-attention guided generative adversarial network called MAGAN for low-light image enhancement in a fully unsupervised fashion. We introduce a mixed-attention module layer, which can model the relationship between each pixel and feature of the image. In this way, our network can enhance a low-light image and remove its noise simultaneously. In addition, we conduct extensive experiments on paired and no-reference datasets to show the superiority of our method in enhancing low-light images.
大多数基于学习的微光图像增强方法通常存在两个问题。首先,它们需要大量成对的数据进行训练,而在大多数情况下很难获得这些数据。第二,在增强过程中,图像噪声很难被去除,甚至可能被放大。换句话说,同时执行去噪和照明增强是困难的。作为使用大量配对数据的监督学习策略的替代方案,如先前工作中所述,本文提出了一种称为MAGAN的混合注意力引导生成对抗性网络,用于以完全无监督的方式进行微光图像增强。我们引入了一个混合注意力模块层,它可以对图像的每个像素和特征之间的关系进行建模。通过这种方式,我们的网络可以增强低光图像并同时去除其噪声。此外,我们在配对和无参考数据集上进行了大量实验,以显示我们的方法在增强弱光图像方面的优越性。
{"title":"MAGAN: Unsupervised low-light image enhancement guided by mixed-attention","authors":"Renjun Wang;Bin Jiang;Chao Yang;Qiao Li;Bolin Zhang","doi":"10.26599/BDMA.2021.9020020","DOIUrl":"https://doi.org/10.26599/BDMA.2021.9020020","url":null,"abstract":"Most learning-based low-light image enhancement methods typically suffer from two problems. First, they require a large amount of paired data for training, which are difficult to acquire in most cases. Second, in the process of enhancement, image noise is difficult to be removed and may even be amplified. In other words, performing denoising and illumination enhancement at the same time is difficult. As an alternative to supervised learning strategies that use a large amount of paired data, as presented in previous work, this paper presents an mixed-attention guided generative adversarial network called MAGAN for low-light image enhancement in a fully unsupervised fashion. We introduce a mixed-attention module layer, which can model the relationship between each pixel and feature of the image. In this way, our network can enhance a low-light image and remove its noise simultaneously. In addition, we conduct extensive experiments on paired and no-reference datasets to show the superiority of our method in enhancing low-light images.","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 2","pages":"110-119"},"PeriodicalIF":13.6,"publicationDate":"2022-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9691293/09691298.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"67834094","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 12
Call for papers: Special issue on AI-enabled Internet of medical things for medical data analytics 论文征集:医学数据分析的人工智能医疗物联网特刊
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-01-01 DOI: 10.26599/BDMA.2022.9020001
{"title":"Call for papers: Special issue on AI-enabled Internet of medical things for medical data analytics","authors":"","doi":"10.26599/BDMA.2022.9020001","DOIUrl":"https://doi.org/10.26599/BDMA.2022.9020001","url":null,"abstract":"","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 2","pages":""},"PeriodicalIF":13.6,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9691293/09691303.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"67834074","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Call for papers: Special issue on artificial intelligence powered Internet of Healthcare Things (IoHT): Data science, emerging trends and applications 论文征集:人工智能医疗物联网特刊:数据科学、新兴趋势和应用
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-01-01 DOI: 10.26599/BDMA.2021.9020029
{"title":"Call for papers: Special issue on artificial intelligence powered Internet of Healthcare Things (IoHT): Data science, emerging trends and applications","authors":"","doi":"10.26599/BDMA.2021.9020029","DOIUrl":"https://doi.org/10.26599/BDMA.2021.9020029","url":null,"abstract":"","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 2","pages":""},"PeriodicalIF":13.6,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9691293/09691302.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"67834076","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Call for Papers: Special Issue on Role & Impact of Advance Technologies AI, ML, and Big Data in Business and Society 论文征集:关于先进技术AI、ML和大数据在商业和社会中的作用和影响的特刊
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-01-01 DOI: 10.26599/BDMA.2022.9020020
{"title":"Call for Papers: Special Issue on Role & Impact of Advance Technologies AI, ML, and Big Data in Business and Society","authors":"","doi":"10.26599/BDMA.2022.9020020","DOIUrl":"https://doi.org/10.26599/BDMA.2022.9020020","url":null,"abstract":"","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 4","pages":""},"PeriodicalIF":13.6,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9832761/09832762.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68067555","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Call for Papers: Special Issue on Role & Impact of Advance Technologies AI, ML, and Big Data in Business and Society 征文:《人工智能、机器学习和大数据在商业和社会中的作用和影响》特刊
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2022-01-01 DOI: 10.26599/bdma.2022.9020020
{"title":"Call for Papers: Special Issue on Role & Impact of Advance Technologies AI, ML, and Big Data in Business and Society","authors":"","doi":"10.26599/bdma.2022.9020020","DOIUrl":"https://doi.org/10.26599/bdma.2022.9020020","url":null,"abstract":"","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"30 1","pages":""},"PeriodicalIF":13.6,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"69029454","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A comparison of computational approaches for intron retention detection 内含子保留检测的计算方法比较
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2021-12-27 DOI: 10.26599/BDMA.2021.9020014
Jiantao Zheng;Cuixiang Lin;Zhenpeng Wu;Hong-Dong Li
Intron Retention (IR) is an alternative splicing mode through which introns are retained in mature RNAs rather than being spliced in most cases. IR has been gaining increasing attention in recent years because of its recognized association with gene expression regulation and complex diseases. Continuous efforts have been dedicated to the development of IR detection methods. These methods differ in their metrics to quantify retention propensity, performance to detect IR events, functional enrichment of detected IRs, and computational speed. A systematic experimental comparison would be valuable to the selection and use of existing methods. In this work, we conduct an experimental comparison of existing IR detection methods. Considering the unavailability of a gold standard dataset of intron retention, we compare the IR detection performance on simulation datasets. Then, we compare the IR detection results with real RNA-Seq data. We also describe the use of differential analysis methods to identify disease-associated IRs and compare differential IRs along with their Gene Ontology enrichment, which is illustrated on an Alzheimer's disease RNA-Seq dataset. We discuss key principles and features of existing approaches and outline their differences. This systematic analysis provides helpful guidance for interrogating transcriptomic data from the point of view of IR.
内含子保留(IR)是一种替代剪接模式,在大多数情况下,内含子保留在成熟RNA中,而不是剪接。近年来,IR因其与基因表达调控和复杂疾病的关系而越来越受到关注。一直致力于开发红外探测方法。这些方法在量化保留倾向、检测IR事件的性能、检测到的IR的功能富集和计算速度方面有所不同。系统的实验比较对现有方法的选择和使用是有价值的。在这项工作中,我们对现有的红外探测方法进行了实验比较。考虑到内含子保留金标准数据集的不可用性,我们比较了模拟数据集上的IR检测性能。然后,我们将IR检测结果与真实的RNA-Seq数据进行比较。我们还描述了使用差异分析方法来识别疾病相关的IRs,并比较差异IRs及其基因本体论富集,如阿尔茨海默病RNA-Seq数据集所示。我们讨论了现有方法的主要原则和特点,并概述了它们的差异。该系统分析为从IR的角度询问转录组数据提供了有用的指导。
{"title":"A comparison of computational approaches for intron retention detection","authors":"Jiantao Zheng;Cuixiang Lin;Zhenpeng Wu;Hong-Dong Li","doi":"10.26599/BDMA.2021.9020014","DOIUrl":"https://doi.org/10.26599/BDMA.2021.9020014","url":null,"abstract":"Intron Retention (IR) is an alternative splicing mode through which introns are retained in mature RNAs rather than being spliced in most cases. IR has been gaining increasing attention in recent years because of its recognized association with gene expression regulation and complex diseases. Continuous efforts have been dedicated to the development of IR detection methods. These methods differ in their metrics to quantify retention propensity, performance to detect IR events, functional enrichment of detected IRs, and computational speed. A systematic experimental comparison would be valuable to the selection and use of existing methods. In this work, we conduct an experimental comparison of existing IR detection methods. Considering the unavailability of a gold standard dataset of intron retention, we compare the IR detection performance on simulation datasets. Then, we compare the IR detection results with real RNA-Seq data. We also describe the use of differential analysis methods to identify disease-associated IRs and compare differential IRs along with their Gene Ontology enrichment, which is illustrated on an Alzheimer's disease RNA-Seq dataset. We discuss key principles and features of existing approaches and outline their differences. This systematic analysis provides helpful guidance for interrogating transcriptomic data from the point of view of IR.","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 1","pages":"15-31"},"PeriodicalIF":13.6,"publicationDate":"2021-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9663253/09663257.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68077702","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Toward intelligent financial advisors for identifying potential clients: A multitask perspective 面向识别潜在客户的智能财务顾问:多任务视角
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2021-12-27 DOI: 10.26599/BDMA.2021.9020021
Qixiang Shao;Runlong Yu;Hongke Zhao;Chunli Liu;Mengyi Zhang;Hongmei Song;Qi Liu
Intelligent Financial Advisors (IFAs) in online financial applications (apps) have brought new life to personal investment by providing appropriate and high-quality portfolios for users. In real-world scenarios, identifying potential clients is a crucial issue for IFAs, i.e., identifying users who are willing to purchase the portfolios. Thus, extracting useful information from various characteristics of users and further predicting their purchase inclination are urgent. However, two critical problems encountered in real practice make this prediction task challenging, i.e., sample selection bias and data sparsity. In this study, we formalize a potential conversion relationship, i.e., user ! activated user ! client and decompose this relationship into three related tasks. Then, we propose a Multitask Feature Extraction Model (MFEM), which can leverage useful information contained in these related tasks and learn them jointly, thereby solving the two problems simultaneously. In addition, we design a two-stage feature selection algorithm to select highly relevant user features efficiently and accurately from an incredibly huge number of user feature fields. Finally, we conduct extensive experiments on a real-world dataset provided by a famous fintech bank. Experimental results clearly demonstrate the effectiveness of MFEM.
在线金融应用程序中的智能金融顾问(IFA)为用户提供了合适且高质量的投资组合,为个人投资带来了新的活力。在现实世界中,识别潜在客户是IFA的一个关键问题,即识别愿意购买投资组合的用户。因此,迫切需要从用户的各种特征中提取有用的信息,并进一步预测他们的购买倾向。然而,在实际实践中遇到的两个关键问题使这项预测任务具有挑战性,即样本选择偏差和数据稀疏性。在这项研究中,我们形式化了一种潜在的转换关系,即用户!激活的用户!客户端,并将此关系分解为三个相关任务。然后,我们提出了一种多任务特征提取模型(MFEM),该模型可以利用这些相关任务中包含的有用信息并联合学习,从而同时解决这两个问题。此外,我们设计了一种两阶段特征选择算法,从数量惊人的用户特征字段中高效准确地选择高度相关的用户特征。最后,我们在一家著名金融科技银行提供的真实世界数据集上进行了广泛的实验。实验结果清楚地证明了MFEM的有效性。
{"title":"Toward intelligent financial advisors for identifying potential clients: A multitask perspective","authors":"Qixiang Shao;Runlong Yu;Hongke Zhao;Chunli Liu;Mengyi Zhang;Hongmei Song;Qi Liu","doi":"10.26599/BDMA.2021.9020021","DOIUrl":"https://doi.org/10.26599/BDMA.2021.9020021","url":null,"abstract":"Intelligent Financial Advisors (IFAs) in online financial applications (apps) have brought new life to personal investment by providing appropriate and high-quality portfolios for users. In real-world scenarios, identifying potential clients is a crucial issue for IFAs, i.e., identifying users who are willing to purchase the portfolios. Thus, extracting useful information from various characteristics of users and further predicting their purchase inclination are urgent. However, two critical problems encountered in real practice make this prediction task challenging, i.e., sample selection bias and data sparsity. In this study, we formalize a potential conversion relationship, i.e., user ! activated user ! client and decompose this relationship into three related tasks. Then, we propose a Multitask Feature Extraction Model (MFEM), which can leverage useful information contained in these related tasks and learn them jointly, thereby solving the two problems simultaneously. In addition, we design a two-stage feature selection algorithm to select highly relevant user features efficiently and accurately from an incredibly huge number of user feature fields. Finally, we conduct extensive experiments on a real-world dataset provided by a famous fintech bank. Experimental results clearly demonstrate the effectiveness of MFEM.","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 1","pages":"64-78"},"PeriodicalIF":13.6,"publicationDate":"2021-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9663253/09663261.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68077805","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 7
Exploiting more associations between slots for multi-domain dialog state tracking 利用插槽之间的更多关联进行多域对话框状态跟踪
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2021-12-27 DOI: 10.26599/BDMA.2021.9020013
Hui Bai;Yan Yang;Jie Wang
Dialog State Tracking (DST) aims to extract the current state from the conversation and plays an important role in dialog systems. Existing methods usually predict the value of each slot independently and do not consider the correlations among slots, which will exacerbate the data sparsity problem because of the increased number of candidate values. In this paper, we propose a multi-domain DST model that integrates slot-relevant information. In particular, certain connections may exist among slots in different domains, and their corresponding values can be obtained through explicit or implicit reasoning. Therefore, we use the graph adjacency matrix to determine the correlation between slots, so that the slots can incorporate more slot-value transformer information. Experimental results show that our approach has performed well on the Multi-domain Wizard-Of-Oz (MultiWOZ) 2.0 and MultiWOZ2.1 datasets, demonstrating the effectiveness and necessity of incorporating slot-relevant information.
对话状态跟踪(DST)旨在从对话中提取当前状态,在对话系统中发挥着重要作用。现有的方法通常独立地预测每个时隙的值,而不考虑时隙之间的相关性,这将由于候选值的数量增加而加剧数据稀疏性问题。在本文中,我们提出了一个集成时隙相关信息的多域DST模型。特别地,不同域中的槽之间可能存在某些连接,并且可以通过显式或隐式推理来获得它们对应的值。因此,我们使用图邻接矩阵来确定槽之间的相关性,以便槽可以包含更多的槽值变换器信息。实验结果表明,我们的方法在多域Wizard Of Oz(MultiWOZ)2.0和MultiWOZ2.1数据集上表现良好,证明了引入时隙相关信息的有效性和必要性。
{"title":"Exploiting more associations between slots for multi-domain dialog state tracking","authors":"Hui Bai;Yan Yang;Jie Wang","doi":"10.26599/BDMA.2021.9020013","DOIUrl":"https://doi.org/10.26599/BDMA.2021.9020013","url":null,"abstract":"Dialog State Tracking (DST) aims to extract the current state from the conversation and plays an important role in dialog systems. Existing methods usually predict the value of each slot independently and do not consider the correlations among slots, which will exacerbate the data sparsity problem because of the increased number of candidate values. In this paper, we propose a multi-domain DST model that integrates slot-relevant information. In particular, certain connections may exist among slots in different domains, and their corresponding values can be obtained through explicit or implicit reasoning. Therefore, we use the graph adjacency matrix to determine the correlation between slots, so that the slots can incorporate more slot-value transformer information. Experimental results show that our approach has performed well on the Multi-domain Wizard-Of-Oz (MultiWOZ) 2.0 and MultiWOZ2.1 datasets, demonstrating the effectiveness and necessity of incorporating slot-relevant information.","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 1","pages":"41-52"},"PeriodicalIF":13.6,"publicationDate":"2021-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9663253/09663259.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68077701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Big data with cloud computing: Discussions and challenges 云计算的大数据:讨论和挑战
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2021-12-27 DOI: 10.26599/BDMA.2021.9020016
Amanpreet Kaur Sandhu
With the recent advancements in computer technologies, the amount of data available is increasing day by day. However, excessive amounts of data create great challenges for users. Meanwhile, cloud computing services provide a powerful environment to store large volumes of data. They eliminate various requirements, such as dedicated space and maintenance of expensive computer hardware and software. Handling big data is a time-consuming task that requires large computational clusters to ensure successful data storage and processing. In this work, the definition, classification, and characteristics of big data are discussed, along with various cloud services, such as Microsoft Azure, Google Cloud, Amazon Web Services, International Business Machine cloud, Hortonworks, and MapR. A comparative analysis of various cloud-based big data frameworks is also performed. Various research challenges are defined in terms of distributed database storage, data security, heterogeneity, and data visualization.
随着计算机技术的进步,可用的数据量与日俱增。然而,过多的数据给用户带来了巨大的挑战。同时,云计算服务提供了一个强大的环境来存储大量数据。它们消除了各种要求,例如专用空间和维护昂贵的计算机硬件和软件。处理大数据是一项耗时的任务,需要大型计算集群来确保成功的数据存储和处理。在这项工作中,讨论了大数据的定义、分类和特征,以及各种云服务,如Microsoft Azure、Google cloud、Amazon Web services、International Business Machine cloud、Hortonworks和MapR。还对各种基于云的大数据框架进行了比较分析。从分布式数据库存储、数据安全、异构性和数据可视化等方面定义了各种研究挑战。
{"title":"Big data with cloud computing: Discussions and challenges","authors":"Amanpreet Kaur Sandhu","doi":"10.26599/BDMA.2021.9020016","DOIUrl":"https://doi.org/10.26599/BDMA.2021.9020016","url":null,"abstract":"With the recent advancements in computer technologies, the amount of data available is increasing day by day. However, excessive amounts of data create great challenges for users. Meanwhile, cloud computing services provide a powerful environment to store large volumes of data. They eliminate various requirements, such as dedicated space and maintenance of expensive computer hardware and software. Handling big data is a time-consuming task that requires large computational clusters to ensure successful data storage and processing. In this work, the definition, classification, and characteristics of big data are discussed, along with various cloud services, such as Microsoft Azure, Google Cloud, Amazon Web Services, International Business Machine cloud, Hortonworks, and MapR. A comparative analysis of various cloud-based big data frameworks is also performed. Various research challenges are defined in terms of distributed database storage, data security, heterogeneity, and data visualization.","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 1","pages":"32-40"},"PeriodicalIF":13.6,"publicationDate":"2021-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9663253/09663258.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68077700","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 47
BCSE: Blockchain-based trusted service evaluation model over big data BCSE:基于区块链的大数据可信服务评估模型
IF 13.6 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE Pub Date : 2021-12-27 DOI: 10.26599/BDMA.2020.9020028
Fengyin Li;Xinying Yu;Rui Ge;Yanli Wang;Yang Cui;Huiyu Zhou
The blockchain, with its key characteristics of decentralization, persistence, anonymity, and auditability, has become a solution to overcome the overdependence and lack of trust for a traditional public key infrastructure on third-party institutions. Because of these characteristics, the blockchain is suitable for solving certain open problems in the service-oriented social network, where the unreliability of submitted reviews of service vendors can cause serious security problems. To solve the unreliability problems of submitted reviews, this paper first proposes a blockchain-based identity authentication scheme and a new trusted service evaluation model by introducing the scheme into a service evaluation model. The new trusted service evaluation model consists of the blockchain-based identity authentication scheme, evaluation submission module, and evaluation publicity module. In the proposed evaluation model, only users who have successfully been authenticated can submit reviews to service vendors. The registration and authentication records of users' identity and the reviews for service vendors are all stored in the blockchain network. The security analysis shows that this model can ensure the credibility of users' reviews for service vendors, and other users can obtain credible reviews of service vendors via the review publicity module. The experimental results also show that the proposed model has a lower review submission delay than other models.
区块链具有去中心化、持久性、匿名性和可审计性的关键特征,已成为克服传统公钥基础设施对第三方机构过度依赖和缺乏信任的解决方案。由于这些特性,区块链适用于解决面向服务的社交网络中的某些开放性问题,服务供应商提交的评论的不可靠性可能会导致严重的安全问题。为了解决提交评论的不可靠性问题,本文首先提出了一种基于区块链的身份认证方案和一种新的可信服务评估模型,并将该方案引入到服务评估模型中。新的可信服务评估模型由基于区块链的身份认证方案、评估提交模块和评估公示模块组成。在所提出的评估模型中,只有成功通过身份验证的用户才能向服务供应商提交评论。用户身份的注册和认证记录以及对服务供应商的审查都存储在区块链网络中。安全分析表明,该模型可以确保用户对服务供应商的评价的可信度,其他用户可以通过评价公示模块获得服务供应商的可信评价。实验结果还表明,与其他模型相比,所提出的模型具有更低的评审提交延迟。
{"title":"BCSE: Blockchain-based trusted service evaluation model over big data","authors":"Fengyin Li;Xinying Yu;Rui Ge;Yanli Wang;Yang Cui;Huiyu Zhou","doi":"10.26599/BDMA.2020.9020028","DOIUrl":"https://doi.org/10.26599/BDMA.2020.9020028","url":null,"abstract":"The blockchain, with its key characteristics of decentralization, persistence, anonymity, and auditability, has become a solution to overcome the overdependence and lack of trust for a traditional public key infrastructure on third-party institutions. Because of these characteristics, the blockchain is suitable for solving certain open problems in the service-oriented social network, where the unreliability of submitted reviews of service vendors can cause serious security problems. To solve the unreliability problems of submitted reviews, this paper first proposes a blockchain-based identity authentication scheme and a new trusted service evaluation model by introducing the scheme into a service evaluation model. The new trusted service evaluation model consists of the blockchain-based identity authentication scheme, evaluation submission module, and evaluation publicity module. In the proposed evaluation model, only users who have successfully been authenticated can submit reviews to service vendors. The registration and authentication records of users' identity and the reviews for service vendors are all stored in the blockchain network. The security analysis shows that this model can ensure the credibility of users' reviews for service vendors, and other users can obtain credible reviews of service vendors via the review publicity module. The experimental results also show that the proposed model has a lower review submission delay than other models.","PeriodicalId":52355,"journal":{"name":"Big Data Mining and Analytics","volume":"5 1","pages":"1-14"},"PeriodicalIF":13.6,"publicationDate":"2021-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8254253/9663253/09663256.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"68077704","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 18
期刊
Big Data Mining and Analytics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1