首页 > 最新文献

2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)最新文献

英文 中文
Image Caption Model Based on Multi-Head Attention and Encoder-Decoder Framework 基于多头注意和编码器框架的图像标题模型
Jianwei Luo, Li Ma
In recently, image caption tasks are solved by using the LSTM to generate description. However, the model only accords image features and is hard to learn existing syntactic features, thereby lead to generate inaccurate description. In this paper, an image captioning model based on multi-head attention mechanism is presented. Specifically, the proposed model adopts Encoder-Decoder framework. A five-layer ResNet is used in Encoder module to extract image features. Multi-head attention layer and full connection feed forward layer are added to Decoder module. In addition, to capture the order of extracting feature sequences, the position-coded is used as a determining factor While calculating multi-head self-attention. Compared With the other current models based on various visual attention mechanisms, experimental results show that the proposed model has better performance.
近年来,利用LSTM生成描述来解决图像标题任务。然而,该模型只符合图像特征,难以学习现有的语法特征,从而导致生成的描述不准确。本文提出了一种基于多头注意机制的图像字幕模型。具体来说,该模型采用了编码器-解码器框架。Encoder模块使用五层ResNet来提取图像特征。解码器模块增加了多头注意层和全连接前馈层。此外,为了捕获提取特征序列的顺序,在计算多头自关注时,将位置编码作为决定因素。实验结果表明,与现有基于各种视觉注意机制的模型相比,本文提出的模型具有更好的性能。
{"title":"Image Caption Model Based on Multi-Head Attention and Encoder-Decoder Framework","authors":"Jianwei Luo, Li Ma","doi":"10.1109/ISKE47853.2019.9170306","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170306","url":null,"abstract":"In recently, image caption tasks are solved by using the LSTM to generate description. However, the model only accords image features and is hard to learn existing syntactic features, thereby lead to generate inaccurate description. In this paper, an image captioning model based on multi-head attention mechanism is presented. Specifically, the proposed model adopts Encoder-Decoder framework. A five-layer ResNet is used in Encoder module to extract image features. Multi-head attention layer and full connection feed forward layer are added to Decoder module. In addition, to capture the order of extracting feature sequences, the position-coded is used as a determining factor While calculating multi-head self-attention. Compared With the other current models based on various visual attention mechanisms, experimental results show that the proposed model has better performance.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"33 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114718658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A New Approach to Predict the Location of Petroleum Reservoirs Using FFNN 一种利用FFNN预测油藏位置的新方法
N. Jaber, A. Hussein, H. Almalikee
In the petroleum industry, data management reis is crucial to the success of petroleum projects. In particular, data acquisition, storage, and classification are major concerns of oil and gas companies. This study therefore focuses on the problem of predicting a petroleum point (a possible oil reservoir) using the data generated by well loggers from the propagation of a set of sensors at different depths within a well. The training of a feedforward neural network (FFNN) model by the LevenbergMarquardt (LM) algorithm involves a random allotment of weight/bias values over multiple epochs to reduce the variance between testing and training data. Random weight assignment degrades the performance of the model, as the variance between testing and training data will remain uncertain. In this paper, a novel method, called modified feedforward neural network (MFFNN) is proposed by freezing the weight/bias coefficients to predict petrol reservoirs with minimal error. The MFFNN outperforms existing conventional models and machine learning algorithms.
在石油工业中,数据管理对石油项目的成功至关重要。特别是,数据采集、存储和分类是油气公司的主要关注点。因此,本研究的重点是利用测井仪在井内不同深度传播的一组传感器产生的数据来预测石油点(可能的油藏)的问题。利用LevenbergMarquardt (LM)算法对前馈神经网络(FFNN)模型进行训练,需要在多个epoch上随机分配权重/偏置值,以减小测试数据与训练数据之间的方差。随机权重分配会降低模型的性能,因为测试数据和训练数据之间的方差仍然是不确定的。本文提出了一种修正前馈神经网络(MFFNN)的新方法,通过冻结权重/偏置系数来实现最小误差的油藏预测。MFFNN优于现有的传统模型和机器学习算法。
{"title":"A New Approach to Predict the Location of Petroleum Reservoirs Using FFNN","authors":"N. Jaber, A. Hussein, H. Almalikee","doi":"10.1109/ISKE47853.2019.9170378","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170378","url":null,"abstract":"In the petroleum industry, data management reis is crucial to the success of petroleum projects. In particular, data acquisition, storage, and classification are major concerns of oil and gas companies. This study therefore focuses on the problem of predicting a petroleum point (a possible oil reservoir) using the data generated by well loggers from the propagation of a set of sensors at different depths within a well. The training of a feedforward neural network (FFNN) model by the LevenbergMarquardt (LM) algorithm involves a random allotment of weight/bias values over multiple epochs to reduce the variance between testing and training data. Random weight assignment degrades the performance of the model, as the variance between testing and training data will remain uncertain. In this paper, a novel method, called modified feedforward neural network (MFFNN) is proposed by freezing the weight/bias coefficients to predict petrol reservoirs with minimal error. The MFFNN outperforms existing conventional models and machine learning algorithms.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132302721","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Residual Neural Network and Wing Loss for Face Alignment Network 面对齐网络的残差神经网络和翼损
Li Wang, Wei Xiang
Face recognition has made great progress due to the development of convolutional neural network (CNN), and face alignment is an important part of recognition, it is easily affected by gestures and occlusion. In this paper, we propose Residual Neural Network and Wing Loss for Face Alignment Network (RWAN), which consists of a plurality of stages, each stage ameliorates the position of facial landmarks estimated from the previous stage. Unlike the traditional cascading model, the network model uses the Residual Neural Network, which is easily to optimize and can improve accuracy by adding considerable depth, the internal residual block uses shortcut to alleviate the gradient explosion problem caused by increasing depth in deep neural network. Enter the face images and extract features from the entire image by introducing landmark heatmaps to obtain more accurate positioning. Using wing loss in the loss function part not only focuses on the landmark of large error points, but also on the small and medium errors of landmarks, it aims to improve the training ability of deep neural network with small and medium range error. The problem of unbalanced data not only confuses classification tasks, but also affects the accuracy of the model when face samples of different attitudes are not balanced in face key detection tasks. a simple but effective data enhancement method is proposed to deal with the problem, which solves the problem of unbalanced data processing by randomly rotating the training samples, amplifying and the like. The experimental results obtained by our method on the 300W dataset indicate the advantages of this method.
由于卷积神经网络(CNN)的发展,人脸识别取得了很大的进步,而人脸对齐是识别的重要组成部分,它容易受到手势和遮挡的影响。在本文中,我们提出了残差神经网络和机翼损失的人脸对齐网络(RWAN),该网络由多个阶段组成,每个阶段都改善了从前一阶段估计的面部标志的位置。与传统的级联模型不同,该网络模型采用残差神经网络,易于优化,通过增加相当大的深度可以提高精度,内部残差块采用捷径,缓解了深度神经网络中增加深度引起的梯度爆炸问题。输入人脸图像,通过引入地标热图从整个图像中提取特征,以获得更准确的定位。在损失函数部分使用机翼损失,既关注大误差点的地标,也关注地标的中小型误差,旨在提高具有中小型误差的深度神经网络的训练能力。在人脸关键字检测任务中,当不同态度的人脸样本不平衡时,数据不平衡问题不仅会混淆分类任务,而且会影响模型的准确性。针对这一问题,提出了一种简单有效的数据增强方法,通过随机旋转训练样本、放大等方法解决了数据处理不平衡的问题。在300W数据集上的实验结果表明了该方法的优越性。
{"title":"Residual Neural Network and Wing Loss for Face Alignment Network","authors":"Li Wang, Wei Xiang","doi":"10.1109/ISKE47853.2019.9170374","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170374","url":null,"abstract":"Face recognition has made great progress due to the development of convolutional neural network (CNN), and face alignment is an important part of recognition, it is easily affected by gestures and occlusion. In this paper, we propose Residual Neural Network and Wing Loss for Face Alignment Network (RWAN), which consists of a plurality of stages, each stage ameliorates the position of facial landmarks estimated from the previous stage. Unlike the traditional cascading model, the network model uses the Residual Neural Network, which is easily to optimize and can improve accuracy by adding considerable depth, the internal residual block uses shortcut to alleviate the gradient explosion problem caused by increasing depth in deep neural network. Enter the face images and extract features from the entire image by introducing landmark heatmaps to obtain more accurate positioning. Using wing loss in the loss function part not only focuses on the landmark of large error points, but also on the small and medium errors of landmarks, it aims to improve the training ability of deep neural network with small and medium range error. The problem of unbalanced data not only confuses classification tasks, but also affects the accuracy of the model when face samples of different attitudes are not balanced in face key detection tasks. a simple but effective data enhancement method is proposed to deal with the problem, which solves the problem of unbalanced data processing by randomly rotating the training samples, amplifying and the like. The experimental results obtained by our method on the 300W dataset indicate the advantages of this method.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128222343","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
An Improved Density Peaks Clustering based on Rough Set Theory for Overlapping Community Detection 基于粗糙集理论的改进密度峰聚类重叠社区检测
Yunfei Feng, Hongmei Chen
Mining community structure from network data set is an important research task in machine learning. Overlapping community detection is more complex due to the ambiguous of nodes which may be partitioned to different communities simultaneously. In this paper, an improved density peaks clustering is proposed to overlapping community detection. The rough set theory based uncertain similarity between nodes is defined in dual-nucleus subspace by fully considering the topological structure. Different strategies are used in density peaks clustering to improve the efficiency and the performance of the community division. Furthermore, rough set theory is employed to describe the overlapping nodes and rough set theory based overlapping community detection algorithm is proposed. Experiments are carried out on real-world social networks and artificial networks. The experimental results show that RSDPCD is effective.
从网络数据集中挖掘社区结构是机器学习领域的一个重要研究课题。由于节点的模糊性,可能会同时被划分到不同的社区,使得重叠社区检测更加复杂。本文提出了一种改进的密度峰聚类方法用于重叠社团检测。在充分考虑拓扑结构的基础上,在双核子空间中定义了基于粗糙集理论的节点间不确定相似度。在密度峰聚类中采用了不同的策略来提高社区划分的效率和性能。利用粗糙集理论对重叠节点进行描述,提出了基于粗糙集理论的重叠社团检测算法。实验分别在现实社会网络和人工网络上进行。实验结果表明,RSDPCD是有效的。
{"title":"An Improved Density Peaks Clustering based on Rough Set Theory for Overlapping Community Detection","authors":"Yunfei Feng, Hongmei Chen","doi":"10.1109/ISKE47853.2019.9170407","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170407","url":null,"abstract":"Mining community structure from network data set is an important research task in machine learning. Overlapping community detection is more complex due to the ambiguous of nodes which may be partitioned to different communities simultaneously. In this paper, an improved density peaks clustering is proposed to overlapping community detection. The rough set theory based uncertain similarity between nodes is defined in dual-nucleus subspace by fully considering the topological structure. Different strategies are used in density peaks clustering to improve the efficiency and the performance of the community division. Furthermore, rough set theory is employed to describe the overlapping nodes and rough set theory based overlapping community detection algorithm is proposed. Experiments are carried out on real-world social networks and artificial networks. The experimental results show that RSDPCD is effective.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128392978","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
A Genetic Algorithm Based Piecewise Linear Representation of Time Series 基于遗传算法的时间序列分段线性表示
Xiyang Yang, Changxin Zhai, Fang Li, Longshu Liu, Youhua Zhang
Line Segment Representation (LSR) refers to represents a time series by a few of line segments, such that the original time series and the piecewise line segment series have shapes as similar as possible. Because of its simple expression, LSR based time series are often easier to be understood and computed for some time series datamining tasks than the original raw data. Two kinds of continuous LSR methods, namely, 11 trend filtering and mix-integer programming (MILP) method, are discussed in this paper. To overcome the poor representation ability of l1 trend filtering, and the high computational complexity of MILP, this paper proposes a hybrid method combining GA and linear programming (GA-LP) to find the optimal LSR time series efficiently. In GA-LP, locations of the breakpoints of the piecewise linear segment are fixed by GA, and values on these locations are fixed by a LP method. Numerical experiments reveal that GA-LP can reduce representation error by comparisons with l1 trend filtering and MILP method, and its computing time is much less than that of MILP.
线段表示(Line Segment Representation, LSR)是指用几条线段表示一个时间序列,使原始时间序列和分段线段序列的形状尽可能相似。由于其简单的表达式,对于一些时间序列数据挖掘任务,基于LSR的时间序列通常比原始原始数据更容易理解和计算。讨论了两种连续LSR方法,即11趋势滤波和混合整数规划(MILP)方法。为了克服l1趋势滤波表示能力差和MILP计算复杂度高的缺点,本文提出了一种结合遗传算法和线性规划(GA- lp)的混合方法来高效地寻找最优LSR时间序列。在GA-LP中,分段线性线段的断点位置由GA确定,断点位置上的值由LP方法确定。数值实验表明,与l1趋势滤波和MILP方法相比,GA-LP方法可以减小表示误差,且计算时间大大少于MILP方法。
{"title":"A Genetic Algorithm Based Piecewise Linear Representation of Time Series","authors":"Xiyang Yang, Changxin Zhai, Fang Li, Longshu Liu, Youhua Zhang","doi":"10.1109/ISKE47853.2019.9170463","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170463","url":null,"abstract":"Line Segment Representation (LSR) refers to represents a time series by a few of line segments, such that the original time series and the piecewise line segment series have shapes as similar as possible. Because of its simple expression, LSR based time series are often easier to be understood and computed for some time series datamining tasks than the original raw data. Two kinds of continuous LSR methods, namely, 11 trend filtering and mix-integer programming (MILP) method, are discussed in this paper. To overcome the poor representation ability of l1 trend filtering, and the high computational complexity of MILP, this paper proposes a hybrid method combining GA and linear programming (GA-LP) to find the optimal LSR time series efficiently. In GA-LP, locations of the breakpoints of the piecewise linear segment are fixed by GA, and values on these locations are fixed by a LP method. Numerical experiments reveal that GA-LP can reduce representation error by comparisons with l1 trend filtering and MILP method, and its computing time is much less than that of MILP.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"47 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134371831","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Hierarchical Region Merging for Multi-scale Image Segmentation 基于分层区域合并的多尺度图像分割
Xiaojun Ma, B. Peng, Xun Gong, Zeng Yu, Tianrui Li
Image segmentation is a key computer vision technique that divides the pixels of an image into different blocks of distinct transactions. The multi-scale segmentation method is one of the image segmentation methods, which can extract the object regions of different scales. It has the potential to fully exploit the application of high resolution and complex scene images and is the research hotspots direction of image segmentation technology. In this work, a feasible image scale-aware algorithm is proposed. By using the segmentation results of the existing multi-scale segmentation algorithm, the global region’s hierarchical region is merged by the quantitative description of each hierarchical region feature to achieve the optimal scale of multi-scale segmentation. We validate the proposed method on different algorithms and data sets. The results have shown that the proposed method can solve the error caused by manual threshold setting and achieve the optimal selection of individual goals to a certain extent.
图像分割是一种关键的计算机视觉技术,它将图像的像素划分为不同的事务块。多尺度分割方法是图像分割方法中的一种,它可以提取不同尺度的目标区域。它具有充分开发高分辨率和复杂场景图像应用的潜力,是图像分割技术的研究热点方向。本文提出了一种可行的图像尺度感知算法。利用现有多尺度分割算法的分割结果,通过对各层次区域特征的定量描述,对全局区域的层次区域进行合并,实现多尺度分割的最优尺度。我们在不同的算法和数据集上验证了所提出的方法。结果表明,该方法可以解决人工阈值设置带来的误差,在一定程度上实现了个体目标的最优选择。
{"title":"Hierarchical Region Merging for Multi-scale Image Segmentation","authors":"Xiaojun Ma, B. Peng, Xun Gong, Zeng Yu, Tianrui Li","doi":"10.1109/ISKE47853.2019.9170297","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170297","url":null,"abstract":"Image segmentation is a key computer vision technique that divides the pixels of an image into different blocks of distinct transactions. The multi-scale segmentation method is one of the image segmentation methods, which can extract the object regions of different scales. It has the potential to fully exploit the application of high resolution and complex scene images and is the research hotspots direction of image segmentation technology. In this work, a feasible image scale-aware algorithm is proposed. By using the segmentation results of the existing multi-scale segmentation algorithm, the global region’s hierarchical region is merged by the quantitative description of each hierarchical region feature to achieve the optimal scale of multi-scale segmentation. We validate the proposed method on different algorithms and data sets. The results have shown that the proposed method can solve the error caused by manual threshold setting and achieve the optimal selection of individual goals to a certain extent.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"29 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134265345","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
A Recommender System for Cold-start Items: A Case Study in the Real Estate Industry 冷启动项目的推荐系统:以房地产行业为例
Qian Zhang, Di Zhang, Jie Lu, Guangquan Zhang, Wei Qu, M. Cohen
The recommender systems provide users with what they prefer and filter unnecessary information. In the fierce marketing environment, it is crucial to recommend items to users in an early stage to keep user’s interests and loyalty. With the fast product renewal, classical recommendation methods such as collaborative filtering cannot handle the cold-start item problem. In many real-world applications, content information of items or users is available and can be used to assist recommendation. Besides, user may interact with the items in different behaviors such as view, click or subscribe. How to use the complex content information and multiple user behaviors are real problems that are not well solved in applications. In this paper, we propose a content-based recommender system to deal with the practical problem. Boosting tree model also added to the system to avoid potential Spam. We applied our developed method to real estate application to recommend new property which just landed into the market to users. Experimental results with three data subsets and three recommendation scenarios demonstrate that the proposed method can outperform the baseline on recommendation accuracy. The results indicate that our method can effectively reduce potential Spam to users, so that user experience will be improved.
推荐系统为用户提供他们喜欢的东西,并过滤不必要的信息。在激烈的营销环境中,早期向用户推荐商品对于保持用户的兴趣和忠诚度至关重要。随着产品更新速度的加快,传统的协同过滤等推荐方法无法处理冷启动产品问题。在许多实际应用程序中,项目或用户的内容信息是可用的,可以用来辅助推荐。此外,用户还可以通过查看、点击、订阅等不同的行为与项目进行交互。如何利用复杂的内容信息和多种用户行为是应用中尚未很好解决的现实问题。在本文中,我们提出了一个基于内容的推荐系统来解决实际问题。提升树模型也添加到系统中,以避免潜在的垃圾邮件。我们将开发的方法应用到房地产应用中,向用户推荐刚刚上市的新房产。在三个数据子集和三个推荐场景下的实验结果表明,该方法在推荐准确率上优于基线。结果表明,我们的方法可以有效地减少潜在的垃圾邮件,从而提高用户体验。
{"title":"A Recommender System for Cold-start Items: A Case Study in the Real Estate Industry","authors":"Qian Zhang, Di Zhang, Jie Lu, Guangquan Zhang, Wei Qu, M. Cohen","doi":"10.1109/ISKE47853.2019.9170411","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170411","url":null,"abstract":"The recommender systems provide users with what they prefer and filter unnecessary information. In the fierce marketing environment, it is crucial to recommend items to users in an early stage to keep user’s interests and loyalty. With the fast product renewal, classical recommendation methods such as collaborative filtering cannot handle the cold-start item problem. In many real-world applications, content information of items or users is available and can be used to assist recommendation. Besides, user may interact with the items in different behaviors such as view, click or subscribe. How to use the complex content information and multiple user behaviors are real problems that are not well solved in applications. In this paper, we propose a content-based recommender system to deal with the practical problem. Boosting tree model also added to the system to avoid potential Spam. We applied our developed method to real estate application to recommend new property which just landed into the market to users. Experimental results with three data subsets and three recommendation scenarios demonstrate that the proposed method can outperform the baseline on recommendation accuracy. The results indicate that our method can effectively reduce potential Spam to users, so that user experience will be improved.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"56 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133075449","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Knowledge-Aware LSTM for Machine Comprehension 面向机器理解的知识感知LSTM
Zhuang Liu, Kaiyu Huang, Ziyu Gao, Degen Huang
Machine Comprehension (MC) of text is the problem to answer a query based on a given document. Although MC has been very popular recently, it still have some serious weaknesses which rely only on query-to-document interaction or its learning is just heavily dependent on the training data. To take advantage of external knowledge to improve neural networks for MC, we propose a novel knowledge enhanced recurrent neural model, called knowledge-aware LSTM (k-LSTM), an extension to basic LSTM cells, designed to exploit external knowledge bases (KBs) to improve neural networks for MC task. To incorporate KBs with contextual information effectively from the currently text, k-LSTM employs an compositional attention mechanism to adaptively decide whether to attend to KBs and which information from external knowledge is useful. Furthermore, we present our knowledge enhanced neural network, called Knowledge-guided DIM Reader (K-DIM Reader), which is a novel knowledge-aware compositional attention neural network architecture, employing the k-LSTM in our framework. By stringing external background knowledge together and imposing compositional attention interaction that regulate their interaction, K-DIM Reader effectively learns to perform reading comprehension processes that are directly inferred from the data in an end-to-end approach. We show our proposed models strength, robustness and interpretability on the challenging MC datasets, achieving significant improvements on SQuAD dataset [1] and obtaining new state-of-the-art results on both Cloze-style datasets, CBTest [2] and CNN news [3]. In particular, we further extend 6 popular end-to-end neural MC models using k-LSTM incorporating knowledge into models for improving MC, and evaluate their performance on both well-known MC datasets. We demonstrate that neural model with external knowledge improves performance on MC task.
文本的机器理解(MC)是基于给定文档回答查询的问题。尽管MC最近非常流行,但它仍然存在一些严重的弱点,仅依赖于查询到文档的交互,或者它的学习严重依赖于训练数据。为了利用外部知识来改进MC神经网络,我们提出了一种新的知识增强递归神经模型,称为知识感知LSTM (k-LSTM),它是基本LSTM单元的扩展,旨在利用外部知识库来改进MC任务的神经网络。为了将KBs与当前文本的上下文信息有效地结合起来,k-LSTM采用了一种组合注意机制来自适应地决定是否关注KBs以及来自外部知识的哪些信息是有用的。在此基础上,我们提出了一种新的知识感知组合注意力神经网络体系结构——知识引导DIM Reader (K-DIM Reader)。通过将外部背景知识串在一起,并施加调节其相互作用的组成注意交互,K-DIM Reader有效地学习执行直接从数据中推断的端到端阅读理解过程。我们在具有挑战性的MC数据集上展示了我们提出的模型的强度、鲁棒性和可解释性,在SQuAD数据集[1]上取得了显著的改进,并在cloce风格的数据集、CBTest[2]和CNN news[3]上获得了最新的结果。特别地,我们使用k-LSTM进一步扩展了6种流行的端到端神经网络MC模型,并将知识纳入模型以改进MC,并评估了它们在两个已知MC数据集上的性能。我们证明了带有外部知识的神经模型可以提高MC任务的性能。
{"title":"Knowledge-Aware LSTM for Machine Comprehension","authors":"Zhuang Liu, Kaiyu Huang, Ziyu Gao, Degen Huang","doi":"10.1109/ISKE47853.2019.9170351","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170351","url":null,"abstract":"Machine Comprehension (MC) of text is the problem to answer a query based on a given document. Although MC has been very popular recently, it still have some serious weaknesses which rely only on query-to-document interaction or its learning is just heavily dependent on the training data. To take advantage of external knowledge to improve neural networks for MC, we propose a novel knowledge enhanced recurrent neural model, called knowledge-aware LSTM (k-LSTM), an extension to basic LSTM cells, designed to exploit external knowledge bases (KBs) to improve neural networks for MC task. To incorporate KBs with contextual information effectively from the currently text, k-LSTM employs an compositional attention mechanism to adaptively decide whether to attend to KBs and which information from external knowledge is useful. Furthermore, we present our knowledge enhanced neural network, called Knowledge-guided DIM Reader (K-DIM Reader), which is a novel knowledge-aware compositional attention neural network architecture, employing the k-LSTM in our framework. By stringing external background knowledge together and imposing compositional attention interaction that regulate their interaction, K-DIM Reader effectively learns to perform reading comprehension processes that are directly inferred from the data in an end-to-end approach. We show our proposed models strength, robustness and interpretability on the challenging MC datasets, achieving significant improvements on SQuAD dataset [1] and obtaining new state-of-the-art results on both Cloze-style datasets, CBTest [2] and CNN news [3]. In particular, we further extend 6 popular end-to-end neural MC models using k-LSTM incorporating knowledge into models for improving MC, and evaluate their performance on both well-known MC datasets. We demonstrate that neural model with external knowledge improves performance on MC task.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122230571","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A Novel Decentralized Blockchain Networks Model with High Concurrenc(Blockchain Networks Model with High Concurrency) 一种新型的高并发去中心化区块链网络模型(Blockchain Networks Model with High Concurrency)
Linghao Zhang, Bingde Lu, Tao Zhao, Hongjun Wang
Blockchain is very important in finance field and electronic business field, so many researchers are attracted to study the technologies of blockchain. Since the transactions in blockchain takes much time, and they make the blockchain poor efficiency, business processes across organizations require the transactions as soon as possible. Concurrency is attracted much attention and is very important in blockchain field. In this paper, a novel decentralized blockchain network model with high concurrency is proposed. First, the idea of the proposed model is stated. Second, the high concurrency blockchain network model is proposed. Third, the corresponding algorithms are designed according to the proposed model. Furthermore, the experiment is conduced and the results show that proposed model works well.
区块链在金融领域和电子商务领域有着重要的作用,因此吸引了众多研究者对区块链技术进行研究。由于区块链中的交易耗时长,使得区块链效率低下,跨组织的业务流程要求交易尽快完成。并发性是区块链领域中备受关注和非常重要的问题。本文提出了一种新型的高并发分布式区块链网络模型。首先,阐述了所提模型的思想。其次,提出了高并发区块链网络模型。第三,根据提出的模型设计相应的算法。最后进行了实验,结果表明该模型是有效的。
{"title":"A Novel Decentralized Blockchain Networks Model with High Concurrenc(Blockchain Networks Model with High Concurrency)","authors":"Linghao Zhang, Bingde Lu, Tao Zhao, Hongjun Wang","doi":"10.1109/ISKE47853.2019.9170359","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170359","url":null,"abstract":"Blockchain is very important in finance field and electronic business field, so many researchers are attracted to study the technologies of blockchain. Since the transactions in blockchain takes much time, and they make the blockchain poor efficiency, business processes across organizations require the transactions as soon as possible. Concurrency is attracted much attention and is very important in blockchain field. In this paper, a novel decentralized blockchain network model with high concurrency is proposed. First, the idea of the proposed model is stated. Second, the high concurrency blockchain network model is proposed. Third, the corresponding algorithms are designed according to the proposed model. Furthermore, the experiment is conduced and the results show that proposed model works well.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125522227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On the Automatic Assessment of Learning Outcome in Programming Techniques 编程技术学习成果的自动评估研究
Brigitte Hass, C. Yuan, Zhong Li
With the introduction of digital media and the rapid spreading of the digitalization process in our society, there is an increased need in the use of online methods for the automatic evaluation of learning outcomes. Such kinds of electronic assessments (abbr. E-Assessment) are of particular importance in the areas of science and engineering education, where students have to learn and exercise on programming techniques. In this work, we have reviewed and analyzed existing approaches aiming at automatic verification of computer programs for teaching and learning purposes. Based on the capabilities and characteristics of these systems, they have been clustered into three categories. After the study of the strengths and limitations of these approaches, we put forward our view on several aspects which are relevant for an E-Assessment system. Our further contribution lies in the discussion of relevant research questions as well as the potential impacts of E-Assessment in future academic teaching.
随着数字媒体的引入和数字化进程在我们社会的迅速传播,人们越来越需要使用在线方法来自动评估学习成果。这种电子评估(简称E-Assessment)在学生必须学习和练习编程技术的科学和工程教育领域尤为重要。在这项工作中,我们回顾和分析了现有的用于教学和学习目的的计算机程序自动验证的方法。根据这些系统的功能和特点,将它们分为三类。在研究了这些方法的优势和局限性之后,我们提出了与电子评估系统相关的几个方面的观点。我们进一步的贡献在于讨论相关的研究问题以及E-Assessment对未来学术教学的潜在影响。
{"title":"On the Automatic Assessment of Learning Outcome in Programming Techniques","authors":"Brigitte Hass, C. Yuan, Zhong Li","doi":"10.1109/ISKE47853.2019.9170370","DOIUrl":"https://doi.org/10.1109/ISKE47853.2019.9170370","url":null,"abstract":"With the introduction of digital media and the rapid spreading of the digitalization process in our society, there is an increased need in the use of online methods for the automatic evaluation of learning outcomes. Such kinds of electronic assessments (abbr. E-Assessment) are of particular importance in the areas of science and engineering education, where students have to learn and exercise on programming techniques. In this work, we have reviewed and analyzed existing approaches aiming at automatic verification of computer programs for teaching and learning purposes. Based on the capabilities and characteristics of these systems, they have been clustered into three categories. After the study of the strengths and limitations of these approaches, we put forward our view on several aspects which are relevant for an E-Assessment system. Our further contribution lies in the discussion of relevant research questions as well as the potential impacts of E-Assessment in future academic teaching.","PeriodicalId":399084,"journal":{"name":"2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130422159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
2019 IEEE 14th International Conference on Intelligent Systems and Knowledge Engineering (ISKE)
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1