一种新的基于深度特征融合网络的点击率预测模型

IF 0.6 4区 工程技术 Q4 MATERIALS SCIENCE, TEXTILES AATCC Journal of Research Pub Date : 2023-01-31 DOI:10.1177/24723444221147967
Xiujin Shi, Yuan Gong, Yiwei Zhang, Yanxia Qin
{"title":"一种新的基于深度特征融合网络的点击率预测模型","authors":"Xiujin Shi, Yuan Gong, Yiwei Zhang, Yanxia Qin","doi":"10.1177/24723444221147967","DOIUrl":null,"url":null,"abstract":"Existing click-through rate prediction models employ both a shallow model and a deep neural model for better feature interaction. The former shallow model aims to extract explainable explicit features and the latter deep neural model aims to learn efficient implicit features. Deep neural network is a commonly used deep neural model, which can yield better performance with more neural layers. However, increasing the number of neural layers would lead to problems such as gradient vanishing, gradient explosion, and excessive parameters. In addition, the performance of a deep neural network will also decrease rapidly when it becomes too deep. In this article, we propose a novel click-through rate prediction model by improving the deep neural model part to alleviate the above problems of deep neural network-based models. This article proposes to utilize a dense deep neural network model to strengthen feature propagation, which takes the outputs of all previous layers as the input of the current layer, instead of only one previous layer being used in the deep neural network. In addition, we also utilize an advanced shallow model FmFM for better explicit features in this article, and explicit and implicit features are interacted in our model. Experiments on two data sets (Criteo and Avazu) show that the proposed click-through rate prediction model significantly outperforms existing classical models such as DeepFM, xDeepFM, and DeepLight models.","PeriodicalId":6955,"journal":{"name":"AATCC Journal of Research","volume":" ","pages":""},"PeriodicalIF":0.6000,"publicationDate":"2023-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Novel Click-Through Rate Prediction Model Based on Deep Feature Fusion Network\",\"authors\":\"Xiujin Shi, Yuan Gong, Yiwei Zhang, Yanxia Qin\",\"doi\":\"10.1177/24723444221147967\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Existing click-through rate prediction models employ both a shallow model and a deep neural model for better feature interaction. The former shallow model aims to extract explainable explicit features and the latter deep neural model aims to learn efficient implicit features. Deep neural network is a commonly used deep neural model, which can yield better performance with more neural layers. However, increasing the number of neural layers would lead to problems such as gradient vanishing, gradient explosion, and excessive parameters. In addition, the performance of a deep neural network will also decrease rapidly when it becomes too deep. In this article, we propose a novel click-through rate prediction model by improving the deep neural model part to alleviate the above problems of deep neural network-based models. This article proposes to utilize a dense deep neural network model to strengthen feature propagation, which takes the outputs of all previous layers as the input of the current layer, instead of only one previous layer being used in the deep neural network. In addition, we also utilize an advanced shallow model FmFM for better explicit features in this article, and explicit and implicit features are interacted in our model. Experiments on two data sets (Criteo and Avazu) show that the proposed click-through rate prediction model significantly outperforms existing classical models such as DeepFM, xDeepFM, and DeepLight models.\",\"PeriodicalId\":6955,\"journal\":{\"name\":\"AATCC Journal of Research\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.6000,\"publicationDate\":\"2023-01-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AATCC Journal of Research\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://doi.org/10.1177/24723444221147967\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"MATERIALS SCIENCE, TEXTILES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AATCC Journal of Research","FirstCategoryId":"88","ListUrlMain":"https://doi.org/10.1177/24723444221147967","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"MATERIALS SCIENCE, TEXTILES","Score":null,"Total":0}
引用次数: 0

摘要

现有的点击率预测模型采用浅层模型和深层神经模型来实现更好的特征交互。前者的浅层神经模型旨在提取可解释的显式特征,后者的深层神经模型旨在学习有效的隐式特征。深度神经网络是一种常用的深度神经模型,神经层数越多,性能越好。然而,增加神经层数会导致梯度消失、梯度爆炸和参数过多等问题。此外,当深度过大时,深度神经网络的性能也会迅速下降。本文通过对深度神经网络模型部分的改进,提出了一种新的点击率预测模型,以缓解基于深度神经网络的模型存在的上述问题。本文提出利用密集深度神经网络模型加强特征传播,将之前所有层的输出作为当前层的输入,而不是在深度神经网络中只使用之前的一层。此外,在本文中,我们还利用了一种先进的浅模型FmFM来获得更好的显式特征,并且在我们的模型中显式和隐式特征是相互作用的。在两个数据集(Criteo和Avazu)上的实验表明,所提出的点击率预测模型显著优于现有的经典模型,如DeepFM、xDeepFM和deelight模型。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A Novel Click-Through Rate Prediction Model Based on Deep Feature Fusion Network
Existing click-through rate prediction models employ both a shallow model and a deep neural model for better feature interaction. The former shallow model aims to extract explainable explicit features and the latter deep neural model aims to learn efficient implicit features. Deep neural network is a commonly used deep neural model, which can yield better performance with more neural layers. However, increasing the number of neural layers would lead to problems such as gradient vanishing, gradient explosion, and excessive parameters. In addition, the performance of a deep neural network will also decrease rapidly when it becomes too deep. In this article, we propose a novel click-through rate prediction model by improving the deep neural model part to alleviate the above problems of deep neural network-based models. This article proposes to utilize a dense deep neural network model to strengthen feature propagation, which takes the outputs of all previous layers as the input of the current layer, instead of only one previous layer being used in the deep neural network. In addition, we also utilize an advanced shallow model FmFM for better explicit features in this article, and explicit and implicit features are interacted in our model. Experiments on two data sets (Criteo and Avazu) show that the proposed click-through rate prediction model significantly outperforms existing classical models such as DeepFM, xDeepFM, and DeepLight models.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
AATCC Journal of Research
AATCC Journal of Research MATERIALS SCIENCE, TEXTILES-
CiteScore
1.30
自引率
0.00%
发文量
34
期刊介绍: AATCC Journal of Research. This textile research journal has a broad scope: from advanced materials, fibers, and textile and polymer chemistry, to color science, apparel design, and sustainability. Now indexed by Science Citation Index Extended (SCIE) and discoverable in the Clarivate Analytics Web of Science Core Collection! The Journal’s impact factor is available in Journal Citation Reports.
期刊最新文献
Effect of Microwave Irradiation on Coloring and Mechanical Properties of Direct Dyed Fabric Statistical Optimization of Process Variables for the Dyeing of Jute with Marigold Petals Using a Dual Mordant System Application of Rare Earth Marking on Anti-counterfeiting Waterless/Less-Water Dyeing Technology Carbon Footprint of Wool at Cradle to Farm-Gate Stage in Victoria, Australia A Novel Polyvinylidene Fluoride/Keratin Electret Filter With Comprehensive Performance and High-Efficiency PM0.3 Removal
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1