{"title":"一种新的基于深度特征融合网络的点击率预测模型","authors":"Xiujin Shi, Yuan Gong, Yiwei Zhang, Yanxia Qin","doi":"10.1177/24723444221147967","DOIUrl":null,"url":null,"abstract":"Existing click-through rate prediction models employ both a shallow model and a deep neural model for better feature interaction. The former shallow model aims to extract explainable explicit features and the latter deep neural model aims to learn efficient implicit features. Deep neural network is a commonly used deep neural model, which can yield better performance with more neural layers. However, increasing the number of neural layers would lead to problems such as gradient vanishing, gradient explosion, and excessive parameters. In addition, the performance of a deep neural network will also decrease rapidly when it becomes too deep. In this article, we propose a novel click-through rate prediction model by improving the deep neural model part to alleviate the above problems of deep neural network-based models. This article proposes to utilize a dense deep neural network model to strengthen feature propagation, which takes the outputs of all previous layers as the input of the current layer, instead of only one previous layer being used in the deep neural network. In addition, we also utilize an advanced shallow model FmFM for better explicit features in this article, and explicit and implicit features are interacted in our model. Experiments on two data sets (Criteo and Avazu) show that the proposed click-through rate prediction model significantly outperforms existing classical models such as DeepFM, xDeepFM, and DeepLight models.","PeriodicalId":6955,"journal":{"name":"AATCC Journal of Research","volume":" ","pages":""},"PeriodicalIF":0.6000,"publicationDate":"2023-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Novel Click-Through Rate Prediction Model Based on Deep Feature Fusion Network\",\"authors\":\"Xiujin Shi, Yuan Gong, Yiwei Zhang, Yanxia Qin\",\"doi\":\"10.1177/24723444221147967\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Existing click-through rate prediction models employ both a shallow model and a deep neural model for better feature interaction. The former shallow model aims to extract explainable explicit features and the latter deep neural model aims to learn efficient implicit features. Deep neural network is a commonly used deep neural model, which can yield better performance with more neural layers. However, increasing the number of neural layers would lead to problems such as gradient vanishing, gradient explosion, and excessive parameters. In addition, the performance of a deep neural network will also decrease rapidly when it becomes too deep. In this article, we propose a novel click-through rate prediction model by improving the deep neural model part to alleviate the above problems of deep neural network-based models. This article proposes to utilize a dense deep neural network model to strengthen feature propagation, which takes the outputs of all previous layers as the input of the current layer, instead of only one previous layer being used in the deep neural network. In addition, we also utilize an advanced shallow model FmFM for better explicit features in this article, and explicit and implicit features are interacted in our model. Experiments on two data sets (Criteo and Avazu) show that the proposed click-through rate prediction model significantly outperforms existing classical models such as DeepFM, xDeepFM, and DeepLight models.\",\"PeriodicalId\":6955,\"journal\":{\"name\":\"AATCC Journal of Research\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.6000,\"publicationDate\":\"2023-01-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AATCC Journal of Research\",\"FirstCategoryId\":\"88\",\"ListUrlMain\":\"https://doi.org/10.1177/24723444221147967\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"MATERIALS SCIENCE, TEXTILES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AATCC Journal of Research","FirstCategoryId":"88","ListUrlMain":"https://doi.org/10.1177/24723444221147967","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"MATERIALS SCIENCE, TEXTILES","Score":null,"Total":0}
A Novel Click-Through Rate Prediction Model Based on Deep Feature Fusion Network
Existing click-through rate prediction models employ both a shallow model and a deep neural model for better feature interaction. The former shallow model aims to extract explainable explicit features and the latter deep neural model aims to learn efficient implicit features. Deep neural network is a commonly used deep neural model, which can yield better performance with more neural layers. However, increasing the number of neural layers would lead to problems such as gradient vanishing, gradient explosion, and excessive parameters. In addition, the performance of a deep neural network will also decrease rapidly when it becomes too deep. In this article, we propose a novel click-through rate prediction model by improving the deep neural model part to alleviate the above problems of deep neural network-based models. This article proposes to utilize a dense deep neural network model to strengthen feature propagation, which takes the outputs of all previous layers as the input of the current layer, instead of only one previous layer being used in the deep neural network. In addition, we also utilize an advanced shallow model FmFM for better explicit features in this article, and explicit and implicit features are interacted in our model. Experiments on two data sets (Criteo and Avazu) show that the proposed click-through rate prediction model significantly outperforms existing classical models such as DeepFM, xDeepFM, and DeepLight models.
期刊介绍:
AATCC Journal of Research. This textile research journal has a broad scope: from advanced materials, fibers, and textile and polymer chemistry, to color science, apparel design, and sustainability.
Now indexed by Science Citation Index Extended (SCIE) and discoverable in the Clarivate Analytics Web of Science Core Collection! The Journal’s impact factor is available in Journal Citation Reports.