Xingxin Zhang, S. Shi, Zhi-xiong Guo, Gang Chen, Han Wei, Yongwang Tang, Liuyang Yu
{"title":"通过深度学习转换器的噪声增强控制文本样式转移","authors":"Xingxin Zhang, S. Shi, Zhi-xiong Guo, Gang Chen, Han Wei, Yongwang Tang, Liuyang Yu","doi":"10.1117/12.2639492","DOIUrl":null,"url":null,"abstract":"Text style transfer is one of the controllable text generation tasks, which can convert text style attributes. The mainstream method is to separate the content and style of the text, and then combine the content vectors with other style vectors to generate. However, implicit expression cannot completely separate meaning and style, separation and recombination may also lead to a decrease in the naturalness and fluency of the text. Therefore, we propose a new idea, which first encodes the text into a latent representation, and iteratively optimizes the latent representation with the smallest changes to achieve style transfer. Introducing noise enhancement before generating results improves the robustness of the generated system and reduces the occurrence of individual results with large errors. Experiments show that our optimization method based on noise enhancement performs well on two public datasets, Yelp and Amazon. Result has excellent performance in three indicators: content preservation, transfer strength, and fluency.","PeriodicalId":336892,"journal":{"name":"Neural Networks, Information and Communication Engineering","volume":"162 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Controlled text style transfer via noise enhancement of deep learning transformer\",\"authors\":\"Xingxin Zhang, S. Shi, Zhi-xiong Guo, Gang Chen, Han Wei, Yongwang Tang, Liuyang Yu\",\"doi\":\"10.1117/12.2639492\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Text style transfer is one of the controllable text generation tasks, which can convert text style attributes. The mainstream method is to separate the content and style of the text, and then combine the content vectors with other style vectors to generate. However, implicit expression cannot completely separate meaning and style, separation and recombination may also lead to a decrease in the naturalness and fluency of the text. Therefore, we propose a new idea, which first encodes the text into a latent representation, and iteratively optimizes the latent representation with the smallest changes to achieve style transfer. Introducing noise enhancement before generating results improves the robustness of the generated system and reduces the occurrence of individual results with large errors. Experiments show that our optimization method based on noise enhancement performs well on two public datasets, Yelp and Amazon. Result has excellent performance in three indicators: content preservation, transfer strength, and fluency.\",\"PeriodicalId\":336892,\"journal\":{\"name\":\"Neural Networks, Information and Communication Engineering\",\"volume\":\"162 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-06-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neural Networks, Information and Communication Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2639492\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks, Information and Communication Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2639492","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Controlled text style transfer via noise enhancement of deep learning transformer
Text style transfer is one of the controllable text generation tasks, which can convert text style attributes. The mainstream method is to separate the content and style of the text, and then combine the content vectors with other style vectors to generate. However, implicit expression cannot completely separate meaning and style, separation and recombination may also lead to a decrease in the naturalness and fluency of the text. Therefore, we propose a new idea, which first encodes the text into a latent representation, and iteratively optimizes the latent representation with the smallest changes to achieve style transfer. Introducing noise enhancement before generating results improves the robustness of the generated system and reduces the occurrence of individual results with large errors. Experiments show that our optimization method based on noise enhancement performs well on two public datasets, Yelp and Amazon. Result has excellent performance in three indicators: content preservation, transfer strength, and fluency.