{"title":"基于视觉注意机制的文本识别改进深度神经网络","authors":"Nguyen Trong Thai, Nguyen Hoang Thuan, D. V. Sang","doi":"10.1109/RIVF51545.2021.9642119","DOIUrl":null,"url":null,"abstract":"Text recognition from images captured by handheld mobile devices has attracted considerable research interest because of its commercial applications. The state-of-the-art printed text recognition methods are often based on attention mechanisms. However, these methods perform poorly on images captured due to poor illumination conditions, blur, noise, and low resolution. To address these unfavorable conditions, we propose a new text recognition method based on an encoder-decoder model. Particularly, we present a novel attention mechanism using a multi-scale cascade fashion combined with a channel attention gate module. Our model is also strengthened by an EfficientNet-like backbone. Extensive experiments on three popular datasets, including SROIE 2019, B-MOD, and CORD, show that our proposed method outperforms the baseline attention mechanism and achieves competitive accuracy compared to other state-ofthe-art approaches.","PeriodicalId":6860,"journal":{"name":"2021 RIVF International Conference on Computing and Communication Technologies (RIVF)","volume":"1 1","pages":"1-6"},"PeriodicalIF":0.0000,"publicationDate":"2021-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Improved Deep Neural Network Based on a Novel Visual Attention Mechanism for Text Recognition\",\"authors\":\"Nguyen Trong Thai, Nguyen Hoang Thuan, D. V. Sang\",\"doi\":\"10.1109/RIVF51545.2021.9642119\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Text recognition from images captured by handheld mobile devices has attracted considerable research interest because of its commercial applications. The state-of-the-art printed text recognition methods are often based on attention mechanisms. However, these methods perform poorly on images captured due to poor illumination conditions, blur, noise, and low resolution. To address these unfavorable conditions, we propose a new text recognition method based on an encoder-decoder model. Particularly, we present a novel attention mechanism using a multi-scale cascade fashion combined with a channel attention gate module. Our model is also strengthened by an EfficientNet-like backbone. Extensive experiments on three popular datasets, including SROIE 2019, B-MOD, and CORD, show that our proposed method outperforms the baseline attention mechanism and achieves competitive accuracy compared to other state-ofthe-art approaches.\",\"PeriodicalId\":6860,\"journal\":{\"name\":\"2021 RIVF International Conference on Computing and Communication Technologies (RIVF)\",\"volume\":\"1 1\",\"pages\":\"1-6\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-08-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 RIVF International Conference on Computing and Communication Technologies (RIVF)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/RIVF51545.2021.9642119\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 RIVF International Conference on Computing and Communication Technologies (RIVF)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/RIVF51545.2021.9642119","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
An Improved Deep Neural Network Based on a Novel Visual Attention Mechanism for Text Recognition
Text recognition from images captured by handheld mobile devices has attracted considerable research interest because of its commercial applications. The state-of-the-art printed text recognition methods are often based on attention mechanisms. However, these methods perform poorly on images captured due to poor illumination conditions, blur, noise, and low resolution. To address these unfavorable conditions, we propose a new text recognition method based on an encoder-decoder model. Particularly, we present a novel attention mechanism using a multi-scale cascade fashion combined with a channel attention gate module. Our model is also strengthened by an EfficientNet-like backbone. Extensive experiments on three popular datasets, including SROIE 2019, B-MOD, and CORD, show that our proposed method outperforms the baseline attention mechanism and achieves competitive accuracy compared to other state-ofthe-art approaches.