{"title":"基于注意力特征增强模块的光流估计方法","authors":"Bingchao Zhao, Cong Peng","doi":"10.1109/ISAS59543.2023.10164590","DOIUrl":null,"url":null,"abstract":"Optical flow estimation is one of the classic tasks in the field of vision. It calculates the motion of the target based on two continuous images. In most of the past work, the estimated optical flow often has errors in scenes of large motion or noise interference because the convolutional neural network structure often focuses on local features. To overcome the problems mentioned above, we propose a feature enhancement module that is based on the self-attention mechanism to enhance the dependencies of long-range features. Additionally, It can filter part of the noise, such as the interference of illumination in the input image. We evaluate our approach on standard benchmarks to verify motion estimation ability. To compare different results intuitively, we visualize flow fields for qualitative analysis. Eventually, we use the heat map to visualize the output of the attention layer to explore the mechanism of the attention algorithm.","PeriodicalId":199115,"journal":{"name":"2023 6th International Symposium on Autonomous Systems (ISAS)","volume":"51 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Optical Flow Estimation Method Based on the Attention Feature Enhancement Module\",\"authors\":\"Bingchao Zhao, Cong Peng\",\"doi\":\"10.1109/ISAS59543.2023.10164590\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Optical flow estimation is one of the classic tasks in the field of vision. It calculates the motion of the target based on two continuous images. In most of the past work, the estimated optical flow often has errors in scenes of large motion or noise interference because the convolutional neural network structure often focuses on local features. To overcome the problems mentioned above, we propose a feature enhancement module that is based on the self-attention mechanism to enhance the dependencies of long-range features. Additionally, It can filter part of the noise, such as the interference of illumination in the input image. We evaluate our approach on standard benchmarks to verify motion estimation ability. To compare different results intuitively, we visualize flow fields for qualitative analysis. Eventually, we use the heat map to visualize the output of the attention layer to explore the mechanism of the attention algorithm.\",\"PeriodicalId\":199115,\"journal\":{\"name\":\"2023 6th International Symposium on Autonomous Systems (ISAS)\",\"volume\":\"51 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 6th International Symposium on Autonomous Systems (ISAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISAS59543.2023.10164590\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 6th International Symposium on Autonomous Systems (ISAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISAS59543.2023.10164590","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
The Optical Flow Estimation Method Based on the Attention Feature Enhancement Module
Optical flow estimation is one of the classic tasks in the field of vision. It calculates the motion of the target based on two continuous images. In most of the past work, the estimated optical flow often has errors in scenes of large motion or noise interference because the convolutional neural network structure often focuses on local features. To overcome the problems mentioned above, we propose a feature enhancement module that is based on the self-attention mechanism to enhance the dependencies of long-range features. Additionally, It can filter part of the noise, such as the interference of illumination in the input image. We evaluate our approach on standard benchmarks to verify motion estimation ability. To compare different results intuitively, we visualize flow fields for qualitative analysis. Eventually, we use the heat map to visualize the output of the attention layer to explore the mechanism of the attention algorithm.