{"title":"基于边缘增强和特征调制的光场深度估算网络","authors":"","doi":"10.1016/j.optlaseng.2024.108662","DOIUrl":null,"url":null,"abstract":"<div><div>Estimating depth from light field images is a critical issue in light field applications. While learning-based methods have made significant strides in light field depth estimation, achieving high accuracy and speed simultaneously remains a major challenge. This paper proposes a light field depth estimation network based on edge enhancement and feature modulation, which significantly improves depth estimation results by emphasizing inter-view correlations while preserving image edge features. Specifically, to prioritize edge details, we introduce an Edge-Enhanced Cost Constructor (EECC) that integrates edge information with existing cost constructors to improve depth estimation performance in complex areas. Furthermore, most light field depth estimation networks utilize only sub-aperture images (SAIs) without considering the inherent angular information in macro-pixel image (MacPI). To address this limitation, we propose the MacPI-Guided Feature Modulation (MGFM) module, which leverages angular information between different views in MacPI to modulate features at each view. Experimental results show that our method not only performs excellently on synthetic datasets but also demonstrates outstanding generalization on real-world datasets, achieving a better balance between accuracy and computation speed.</div></div>","PeriodicalId":49719,"journal":{"name":"Optics and Lasers in Engineering","volume":null,"pages":null},"PeriodicalIF":3.5000,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Edge enhancement and feature modulation based network for light field depth estimation\",\"authors\":\"\",\"doi\":\"10.1016/j.optlaseng.2024.108662\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Estimating depth from light field images is a critical issue in light field applications. While learning-based methods have made significant strides in light field depth estimation, achieving high accuracy and speed simultaneously remains a major challenge. This paper proposes a light field depth estimation network based on edge enhancement and feature modulation, which significantly improves depth estimation results by emphasizing inter-view correlations while preserving image edge features. Specifically, to prioritize edge details, we introduce an Edge-Enhanced Cost Constructor (EECC) that integrates edge information with existing cost constructors to improve depth estimation performance in complex areas. Furthermore, most light field depth estimation networks utilize only sub-aperture images (SAIs) without considering the inherent angular information in macro-pixel image (MacPI). To address this limitation, we propose the MacPI-Guided Feature Modulation (MGFM) module, which leverages angular information between different views in MacPI to modulate features at each view. Experimental results show that our method not only performs excellently on synthetic datasets but also demonstrates outstanding generalization on real-world datasets, achieving a better balance between accuracy and computation speed.</div></div>\",\"PeriodicalId\":49719,\"journal\":{\"name\":\"Optics and Lasers in Engineering\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":3.5000,\"publicationDate\":\"2024-10-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Optics and Lasers in Engineering\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0143816624006407\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Lasers in Engineering","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0143816624006407","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPTICS","Score":null,"Total":0}
Edge enhancement and feature modulation based network for light field depth estimation
Estimating depth from light field images is a critical issue in light field applications. While learning-based methods have made significant strides in light field depth estimation, achieving high accuracy and speed simultaneously remains a major challenge. This paper proposes a light field depth estimation network based on edge enhancement and feature modulation, which significantly improves depth estimation results by emphasizing inter-view correlations while preserving image edge features. Specifically, to prioritize edge details, we introduce an Edge-Enhanced Cost Constructor (EECC) that integrates edge information with existing cost constructors to improve depth estimation performance in complex areas. Furthermore, most light field depth estimation networks utilize only sub-aperture images (SAIs) without considering the inherent angular information in macro-pixel image (MacPI). To address this limitation, we propose the MacPI-Guided Feature Modulation (MGFM) module, which leverages angular information between different views in MacPI to modulate features at each view. Experimental results show that our method not only performs excellently on synthetic datasets but also demonstrates outstanding generalization on real-world datasets, achieving a better balance between accuracy and computation speed.
期刊介绍:
Optics and Lasers in Engineering aims at providing an international forum for the interchange of information on the development of optical techniques and laser technology in engineering. Emphasis is placed on contributions targeted at the practical use of methods and devices, the development and enhancement of solutions and new theoretical concepts for experimental methods.
Optics and Lasers in Engineering reflects the main areas in which optical methods are being used and developed for an engineering environment. Manuscripts should offer clear evidence of novelty and significance. Papers focusing on parameter optimization or computational issues are not suitable. Similarly, papers focussed on an application rather than the optical method fall outside the journal''s scope. The scope of the journal is defined to include the following:
-Optical Metrology-
Optical Methods for 3D visualization and virtual engineering-
Optical Techniques for Microsystems-
Imaging, Microscopy and Adaptive Optics-
Computational Imaging-
Laser methods in manufacturing-
Integrated optical and photonic sensors-
Optics and Photonics in Life Science-
Hyperspectral and spectroscopic methods-
Infrared and Terahertz techniques