Learning Enriched Features for Video Denoising with Convolutional Neural Network

Xianfeng Tang, Peining Zhen, M. Kang, Hang Yi, Wei Wang, Hai-Bao Chen
{"title":"Learning Enriched Features for Video Denoising with Convolutional Neural Network","authors":"Xianfeng Tang, Peining Zhen, M. Kang, Hang Yi, Wei Wang, Hai-Bao Chen","doi":"10.1109/APCCAS50809.2020.9301660","DOIUrl":null,"url":null,"abstract":"Video denoising is of great significance in video processing when shooting conditions are complex such as dynamic scenes and low light. Although existing algorithms have already achieved remarkable denoising performance, the inference time of them is usually impractical for real-time applications. In this paper, we propose a convolutional neural network architecture for video denoising. In contrast to other existing CNN-based methods, our approach utilizes different proportion convolutional kernel numbers in a block for extracting enriched features. Channel attention mechanism is integrated in the network to enhance the denoising performance. The network only needs three contiguous frames and noise map as inputs, which leads to a similar excellent running time to the state-of-the-art. We compare our method with different conventional algorithms VBM4D, VNLB and the state-of-the-art CNN-based method FastDVDnet. Experiment results indicate that our method outputs more convincing results in visual and more robustness than others in both peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) indexes.","PeriodicalId":127075,"journal":{"name":"2020 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2020-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/APCCAS50809.2020.9301660","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Video denoising is of great significance in video processing when shooting conditions are complex such as dynamic scenes and low light. Although existing algorithms have already achieved remarkable denoising performance, the inference time of them is usually impractical for real-time applications. In this paper, we propose a convolutional neural network architecture for video denoising. In contrast to other existing CNN-based methods, our approach utilizes different proportion convolutional kernel numbers in a block for extracting enriched features. Channel attention mechanism is integrated in the network to enhance the denoising performance. The network only needs three contiguous frames and noise map as inputs, which leads to a similar excellent running time to the state-of-the-art. We compare our method with different conventional algorithms VBM4D, VNLB and the state-of-the-art CNN-based method FastDVDnet. Experiment results indicate that our method outputs more convincing results in visual and more robustness than others in both peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) indexes.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
学习卷积神经网络视频去噪的丰富特征
在动态场景、弱光等拍摄条件复杂的视频处理中,视频去噪具有重要意义。虽然现有的算法已经取得了显著的去噪性能,但它们的推理时间通常不适合实时应用。本文提出了一种用于视频去噪的卷积神经网络结构。与其他现有的基于cnn的方法相比,我们的方法利用块中不同比例的卷积核数来提取丰富的特征。在网络中加入了信道注意机制,提高了去噪性能。该网络只需要三个连续帧和噪声图作为输入,这使得其运行时间与最先进的网络相似。我们将我们的方法与不同的传统算法VBM4D、VNLB和最先进的基于cnn的方法FastDVDnet进行了比较。实验结果表明,该方法在视觉上的结果更令人信服,在峰值信噪比(PSNR)和结构相似指数度量(SSIM)指标上的鲁棒性更强。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
"Truth from Practice, Learning beyond Teaching" Exploration in Teaching Analog Integrated Circuit 100 MHz Random Number Generator Design Using Interleaved Metastable NAND/NOR Latches* Performance Analysis of Non-Profiled Side Channel Attacks Based on Convolutional Neural Networks A Self-coupled DT MASH ΔΣ Modulator with High Tolerance to Noise Leakage An Energy-Efficient Time-Domain Binary Neural Network Accelerator with Error-Detection in 28nm CMOS
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1