G. R. Vishalakshi, A. Shobharani, M. C. Hanumantharaju
{"title":"基于小波能量的自适应retinex弱光移动视频增强算法","authors":"G. R. Vishalakshi, A. Shobharani, M. C. Hanumantharaju","doi":"10.1080/13682199.2023.2260663","DOIUrl":null,"url":null,"abstract":"ABSTRACTOur paper presents an adaptive multiscale retinex algorithm and a new wavelet energy metric to improve low-light video captured on mobile devices. Initially, we extract RGB frames from the video and convert them to hue-saturation-value (HSV) format, preserving the hue channel to prevent common RGB colour shifting issues. Saturation channel enhancement is achieved through histogram equalization (HE), extending the dynamic range. The adaptive retinex algorithm enhances the value channel, quantified by our new wavelet energy metric. Combining the modified value and saturation channels improves the contrast of the reconstructed image. As a final step, we transform the HSV video back to RGB and restore naturalness using a modified colour restoration technique. The proposed approach has been tested on over 300 images and videos. It is evident from the experimental results presented that the proposed method lowers noise and halo artifacts more effectively than existing methods.KEYWORDS: Low light enhancementmobile videoHSV colour spaceadaptive multiscale retinexwavelet energy Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationNotes on contributorsG. R. VishalakshiVishalakshi G. R. completed a Bachelor of Engineering (B. E) in Electronics and Communication and a Masters of Technology (M. Tech) in Digital Electronics from Visvesvaraya Technological University (VTU), Belagavi, Karnataka, India, in the years 2005 and 2012, respectively and Pursuing Ph.D. in VTU under the guidance of A. Shobharani on video enhancement technique. Her research interest is in subjects like image and video processing, VLSI, and CNN.A. ShobharaniA. Shobha Rani received her B. E (Electronics and Communication Engineering) degree from Bangalore University in the year 2000, M. Tech (Digital Electronics and Communication) Degree from Visveswaraya Technological University (VTU), Belgaum in the year 2005, and Ph. D. (Networking) degree from Kuvempu University, Shimoga, in the year, 2014. She works as an Associate Professor in the Department of ECE at BMS Institute of Technology and Management, Bengaluru, India. She has 23 technical articles in well-reputed journals and conferences. Her research interests include designing and implementing efficient protocols for wireless networks such as Ad hoc, Sensor, and Mesh networks.M. C. HanumantharajuM. C. Hanumantharaju received his B. E (Electronics and Communication Engineering) degree from Bangalore University in the year 2001, M. Tech (Digital Communication and Network Engineering) degree from Visvesvaraya Technological University (VTU), Belagavi in the year 2004, and Ph. D (VLSI Signal and Image Processing) degree from VTU, Belagavi, in the year, 2014. He works as a Professor in the Department of ECE at BMS Institute of Technology and Management, Bengaluru, India. He has authored two books and 50 technical articles in refereed journals and proceedings such as IEEE, Intelligent Systems, Particle Swarm Optimization, etc. He is currently a reviewer for IEEE Transactions on Industrial Electronics, Computers and Electrical Engineering Journal, Journal of Microscopy and Ultrastructure, etc. His research interests include the Design of hardware architectures for signal and image processing algorithms, computer vision, Register Transfer Level (RTL) Verilog coding, synthesis and optimization of Integrated Circuits (ICs), and FPGA/ASIC Design.","PeriodicalId":22456,"journal":{"name":"The Imaging Science Journal","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Wavelet energy-based adaptive retinex algorithm for low light mobile video enhancement\",\"authors\":\"G. R. Vishalakshi, A. Shobharani, M. C. Hanumantharaju\",\"doi\":\"10.1080/13682199.2023.2260663\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACTOur paper presents an adaptive multiscale retinex algorithm and a new wavelet energy metric to improve low-light video captured on mobile devices. Initially, we extract RGB frames from the video and convert them to hue-saturation-value (HSV) format, preserving the hue channel to prevent common RGB colour shifting issues. Saturation channel enhancement is achieved through histogram equalization (HE), extending the dynamic range. The adaptive retinex algorithm enhances the value channel, quantified by our new wavelet energy metric. Combining the modified value and saturation channels improves the contrast of the reconstructed image. As a final step, we transform the HSV video back to RGB and restore naturalness using a modified colour restoration technique. The proposed approach has been tested on over 300 images and videos. It is evident from the experimental results presented that the proposed method lowers noise and halo artifacts more effectively than existing methods.KEYWORDS: Low light enhancementmobile videoHSV colour spaceadaptive multiscale retinexwavelet energy Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationNotes on contributorsG. R. VishalakshiVishalakshi G. R. completed a Bachelor of Engineering (B. E) in Electronics and Communication and a Masters of Technology (M. Tech) in Digital Electronics from Visvesvaraya Technological University (VTU), Belagavi, Karnataka, India, in the years 2005 and 2012, respectively and Pursuing Ph.D. in VTU under the guidance of A. Shobharani on video enhancement technique. Her research interest is in subjects like image and video processing, VLSI, and CNN.A. ShobharaniA. Shobha Rani received her B. E (Electronics and Communication Engineering) degree from Bangalore University in the year 2000, M. Tech (Digital Electronics and Communication) Degree from Visveswaraya Technological University (VTU), Belgaum in the year 2005, and Ph. D. (Networking) degree from Kuvempu University, Shimoga, in the year, 2014. She works as an Associate Professor in the Department of ECE at BMS Institute of Technology and Management, Bengaluru, India. She has 23 technical articles in well-reputed journals and conferences. Her research interests include designing and implementing efficient protocols for wireless networks such as Ad hoc, Sensor, and Mesh networks.M. C. HanumantharajuM. C. Hanumantharaju received his B. E (Electronics and Communication Engineering) degree from Bangalore University in the year 2001, M. Tech (Digital Communication and Network Engineering) degree from Visvesvaraya Technological University (VTU), Belagavi in the year 2004, and Ph. D (VLSI Signal and Image Processing) degree from VTU, Belagavi, in the year, 2014. He works as a Professor in the Department of ECE at BMS Institute of Technology and Management, Bengaluru, India. He has authored two books and 50 technical articles in refereed journals and proceedings such as IEEE, Intelligent Systems, Particle Swarm Optimization, etc. He is currently a reviewer for IEEE Transactions on Industrial Electronics, Computers and Electrical Engineering Journal, Journal of Microscopy and Ultrastructure, etc. His research interests include the Design of hardware architectures for signal and image processing algorithms, computer vision, Register Transfer Level (RTL) Verilog coding, synthesis and optimization of Integrated Circuits (ICs), and FPGA/ASIC Design.\",\"PeriodicalId\":22456,\"journal\":{\"name\":\"The Imaging Science Journal\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-09-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Imaging Science Journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/13682199.2023.2260663\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Imaging Science Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/13682199.2023.2260663","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
摘要:本文提出了一种自适应多尺度retinex算法和一种新的小波能量度量来改善移动设备上低光视频的捕获。最初,我们从视频中提取RGB帧并将其转换为色调饱和值(HSV)格式,保留色调通道以防止常见的RGB颜色移动问题。饱和通道增强是通过直方图均衡化(HE)实现的,扩展了动态范围。自适应retinex算法增强了价值通道,并通过我们的新小波能量度量进行量化。将修正值与饱和通道相结合,提高了重建图像的对比度。作为最后一步,我们将HSV视频转换回RGB,并使用修改的颜色恢复技术恢复自然性。该方法已经在300多张图片和视频上进行了测试。实验结果表明,该方法比现有方法更有效地降低了噪声和光晕伪影。关键词:弱光增强移动视频hsv色彩空间自适应多尺度视网膜小波能量披露声明作者未报告潜在利益冲突。其他资料:捐助者说明R. VishalakshiVishalakshi G. R.分别于2005年和2012年在印度卡纳塔克邦Belagavi的Visvesvaraya Technological University (VTU)获得电子与通信工程学士学位和数字电子学硕士学位,并在a . Shobharani的视频增强技术指导下在VTU攻读博士学位。她的研究兴趣包括图像和视频处理、VLSI和cnn。ShobharaniA。Shobha Rani于2000年在班加罗尔大学获得电子与通信工程学士学位,2005年在Belgaum Visveswaraya理工大学获得数字电子与通信硕士学位,并于2014年在Shimoga Kuvempu大学获得网络博士学位。她是印度班加罗尔BMS技术与管理学院ECE系的副教授。她在知名期刊和会议上发表了23篇技术文章。她的研究兴趣包括设计和实现无线网络的高效协议,如Ad hoc,传感器和Mesh网络。c . HanumantharajuM。C. Hanumantharaju于2001年获得班加罗尔大学(Bangalore University)电子与通信工程学士学位,2004年获得Visvesvaraya Technological University (VTU)数字通信与网络工程硕士学位,2014年获得VTU Belagavi超大集成电路信号与图像处理博士学位。他是印度班加罗尔BMS技术与管理学院ECE系教授。他撰写了两本书,并在IEEE,智能系统,粒子群优化等期刊和会议上发表了50篇技术文章。他目前是IEEE Transactions on Industrial Electronics, Computers and Electrical Engineering Journal, Journal of Microscopy and Ultrastructure等杂志的审稿人。他的研究兴趣包括信号和图像处理算法的硬件架构设计,计算机视觉,寄存器传输电平(RTL) Verilog编码,集成电路(ic)的合成和优化,以及FPGA/ASIC设计。
Wavelet energy-based adaptive retinex algorithm for low light mobile video enhancement
ABSTRACTOur paper presents an adaptive multiscale retinex algorithm and a new wavelet energy metric to improve low-light video captured on mobile devices. Initially, we extract RGB frames from the video and convert them to hue-saturation-value (HSV) format, preserving the hue channel to prevent common RGB colour shifting issues. Saturation channel enhancement is achieved through histogram equalization (HE), extending the dynamic range. The adaptive retinex algorithm enhances the value channel, quantified by our new wavelet energy metric. Combining the modified value and saturation channels improves the contrast of the reconstructed image. As a final step, we transform the HSV video back to RGB and restore naturalness using a modified colour restoration technique. The proposed approach has been tested on over 300 images and videos. It is evident from the experimental results presented that the proposed method lowers noise and halo artifacts more effectively than existing methods.KEYWORDS: Low light enhancementmobile videoHSV colour spaceadaptive multiscale retinexwavelet energy Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationNotes on contributorsG. R. VishalakshiVishalakshi G. R. completed a Bachelor of Engineering (B. E) in Electronics and Communication and a Masters of Technology (M. Tech) in Digital Electronics from Visvesvaraya Technological University (VTU), Belagavi, Karnataka, India, in the years 2005 and 2012, respectively and Pursuing Ph.D. in VTU under the guidance of A. Shobharani on video enhancement technique. Her research interest is in subjects like image and video processing, VLSI, and CNN.A. ShobharaniA. Shobha Rani received her B. E (Electronics and Communication Engineering) degree from Bangalore University in the year 2000, M. Tech (Digital Electronics and Communication) Degree from Visveswaraya Technological University (VTU), Belgaum in the year 2005, and Ph. D. (Networking) degree from Kuvempu University, Shimoga, in the year, 2014. She works as an Associate Professor in the Department of ECE at BMS Institute of Technology and Management, Bengaluru, India. She has 23 technical articles in well-reputed journals and conferences. Her research interests include designing and implementing efficient protocols for wireless networks such as Ad hoc, Sensor, and Mesh networks.M. C. HanumantharajuM. C. Hanumantharaju received his B. E (Electronics and Communication Engineering) degree from Bangalore University in the year 2001, M. Tech (Digital Communication and Network Engineering) degree from Visvesvaraya Technological University (VTU), Belagavi in the year 2004, and Ph. D (VLSI Signal and Image Processing) degree from VTU, Belagavi, in the year, 2014. He works as a Professor in the Department of ECE at BMS Institute of Technology and Management, Bengaluru, India. He has authored two books and 50 technical articles in refereed journals and proceedings such as IEEE, Intelligent Systems, Particle Swarm Optimization, etc. He is currently a reviewer for IEEE Transactions on Industrial Electronics, Computers and Electrical Engineering Journal, Journal of Microscopy and Ultrastructure, etc. His research interests include the Design of hardware architectures for signal and image processing algorithms, computer vision, Register Transfer Level (RTL) Verilog coding, synthesis and optimization of Integrated Circuits (ICs), and FPGA/ASIC Design.