Shiquan Ding;Jun Huang;Zhanchuan Cai;Yong Ma;Kangle Wu;Fan Fan
{"title":"FIAFusion: A Feedback-Based Illumination-Adaptive Infrared and Visible Image Fusion Method","authors":"Shiquan Ding;Jun Huang;Zhanchuan Cai;Yong Ma;Kangle Wu;Fan Fan","doi":"10.1109/JSEN.2025.3525700","DOIUrl":null,"url":null,"abstract":"Infrared (IR) and visible (VI) image fusion enables to combine the strengths of both original images adequately, retaining essential target information and abundant detailed textures. Existing fusion methods mainly cater to well-illuminated scenes. Although some researchers have explored complex scenes, there are still some unresolved issues, such as suboptimal lighting levels and loss of local details. To overcome these issues, we introduce a novel method named FIAFusion. FIAFusion is structured into three primary components: initially, the illumination-adaptive network (IAN) adjusts the illumination of the original VI image adaptively. Subsequently, the fusion network (FUN) efficiently merges the complementary information from the original IR image and the illumination-adapted VI image into a fused image of high visual quality. To achieve an ideal illumination level in the fused image, the feedback network (FEN) is designed to feedback on the illumination information of the fused image to both IAN and FUN, guiding the illumination correction to facilitate mutual promotion between illumination adaptation and fusion process effectively. Extensive comparative and supplementary experiments conducted on LLVIP and MSRS datasets indicate that our method surpasses state-of-the-art (SOTA) IR and VI image fusion methods. Moreover, our method demonstrates significant performance improvements in pedestrian detection tasks.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 4","pages":"7667-7680"},"PeriodicalIF":4.3000,"publicationDate":"2025-01-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10838315/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Infrared (IR) and visible (VI) image fusion enables to combine the strengths of both original images adequately, retaining essential target information and abundant detailed textures. Existing fusion methods mainly cater to well-illuminated scenes. Although some researchers have explored complex scenes, there are still some unresolved issues, such as suboptimal lighting levels and loss of local details. To overcome these issues, we introduce a novel method named FIAFusion. FIAFusion is structured into three primary components: initially, the illumination-adaptive network (IAN) adjusts the illumination of the original VI image adaptively. Subsequently, the fusion network (FUN) efficiently merges the complementary information from the original IR image and the illumination-adapted VI image into a fused image of high visual quality. To achieve an ideal illumination level in the fused image, the feedback network (FEN) is designed to feedback on the illumination information of the fused image to both IAN and FUN, guiding the illumination correction to facilitate mutual promotion between illumination adaptation and fusion process effectively. Extensive comparative and supplementary experiments conducted on LLVIP and MSRS datasets indicate that our method surpasses state-of-the-art (SOTA) IR and VI image fusion methods. Moreover, our method demonstrates significant performance improvements in pedestrian detection tasks.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice