Real-time implementation of multi-source image fusion algorithm
Keywords:
FPGA, image fusionAbstract
Aiming at the real-time requirements of image fusion in the infrared and visible light, a real-time implementation method to solve the current high-definition or ultrahigh-definition multi-source Laplacian pyramid image fusion was proposed. Based on the video data stream, a parallel processing pipeline architecture of Laplacian pyramid system was designed. The time delay and optimization ideas between the pipelines were analyzed. All the delay time differences were compensated through on-chip cache to achieve the equal length of pipeline and guarantee the integrity of data processing in the whole algorithm. This method could realize 5-level Laplacian pyramid fusion of dual-channel 1080×1920@60 Hz video images on XILINX 7 series field programmable gate array (FPGA) and above. The experimental results show that this real-time method has better fusion effect, with only 10.535 ms of one-frame image fusion and the processing delay is less than 1 ms. © 2022 Editorial office of Journal of Applied Optics. All rights reserved.
References
WANG Shile, Research of information fusion and enhancement of multi-source image, (2012); YAN Xiang, Research on algorithm for multi-source image fusion, (2018); LIN Zihui, Research on infrared and visible image fusion based on multi-scale transform, (2019); LYU Yong, Research on multi-filed infrared and visible image fusion registration technology, (2020); LI Yuqi, ZHAO Haitao, Depth estimation based on adaptive fusion of infrared and vision light images progressively, Journal of Applied Opitics, 41, 1, pp. 24-32, (2020); CHEN Qingjiang, WANG Zebai, CHAI Yuzhou, Multifocus image fusion method based on improved VGG network, Journal of Applied Opitics, 14, 3, pp. 500-507, (2020); HUANG Wenbo, YAN Huan, Infrared and visible image fusion based on two-scale decomposition and extraction, Modern Computer, 16, 6, pp. 148-153, (2021); ZHAO Xin, Research on multi-source image fusion system based on DSP, (2020); GE Fei, Research of image fusion based on multicore DSP, (2016); YANG Feng, Design and optimization of image fusion algorithm based on multicore DSP, (2014); LIU Bing, Design and implementation of imgae fusion correction algorithm based on FPGA, (2018); TANG Wei, Infrared and low-light-level image fusion research based on FPGA, (2012); ZhANG Hao, Infrared and CCD image fusion research and hardware design based on FPGA, (2015); LU Rong, GAO Kun, NI Guoqiang, Et al., Study on real-time implementation of multi-resolution image fusion system based on FPGA, Laser & Infrared, 37, 7, pp. 1018-1021, (2007); MA Yongqiang, HOU Hongxu, WANG Shunli, Image contrast enhancement algorithm based on normalized scalar weight map coupled fusion pyramid, Application Research of Compluters, 32, 10, pp. 3187-3190, (2015)
Published
How to Cite
Issue
Section
License
Copyright (c) 2022 Journal of Applied Optics
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
The CC Attribution-NonCommercial 4.0 License allows sharing and adapting the work, provided the creator is credited and the work is not used commercially. Modifications must be indicated, and derivative works under the same license are allowed.
