SDDFusion: 分割与检测驱动的红外与可见光图像融合网络
CSTR:
作者:
作者单位:

南京理工大学 电子工程与光电技术学院,江苏 南京 210094

作者简介:

E-mail : k.ren@njust.edu.cn

通讯作者:

中图分类号:

TP391.4

基金项目:


SDDFusion: Segmentation and detection-driven infrared and visible image fusion network
Author:
Affiliation:

School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing 210094, China

Fund Project:

supported in part by the National Natural Science Foundation of China 62175111the Fundamental Research Funds for the Central Universities 30922010715supported in part by the National Natural Science Foundation of China (62175111); the Fundamental Research Funds for the Central Universities (30922010715)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    红外与可见光图像融合旨在整合热辐射与反射成像的互补信息,?????同时突出显著目标并保留纹理细节,?????从而为人眼感知与下游视觉任务提供更全面的输入。?为此,?本文提出一种分割与检测驱动的红外与可见光图像融合网络。?????该框架由融合网络与两条任务驱动分支构成:?????目标判别器与分割分支分别通过各自的损失函数引导融合网络保留更丰富的高层语义。?????为增强特征表征能力,?????我们设计了基于密集块的密集连接与梯度残差模块( DCGRM)用于深层特征提取;?????在解码阶段引入大核注意力(LKA)模块,?????以聚焦关键区域并降低信息损失,?????从而进一步提升融合图像质量。?????实验表明,?????所提方法既突出显著目标又保留丰富细节;?????在多项融合指标上优于对比方法。?此外,?????得益于任务协同的设计,?????所提方法在分割与检测下游视觉任务上亦展现出性能优势。

    Abstract:

    Infrared and visible image fusion aims to integrate the complementary information from thermal radiation and reflectance imaging, while highlighting salient targets and preserving texture details, thereby providing more comprehensive inputs for human visual perception and downstream vision tasks. To this end, this paper proposes a segmentation- and detection-driven infrared and visible image fusion network. The framework consists of a fusion network and two task-driven branches: an object discriminator and a segmentation branch, which guide the fusion network to retain richer high-level semantics through their respective loss functions. To enhance feature representation, we design a Dense Connection and Gradient Residual Module (DCGRM) based on dense blocks for deep feature extraction. Furthermore, a Large Kernel Attention (LKA) module is introduced in the decoding stage to focus on key regions and reduce information loss, further improving the quality of the fused images. Experiments demonstrate that the proposed method not only highlights salient targets but also preserves rich details, outperforming comparative methods across multiple fusion metrics. Moreover, benefiting from the task-driven collaborative design, the proposed method also exhibits superior performance in downstream vision tasks, including segmentation and object detection.

    参考文献
    相似文献
    引证文献
引用本文

周宇航,杨启民,任侃,陈钱. SDDFusion: 分割与检测驱动的红外与可见光图像融合网络[J].红外与毫米波学报,2026,45(5):787-801. Zhou Yu-Hang, Yang Qi-Min, Ren Kan, Chen Qian. SDDFusion: Segmentation and detection-driven infrared and visible image fusion network[J]. J. Infrared Millim. Waves,2026,45(5):787-801.

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-09-25
  • 最后修改日期:2025-10-26
  • 录用日期:2025-10-28
  • 在线发布日期: 2026-07-24
  • 出版日期:
文章二维码