Depth estimation of thermal infrared images based on self-supervised learning
Author:
Affiliation:

1.College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China;2.Science and Technology on Electro-Optical Information Security Control Laboratory, Tianjin 300308, China

Clc Number:

TP29

Fund Project:

Supported by the Open Foundation of Science and Technology on Electro-Optical Information Security Control Laboratory(JCKY2022210C005), the National Natural Science Foundation of China (U2033201), and Aeronautical Science Foundation of China(20220058052001)

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    Depth estimation based on unsupervised learning is one of the important issues in the field of computer vision. However, existing algorithms of depth estimation are mainly designed based on visible images. Compared with visible images, thermal infrared images have the disadvantages of low contrast and insufficient detailed information. To this end, a depth estimation network is constructed and an unsupervised depth estimation method is proposed for thermal infrared images according to their characteristics. The network consists of three parts: feature extraction module, feature aggregation module, and feature fusion module. Firstly, a feature aggregation module is designed to improve network ability to acquire the edge information of target objects and the small object information of the image. Secondly, the channel attention mechanism is introduced in feature fusion module to effectively capture the interaction relationship between different channels. Finally, a depth estimation network for thermal infrared images is established. In this network, the model parameters are trained by thermal infrared sequence images to achieve the pixel-level depth estimation of a single thermal infrared image. The results of ablation studies and comparative experiments fully demonstrate that the performance of the proposed method in pixel-level depth estimation of thermal infrared image outperforms other representative methods.

    Reference
    Related
    Cited by
Get Citation

DING Meng, GUAN Song, LI Shuai, YU Kuai-Kuai, XU Yi-Ming. Depth estimation of thermal infrared images based on self-supervised learning[J]. Journal of Infrared and Millimeter Waves,2023,42(6):906~915

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:December 13,2022
  • Revised:November 01,2023
  • Adopted:February 01,2023
  • Online: November 01,2023
  • Published: