Deep plug-and-play self-supervised neural networks for spectral snapshot compressive imaging
CSTR:
Author:
Affiliation:

1.School of Physics and Optoeletronic Engineering, Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, China;2.Key Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China;3.University of Chinese Academy of Sciences, Beijing 100049, China

Clc Number:

TP753

Fund Project:

Supported by the Zhejiang Provincial "Jianbing" and "Lingyan" R&D Programs (2023C03012, 2024C01126)

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    The encoding aperture snapshot spectral imaging system, based on the compressive sensing theory, can be regarded as an encoder, which can efficiently obtain compressed two-dimensional spectral data and then decode it into three-dimensional spectral data through deep neural networks. However, training the deep neural networks requires a large amount of clean data that is difficult to obtain. To address the problem of insufficient training data for deep neural networks, a self-supervised hyperspectral denoising neural network based on neighborhood sampling is proposed. This network is integrated into a deep plug-and-play framework to achieve self -supervised spectral reconstruction. The study also examines the impact of different noise degradation models on the final reconstruction quality. Experimental results demonstrate that the self-supervised learning method enhances the average peak signal-to-noise ratio by 1.18 dB and improves the structural similarity by 0.009 compared with the supervised learning method. Additionally, it achieves better visual reconstruction results.

    Reference
    Related
    Cited by
Get Citation

ZHANG Xing-Yu, ZHU Shou-Zheng, ZHOU Tian-Shu, QI Hong-Xing, WANG Jian-Yu, LI Chun-Lai, LIU Shi-Jie. Deep plug-and-play self-supervised neural networks for spectral snapshot compressive imaging[J]. Journal of Infrared and Millimeter Waves,2024,43(6):846~857

Copy
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:February 29,2024
  • Revised:November 11,2024
  • Adopted:April 10,2024
  • Online: November 06,2024
  • Published:
Article QR Code