Deep Plug-and-Play Self-Supervised Neural Networks for Spectral Snapshot Compressive Imaging
DOI:
CSTR:
Author:
Affiliation:

1.Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, China;2.Key Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China;3.University of Chinese Academy of Sciences, Beijing 100049, China

Clc Number:

Fund Project:

Supported by the National Natural Science Foundation of China (…….) ; XXX Foundation of China (…..);……

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    The coded aperture snapshot spectral imaging system, based on compressed sensing theory, functions as an capable of efficiently acquiring compressed two-dimensional spectral data. This data is subsequently decoded into three-dimensional spectral data through a deep neural network. However, training the deep neural network necessitates a substantial amount of clean data, which is often challenging to obtain. To address the issue of insufficient training data for deep neural network, a self-supervised hyperspectral denoising neural network is proposed, leveraging the concept of neighborhood sampling. This network is integrated into the deep plug-and-play framework, enabling self-supervised spectral reconstruction. The study also examines the impact of different noise degradation models on the final reconstruction quality. Experimental results demonstrate that compared with supervised learning method, the self-supervised learning method enhances the average peak signal-to-noise ratio by 1.18dB and improves the structural similarity is improved by 0.009. Additionally, it achieves superior visual reconstruction outcomes without relying on clean data as labels.

    Reference
    Related
    Cited by
Get Citation
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:February 29,2024
  • Revised:July 24,2024
  • Adopted:April 10,2024
  • Online: July 15,2024
  • Published:
Article QR Code