Loading [a11y]/accessibility-menu.js
Sparse GANs for Thermal Infrared Image Generation From Optical Image | IEEE Journals & Magazine | IEEE Xplore

Sparse GANs for Thermal Infrared Image Generation From Optical Image


We present a sparse generative model based on pix2pix framework to produce synthetic TIR data from optical RGB images. The new model uses a U-net architecture but only se...

Abstract:

Thermal infrared (TIR) images are not influenced by the illumination variations and can be used in total darkness. With these advantages, TIR technology has a wide applic...Show More

Abstract:

Thermal infrared (TIR) images are not influenced by the illumination variations and can be used in total darkness. With these advantages, TIR technology has a wide application in surveillance systems and various defense systems. However, there are not enough TIR images for wide range of application because the equipment for thermal infrared imaging is expensive and demands strict imaging conditions. To address this problem, we propose a sparse generative model based on pix2pix framework to produce synthetic TIR data from optical RGB images. Considering little texture and color information in TIR images, this model uses a U-net architecture but only selects partial low-level and high-level information for symmetric connections. Specially, we integrate intensity and gradient losses into the objective to train models, which assists generation models to learn more infrared images' characteristics. The experiments on public datasets prove that this proposed method can generate TIR data from optical images. Compared with current pix2pix networks, this method achieves increases by over 6.5% and over 1.2% separately on the metrics of SSIM and PSNR based on the public datasets. The SSIM value even gets an increase by 7% for daytime images. Meanwhile the network parameters decent by 13%.
We present a sparse generative model based on pix2pix framework to produce synthetic TIR data from optical RGB images. The new model uses a U-net architecture but only se...
Published in: IEEE Access ( Volume: 8)
Page(s): 180124 - 180132
Date of Publication: 18 September 2020
Electronic ISSN: 2169-3536

Funding Agency:


References

References is not available for this document.