Abstract
Model trained on synthetic datasets are difficult to obtain good results in the real world due to domain shift. Previous works have been devoted to mining the potential of existing natural datasets to obtain better results, but the number of images in the dataset is ultimately limited. In this paper, we propose MemDNet, a two-branch dehazing network that incorporates an atmospheric scattering model. Our approach utilizes a residual network and a U-shaped network to estimate the corresponding parameters. To alleviate the issue of insufficient natural hazy image pairs, we propose a generalized memory branch that incorporates information from exogenous images. This allows the network to memorize the fine details of the exogenous images, thereby enhancing its ability to recover image colors. Extensive experimental results demonstrate that our proposed memory branch is general and effective, and our method outperforms the state-of-the-art methods on real datasets.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Narasimhan, S.G., Nayar, S.K.: Vision and the atmosphere. Int. J. Comput. Vis. 48(3), 233–254 (2002)
Cantor, A.: Optics of the atmosphere–scattering by molecules and particles. IEEE J. Quantum Electron. 698–699 (1978)
He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2011)
Zhu, Q., Mai, J., Shao, L.: A fast single image haze removal algorithm using color attenuation prior. IEEE Trans. Image Process. 24(11), 3522–3533 (2015)
Berman, D., Treibitz, T., Avidan, S.: Non-local image dehazing. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
Li, B., Peng, X., Wang, Z., Xu, J., Dan, F.: AOD-Net: all-in-one dehazing network. In: 2017 IEEE International Conference on Computer Vision (ICCV) (2017)
Cai, B., Xu, X., Jia, K., Qing, C., Tao, D.: Dehazenet: an end-to-end system for single image haze removal. IEEE Trans. Image Process. 25(11), 5187–5198 (2016)
Ren, W., Liu, S., Zhang, H., Pan, J., Cao, X., Yang, M.-H.: Single image dehazing via multi-scale convolutional neural networks. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 154–169. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_10
Liu, X., Ma, Y., Shi, Z., Chen, J.: Griddehazenet: attention-based multi-scale network for image dehazing (2019)
Dong, H., et al.: Multi-scale boosted dehazing network with dense feature fusion. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2157–2167 (2020)
Qin, X., Wang, Z., Bai, Y., Xie, X., Jia, H.: FFA-Net: feature fusion attention network for single image dehazing. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 11908–11915 (2020)
Wu, H., Qu, Y., Lin, S., et al.: Contrastive learning for compact single image dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10551–10560 (2021)
Zheng, Y., Zhan, J., He, S., et al.: Curricular contrastive regularization for physics-aware single image dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5785–5794 (2023)
Wu, R., Duan, Z., Guo, C., et al.: RIDCP: revitalizing real image dehazing via high-quality codebook priors. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2023)
Chen, Z., Wang, Y., Yang, Y., et al.: PSD: principled synthetic-to-real dehazing guided by physical priors. In: Computer Vision and Pattern Recognition (2021)
Yang, Y., Wang, C., Liu, R., et al.: Self-augmented unpaired image dehazing via density and depth decomposition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2037–2046 (2022)
Zhao, S., Zhang, L., Shen, Y., et al.: RefineDNet: a weakly supervised refinement framework for single image dehazing. IEEE Trans. Image Process. 30, 3391–3404 (2021)
Ullah, H., Muhammad, K., Irfan, M., et al.: Light-DehazeNet: a novel lightweight CNN architecture for single image dehazing. IEEE Trans. Image Process. 30, 8968–8982 (2021)
Wang, G., Yu, X.: MSF\(\$\hat{\,}2\$\)DN: multi scale feature fusion dehazing network with dense connection. In: Proceedings of the Asian Conference on Computer Vision (ACCV), pp. 2950–2966 (2022)
Ancuti, C.O., Ancuti, C., Timofte, R., et al.: O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor images. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2018)
Ancuti, C.O., Ancuti, C., Timofte, R., et al.: I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images (2018)
Ancuti, C.O., Ancuti, C., Timofte, R.: NH-HAZE: an image dehazing benchmark with non-homogeneous hazy and haze-free images. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2020)
Ancuti, C.O., Ancuti, C., Sbert, M., et al.: Dense Haze: a benchmark for image dehazing with dense-haze and haze-free images. arXiv (2019)
Li, B., Ren, W., Fu, D., et al.: RESIDE: A Benchmark for Single Image Dehazing (2017)
Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: Bengio, Y., LeCun, Y. (eds.) 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, 7–9 May 2015, Conference Track Proceedings (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Wang, G., Yu, X. (2024). MemDNet: Memorizing More Exogenous Information to Dehaze Natural Hazy Image. In: Liu, Q., et al. Pattern Recognition and Computer Vision. PRCV 2023. Lecture Notes in Computer Science, vol 14435. Springer, Singapore. https://doi.org/10.1007/978-981-99-8552-4_4
Download citation
DOI: https://doi.org/10.1007/978-981-99-8552-4_4
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-8551-7
Online ISBN: 978-981-99-8552-4
eBook Packages: Computer ScienceComputer Science (R0)