Skip to main content
SpringerLink
Log in

Multi-focus image fusion algorithm based on region detection and ACS network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

To address the problems of artifacts and information residuals in existing multi-focus image fusion algorithms, this paper proposes a multi-focus image algorithm based on region detection and the ACS network. First, region detection is used to identify the focus and boundary regions, allowing for the creation of an initial fusion image. Second, the ACS network learns the fusion rules for multi-focus images, which results in a network fusion image. Finally, using the boundary region information, the initial and network fusion images are weighted and combined to create the final fused image. The experimental results show that the algorithm outperforms other comparative algorithms in both the focus region and the boundary region, and the evaluation indexes are improved by more than 4.8% and 1.5%, respectively; at the same time, the subjective effect is more in line with the HVS, and there are no visual artifacts in various regions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data Availability

Data available on request from the authors.

References

  1. Wang H (2018) Multi-focus image fusion algorithm based on focus detection in spatial and NSCT domain. PloS one 13(9):e0204225

    Article  Google Scholar 

  2. Zhang Q et al (2018) Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: a review. Inf Fusion 40:57–75

  3. De I, Chanda B (2013) Multi-focus image fusion using a morphology-based focus measure in a quad-tree structure. Inf Fusion 14(2):136–146

  4. Li M, Cai W, Tan Z (2006) A region-based multi-sensor image fusion scheme using pulse-coupled neural network. Pattern Recogn Lett 27(16):1948–1956

    Article  Google Scholar 

  5. Chen Y, Guan J, Cham WK (2017) Robust multi-focus image fusion using edge model and multi-matting. IEEE Trans Image Process 27(3):1526–1541

    Article  MathSciNet  Google Scholar 

  6. Li S et al (2017) Pixel-level image fusion: a survey of the state of the art. Inf Fusion 33:100–112

  7. Zhang X (2021) Deep learning-based multi-focus image fusion: a survey and a comparative study. IEEE Trans Pattern Anal Mach Intell 44(9):4819–4838

  8. Zhao W et al (2021) Region-and pixel-level multi-focus image fusion through convolutional neural networks. Mobile Netw Appl 26:40–56

  9. Tang H et al (2018) Pixel convolutional neural network for multi-focus image fusion. Inf Sci 433:125–141

  10. Ma H et al (2019) Boundary aware multi-focus image fusion using deep neural network. In: 2019 IEEE International Conference on Multimedia and Expo (ICME). IEEE, pp 1150–1155

  11. Huang G et al (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708

  12. Mustafa HT, Yang J, Zareapoor M (2019) Multi-scale convolutional neural network for multi-focus image fusion. Image Vision Comput 85:26–35

    Article  Google Scholar 

  13. Yang Y et al (2019) Multilevel features convolutional neural network for multifocus image fusion. IEEE Trans Comput Imaging 5(2):262–273

    Article  Google Scholar 

  14. Prabhakar KR, Srikar VS, Babu RV (2017) Deepfuse: a deep unsupervised approach for exposure fusion with extreme exposure image pairs. In: Proceedings of the IEEE international conference on computer vision, pp 4714–4722

  15. Li J et al (2020) DRPL: deep regression pair learning for multi-focus image fusion. IEEE Trans Image Process 29:4816–4831

  16. Zhang H, Ma J (2021) SDNet: a versatile squeeze-and-decomposition network for real-time image fusion. Int J Comput Vis 129:2761–2785

  17. Amin-Naji M, Aghagolzadeh A, Ezoji M (2020) CNNs hard voting for multi-focus image fusion. J Ambient Intell Humanized Comput 11:1749–1769

  18. Xu H et al (2020) U2Fusion: a unified unsupervised image fusion network. In: IEEE Trans Pattern Anal Mach Intell 44(1):502–518

  19. Haitao Y, Wei Z (2023) Multi-Scale Dilated Convolutional Neural Network Based Multi-Focus Image Fusion Algorithm. Laser Optoelectron Progress 60(2):0210003–0210003

    Google Scholar 

  20. Chandra JG, Anshuman S, Anupam A (2022) Capsule neural networks on spatio-temporal EEG frames for cross-subject emotion recognition. Biomed Signal Process Control 72:1746–8094

    Google Scholar 

  21. Ma H et al (2020) An \(\alpha \)-matte boundary defocus model-based cascaded network for multi-focus image fusion. IEEE Trans Image Process 29:8668–8679

    Article  Google Scholar 

  22. Jiang L et al (2021) Pseudo-Siamese residual atrous pyramid network for multifocus image fusion. IET Image Process 15(13):3304–3317

    Article  Google Scholar 

  23. Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141

  24. Heng Li et al (2021) Multi-focus image fusion algorithm based on supervised learning for fully convolutional neural network. Pattern Recogn Lett 141:45–53

    Article  Google Scholar 

  25. Nejati M, Samavi S, Shirani S (2015) Multi-focus image fusion using dictionary-based sparse representation. Inf Fusion 25:72–84

    Article  Google Scholar 

  26. Zhang Y, Bai X, Wang T (2017) Boundary finding based multi-focus image fusion through multi-scale morphological focus-measure. Inf Fusion 35:81–101

    Article  Google Scholar 

  27. Qiu X et al (2019) Guided filter-based multi-focus image fusion through focus region detection. Signal Process Image Commun 72:35–46

    Article  Google Scholar 

  28. Liu Y et al (2017) Multi-focus image fusion with a deep convolutional neural network. Inf Fusion 36:191–207

    Article  Google Scholar 

  29. Amin-Naji M, Aghagolzadeh A, Ezoji M (2019) Ensemble of CNN for multi-focus image fusion. Inf Fusion 51:201–214

    Article  Google Scholar 

  30. Zhang Y et al (2020) IFCNN: a general image fusion framework based on convolutional neural network. Inf Fusion 54:99–118

  31. Ma B et al (2021) Sesf-fuse: an unsupervised deep model for multi-focus image fusion. Neural Comput & Applic 33:5793–5804

  32. Ma B et al (2022) End-to-end learning for simultaneously generating decision map and multi-focus image fusion result. Neurocomputing 470:204–216

    Article  Google Scholar 

  33. Li S, Hong R, Wu X (2008) A novel similarity based quality metric for image fusion. In: 2008 International conference on audio, language and image processing. IEEE, pp 167–172

  34. Han Y et al (2013) A new image fusion performance metric based on visual information fidelity. Inf Fusion 14(2):127–135

    Article  Google Scholar 

  35. Haghighat MBA, Aghagolzadeh A, Seyedarabi H (2011) A non-reference image fusion metric based on mutual information of image features. Comput Electr Eng 37(5):744–756

    Article  Google Scholar 

  36. Wang HN, Zhong W, Wang J (2004) Research of measurement for digital image definition. J Image Graph 9(7):828–831

  37. Bai X, Zhou F, Xue B (2012) Noise-suppressed image enhancement using multiscale top-hat selection transform through region extraction. Appl Opt 51(3):338–347

Download references

Acknowledgements

The authors acknowledge Guangdong Science and Technology Program ((2017A010101016).

Author information

Authors and Affiliations

  1. School of Information Engineering, Guangdong University of Technology, Guangzhou, 510006, Guangdong, China

    Miao Lin & Weitong Li

Authors
  1. Miao Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Weitong Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Weitong Li.

Ethics declarations

Conflicts of interest

The authors declare that no potentail competing interests exist. There is no an undisclosed relationship that may pose a competing interest. There is no an undisclosed funding source that may pose a competing interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, M., Li, W. Multi-focus image fusion algorithm based on region detection and ACS network. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-19244-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11042-024-19244-2

Keywords

Search

Navigation