Skip to main content

Advertisement

SpringerLink
Log in

Deep neural network for beam hardening artifacts removal in image reconstruction

  • Published:
Applied Intelligence Aims and scope Submit manuscript

Abstract

Image reconstruction with limited angles projection data is a challenging task in computed tomography (CT). The amount of radiation associated with CT induces health implications to the patient. Besides, image reconstruction with limited-angles projection data distorts the image, thus emasculating the efficiency of diagnosis. Also, the poly-chromatic nature of the X-ray adds beam-hardening artifacts in the reconstruction. The state-of-the-art approaches available in the literature have proposed the solutions for beam-hardening artifacts correction in full span computed tomography. Most of the solutions are hardware based and need extra hardware to remove the beam hardening artifacts. The present manuscript proposes artificial intelligence based software solution for the beam hardening artifacts removal. This manuscript has presented a cascaded encoder-decoder architecture named cascaded deep neural network for image reconstruction (CDNN). The CDNN architecture has convolution neural network blocks that include convolution layers, rectified linear units ReLU, and batch normalization layers. The network has skip-connections for better learning of features between input and output. The network has been designed as a forward model. The stochastic gradient descent optimization method has been used for training the network. Image reconstructed from Fourier transform-based approach has been used as a prior. A novel approach for reduction of beam-hardening artifacts in case of limited-angles computed tomography using CDNN has been presented. The proposed approach is comparable to other hardware/software solutions for aforesaid purpose and does not require any extra hardware. The proposed approach has improved the image quality as compared to U-Net and the other state-of-the-art methods. It has been found from the experiments that the CDNN suppresses the artifacts and improves the reconstruction. The performance of the proposed CDNN has been tested with real-life data having beam hardening artifacts. It has been observed that the CDNN has improved the reconstruction quality by reducing streak, ring artifacts, and beam hardening artifacts and also preserving the profound structures.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Abdurahman S, Frysch R, Bismark R, Melnik S, Beuing O, Rose G (2018) Beam hardening correction using cone beam consistency conditions. IEEE Trans Med Imaging 37(10):2266–2277

    Article  Google Scholar 

  2. Abella M, Martínez C, Desco M, Vaquero JJ, Fessler JA (2020) Simplified statistical image reconstruction for x-ray ct with beam-hardening artifact compensation. IEEE Trans Med Imaging 39(1):111–118. https://doi.org/10.1109/TMI.2019.2921929

    Article  Google Scholar 

  3. Aggarwal HK, Mani MP, Jacob M (2018) Modl: Model-based deep learning architecture for inverse problems. IEEE Trans Med Imaging 38(2):394–405

    Article  Google Scholar 

  4. Aharon M, Elad M, Bruckstein A (2006) K-svd: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans Signal Process 54(11):4311–4322. https://doi.org/10.1109/TSP.2006.881199

    Article  Google Scholar 

  5. Andersen AH, Kak AC (1984) Simultaneous algebraic reconstruction technique (sart): a superior implementation of the art algorithm. Ultraso Imaging 6(1):81–94

    Article  Google Scholar 

  6. Bajpai M, Gupta P, Munshi P (2013) Multi-core cpu based three-dimensional image reconstruction for limited view tomography. In: World congress on industrial process tomography. ISIPT

  7. Bajpai M, Gupta P, Munshi P (2015) Fast multi-processor multi-gpu based algorithm of tomographic inversion for 3d image reconstruction. Int J High Perform Comput Appl 29(1):64–72

    Article  Google Scholar 

  8. Bajpai M, Gupta P, Munshi P, Titarenko V, Withers P (2013) A graphical processing unit-based parallel implementation of multiplicative algebraic reconstruction technique algorithm for limited view tomography. Res Nondestruct Eval 24(4):211–222

    Article  Google Scholar 

  9. Bajpai M, Schorr C, Maisl M, Gupta P, Munshi P (2013) High resolution 3d image reconstruction using the algebraic method for cone-beam geometry over circular and helical trajectories. NDT & E Int 60:62–69

    Article  Google Scholar 

  10. Bao L, Ye F, Cai C, Wu J, Zeng K, van Zijl PC, Chen Z (2019) Undersampled mr image reconstruction using an enhanced recursive residual network. J Magn Reson 305:232–246

    Article  Google Scholar 

  11. Bara N, Murata K (1981) Maximum entropy image reconstruction from projections. Opt Commun 38(2):91–95

    Article  Google Scholar 

  12. Bartle RG (2014) The elements of integration and Lebesgue measure. Wiley

  13. Bayaraa T, Hyun CM, Jang TJ, Lee SM, Seo JK (2020) A two-stage approach for beam hardening artifact reduction in low-dose dental cbct. IEEE Access

  14. Boublil D, Elad M, Shtok J, Zibulevsky M (2015) Spatially-adaptive reconstruction in computed tomography using neural networks. IEEE Trans Med Imaging 34(7):1474–1485

    Article  Google Scholar 

  15. Chang Z, Ye DH, Srivastava S, Thibault JB, Sauer K, Bouman C (2019) Prior-guided metal artifact reduction for iterative x-ray computed tomography. IEEE Trans Med Imaging 38(6):1532–1542. https://doi.org/10.1109/TMI.2018.2886701

    Article  Google Scholar 

  16. Chen H, Zhang Y, Kalra MK, Lin F, Chen Y, Liao P, Zhou J, Wang G (2017) Low-dose ct with a residual encoder-decoder convolutional neural network. IEEE Trans Med Imaging 36(12):2524–2535

    Article  Google Scholar 

  17. Chen H, Zhang Y, Zhang W, Liao P, Li K, Zhou J, Wang G (2017) Low-dose ct via convolutional neural network. Biomed Opt Express 8(2):679–694

    Article  Google Scholar 

  18. Chen Y, Shi L, Feng Q, Yang J, Shu H, Luo L, Coatrieux JL, Chen W (2014) Artifact suppressed dictionary learning for low-dose ct image processing. IEEE Trans Med Imaging 33(12):2271–2292

    Article  Google Scholar 

  19. Chen Y, Yu F, Luo L, Toumoulin C (2013) Improving abdomen tumor low-dose ct images using dictionary learning based patch processing and unsharp filtering. In: 2013 35Th annual international conference of the IEEE engineering in medicine and biology society (EMBC). IEEE, pp 4014–4017

  20. Chollet F (2018) Deep Learning mit Python und Keras: Das Praxis-Handbuch vom Entwickler der Keras-Bibliothek. MITP GmbH & Co KG

  21. Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M et al (2013) The cancer imaging archive (tcia): maintaining and operating a public information repository. J Digit Imaging 26(6):1045–1057

    Article  Google Scholar 

  22. Dabov K, Foi A, Katkovnik V, Egiazarian K (2007) Image denoising by sparse 3-d transform-domain collaborative filtering. IEEE Trans Image Process 16(8):2080–2095. https://doi.org/10.1109/TIP.2007.901238

    Article  MathSciNet  Google Scholar 

  23. Danan Y, Avraham D, Zalevsky Z (2020) Reduction in irradiation dose in aperture coded enhanced computed tomography imager using super-resolution techniques. Sensors 20(22):6551

    Article  Google Scholar 

  24. Dong C, Loy CC, He K, Tang X (2015) Image super-resolution using deep convolutional networks. IEEE Trans Pattern Anal Mach Intell 38(2):295–307

    Article  Google Scholar 

  25. Gilbert P (1972) Iterative methods for the three-dimensional reconstruction of an object from projections. J Theor Biol 36(1):105–117

    Article  Google Scholar 

  26. Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249–256

  27. Gordon R, Bender R, Herman GT (1970) Algebraic reconstruction techniques (art) for three-dimensional electron microscopy and x-ray photography. J Theor Biol 29(3):471–481

    Article  Google Scholar 

  28. Gordon RA (1994) The integrals of lebesgue, denjoy, perron, and henstock. vol 4. American Mathematical Society

  29. Gürsoy D, De Carlo F, Xiao X, Jacobsen C (2014) Tomopy: a framework for the analysis of synchrotron tomographic data. J Synchrotron Radiat 21(5):1188–1193

    Article  Google Scholar 

  30. Herman GT (2009) Fundamentals of computerized tomography: image reconstruction from projections. Springer Science & Business Media

  31. Jerez A, Márquez M, Arguello H (2021) Adaptive coded aperture design for compressive computed tomography. J Comput Appl Math 384, 113174. https://doi.org/10.1016/j.cam.2020.113174

  32. Jin KH, McCann MT, Froustey E, Unser M (2017) Deep convolutional neural network for inverse problems in imaging. IEEE Trans Image Process 26(9):4509–4522

    Article  MathSciNet  Google Scholar 

  33. Kalare KW, Bajpai MK (2020) Recdnn: deep neural network for image reconstruction from limited view projection data. Soft Computing. https://doi.org/10.1007/s00500-020-05013-4

  34. Kang E, Min J, Ye JC (2017) A deep convolutional neural network using directional wavelets for low-dose x-ray ct reconstruction. Med Phys 44(10):e360–e375

    Article  Google Scholar 

  35. LeCun YA, Bottou L, Orr GB, Müller KR (2012) Efficient backprop. In: Neural networks: Tricks of the trade. Springer, pp 9–48

  36. Lin DJ, Johnson PM, Knoll F, Lui YW (2020) Artificial intelligence for mr image reconstruction: An overview for clinicians. Journal of Magnetic Resonance Imaging

  37. Liugang G, Jianfeng S, Tao L, Kai X, Xinye N (2019) Metal artifact reduction method based on noncoplanar scanning in cbct imaging. IEEE Access 8:7236–7243

    Article  Google Scholar 

  38. Natterer F, Wübbeling F (2001) Mathematical methods in image reconstruction, vol 5. SIAM

  39. Pelt DM, Batenburg KJ (2013) Fast tomographic reconstruction from limited data using artificial neural networks. IEEE Trans Image Process 22(12):5238–5251

    Article  Google Scholar 

  40. Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 234–241

  41. Sarkar S, Wahi P, Munshi P (2019) An empirical correction method for beam-hardening artifact in computerized tomography (ct) images. NDT & E Int 102:104–113

    Article  Google Scholar 

  42. Shan H, Padole A, Homayounieh F, Kruger U, Khera RD, Nitiwarangkul C, Kalra MK, Wang G (2019) Competitive performance of a modularized deep neural network compared to commercial algorithms for low-dose ct image reconstruction. Nat Mach Intell 1(6):269–276

    Article  Google Scholar 

  43. Shan H, Zhang Y, Yang Q, Kruger U, Kalra MK, Sun L, Cong W, Wang G (2018) 3-d convolutional encoder-decoder network for low-dose ct via transfer learning from a 2-d trained network. IEEE Trans Med Imaging 37(6):1522–1534

    Article  Google Scholar 

  44. Solomon J, Lyu P, Marin D, Samei E (2020) Noise and spatial resolution properties of a commercially available deep-learning based ct reconstruction algorithm. Medical Physics

  45. Vedula V, Munshi P (2008) An improved algorithm for beam-hardening corrections in experimental x-ray tomography. NDT & E Int 41(1):25–31

    Article  Google Scholar 

  46. Wei J, Chen P, Han Y, Zhao Y (2021) Blind separation model of multi-voltage projections for the hardening artifact correction in computed tomography. Biomed Signal Process Control 64:102236

    Article  Google Scholar 

  47. Willemink MJ, Noël PB (2019) The evolution of image reconstruction for ct—from filtered back projection to artificial intelligence. Eur Radiol 29(5):2185–2195

    Article  Google Scholar 

  48. Wolterink JM, Leiner T, Viergever MA, Išgum I (2017) Generative adversarial networks for noise reduction in low-dose ct. IEEE Trans Med Imaging 36(12):2536–2545

    Article  Google Scholar 

  49. Würfl T, Ghesu FC, Christlein V, Maier A (2016) Deep learning computed tomography. In: International conference on medical image computing and computer-assisted intervention. Springer, pp 432–440

  50. Yang Q, Yan P, Zhang Y, Yu H, Shi Y, Mou X, Kalra MK, Zhang Y, Sun L, Wang G (2018) Low-dose ct image denoising using a generative adversarial network with wasserstein distance and perceptual loss. IEEE Trans Med Imaging 37(6):1348–1357

    Article  Google Scholar 

  51. Yu H, Wang G (2010) A soft-threshold filtering approach for reconstruction from a limited number of projections. Phys Med Biol 55(13):3905

    Article  Google Scholar 

  52. Zhao W, Li D, Niu K, Qin W, Peng H, Niu T (2018) Robust beam hardening artifacts reduction for computed tomography using spectrum modeling. IEEE Trans Comput Imaging 5(2):333–342

    Article  Google Scholar 

  53. Zhu B, Liu JZ, Cauley SF, Rosen BR, Rosen MS (2018) Image reconstruction by domain-transform manifold learning. Nature 555(7697):487–492

    Article  Google Scholar 

Download references

Acknowledgements

This work has been supported by the Ministry of Electronics and Information Technology (MEITY), Government of India under the Visvesvaraya Ph.D. scheme. The authors would like to thank MEITY for providing a Ph.D. fellowship under the Visvesvaraya Ph.D. scheme.

Author information

Authors and Affiliations

  1. Computer Science and Engineering Discipline, Indian Institute of Information Technology Design and Manufacturing Jabalpur, Jabalpur, India

    Kailash Kalare & Manish Bajpai

  2. Indian Institute of Technology, Kanpur, India

    Shubhabrata Sarkar & Prabhat Munshi

Authors
  1. Kailash Kalare
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manish Bajpai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shubhabrata Sarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Prabhat Munshi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kailash Kalare.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kalare, K., Bajpai, M., Sarkar, S. et al. Deep neural network for beam hardening artifacts removal in image reconstruction. Appl Intell 52, 6037–6056 (2022). https://doi.org/10.1007/s10489-021-02604-y

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10489-021-02604-y

Keywords

Search

Navigation