Abstract
This paper presents a novel deformable registration framework, leveraging an image prior specified through a denoising function, for severely noise-corrupted placental images. Recent work on plug-and-play (PnP) priors has shown the state-of-the-art performance of reconstruction algorithms under such priors in a range of imaging applications. Integration of powerful image denoisers into advanced registration methods provides our model with a flexibility to accommodate datasets that have low signal-to-noise ratios (SNRs). We demonstrate the performance of our method under a wide variety of denoising models in the context of diffeomorphic image registration. Experimental results show that our model substantially improves the accuracy of spatial alignment in applications of 3D in-utero diffusion-weighted MR images (DW-MRI) that suffer from low SNR and large spatial transformations.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Avants, B.B., Epstein, C.L., Grossman, M., Gee, J.C.: Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain. Med. Image Anal. 12(1), 26–41 (2008)
Beck, A., Teboulle, M.: Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Trans. Image Process. 18(11), 2419–2434 (2009)
Beg, M.F., Miller, M.I., Trouvé, A., Younes, L.: Computing large deformation metric mappings via geodesic flows of diffeomorphisms. Int. J. Comput. Vision 61(2), 139–157 (2005)
Blencowe, H., et al.: Born too soon: the global epidemiology of 15 million preterm births. Reprod. Health 10(1), S2 (2013)
Bredies, K., Kunisch, K., Pock, T.: Total generalized variation. SIAM J. Imaging Sci. 3(3), 492–526 (2010)
Broit, C.: Optimal registration of deformed images (1981)
Buades, A., Coll, B., Morel, J.M.: A non-local algorithm for image denoising. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 2, pp. 60–65. IEEE (2005)
Buzzard, G.T., Chan, S.H., Sreehari, S., Bouman, C.A.: Plug-and-play unplugged: optimization free reconstruction using consensus equilibrium. SIAM J. Imaging Sci. 11(3), 2001–2020 (2018)
Chan, S.H., Wang, X., Elgendy, O.A.: Plug-and-play ADMM for image restoration: fixed-point convergence and applications. IEEE Trans. Comput. Imaging 3(1), 84–98 (2017)
Christensen, G.E.: Deformable shape models for anatomy (1994)
Dabov, K., Foi, A., Egiazarian, K.: Video denoising by sparse 3D transform-domain collaborative filtering. In: 15th European Signal Processing Conference, pp. 145–149. IEEE (2007)
Han, J., et al.: A variational framework for joint image registration, denoising and edge detection. In: Handels, H., Ehrhardt, J., Horsch, A., Meinzer, H.P., Tolxdorff, T. (eds.) Bildverarbeitung für die Medizin 2006, pp. 246–250. Springer, Heidelberg (2006). https://doi.org/10.1007/3-540-32137-3_50
Le Bihan, D., Poupon, C., Amadon, A., Lethimonnier, F.: Artifacts and pitfalls in diffusion MRI. J. Magn. Reson. Imaging 24(3), 478–488 (2006). An Official Journal of the International Society for Magnetic Resonance in Medicine
Lempitsky, V., Rother, C., Blake, A.: Logcut-efficient graph cut optimization for Markov random fields. In: IEEE 11th International Conference on Computer Vision, pp. 1–8. IEEE (2007)
Leventon, M., Wells III, W.M., Grimson, W.E.L.: Multiple view 2D-3D mutual information registration. In: Image Understanding Workshop, vol. 20, p. 21. Citeseer (1997)
Lombaert, H., Cheriet, F.: Simultaneous image de-noising and registration using graph cuts: application to corrupted medical images. In: 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA), pp. 264–268. IEEE (2012)
Lombaert, H., Cheriet, F.: Simultaneous image denoising and registration using graph cuts, July 2012
Meinhardt, T., Moeller, M., Hazirbas, C., Cremers, D.: Learning proximal operators: using denoising networks for regularizing inverse imaging problems. In: Proceedings of IEEE International Conference on Computer Vision (ICCV), Venice, pp. 1799–1808, 22–29 October 2017
Miller, M.I., Trouvé, A., Younes, L.: Geodesic shooting for computational anatomy. J. Math. Imaging Vis. 24(2), 209–228 (2006)
Nocedal, J., Wright, S.J.: Numerical Optimization, 2nd edn. Springer, New York (2006). https://doi.org/10.1007/978-0-387-40065-5
Parikh, N., Boyd, S.: Proximal algorithms. Found. Trends Optim. 1(3), 123–231 (2014)
Partridge, S.C., McDonald, E.S.: Diffusion weighted MRI of the breast: protocol optimization, guidelines for interpretation, and potential clinical applications. Magn. Reson. Imaging Clin. N. Am. 21(3), 601 (2013)
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. Physica D 60(1–4), 259–268 (1992)
Ryu, E.K., Liu, J., Wnag, S., Chen, X., Wang, Z., Yin, W.: Plug-and-play methods provably converge with properly trained denoisers. In: Proceedings of the 36th International Conference on Machine Learning (ICML), Long Beach, June 2019
Sanches, J.M., Marques, J.S.: Joint image registration and volume reconstruction for 3D ultrasound. Pattern Recogn. Lett. 24(4–5), 791–800 (2003)
Sreehari, S., et al.: Plug-and-play priors for bright field electron tomography and sparse interpolation. IEEE Trans. Comput. Imaging 2(4), 408–423 (2016)
Sun, Y., Wohlberg, B., Kamilov, U.S.: An online plug-and-play algorithm for regularized image reconstruction. IEEE Trans. Comput. Imaging (2019)
Telea, A., Preusser, T., Garbe, C., Droske, M., Rumpf, M.: A variational approach to joint denoising, edge detection and motion estimation. In: Franke, K., Müller, K.-R., Nickolay, B., Schäfer, R. (eds.) DAGM 2006. LNCS, vol. 4174, pp. 525–535. Springer, Heidelberg (2006). https://doi.org/10.1007/11861898_53
Tomaževič, D., Likar, B., Pernuš, F.: Reconstruction-based 3D/2D image registration. In: Duncan, J.S., Gerig, G. (eds.) MICCAI 2005. LNCS, vol. 3750, pp. 231–238. Springer, Heidelberg (2005). https://doi.org/10.1007/11566489_29
Venkatakrishnan, S.V., Bouman, C.A., Wohlberg, B.: Plug-and-play priors for model based reconstruction. In: IEEE Global Conference on Signal and Information Processing, pp. 945–948. IEEE (2013)
Vialard, F.X., Risser, L., Rueckert, D., Cotter, C.J.: Diffeomorphic 3D image registration via geodesic shooting using an efficient adjoint calculation. Int. J. Comput. Vision 97(2), 229–241 (2012)
Vishnevskiy, V., Stoeck, C., Székely, G., Tanner, C., Kozerke, S.: Simultaneous denoising and registration for accurate cardiac diffusion tensor reconstruction from MRI. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9349, pp. 215–222. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24553-9_27
Zhang, M., Fletcher, P.T.: Finite-dimensional lie algebras for fast diffeomorphic image registration. In: Ourselin, S., Alexander, D.C., Westin, C.-F., Cardoso, M.J. (eds.) IPMI 2015. LNCS, vol. 9123, pp. 249–260. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-19992-4_19
Zhang, M., Fletcher, P.T.: Fast diffeomorphic image registration via Fourier-approximated lie algebras. Int. J. Comput. Vision 127(1), 61–73 (2019)
Zhang, M., et al.: Frequency diffeomorphisms for efficient image registration. In: Niethammer, M., et al. (eds.) IPMI 2017. LNCS, vol. 10265, pp. 559–570. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-59050-9_44
Acknowledgement
This work was supported by NIH grant R01HD094381, NIH grant R01AG053548, and BrightFocus Foundation A2017330S.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Xing, J., Kamilov, U., Wu, W., Wang, Y., Zhang, M. (2019). Plug-and-Play Priors for Reconstruction-Based Placental Image Registration. In: Wang, Q., et al. Smart Ultrasound Imaging and Perinatal, Preterm and Paediatric Image Analysis. PIPPI SUSI 2019 2019. Lecture Notes in Computer Science(), vol 11798. Springer, Cham. https://doi.org/10.1007/978-3-030-32875-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-030-32875-7_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32874-0
Online ISBN: 978-3-030-32875-7
eBook Packages: Computer ScienceComputer Science (R0)