Skip to main content

A Superpixel-Wise Fully Convolutional Neural Network Approach for Diabetic Foot Ulcer Tissue Classification

  • Conference paper
  • First Online:
Pattern Recognition. ICPR International Workshops and Challenges (ICPR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12661))

Included in the following conference series:

Abstract

Accurate assessment of diabetic foot ulcers (DFU) is primordial to provide an efficient treatment and to prevent amputation. Traditional DFU assessment methods used by clinicians are based on visual examination of the ulcer by estimating the surface and analyzing tissue conditions. These manual methods are subjective and make direct contact with the wound, resulting in high variability and risk of infection. In this research work, we propose a novel smartphone-based skin telemonitoring system to support medical diagnoses and decisions during DFU tissues examination. The database contains 219 images, for effective tissue identification and annotation of the ground truth, a graphical interface based on superpixel segmentation method has been used. Our method performs DFU assessment in an end-to-end style comprising automatic ulcer segmentation and tissue classification. The classification task is performed at a patch-level, superpixels extracted with SLIC are used as input for the training of the deep neural network. State-of-the-art deep learning models for semantic segmentation have been used to perform tissue differentiation within the ulcer area into three classes (Necrosis, Granulation and Slough) and have been compared to the proposed method. The proposed superpixel-based method outperforms classic fully convolutional network models while improving significantly the performance on all the metrics. Accuracy and DICE index are improved from 84.55% to 92.68% and from 54.31% to 75.74% respectively for FCN-32. The results reveal robust tissue classification effectiveness and the potential of our system to monitor DFU healing over time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Standup: Smartphone thermal analysis for diabetic foot ulcer prevention and treatment (2018). https://standupproject.eu/

  2. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: Slic superpixels. Technical report (2010)

    Google Scholar 

  3. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)

    Article  Google Scholar 

  4. Aguiree, F., et al.: Idf diabetes atlas (2013)

    Google Scholar 

  5. Alexiadou, K., Doupis, J.: Management of diabetic foot ulcers. Diab. Ther. 3(1), 4 (2012)

    Article  Google Scholar 

  6. Badrinarayanan, V., Kendall, A., Cipolla, R.: Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)

    Article  Google Scholar 

  7. Blanco, G., et al.: A superpixel-driven deep learning approach for the analysis of dermatological wounds. Comput. Methods Programs Biomed. 183, 105079 (2020)

    Article  Google Scholar 

  8. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)

    Google Scholar 

  9. Dice, L.R.: Measures of the amount of ecologic association between species. Ecology 26(3), 297–302 (1945)

    Article  Google Scholar 

  10. Godeiro, V., Neto, J.S., Carvalho, B., Santana, B., Ferraz, J., Gama, R.: Chronic wound tissue classification using convolutional networks and color space reduction. In: 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6. IEEE (2018)

    Google Scholar 

  11. Goyal, M., Reeves, N.D., Davison, A.K., Rajbhandari, S., Spragg, J., Yap, M.H.: DFUNet: convolutional neural networks for diabetic foot ulcer classification. IEEE Trans. Emerg. Topics Comput. Intell. 4, 728–739 (2018)

    Article  Google Scholar 

  12. Goyal, M., Reeves, N.D., Rajbhandari, S., Yap, M.H.: Robust methods for real-time diabetic foot ulcer detection and localization on mobile devices. IEEE J. Biomed. Health Inform. 23(4), 1730–1741 (2018)

    Article  Google Scholar 

  13. Gray, D., White, R., Cooper, P., Kingsley, A.: Understanding applied wound management. WOUNDS UK 1(1), 62 (2005)

    Google Scholar 

  14. Jørgensen, L.B., Sørensen, J.A., Jemec, G.B., Yderstræde, K.B.: Methods to assess area and volume of wounds-a systematic review. Int. Wound J. 13(4), 540–553 (2016)

    Article  Google Scholar 

  15. Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)

    Google Scholar 

  16. Mukherjee, R., Manohar, D.D., Das, D.K., Achar, A., Mitra, A., Chakraborty, C.: Automated tissue classification framework for reproducible chronic wound assessment. BioMed Rese. Int. 2014, 1–9 (2014)

    Google Scholar 

  17. Nejati, H., et al.: Fine-grained wound tissue analysis using deep neural network. In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1010–1014. IEEE (2018)

    Google Scholar 

  18. NIRI, R., Lucas, Y., Treuillet, S., Douzi, H.: Smartphone-based thermal imaging system for diabetic foot ulcer assessment. In: Journées d’Etude sur la TéléSanté. Sorbonne Universités, Paris, France, May 2019. https://hal.archives-ouvertes.fr/hal-02161044

  19. Rania, N., Douzi, H., Yves, L., Sylvie, T.: Semantic segmentation of diabetic foot ulcer images: dealing with small dataset in DL approaches. In: El Moataz, A., Mammass, D., Mansouri, A., Nouboud, F. (eds.) ICISP 2020. LNCS, vol. 12119, pp. 162–169. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-51935-3_17

    Chapter  Google Scholar 

  20. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28

    Chapter  Google Scholar 

  21. Ruder, S.: An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747 (2016)

  22. Silberman, N., Hoiem, D., Kohli, P., Fergus, R.: Indoor segmentation and support inference from RGBD images. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7576, pp. 746–760. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33715-4_54

    Chapter  Google Scholar 

  23. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  24. Sreedhar, K., Panlal, B.: Enhancement of images using morphological transformation. arXiv preprint arXiv:1203.2514 (2012)

  25. Wang, C., et al.: A unified framework for automatic wound segmentation and analysis with deep convolutional neural networks. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2415–2418. IEEE (2015)

    Google Scholar 

  26. Wang, L., Pedersen, P.C., Agu, E., Strong, D.M., Tulu, B.: Area determination of diabetic foot ulcer images using a cascaded two-stage SVM-based classification. IEEE Trans. Biomed. Eng. 64(9), 2098–2109 (2016)

    Article  Google Scholar 

  27. Wannous, H., Lucas, Y., Treuillet, S., Albouy, B.: A complete 3D wound assessment tool for accurate tissue classification and measurement. In: 2008 15th IEEE International Conference on Image Processing, pp. 2928–2931. IEEE (2008)

    Google Scholar 

  28. Wannous, H., Treuillet, S., Lucas, Y.: Robust tissue classification for reproducible wound assessment in telemedicine environments. J. Electron. Imaging 19(2), 023002 (2010)

    Article  Google Scholar 

  29. Wantanajittikul, K., Auephanwiriyakul, S., Theera-Umpon, N., Koanantakool, T.: Automatic segmentation and degree identification in burn color images. In: The 4th 2011 Biomedical Engineering International Conference, pp. 169–173. IEEE (2012)

    Google Scholar 

  30. Young, T.: Accurate assessment of different wound tissue types. Wounds Essentials 10(1), 51–4 (2015)

    MathSciNet  Google Scholar 

  31. Zahia, S., Sierra-Sosa, D., Garcia-Zapirain, B., Elmaghraby, A.: Tissue classification and segmentation of pressure injuries using convolutional neural networks. Comput. Methods Programs Biomed. 159, 51–58 (2018)

    Article  Google Scholar 

Download references

Acknowledgments

This research work is supported by the European Union’s Horizon 2020 under the Marie Sklodowska-Curie grant agreement No. 777661. The authors express their gratitude to the Hospital Nacional Dos de Mayo in Peru, the CHRO Hospital in France and especially to Evelyn Gutiérrez for their cooperation in collecting diabetic foot images.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rania Niri .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Niri, R., Douzi, H., Lucas, Y., Treuillet, S. (2021). A Superpixel-Wise Fully Convolutional Neural Network Approach for Diabetic Foot Ulcer Tissue Classification. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12661. Springer, Cham. https://doi.org/10.1007/978-3-030-68763-2_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-68763-2_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-68762-5

  • Online ISBN: 978-3-030-68763-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics