Abstract
Accurate assessment of diabetic foot ulcers (DFU) is primordial to provide an efficient treatment and to prevent amputation. Traditional DFU assessment methods used by clinicians are based on visual examination of the ulcer by estimating the surface and analyzing tissue conditions. These manual methods are subjective and make direct contact with the wound, resulting in high variability and risk of infection. In this research work, we propose a novel smartphone-based skin telemonitoring system to support medical diagnoses and decisions during DFU tissues examination. The database contains 219 images, for effective tissue identification and annotation of the ground truth, a graphical interface based on superpixel segmentation method has been used. Our method performs DFU assessment in an end-to-end style comprising automatic ulcer segmentation and tissue classification. The classification task is performed at a patch-level, superpixels extracted with SLIC are used as input for the training of the deep neural network. State-of-the-art deep learning models for semantic segmentation have been used to perform tissue differentiation within the ulcer area into three classes (Necrosis, Granulation and Slough) and have been compared to the proposed method. The proposed superpixel-based method outperforms classic fully convolutional network models while improving significantly the performance on all the metrics. Accuracy and DICE index are improved from 84.55% to 92.68% and from 54.31% to 75.74% respectively for FCN-32. The results reveal robust tissue classification effectiveness and the potential of our system to monitor DFU healing over time.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Standup: Smartphone thermal analysis for diabetic foot ulcer prevention and treatment (2018). https://standupproject.eu/
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: Slic superpixels. Technical report (2010)
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstrunk, S.: Slic superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2282 (2012)
Aguiree, F., et al.: Idf diabetes atlas (2013)
Alexiadou, K., Doupis, J.: Management of diabetic foot ulcers. Diab. Ther. 3(1), 4 (2012)
Badrinarayanan, V., Kendall, A., Cipolla, R.: Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)
Blanco, G., et al.: A superpixel-driven deep learning approach for the analysis of dermatological wounds. Comput. Methods Programs Biomed. 183, 105079 (2020)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE (2009)
Dice, L.R.: Measures of the amount of ecologic association between species. Ecology 26(3), 297–302 (1945)
Godeiro, V., Neto, J.S., Carvalho, B., Santana, B., Ferraz, J., Gama, R.: Chronic wound tissue classification using convolutional networks and color space reduction. In: 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP), pp. 1–6. IEEE (2018)
Goyal, M., Reeves, N.D., Davison, A.K., Rajbhandari, S., Spragg, J., Yap, M.H.: DFUNet: convolutional neural networks for diabetic foot ulcer classification. IEEE Trans. Emerg. Topics Comput. Intell. 4, 728–739 (2018)
Goyal, M., Reeves, N.D., Rajbhandari, S., Yap, M.H.: Robust methods for real-time diabetic foot ulcer detection and localization on mobile devices. IEEE J. Biomed. Health Inform. 23(4), 1730–1741 (2018)
Gray, D., White, R., Cooper, P., Kingsley, A.: Understanding applied wound management. WOUNDS UK 1(1), 62 (2005)
Jørgensen, L.B., Sørensen, J.A., Jemec, G.B., Yderstræde, K.B.: Methods to assess area and volume of wounds-a systematic review. Int. Wound J. 13(4), 540–553 (2016)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Mukherjee, R., Manohar, D.D., Das, D.K., Achar, A., Mitra, A., Chakraborty, C.: Automated tissue classification framework for reproducible chronic wound assessment. BioMed Rese. Int. 2014, 1–9 (2014)
Nejati, H., et al.: Fine-grained wound tissue analysis using deep neural network. In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1010–1014. IEEE (2018)
NIRI, R., Lucas, Y., Treuillet, S., Douzi, H.: Smartphone-based thermal imaging system for diabetic foot ulcer assessment. In: Journées d’Etude sur la TéléSanté. Sorbonne Universités, Paris, France, May 2019. https://hal.archives-ouvertes.fr/hal-02161044
Rania, N., Douzi, H., Yves, L., Sylvie, T.: Semantic segmentation of diabetic foot ulcer images: dealing with small dataset in DL approaches. In: El Moataz, A., Mammass, D., Mansouri, A., Nouboud, F. (eds.) ICISP 2020. LNCS, vol. 12119, pp. 162–169. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-51935-3_17
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Ruder, S.: An overview of gradient descent optimization algorithms. arXiv preprint arXiv:1609.04747 (2016)
Silberman, N., Hoiem, D., Kohli, P., Fergus, R.: Indoor segmentation and support inference from RGBD images. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7576, pp. 746–760. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33715-4_54
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
Sreedhar, K., Panlal, B.: Enhancement of images using morphological transformation. arXiv preprint arXiv:1203.2514 (2012)
Wang, C., et al.: A unified framework for automatic wound segmentation and analysis with deep convolutional neural networks. In: 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 2415–2418. IEEE (2015)
Wang, L., Pedersen, P.C., Agu, E., Strong, D.M., Tulu, B.: Area determination of diabetic foot ulcer images using a cascaded two-stage SVM-based classification. IEEE Trans. Biomed. Eng. 64(9), 2098–2109 (2016)
Wannous, H., Lucas, Y., Treuillet, S., Albouy, B.: A complete 3D wound assessment tool for accurate tissue classification and measurement. In: 2008 15th IEEE International Conference on Image Processing, pp. 2928–2931. IEEE (2008)
Wannous, H., Treuillet, S., Lucas, Y.: Robust tissue classification for reproducible wound assessment in telemedicine environments. J. Electron. Imaging 19(2), 023002 (2010)
Wantanajittikul, K., Auephanwiriyakul, S., Theera-Umpon, N., Koanantakool, T.: Automatic segmentation and degree identification in burn color images. In: The 4th 2011 Biomedical Engineering International Conference, pp. 169–173. IEEE (2012)
Young, T.: Accurate assessment of different wound tissue types. Wounds Essentials 10(1), 51–4 (2015)
Zahia, S., Sierra-Sosa, D., Garcia-Zapirain, B., Elmaghraby, A.: Tissue classification and segmentation of pressure injuries using convolutional neural networks. Comput. Methods Programs Biomed. 159, 51–58 (2018)
Acknowledgments
This research work is supported by the European Union’s Horizon 2020 under the Marie Sklodowska-Curie grant agreement No. 777661. The authors express their gratitude to the Hospital Nacional Dos de Mayo in Peru, the CHRO Hospital in France and especially to Evelyn Gutiérrez for their cooperation in collecting diabetic foot images.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Niri, R., Douzi, H., Lucas, Y., Treuillet, S. (2021). A Superpixel-Wise Fully Convolutional Neural Network Approach for Diabetic Foot Ulcer Tissue Classification. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12661. Springer, Cham. https://doi.org/10.1007/978-3-030-68763-2_23
Download citation
DOI: https://doi.org/10.1007/978-3-030-68763-2_23
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-68762-5
Online ISBN: 978-3-030-68763-2
eBook Packages: Computer ScienceComputer Science (R0)