Skip to main content
Log in

Automatic feature generation in endoscopic images

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript

Abstract

Motivation

Fiber optic endoscopy is essential for minimally invasive surgery, but endoscopic images are very challenging for computer vision algorithms, since they contain many effects like tissue deformations, specular reflections, smoke, variable illumination and field of view. We developed a method to extract features from endoscopic images usable for scene analysis and classification. These features could be used with data from other sensors for workflow analysis and recognition.

Materials and methods

Evolutionary reinforcement learning that automatically computes good features, making it possible to classify endoscopic images into their respective surgical phases. It is especially designed to abstract the relevant information from the highly noisy images automatically.

Results

Automatic feature extraction was used to classify images from endoscopic cholecystectomies into their respective surgical phases. These automatically computed features perform better than some classical features from computer vision. The automated feature extraction process enables reasonable classification rates for complex and difficult images where no good features are known.

Conclusion

We developed an automatic method that extracts features from images for use in classification. The method was applied to endoscopic images yielding promising results and demonstrating its feasibility under demanding conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ahmadi S-A, Sielhorst T, Stauder R, Horn M, Feussner H, Navab N (2006) Recovery of surgical workflow without explicit models. In: Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp 420-428

  2. Banzhaf W, Nordin P, Keller RE, Francone FD (1998) Genetic programming: an introduction. Morgan Kaufmann Publishers Inc., San Francisco

    Google Scholar 

  3. Burges CJC (1998) A tutorial on support vector machines for pattern recognition. In: Zeitschrift Data Mining and Knowledge Discovery, pp 121–167

  4. Ghosh P, Mitchell M (2006) Segmentation of medical images using a genetic algorithm. In: Proceedings of the 8th annual conference on Genetic and evolutionary computation, ACM Press, New York, pp 1171–1178

  5. Iakovidis DK, Maroulis DE, Karkanis SA, Brokos A (2005) A comparative study of texture features for the discrimination of gastric polyps in endoscopic video. In: Proceedings of the 18th IEEE symposium on computer-based medical systems, IEEE, pp 575–580

  6. Karkanis SA, Iakovidis DK, Maroulis DE, Karras DA, Tzivras M (2003) Computer-aided tumor detection in endoscopic video using color wavelet features. In: IEEE transactions on information technology in biomedicine, vol. 7, IEEE, pp 141–152

  7. Koza JR (1990) Genetic programming: a paradigm for genetically breeding populations of computer programs to solve problems. Stanford University Computer Science Department. Technical report

  8. Lo BP, Darzi A, Yang G-Z (2003) Episode classification for the analysis of tissue/instrument interaction with multiple visual cues. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp 230–237

  9. Majewski P, Jedruch W (2005) Endoscopy images classification with kernel based learning algorithms. In: Innovations in Applied Artificial Intelligence, pp 400–405

  10. Nandi RJ, Nandi AK, Rangayyan RM, Scutt D (2006) Classification of breast masses in mammograms using genetic programming and feature selection. In: J Med Biol Eng Comput. Springer, Berlin, pp 683–694

  11. Ohnuma K, Masamune K, Yoshimitsu K, Sadahiro T, Vain J, Fukui Y, Miyawaki F (2006) Timed-automata-based model for laparoscopic surgery and intraoperative motion recognition of a surgeon as interface connecting the surgical scenario and real operating room. In: Computer Assisted Radiology and Surgery, pp 442–445

  12. Szymanski JJ, Brumby SP, Pope P, Eads D, Esch-Mosher D, Galassi M, Harvey NR, Mcculloch HD, Perkins SJ, Porter R, Theiler J, Young AC, Bloch JJ, David N (2002) Feature extraction from multiple data sources using genetic programming. In: Proceedings of SPIE, Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery VIII, vol. 4725, pp 338–345

  13. Schölkopf B, Smola AJ, Williamson RC, Bartlett PL (2000) A new support vector algorithms. In: Neural computation. The MIT Press, Cambridge, vol. 12, pp 1207–1245

  14. Wang P, Krishnan SM, Kugean C, Tjoa MP (2001) Classification of endoscopic images based on texture and neural network. In: Proceedings of Engineering in Medicine and Biology Society, vol. 4, IEEE, pp 3691–3695

  15. Zhang M, Ciesielski VB, Andreae P (2003) A domain independent window approach to multiclass object detection using genetic programming. In: EURASIP J Appl Signal Process, vol. 8. Hindawi Publishing Corporation, pp 841–859

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ulrich Klank.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Klank, U., Padoy, N., Feussner, H. et al. Automatic feature generation in endoscopic images. Int J CARS 3, 331–339 (2008). https://doi.org/10.1007/s11548-008-0223-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11548-008-0223-8

Keywords

Navigation