Authors:
Stefano Mazzocchetti
1
;
Laura Cercenelli
1
;
Lorenzo Bianchi
2
;
3
;
Riccardo Schiavina
2
;
3
and
Emanuela Marcelli
1
Affiliations:
1
eDIMES Lab, Laboratory of Bioengineering, Department of Medical and Surgical Sciences, University of Bologna, Via Massarenti, 9, 40138 Bologna, Italy
;
2
Division of Urology, IRCCS Azienda Ospedaliero, Universitaria di Bologna, Via Massarenti, 9, 40138 Bologna, Italy
;
3
Department of Medical and Surgical Sciences, University of Bologna, Via Massarenti, 9, 40138 Bologna, Italy
Keyword(s):
Minimally Invasive Surgery, Robotic Surgery, Semantic Image Synthesis, Deep Learning, GAN, Computer Vision.
Abstract:
With the continuous evolution of robotic-assisted surgery, the integration of advanced technologies into the field becomes pivotal for improving surgical outcomes. The lack of labelled surgical datasets limits the range of possible applications of deep learning techniques in the surgical field. As a matter of fact, the annotation process to label datasets is time consuming. This paper introduces an approach for realistic image generation in the context of Robotic Assisted Partial Nephrectomy (RAPN) using the Semantic Image Synthesis (SIS) technique. Leveraging descriptive semantic maps, our method aims to bridge the gap between abstract scene representation and visually compelling laparoscopic images. It is shown that our approach can effectively generate photo-realistic Minimally Invasive Surgery (MIS) synthetic images starting from a sparse set of annotated real images. Furthermore, we demonstrate that synthetic data can be used to train a semantic segmentation network that general
izes on real data reducing the annotation time needed.
(More)