Phytoplankton Image Segmentation and Annotation Method Based on Microscopic Fluorescence

Abstract

Microscopic phytoplankton segmentation is an important part of water quality assessment. The segmentation of microscopic phytoplankton still faces challenges for computer vision, such as being affected by background impurities and requiring a large number of manual annotation. In this paper, the characteristics of phytoplankton emitting fluorescence under excitation light were utilized to segment and annotate phytoplankton contours by fusing fluorescence images and bright field images. Morphological operations were used to process microscopic fluorescence images to obtain the initial contours of phytoplankton. Then, microscopic bright field images were processed by Active Contour to fine tune the contours. Seven algae species were selected as the experimental objects. Compared with manually labeling the contour in LabelMe, the recall, precision, FI score and IOU of the proposed segmentation method are 85.3%, 84.5%, 84.7%, and 74.6%, respectively. Mask-RCNN was used to verify the correctness of labels annotated by the proposed method. The average recall, precision, F1 score and IOU are 97.0%, 86.5%, 91.1%, and 84.2%, respectively, when the Mask-RCNN is trained with the proposed automatic labeling method. And the results corresponding to manual labeling are 95.3%, 86.1%, 90.3%, and 82.8% respectively. The experimental results show that the proposed method can segment the phytoplankton microscopic image accurately, and the automatically annotated contour data has the same effect as the manually annotated contour data in Mask-RCNN, which greatly reduces the manual annotation workload.