Weakly Supervised Collaborative Learning for Airborne Pollen Segmentation and Classification from SEM Images

Abstract

Existing pollen identification methods heavily rely on the scale and quality of pollen images. However, there are many impurities in real-world SEM images that should be considered. This paper proposes a collaborative learning method to jointly improve the performance of pollen segmentation and classification in a weakly supervised manner. It first locates pollen regions from the raw images based on the detection model. To improve the classification performance, we segmented the pollen grains through a pre-trained U-Net using unsupervised pollen contour features. The segmented pollen regions were fed into a deep convolutional neural network to obtain the activation maps, which were used to further refine the segmentation masks. In this way, both segmentation and classification models can be collaboratively trained, supervised by just pollen contour features and class-specific information. Extensive experiments on real-world datasets were conducted, and the results prove that our method effectively avoids impurity interference and improves pollen identification accuracy (86.6%) under the limited supervision (around 1000 images with image-level labels).

Keywords

• deep learning
• SEM
• pollen identification
• airborne allergic pollen