Semi-Supervised Self-Training Method Based on an Optimum-Path Forest

Abstract

Semi-supervised self-training method can train an effective classifier by exploiting labeled and unlabeled samples. Recently, a self-training method based on density peaks of data (STDP) is proposed. However, it still suffers from some shortcomings to be addressed. For example, STDP is affected by cut-off distance dc. As a result, it is tricky for STDP to select an optimal parameter dc on each data set. Furthermore, STDP has a poor performance on data sets with some variations in density because of cut-off distance dc. In order to solve these problems, we present a new self-training method which connects unlabeled and labeled samples as vertexes of an optimum path forest to discover the underlying structure of feature space. Furthermore, the underlying structure of the feature space is used to guide the self-training method to train a classifier. Compared with STDP, our algorithm is free of parameters and can work better on data sets with some variations in density. Moreover, we are surprised to find that our algorithm also has some advantages in dealing with overlapping data sets. The experimental results on real data sets clearly demonstrate that our algorithm has better performance than some previous works in improving the performance of base classifiers of k-nearest neighbor, support vector machine and cart.

Keywords

• Self-training method
• semi-supervised classification
• optimum-path forest
• semi-supervised learning