Generalized Zero Shot Learning via Synthesis Pseudo Features

Abstract

Compared with conventional zero-shot learning (ZSL), generalized ZSL (GZSL) is more challenging because the test instances may come from seen and unseen classes. The most existing GZSL methods learn a visual-semantic mapping function to bridge the knowledge transfer from seen to unseen classes by using semantic information and other labeled training data. However, these methods often suffer from severe performance degradation because they ignore similar structures between different classes. To solve these problems, we propose a GZSL method that transforms GZSL problems to conventional supervised learning ones by synthesizing pseudo features for unseen classes. This technique has two key aspects. The first one is the synthesis strategy; the proposed strategy directly synthesizes the pseudo features of unseen classes contrary to current synthesis-based methods, which synthesize pseudo instances. Our method regards the combination of N features of instances as the pseudo features. These N features belong to N different classes that are similar to unseen ones. This synthesis strategy is in line with the cognitive style of human beings. The second key aspect is that we preserve the similar structures between seen and unseen classes. Inspired by the center loss method, we assign each semantic vector as the center of deep features in the training stage. This way preserves the similar structures between the classes. Such preservation can be beneficial for improving classification accuracy. The experimental results on four benchmark datasets demonstrate that our model outperforms state-of-the-art methods for the GZSL. The source code is available at https://github.com/guizilaile23/SPF-GZSL.

Keywords

• Generalized zero-shot learning
• pseudo feature synthesis
• image classification
• supervised learning
• multi-class classification