Dataset for image classification with knowledge

Abstract

Deep learning applied to raw data has demonstrated outstanding image classification performance, mainly when abundant data is available. However, performance significantly degrades when a substantial volume of data is unavailable. Furthermore, deep architectures struggle to achieve satisfactory performance levels when distinguishing between distinct classes, such as fine-grained image classification, is challenging. Utilizing a priori knowledge alongside raw data can enhance image classification in demanding scenarios. Nevertheless, only a limited number of image classification datasets given with a priori knowledge are currently available, thereby restricting research efforts in this field. This paper introduces innovative datasets for the classification problem that integrate a priori knowledge. These datasets are built from existing data typically employed for multilabel multiclass classification or object detection. Frequent closed itemset mining is used to create classes and their corresponding attributes (e.g. the presence of an object in an image) and then to extract a priori knowledge expressed by rules on these attributes. The algorithm for generating rules is described.

Keywords

• Computer vision
• Image classification
• Knowledge
• Deep learning
• Rules