Comprehensive Survey of Loss Functions in Knowledge Graph Embedding Models

Abstract

Due to its rich and intuitive expressivity,knowledge graph has received much attention of many scholars. A lot of works have been accumulated in knowledge graph embedding. The results of the works have played an important role in some fields, such as e-commerce, finance,medicine, transportation and intelligent Q & A. In the knowledge graph embedding model, the loss function plays a key role in its training stage. Based on the existing research of knowledge graph embeddings, this paper classifies the loss functions used in the model into six categories: hinge loss, logistic loss, cross entropy loss, log likelihood loss, negative sampling loss and mean square error loss. The prototype formula and physical meaning of loss functions and their expansion, evolution and application in knowledge graph embedding models are analyzed in detail one by one.Based on the above,the usage, efficiency and convergence of various loss functions in the static and dynamic knowledge graph scenarios are comprehensively analyzed and evaluated. According to the analysis results, combined with the development and application trend of knowledge graph and the current situation of loss functions,the future works of loss functions are discussed.

Keywords

• knowledge graph|loss function|embedding model|knowledge representation learning