Jisuanji kexue (Apr 2023)

Comprehensive Survey of Loss Functions in Knowledge Graph Embedding Models

  • SHEN Qiuhui, ZHANG Hongjun, XU Youwei, WANG Hang, CHENG Kai

DOI
https://doi.org/10.11896/jsjkx.211200175
Journal volume & issue
Vol. 50, no. 4
pp. 149 – 158

Abstract

Read online

Due to its rich and intuitive expressivity,knowledge graph has received much attention of many scholars. A lot of works have been accumulated in knowledge graph embedding. The results of the works have played an important role in some fields, such as e-commerce, finance,medicine, transportation and intelligent Q & A. In the knowledge graph embedding model, the loss function plays a key role in its training stage. Based on the existing research of knowledge graph embeddings, this paper classifies the loss functions used in the model into six categories: hinge loss, logistic loss, cross entropy loss, log likelihood loss, negative sampling loss and mean square error loss. The prototype formula and physical meaning of loss functions and their expansion, evolution and application in knowledge graph embedding models are analyzed in detail one by one.Based on the above,the usage, efficiency and convergence of various loss functions in the static and dynamic knowledge graph scenarios are comprehensively analyzed and evaluated. According to the analysis results, combined with the development and application trend of knowledge graph and the current situation of loss functions,the future works of loss functions are discussed.

Keywords