Knowledge Graph Link Prediction Fusing Description and Structural Features

Abstract

Knowledge graph generally has the problem of incomplete knowledge, which makes link prediction an important research content of knowledge graph. Existing models only focus on the embedding representation of triples. On the one hand, in terms of model input, only the embedding representation of entities and relations is randomly initialized, and the description information of entities and relations is not incorporated, which will lack semantic information; on the other hand, in decoding, the influence of the structural features of the triplet itself on the link prediction results is ignored. Aiming at the above problems, this paper proposes a knowledge graph link prediction model BFGAT (graph attention network link prediction based on fusion of description information and structural features) that integrates description information and structural features. The BFGAT model uses the BERT pretraining model to encode the description information of entities and relations, and integrates the description information into the embedding representation of entities and relations to solve the problem of missing semantic information. In the coding process, graph attention mechanism is used to aggregate the information of adjacent nodes to solve the problem that the target node can obtain more information. The embedding representation of triples is spliced into a matrix in the decoding process, using a method based on CNN convolution pooling to solve the problem of triple structural features. The model is subjected to detailed experiments on the public datasets FB15k-237 and WN18RR, and the experiments show that the BFGAT model can effectively improve the effect of knowledge graph link prediction.

Keywords

• knowledge graph; link prediction; bert; convolutional neural networks (cnn)