Complex & Intelligent Systems (Jul 2024)

KnowledgeNavigator: leveraging large language models for enhanced reasoning over knowledge graph

  • Tiezheng Guo,
  • Qingwen Yang,
  • Chen Wang,
  • Yanyi Liu,
  • Pan Li,
  • Jiawei Tang,
  • Dapeng Li,
  • Yingyou Wen

DOI
https://doi.org/10.1007/s40747-024-01527-8
Journal volume & issue
Vol. 10, no. 5
pp. 7063 – 7076

Abstract

Read online

Abstract Large language models have achieved outstanding performance on various downstream tasks with their advanced understanding of natural language and zero-shot capability. However, they struggle with knowledge constraints, particularly in tasks requiring complex reasoning or extended logical sequences. These limitations can affect their performance in question answering by leading to inaccuracies and hallucinations. This paper proposes a novel framework called KnowledgeNavigator that leverages large language models on knowledge graphs to achieve accurate and interpretable multi-hop reasoning. Especially with an analysis-retrieval-reasoning process, KnowledgeNavigator searches the optimal path iteratively to retrieve external knowledge and guide the reasoning to reliable answers. KnowledgeNavigator treats knowledge graphs and large language models as flexible components that can be switched between different tasks without additional costs. Experiments on three benchmarks demonstrate that KnowledgeNavigator significantly improves the performance of large language models in question answering and outperforms all large language models-based baselines.

Keywords