Applied Sciences (Oct 2022)

Automatic Fact Checking Using an Interpretable Bert-Based Architecture on COVID-19 Claims

  • Ramón Casillas,
  • Helena Gómez-Adorno,
  • Victor Lomas-Barrie,
  • Orlando Ramos-Flores

DOI
https://doi.org/10.3390/app122010644
Journal volume & issue
Vol. 12, no. 20
p. 10644

Abstract

Read online

We present a neural network architecture focused on verifying facts against evidence found in a knowledge base. The architecture can perform relevance evaluation and claim verification, parts of a well-known three-stage method of fact-checking. We fine-tuned BERT to codify claims and pieces of evidence separately. An attention layer between the claim and evidence representation computes alignment scores to identify relevant terms between both. Finally, a classification layer receives the vector representation of claims and evidence and performs the relevance and verification classification. Our model allows a more straightforward interpretation of the predictions than other state-of-the-art models. We use the scores computed within the attention layer to show which evidence spans are more relevant to classify a claim as supported or refuted. Our classification models achieve results compared to the state-of-the-art models in terms of classification of relevance evaluation and claim verification accuracy on the FEVER dataset.

Keywords