Proceedings of the XXth Conference of Open Innovations Association FRUCT (Nov 2016)

Writer identification based on letter frequency distribution

  • Polina Diurdeva,
  • Elena Mikhailova,
  • Dmitry Shalymov

DOI
https://doi.org/10.23919/FRUCT.2016.7892179
Journal volume & issue
Vol. 420, no. 19
pp. 24 – 30

Abstract

Read online

Lately writer identification problem has become actual due to huge amount of documents in digital form. In the current work an approach based on frequency combination of letters is investigated for solving such a task as classification of documents by authorship. This research examines and compares four different distance measures between a text of unknown authorship and an authors' profile: L1 measure, Kullback-Leibler divergence, base metric of Common N-gram method (OVG)[8] and certain variation of dissimilarity measure of CNG method which was proposed in [12]. Comparison outlines cases when some metric outperforms others with a specific parameter combination. Experiments are conducted on different Russian and English corpora.

Keywords