Transactions of the Association for Computational Linguistics (Nov 2019)

On the Complexity and Typology of Inflectional Morphological Systems

  • Cotterell, Ryan,
  • Kirov, Christo,
  • Hulden, Mans,
  • Eisner, Jason

DOI
https://doi.org/10.1162/tacl_a_00271
Journal volume & issue
Vol. 7
pp. 327 – 342

Abstract

Read online

We quantify the linguistic complexity of different languages’ morphological systems. We verify that there is a statistically significant empirical trade-off between paradigm size and irregularity: A language’s inflectional paradigms may be either large in size or highly irregular, but never both. We define a new measure of paradigm irregularity based on the conditional entropy of the surface realization of a paradigm— how hard it is to jointly predict all the word forms in a paradigm from the lemma. We estimate irregularity by training a predictive model. Our measurements are taken on large morphological paradigms from 36 typologically diverse languages.