PLoS ONE (Jan 2020)

Equiprobable discrete models of site-specific substitution rates underestimate the extent of rate variability.

  • Frank Mannino,
  • Sadie Wisotsky,
  • Sergei L Kosakovsky Pond,
  • Spencer V Muse

DOI
https://doi.org/10.1371/journal.pone.0229493
Journal volume & issue
Vol. 15, no. 3
p. e0229493

Abstract

Read online

It is standard practice to model site-to-site variability of substitution rates by discretizing a continuous distribution into a small number, K, of equiprobable rate categories. We demonstrate that the variance of this discretized distribution has an upper bound determined solely by the choice of K and the mean of the distribution. This bound can introduce biases into statistical inference, especially when estimating parameters governing site-to-site variability of substitution rates. Applications to two large collections of sequence alignments demonstrate that this upper bound is often reached in analyses of real data. When parameter estimation is of primary interest, additional rate categories or more flexible modeling methods should be considered.