Applied Sciences (Feb 2022)

Evaluation of Tacotron Based Synthesizers for Spanish and Basque

  • Víctor García,
  • Inma Hernáez,
  • Eva Navas

DOI
https://doi.org/10.3390/app12031686
Journal volume & issue
Vol. 12, no. 3
p. 1686

Abstract

Read online

In this paper, we describe the implementation and evaluation of Text to Speech synthesizers based on neural networks for Spanish and Basque. Several voices were built, all of them using a limited number of data. The system applies Tacotron 2 to compute mel-spectrograms from the input sequence, followed by WaveGlow as neural vocoder to obtain the audio signals from the spectrograms. The limited number of data used for training the models leads to synthesis errors in some sentences. To automatically detect those errors, we developed a new method that is able to find the sentences that have lost the alignment during the inference process. To mitigate the problem, we implemented a guided attention providing the system with the explicit duration of the phonemes. The resulting system was evaluated to assess its robustness, quality and naturalness both with objective and subjective measures. The results reveal the capacity of the system to produce good quality and natural audios.

Keywords