Frontiers in Communications and Networks (Sep 2021)

Federated Learning for Audio Semantic Communication

  • Haonan Tong,
  • Zhaohui Yang,
  • Sihua Wang,
  • Ye Hu,
  • Omid Semiari,
  • Walid Saad,
  • Changchuan Yin

DOI
https://doi.org/10.3389/frcmn.2021.734402
Journal volume & issue
Vol. 2

Abstract

Read online

In this paper, the problem of audio semantic communication over wireless networks is investigated. In the considered model, wireless edge devices transmit large-sized audio data to a server using semantic communication techniques. The techniques allow devices to only transmit audio semantic information that captures the contextual features of audio signals. To extract the semantic information from audio signals, a wave to vector (wav2vec) architecture based autoencoder is proposed, which consists of convolutional neural networks (CNNs). The proposed autoencoder enables high-accuracy audio transmission with small amounts of data. To further improve the accuracy of semantic information extraction, federated learning (FL) is implemented over multiple devices and a server. Simulation results show that the proposed algorithm can converge effectively and can reduce the mean squared error (MSE) of audio transmission by nearly 100 times, compared to a traditional coding scheme.

Keywords