Sensors (Apr 2024)

Soundscape Characterization Using Autoencoders and Unsupervised Learning

  • Daniel Alexis Nieto-Mora,
  • Maria Cristina Ferreira de Oliveira,
  • Camilo Sanchez-Giraldo,
  • Leonardo Duque-Muñoz,
  • Claudia Isaza-Narváez,
  • Juan David Martínez-Vargas

DOI
https://doi.org/10.3390/s24082597
Journal volume & issue
Vol. 24, no. 8
p. 2597

Abstract

Read online

Passive acoustic monitoring (PAM) through acoustic recorder units (ARUs) shows promise in detecting early landscape changes linked to functional and structural patterns, including species richness, acoustic diversity, community interactions, and human-induced threats. However, current approaches primarily rely on supervised methods, which require prior knowledge of collected datasets. This reliance poses challenges due to the large volumes of ARU data. In this work, we propose a non-supervised framework using autoencoders to extract soundscape features. We applied this framework to a dataset from Colombian landscapes captured by 31 audiomoth recorders. Our method generates clusters based on autoencoder features and represents cluster information with prototype spectrograms using centroid features and the decoder part of the neural network. Our analysis provides valuable insights into the distribution and temporal patterns of various sound compositions within the study area. By utilizing autoencoders, we identify significant soundscape patterns characterized by recurring and intense sound types across multiple frequency ranges. This comprehensive understanding of the study area’s soundscape allows us to pinpoint crucial sound sources and gain deeper insights into its acoustic environment. Our results encourage further exploration of unsupervised algorithms in soundscape analysis as a promising alternative path for understanding and monitoring environmental changes.

Keywords