A hierarchical birdsong feature extraction architecture combining static and dynamic modeling

Yanan Wang; Aibin Chen; Huaicheng Li; Guoxiong Zhou; Jizheng Yi; Zhiqiang Zhang

Ecological Indicators (Jun 2023)

A hierarchical birdsong feature extraction architecture combining static and dynamic modeling

Yanan Wang,
Aibin Chen,
Huaicheng Li,
Guoxiong Zhou,
Jizheng Yi,
Zhiqiang Zhang

Affiliations

Yanan Wang: Institute of Artificial Intelligence Application, College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha 410004, China
Aibin Chen: Institute of Artificial Intelligence Application, College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha 410004, China; Corresponding author.
Huaicheng Li: Institute of Artificial Intelligence Application, College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha 410004, China
Guoxiong Zhou: Institute of Artificial Intelligence Application, College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha 410004, China
Jizheng Yi: Institute of Artificial Intelligence Application, College of Computer and Information Engineering, Central South University of Forestry and Technology, Changsha 410004, China
Zhiqiang Zhang: Wildlife Conservation and Utilization Laboratory, College of Forestry, Central South University of Forestry and Technology, Changsha 410004, China

Journal volume & issue: Vol. 150
p. 110258

Abstract

Read online

To conserve bird biodiversity and monitor the distribution of species in the region, it is of tremendous necessity to identify birds by their songs and explore the rich ecological information birdsong contains. The audios recorded in the monitoring area generally have complex background noise, the characteristics of the song are not prominent and the biological spectrum information is not comprehensive, which brings some challenges to the identification of birds. This study proposes a hierarchical birdsong feature extraction architecture combining dynamic and static modeling to cope with complex environments as a modeling context. Firstly, six common speech features were extracted for the characteristics of birdsong. The Pearson correlation coefficient is then used to analyze the correlations between birdsong and human speech, examining the correlations between each feature in the presence and absence of environmental noise interference. Combined with the scatter plot matrix analysis, we conclude that Mel Frequency Cepstral Coefficient (MFCC) is more suitable comparing with other features when dealing with birdsong and can superiorly cope with a complex background noise. Secondly, a feature extraction architecture is built, which integrates static and dynamic modeling to fully explore the contextual relationship, to solve the problem of ignoring the internal structure information of the patch and losing some spatial information in the Transformer-type model. Finally, a hierarchical refinement module is designed to help extract more detailed features, as well as to optimize the computational cost of the Transformer-type model that requires many training data and has high complexity. The performance of the model can be detected with 93.67 % accuracy on the self-built birdsong dataset, 95.19 % accuracy on the public birdsong dataset Birdsdata and 97.02 % accuracy on the public environmental dataset UrbanSound8k.

Published in Ecological Indicators

ISSN: 1470-160X (Print); 1872-7034 (Online)
Publisher: Elsevier
Country of publisher: United Kingdom
LCC subjects: Science: Biology (General): Ecology
Website: https://www.sciencedirect.com/journal/ecological-indicators

About the journal

Abstract

Keywords