Multi‐scale audio super resolution via deep pyramid wavelet convolutional neural network

Abstract

Abstract In this letter, a pyramid wavelet convolutional neural network for audio super resolution is presented. Since the audio signal is non‐stationary, previous convolutional neural network based approaches may fail in capturing the details, these method usually focus on the global approximation error and thus produce over smooth results. To cope with this issue, it is suggested to predict the wavelet coefficients of the audio signal, and reconstruct the signal from these coefficients stage by stage rather. The prediction errors of the wavelet coefficients are included to the loss function to force the model to capture the detail components. Experimental results show that the approach, training on the VCTK public dataset, achieves more appealing results than state‐of‐the‐art methods.

Keywords

• Speech and audio signal processing
• Interpolation and function approximation (numerical analysis)
• Linear algebra (numerical analysis)
• Integral transforms in numerical analysis
• Digital signal processing
• Interpolation and function approximation (numerical analysis)