Correlation-based frequency warping for voice conversion

• Main Authors: Tian, Xiaohai, Wu, Zhizheng, Lee, Siu-Wa, Chng, Eng Siong
• Other Authors: School of Computer Science and Engineering
• Format: Conference or Workshop Item
• Language: English
• Published: 2018
• Subjects: DRNTU::Engineering::Computer science and engineering; Speech Synthesis; Voice Conversion
• Online Access: https://hdl.handle.net/10356/89598; http://hdl.handle.net/10220/47053
• Institution: Nanyang Technological University

Frequency warping (FW) based voice conversion aims to modify the frequency axis of source spectra towards that of the target. In previous works, the optimal warping function was calculated by minimizing the spectral distance of converted and target spectra without considering the spectral shape. Nevertheless, speaker timbre and identity greatly depend on vocal tract peaks and valleys of spectrum. In this paper, we propose a method to define the warping function by maximizing the correlation between the converted and target spectra. Different from the conventional warping methods, the correlation-based optimization is not determined by the magnitude of the spectra. Instead, both spectral peaks and valleys are considered in the optimization process, which also improves the performance of amplitude scaling. Experiments were conducted on VOICES database, and the results show that after amplitude scaling our proposed method reduced the mel-spectral distortion from 5.85 dB to 5.60 dB. The subjective listening tests also confirmed the effectiveness of the proposed method.