Effects of training data variety in generating glottal pulses from acoustic features with DNNs

Loading...
Thumbnail Image
Journal Title
Journal ISSN
Volume Title
Conference article in proceedings
This publication is imported from Aalto University research portal.
View publication in the Research portal
View/Open full text file from the Research portal
Date
2017-08
Major/Subject
Mcode
Degree programme
Language
en
Pages
5
3946-3950
Series
Proceedings of Interspeech 2017, Interspeech: Annual Conference of the International Speech Communication Association
Abstract
Glottal volume velocity waveform, the acoustical excitation of voiced speech, cannot be acquired through direct measurements in normal production of continuous speech. Glottal inverse filtering (GIF), however, can be used to estimate the glottal flow from recorded speech signals. Unfortunately, the usefulness of GIF algorithms is limited since they are sensitive to noise and call for high-quality recordings. Recently, efforts have been taken to expand the use of GIF by training deep neural networks (DNNs) to learn a statistical mapping between frame-level acoustic features and glottal pulses estimated by GIF. This framework has been successfully utilized in statistical speech synthesis in the form of the GlottDNN vocoder which uses a DNN to generate glottal pulses to be used as the synthesizer’s excitation waveform. In this study, we investigate how the DNN-based generation of glottal pulses is affected by training data variety. The evaluation is done using both objective measures as well as subjective listening tests of synthetic speech. The results suggest that the performance of the glottal pulse generation with DNNs is affected particularly by how well the training corpus suits GIF: processing low-pitched male speech and sustained phonations shows better performance than processing high-pitched female voices or continuous speech.
Description
Keywords
glottal inverse filtering, speech synthesis
Other note
Citation
Airaksinen , M & Alku , P 2017 , Effects of training data variety in generating glottal pulses from acoustic features with DNNs . in Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH . vol. 2017-August , Interspeech: Annual Conference of the International Speech Communication Association , International Speech Communication Association (ISCA) , pp. 3946-3950 , Interspeech , Stockholm , Sweden , 20/08/2017 . https://doi.org/10.21437/Interspeech.2017-363