logo Idiap Research Institute        
 [BibTeX] [Marc21]
AN END-TO-END NETWORK TO SYNTHESIZE INTONATION USING A GENERALIZED COMMAND RESPONSE MODEL
Type of publication: Idiap-RR
Citation: Marelli_Idiap-RR-05-2019
Number: Idiap-RR-05-2019
Year: 2019
Month: 5
Institution: Idiap
Abstract: The generalized command response (GCR) model represents intonation as a superposition of muscle responses to spike command signals. We have previously shown that the spikes can be predicted by a two-stage system, consisting of a recurrent neural network and a post-processing procedure, but the responses themselves were fixed dictionary atoms. We propose an end-to-end neural architecture that replaces the dictionary atoms with trainable second-order recurrent elements analogous to recursive filters. We demonstrate gradient stability under modest conditions, and show that the system can be trained by imposing temporal sparsity constraints. Subjective listening tests demonstrate that the system can synthesize intonation with high naturalness, comparable to state-of-the-art acoustic models, and retains the physiological plausibility of the GCR model.
Keywords: Digital IIR Filters, Fujisaki Model, neural networks, Prosody Modelling, speech synthesis
Projects Idiap
Authors Marelli, François
Schnell, Bastian
Bourlard, Hervé
Dutoit, T.
Garner, Philip N.
Crossref by Marelli_ICASSP2019_2019
Added by: [ADM]
Total mark: 0
Attachments
  • Marelli_Idiap-RR-05-2019.pdf (MD5: e1bbd2c2a4c97c68db7b8c78a50ab282)
Notes