<  Back to the Polytechnique Montréal portal

Sigma-lognormal modeling of speech

C. Carmona-Duarte, M. A. Ferrer, Réjean Plamondon, A. Gómez-Rodellar and P. Gómez-Vilda

Article (2021)

[img]
Preview
Published Version
Terms of Use: Creative Commons Attribution .
Download (2MB)
Cite this document: Carmona-Duarte, C., Ferrer, M. A., Plamondon, R., Gómez-Rodellar, A. & Gómez-Vilda, P. (2021). Sigma-lognormal modeling of speech. Cognitive Computation, 13(2), p. 488-503. doi:10.1007/s12559-020-09803-8
Show abstract Hide abstract

Abstract

Human movement studies and analyses have been fundamental in many scientific domains, ranging from neuroscience to education, pattern recognition to robotics, health care to sports, and beyond. Previous speech motor models were proposed to understand how speech movement is produced and how the resulting speech varies when some parameters are changed. However, the inverse approach, in which the muscular response parameters and the subject’s age are derived from real continuous speech, is not possible with such models. Instead, in the handwriting field, the kinematic theory of rapid human movements and its associated Sigma-lognormal model have been applied successfully to obtain the muscular response parameters. This work presents a speech kinematics-based model that can be used to study, analyze, and reconstruct complex speech kinematics in a simplified manner. A method based on the kinematic theory of rapid human movements and its associated Sigma-lognormal model are applied to describe and to parameterize the asymptotic impulse response of the neuromuscular networks involved in speech as a response to a neuromotor command. The method used to carry out transformations from formants to a movement observation is also presented. Experiments carried out with the (English) VTR-TIMIT database and the (German) Saarbrucken Voice Database, including people of different ages, with and without laryngeal pathologies, corroborate the link between the extracted parameters and aging, on the one hand, and the proportion between the first and second formants required in applying the kinematic theory of rapid human movements, on the other. The results should drive innovative developments in the modeling and understanding of speech kinematics.

Uncontrolled Keywords

Speech processing, Kinematic theory of rapid human movements, Sigma-lognormal model, Speech kinematics, Aging, Modeling of the neuromotor system

Open Access document in PolyPublie
Subjects: 2500 Génie électrique et électronique > 2500 Génie électrique et électronique
2800 Intelligence artificielle > 2801 Langage naturel et reconnaissance de la parole
Department: Département de génie électrique
Research Center: Laboratoire Scribens
Funders: CRSNG/NSERC, Spanish government’s MIMECO TEC2016-77791 - Research project, European Union FEDER program/funds, Teca-Park/MonParLoc FGCSIC CENIE-0348_CIE_6_E (InterReg Programme), Juan de la Cierva contract, ULPGC - Viera y Clavijo Grant, Spanish government - José Castillejo” Mobility Grant
Grant number: RGPIN-2015-06409, IJCI-2016-27682, CAS18/00315
Date Deposited: 24 Mar 2022 11:44
Last Modified: 25 Mar 2022 01:20
PolyPublie URL: https://publications.polymtl.ca/9264/
Document issued by the official publisher
Journal Title: Cognitive Computation (vol. 13, no. 2)
Publisher: Springer Nature
Official URL: https://doi.org/10.1007/s12559-020-09803-8

Statistics

Total downloads

Downloads per month in the last year

Origin of downloads

Dimensions

Repository Staff Only