Cristina Carmona-Duarte, Miguel A. Ferrer, Réjean Plamondon, Andrés Gómez-Rodellar and P. Gómez-Vilda
Article (2021)
|
Open Access to the full text of this document Published Version Terms of Use: Creative Commons Attribution Download (1MB) |
Abstract
Human movement studies and analyses have been fundamental in many scientific domains, ranging from neuroscience to education, pattern recognition to robotics, health care to sports, and beyond. Previous speech motor models were proposed to understand how speech movement is produced and how the resulting speech varies when some parameters are changed. However, the inverse approach, in which the muscular response parameters and the subject's age are derived from real continuous speech, is not possible with such models. Instead, in the handwriting field, the kinematic theory of rapid human movements and its associated Sigma-lognormal model have been applied successfully to obtain the muscular response parameters. This work presents a speech kinematics-based model that can be used to study, analyze, and reconstruct complex speech kinematics in a simplified manner. A method based on the kinematic theory of rapid human movements and its associated Sigma-lognormal model are applied to describe and to parameterize the asymptotic impulse response of the neuromuscular networks involved in speech as a response to a neuromotor command. The method used to carry out transformations from formants to a movement observation is also presented. Experiments carried out with the (English) VTR-TIMIT database and the (German) Saarbrucken Voice Database, including people of different ages, with and without laryngeal pathologies, corroborate the link between the extracted parameters and aging, on the one hand, and the proportion between the first and second formants required in applying the kinematic theory of rapid human movements, on the other. The results should drive innovative developments in the modeling and understanding of speech kinematics.
Uncontrolled Keywords
Subjects: |
2500 Electrical and electronic engineering > 2500 Electrical and electronic engineering 2800 Artificial intelligence > 2801 Natural language and speech understanding |
---|---|
Department: | Department of Electrical Engineering |
Research Center: | Scribens Laboratory |
Funders: | CRSNG/NSERC, Spanish government’s MIMECO TEC2016-77791 - Research project, European Union FEDER program/funds, Teca-Park/MonParLoc FGCSIC CENIE-0348_CIE_6_E (InterReg Programme), Juan de la Cierva contract, ULPGC - Viera y Clavijo Grant, Spanish government - José Castillejo” Mobility Grant |
Grant number: | RGPIN-2015-06409, IJCI-2016-27682, CAS18/00315 |
PolyPublie URL: | https://publications.polymtl.ca/9264/ |
Journal Title: | Cognitive Computation (vol. 13, no. 2) |
Publisher: | Springer Nature |
DOI: | 10.1007/s12559-020-09803-8 |
Official URL: | https://doi.org/10.1007/s12559-020-09803-8 |
Date Deposited: | 24 Mar 2022 11:44 |
Last Modified: | 09 Apr 2025 07:30 |
Cite in APA 7: | Carmona-Duarte, C., Ferrer, M. A., Plamondon, R., Gómez-Rodellar, A., & Gómez-Vilda, P. (2021). Sigma-lognormal modeling of speech. Cognitive Computation, 13(2), 488-503. https://doi.org/10.1007/s12559-020-09803-8 |
---|---|
Statistics
Total downloads
Downloads per month in the last year
Origin of downloads
Dimensions