1
|
Mofakham AA, Helenbrook BT, Erath BD, Ferro AR, Ahmed T, Brown DM, Ahmadi G. Influence of two-dimensional expiratory airflow variations on respiratory particle propagation during pronunciation of the fricative [f]. JOURNAL OF AEROSOL SCIENCE 2023; 173:106179. [PMID: 37069899 PMCID: PMC10088289 DOI: 10.1016/j.jaerosci.2023.106179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 02/19/2023] [Accepted: 03/27/2023] [Indexed: 06/19/2023]
Abstract
Propagation of respiratory particles, potentially containing viable viruses, plays a significant role in the transmission of respiratory diseases (e.g., COVID-19) from infected people. Particles are produced in the upper respiratory system and exit the mouth during expiratory events such as sneezing, coughing, talking, and singing. The importance of considering speaking and singing as vectors of particle transmission has been recognized by researchers. Recently, in a companion paper, dynamics of expiratory flow during fricative utterances were explored, and significant variations of airflow jet trajectories were reported. This study focuses on respiratory particle propagation during fricative productions and the effect of airflow variations on particle transport and dispersion as a function of particle size. The commercial ANSYS-Fluent computational fluid dynamics (CFD) software was employed to quantify the fluid flow and particle dispersion from a two-dimensional mouth model of sustained fricative [f] utterance as well as a horizontal jet flow model. The fluid velocity field and particle distributions estimated from the mouth model were compared with those of the horizontal jet flow model. The significant effects of the airflow jet trajectory variations on the pattern of particle transport and dispersion during fricative utterances were studied. Distinct differences between the estimations of the horizontal jet model for particle propagation with those of the mouth model were observed. The importance of considering the vocal tract geometry and the failure of a horizontal jet model to properly estimate the expiratory airflow and respiratory particle propagation during the production of fricative utterances were emphasized.
Collapse
Affiliation(s)
- Amir A Mofakham
- Department of Mechanical and Aerospace Engineering, Clarkson University, Potsdam, NY 13699, United States of America
| | - Brian T Helenbrook
- Department of Mechanical and Aerospace Engineering, Clarkson University, Potsdam, NY 13699, United States of America
| | - Byron D Erath
- Department of Mechanical and Aerospace Engineering, Clarkson University, Potsdam, NY 13699, United States of America
| | - Andrea R Ferro
- Department of Civil and Environmental Engineering, Clarkson University, Potsdam, NY 13699, United States of America
| | - Tanvir Ahmed
- Department of Mechanical and Aerospace Engineering, Clarkson University, Potsdam, NY 13699, United States of America
| | - Deborah M Brown
- Joint Educational Programs, Trudeau Institute, Saranac Lake, NY 12983, United States of America
| | - Goodarz Ahmadi
- Department of Mechanical and Aerospace Engineering, Clarkson University, Potsdam, NY 13699, United States of America
| |
Collapse
|
2
|
Kröger BJ. Computer-Implemented Articulatory Models for Speech Production: A Review. Front Robot AI 2022; 9:796739. [PMID: 35494539 PMCID: PMC9040071 DOI: 10.3389/frobt.2022.796739] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2021] [Accepted: 02/21/2022] [Indexed: 11/24/2022] Open
Abstract
Modeling speech production and speech articulation is still an evolving research topic. Some current core questions are: What is the underlying (neural) organization for controlling speech articulation? How to model speech articulators like lips and tongue and their movements in an efficient but also biologically realistic way? How to develop high-quality articulatory-acoustic models leading to high-quality articulatory speech synthesis? Thus, on the one hand computer-modeling will help us to unfold underlying biological as well as acoustic-articulatory concepts of speech production and on the other hand further modeling efforts will help us to reach the goal of high-quality articulatory-acoustic speech synthesis based on more detailed knowledge on vocal tract acoustics and speech articulation. Currently, articulatory models are not able to reach the quality level of corpus-based speech synthesis. Moreover, biomechanical and neuromuscular based approaches are complex and still not usable for sentence-level speech synthesis. This paper lists many computer-implemented articulatory models and provides criteria for dividing articulatory models in different categories. A recent major research question, i.e., how to control articulatory models in a neurobiologically adequate manner is discussed in detail. It can be concluded that there is a strong need to further developing articulatory-acoustic models in order to test quantitative neurobiologically based control concepts for speech articulation as well as to uncover the remaining details in human articulatory and acoustic signal generation. Furthermore, these efforts may help us to approach the goal of establishing high-quality articulatory-acoustic as well as neurobiologically grounded speech synthesis.
Collapse
|
3
|
Lu H, Yoshinaga T, Li C, Nozaki K, Iida A, Tsubokura M. Numerical investigation of effects of incisor angle on production of sibilant /s/. Sci Rep 2021; 11:16720. [PMID: 34408209 PMCID: PMC8373871 DOI: 10.1038/s41598-021-96173-2] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2021] [Accepted: 08/02/2021] [Indexed: 11/10/2022] Open
Abstract
The effects of the inclination angle of the incisor on the speech production of the fricative consonant /s/ was investigated using an implicit compressible flow solver. The hierarchical structure grid was applied to reduce the grid generation time for the vocal tract geometry. The airflow and sound during the pronunciation of /s/ were simulated using the adaptively switched time stepping scheme, and the angle of the incisor in the vocal tract was changed from normal position up to 30°. The results showed that increasing the incisor angle affected the flow configuration and moved the location of the high turbulence intensity region thereby decreased the amplitudes of the sound in the frequency range from 8 to 12 kHz. Performing the Fourier transform on the velocity fluctuation, we found that the position of large magnitudes of the velocity at 10 kHz shifted toward the lip outlet when the incisor angle was increased. In addition, separate acoustic simulations showed that the shift in the potential sound source position decreased the far-field sound amplitudes above 8 kHz. These results provide the underlying insights necessary to design dental prostheses for the production of sibilant fricatives.
Collapse
Affiliation(s)
- HsuehJui Lu
- Computational Fluid Dynamics Laboratory, Department of Computational Science, Graduate School of System Informatics, Kobe University, 1-1 Rokkodai, Nada-ku, Kobe, 657-8501, Japan.,Complex Phenomena Unified Simulation Research Team, RIKEN, Advanced Institute for Computational Science, Kobe, 650-0047, Japan
| | - Tsukasa Yoshinaga
- Toyohashi University of Technology, 1-1 Hibarigaoka, Tempaku-cho, Toyohashi, Aichi, 441-8580, Japan
| | - ChungGang Li
- Computational Fluid Dynamics Laboratory, Department of Computational Science, Graduate School of System Informatics, Kobe University, 1-1 Rokkodai, Nada-ku, Kobe, 657-8501, Japan. .,Complex Phenomena Unified Simulation Research Team, RIKEN, Advanced Institute for Computational Science, Kobe, 650-0047, Japan.
| | - Kazunori Nozaki
- Osaka University Dental Hospital, 1-1 Yamadaoka, Suita, Osaka, 565-0871, Japan
| | - Akiyoshi Iida
- Toyohashi University of Technology, 1-1 Hibarigaoka, Tempaku-cho, Toyohashi, Aichi, 441-8580, Japan
| | - Makoto Tsubokura
- Computational Fluid Dynamics Laboratory, Department of Computational Science, Graduate School of System Informatics, Kobe University, 1-1 Rokkodai, Nada-ku, Kobe, 657-8501, Japan.,Complex Phenomena Unified Simulation Research Team, RIKEN, Advanced Institute for Computational Science, Kobe, 650-0047, Japan
| |
Collapse
|
4
|
Change in aeroacoustic sound mechanism during sibilant sound with different velopharyngeal opening sizes. Med Biol Eng Comput 2021; 59:937-945. [PMID: 33797695 DOI: 10.1007/s11517-021-02356-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2020] [Accepted: 03/24/2021] [Indexed: 10/21/2022]
Abstract
The velopharyngeal valve regulates the opening between the nasal and oral cavities. The lack of complete closure is especially problematic in speech because inappropriate leakage of airflow and/or sound into the nasal cavity causes abnormal sound production and increased nasality. The purpose of this study is to use the large eddy simulation approach to examine changes in sound source mechanisms as the size of the opening changes during the production of a sibilant sound. The baseline geometry of the model is based on the pharyngeal airway of a subject having a small velopharyngeal opening while sustaining a sibilant sound. Modifications to the model are done by systematically widening or narrowing the opening (all else being equal). Results show that acoustic energy in the nasal cavity is directly related to the size of the velopharyngeal opening and that there is a critical size where the magnitude of Lighthill's acoustics source in the nasal cavity is maximized. The far-field acoustic energy and its correlation with the sound source mechanisms are also dependent on the size of the velopharyngeal opening. Patient-specific geometry with a velopharyngeal opening during a normal sibilant /s/ sound is shown to the left. Lighthill's acoustic source term is displayed on the right and varies depending on the size of the velopharyngeal opening.
Collapse
|
5
|
Dabbaghchian S, Arnela M, Engwall O, Guasch O. Simulation of vowel-vowel utterances using a 3D biomechanical-acoustic model. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2021; 37:e3407. [PMID: 33070445 DOI: 10.1002/cnm.3407] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2020] [Revised: 09/17/2020] [Accepted: 09/28/2020] [Indexed: 06/11/2023]
Abstract
A link is established between biomechanical and acoustic 3D models for the numerical simulation of vowel-vowel utterances. The former rely on the activation and contraction of relevant muscles for voice production, which displace and distort speech organs. However, biomechanical models do not provide a closed computational domain of the 3D vocal tract airway where to simulate sound wave propagation. An algorithm is thus proposed to extract the vocal tract boundary from the surrounding anatomical structures at each time step of the transition between vowels. The resulting 3D geometries are fed into a 3D finite element acoustic model that solves the mixed wave equation for the acoustic pressure and particle velocity. An arbitrary Lagrangian-Eulerian framework is considered to account for the evolving vocal tract. Examples include six static vowels and three dynamic vowel-vowel utterances. Plausible muscle activation patterns are first determined for the static vowel sounds following an inverse method. Dynamic utterances are then generated by linearly interpolating the muscle activation of the static vowels. Results exhibit nonlinear trajectory of the vocal tract geometry, similar to that observed in electromagnetic midsagittal articulography. Clear differences are appreciated when comparing the generated sound with that obtained from direct linear interpolation of the vocal tract geometry. That is, interpolation between the starting and ending vocal tract geometries of an utterance, without resorting to any biomechanical model.
Collapse
Affiliation(s)
- Saeed Dabbaghchian
- Department of Speech, Music, and Hearing, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Marc Arnela
- GTM Grup de recerca en Tecnologies Mèdia, La Salle-Universitat Ramon Llull, Barcelona, Spain
| | - Olov Engwall
- Department of Speech, Music, and Hearing, KTH Royal Institute of Technology, Stockholm, Sweden
| | - Oriol Guasch
- GTM Grup de recerca en Tecnologies Mèdia, La Salle-Universitat Ramon Llull, Barcelona, Spain
| |
Collapse
|
6
|
Pont A, Guasch O, Arnela M. Finite element generation of sibilants /s/ and /z/ using random distributions of Kirchhoff vortices. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2020; 36:e3302. [PMID: 31883313 DOI: 10.1002/cnm.3302] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/26/2019] [Revised: 09/20/2019] [Accepted: 12/20/2019] [Indexed: 06/10/2023]
Abstract
The numerical simulation of sibilant sounds in three-dimensional realistic vocal tracts constitutes a challenging problem because it involves a wide range of turbulent flow scales. Rotating eddies generate acoustic waves whose wavelengths are inversely proportional to the flow local Mach number. If that is low, very fine meshes are required to capture the flow dynamics. In standard hybrid computational aeroacoustics (CAA), where the incompressible Navier-Stokes equations are first solved to get a source term that is secondly input into an acoustic wave equation, this implies resorting to supercomputer facilities. As a consequence, only very short time intervals of the sibilant can be produced, which may be enough for its spectral characterization but insufficient to synthesize, for instance, an audio file from it or a syllable sound. In this work, we propose to substitute the aeroacoustic source term obtained from the computational fluid dynamics (CFD) in the first step of hybrid CAA, by a random distribution of Kirchhoff's spinning vortices, located in the region between the upper incisors and the lower lip. In this way, one only needs to solve a linear wave equation to generate a sibilant, and therefore avoids the costly large-scale computations. We show that our proposal can recover the outcomes of hybrid CAA simulations in average, and that it can be applied to generate sibilants /s/ and /z/. Modeling and implementation details of the Kirchhoff vortex distribution in a stabilized finite element code are discussed in the paper, as well as the outcomes of the simulations.
Collapse
Affiliation(s)
- Arnau Pont
- GTM Grup de Recerca en Tecnologies Mèdia, La Salle-Universitat Ramon Llull, Barcelona, Spain
| | - Oriol Guasch
- GTM Grup de Recerca en Tecnologies Mèdia, La Salle-Universitat Ramon Llull, Barcelona, Spain
| | - Marc Arnela
- GTM Grup de Recerca en Tecnologies Mèdia, La Salle-Universitat Ramon Llull, Barcelona, Spain
| |
Collapse
|
7
|
Sundström E, Oren L. Sound production mechanisms of audible nasal emission during the sibilant /s/. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2019; 146:4199. [PMID: 31893718 PMCID: PMC7043896 DOI: 10.1121/1.5135566] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2019] [Revised: 11/05/2019] [Accepted: 11/05/2019] [Indexed: 06/10/2023]
Abstract
Audible nasal emission is a speech disorder that involves undesired sound generated by airflow into the nasal cavity during production of oral sounds. This disorder is associated with small-to-medium sized velopharyngeal openings. These openings induce turbulence in the nasal cavity, which in turn produces sound. The purpose of this study is to examine the aeroacoustic mechanisms that generate turbulent sound during production of a sibilant /s/ with and without a small opening of the velopharyngeal valve. The models are based on two pediatric subjects who were diagnosed with severe audible nasal emission. The geometries were delineated from computed tomography scans taken while the subjects were sustaining a sibilant sound. Large eddy simulation with the Ffowcs Williams and Hawkings analogy was used to predict the flow behavior and its acoustic characterization. It shows that the majority of the acoustic energy is produced by surface loading, which is related to dipole sources that resonate in the nasal cavity. The quadrupole source term that is associated with the unsteady shear layers is seen to be less significant. It also shows that closure of the velopharyngeal valve changes the far-field spectrum significantly because aeroacoustic mechanisms in the nasal cavity are eliminated.
Collapse
Affiliation(s)
- Elias Sundström
- Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati, 231 Albert Sabin Way, Cincinnati, Ohio 45267, USA
| | - Liran Oren
- Department of Otolaryngology-Head and Neck Surgery, University of Cincinnati, 231 Albert Sabin Way, Cincinnati, Ohio 45267, USA
| |
Collapse
|
8
|
Yoshinaga T, Nozaki K, Wada S. Aeroacoustic analysis on individual characteristics in sibilant fricative production. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2019; 146:1239. [PMID: 31472528 DOI: 10.1121/1.5122793] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/07/2019] [Accepted: 07/31/2019] [Indexed: 06/10/2023]
Abstract
The cause of individual acoustic characteristics of sibilant fricatives /s/ and /ʃ/ was analyzed by extracting vocal tract geometries and conducting aeroacoustic experiments and simulations on each geometry. The vocal tract geometries of five Japanese subjects while sustaining /s/ and /ʃ/ were collected by magnetic resonance imaging. Flow and sound generation in the vocal tracts was predicted by large eddy simulations of compressible flow. The characteristic dimensions of the vocal tracts were extracted and simplified vocal tract models were constructed to clarify the relationship between the geometries and the acoustic characteristics. The acoustic characteristics of sounds generated by the simplified models agreed well with the sounds predicted by the simulation, indicating that the proposed model is able to express the individual characteristics in the production of sibilant fricatives. A comparison of the models showed that the volume and length of a space downstream from the constriction are key factors controlling the acoustic characteristics of each subject.
Collapse
Affiliation(s)
- Tsukasa Yoshinaga
- Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka 560-8531, Japan
| | - Kazunori Nozaki
- Osaka University Dental Hospital, 1-8 Yamadaoka, Suita, Osaka 565-0871, Japan
| | - Shigeo Wada
- Graduate School of Engineering Science, Osaka University, 1-3 Machikaneyama, Toyonaka, Osaka 560-8531, Japan
| |
Collapse
|