Computational aeroacoustics to identify sound sources in the generation of sibilant /s/

Influence of two-dimensional expiratory airflow variations on respiratory particle propagation during pronunciation of the fricative [f]

Propagation of respiratory particles, potentially containing viable viruses, plays a significant role in the transmission of respiratory diseases (e.g., COVID-19) from infected people. Particles are produced in the upper respiratory system and exit the mouth during expiratory events such as sneezing, coughing, talking, and singing. The importance of considering speaking and singing as vectors of particle transmission has been recognized by researchers. Recently, in a companion paper, dynamics of expiratory flow during fricative utterances were explored, and significant variations of airflow jet trajectories were reported. This study focuses on respiratory particle propagation during fricative productions and the effect of airflow variations on particle transport and dispersion as a function of particle size. The commercial ANSYS-Fluent computational fluid dynamics (CFD) software was employed to quantify the fluid flow and particle dispersion from a two-dimensional mouth model of sustained fricative [f] utterance as well as a horizontal jet flow model. The fluid velocity field and particle distributions estimated from the mouth model were compared with those of the horizontal jet flow model. The significant effects of the airflow jet trajectory variations on the pattern of particle transport and dispersion during fricative utterances were studied. Distinct differences between the estimations of the horizontal jet model for particle propagation with those of the mouth model were observed. The importance of considering the vocal tract geometry and the failure of a horizontal jet model to properly estimate the expiratory airflow and respiratory particle propagation during the production of fricative utterances were emphasized.

Computer-Implemented Articulatory Models for Speech Production: A Review

Modeling speech production and speech articulation is still an evolving research topic. Some current core questions are: What is the underlying (neural) organization for controlling speech articulation? How to model speech articulators like lips and tongue and their movements in an efficient but also biologically realistic way? How to develop high-quality articulatory-acoustic models leading to high-quality articulatory speech synthesis? Thus, on the one hand computer-modeling will help us to unfold underlying biological as well as acoustic-articulatory concepts of speech production and on the other hand further modeling efforts will help us to reach the goal of high-quality articulatory-acoustic speech synthesis based on more detailed knowledge on vocal tract acoustics and speech articulation. Currently, articulatory models are not able to reach the quality level of corpus-based speech synthesis. Moreover, biomechanical and neuromuscular based approaches are complex and still not usable for sentence-level speech synthesis. This paper lists many computer-implemented articulatory models and provides criteria for dividing articulatory models in different categories. A recent major research question, i.e., how to control articulatory models in a neurobiologically adequate manner is discussed in detail. It can be concluded that there is a strong need to further developing articulatory-acoustic models in order to test quantitative neurobiologically based control concepts for speech articulation as well as to uncover the remaining details in human articulatory and acoustic signal generation. Furthermore, these efforts may help us to approach the goal of establishing high-quality articulatory-acoustic as well as neurobiologically grounded speech synthesis.

Numerical investigation of effects of incisor angle on production of sibilant /s/

The effects of the inclination angle of the incisor on the speech production of the fricative consonant /s/ was investigated using an implicit compressible flow solver. The hierarchical structure grid was applied to reduce the grid generation time for the vocal tract geometry. The airflow and sound during the pronunciation of /s/ were simulated using the adaptively switched time stepping scheme, and the angle of the incisor in the vocal tract was changed from normal position up to 30°. The results showed that increasing the incisor angle affected the flow configuration and moved the location of the high turbulence intensity region thereby decreased the amplitudes of the sound in the frequency range from 8 to 12 kHz. Performing the Fourier transform on the velocity fluctuation, we found that the position of large magnitudes of the velocity at 10 kHz shifted toward the lip outlet when the incisor angle was increased. In addition, separate acoustic simulations showed that the shift in the potential sound source position decreased the far-field sound amplitudes above 8 kHz. These results provide the underlying insights necessary to design dental prostheses for the production of sibilant fricatives.

Change in aeroacoustic sound mechanism during sibilant sound with different velopharyngeal opening sizes

The velopharyngeal valve regulates the opening between the nasal and oral cavities. The lack of complete closure is especially problematic in speech because inappropriate leakage of airflow and/or sound into the nasal cavity causes abnormal sound production and increased nasality. The purpose of this study is to use the large eddy simulation approach to examine changes in sound source mechanisms as the size of the opening changes during the production of a sibilant sound. The baseline geometry of the model is based on the pharyngeal airway of a subject having a small velopharyngeal opening while sustaining a sibilant sound. Modifications to the model are done by systematically widening or narrowing the opening (all else being equal). Results show that acoustic energy in the nasal cavity is directly related to the size of the velopharyngeal opening and that there is a critical size where the magnitude of Lighthill's acoustics source in the nasal cavity is maximized. The far-field acoustic energy and its correlation with the sound source mechanisms are also dependent on the size of the velopharyngeal opening. Patient-specific geometry with a velopharyngeal opening during a normal sibilant /s/ sound is shown to the left. Lighthill's acoustic source term is displayed on the right and varies depending on the size of the velopharyngeal opening.

Simulation of vowel-vowel utterances using a 3D biomechanical-acoustic model

A link is established between biomechanical and acoustic 3D models for the numerical simulation of vowel-vowel utterances. The former rely on the activation and contraction of relevant muscles for voice production, which displace and distort speech organs. However, biomechanical models do not provide a closed computational domain of the 3D vocal tract airway where to simulate sound wave propagation. An algorithm is thus proposed to extract the vocal tract boundary from the surrounding anatomical structures at each time step of the transition between vowels. The resulting 3D geometries are fed into a 3D finite element acoustic model that solves the mixed wave equation for the acoustic pressure and particle velocity. An arbitrary Lagrangian-Eulerian framework is considered to account for the evolving vocal tract. Examples include six static vowels and three dynamic vowel-vowel utterances. Plausible muscle activation patterns are first determined for the static vowel sounds following an inverse method. Dynamic utterances are then generated by linearly interpolating the muscle activation of the static vowels. Results exhibit nonlinear trajectory of the vocal tract geometry, similar to that observed in electromagnetic midsagittal articulography. Clear differences are appreciated when comparing the generated sound with that obtained from direct linear interpolation of the vocal tract geometry. That is, interpolation between the starting and ending vocal tract geometries of an utterance, without resorting to any biomechanical model.

Finite element generation of sibilants /s/ and /z/ using random distributions of Kirchhoff vortices

The numerical simulation of sibilant sounds in three-dimensional realistic vocal tracts constitutes a challenging problem because it involves a wide range of turbulent flow scales. Rotating eddies generate acoustic waves whose wavelengths are inversely proportional to the flow local Mach number. If that is low, very fine meshes are required to capture the flow dynamics. In standard hybrid computational aeroacoustics (CAA), where the incompressible Navier-Stokes equations are first solved to get a source term that is secondly input into an acoustic wave equation, this implies resorting to supercomputer facilities. As a consequence, only very short time intervals of the sibilant can be produced, which may be enough for its spectral characterization but insufficient to synthesize, for instance, an audio file from it or a syllable sound. In this work, we propose to substitute the aeroacoustic source term obtained from the computational fluid dynamics (CFD) in the first step of hybrid CAA, by a random distribution of Kirchhoff's spinning vortices, located in the region between the upper incisors and the lower lip. In this way, one only needs to solve a linear wave equation to generate a sibilant, and therefore avoids the costly large-scale computations. We show that our proposal can recover the outcomes of hybrid CAA simulations in average, and that it can be applied to generate sibilants /s/ and /z/. Modeling and implementation details of the Kirchhoff vortex distribution in a stabilized finite element code are discussed in the paper, as well as the outcomes of the simulations.

Sound production mechanisms of audible nasal emission during the sibilant /s/

Audible nasal emission is a speech disorder that involves undesired sound generated by airflow into the nasal cavity during production of oral sounds. This disorder is associated with small-to-medium sized velopharyngeal openings. These openings induce turbulence in the nasal cavity, which in turn produces sound. The purpose of this study is to examine the aeroacoustic mechanisms that generate turbulent sound during production of a sibilant /s/ with and without a small opening of the velopharyngeal valve. The models are based on two pediatric subjects who were diagnosed with severe audible nasal emission. The geometries were delineated from computed tomography scans taken while the subjects were sustaining a sibilant sound. Large eddy simulation with the Ffowcs Williams and Hawkings analogy was used to predict the flow behavior and its acoustic characterization. It shows that the majority of the acoustic energy is produced by surface loading, which is related to dipole sources that resonate in the nasal cavity. The quadrupole source term that is associated with the unsteady shear layers is seen to be less significant. It also shows that closure of the velopharyngeal valve changes the far-field spectrum significantly because aeroacoustic mechanisms in the nasal cavity are eliminated.

Aeroacoustic analysis on individual characteristics in sibilant fricative production

The cause of individual acoustic characteristics of sibilant fricatives /s/ and /ʃ/ was analyzed by extracting vocal tract geometries and conducting aeroacoustic experiments and simulations on each geometry. The vocal tract geometries of five Japanese subjects while sustaining /s/ and /ʃ/ were collected by magnetic resonance imaging. Flow and sound generation in the vocal tracts was predicted by large eddy simulations of compressible flow. The characteristic dimensions of the vocal tracts were extracted and simplified vocal tract models were constructed to clarify the relationship between the geometries and the acoustic characteristics. The acoustic characteristics of sounds generated by the simplified models agreed well with the sounds predicted by the simulation, indicating that the proposed model is able to express the individual characteristics in the production of sibilant fricatives. A comparison of the models showed that the volume and length of a space downstream from the constriction are key factors controlling the acoustic characteristics of each subject.