Automatic prediction of tongue muscle activations using a finite element model

The effect of simulated radiation induced fibrosis on tongue protrusion

Radiation therapy (RT) is an important adjuvant and primary treatment modality for head and neck cancers. A severe side effect of RT is fibrosis or scarring of muscle tissues of the oral cavity including the tongue. Previous studies have demonstrated that increased radiation doses to the oral cavity structures have led to decrements in function, hypothesized to result from changes in muscle tissue properties that affect the tongue's function. To understand the complex relationship between tongue muscle fibrosis and tongue function, the current study used a virtual biomechanical model of the tongue. Fibrosis parameters including density (high, low), area (large, small) and location (946 node centres) were systematically varied in the model to test its impact on a target tongue tip motion (protrusion). The impact of fibrosis lesion parameters on three directional components of the tip (anterior-inferior, lateral-medial, and superior-inferior) were analyzed using multi linear regression models. Increases in density and area of fibrosis significantly predicted tongue protrusion movements compared to baseline. In the anterior-posterior direction, reductions in the tongue protrusion were observed. In the inferior-superior direction, the tongue height remained above baseline for the majority of cases. In the lateral-medial direction, ipsilateral deviations were observed. The location of fibrosis modulated these three main effects by either amplifying the observed effect or minimizing it. The findings support the hypothesis that changes in muscle tissue properties because of fibrosis impact tongue function. Increases in density and area of fibrosis impact key muscles in the target motion. The range of modulating effects of the lesion location (i.e., either amplifying or minimizing certain impact patterns) highlights the intricacy of tongue anatomy/soft tissue biomechanics and may suggest that lesions in any location will compromise the tongue's movement.

Biomechanical and Cortical Control of Tongue Movements During Chewing and Swallowing

Tongue function is vital for chewing and swallowing and lingual dysfunction is often associated with dysphagia. Better treatment of dysphagia depends on a better understanding of hyolingual morphology, biomechanics, and neural control in humans and animal models. Recent research has revealed significant variation among animal models in morphology of the hyoid chain and suprahyoid muscles which may be associated with variation in swallowing mechanisms. The recent deployment of XROMM (X-ray Reconstruction of Moving Morphology) to quantify 3D hyolingual kinematics has revealed new details on flexion and roll of the tongue during chewing in animal models, movements similar to those used by humans. XROMM-based studies of swallowing in macaques have falsified traditional hypotheses of mechanisms of tongue base retraction during swallowing, and literature review suggests that other animal models may employ a diversity of mechanisms of tongue base retraction. There is variation among animal models in distribution of hyolingual proprioceptors but how that might be related to lingual mechanics is unknown. In macaque monkeys, tongue kinematics-shape and movement-are strongly encoded in neural activity in orofacial primary motor cortex, giving optimism for development of brain-machine interfaces for assisting recovery of lingual function after stroke. However, more research on hyolingual biomechanics and control is needed for technologies interfacing the nervous system with the hyolingual apparatus to become a reality.

Muscle-driven forward dynamic active hybrid model of the lumbosacral spine: combined FEM and multibody simulation

Most spine models belong to either the musculoskeletal multibody (MB) or finite element (FE) method. Recently, coupling of MB and FE models has increasingly been used to combine advantages of both methods. Active hybrid FE-MB models, still rarely used in spine research, avoid the interface and convergence problems associated with model coupling. They provide the inherent ability to account for the full interplay of passive and active mechanisms for spinal stability. In this paper, we developed and validated a novel muscle-driven forward dynamic active hybrid FE-MB model of the lumbosacral spine (LSS) in ArtiSynth to simultaneously calculate muscle activation patterns, vertebral movements, and internal mechanical loads. The model consisted of the rigid vertebrae L1-S1 interconnected with hyperelastic fiber-reinforced FE intervertebral discs, ligaments, facet joints, and force actuators representing the muscles. Morphological muscle data were implemented via a semi-automated registration procedure. Four auxiliary bodies were utilized to describe non-linear muscle paths by wrapping and attaching the anterior abdominal muscles. This included an abdominal plate whose kinematics was optimized using motion capture data from upper body movements. Intra-abdominal pressure was calculated from the forces of the abdominal muscles compressing the abdominal cavity. For the muscle-driven approach, forward dynamics assisted data tracking was used to predict muscle activation patterns that generate spinal postures and balance the spine without prescribing accurate spinal kinematics. During calibration, the maximum specific muscle tension and spinal rhythms resulting from the model dynamics were evaluated. To validate the model, load cases were simulated from -10° extension to +30° flexion with weights up to 20 kg in both hands. The biomechanical model responses were compared with in vivo literature data of intradiscal pressures, intra-abdominal pressures, and muscle activities. The results demonstrated high agreement with this data and highlight the advantages of active hybrid modeling for the LSS. Overall, this new self-contained tool provides a robust and efficient estimation of LSS biomechanical responses under in vivo similar loads, for example, to improve pain treatment by spinal stabilization therapies.

Modern three-dimensional digital methods for studying locomotor biomechanics in tetrapods

Here, we review the modern interface of three-dimensional (3D) empirical (e.g. motion capture) and theoretical (e.g. modelling and simulation) approaches to the study of terrestrial locomotion using appendages in tetrapod vertebrates. These tools span a spectrum from more empirical approaches such as XROMM, to potentially more intermediate approaches such as finite element analysis, to more theoretical approaches such as dynamic musculoskeletal simulations or conceptual models. These methods have much in common beyond the importance of 3D digital technologies, and are powerfully synergistic when integrated, opening a wide range of hypotheses that can be tested. We discuss the pitfalls and challenges of these 3D methods, leading to consideration of the problems and potential in their current and future usage. The tools (hardware and software) and approaches (e.g. methods for using hardware and software) in the 3D analysis of tetrapod locomotion have matured to the point where now we can use this integration to answer questions we could never have tackled 20 years ago, and apply insights gleaned from them to other fields.

Lateral vocalization in Brazilian Portuguese

Lateral vocalization is a cross-linguistically common phenomenon where a lateral is realized as a glide, such as [w, j], or a vowel [u, i]. In this paper, we focus on the articulatory triggers that could cause lateral vocalization. We examined Brazilian Portuguese, a language known for the process of lateral vocalization in coda position. We examined the lateral in onset and coda position in four vocalic environments and compared the dynamic tongue contours and contours at the point of maximum constriction in each environment. We also performed biomechanical simulations of lateral articulation and the vocalized lateral. The results indicate increased tongue body retraction in coda position, which is accompanied by tongue body raising. Simulations further revealed that vocalized laterals mainly recruit intrinsic lingual muscles along with the styloglossus. Taken together, the data suggest that vocalization is a result of positional phonetic effects including lenition and additional retraction in the coda position.

Beyond language: The unspoken sensory-motor representation of the tongue in non-primates, non-human and human primates

The English idiom "on the tip of my tongue" commonly acknowledges that something is known, but it cannot be immediately brought to mind. This phrase accurately describes sensorimotor functions of the tongue, which are fundamental for many tongue-related behaviors (e.g., speech), but often neglected by scientific research. Here, we review a wide range of studies conducted on non-primates, non-human and human primates with the aim of providing a comprehensive description of the cortical representation of the tongue's somatosensory inputs and motor outputs across different phylogenetic domains. First, we summarize how the properties of passive non-noxious mechanical stimuli are encoded in the putative somatosensory tongue area, which has a conserved location in the ventral portion of the somatosensory cortex across mammals. Second, we review how complex self-generated actions involving the tongue are represented in more anterior regions of the putative somato-motor tongue area. Finally, we describe multisensory response properties of the primate and non-primate tongue area by also defining how the cytoarchitecture of this area is affected by experience and deafferentation.

Influence of rotator cuff integrity on loading and kinematics before and after reverse shoulder arthroplasty

Reverse Shoulder Arthroplasty has become a very common procedure for shoulder joint replacement, even for scenarios where an anatomical reconstruction would traditionally be used. Our hypothesis is that implanting a reverse prosthesis with a functional rotator cuff may lead to higher joint reaction force (JRF) and have a negative impact on the prosthesis. Available motion capture data during anterior flexion was input to a finite-element musculoskeletal shoulder model, and muscle activations were computed using inverse dynamics. Simulations were carried out for the intact joint as well as for various types of rotator cuff tears: superior (supraspinatus), superior-anterior (supraspinatus and subscapularis), and superior-posterior (supraspinatus, infraspinatus and teres minor). Each rotator cuff tear condition was repeated after shifting the humerus and the glenohumeral joint center of rotation to represent the effect of a reverse prosthesis. Changes in compressive, shear, and total JRF were analyzed. The model compared favorably to in vivo JRF measurements, and existing clinical and biomechanical knowledge. Implanting a reverse prosthesis with a functional rotator cuff or with an isolated supraspinatus tear led to more than 2 times higher compressive JRF than with massive rotator cuff tears (superior-anterior or superior-posterior), while the shear force remained comparable. The total JRF increased more than 1.5 times. While a lower shear to compressive ratio may reduce the risk of glenosphere loosening, higher JRF might increase the risk for other failure modes such as fracture or polyethylene wear of the reverse prosthesis.

Developmental Functional Modules in Infant Vocalizations

Purpose Developmental functional modules (DFMs) are biological modules that are defined by their structural (morphological), functional, or developmental elements, and, in some cases, all three of these. This review article considers the hypothesis that vocal development in the first year of life can be understood in large part with respect to DFMs that characterize the speech production system. Method Literature is reviewed on relevant embryology, orofacial reflexes, craniofacial muscle properties, stages of vocal development, and related topics to identity candidates for DFMs. Results The following DFMs are identified and described: laryngeal, pharyngo-laryngeal, mandibular, velopharyngeal, labial complex, and lingual complex. These DFMs and their submodules, considered along with phenomena such as rhythmic movements, account for several well-documented features of vocal development in the first year of life. The proposed DFMs, rooted in embryologic, histologic, and kinematic properties, serve as low-dimensional control variables for the developing vocal tract. Each DFM is semi-autonomous but interacts with other DFMs to produce patterns of vocal behavior. Discussion Considered in relation to contemporary profiles and models of vocal development in the first year of life, DFMs have interpretive and explanatory value. DFMs complement other approaches in the study of infant vocalizations and are grounded in biology.

Personalized biomechanical tongue models based on diffusion-weighted MRI and validated using optical tracking of range of motion

For advanced tongue cancer, the choice between surgery and organ-sparing treatment is often dependent on the expected loss of tongue functionality after treatment. Biomechanical models might assist in this choice by simulating the post-treatment function loss. However, this function loss varies between patients and should, therefore, be predicted for each patient individually. In the present study, the goal was to better predict the postoperative range of motion (ROM) of the tongue by personalizing biomechanical models using diffusion-weighted MRI and constrained spherical deconvolution reconstructions of tongue muscle architecture. Diffusion-weighted MRI scans of ten healthy volunteers were obtained to reconstruct their tongue musculature, which were subsequently registered to a previously described population average or atlas. Using the displacement fields obtained from the registration, the segmented muscle fiber tracks from the atlas were morphed back to create personalized muscle fiber tracks. Finite element models were created from the fiber tracks of the atlas and those of the individual tongues. Via inverse simulation of a protruding, downward, left and right movement, the ROM of the tongue was predicted. This prediction was compared to the ROM measured with a 3D camera. It was demonstrated that biomechanical models with personalized muscles bundles are better in approaching the measured ROM than a generic model. However, to achieve this result a correction factor was needed to compensate for the small magnitude of motion of the model. Future versions of these models may have the potential to improve the estimation of function loss after treatment for advanced tongue cancer.

Simulation of vowel-vowel utterances using a 3D biomechanical-acoustic model

A link is established between biomechanical and acoustic 3D models for the numerical simulation of vowel-vowel utterances. The former rely on the activation and contraction of relevant muscles for voice production, which displace and distort speech organs. However, biomechanical models do not provide a closed computational domain of the 3D vocal tract airway where to simulate sound wave propagation. An algorithm is thus proposed to extract the vocal tract boundary from the surrounding anatomical structures at each time step of the transition between vowels. The resulting 3D geometries are fed into a 3D finite element acoustic model that solves the mixed wave equation for the acoustic pressure and particle velocity. An arbitrary Lagrangian-Eulerian framework is considered to account for the evolving vocal tract. Examples include six static vowels and three dynamic vowel-vowel utterances. Plausible muscle activation patterns are first determined for the static vowel sounds following an inverse method. Dynamic utterances are then generated by linearly interpolating the muscle activation of the static vowels. Results exhibit nonlinear trajectory of the vocal tract geometry, similar to that observed in electromagnetic midsagittal articulography. Clear differences are appreciated when comparing the generated sound with that obtained from direct linear interpolation of the vocal tract geometry. That is, interpolation between the starting and ending vocal tract geometries of an utterance, without resorting to any biomechanical model.

In-vivo tongue stiffness measured by aspiration: Resting vs general anesthesia

Tongue cancer treatment often results in impaired speech, swallowing, or mastication. Simulating the effect of treatments can help the patient and the treating physician to understand the effects and impact of the intervention. To simulate deformations of the tongue, identifying accurate mechanical properties of tissue is essential. However, not many succeeded in characterizing in-vivo tongue stiffness. Those who did, measured the tongue At Rest (AR), in which muscle tone subsides even if muscles are not willingly activated. We expected to find an absolute rest state in participants 'under General Anesthesia' (GA). We elaborated on previous work by measuring the mechanical behavior of the in-vivo tongue under aspiration using an improved volume-based method. Using this technique, 5 to 7 measurements were performed on 10 participants both AR and under GA. The obtained Pressure-Shape curves were first analyzed using the initial slope and its variations. Hereafter, an inverse Finite Element Analysis (FEA) was applied to identify the mechanical parameters using the Yeoh, Gent, and Ogden hyperelastic models. The measurements AR provided a mean Young's Modulus of 1638 Pa (min 1035 - max 2019) using the Yeoh constitutive model, which is in line with previous ex-vivo measurements. However, while hoping to find a rest state under GA, the tongue unexpectedly appeared to be approximately 2 to 2.5 times stiffer under GA than AR. Explanations for this were sought by examining drugs administered during GA, blood flow, perfusion, and upper airway reflexes, but neither of these explanations could be confirmed.

Quantal biomechanical effects in speech postures of the lips

The unique biomechanical and functional constraints on human speech make it a promising area for research investigating modular control of movement. The present article illustrates how a modular control approach to speech can provide insights relevant to understanding both motor control and observed variation across languages. We specifically explore the robust typological finding that languages produce different degrees of labial constriction using distinct muscle groupings and concomitantly distinct lip postures. Research has suggested that these lip postures exploit biomechanical regions of nonlinearity between neural activation and movement, also known as quantal regions, to allow movement goals to be realized despite variable activation signals. We present two sets of computer simulations showing that these labial postures can be generated under the assumption of modular control and that the corresponding modules are biomechanically robust: first to variation in the activation levels of participating muscles, and second to interference from surrounding muscles. These results provide support for the hypothesis that biomechanical robustness is an important factor in selecting the muscle groupings used for speech movements and provide insight into the neurological control of speech movements and how biomechanical and functional constraints govern the emergence of speech motor modules. We anticipate that future experimental work guided by biomechanical simulation results will provide new insights into the neural organization of speech movements.NEW & NOTEWORTHY This article provides additional evidence that speech motor control is organized in a modular fashion and that biomechanics constrain the kinds of motor modules that may emerge. It also suggests that speech can be a fruitful domain for the study of modularity and that a better understanding of speech motor modules will be useful for speech research. Finally, it suggests that biomechanical modeling can serve as a useful complement to experimental work when studying modularity.

Surface-based modeling of muscles: Functional simulation of the shoulder

Musculoskeletal simulations are an essential tool for studying functional implications of pathologies and of potential surgical outcomes, e.g., for the complex shoulder anatomy. Most shoulder models rely on line-segment approximation of muscles with potential limitations. Comprehensive shoulder models based on continuum-mechanics are scarce due to their complexity in both modeling and computation. In this paper, we present a surface-based modeling approach for muscles, which simplifies the modeling process and is efficient for computation. We propose to use surface geometries for modeling muscles, and devise an automatic approach to generate such models, given the locations of the origin and insertion of tendons. The surfaces are expressed as higher-order tensor B-splines, which ensure smoothness of the geometrical representation. They are simulated as membrane elements within a finite element simulation. This is demonstrated on a comprehensive model of the upper limb, where muscle activations needed to perform desired motions are obtained by using inverse dynamics. In synthetic examples, we demonstrate our proposed surface elements both to be easy to customize (e.g., with spatially varying material properties) and to be substantially (up to 12 times) faster in simulation compared to their volumetric counterpart. With our presented automatic approach of muscle wrapping around bones, the humeral head is exemplified to be wrapped physiologically consistently with surface elements. Our functional simulation is shown to successfully replicate a tracked shoulder motion during activities of daily living. We demonstrate surface-based models to be a numerically stable and computationally efficient compromise between line-segment and volumetric models, enabling anatomical correctness, subject-specific customization, and fast simulations, for a comprehensive simulation of musculoskeletal motion.

Analysis of fiber strain in the human tongue during speech

This study investigates mechanical cooperation among tongue muscles. Five volunteers were imaged using tagged magnetic resonance imaging to quantify spatiotemporal kinematics while speaking. Waveforms of strain in the line of action of fibers (SLAF) were estimated by projecting strain tensors onto a model of fiber directionality. SLAF waveforms were temporally aligned to determine consistency across subjects and correlation across muscles. The cohort exhibited consistent patterns of SLAF, and muscular extension-contraction was correlated. Volume-preserving tongue movement in speech generation can be achieved through multiple paths, but the study reveals similarities in motion patterns and muscular action-despite anatomical (and other) dissimilarities.

Human sound systems are shaped by post-Neolithic changes in bite configuration

Linguistic diversity, now and in the past, is widely regarded to be independent of biological changes that took place after the emergence of Homo sapiens We show converging evidence from paleoanthropology, speech biomechanics, ethnography, and historical linguistics that labiodental sounds (such as "f" and "v") were innovated after the Neolithic. Changes in diet attributable to food-processing technologies modified the human bite from an edge-to-edge configuration to one that preserves adolescent overbite and overjet into adulthood. This change favored the emergence and maintenance of labiodentals. Our findings suggest that language is shaped not only by the contingencies of its history, but also by culturally induced changes in human biology.

Reconfigurable soft body trajectories using unidirectionally stretchable composite laminae

Compliant, continuum structures allow living creatures to perform complex tasks inaccessible to artificial rigid systems. Although advancements in hyper-elastic materials have spurred the development of synthetic soft structures (i.e., artificial muscles), these structures have yet to match the precise control and diversity of motions witnessed in living creatures. Cephalopods tentacles, for example, can undergo multiple trajectories using muscular hydrostat, a structure consisting of aggregated laminae of unidirectional muscle fibers. Here, we present a self-adhesive composite lamina inspired by the structural morphology of the muscular hydrostat, which adheres to any volumetrically expanding soft body to govern its motion trajectory. The composite lamina is stretchable only in one direction due to inextensible continuous fibers unidirectionally embedded within its hyper-elastic matrix. We showcase reconfiguration of inflation trajectories of two- and three-dimensional soft bodies by simply adhering laminae to their surfaces.

An interactive surgical simulation tool to assess the consequences of a partial glossectomy on a biomechanical model of the tongue

Oral cancer surgery has a negative influence on the quality of life (QOL). As a result of the complex physiology involved in oral functions, estimation of surgical effects on functionality remains difficult. We present a user-friendly biomechanical simulation of tongue surgery, including closure with suturing and scar formation, followed by an automated adaptation of a finite element (FE) model to the shape of the tongue. Different configurations of our FE model were evaluated and compared to a well-established FE model. We showed that the post-operative impairment as predicted by our model was qualitatively comparable to a patient case for five different tongue maneuvers.

A comprehensive and volumetric musculoskeletal model for the dynamic simulation of the shoulder function

We present a volumetric and extensive finite element model of the shoulder usable in the context of inverse control, in which the scapula is left unconstrained on the ribcage. Such a model allows for exploring various shoulder movements, which are essential for making patient-specific decisions. The proposed model consists of 23 volumetric muscles parts modelled using the finite element method. The glenohumeral, acromioclavicular and sternoclavicular joints are modelled with soft ball-socket constraints. The musculoskeletal model can be controlled by a tracking-based algorithm, finding the excitations values in the muscles needed to follow some target points. The moment arms obtained during abduction and rotation are compared with the literature, which includes results from cadaveric data and a fine FE model of the rotator cuff and the deltoid. We simulated the paralysis of serratus anterior, a main reason of scapular winging, and compared it with its physiological counterpart. A deficiency in the range of motion as well as a reduction in upward rotation were observed, which both corroborate clinical observations. This is one of the most comprehensive model of the shoulder, which can be used to study complex pathologies of the shoulder and their impact on functional outcome such as range-of-motion.

A Sparse Non-Negative Matrix Factorization Framework for Identifying Functional Units of Tongue Behavior From MRI

Muscle coordination patterns of lingual behaviors are synergies generated by deforming local muscle groups in a variety of ways. Functional units are functional muscle groups of local structural elements within the tongue that compress, expand, and move in a cohesive and consistent manner. Identifying the functional units using tagged-magnetic resonance imaging (MRI) sheds light on the mechanisms of normal and pathological muscle coordination patterns, yielding improvement in surgical planning, treatment, or rehabilitation procedures. In this paper, to mine this information, we propose a matrix factorization and probabilistic graphical model framework to produce building blocks and their associated weighting map using motion quantities extracted from tagged-MRI. Our tagged-MRI imaging and accurate voxel-level tracking provide previously unavailable internal tongue motion patterns, thus revealing the inner workings of the tongue during speech or other lingual behaviors. We then employ spectral clustering on the weighting map to identify the cohesive regions defined by the tongue motion that may involve multiple or undocumented regions. To evaluate our method, we perform a series of experiments. We first use two-dimensional images and synthetic data to demonstrate the accuracy of our method. We then use three-dimensional synthetic and in vivo tongue motion data using protrusion and simple speech tasks to identify subject-specific and data-driven functional units of the tongue in localized regions.

What is a tongue tie? Defining the anatomy of the in-situ lingual frenulum

Surgical release of the lingual frenulum (frenotomy) has become an increasingly common procedure, performed from birth through to adulthood. Surprisingly, detailed anatomy of the in‐situ lingual frenulum has never been described, and no anatomical basis has been proposed for the individual variability in frenulum morphology. The lingual frenulum is frequently referred to as a “cord” or “submucosal band” of connective tissue, yet there is no evidence to support this anatomical construct. This paper aims to describe the anatomy of the in‐situ lingual frenulum and its relationship to floor of mouth structures. Fresh tissue microdissection of the lingual frenulum and floor of mouth was performed on nine adult cadavers with photo‐documentation and description of findings. The lingual frenulum is a dynamic structure, formed by a midline fold in a layer of fascia that inserts around the inner arc of the mandible, forming a diaphragm‐like structure across the floor of mouth. This fascia is located immediately beneath the oral mucosa, fusing centrally with the connective tissue on the tongue's ventral surface. The sublingual glands and submandibular ducts are enveloped by the fascial layer and anterior genioglossus fibers are suspended beneath it. Lingual nerve branches are located superficially on the ventral surface of the tongue, immediately deep to the fascia. The lingual frenulum is not a discrete midline structure. It is formed by dynamic elevation of a midline fold in the floor of mouth fascia. With this study, the clinical concept of ankyloglossia and its surgical management warrant revision. Clin. Anat. 32:749–761, 2019. © 2019 The Authors. Clinical Anatomy published by Wiley Periodicals, Inc. on behalf of American Association of Clinical Anatomists.

Compensatory strategies for the alveolar flap [ɾ] production in the presence of ankyloglossia

ABSTRACT Purpose: to analyze the compensatory strategies used by subjects with ankyloglossia for the production of the consonantal alveolar flap sound /ɾ/. Methods: a cross-sectional analytic observational comparative study was conducted with 88 subjects, 44 being diagnosed with ankyloglossia and 44 with normal lingual frenulum, matched by age and gender. They were asked to repeat the syllable /ra/ five times in a row. Video recordings of the speech were taken. Frame by frame analysis of all recordings were performed to verify tongue, lip, and mandible movements during the production of the alveolar flap. The analysis of the films was performed by two Speech Language Pathologists specialized in Orofacial Myofunctional Disorder. Fisher’s Exact Test was used for statistical treatment (p≤0.05.) Results: the frame by frame analysis of the alveolar flap production of subjects with and without ankyloglossia showed that subjects with ankyloglossia performed several compensatory strategies when producing this sound. There was a statistically significant difference (p=0.001) when subjects with and without ankyloglossia were compared. Conclusion: subjects with ankyloglossia used several lip, tongue, and mandible compensatory strategies to produce the Brazilian Portuguese consonantal alveolar flap /ɾ/.

Laplace-based modeling of fiber orientation in the tongue

Mechanical modeling of tongue deformation plays a significant role in the study of breathing, swallowing, and speech production. In the absence of internal joints, fiber orientations determine the direction of sarcomeric contraction and have great influence over real and simulated tissue motion. However, subject-specific experimental observations of fiber distribution are difficult to obtain; thus, models of fiber distribution are generally used in mechanical simulations. This paper describes modeling of fiber distribution using solutions of Laplace equations and compares the effectiveness of this approach against tractography from diffusion tensor magnetic resonance imaging. The experiments included qualitative comparison of streamlines from the fiber model against experimental tractography, as well as quantitative differences between biomechanical simulations focusing in the region near the genioglossus. The model showed good overall agreement in terms of fiber directionality and muscle positioning when compared to subject-specific imaging results and the literature. The angle between the fiber distribution model against tractography in the genioglossus and geniohyoid muscles averaged [Formula: see text] likely due to experimental noise. However, kinematic responses were similar between simulations with modeled fibers versus experimentally obtained fibers; average discrepancy in surface displacement ranged from 1 to 7 mm, and average strain residual magnitude ranged from [Formula: see text] to 0.2. The results suggest that, for simulation purposes, the modeled fibers can act as a reasonable approximation for the tongue's fiber distribution. Also, given its agreement with the global tongue anatomy, the approach may be used in model-based reconstruction of displacement tracking and diffusion results.

Fast Forward-Dynamics Tracking Simulation: Application to Upper Limb and Shoulder Modeling

OBJECTIVE

Musculoskeletal simulation can be used to estimate muscle forces in clinical movement studies. However, such simulations typically only target movement measurements and are not applicable to force exertion tasks which are commonly used in rehabilitation therapy. Simulations can also produce nonphysiological joint forces or be too slow for real-time clinical applications, such as rehabilitation with real-time feedback. The objective of this study is to propose and evaluate a new formulation of forward-dynamics assisted tracking simulation that incorporates measured reaction forces as targets or constraints without any additional computational cost.

METHODS

We illustrate our method with idealized proof-of-concept models and evaluate it with two upper limb cases: Tracking of hand reaction forces during an isometric force-generation task and constraining glenohumeral joint reaction forces for stability during arm elevation.

RESULTS

We show that the addition of reaction force optimization terms within our simulations generates plausible muscle force predictions for these tasks, which are strongly related to reaction forces in addition to movement. Execution times for all models tested were not different when run with or without the reaction force optimization term, ensuring that the simulations are fast enough for real-time clinical applications.

CONCLUSION

Our novel reaction force optimization term leads to more realistic shoulder reaction forces, without any additional computational costs.

SIGNIFICANCE

Our formulation is not only valuable for shoulder simulations, but could be used in various clinical situations (e.g., for different joints and rehabilitation therapy tasks) where the direction and/or magnitude of reaction forces are of interest.

Inverse Biomechanical Modeling of the Tongue via Machine Learning and Synthetic Training Data

The tongue's deformation during speech can be measured using tagged magnetic resonance imaging, but there is no current method to directly measure the pattern of muscles that activate to produce a given motion. In this paper, the activation pattern of the tongue's muscles is estimated by solving an inverse problem using a random forest. Examples describing different activation patterns and the resulting deformations are generated using a finite-element model of the tongue. These examples form training data for a random forest comprising 30 decision trees to estimate contractions in 262 contractile elements. The method was evaluated on data from tagged magnetic resonance data from actual speech and on simulated data mimicking flaps that might have resulted from glossectomy surgery. The estimation accuracy was modest (5.6% error), but it surpassed a semi-manual approach (8.1% error). The results suggest that a machine learning approach to contraction pattern estimation in the tongue is feasible, even in the presence of flaps.

An experimental model to investigate the biomechanical determinants of pharyngeal mucosa coating during swallowing

The development of innovative experimental approaches is necessary to gain insights in the complex biomechanics of swallowing. In particular, unraveling the mechanisms of formation of the thin film of bolus coating the pharyngeal mucosa after the ingestion of liquid or semi-liquid food products is an important challenge, with implication in dysphagia treatment and sensory perceptions. The aim here is to propose an original experimental model of swallowing (i) to simulate the peristaltic motions driving the bolus from the oral cavity to the esophagus, (ii) to mimic and vary complex physiological variables of the pharyngeal mucosa (lubrication, deformability and velocity) and (iii) to measure the thickness and the composition of the coatings resulting from bolus flow. Three Newtonian glucose solutions were considered as model food boli, through sets of experiments covering different ranges of each physiological parameter mimicked. The properties of the coatings (thickness and dilution in saliva film) were shown to depend significantly on the physical properties of food products considered (viscosity and density), but also on physiological variables such as lubrication by saliva, velocity of the peristaltic wave, and to a lesser extent, the deformability of the pharyngeal mucosa. The biomechanical peristalsis simulator developed here can contribute to unravel the determinants of bolus adhesion on pharyngeal mucosa, necessary both for the design of alternative food products for people affected by swallowing disorders, and for a better understanding of the dynamic mechanisms of aroma perception.

A Novel Filtering Approach for 3D Harmonic Phase Analysis of Tagged MRI

Harmonic phase analysis has been used to perform noninvasive organ motion and strain estimation using tagged magnetic resonance imaging (MRI). The filtering process, which is used to produce harmonic phase images used for tissue tracking, influences the estimation accuracy. In this work, we evaluated different filtering approaches, and propose a novel high-pass filter for volumes tagged in individual directions. Testing was done using an open benchmarking dataset and synthetic images obtained using a mechanical model. We compared estimation results from our filtering approach with results from the traditional filtering approach. Our results indicate that 1) the proposed high-pass filter outperforms the traditional filtering approach reducing error by as much as 50% and 2) the accuracy improvements are especially marked in complex deformations.

sEMG-assisted inverse modelling of 3D lip movement: a feasibility study towards person-specific modelling

We propose a surface-electromyographic (sEMG) assisted inverse-modelling (IM) approach for a biomechanical model of the face to obtain realistic person-specific muscle activations (MA) by tracking movements as well as innervation trajectories. We obtained sEMG data of facial muscles and 3D positions of lip markers in six volunteers and, using a generic finite element (FE) face model in ArtiSynth, performed inverse static optimisation with and without sEMG tracking on both simulation data and experimental data. IM with simulated data and experimental data without sEMG data showed good correlations of tracked positions (0.93 and 0.67) and poor correlations of MA (0.27 and 0.20). When utilising the sEMG-assisted IM approach, MA correlations increased drastically (0.83 and 0.59) without sacrificing performance in position correlations (0.92 and 0.70). RMS errors show similar trends with an error of 0.15 in MA and of 1.10 mm in position. Therefore, we conclude that we were able to demonstrate the feasibility of an sEMG-assisted inverse modelling algorithm for the perioral region. This approach may help to solve the ambiguity problem in inverse modelling and may be useful, for instance, in future applications for preoperatively predicting treatment-related function loss.

Do innate stereotypies serve as a basis for swallowing and learned speech movements?

Keven & Akins suggest that innate stereotypies like TP/R may participate in the acquisition of tongue control. This commentary examines this claim in the context of speech motor learning and biomechanics, proposing that stereotypies could provide a basis for both swallowing and speech movements, and provides biomechanical simulation results to supplement neurological evidence for similarities between the two behaviors.

Model-based inverse estimation for active contraction stresses of tongue muscles using 3D surface shape in speech production

This paper presents a novel inverse estimation approach for the active contraction stresses of tongue muscles during speech. The proposed method is based on variational data assimilation using a mechanical tongue model and 3D tongue surface shapes for speech production. The mechanical tongue model considers nonlinear hyperelasticity, finite deformation, actual geometry from computed tomography (CT) images, and anisotropic active contraction by muscle fibers, the orientations of which are ideally determined using anatomical drawings. The tongue deformation is obtained by solving a stationary force-equilibrium equation using a finite element method. An inverse problem is established to find the combination of muscle contraction stresses that minimizes the Euclidean distance of the tongue surfaces between the mechanical analysis and CT results of speech production, where a signed-distance function represents the tongue surface. Our approach is validated through an ideal numerical example and extended to the real-world case of two Japanese vowels, /ʉ/ and /ɯ/. The results capture the target shape completely and provide an excellent estimation of the active contraction stresses in the ideal case, and exhibit similar tendencies as in previous observations and simulations for the actual vowel cases. The present approach can reveal the relative relationship among the muscle contraction stresses in similar utterances with different tongue shapes, and enables the investigation of the coordination of tongue muscles during speech using only the deformed tongue shape obtained from medical images. This will enhance our understanding of speech motor control.

Speech Map: A Statistical Multimodal Atlas of 4D Tongue Motion During Speech from Tagged and Cine MR Images

Quantitative measurement of functional and anatomical traits of 4D tongue motion in the course of speech or other lingual behaviors remains a major challenge in scientific research and clinical applications. Here, we introduce a statistical multimodal atlas of 4D tongue motion using healthy subjects, which enables a combined quantitative characterization of tongue motion in a reference anatomical configuration. This atlas framework, termed Speech Map, combines cine- and tagged-MRI in order to provide both the anatomic reference and motion information during speech. Our approach involves a series of steps including (1) construction of a common reference anatomical configuration from cine-MRI, (2) motion estimation from tagged-MRI, (3) transformation of the motion estimations to the reference anatomical configuration, and (4) computation of motion quantities such as Lagrangian strain. Using this framework, the anatomic configuration of the tongue appears motionless, while the motion fields and associated strain measurements change over the time course of speech. In addition, to form a succinct representation of the high-dimensional and complex motion fields, principal component analysis is carried out to characterize the central tendencies and variations of motion fields of our speech tasks. Our proposed method provides a platform to quantitatively and objectively explain the differences and variability of tongue motion by illuminating internal motion and strain that have so far been intractable. The findings are used to understand how tongue function for speech is limited by abnormal internal motion and strain in glossectomy patients.

Prediction of muscle activation for an eye movement with finite element modeling

In this paper, a 3D finite element (FE) modeling is employed in order to predict extraocular muscles' activation and investigate force coordination in various motions of the eye orbit. A continuum constitutive hyperelastic model is employed for material description in dynamic modeling of the extraocular muscles (EOMs). Two significant features of this model are accurate mass modeling with FE method and stimulating EOMs for motion through muscle activation parameter. In order to validate the eye model, a forward dynamics simulation of the eye motion is carried out by variation of the muscle activation. Furthermore, to realize muscle activation prediction in various eye motions, two different tracking-based inverse controllers are proposed. The performance of these two inverse controllers is investigated according to their resulted muscle force magnitude and muscle force coordination. The simulation results are compared with the available experimental data and the well-known existing neurological laws. The comparison authenticates both the validation and the prediction results.

Predicting 3D lip shapes using facial surface EMG

Aim

The aim of this study is to prove that facial surface electromyography (sEMG) conveys sufficient information to predict 3D lip shapes. High sEMG predictive accuracy implies we could train a neural control model for activation of biomechanical models by simultaneously recording sEMG signals and their associated motions.

Materials and methods

With a stereo camera set-up, we recorded 3D lip shapes and simultaneously performed sEMG measurements of the facial muscles, applying principal component analysis (PCA) and a modified general regression neural network (GRNN) to link the sEMG measurements to 3D lip shapes. To test reproducibility, we conducted our experiment on five volunteers, evaluating several sEMG features and window lengths in unipolar and bipolar configurations in search of the optimal settings for facial sEMG.

Conclusions

The errors of the two methods were comparable. We managed to predict 3D lip shapes with a mean accuracy of 2.76 mm when using the PCA method and 2.78 mm when using modified GRNN. Whereas performance improved with shorter window lengths, feature type and configuration had little influence.

Variability in muscle activation of simple speech motions: A biomechanical modeling approach

Biomechanical models of the oropharynx facilitate the study of speech function by providing information that cannot be directly derived from imaging data, such as internal muscle forces and muscle activation patterns. Such models, when constructed and simulated based on anatomy and motion captured from individual speakers, enable the exploration of inter-subject variability of speech biomechanics. These models also allow one to answer questions, such as whether speakers produce similar sounds using essentially the same motor patterns with subtle differences, or vastly different motor equivalent patterns. Following this direction, this study uses speaker-specific modeling tools to investigate the muscle activation variability in two simple speech tasks that move the tongue forward (/ə-ɡis/) vs backward (/ə-suk/). Three dimensional tagged magnetic resonance imaging data were used to inversely drive the biomechanical models in four English speakers. Results show that the genioglossus is the workhorse muscle of the tongue, with activity levels of 10% in different subdivisions at different times. Jaw and hyoid positioners (inferior pterygoid and digastric) also show high activation during specific phonemes. Other muscles may be more involved in fine tuning the shapes. For example, slightly more activation of the anterior portion of the transverse is found during apical than laminal /s/, which would protrude the tongue tip to a greater extent for the apical /s/.

Speaking Tongues Are Actively Braced

PURPOSE

Bracing of the tongue against opposing vocal-tract surfaces such as the teeth or palate has long been discussed in the context of biomechanical, somatosensory, and aeroacoustic aspects of tongue movement. However, previous studies have tended to describe bracing only in terms of contact (rather than mechanical support), and only in limited phonetic contexts, supporting a widespread view of bracing as an occasional state, peculiar to specific sounds or sound combinations.

METHOD

The present study tests the pervasiveness and effortfulness of tongue bracing in continuous English speech passages using electropalatography and 3-D biomechanical simulations.

RESULTS

The tongue remains in continuous contact with the upper molars during speech, with only rare exceptions. Use of the term bracing (rather than merely contact) is supported here by biomechanical simulations showing that lateral bracing is an active posture requiring dedicated muscle activation; further, loss of lateral contact for onset /l/ allophones is found to be consistently accompanied by contact of the tongue blade against the anterior palate. In the rare instances where direct evidence for contact is lacking (only in a minority of low vowel and postvocalic /l/ tokens), additional biomechanical simulations show that lateral contact is maintained against pharyngeal structures dorsal to the teeth.

CONCLUSION

Taken together, these results indicate that tongue bracing is both pervasive and active in running speech and essential in understanding tongue movement control.

Predicting 3D lip movement using facial sEMG: a first step towards estimating functional and aesthetic outcome of oral cancer surgery

In oral cancer, loss of function due to surgery can be unacceptable, designating the tumour as functionally inoperable. Other curative treatments can then be considered. Currently, predictions of these functional consequences are subjective and unreliable. We want to create patient-specific models to improve and objectify these predictions. A first step was taken by controlling a 3D lip model with volunteer-specific sEMG activities. We focus on the lips first, because they are essential for speech, oral food transport, and facial mimicry. Besides, they are more accessible to measurements than intraoral organs. 3D lip movement and corresponding sEMG activities are measured in five healthy volunteers, who performed 19 instructions repeatedly, to create a quantitative lip model by establishing the relationship between sEMG activities of eight facial muscles bilaterally on the input side and the corresponding 3D lip displacements on the output side. The relationship between 3D lip movement and sEMG activities was accommodated in a state-space model. A good relationship between sEMG activities and 3D lip movement was established with an average root mean square error of 2.43 mm for the first-order system and 2.46 mm for the second-order system. This information can be incorporated into biomechanical models to further personalise functional outcome assessment after treatment.

Upper Airway Elasticity Estimation in Pediatric Down Syndrome Sleep Apnea Patients Using Collapsible Tube Theory

Elasticity of the soft tissues surrounding the upper airway lumen is one of the important factors contributing to upper airway disorders such as snoring and obstructive sleep apnea. The objective of this study is to calculate patient specific elasticity of the pharynx from magnetic resonance (MR) images using a 'tube law', i.e., the relationship between airway cross-sectional area and transmural pressure difference. MR imaging was performed under anesthesia in children with Down syndrome (DS) and obstructive sleep apnea (OSA). An airway segmentation algorithm was employed to evaluate changes in airway cross-sectional area dilated by continuous positive airway pressure (CPAP). A pressure-area relation was used to make localized estimates of airway wall stiffness for each patient. Optimized values of patient specific Young's modulus for tissue in the velopharynx and oropharynx, were estimated from finite element simulations of airway collapse. Patient specific deformation of the airway wall under CPAP was found to exhibit either a non-linear 'hardening' or 'softening' behavior. The localized airway and tissue elasticity were found to increase with increasing severity of OSA. Elasticity based patient phenotyping can potentially assist clinicians in decision making on CPAP and airway or tissue elasticity can supplement well-known clinical measures of OSA severity.

Subject-Specific Biomechanical Modelling of the Oropharynx: Towards Speech Production

Biomechanical models of the oropharynx are beneficial to treatment planning of speech impediments by providing valuable insight into the speech function such as motor control. In this paper, we develop a subject-specific model of the oropharynx and investigate its utility in speech production. Our approach adapts a generic tongue-jaw-hyoid model (Stavness et al. 2011) to fit and track dynamic volumetric MRI data of a normal speaker, subsequently coupled to a source-filter based acoustic synthesizer. We demonstrate our model's ability to track tongue tissue motion, simulate plausible muscle activation patterns, as well as generate acoustic results that have comparable spectral features to the associated recorded audio. Finally, we propose a method to adjust the spatial resolution of our subject-specific tongue model to match the fidelity level of our MRI data and speech synthesizer. Our findings suggest that a higher resolution tongue model - using similar muscle fibre definition - does not show a significant improvement in acoustic performance, for our speech utterance and at this level of fidelity; however we believe that our approach enables further refinements of the muscle fibres suitable for studying longer speech sequences and finer muscle innervation using higher resolution dynamic data.

The role of oral soft tissues in swallowing function: what can tongue pressure tell us?

Tongue pressure data taken from healthy subjects during normal oral activities such as mastication, speech and swallowing are providing us with new ways of understanding the role of the tongue in craniofacial growth and function. It has long been recognized that the sequential contact between the tongue and the palate plays a crucial role in the oropharyngeal phase of swallowing. However, because the focus of most research on intraoral pressure has been on the generation of positive pressure by the tongue on the hard palate and teeth, generation and coordination of absolute intraoral pressures and regional pressure gradients has remained unexplored. Ongoing research in our laboratory has uncovered highly variable individual pressure patterns during swallowing, which can nonetheless be divided into four stages: preparatory, primary propulsive, intermediate and terminal. These stages may further be sub-classified according to pressure patterns generated at the individual level as tipper or dipper patterns in the preparatory stage, roller or slapper in the primary propulsive and monophasic or biphasic during the intermediate stage. Interestingly, while an increase in bolus viscosity can result in significant changes to pressure patterns in some individuals, it has little effect in others. Highly individual responses to increased viscosity are also observed with swallowing duration. The above, together with other findings, have important implications for our understanding of the aetiology of widely differing conditions such as protrusive and retrusive malocclusions, dysphagia and sleep apnoea, as well as the development of novel food products.

Activation of upper airway muscles during breathing and swallowing

The upper airway is a complex muscular tube that is used by the respiratory and digestive systems. The upper airway is invested with several small and anatomically peculiar muscles. The muscle fiber orientations and their nervous innervation are both extremely complex, and how the activity of the muscles is initiated and adjusted during complex behaviors is poorly understood. The bulk of the evidence suggests that the entire assembly of tongue and laryngeal muscles operate together but differently during breathing and swallowing, like a ballet rather than a solo performance. Here we review the functional anatomy of the tongue and laryngeal muscles, and their neural innervation. We also consider how muscular activity is altered as respiratory drive changes, and briefly address upper airway muscle control during swallowing.

Effect of lingual plates on generating intra-oral pressure during swallowing: an experimental study in healthy subjects

Background

Although palatal augmentation prostheses (PAPs) can improve dysphagia, their application is compromised in the absence of maxillary abutment teeth. Experimental lingual plates (ELPs) used for raising the tongue may be employed as alternative to PAPs.

Methods

Influence of different ELP designs, plateau (P–type) and drop-shaped (D–type), on the intra–oral pressure during swallowing were tested. Eleven healthy dentate volunteers, with a mean age of 35.5±10.5 years, participated in this study. Tongue pressure on the hard palate was measured using an ultra-thin sensor sheet with five measuring points, whilst performing dry, 5–ml and 15–ml water swallows, with and without the ELPs in situ. Additional pressure sensors were installed in the lingual aspects of the ELPs, and on the vestibular aspect of the lower molars for measuring sublingual and oral vestibule pressures, respectively. Each measurement was recorded thrice. A repeated measures ANOVA was employed to verify differences in duration, maximal magnitude and integrated value for the different experimental situations. Tukey’s post hoc test was performed for comparison testing. Statistical significance was set at p<0.05.

Results

The sequence of tongue–palate contact on the median line of the hard palate without ELPs was maintained, except for the 15 ml P–type swallow. Tongue pressure started earlier with the D–type but reached its peak nearly at the same time as without ELPs. The peak magnitude and cumulative tongue pressure against the hard palate decreased by wearing ELPs (p<0.05), but was inconsistent between the two types of ELPs and for the different swallowing volumes. Both, maximum and cumulative vestibular pressures were mostly similar or larger with P–type than that with D–type.

Conclusion

D-type and P-type ELPs seem to have the inverse effect of PAPs on the palatal tongue pressure during swallowing. These first counterintuitive findings do not yet justify rejecting the basic rationale of using ELPs for the treatment of dysphagia; hence a rather biologically designed piezographic lingual plate may be more appropriate.