Analysis of speech and tongue motion in normal and post-glossectomy speaker using cine MRI

Automatic Multiple Articulator Segmentation in Dynamic Speech MRI Using a Protocol Adaptive Stacked Transfer Learning U-NET Model

Dynamic magnetic resonance imaging has emerged as a powerful modality for investigating upper-airway function during speech production. Analyzing the changes in the vocal tract airspace, including the position of soft-tissue articulators (e.g., the tongue and velum), enhances our understanding of speech production. The advent of various fast speech MRI protocols based on sparse sampling and constrained reconstruction has led to the creation of dynamic speech MRI datasets on the order of 80-100 image frames/second. In this paper, we propose a stacked transfer learning U-NET model to segment the deforming vocal tract in 2D mid-sagittal slices of dynamic speech MRI. Our approach leverages (a) low- and mid-level features and (b) high-level features. The low- and mid-level features are derived from models pre-trained on labeled open-source brain tumor MR and lung CT datasets, and an in-house airway labeled dataset. The high-level features are derived from labeled protocol-specific MR images. The applicability of our approach to segmenting dynamic datasets is demonstrated in data acquired from three fast speech MRI protocols: Protocol 1: 3 T-based radial acquisition scheme coupled with a non-linear temporal regularizer, where speakers were producing French speech tokens; Protocol 2: 1.5 T-based uniform density spiral acquisition scheme coupled with a temporal finite difference (FD) sparsity regularization, where speakers were producing fluent speech tokens in English, and Protocol 3: 3 T-based variable density spiral acquisition scheme coupled with manifold regularization, where speakers were producing various speech tokens from the International Phonetic Alphabetic (IPA). Segments from our approach were compared to those from an expert human user (a vocologist), and the conventional U-NET model without transfer learning. Segmentations from a second expert human user (a radiologist) were used as ground truth. Evaluations were performed using the quantitative DICE similarity metric, the Hausdorff distance metric, and segmentation count metric. This approach was successfully adapted to different speech MRI protocols with only a handful of protocol-specific images (e.g., of the order of 20 images), and provided accurate segmentations similar to those of an expert human.

Detailed speech evaluation including formant 3 analysis and voice visualization in maxillofacial rehabilitation: A clinical report

Objective speech evaluation such as analysis of formants 1 and 2 and nasality measurement have been used in maxillofacial rehabilitation for outcome assessment. However, in some patients, those evaluations are insufficient to assess a specific or unique problem. This report describes the use of a new speech evaluation including formant 3 analysis and voice visualization in a patient with a maxillofacial defect. The patient was a 67-year-old man who had a maxillary defect that opened to the maxillary sinus and who had an unnatural voice even when wearing an obturator. Nasality was low and the frequency of formants 1 and 2 were normal even without the obturator. However, a low frequency of formant 3 and a shifted center of voice were observed. These results indicated that the unnatural voice was related to increased resonant volume in the pharynx rather than hypernasality. This patient demonstrates that advanced speech analysis can be useful for detecting the cause of speech disorder and planning maxillofacial rehabilitation.

Programmed-stimuli responsive carrier-free multidrug delivery system for highly efficient trimodal combination therapy

Programmed response, carrier-free, and multimodal therapy drug delivery systems (DDS) are promising solutions to multidirectional cytotoxic effects, inefficient antitumor, and severe side effects for cancer therapy. Here, three widely used clinical drugs, interferon α1b (IFNα1b), indocyanine green (ICG), and doxorubicin (DOX), were prepared into carrier-free DDS IFNα1b-ICG-DOX (IID) by a simple one-step method without additional any reagents. IID can achieve smart and programmed DDS by combining low pH and near-infrared (NIR) light stimuli-responsive controlled release. In pH = 7.4 environments, our IID is about 380 nm in size with negative charge rounded particles; while they enter into the acid environment (pH < 7), hydrogen ions (H⁺) trigger DOX release, their size becomes larger and the surface charge turns positive. These larger particles are rapidly disintegrated after exposure to NIR light and then the remaining DOX, IFNα1b, and ICG are released. In vivo, the IID with larger size and positive charge resulting from low pH is is easy to accumulate in tumor tissue. Tumors can be exposed to NIR light when needed to control the release of these three drugs. Hence, DOX, ICG, and IFNα1b can be enriched in the tumor to the high efficiency of combined chemotherapy, photothermal therapy, and immunotherapy.

Speech disorders in patients with Tongue squamous cell carcinoma: A longitudinal observational study based on a questionnaire and acoustic analysis

BACKGROUND

Speech disorders are common dysfunctions in patients with tongue squamous cell carcinoma (TSCC) that can diminish their quality of life. There are few studies with multidimensional and longitudinal assessments of speech function in TSCC patients.

METHODS

This longitudinal observational study was conducted at the Hospital of Stomatology, Sun Yat-sen University, China, from January 2018 to March 2021. A cohort of 92 patients (53 males, age range: 24-77 years) diagnosed with TSCC participated in this study. Speech function was assessed from preoperatively to one year postoperatively using the Speech Handicap Index questionnaire and acoustic parameters. The risk factors for postoperative speech disorder were analyzed by a linear mixed-effects model. A t test or Mann‒Whitney U test was applied to analyze the differences in acoustic parameters under the influence of risk factors to determine the pathophysiological mechanisms of speech disorders in patients with TSCC.

RESULTS

The incidence of preoperative speech disorders was 58.7%, which increased up to 91.4% after surgery. Higher T stage (P＜0.001) and larger range of tongue resection (P = 0.002) were risk factors for postoperative speech disorders. Among the acoustic parameters, F2/i/decreased remarkably with higher T stage (P = 0.021) and larger range of tongue resection (P = 0.009), indicating restricted tongue movement in the anterior-posterior direction. The acoustic parameters analysis during the follow-up period showed that F1 and F2 were not significantly different of the patients with subtotal or total glossectomy over time.

CONCLUSIONS

Speech disorders in TSCC patients is common and persistent. Less residual tongue volume led to worse speech-related QoL, indicating that surgically restoring the length of the tongue and strengthening tongue extension postoperatively may be important.

A segmentation-informed deep learning framework to register dynamic two-dimensional magnetic resonance images of the vocal tract during speech

Objective

Dynamic magnetic resonance (MR) imaging enables visualisation of articulators during speech. There is growing interest in quantifying articulator motion in two-dimensional MR images of the vocal tract, to better understand speech production and potentially inform patient management decisions. Image registration is an established way to achieve this quantification. Recently, segmentation-informed deformable registration frameworks have been developed and have achieved state-of-the-art accuracy. This work aims to adapt such a framework and optimise it for estimating displacement fields between dynamic two-dimensional MR images of the vocal tract during speech.

Methods

A deep-learning-based registration framework was developed and compared with current state-of-the-art registration methods and frameworks (two traditional methods and three deep-learning-based frameworks, two of which are segmentation informed). The accuracy of the methods and frameworks was evaluated using the Dice coefficient (DSC), average surface distance (ASD) and a metric based on velopharyngeal closure. The metric evaluated if the fields captured a clinically relevant and quantifiable aspect of articulator motion.

Results

The segmentation-informed frameworks achieved higher DSCs and lower ASDs and captured more velopharyngeal closures than the traditional methods and the framework that was not segmentation informed. All segmentation-informed frameworks achieved similar DSCs and ASDs. However, the proposed framework captured the most velopharyngeal closures.

Conclusions

A framework was successfully developed and found to more accurately estimate articulator motion than five current state-of-the-art methods and frameworks.

Significance

The first deep-learning-based framework specifically for registering dynamic two-dimensional MR images of the vocal tract during speech has been developed and evaluated.

Hypoxia alleviating platinum(IV)/chlorin e6-based combination chemotherapeutic-photodynamic nanomedicine for oropharyngeal carcinoma

Hypoxia is an important pathological hallmark of the tumor microenvironment, associated with metabolic alterations, cell proliferation, aggressiveness, metastasis, and therapy resistance in cancers. Hypoxia impedes the outcome of photodynamic therapy (PDT), which is largely dependent on molecular oxygen to generate cytotoxic ¹O₂. Here, a near-infrared light activatable, oxygen-generating nanomicellar PDT-chemotherapy system (mPPCPN Ms) constituted of amphiphilic mPEG-PLA, photosensitizer Ce6, and tetravalent platinum prodrug Pt(IV)-diazide was developed for oral squamous cell carcinoma. The polymer conjugate self-assemble to nanosize (115 ± 2.35 nm) micelles, which, upon irradiation (660 nm laser), activated Ce6, and photodecomposed to produce cytotoxic Pt(II), azidyl radical, and molecular oxygen. The strategically fabricated PDT-chemotherapy produced a strong antitumor response in vitro using oral squamous cell carcinoma and in vivo in oral cancer-xenografted mouse models, revealing its significant potential in chemo-photodynamic combination therapy with the benefit of reversing hypoxia.

Digital acoustic analysis of the first three formant frequencies in patients with a prosthesis after maxillectomy

STATEMENT OF PROBLEM

Prosthetic rehabilitation with an obturator can help to restore or improve the intelligibility of speech in patients after maxillectomy. The frequency of formants 1 and 2 as well as their ranges were initially reported in patients with maxillary defects in 2002, and the evaluation method that was used is now applied in clinical evaluation. However, the details of formant 3 are not known and warrant investigation because, according to speech science, formant 3 is related to the pharyngeal volume. Clarifying the formant frequency values of formant 3 in patients after maxillectomy would enable prosthodontists to refer to these data when planning treatment and when assessing the outcome of an obturator.

PURPOSE

The purpose of this clinical study was to determine the acoustic characteristics of formant 3, together with those of formants 1 and 2, by using a digital acoustic analysis during maxillofacial prosthetic treatment. The utility of determining formant 3 in the evaluation of speech in patients after maxillectomy was also evaluated.

MATERIAL AND METHODS

Twenty-six male participants after a maxillectomy (mean age, 63 years; range, 20 to 93 years) were included, and the 5 Japanese vowels /a/, /e/, /i/, /o/, and /u/ produced with and without a definitive obturator prosthesis were recorded. The frequencies of the 3 formants were determined, and their ranges were calculated by using a speech analysis system (Computerized Speech Lab CSL 4400). The Wilcoxon signed rank test was used to compare the formants between the 2 use conditions (α=0.05).

RESULTS

Significant differences were found in the frequencies and ranges of all 3 formants between the use conditions. The ranges of all 3 formants produced with the prosthesis were significantly greater than those produced without it.

CONCLUSIONS

Based on the findings, both the first 2 formants and the third formant were changed by wearing an obturator prosthesis. Because formant 3 is related to the volume of the pharynx, evaluation of this formant and its range can reflect the effectiveness of the prosthesis to seal the oronasal communication and help reduce hypernasality, suggesting the utility of formant 3 analysis in prosthodontic rehabilitation.

Evaluation of Tongue Functions After Free Flap Reconstruction

Squamous cell carcinoma of the tongue is the most common malignancy of the oral cavity, the lateral border being the commonest site. The treatment strategies mandate surgery followed by appropriate reconstruction as the first line of management. There are many suitable methods of reconstruction of tongue defects after surgery, but the principle of an ideal reconstruction method should provide not only satisfactory structural cosmesis, but also good restoration of function. We present our experience with the skin lined free flaps reconstruction for defects of the tongue and floor of mouth, and present analyses of the functional outcomes of reconstruction. This prospective longitudinal study included 93 patients and was conducted in a tertiary care center in Punjab. All patients underwent free flap reconstruction after tumor removal. The functional outcome of the tongue following reconstruction was evaluated 9 months after the completion of treatment. Functions were assessed and matched with sexes and age-matched normal individuals. The data obtained were analyzed by the student 't' test and the p values < 0.05 were considered statistically significant. The duration of swallowing in patients with FRF flap and ALT flap when compared to the normative was significant (< 0.05). There were changes in configuration and volume of the oral cavity after surgery which generates resonant and articulatory alterations, thus the intelligibility of the patient's speech is lowered. There is also a restriction in the tongue movements and reduction in the sensations of the reconstructed part of the tongue. Both the free ALT flap and the FRF flap can provide acceptable functional restoration of the tongue after radical tumor resection.

Photodynamic therapy in the treatment of oral squamous cell carcinoma - The state of the art in preclinical research on the animal model

BACKGROUND

Oral cavity squamous cell carcinoma is a common cancer of the head and neck region. Due to the frequency of diagnoses, high rate of mortality, mutilating nature of classic therapy and numerous complications, new methods of treatment are being sought. One promising solution for treatment that is utilized in many fields of oncology is photodynamic therapy. The purpose of this article is to present a general overview of the use of photodynamic therapy in preclinical in vivo studies on the animal model.

MATERIAL AND METHODS

A literature search for articles corresponding to the topic of this review was performed using the PubMed and MEDLINE databases using the following keywords: 'oral cavity squamous cell carcinoma,' 'photodynamic therapy,' 'photosensitizer(s),' 'in vivo', and 'animal model'.

RESULTS

Based on the literature review, the two most used animal models can be distinguished in research on the use of photodynamic therapy for oral squamous cell carcinoma. Studies mainly focus on the evaluation of tumor growth inhibition after using therapies with various photosensitizers on the murine or hamster cheek pouch models.

CONCLUDING REMARKS

The animal model is a part of preclinical research. Unfortunately, each of the models has its limitations, so it is difficult to extrapolate the results to clinical trials.

Deep-learning-based segmentation of the vocal tract and articulators in real-time magnetic resonance images of speech

BACKGROUND AND OBJECTIVE

Magnetic resonance (MR) imaging is increasingly used in studies of speech as it enables non-invasive visualisation of the vocal tract and articulators, thus providing information about their shape, size, motion and position. Extraction of this information for quantitative analysis is achieved using segmentation. Methods have been developed to segment the vocal tract, however, none of these also fully segment any articulators. The objective of this work was to develop a method to fully segment multiple groups of articulators as well as the vocal tract in two-dimensional MR images of speech, thus overcoming the limitations of existing methods.

METHODS

Five speech MR image sets (392 MR images in total), each of a different healthy adult volunteer, were used in this work. A fully convolutional network with an architecture similar to the original U-Net was developed to segment the following six regions in the image sets: the head, soft palate, jaw, tongue, vocal tract and tooth space. A five-fold cross-validation was performed to investigate the segmentation accuracy and generalisability of the network. The segmentation accuracy was assessed using standard overlap-based metrics (Dice coefficient and general Hausdorff distance) and a novel clinically relevant metric based on velopharyngeal closure.

RESULTS

The segmentations created by the method had a median Dice coefficient of 0.92 and a median general Hausdorff distance of 5mm. The method segmented the head most accurately (median Dice coefficient of 0.99), and the soft palate and tooth space least accurately (median Dice coefficients of 0.92 and 0.93 respectively). The segmentations created by the method correctly showed 90% (27 out of 30) of the velopharyngeal closures in the MR image sets.

CONCLUSIONS

An automatic method to fully segment multiple groups of articulators as well as the vocal tract in two-dimensional MR images of speech was successfully developed. The method is intended for use in clinical and non-clinical speech studies which involve quantitative analysis of the shape, size, motion and position of the vocal tract and articulators. In addition, a novel clinically relevant metric for assessing the accuracy of vocal tract and articulator segmentation methods was developed.

Rehabilitation of speech disorders following glossectomy, based on ultrasound visual illustration and feedback

Intraoral surgery for tongue cancer usually induces speech disorders that have a negative impact on communication and quality of life. Studies have documented the benefit of tongue ultrasound imaging as a visual articulatory feedback for speech rehabilitation. This study aims to assess specifically the complementary contribution of visual feedback to visual illustration (i.e. the display of ultrasound video of target language movements) for the speech rehabilitation of glossectomised patients. Two therapy conditions were used alternately for ten glossectomised French patients randomly divided into two cohorts. The IF cohort benefitted from 10 sessions using illustration alone (IL condition) followed by 10 sessions using illustration supplemented by visual feedback (IL+F condition). The FI cohort followed the opposite protocol, i.e. the first 10 sessions with the IL+F condition, followed by 10 sessions with the IL condition. Phonetic accuracy (Percent Consonants Correct) was monitored at baseline (T0, before the first series) and after each series (T1 and T2) using clinical speech-language assessments. None of the contrasts computed between the two conditions, using logistic regression with random effects models, were found to be statistically significant for the group analysis of assessment scores. Results were significant for a few individuals, with balanced advantages in both conditions. In conclusion, the use of articulatory visual feedback does not seem to bring a decisive advantage over the use of visual illustration, though speech therapists and patients reported that ultrasound feedback was useful at the beginning. This result should be confirmed by similar studies involving other types of speech disorders.

Realistic Dynamic Numerical Phantom for MRI of the Upper Vocal Tract

Dynamic and real-time MRI (rtMRI) of human speech is an active field of research, with interest from both the linguistics and clinical communities. At present, different research groups are investigating a range of rtMRI acquisition and reconstruction approaches to visualise the speech organs. Similar to other moving organs, it is difficult to create a physical phantom of the speech organs to optimise these approaches; therefore, the optimisation requires extensive scanner access and imaging of volunteers. As previously demonstrated in cardiac imaging, realistic numerical phantoms can be useful tools for optimising rtMRI approaches and reduce reliance on scanner access and imaging volunteers. However, currently, no such speech rtMRI phantom exists. In this work, a numerical phantom for optimising speech rtMRI approaches was developed and tested on different reconstruction schemes. The novel phantom comprised a dynamic image series and corresponding k-space data of a single mid-sagittal slice with a temporal resolution of 30 frames per second (fps). The phantom was developed based on images of a volunteer acquired at a frame rate of 10 fps. The creation of the numerical phantom involved the following steps: image acquisition, image enhancement, segmentation, mask optimisation, through-time and spatial interpolation and finally the derived k-space phantom. The phantom was used to: (1) test different k-space sampling schemes (Cartesian, radial and spiral); (2) create lower frame rate acquisitions by simulating segmented k-space acquisitions; (3) simulate parallel imaging reconstructions (SENSE and GRAPPA). This demonstrated how such a numerical phantom could be used to optimise images and test multiple sampling strategies without extensive scanner access.

Analysis of fiber strain in the human tongue during speech

This study investigates mechanical cooperation among tongue muscles. Five volunteers were imaged using tagged magnetic resonance imaging to quantify spatiotemporal kinematics while speaking. Waveforms of strain in the line of action of fibers (SLAF) were estimated by projecting strain tensors onto a model of fiber directionality. SLAF waveforms were temporally aligned to determine consistency across subjects and correlation across muscles. The cohort exhibited consistent patterns of SLAF, and muscular extension-contraction was correlated. Volume-preserving tongue movement in speech generation can be achieved through multiple paths, but the study reveals similarities in motion patterns and muscular action-despite anatomical (and other) dissimilarities.

Genipin Induces Autophagy and Suppresses Cell Growth of Oral Squamous Cell Carcinoma via PI3K/AKT/MTOR Pathway

Background

Oral squamous cell carcinoma (OSCC) is a common malignant tumor of the head and neck, and it accounts for more than 90% of oral cancer. Due to high mortality, limitations of traditional treatment and many complications, new treatment methods are urgently needed. This study aimed to look into the effect of new potential anti-tumor drug, genipin, on OSCC treatment.

Methods

In vitro, CCK-8, colony formation, and flow cytometry were used to detect the effect of genipin on SCC-9 and SCC-15 cell lines. Immunofluorescence, real-time PCR, and Western blotting were used to investigate its mechanism. Xenograft tumor model was used to explore the role of genipin in vivo.

Results

We found that genipin suppressed cell growth and induced apoptosis in vitro. In addition, the expression of p62 was down-regulated while Beclin1 and LC3II were up-regulated in SCC-25 and SCC-9 cells. 3-methyladenine (3-MA) significantly decreased LC3 (LC3II)⁺ puncta, but genipin rescuect 3d this reduction. Furthermore, genipin also reduced the expression of p-PI3K, p-AKT, and p-mTOR. In vivo experiment showed that genipin significantly curbed the tumor size and weight. The positive expression of Ki67 protein and number of apoptotic cells were increased.

Conclusion

Conclusively, this study implicated that genipin suppresses cell proliferation and stimulated apoptosis, and is the first exploration showing that genipin induces OSCC cell autophagy via PI3K/AKT/mTOR pathway inhibition.

Effects of oral and oropharyngeal cancer on speech intelligibility using acoustic analysis: Systematic review

BACKGROUND

The development of automatic tools based on acoustic analysis allows to overcome the limitations of perceptual assessment for patients with head and neck cancer. The aim of this study is to provide a systematic review of literature describing the effects of oral and oropharyngeal cancer on speech intelligibility using acoustic analysis.

METHODS

Two databases (PubMed and Embase) were surveyed. The selection process, according to the preferred reporting items for systematic reviews and meta-analyses (PRISMA) statement, led to a final set of 22 articles.

RESULTS

Nasalance is studied mainly in oropharyngeal patients. The vowels are mostly studied using formant analysis and vowel space area, the consonants by means of spectral moments with specific parameters according to their phonetic characteristic. Machine learning methods allow classifying "intelligible" or "unintelligible" speech for T3 or T4 tumors.

CONCLUSIONS

The development of comprehensive models combining different acoustic measures would allow a better consideration of the functional impact of the speech disorder.

Quantification of tongue mobility impairment using optical tracking in patients after receiving primary surgery or chemoradiation

PURPOSE

Tongue mobility has shown to be a clinically interesting parameter on functional results after tongue cancer treatment which can be objectified by measuring the Range Of Motion (ROM). Reliable measurements of ROM would enable us to quantify the severity of functional impairments and use these for shared decision making in treatment choices, rehabilitation of speech and swallowing disturbances after treatment.

METHOD

Nineteen healthy participants, eighteen post-chemotherapy patients and seventeen post-surgery patients were asked to perform standardized tongue maneuvers in front of a 3D camera system, which were subsequently tracked and corrected for head and jaw motion. Indicators, such as the left-right tongue range and the deflection angle with the horizontal axis were extracted from the tongue trajectory to serve as a quantitative measure for the impaired tongue mobility.

RESULTS

The range and deflection angle showed an excellent intra- and interrater reliability (ICC 0.9) The repeatability experiment showed an average standard deviation of 2.5 mm to 3.5 mm for every movement, except the upward movement. The post-surgery patient group showed a smaller tongue range and higher deflection angle overall than the healthy participants. Post-chemoradiation patients showed less difference in tongue ROM compared with healthy participants. Only a few patients showed asymmetrical movement after treatment, which could not always be explained by T-stage or the side of treatment alone.

CONCLUSION

We introduced a reliable and reproducible method for measuring the ROM and to quantify for motion impairments, that was able to show differences in tongue ROM between healthy subjects and patients after chemoradiation or surgery. Future research should focus on measuring patients with oral cancer pre- and post-treatment in combination with the collection of detailed information about the individual tongue anatomy, so that the full ROM trajectory can be used to identify changes over time and to quantify functional impairment.