Tracking Hyoid Bone Displacement During Swallowing Without Videofluoroscopy Using Machine Learning of Vibratory Signals

Machine learning in the evaluation of voice and swallowing in the head and neck cancer patient

PURPOSE OF REVIEW

The purpose of this review is to present recent advances and limitations in machine learning applied to the evaluation of speech, voice, and swallowing in head and neck cancer.

RECENT FINDINGS

Novel machine learning models incorporating diverse data modalities with improved discriminatory capabilities have been developed for predicting toxicities following head and neck cancer therapy, including dysphagia, dysphonia, xerostomia, and weight loss as well as guiding treatment planning. Machine learning has been applied to the care of posttreatment voice and swallowing dysfunction by offering objective and standardized assessments and aiding innovative technologies for functional restoration. Voice and speech are also being utilized in machine learning algorithms to screen laryngeal cancer.

SUMMARY

Machine learning has the potential to help optimize, assess, predict, and rehabilitate voice and swallowing function in head and neck cancer patients as well as aid in cancer screening. However, existing studies are limited by the lack of sufficient external validation and generalizability, insufficient transparency and reproducibility, and no clear superior predictive modeling strategies. Algorithms and applications will need to be trained on large multiinstitutional data sets, incorporate sociodemographic data to reduce bias, and achieve validation through clinical trials for optimal performance and utility.

Temporal Sequence of Laryngeal Vestibule Closure and Reopening is Associated With Airway Protection

BACKGROUND

Upper esophageal sphincter opening (UESO), and laryngeal vestibule closure (LVC) are two essential kinematic events whose timings are crucial for adequate bolus clearance and airway protection during swallowing. Their temporal characteristics can be quantified through time-consuming analysis of videofluoroscopic swallow studies (VFSS).

OBJECTIVES

We sought to establish a model to predict the odds of penetration or aspiration during swallowing based on 15 temporal factors of UES and laryngeal vestibule kinematics.

METHODS

Manual temporal measurements and ratings of penetration and aspiration were conducted on a videofluoroscopic dataset of 408 swallows from 99 patients. A generalized estimating equation model was deployed to analyze association between individual factors and the risk of penetration or aspiration.

RESULTS

The results indicated that the latencies of laryngeal vestibular events and the time lapse between UESO onset and LVC were highly related to penetration or aspiration. The predictive model incorporating patient demographics and bolus presentation showed that delayed LVC by 0.1 s or delayed LVO by 1% of the swallow duration (average 0.018 s) was associated with a 17.19% and 2.68% increase in odds of airway invasion, respectively.

CONCLUSION

This predictive model provides insight into kinematic factors that underscore the interaction between the intricate timing of laryngeal kinematics and airway protection. Recent investigation in automatic noninvasive or videofluoroscopic detection of laryngeal kinematics would provide clinicians access to objective measurements not commonly quantified in VFSS. Consequently, the temporal and sequential understanding of these kinematics may interpret such measurements to an estimation of the risk of aspiration or penetration which would give rise to rapid computer-assisted dysphagia diagnosis.

LEVEL OF EVIDENCE

2 Laryngoscope, 133:521-527, 2023.

Non-Invasive Sensor-Based Estimation of Anterior-Posterior Upper Esophageal Sphincter Opening Maximal Distension

OBJECTIVE

Dysphagia management relies on the evaluation of the temporospatial kinematic events of swallowing performed in videofluoroscopy (VF) by trained clinicians. The upper esophageal sphincter (UES) opening distension represents one of the important kinematic events that contribute to healthy swallowing. Insufficient distension of UES opening can lead to an accumulation of pharyngeal residue and subsequent aspiration which in turn can lead to adverse outcomes such as pneumonia. VF is usually used for the temporal and spatial evaluation of the UES opening; however, VF is not available in all clinical settings and may be inappropriate or undesirable for some patients. High resolution cervical auscultation (HRCA) is a noninvasive technology that uses neck-attached sensors and machine learning to characterize swallowing physiology by analyzing the swallow-induced vibrations/sounds in the anterior neck region. We investigated the ability of HRCA to noninvasively estimate the maximal distension of anterior-posterior (A-P) UES opening as accurately as the measurements performed by human judges from VF images.

METHODS AND PROCEDURES

Trained judges performed the kinematic measurement of UES opening duration and A-P UES opening maximal distension on 434 swallows collected from 133 patients. We used a hybrid convolutional recurrent neural network supported by attention mechanisms which takes HRCA raw signals as input and estimates the value of the A-P UES opening maximal distension as output.

RESULTS

The proposed network estimated the A-P UES opening maximal distension with an absolute percentage error of 30% or less for more than 64.14% of the swallows in the dataset.

CONCLUSION

This study provides substantial evidence for the feasibility of using HRCA to estimate one of the key spatial kinematic measurements used for dysphagia characterization and management. Clinical and Translational Impact Statement: The findings in this study have a direct impact on dysphagia diagnosis and management through providing a non-invasive and cheap way to estimate one of the most important swallowing kinematics, the UES opening distension, that contributes to safe swallowing. This study, along with other studies that utilize HRCA for swallowing kinematic analysis, paves the way for developing a widely available and easy-to-use tool for dysphagia diagnosis and management.

Autonomous Swallow Segment Extraction Using Deep Learning in Neck-Sensor Vibratory Signals From Patients With Dysphagia

Dysphagia occurs secondary to a variety of underlying etiologies and can contribute to increased risk of adverse events such as aspiration pneumonia and premature mortality. Dysphagia is primarily diagnosed and characterized by instrumental swallowing exams such as videofluoroscopic swallowing studies. videofluoroscopic swallowing studies involve the inspection of a series of radiographic images for signs of swallowing dysfunction. Though effective, videofluoroscopic swallowing studies are only available in certain clinical settings and are not always desirable or feasible for certain patients. Because of the limitations of current instrumental swallow exams, research studies have explored the use of acceleration signals collected from neck sensors and demonstrated their potential in providing comparable radiation-free diagnostic value as videofluoroscopic swallowing studies. In this study, we used a hybrid deep convolutional recurrent neural network that can perform multi-level feature extraction (localized and across time) to annotate swallow segments automatically via multi-channel swallowing acceleration signals. In total, we used signals and videofluoroscopic swallowing study images of 3144 swallows from 248 patients with suspected dysphagia. Compared to other deep network variants, our network was superior at detecting swallow segments with an average area under the receiver operating characteristic curve value of 0.82 (95% confidence interval: 0.807-0.841), and was in agreement with up to 90% of the gold standard-labeled segments.

AI-Based Detection of Aspiration for Video-Endoscopy with Visual Aids in Meaningful Frames to Interpret the Model Outcome

Disorders of swallowing often lead to pneumonia when material enters the airways (aspiration). Flexible Endoscopic Evaluation of Swallowing (FEES) plays a key role in the diagnostics of aspiration but is prone to human errors. An AI-based tool could facilitate this process. Recent non-endoscopic/non-radiologic attempts to detect aspiration using machine-learning approaches have led to unsatisfying accuracy and show black-box characteristics. Hence, for clinical users it is difficult to trust in these model decisions. Our aim is to introduce an explainable artificial intelligence (XAI) approach to detect aspiration in FEES. Our approach is to teach the AI about the relevant anatomical structures, such as the vocal cords and the glottis, based on 92 annotated FEES videos. Simultaneously, it is trained to detect boluses that pass the glottis and become aspirated. During testing, the AI successfully recognized the glottis and the vocal cords but could not yet achieve satisfying aspiration detection quality. While detection performance must be optimized, our architecture results in a final model that explains its assessment by locating meaningful frames with relevant aspiration events and by highlighting suspected boluses. In contrast to comparable AI tools, our framework is verifiable and interpretable and, therefore, accountable for clinical users.

Automated pharyngeal phase detection and bolus localization in videofluoroscopic swallowing study: Killing two birds with one stone?

BACKGROUND AND OBJECTIVE

The videofluoroscopic swallowing study (VFSS) is a gold-standard imaging technique for assessing swallowing, but analysis and rating of VFSS recordings is time consuming and requires specialized training and expertise. Researchers have recently demonstrated that it is possible to automatically detect the pharyngeal phase of swallowing and to localize the bolus in VFSS recordings via computer vision approaches, fostering the development of novel techniques for automatic VFSS analysis. However, training of algorithms to perform these tasks requires large amounts of annotated data that are seldom available. In this paper, we demonstrate that the challenges of pharyngeal phase detection and bolus localization can be solved together using a single approach.

METHODS

We propose a deep-learning framework that jointly tackles pharyngeal phase detection and bolus localization in a weakly-supervised manner, requiring only the initial and final frames of the pharyngeal phase as ground truth annotations for the training. Our approach stems from the observation that bolus presence in the pharynx is the most prominent visual feature upon which to infer whether individual VFSS frames belong to the pharyngeal phase. We conducted extensive experiments with multiple convolutional neural networks (CNNs) on a dataset of 1245 bolus-level clips from 59 healthy subjects.

RESULTS

We demonstrated that the pharyngeal phase can be detected with an F1-score higher than 0.9. Moreover, by processing the class activation maps of the CNNs, we were able to localize the bolus with promising results, obtaining correlations with ground truth trajectories higher than 0.9, without any manual annotations of bolus location used for training purposes.

CONCLUSIONS

Once validated on a larger sample of participants with swallowing disorders, our framework will pave the way for the development of intelligent tools for VFSS analysis to support clinicians in swallowing assessment.

Automated assessment of hyoid movement during normal swallow using ultrasound

BACKGROUND

The potential for using ultrasound by speech and language therapists (SLTs) as an adjunct clinical tool to assess swallowing function has received increased attention during the COVID-19 pandemic, with a recent review highlighting the need for further research on normative data, objective measurement, elicitation protocol and training. The dynamic movement of the hyoid, visible in ultrasound, is crucial in facilitating bolus transition and protection of the airway during a swallow and has shown promise as a biomarker of swallowing function.

AIMS

To examine the kinematics of the hyoid during a swallow using ultrasound imaging and to relate the patterns to the different stages of a normal swallow. To evaluate the accuracy and robustness of two different automatic hyoid tracking methods relative to manual hyoid position estimation.

METHODS & PROCEDURES

Ultrasound data recorded from 15 healthy participants swallowing a 10 ml water bolus delivered by cup or spoon were analysed. The movement of the hyoid was tracked using manually marked frame-to-frame positions, automated hyoid shadow tracking and deep neural net (DNN) tracking. Hyoid displacement along the horizontal image axis (HxD) was charted throughout a swallow, and the maximum horizontal displacement (HxD max) and maximum hyoid velocity (HxV max) along the same axis were automatically calculated.

OUTCOMES & RESULTS

The HxD and HxV of 10 ml swallows are similar to values reported in the literature. The trajectory of the hyoid movement and its location at significant swallow event time points showed increased hyoid displacement towards the peak of the swallow. Using an interclass correlation coefficient, HxD max and HxV max values derived from the DNN tracker and shadow tracker are shown to be in high agreement and moderate agreement, respectively, when compared with values derived from manual tracking.

CONCLUSIONS & IMPLICATIONS

The similarity of the hyoid tracking results using ultrasound to previous reports based on different instrumental tools supports the possibility of using hyoid movement as a measure of swallowing function in ultrasound. The use of machine learning to automatically track the hyoid movement potentially provides a reliable and efficient way to quantify swallowing function. These findings contribute towards improving the clinical utility of ultrasound as a swallowing assessment tool. Further research on both normative and clinical populations is needed to validate hyoid movement metrics as a means of differentiating normal and abnormal swallows and to verify the reliability of automatic tracking.

WHAT THIS PAPER ADDS

What is already known on this subject There is growing interest in the use of ultrasound as an adjunct tool for assessing swallowing function. However, there is currently insufficient knowledge about the patterning and timing of lingual and hyoid movement in a typical swallow. We know that movement of the hyoid plays an essential role in bolus transition and airway protection. However, manual tracking of hyoid movement is time-consuming and restricts the extent of large-scale normative studies. What this study adds We show that hyoid movement can be tracked automatically, providing measurable continuous positional data. Measurements derived from this objective data are comparable with similar measures previously reported using videofluoroscopy and of the two automatic trackers assessed, the DNN approach demonstrates better robustness and higher agreement with manually derived measures. Using this kinematic data, hyoid movement can be related to different stages of swallowing. Clinical implications of this study This study contributes towards our understanding of the kinematics of a typical swallow by evaluating an automated hyoid tracking method, paving the way for future studies of typical and disordered swallow. The challenges of image acquisition highlight issues to be considered when establishing clinical protocols. The application of machine learning enhances the utility of ultrasound swallowing assessment by reducing the labour required and permitting a wider range of hyoid measurements. Further research in normative and clinical populations is facilitated by automatic data extraction allowing the validity of prospective hyoid measures in differentiating different types of swallows to be rigorously assessed.

Are Oropharyngeal Dysphagia Screening Tests Effective in Preventing Pneumonia?

Oropharyngeal dysphagia, a clinical condition that indicates difficulty in moving food and liquid from the oral cavity to the esophagus, has a markedly high prevalence in the elderly. The number of elderly people with oropharyngeal dysphagia is expected to increase due to the aging of the world's population. Understanding the current situation of dysphagia screening is crucial when considering future countermeasures. We report findings from a literature review including citations on current objective dysphagia screening tests: the Water Swallowing Test, Mann Assessment of Swallowing Ability, and the Gugging Swallowing Screen. Pneumonia can be predicted using the results of the screening tests discussed in this review, and the response after the screening tests is important for prevention. In addition, although interdisciplinary team approaches prevent and reduce aspiration, optimal treatment is a challenging. Intervention studies with multiple factors focusing on the elderly are needed.

Using an Automated Speech Recognition Approach to Differentiate Between Normal and Aspirating Swallowing Sounds Recorded from Digital Cervical Auscultation in Children

Use of machine learning to accurately detect aspirating swallowing sounds in children is an evolving field. Previously reported classifiers for the detection of aspirating swallowing sounds in children have reported sensitivities between 79 and 89%. This study aimed to investigate the accuracy of using an automatic speaker recognition approach to differentiate between normal and aspirating swallowing sounds recorded from digital cervical auscultation in children. We analysed 106 normal swallows from 23 healthy children (median 13 months; 52.1% male) and 18 aspirating swallows from 18 children (median 10.5 months; 61.1% male) who underwent concurrent videofluoroscopic swallow studies with digital cervical auscultation. All swallowing sounds were on thin fluids. A support vector machine classifier with a polynomial kernel was trained on feature vectors that comprised the mean and standard deviation of spectral subband centroids extracted from each swallowing sound in the training set. The trained support vector machine was then used to classify swallowing sounds in the test set. We found high accuracy in the differentiation of aspirating and normal swallowing sounds with 98% overall accuracy. Sensitivity for the detection of aspiration and normal swallowing sounds were 89% and 100%, respectively. There were consistent differences in time, power spectral density and spectral subband centroid features between aspirating and normal swallowing sounds in children. This study provides preliminary research evidence that aspirating and normal swallowing sounds in children can be differentiated accurately using machine learning techniques.

A Preliminary Investigation of Similarities of High Resolution Cervical Auscultation Signals Between Thin Liquid Barium and Water Swallows

Dysphagia, commonly referred to as abnormal swallowing, affects millions of people annually. If not diagnosed expeditiously, dysphagia can lead to more severe complications, such as pneumonia, nutritional deficiency, and dehydration. Bedside screening is the first step of dysphagia characterization and is usually based on pass/fail tests in which a nurse observes the patient performing water swallows to look for dysphagia overt signs such as coughing. Though quick and convenient, bedside screening only provides low-level judgment of impairment, lacks standardization, and suffers from subjectivity. Recently, high resolution cervical auscultation (HRCA) has been investigated as a less expensive and non-invasive method to diagnose dysphagia. It has shown strong preliminary evidence of its effectiveness in penetration-aspiration detection as well as multiple swallow kinematics. HRCA signals have traditionally been collected and investigated in conjunction with videofluoroscopy exams which are performed using barium boluses including thin liquid. An HRCA-based bedside screening is highly desirable to expedite the initial dysphagia diagnosis and overcome all the drawbacks of the current pass/fail screening tests. However, all research conducted for using HRCA in dysphagia is based on thin liquid barium boluses and thus not guaranteed to provide valid results for water boluses used in bedside screening. If HRCA signals show no significant differences between water and thin liquid barium boluses, then the same algorithms developed on thin liquid barium boluses used in diagnostic imaging studies, it can be then directly used with water boluses. This study investigates the similarities and differences between HRCA signals from thin liquid barium swallows compared to those signals from water swallows. Multiple features from the time, frequency, time-frequency, and information-theoretic domain were extracted from each type of swallow and a group of linear mixed models was tested to determine the significance of differences. Machine learning classifiers were fit to the data as well to determine if the swallowed material (thin liquid barium or water) can be correctly predicted from an unlabeled set of HRCA signals. The results demonstrated that there is no systematic difference between the HRCA signals of thin liquid barium swallows and water swallows. While no systematic difference was discovered, the evidence of complete conformity between HRCA signals of both materials was inconclusive. These results must be validated further to confirm conformity between the HRCA signals of thin liquid barium swallows and water swallows.

Effects of Presbyphagia on Oropharyngeal Swallowing Observed during Modified Barium Swallow Studies

OBJECTIVES

Understanding how aging impacts swallowing can help differentiate typical from atypical behaviors. This study aimed to quantify age-related swallowing alterations observed during a modified barium swallow study.

DESIGN

Cross-sectional study.

SETTING

Adult fluoroscopy suite in a metropolitan hospital at an academic center.

PARTICIPANTS

195 healthy adults distributed across 3 age categories: 21-39; 40-59; 60+ years.

MEASUREMENTS

17 physiologic components of swallowing across three functional domains (oral, pharyngeal, esophageal), including summed composite scores (Oral Total [OT] and Pharyngeal Total [PT]), from the validated and standardized Modified Barium Swallow Impairment Profile.

RESULTS

Most components (65%) demonstrated no impairment (scores of "0"). The odds of a worse (higher) score increased significantly with age for: Tongue Control during Bolus Hold, Hyolaryngeal Movement, Laryngeal Closure, Pharyngeal Contraction, and Pharyngoesophageal Segment Opening. OT and PT scores for 40-59-year-olds were worse than the youngest group (p=.01 and p <.001, respectively). Adults 60+ years had significantly worse PT scores among all groups (p-values <.01).

CONCLUSION

Oropharyngeal swallowing physiology evolves as healthy adults age and should be considered during clinical decision-making.

Characterizing Effortful Swallows from Healthy Community Dwelling Adults Across the Lifespan Using High-Resolution Cervical Auscultation Signals and MBSImP Scores: A Preliminary Study

There is growing enthusiasm to develop inexpensive, non-invasive, and portable methods that accurately assess swallowing and provide biofeedback during dysphagia treatment. High-resolution cervical auscultation (HRCA), which uses acoustic and vibratory signals from non-invasive sensors attached to the anterior laryngeal framework during swallowing, is a novel method for quantifying swallowing physiology via advanced signal processing and machine learning techniques. HRCA has demonstrated potential as a dysphagia screening method and diagnostic adjunct to VFSSs by determining swallowing safety, annotating swallow kinematic events, and classifying swallows between healthy participants and patients with a high degree of accuracy. However, its feasibility as a non-invasive biofeedback system has not been explored. This study investigated 1. Whether HRCA can accurately differentiate between non-effortful and effortful swallows; 2. Whether differences exist in Modified Barium Swallow Impairment Profile (MBSImP) scores (#9, #11, #14) between non-effortful and effortful swallows. We hypothesized that HRCA would accurately classify non-effortful and effortful swallows and that differences in MBSImP scores would exist between the types of swallows. We analyzed 247 thin liquid 3 mL command swallows (71 effortful) to minimize variation from 36 healthy adults who underwent standardized VFSSs with concurrent HRCA. Results revealed differences (p < 0.05) in 9 HRCA signal features between non-effortful and effortful swallows. Using HRCA signal features as input, decision trees classified swallows with 76% accuracy, 76% sensitivity, and 77% specificity. There were no differences in MBSImP component scores between non-effortful and effortful swallows. While preliminary in nature, this study demonstrates the feasibility/promise of HRCA as a biofeedback method for dysphagia treatment.

Characterizing Swallows From People With Neurodegenerative Diseases Using High-Resolution Cervical Auscultation Signals and Temporal and Spatial Swallow Kinematic Measurements

Purpose The prevalence of dysphagia in patients with neurodegenerative diseases (ND) is alarmingly high and frequently results in morbidity and accelerated mortality due to subsequent adverse events (e.g., aspiration pneumonia). Swallowing in patients with ND should be continuously monitored due to the progressive disease nature. Access to instrumental swallow evaluations can be challenging, and limited studies have quantified changes in temporal/spatial swallow kinematic measures in patients with ND. High-resolution cervical auscultation (HRCA), a dysphagia screening method, has accurately differentiated between safe and unsafe swallows, identified swallow kinematic events (e.g., laryngeal vestibule closure [LVC]), and classified swallows between healthy adults and patients with ND. This study aimed to (a) compare temporal/spatial swallow kinematic measures between patients with ND and healthy adults and (b) investigate HRCA's ability to annotate swallow kinematic events in patients with ND. We hypothesized there would be significant differences in temporal/spatial swallow measurements between groups and that HRCA would accurately annotate swallow kinematic events in patients with ND. Method Participants underwent videofluoroscopic swallowing studies with concurrent HRCA. We used linear mixed models to compare temporal/spatial swallow measurements (n = 170 ND patient swallows, n = 171 healthy adult swallows) and deep learning machine-learning algorithms to annotate specific temporal and spatial kinematic events in swallows from patients with ND. Results Differences (p < .05) were found between groups for several temporal and spatial swallow kinematic measures. HRCA signal features were used as input to machine-learning algorithms and annotated upper esophageal sphincter (UES) opening, UES closure, LVC, laryngeal vestibule reopening, and hyoid bone displacement with 66.25%, 85%, 68.18%, 70.45%, and 44.6% accuracy, respectively, compared to human judges' measurements. Conclusion This study demonstrates HRCA's potential in characterizing swallow function in patients with ND and other patient populations.

Establishing Reference Values for Temporal Kinematic Swallow Events Across the Lifespan in Healthy Community Dwelling Adults Using High-Resolution Cervical Auscultation

Few research studies have investigated temporal kinematic swallow events in healthy adults to establish normative reference values. Determining cutoffs for normal and disordered swallowing is vital for differentially diagnosing presbyphagia, variants of normal swallowing, and dysphagia; and for ensuring that different swallowing research laboratories produce consistent results in common measurements from different samples within the same population. High-resolution cervical auscultation (HRCA), a sensor-based dysphagia screening method, has accurately annotated temporal kinematic swallow events in patients with dysphagia, but hasn't been used to annotate temporal kinematic swallow events in healthy adults to establish dysphagia screening cutoffs. This study aimed to determine: (1) Reference values for temporal kinematic swallow events, (2) Whether HRCA can annotate temporal kinematic swallow events in healthy adults. We hypothesized (1) Our reference values would align with a prior study; (2) HRCA would detect temporal kinematic swallow events as accurately as human judges. Trained judges completed temporal kinematic measurements on 659 swallows (N = 70 adults). Swallow reaction time and LVC duration weren't different (p > 0.05) from a previously published historical cohort (114 swallows, N = 38 adults), while other temporal kinematic measurements were different (p < 0.05), suggesting a need for further standardization to feasibly pool data analyses across laboratories. HRCA signal features were used as input to machine learning algorithms and annotated UES opening (69.96% accuracy), UES closure (64.52% accuracy), LVC (52.56% accuracy), and LV re-opening (69.97% accuracy); providing preliminary evidence that HRCA can noninvasively and accurately annotate temporal kinematic measurements in healthy adults to determine dysphagia screening cutoffs.

Chest-Worn Inertial Sensors: A Survey of Applications and Methods

Inertial Measurement Units (IMUs) are frequently implemented in wearable devices. Thanks to advances in signal processing and machine learning, applications of IMUs are not limited to those explicitly addressing body movements such as Activity Recognition (AR). On the other hand, wearing IMUs on the chest offers a few advantages over other body positions. AR and posture analysis, cardiopulmonary parameters estimation, voice and swallowing activity detection and other measurements can be approached through chest-worn inertial sensors. This survey tries to introduce the applications that come with the chest-worn IMUs and summarizes the existing methods, current challenges and future directions associated with them. In this regard, this paper references a total number of 57 relevant studies from the last 10 years and categorizes them into seven application areas. We discuss the inertial sensors used as well as their placement on the body and their associated validation methods based on the application categories. Our investigations show meaningful correlations among the studies within the same application categories. Then, we investigate the data processing architectures of the studies from the hardware point of view, indicating a lack of effort on handling the main processing through on-body units. Finally, we propose combining the discussed applications in a single platform, finding robust ways for artifact cancellation, and planning optimized sensing/processing architectures for them, to be taken more seriously in future research.

How Closely do Machine Ratings of Duration of UES Opening During Videofluoroscopy Approximate Clinician Ratings Using Temporal Kinematic Analyses and the MBSImP?

Clinicians evaluate swallow kinematic events by analyzing videofluoroscopy (VF) images for dysphagia management. The duration of upper esophageal sphincter opening (DUESO) is one important temporal swallow event, because reduced DUESO can result in pharyngeal residue and penetration/aspiration. VF is frequently used for evaluating swallowing but exposes patients to radiation and is not always feasible/readily available. High resolution cervical auscultation (HRCA) is a non-invasive, sensor-based dysphagia screening method that uses signal processing and machine learning to characterize swallowing. We investigated HRCA's ability to annotate DUESO and predict Modified Barium Swallow Impairment Profile (MBSImP) scores (component #14). We hypothesized that HRCA and machine learning techniques would detect DUESO with similar accuracy as human judges. Trained judges completed temporal kinematic measurements of DUESO on 719 swallows (116 patients) and 50 swallows (15 age-matched healthy adults). An MBSImP certified clinician completed MBSImP ratings on 100 swallows. A multi-layer convolutional recurrent neural network (CRNN) using HRCA signal features for input was used to detect DUESO. Generalized estimating equations models were used to determine statistically significant HRCA signal features for predicting DUESO MBSImP scores. A support vector machine (SVM) classifier and a leave-one-out procedure was used to predict DUESO MBSImP scores. The CRNN detected UES opening within a 3-frame tolerance for 82.6% of patient and 86% of healthy swallows and UES closure for 72.3% of patient and 64% of healthy swallows. The SVM classifier predicted DUESO MBSImP scores with 85.7% accuracy. This study provides evidence of HRCA's feasibility in detecting DUESO without VF images.