Clinically evaluated procedure for the reconstruction of vocal fold vibrations from endoscopic digital high-speed videos

Efficient and effective extraction of vocal fold vibratory patterns from high-speed digital imaging

High-speed digital imaging can provide valuable information on disordered voice production in voice science. However, the large amounts of high-speed image data with limited image resolutions produce significant challenges for computer analysis, and thus effective and efficient image edge extraction methods allowing for the batch analysis of high-speed images of vocal folds is clinically important. In this paper, a novel algorithm for automatic image edge detection is proposed to effectively and efficiently process high-speed images of the vocal folds. The method integrates Lagrange interpolation, differentiation, and Canny edge detection, which allow objective extraction of aperiodic vocal fold vibratory patterns from large numbers of high-speed digital images. This method and two other popular algorithms, histogram and active contour, are performed on 10 sets of high-speed video data from excised larynx experiments to compare their performances in analyzing high-speed images. The accuracy in computing glottal area and the computation time of these methods are investigated. The results show that our proposed method provides the most accurate and efficient detection, and is applicable when processing low-resolution images. In this study, we focus on developing a method to effectively and efficiently process high-speed image data from excised larynges. However, in addition we show the clinical potential of this method by use of example high-speed image data obtained from a patient with vocal nodules.The proposed automatic image-processing algorithm may provide a valuable biomedical application for the clinical assessment of vocal disorders by use of high-speed digital imaging.

Spatio-temporal quantification of vocal fold vibrations using high-speed videoendoscopy and a biomechanical model

Pathologic changes within the organic constitution of vocal folds or a functional impairment of the larynx may result in disturbed or even irregular vocal fold vibrations. The consequences are perturbations of the acoustic speech signal which are perceived as a hoarse voice. By means of appropriate image processing techniques, the vocal fold dynamics are extracted from digital high-speed videos. This study addresses the approach to obtain a parametric description of the spatio-temporal characteristics of the vocal fold oscillations for the aim of classification. For this purpose a biomechanical vocal fold model is introduced. An automatic optimization procedure is developed for fitting the model dynamics to the observed vocal fold oscillations. Thus, the resulting parameter values represent a specific vibration pattern and serve as an objective quantification measure. Performance and reliability of the optimization procedure are validated with synthetically generated data sets. The high-speed videos of two normal voice subjects and six patients suffering from different voice disorders are processed. The resulting model parameters represent a rough approximation of physiological parameters along the entire vocal folds.

Spatiotemporal classification of vocal fold dynamics by a multimass model comprising time-dependent parameters

A model-based approach is proposed to objectively measure and classify vocal fold vibrations by left-right asymmetries along the anterior-posterior direction, especially in the case of nonstationary phonation. For this purpose, vocal fold dynamics are recorded in real time with a digital high-speed camera during phonation of sustained vowels as well as pitch raises. The dynamics of a multimass model with time-dependent parameters are matched to vocal fold vibrations extracted at dorsal, medial, and ventral positions by an automatic optimization procedure. The block-based optimization accounts for nonstationary vibrations and compares the vocal fold and model dynamics by wavelet coefficients. The optimization is verified with synthetically generated data sets and is applied to 40 clinical high-speed recordings comprising normal and pathological voice subjects. The resulting model parameters allow an intuitive visual assessment of vocal fold instabilities within an asymmetry diagram and are applicable to an objective quantification of asymmetries.

Phonovibrography: mapping high-speed movies of vocal fold vibrations into 2-D diagrams for visualizing and analyzing the underlying laryngeal dynamics

Endoscopic high-speed laryngoscopy in combination with image analysis strategies is the most promising approach to investigate the interrelation between vocal fold vibrations and voice disorders. So far, due to the lack of an objective and standardized analysis procedure a unique characterization of vocal fold vibrations has not been achieved yet. We present a visualization and analysis strategy which transforms the segmented edges of vibrating vocal folds into a single 2-D image, denoted Phonovibrogram (PVG). Within a PVG the individual type of vocal fold vibration becomes uniquely characterized by specific geometric patterns. The PVG geometries give an intuitive access on the type and degree of the laryngeal asymmetry and can be quantified using an image segmentation approach. The PVG analysis was applied to 14 representative recordings derived from a high-speed database comprising normal and pathological voices. We demonstrate that PVGs are capable to differentiate and quantify different types of normal and pathological vocal fold vibrations. The objective and precise quantification of the PVG geometry may have the potential to realize a novel classification of vocal fold vibrations.

Calibration of laryngeal endoscopic high-speed image sequences by an automated detection of parallel laser line projections

High-speed laryngeal endoscopic systems record vocal fold vibrations during phonation in real-time. For a quantitative analysis of vocal fold dynamics a metrical scale is required to get absolute laryngeal dimensions of the recorded image sequence. For the clinical use there is no automated and stable calibration procedure up to now. A calibration method is presented that consists of a laser projection device and the corresponding image processing for the automated detection of the laser calibration marks. The laser projection device is clipped to the endoscope and projects two parallel laser lines with a known distance to each other as calibration information onto the vocal folds. Image processing methods automatically identify the pixels belonging to the projected laser lines in the image data. The line detection bases on a Radon transform approach and is a two-stage process, which successively uses temporal and spatial characteristics of the projected laser lines in the high-speed image sequence. The robustness and the applicability are demonstrated with clinical endoscopic image sequences. The combination of the laser projection device and the image processing enables the calibration of laryngeal endoscopic images within the vocal fold plane and thus provides quantitative metrical data of vocal fold dynamics.