Comparison of voice relative fundamental frequency estimates derived from an accelerometer signal and low-pass filtered and unprocessed microphone signals

Estimation of Speech Features Using a Wearable Inertial Sensor

Speech features have been investigated as novel digital biomarkers for many psychiatric and neurocognitive diseases. Microphones are the most used devices for speech recording but inevitably suffering from several disadvantages such as privacy leakage and environmental noises, limiting their clinical applications particularly for long-term ambulatory monitoring. The aim of the present study is therefore to explore the feasibility of extracting speech features from the acceleration recorded on the sternum. Ten healthy subjects volunteered in our study. Two speech tasks, that is, repeating one sentence 20 times and reading 20 different sentences, were performed by each subject, with each task repeated eight times under different speech rate and loudness. Voice signals and speech-caused chest vibrations were simultaneously recorded by a microphone and an accelerometer placed on the sternum. Forty-two acoustic features and six time-related prosodic features were extracted from both signals using a standard toolbox, and then compared by a linear fit and correlation analysis. Good agreement between the acceleration features and microphone features is observed in all six time-related prosodic features for both tasks, but only in 19 and 17 acoustic features for task 1 and 2, respectively, with most of them loudness- or pitch-related. Our results suggest the sternum acceleration to track time-related speech prosody, loudness, and pitch very well, demonstrating the feasibility of deriving digital biomarkers from the acceleration signal for diseases strongly related to time-related prosodic and loudness features.

Voice Onset Time in Children With and Without Vocal Fold Nodules

PURPOSE

Voice onset time (VOT) of voiceless consonants provides information on the coordination of the vocal and articulatory systems. This study examined whether vocal-articulatory coordination is affected by the presence of vocal fold nodules (VFNs) in children.

METHOD

The voices of children with VFNs (6-12 years) and age- and gender-matched vocally healthy controls were examined. VOT was calculated as the time between the voiceless stop consonant burst and the vocal onset of the vowel. Measures of the average VOT and VOT variability, defined as the coefficient of variation, were calculated. The acoustic measure of dysphonia, cepstral peak prominence (CPP), was also calculated. CPP provides information about the overall periodicity of the signal, with more dysphonic voices having lower CPP values.

RESULTS

There were no significant differences in either average VOT or VOT variability between the VFN and control groups. VOT variability and average VOT were both significantly predicted by the interaction between Group and CPP. There was a significant negative correlation between CPP and VOT variability in the VFN group, but no significant relationship was found in the control group.

CONCLUSIONS

Unlike previous studies with adults, there were no group differences in average VOT or VOT variability in this study. However, children with VFNs who were more dysphonic had increased VOT variability, suggestive of a relationship between dysphonia severity and control of vocal onset during speech production.

Effects of surgery on the relationship between subglottic pressure and fundamental frequency in vocal fold dynamics in patients with benign laryngeal diseases

PURPOSE

Subglottic pressure (P_s) and fundamental frequency (F₀) play important roles in governing vocal fold (VF) dynamics. Theoretical description, model simulation, excised larynx and animal models have been used in previous studies, yet clinically applicable measurements are still lacking. This study aimed to evaluate the effects of surgery for benign laryngeal lesions by investigating the relationship between F₀ and P_s.

METHODS

Patients with benign laryngeal lesions who underwent phonosurgery were prospectively recruited. Participants were instructed to sustain voicing the vowel /o/ at three incremental frequencies four semitones apart in the modal register (F01, F02, F03). F₀ was estimated by VF vibration on the accelerometer. P_s change was achieved and measured using the airflow interruption method.

RESULTS

Thirteen patients with a mean age (SD) of 43.5 (12.4) years were included. The change in F₀ per unit change of P_s, which is the slope (Hz/kPa) of the regression line of the frequency-pressure data pairs, decreased as the tension of the VF increased. The slopes significantly increased after the operation for F01 and F02 (36.43 ± 14.68 preoperatively, 53.91 ± 30.71 postoperatively, p = 0.011 and 26.02 ± 10.71; 34.85 ± 17.92, p = 0.046, respectively). In addition, there was a significant decrease in phonation threshold pressure and improvements in the grade, roughness, breathiness, asthenia, strain scale, and the voice handicap inventory-10.

CONCLUSIONS

The relationship between F₀ and P_s may serve as an objective assessment of the outcomes in the treatment of benign laryngeal diseases with clinical relevance.

Automated Relative Fundamental Frequency Algorithms for Use With Neck-Surface Accelerometer Signals

OBJECTIVE

Relative fundamental frequency (RFF) has been suggested as a potential acoustic measure of vocal effort. However, current clinical standards for RFF measures require time-consuming manual markings. Previous semi-automated algorithms have been developed to calculate RFF from microphone signals. The current study aimed to develop fully automated algorithms to calculate RFF from neck-surface accelerometer signals for ecological momentary assessment and ambulatory monitoring of voice.

METHODS

Training a set of 2646 /vowel-fricative-vowel/ utterances from 317 unique speakers, with and without voice disorders, was used to develop automated algorithms to calculate RFF values from neck-surface accelerometer signals. The algorithms first rejected utterances with poor vowel-to-noise ratios, then identified fricative locations, then used signal features to determine voicing boundary cycles, and finally calculated corresponding RFF values. These automated RFF values were compared to the clinical gold-standard of manual RFF calculated from simultaneously collected microphone signals in a novel test set of 639 utterances from 77 unique speakers.

RESULTS

Automated accelerometer-based RFF values resulted in an average mean bias error (MBE) across all cycles of 0.027 ST, with an MBE of 0.152 ST and -0.252 ST in the offset and onset cycles closest to the fricative, respectively.

CONCLUSION

All MBE values were smaller than the expected changes in RFF values following successful voice therapy, suggesting that the current algorithms could be used for ecological momentary assessment and ambulatory monitoring via neck-surface accelerometer signals.

Relative Fundamental Frequency in Children With and Without Vocal Fold Nodules

Purpose Relative fundamental frequency (RFF) is an acoustic measure that is sensitive to functional voice differences in adults. The aim of the current study was to evaluate RFF in children, as there are known structural and functional differences between the pediatric and adult vocal mechanisms. Method RFF was analyzed in 28 children with vocal fold nodules (CwVN, M = 9.0 years) and 28 children with typical voices (CwTV, M = 8.9 years). RFF is the instantaneous fundamental frequency (f ₀) of the 10 vocalic cycles during devoicing (vocal offset) and 10 vocalic cycles during the revoicing (vocal onset) of the vowels that surround a voiceless consonant. Each cycle's f ₀ was normalized to a steady-state portion of the vowel. RFF values for the cycles closest to the voiceless consonant, that is, Offset Cycle 10 and Onset Cycle 1, were examined. Results Average RFF values for Offset Cycle 10 and Onset Cycle 1 did not differ between CwVN and CwTV; however, within-subject variability of Offset Cycle 10 was decreased in CwVN. Across both groups, male children had lower Offset Cycle 10 RFF values as compared to female children. Additionally, Onset Cycle 1 values were decreased in younger children as compared to those of older children. Conclusions Unlike previous work with adults, CwVN did not have significantly different RFF values than CwTV. Younger children had lower RFF values for Onset Cycle 1 than older children, suggesting that vocal onset f ₀ may provide information on the maturity of the laryngeal motor system.

Estimating vocal fold stiffness: Using the relationship between subglottic pressure and fundamental frequency of phonation as an analog

OBJECTIVE

The stiffness of the vocal folds is an important factor in voice production, yet clinically applicable measurements are still lacking. It has been demonstrated in an in vivo canine model that fundamental frequency (F₀ ) increased linearly as subglottic pressure (P_s ) increased, but with a lesser slope for higher levels of vocal fold tension. In this study, the relationship between F₀ and P_s was investigated using the airflow interruption method in awake patients non-invasively.

DESIGN

Healthy volunteers enrolled for evaluation.

SETTING

Single-centre.

PARTICIPANTS

Thirty-three healthy volunteers aged 20 and older were recruited, with one excluded for a recent asthma attack.

MAIN OUTCOME MEASURES

The relationships between F₀ and P_s , described as the slope (Hz/kPa), were investigated when the participants sustained voicing the vowel/o/at 3 incremental frequencies 4 semitones apart in the modal register (F1, F2 and F3).

RESULTS

Thirty-two healthy volunteers (20 females, 12 males) aged 20-47 years were enrolled for final analyses. There was a statistically significant difference in the slopes of the linear regression lines of F₀ -P_s , depending on the frequency with which the vowel/o/ was produced (P < .001). The slope differed significantly between F2 and F1 (P < .001; P = .015), F3 and F1 (P < .001; P = .002) and F3 and F2 (P < .001; P = .005) for both women and men, respectively.

CONCLUSIONS

It was demonstrated that the higher the vocal fold tension, the smaller the slope between F₀ and P_s . Using the relationship between F₀ and P_s as an analog of vocal fold stiffness is potentially practical for clinical application.

The relationship between acoustical and perceptual measures of vocal effort

Excessive vocal effort is a common clinical voice symptom, yet the acoustical manifestation of vocal effort and how that is perceived by speakers and listeners has not been fully elucidated. Here, 26 vocally healthy adults increased vocal effort during the production of the utterance /ifi/, followed by self-ratings of effort on a 100 mm visual analog scale. Twenty inexperienced listeners assessed the speakers' vocal effort using the visual sort-and-rate method. Previously proposed acoustical correlates of vocal effort were calculated, including: mean sound pressure level (SPL), mean fundamental frequency (f o), relative fundamental frequency (RFF) offset cycle 10 and onset cycle 1, harmonics-to-noise ratio (HNR), cepstral peak prominence and its standard deviation (SD), and low-to-high (L/H) spectral ratio and its SD. Two separate mixed-effects regression models yielded mean SPL, L/H ratio, and HNR as significant predictors of both speaker and listener ratings of vocal effort. RFF offset cycle 10 and mean f o were significant predictors of listener ratings only. Therefore, speakers and listeners attended to similar acoustical cues when making judgments of vocal effort, but listeners also used additional time-based information. Further work is needed to determine how vocal effort manifests in the speech signal in speakers with voice disorders.

The Relationship Between Relative Fundamental Frequency and a Kinematic Estimate of Laryngeal Stiffness in Healthy Adults

PURPOSE

This study examined the relationship between the acoustic measure relative fundamental frequency (RFF) and a kinematic estimate of laryngeal stiffness.

METHOD

Twelve healthy adults (mean age = 22.7 years, SD = 4.4; 10 women, 2 men) produced repetitions of /ifi/ while varying their vocal effort during simultaneous acoustic and video nasendoscopic recordings. RFF was determined from the last 10 voicing cycles before the voiceless obstruent (RFF offset) and the first 10 cycles of revoicing (RFF onset). A kinematic stiffness ratio was calculated for the vocal fold adductory gesture during revoicing by normalizing the maximum angular velocity by the maximum glottic angle during the voiceless obstruent.

RESULTS

A linear mixed effect model indicated that RFF offset and onset were significant predictors of the kinematic stiffness ratios. The model accounted for 52% of the variance in the kinematic data. Individual relationships between RFF and kinematic stiffness ratios varied across participants, with at least moderate negative correlations in 83% of participants for RFF offset but only 40% of participants for RFF onset.

CONCLUSIONS

RFF significantly predicted kinematic estimates of laryngeal stiffness in healthy speakers and has the potential to be a useful clinical indicator of laryngeal tension. Further research is needed in individuals with voice disorders.

Relationships between vocal function measures derived from an acoustic microphone and a subglottal neck-surface accelerometer

Monitoring subglottal neck-surface acceleration has received renewed attention due to the ability of low-profile accelerometers to confidentially and noninvasively track properties related to normal and disordered voice characteristics and behavior. This study investigated the ability of subglottal neck-surface acceleration to yield vocal function measures traditionally derived from the acoustic voice signal and help guide the development of clinically functional accelerometer-based measures from a physiological perspective. Results are reported for 82 adult speakers with voice disorders and 52 adult speakers with normal voices who produced the sustained vowels /a/, /i/, and /u/ at a comfortable pitch and loudness during the simultaneous recording of radiated acoustic pressure and subglottal neck-surface acceleration. As expected, timing-related measures of jitter exhibited the strongest correlation between acoustic and neck-surface acceleration waveforms (r ≤ 0.99), whereas amplitude-based measures of shimmer correlated less strongly (r ≤ 0.74). Additionally, weaker correlations were exhibited by spectral measures of harmonics-to-noise ratio (r ≤ 0.69) and tilt (r ≤ 0.57), whereas the cepstral peak prominence correlated more strongly (r ≤ 0.90). These empirical relationships provide evidence to support the use of accelerometers as effective complements to acoustic recordings in the assessment and monitoring of vocal function in the laboratory, clinic, and during an individual's daily activities.

Voice Relative Fundamental Frequency Via Neck-Skin Acceleration in Individuals With Voice Disorders

PURPOSE

This study investigated the use of neck-skin acceleration for relative fundamental frequency (RFF) analysis.

METHOD

Forty individuals with voice disorders associated with vocal hyperfunction and 20 age- and sex-matched control participants were recorded with a subglottal neck-surface accelerometer and a microphone while producing speech stimuli appropriate for RFF. Rater reliabilities, RFF means, and RFF standard deviations derived from the accelerometer were compared with those derived from the microphone.

RESULTS

RFF estimated from the accelerometer had slightly higher intrarater reliability and identical interrater reliability compared with values estimated with the microphone. Although sensor type and the Vocal Cycle × Sensor and Vocal Cycle × Sensor × Group interactions showed significant effects on RFF means, the typical RFF pattern could be derived from either sensor. For both sensors, the RFF of individuals with vocal hyperfunction was lower than that of the controls. Sensor type and its interactions did not have significant effects on RFF standard deviations.

CONCLUSIONS

RFF can be reliably estimated using an accelerometer, but these values cannot be compared with those collected via microphone. Future studies are needed to determine the physiological basis of RFF and examine the effect of sensors on RFF in practical voice assessment and monitoring settings.

Average Ambulatory Measures of Sound Pressure Level, Fundamental Frequency, and Vocal Dose Do Not Differ Between Adult Females With Phonotraumatic Lesions and Matched Control Subjects

OBJECTIVES

Clinical management of phonotraumatic vocal fold lesions (nodules, polyps) is based largely on assumptions that abnormalities in habitual levels of sound pressure level (SPL), fundamental frequency (f0), and/or amount of voice use play a major role in lesion development and chronic persistence. This study used ambulatory voice monitoring to evaluate if significant differences in voice use exist between patients with phonotraumatic lesions and normal matched controls.

METHODS

Subjects were 70 adult females: 35 with vocal fold nodules or polyps and 35 age-, sex-, and occupation-matched normal individuals. Weeklong summary statistics of voice use were computed from anterior neck surface acceleration recorded using a smartphone-based ambulatory voice monitor.

RESULTS

Paired t tests and Kolmogorov-Smirnov tests resulted in no statistically significant differences between patients and matched controls regarding average measures of SPL, f0, vocal dose measures, and voicing/voice rest periods. Paired t tests comparing f0 variability between the groups resulted in statistically significant differences with moderate effect sizes.

CONCLUSIONS

Individuals with phonotraumatic lesions did not exhibit differences in average ambulatory measures of vocal behavior when compared with matched controls. More refined characterizations of underlying phonatory mechanisms and other potentially contributing causes are warranted to better understand risk factors associated with phonotraumatic lesions.

Effects of Adventitious Acute Vocal Trauma: Relative Fundamental Frequency and Listener Perception

OBJECTIVE

High voice users (individuals who demonstrate excessive or loud vocal use) are at risk for developing voice disorders. The objective of this study was to examine, both acoustically and perceptually, vocal changes in healthy speakers after an acute period of high voice use.

METHODS

Members of a university women's volleyball team (n = 12) were recorded a week before (pre) and week after (post) the 10-week spring season; n = 6 control speakers were recorded over the same time period for comparison. Speakers read four sentences, which were analyzed for relative fundamental frequency (RFF). Eight naïve listeners participated in an auditory-perceptual visual sort and rate (VSR) task, in which they rated each voice sample's overall severity and strain.

RESULTS

No significant differences were found as a function of time point in the VSR ratings for the volleyball group. Onset cycle 1 RFF values were significantly lower (P = 0.04) in the postrecordings of the volleyball participants compared with prerecordings, but there was no significant difference (P = 0.20) in offset cycle 10 RFF values. Receiver operating characteristic analyses indicated moderate sensitivity and specificity of onset cycle 1 RFF for discrimination between the volleyball and control participants. Changes were not apparent in the control group as a function of time for either, onset cycle 1 RFF, offset cycle 10 RFF, or either vocal attribute.

CONCLUSIONS

Onset cycle 1 RFF may be an effective marker for detecting vocal changes over an acute high voice use period of time before perceptual changes are noted.