Timing variability of sensorimotor integration during vocalization in individuals who stutter

Mirrors and toothaches: commonplace manipulations of non-auditory feedback availability change perceived speech intelligibility

This paper investigates the impact of two non-technical speech feedback perturbations outside the auditory modality: topical application of commercially-available benzocaine to reduce somatosensory feedback from speakers' lips and tongue tip, and the presence of a mirror to provide fully-detailed visual self-feedback. In experiment 1, speakers were recorded under normal quiet conditions (i.e., baseline), then again with benzocaine application plus auditory degradation, and finally with the addition of mirror feedback. Speech produced under normal and both feedback-altered conditions was assessed via naïve listeners' intelligibility discrimination judgments. Listeners judged speech produced under bisensory degradation to be less intelligible than speech from the un-degraded baseline, and with a greater degree of difference than previously observed with auditory-only degradation. The introduction of mirror feedback, however, did not result in relative improvements in intelligibility. Experiment 2, therefore, assessed the effect of a mirror on speech intelligibility in isolation with no other sensory feedback manipulations. Speech was recorded at baseline and then again in front of a mirror, and relative intelligibility was discriminated by naïve listeners. Speech produced with mirror feedback was judged as less intelligible than baseline tokens, indicating a negative impact of visual self-feedback in the absence of other sensory manipulations. The results of both experiments demonstrate that relatively accessible manipulations of non-auditory sensory feedback can produce speech-relevant effects, and that those effects are perceptible to naïve listeners.

Sensorimotor Simulation's Influence on Stress: EEG and Autonomic Responses in Digital Interviews

This study explored the role of sensorimotor simulation in modulating the stress response in individuals exposed to stressful digital simulated interviews. Participants were assigned to two different versions of a Digital Social Stress Test: a simulated version with a dynamic-realistic examining committee (Dyn-DSST) and a version with a static examining committee (Stat-DSST). During interview preparation, behavioral indices reflecting stress regulation and resistance, response times, and electroencephalographic (EEG) and autonomic indices were collected. Higher regulation scores were found for the Stat-DSST group compared to the Dyn-DSST group, probably induced by the presence of limited external sensory input in time and space, perceived as less stressful. The EEG results revealed a distinct contribution of the low- and high-frequency bands for both groups. Dyn-DSST required greater cognitive regulation effort due to the presence of a continuous flow of information, which can enhance sensory and motor activation in the brain. The SCR increased in the Dyn-DSST group compared to the Stat-DSST group, reflecting greater emotional involvement in the Dyn-DSST group and reduced sensory stimulation in the static version. In conclusion, the results suggest that sensorimotor simulation impacts the stress response differently in dynamic interviews compared to static ones, with distinct profiles based on behavioral, EEG, and autonomic measures.

Test-Retest Reliability of Behavioral Assays of Feedforward and Feedback Auditory-Motor Control of Voice and Articulation

PURPOSE

Behavioral assays of feedforward and feedback auditory-motor control of voice and articulation frequently are used to make inferences about underlying neural mechanisms and to study speech development and disorders. However, no studies have examined the test-retest reliability of such measures, which is critical for rigorous study of auditory-motor control. Thus, the purpose of the present study was to assess the reliability of assays of feedforward and feedback control in voice versus articulation domains.

METHOD

Twenty-eight participants (14 cisgender women, 12 cisgender men, one transgender man, one transmasculine/nonbinary) who denied any history of speech, hearing, or neurological impairment were measured for responses to predictable versus unexpected auditory feedback perturbations of vocal (fundamental frequency, fo) and articulatory (first formant, F1) acoustic parameters twice, with 3-6 weeks between sessions. Reliability was measured with intraclass correlations.

RESULTS

Opposite patterns of reliability were observed for fo and F1; fo reflexive responses showed good reliability and fo adaptive responses showed poor reliability, whereas F1 reflexive responses showed poor reliability and F1 adaptive responses showed moderate reliability. However, a criterion-referenced categorical measurement of fo adaptive responses as typical versus atypical showed substantial test-retest agreement.

CONCLUSIONS

Individual responses to some behavioral assays of auditory-motor control of speech should be interpreted with caution, which has implications for several fields of research. Additional research is needed to establish reliable criterion-referenced measures of F1 adaptive responses as well as fo and F1 reflexive responses. Furthermore, the opposite patterns of test-retest reliability observed for voice versus articulation add to growing evidence for differences in underlying neural control mechanisms.

Auditory feedback control in adults who stutter during metronome-paced speech I. Timing Perturbation

PURPOSE

This study determined whether adults who stutter (AWS) exhibit deficits in responding to an auditory feedback timing perturbation, and whether external timing cues, which increase fluency, attenuate any disruptions due to altered temporal auditory feedback.

METHODS

Fifteen AWS and sixteen adults who do not stutter (ANS) read aloud a multisyllabic sentence either with normal pacing or with each syllable paced at the rate of a metronome. On random trials, an auditory feedback timing perturbation was applied, and timing responses were compared between groups and pacing conditions.

RESULTS

Both groups responded to the timing perturbation by delaying subsequent syllable boundaries, and there were no significant differences between groups in either pacing condition. Furthermore, no response differences were found between normally paced and metronome-paced conditions.

CONCLUSION

These findings are interpreted as showing that 1) AWS respond normally to pure timing perturbations, and 2) metronome-paced speech has no effect on online speech timing control as assessed in the present experiment.

Auditory feedback control in adults who stutter during metronome-paced speech II. Formant Perturbation

PURPOSE

Prior work has shown that Adults who stutter (AWS) have reduced and delayed responses to auditory feedback perturbations. This study aimed to determine whether external timing cues, which increase fluency, resolve auditory feedback processing disruptions.

METHODS

Fifteen AWS and sixteen adults who do not stutter (ANS) read aloud a multisyllabic sentence either with natural stress and timing or with each syllable paced at the rate of a metronome. On random trials, an auditory feedback formant perturbation was applied, and formant responses were compared between groups and pacing conditions.

RESULTS

During normally paced speech, ANS showed a significant compensatory response to the perturbation by the end of the perturbed vowel, while AWS did not. In the metronome-paced condition, which significantly reduced the disfluency rate, the opposite was true: AWS showed a significant response by the end of the vowel, while ANS did not.

CONCLUSION

These findings indicate a potential link between the reduction in stuttering found during metronome-paced speech and changes in auditory motor integration in AWS.

Quantitatively characterizing reflexive responses to pitch perturbations

Background

Reflexive pitch perturbation experiments are commonly used to investigate the neural mechanisms underlying vocal motor control. In these experiments, the fundamental frequency–the acoustic correlate of pitch–of a speech signal is shifted unexpectedly and played back to the speaker via headphones in near real-time. In response to the shift, speakers increase or decrease their fundamental frequency in the direction opposing the shift so that their perceived pitch is closer to what they intended. The goal of the current work is to develop a quantitative model of responses to reflexive perturbations that can be interpreted in terms of the physiological mechanisms underlying the response and that captures both group-mean data and individual subject responses.

Methods

A model framework was established that allowed the specification of several models based on Proportional-Integral-Derivative and State-Space/Directions Into Velocities of Articulators (DIVA) model classes. The performance of 19 models was compared in fitting experimental data from two published studies. The models were evaluated in terms of their ability to capture both population-level responses and individual differences in sensorimotor control processes.

Results

A three-parameter DIVA model performed best when fitting group-mean data from both studies; this model is equivalent to a single-rate state-space model and a first-order low pass filter model. The same model also provided stable estimates of parameters across samples from individual subject data and performed among the best models to differentiate between subjects. The three parameters correspond to gains in the auditory feedback controller’s response to a perceived error, the delay of this response, and the gain of the somatosensory feedback controller’s “resistance” to this correction. Excellent fits were also obtained from a four-parameter model with an additional auditory velocity error term; this model was better able to capture multi-component reflexive responses seen in some individual subjects.

Conclusion

Our results demonstrate the stereotyped nature of an individual’s responses to pitch perturbations. Further, we identified a model that captures population responses to pitch perturbations and characterizes individual differences in a stable manner with parameters that relate to underlying motor control capabilities. Future work will evaluate the model in characterizing responses from individuals with communication disorders.

Tract profiles of the cerebellar peduncles in children who stutter

Cerebellar-cortical loops comprise critical neural circuitry that supports self-initiated movements and motor adjustments in response to perceived errors, functions that are affected in stuttering. It is unknown whether structural aspects of cerebellar circuitry are affected in stuttering, particularly in children close to symptom onset. Here we examined white matter diffusivity characteristics of the three cerebellar peduncles (CPs) based on diffusion MRI (dMRI) data collected from 41 children who stutter (CWS) and 42 controls in the 3-11 years range. We hypothesized that CWS would exhibit decreased fractional anisotropy (FA) in the right CPs given the contralateral connectivity of the cerebellar-cortical loops and past reports of structural differences in left cortical areas in stuttering speakers. Automatic Fiber Quantification (AFQ) was used to track and segment cerebellar white matter pathways and to extract diffusivity measures. We found significant group differences for FA in the right inferior CP (ICP) only: controls showed significantly higher FA in the right ventral ICP compared to CWS, controlling for age, sex, and verbal IQ. Furthermore, FA of right ICP was negatively correlated with stuttering frequency in CWS. These results suggest an early developmental difference in the right ICP for CWS compared to age-matched peers, which may indicate an alteration in error processing, a function previously linked to the ICP. Lower FA here may impact error monitoring and sensory input processing to guide motor corrections. Further longitudinal investigations in children may provide additional insights into how CP development links to stuttering persistence and recovery.

Delayed Auditory Feedback Elicits Specific Patterns of Serial Order Errors in a Paced Syllable Sequence Production Task

PURPOSE

Delayed auditory feedback (DAF) interferes with speech output. DAF causes distorted and disfluent productions and errors in the serial order of produced sounds. Although DAF has been studied extensively, the specific patterns of elicited speech errors are somewhat obscured by relatively small speech samples, differences across studies, and uncontrolled variables. The goal of this study was to characterize the types of serial order errors that increase under DAF in a systematic syllable sequence production task, which used a closed set of sounds and controlled for speech rate.

METHOD

Sixteen adult speakers repeatedly produced CVCVCV (C = consonant, V = vowel) sequences, paced to a "visual metronome," while hearing self-generated feedback with delays of 0-250 ms. Listeners transcribed recordings, and speech errors were classified based on the literature surrounding naturally occurring slips of the tongue. A series of mixed-effects models were used to assess the effects of delay for different error types, for error arrival time, and for speaking rate.

RESULTS

DAF had a significant effect on the overall error rate for delays of 100 ms or greater. Statistical models revealed significant effects (relative to zero delay) for vowel and syllable repetitions, vowel exchanges, vowel omissions, onset disfluencies, and distortions. Serial order errors were especially dominated by vowel and syllable repetitions. Errors occurred earlier on average within a trial for longer feedback delays. Although longer delays caused slower speech, this effect was mediated by the run number (time in the experiment) and small compared with those in previous studies.

CONCLUSIONS

DAF drives a specific pattern of serial order errors. The dominant pattern of vowel and syllable repetition errors suggests possible mechanisms whereby DAF drives changes to the activity in speech planning representations, yielding errors. These mechanisms are outlined with reference to the GODIVA (Gradient Order Directions Into Velocities of Articulators) model of speech planning and production.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.19601785.

Structural brain network topological alterations in stuttering adults

Persistent developmental stuttering is a speech disorder that primarily affects normal speech fluency but encompasses a complex set of symptoms ranging from reduced sensorimotor integration to socioemotional challenges. Here, we investigated the whole brain structural connectome and its topological alterations in adults who stutter. Diffusion weighted imaging data of 33 subjects (13 adults who stutter and 20 fluent speakers) was obtained along with a stuttering severity evaluation. The structural brain network properties were analyzed using Network-based statistics and graph theoretical measures particularly focusing on community structure, network hubs and controllability. Bayesian power estimation was used to assess the reliability of the structural connectivity differences by examining the effect size. The analysis revealed reliable and wide-spread decreases in connectivity for adults who stutter in regions associated with sensorimotor, cognitive, emotional, and memory-related functions. The community detection algorithms revealed different subnetworks for fluent speakers and adults who stutter, indicating considerable network adaptation in adults who stutter. Average and modal controllability differed between groups in a subnetwork encompassing frontal brain regions and parts of the basal ganglia.

The results revealed extensive structural network alterations and substantial adaptation in neural architecture in adults who stutter well beyond the sensorimotor network. These findings highlight the impact of the neurodevelopmental effects of persistent stuttering on neural organization and the importance of examining the full structural connectome and the network alterations that underscore the behavioral phenotype.

White matter correlates of sensorimotor synchronization in persistent developmental stuttering

INTRODUCTION

Individuals with persistent developmental stuttering display deficits in aligning motor actions to external cues (i.e., sensorimotor synchronization). Diffusion imaging studies point to stuttering-associated differences in dorsal, not ventral, white matter pathways, and in the cerebellar peduncles. Here, we studied microstructural white matter differences between adults who stutter (AWS) and fluent speakers using two complementary approaches to: (a) assess previously reported group differences in white matter diffusivity, and (b) evaluate the relationship between white matter diffusivity and sensorimotor synchronization in each group.

METHODS

Participants completed a sensorimotor synchronization task and a diffusion MRI scan. We identified the cerebellar peduncles and major dorsal- and ventral-stream language pathways in each individual and assessed correlations between sensorimotor synchronization and diffusion measures along the tracts.

RESULTS

The results demonstrated group differences in dorsal, not ventral, language tracts, in alignment with prior reports. Specifically, AWS had significantly lower fractional anisotropy (FA) in the left arcuate fasciculus, and significantly higher mean diffusivity (MD) in the bilateral frontal aslant tract compared to fluent speakers, while no significant group difference was detected in the inferior fronto-occipital fasciculus. We also found significant group differences in both FA and MD of the left middle cerebellar peduncle. Comparing patterns of association with sensorimotor synchronization revealed a novel double dissociation: MD within the left inferior cerebellar peduncle was significantly correlated with mean asynchrony in AWS but not in fluent speakers, while FA within the left arcuate fasciculus was significantly correlated with mean asynchrony in fluent speakers, but not in AWS.

CONCLUSIONS

Our results support the view that stuttering involves altered connectivity in dorsal tracts and that AWS may rely more heavily on cerebellar tracts to process timing information. Evaluating microstructural associations with sensitive behavioral measures provides a powerful tool for discovering additional functional differences in the underlying connectivity in AWS.

Intact Correction for Self-Produced Vowel Formant Variability in Individuals With Cerebellar Ataxia Regardless of Auditory Feedback Availability

Purpose Individuals with cerebellar ataxia (CA) caused by cerebellar degeneration exhibit larger reactive compensatory responses to unexpected auditory feedback perturbations than neurobiologically typical speakers, suggesting they may rely more on feedback control during speech. We test this hypothesis by examining variability in unaltered speech. Previous studies of typical speakers have demonstrated a reduction in formant variability (centering) observed during the initial phase of vowel production from vowel onset to vowel midpoint. Centering is hypothesized to reflect feedback-based corrections for self-produced variability and thus may provide a behavioral assay of feedback control in unperturbed speech in the same manner as the compensatory response does for feedback perturbations. Method To comprehensively compare centering in individuals with CA and controls, we examine centering in two vowels (/i/ and /ɛ/) under two contexts (isolated words and connected speech). As a control, we examine speech produced both with and without noise to mask auditory feedback. Results Individuals with CA do not show increased centering compared to age-matched controls, regardless of vowel, context, or masking. Contrary to previous results in neurobiologically typical speakers, centering was not affected by the presence of masking noise in either group. Conclusions The similar magnitude of centering seen with and without masking noise questions whether centering is driven by auditory feedback. However, if centering is at least partially driven by auditory/somatosensory feedback, these results indicate that the larger compensatory response to altered auditory feedback observed in individuals with CA may not reflect typical motor control processes during normal, unaltered speech production.

Responses to Auditory Feedback Manipulations in Speech May Be Affected by Previous Exposure to Auditory Errors

Purpose Speakers use auditory feedback to guide their speech output, although individuals differ in the magnitude of their compensatory response to perceived errors in feedback. Little is known about the factors that contribute to the compensatory response or how fixed or flexible they are within an individual. Here, we test whether manipulating the perceived reliability of auditory feedback modulates speakers' compensation to auditory perturbations, as predicted by optimal models of sensorimotor control. Method Forty participants produced monosyllabic words in two separate sessions, which differed in the auditory feedback given during an initial exposure phase. In the veridical session exposure phase, feedback was normal. In the noisy session exposure phase, small, random formant perturbations were applied, reducing reliability of auditory feedback. In each session, a subsequent test phase introduced larger unpredictable formant perturbations. We assessed whether the magnitude of within-trial compensation for these larger perturbations differed across the two sessions. Results Compensatory responses to downward (though not upward) formant perturbations were larger in the veridical session than the noisy session. However, in post hoc testing, we found the magnitude of this effect is highly dependent on the choice of analysis procedures. Compensation magnitude was not predicted by other production measures, such as formant variability, and was not reliably correlated across sessions. Conclusions Our results, though mixed, provide tentative support that the feedback control system monitors the reliability of sensory feedback. These results must be interpreted cautiously given the potentially limited stability of auditory feedback compensation measures across analysis choices and across sessions. Supplemental Material https://doi.org/10.23641/asha.14167136.

The Role of Sensory Feedback in Developmental Stuttering: A Review

Developmental stuttering is a neurodevelopmental disorder that severely affects speech fluency. Multiple lines of evidence point to a role of sensory feedback in the disorder; this has led to a number of theories proposing different disruptions to the use of sensory feedback during speech motor control in people who stutter. The purpose of this review was to bring together evidence from studies using altered auditory feedback paradigms with people who stutter, in order to evaluate the predictions of these different theories. This review highlights converging evidence for particular patterns of differences in the responses of people who stutter to feedback perturbations. The implications for hypotheses on the nature of the disruption to sensorimotor control of speech in the disorder are discussed, with reference to neurocomputational models of speech control (predominantly, the DIVA model; Guenther et al., 2006; Tourville et al., 2008). While some consistent patterns are emerging from this evidence, it is clear that more work in this area is needed with developmental samples in particular, in order to tease apart differences related to symptom onset from those related to compensatory strategies that develop with experience of stuttering.

Auditory Feedback Control of Vocal Pitch in Spasmodic Dysphonia

OBJECTIVES/HYPOTHESIS

Hearing plays an important role in the maintenance of vocal control in normal individuals. In patients with spasmodic dysphonia (SD), however, the ability to maintain sustained control of phonation is impaired. The origins of SD are unknown, and it is unclear whether auditory feedback-dependent vocal control is compromised in these patients.

STUDY DESIGN

Prospective case-control study.

METHODS

We tested 15 SD patients and 11 age-matched controls. Voice recordings were performed while subjects repeated the vowel /e/ and auditory feedback of their vocal sounds was altered in real-time to introduce a pitch-shift (±2 semitones), presented back to subjects using headphones. Recordings were analyzed to determine voice changes following the pitch-shifted feedback. Results were further compared with patient demographics and subjective measures of dysphonia, including the Voice Handicap Index (VHI).

RESULTS

Despite considerable pitch variability and vocal breaks, SD patients exhibited significantly higher average vocal pitch compensation than control subjects. SD patients also exhibited greater variability than controls. However, there were no significant correlations between vocal compensation and patient demographics, although there was a significant inverse correlation with VHI.

CONCLUSIONS

In this pilot study, patients with SD exhibited increased sensitivity to altered auditory feedback during sustained phonation. These results are consistent with recent theories of SD as a disorder of sensory-motor feedback processing, and suggest possible avenues for future investigation.

LEVEL OF EVIDENCE

3 Laryngoscope, 131:2070-2075, 2021.

Adaptation to pitch-altered feedback is independent of one's own voice pitch sensitivity

Monitoring voice pitch is a fine-tuned process in daily conversations as conveying accurately the linguistic and affective cues in a given utterance depends on the precise control of phonation and intonation. This monitoring is thought to depend on whether the error is treated as self-generated or externally-generated, resulting in either a correction or inflation of errors. The present study reports on two separate paradigms of adaptation to altered feedback to explore whether participants could behave in a more cohesive manner once the error is of comparable size perceptually. The vocal behavior of normal-hearing and fluent speakers was recorded in response to a personalized size of pitch shift versus a non-specific size, one semitone. The personalized size of shift was determined based on the just-noticeable difference in fundamental frequency (F0) of each participant’s voice. Here we show that both tasks successfully demonstrated opposing responses to a constant and predictable F0 perturbation (on from the production onset) but these effects barely carried over once the feedback was back to normal, depicting a pattern that bears some resemblance to compensatory responses. Experiencing a F0 shift that is perceived as self-generated (because it was precisely just-noticeable) is not enough to force speakers to behave more consistently and more homogeneously in an opposing manner. On the contrary, our results suggest that the type of the response as well as the magnitude of the response do not depend in any trivial way on the sensitivity of participants to their own voice pitch. Based on this finding, we speculate that error correction could possibly occur even with a bionic ear, typically even when F0 cues are too subtle for cochlear implant users to detect accurately.

Auditory-Motor Perturbations of Voice Fundamental Frequency: Feedback Delay and Amplification

Purpose Gradual and sudden perturbations of vocal fundamental frequency (f _o), also known as adaptive and reflexive f _o perturbations, are techniques to study the influence of auditory feedback on voice f _o control mechanisms. Previous vocal f _o perturbations have incorporated varied setup-specific feedback delays and amplifications. Here, we investigated the effects of feedback delays (10-100 ms) and amplifications on both adaptive and reflexive f _o perturbation paradigms, encapsulating the variability in equipment-specific delays (3-45 ms) and amplifications utilized in previous experiments. Method Responses to adaptive and reflexive f _o perturbations were recorded in 24 typical speakers for four delay conditions (10, 40, 70, and 100 ms) or three amplification conditions (-10, +5, and +10 dB relative to microphone) in a counterbalanced order. Repeated-measures analyses of variance were carried out on the magnitude of f _o responses to determine the effect of feedback condition. Results There was a statistically significant effect of the level of auditory feedback amplification on the response magnitude during adaptive f _o perturbations, driven by the difference between +10- and -10-dB amplification conditions (hold phase difference: M = 38.3 cents, SD = 51.2 cents; after-effect phase: M = 66.1 cents, SD = 84.6 cents). No other statistically significant effects of condition were found for either paradigm. Conclusions Experimental equipment delays below 100 ms in behavioral paradigms do not affect the results of f _o perturbation paradigms. As there is no statistically significant difference between the response magnitudes elicited by +5- and +10-dB auditory amplification conditions, this study is a confirmation that an auditory feedback amplification of +5 dB relative to microphone is sufficient to elicit robust compensatory responses for f _o perturbation paradigms.

Coarticulatory Aspects of the Fluent Speech of French and Italian People Who Stutter Under Altered Auditory Feedback

A number of studies have shown that phonetic peculiarities, especially at the coarticulation level, exist in the disfluent as well as in the perceptively fluent speech of people who stutter (PWS). However, results from fluent speech are very disparate and not easily interpretable. Are the coarticulatory features observed in fluent speech of PWS a manifestation of the disorder, or rather a compensation for the disorder itself? The purpose of the present study is to investigate the coarticulatory behavior in the fluent speech of PWS in the attempt to answer the question on its symptomatic or adaptive nature. In order to achieve this, we have studied the speech of 21 adult PWS (10 French and 11 Italian) compared to that of 20 fluent adults (10 French and 10 Italian). The participants had to repeat simple CV syllables in short carrier sentences, where C = /b, d, g/ and V = /a, i, u/. Crucially, this repetition task was performed in order to compare fluent speech coarticulation of PWS to that of PWNS, and to compare the coarticulation of PWS under a condition with normal auditory feedback (NAF) and under a fluency-enhancing condition due to an altered auditory feedback (AAF). This is the first study, to our knowledge, to investigate the coarticulation behavior under AAF. The degree of coarticulation was measured by means of the Locus Equations (LE). The coarticulation degree observed in fluent PWS speech is lower than that of the PWNS, and, more importantly, in AAF condition, PWS coarticulation appears even weaker than in the NAF condition. The results allow to interpret the lower degree of coarticulation found in fluent speech of PWS under NAF condition as a compensation for the disorder, based on the fact that PWS’s coarticulation is weakening in fluency-enhancing conditions, further away from the degree of coarticulation observed in PWNS. Since a lower degree of coarticulation is associated to a greater separation between the places of articulation of the consonant and the vowel, these results are compatible with the hypothesis that larger articulatory movements could be responsible for the stabilization of the PWS speech motor system, increasing the kinesthetic feedback from the effector system. This interpretation shares with a number of relatively recent proposal the idea that stuttering derives from an impaired feedforward (open-loop) control system, which makes PWS rely more heavily on a feedback-based (closed loop) motor control strategy.

It's About Time: Minimizing Hardware and Software Latencies in Speech Research With Real-Time Auditory Feedback

Purpose Various aspects of speech production related to auditory-motor integration and learning have been examined through auditory feedback perturbation paradigms in which participants' acoustic speech output is experimentally altered and played back via earphones/headphones "in real time." Scientific rigor requires high precision in determining and reporting the involved hardware and software latencies. Many reports in the literature, however, are not consistent with the minimum achievable latency for a given experimental setup. Here, we focus specifically on this methodological issue associated with implementing real-time auditory feedback perturbations, and we offer concrete suggestions for increased reproducibility in this particular line of work. Method Hardware and software latencies as well as total feedback loop latency were measured for formant perturbation studies with the Audapter software. Measurements were conducted for various audio interfaces, desktop and laptop computers, and audio drivers. An approach for lowering Audapter's software latency through nondefault parameter specification was also tested. Results Oft-overlooked hardware-specific latencies were not negligible for some of the tested audio interfaces (adding up to 15 ms). Total feedback loop latencies (including both hardware and software latency) were also generally larger than claimed in the literature. Nondefault parameter values can improve Audapter's own processing latency without negative impact on formant tracking. Conclusions Audio interface selection and software parameter optimization substantially affect total feedback loop latency. Thus, the actual total latency (hardware plus software) needs to be correctly measured and described in all published reports. Future speech research with "real-time" auditory feedback perturbations should increase scientific rigor by minimizing this latency.

Neural Correlates of Vocal Pitch Compensation in Individuals Who Stutter

Stuttering is a disorder that impacts the smooth flow of speech production and is associated with a deficit in sensorimotor integration. In a previous experiment, individuals who stutter were able to vocally compensate for pitch shifts in their auditory feedback, but they exhibited more variability in the timing of their corrective responses. In the current study, we focused on the neural correlates of the task using functional MRI. Participants produced a vowel sound in the scanner while hearing their own voice in real time through headphones. On some trials, the audio was shifted up or down in pitch, eliciting a corrective vocal response. Contrasting pitch-shifted vs. unshifted trials revealed bilateral superior temporal activation over all the participants. However, the groups differed in the activation of middle temporal gyrus and superior frontal gyrus [Brodmann area 10 (BA 10)], with individuals who stutter displaying deactivation while controls displayed activation. In addition to the standard univariate general linear modeling approach, we employed a data-driven technique (independent component analysis, or ICA) to separate task activity into functional networks. Among the networks most correlated with the experimental time course, there was a combined auditory-motor network in controls, but the two networks remained separable for individuals who stuttered. The decoupling of these networks may account for temporal variability in pitch compensation reported in our previous work, and supports the idea that neural network coherence is disturbed in the stuttering brain.

Theta Modulated Neural Phase Coherence Facilitates Speech Fluency in Adults Who Stutter

Adults who stutter (AWS) display altered patterns of neural phase coherence within the speech motor system preceding disfluencies. These altered patterns may distinguish fluent speech episodes from disfluent ones. Phase coherence is relevant to the study of stuttering because it reflects neural communication within brain networks. In this follow-up study, the oscillatory cortical dynamics preceding fluent speech in AWS and adults who do not stutter (AWNS) were examined during a single-word delayed reading task using electroencephalographic (EEG) techniques. Compared to AWNS, fluent speech preparation in AWS was characterized by a decrease in theta-gamma phase coherence and a corresponding increase in theta-beta coherence level. Higher spectral powers in the beta and gamma bands were also observed preceding fluent utterances by AWS. Overall, there was altered neural communication during speech planning in AWS that provides novel evidence for atypical allocation of feedforward control by AWS even before fluent utterances.

Adults who stutter and metronome synchronization: evidence for a nonspeech timing deficit

Speech timing deficits have been proposed as a causal factor in the disorder of stuttering. The question of whether individuals who stutter have deficits in nonspeech timing is one that has been revisited often, with conflicting results. Here, we uncover subtle differences in a manual metronome synchronization task that included tempo changes with adults who stutter and fluent speakers. We used sensitive circular statistics to examine both asynchrony and consistency in motor production. While both groups displayed a classic negative mean asynchrony (tapping before the beat), individuals who stutter anticipated the beat even more than their fluent peers, and their consistency was particularly affected at slow tempi. Surprisingly, individuals who stutter did not have problems with interval correction at tempo changes. We also examined the influence of music experience on synchronization behavior in both groups. While music perception and training were related to synchronization behavior in fluent participants, these correlations were not present for the stuttering group; however, one measure of stuttering severity (self-rated severity) was negatively correlated with music training. Overall, we found subtle differences in paced auditory-motor synchronization in individuals who stutter, consistent with a timing problem extending to nonspeech.