What does motor efference copy represent? Evidence from speech production

Somatosensory influence on auditory cortical response of self-generated sound

Motor execution which results in the generation of sounds attenuates the cortical response to these self-generated sounds. This attenuation has been explained as a result of motor relevant processing. The current study shows that corresponding somatosensory inputs can also change the auditory processing of a self-generated sound. We recorded auditory event-related potentials (ERP) in response to self-generated sounds and assessed how the amount of auditory attenuation changed according to the somatosensory inputs. The sound stimuli were generated by a finger movement that pressed on a virtual object, which was produced by a haptic robotic device. Somatosensory inputs were modulated by changing the stiffness of this virtual object (low and high) in an unpredictable manner. For comparison purposes, we carried out the same test with a computer keyboard, which is conventionally used to induce the auditory attenuation of self-generated sound. While N1 and P2 attenuations were clearly induced in the control condition with the keyboard as has been observed in previous studies, when using the robotic device the amplitude of N1 was found to vary according to the stiffness of the virtual object. The amplitude of N1 in the low stiffness condition was similar to that found using the keyboard for the same condition but not in the high stiffness condition. In addition, P2 attenuation did not differ between stiffness conditions. The waveforms of auditory ERP after 200 ms also differed according to the stiffness conditions. The estimated source of N1 attenuation was located in the right parietal area. These results suggest that somatosensory inputs during movement can modify the auditory processing of self-generated sound. The auditory processing of self-generated sound may represent self-referenced processing like an embodied process or an action-perception mechanism.

Gamma and Theta/Alpha-Band Oscillations in the Electroencephalogram Distinguish the Content of Inner Speech

Inner speech refers to the silent production of language in one's mind. As a purely mental action without obvious physical manifestations, inner speech has been notoriously difficult to quantify. To address this issue, the present study repurposed the phenomenon of speaking-induced suppression, wherein overt speech has been consistently shown to elicit reduced auditory evoked potentials compared with externally generated speech, as well as changes in oscillatory activity in gamma and theta frequency bands. Given the functional similarities between inner and overt speech, we used an established experimental protocol to investigate whether similar metrics could be used to distinguish the content of inner speech. Healthy participants (n = 129) produced an inner syllable at a precisely specified time. An audible syllable was concurrently presented which either matched or mismatched the content of the inner syllable. The results revealed that Match and Mismatch conditions could be differentiated on the basis of their evoked oscillations in the gamma, theta, and alpha bands. Notably, there was a gamma-band oscillation in the vicinity of the P2 that differed between the Match and Mismatch conditions, suggesting that "late" gamma-band activity may index consciously perceived expectancy violations, or cognitive prediction errors. Regarding the auditory evoked potentials, the N1 component was suppressed in the Match condition while the P2 component was suppressed in the Mismatch condition, replicating previous findings. This study provides support for the existence of "inner speaking-induced suppression", and demonstrates that inner syllables can be differentiated based on their influence on the electroencephalographic activity elicited by simultaneously-presented audible syllables.

The Brain's Sensitivity to Sensory Error Can Be Modulated by Altering Perceived Variability

When individuals make a movement that produces an unexpected outcome, they learn from the resulting error. This process, essential in both acquiring new motor skills and adapting to changing environments, critically relies on error sensitivity, which governs how much behavioral change results from a given error. Although behavioral and computational evidence suggests error sensitivity can change in response to task demands, neural evidence regarding the flexibility of error sensitivity in the human brain is lacking. Here, we tested whether the nervous system's sensitivity to errors, as measured by prediction-driven suppression of auditory cortical activity, can be modulated by altering participants' (both males and females) perceived variability during speech. Our results showed that error sensitivity, as measured by this suppression, was increased after exposure to an auditory perturbation that increased speakers' perceived variability. The current study establishes the validity of behaviorally modulating the nervous system's sensitivity to errors, which has significant potential to enhance motor learning and rehabilitation.

Multitasking Practice Eliminates Modality-Based Interference by Separating Task Representations in Sensory Brain Regions

The debate on the neural basis of multitasking costs evolves around neural overlap between concurrently performed tasks. Recent evidence suggests that training-related reductions in representational overlap in fronto-parietal brain regions predict multitasking improvements. Cognitive theories assume that overlap of task representations may lead to unintended information exchange between tasks (i.e., crosstalk). Modality-based crosstalk was suggested as a source for multitasking costs in multisensory settings. Robust findings of increased costs for certain modality mappings may be explained by crosstalk between the stimulus modality in one task and sensory action consequences in the concurrently performed task. Whether modality-based crosstalk emerges from representational overlap in general fronto-parietal multitasking regions or modality-specific regions is not known yet. In this functional neuroimaging study, we investigate neural overlap during multitasking performance in humans, focusing on modality compatibility by employing multivariate pattern analysis and modality-specific practice interventions in three groups (total N = 54, 24 females). We observed significant differences between modality compatible and modality incompatible single-task representations, specifically in the auditory cortex but not in fronto-parietal regions. Notably, improved auditory decoding accuracy related to modality incompatible tasks was predictive of performance gains in the corresponding dual task along with complete elimination of modality-specific dual-task costs. This predictive relationship was evident only in the group practicing modality incompatible mappings, suggesting that specific practice on task sets with modality overlap influenced both neural representations and subsequent multitasking performance. This study contributes to the integration of cognitive theory and neuroscience and the role of task representations in dual-task interference.

Brain imaging and electrophysiological markers of anaphoric reference during speech production

Pronouns create cohesive links in discourse by referring to previously mentioned elements. Here, we focus on pronominalization during speech production in three experiments employing ERP and fMRI methodologies. Participants were asked to produce two short sentences describing a man or woman using an object. In the second sentence, they were instructed to use a pronoun to refer to the same person and a noun to refer to a different person. The first ERP experiment revealed that noun conditions elicited more negative ERPs starting at 220 ms, with significant differences in early and later time windows, particularly in the left hemisphere. The second ERP experiment showed divergence at 280 ms, with significant differences between 300 and 400 ms at midline electrodes, again indicating more negative ERPs for nouns. The fMRI experiment identified greater activations for nouns than pronouns in regions like the superior temporal gyrus (STG) and cerebellar vermis, suggesting higher working memory load and lexical retrieval demands for nouns compared to pronouns. Moreover, pronouns elicited an enhanced centro-parietal positivity, indicating increased attentional demands. These findings suggest that while noun processing requires greater working memory and lexical retrieval, pronoun processing engages more attentional resources. This study advances our understanding of the neural mechanisms underlying pronominalization during speech production, highlighting distinct neural responses for nouns and pronouns.

Spatiotemporal Mapping of Auditory Onsets during Speech Production

The human auditory cortex is organized according to the timing and spectral characteristics of speech sounds during speech perception. During listening, the posterior superior temporal gyrus is organized according to onset responses, which segment acoustic boundaries in speech, and sustained responses, which further process phonological content. When we speak, the auditory system is actively processing the sound of our own voice to detect and correct speech errors in real time. This manifests in neural recordings as suppression of auditory responses during speech production compared with perception, but whether this differentially affects the onset and sustained temporal profiles is not known. Here, we investigated this question using intracranial EEG recorded from seventeen pediatric, adolescent, and adult patients with medication-resistant epilepsy while they performed a reading/listening task. We identified onset and sustained responses to speech in the bilateral auditory cortex and observed a selective suppression of onset responses during speech production. We conclude that onset responses provide a temporal landmark during speech perception that is redundant with forward prediction during speech production and are therefore suppressed. Phonological feature tuning in these "onset suppression" electrodes remained stable between perception and production. Notably, auditory onset responses and phonological feature tuning were present in the posterior insula during both speech perception and production, suggesting an anatomically and functionally separate auditory processing zone that we believe to be involved in multisensory integration during speech perception and feedback control.

Does pre-speech auditory modulation reflect processes related to feedback monitoring or speech movement planning?

Previous studies have revealed that auditory processing is modulated during the planning phase immediately prior to speech onset. To date, the functional relevance of this pre-speech auditory modulation (PSAM) remains unknown. Here, we investigated whether PSAM reflects neuronal processes that are associated with preparing auditory cortex for optimized feedback monitoring as reflected in online speech corrections. Combining electroencephalographic PSAM data from a previous data set with new acoustic measures of the same participants' speech, we asked whether individual speakers' extent of PSAM is correlated with the implementation of within-vowel articulatory adjustments during /b/-vowel-/d/ word productions. Online articulatory adjustments were quantified as the extent of change in inter-trial formant variability from vowel onset to vowel midpoint (a phenomenon known as centering). This approach allowed us to also consider inter-trial variability in formant production, and its possible relation to PSAM, at vowel onset and midpoint separately. Results showed that inter-trial formant variability was significantly smaller at vowel midpoint than at vowel onset. PSAM was not significantly correlated with this amount of change in variability as an index of within-vowel adjustments. Surprisingly, PSAM was negatively correlated with inter-trial formant variability not only in the middle but also at the very onset of the vowels. Thus, speakers with more PSAM produced formants that were already less variable at vowel onset. Findings suggest that PSAM may reflect processes that influence speech acoustics as early as vowel onset and, thus, that are directly involved in motor command preparation (feedforward control) rather than output monitoring (feedback control).

Vocal control and speech production in cochlear implant listeners: A review within auditory-motor processing framework

A comprehensive literature review is conducted to summarize and discuss prior findings on how cochlear implants (CI) affect the users' abilities to produce and control vocal and articulatory movements within the auditory-motor integration framework of speech. Patterns of speech production pre- versus post-implantation, post-implantation adjustments, deviations from the typical ranges of speakers with normal hearing (NH), the effects of switching the CI on and off, as well as the impact of altered auditory feedback on vocal and articulatory speech control are discussed. Overall, findings indicate that CIs enhance the vocal and articulatory control aspects of speech production at both segmental and suprasegmental levels. While many CI users achieve speech quality comparable to NH individuals, some features still deviate in a group of CI users even years post-implantation. More specifically, contracted vowel space, increased vocal jitter and shimmer, longer phoneme and utterance durations, shorter voice onset time, decreased contrast in fricative production, limited prosodic patterns, and reduced intelligibility have been reported in subgroups of CI users compared to NH individuals. Significant individual variations among CI users have been observed in both the pace of speech production adjustments and long-term speech outcomes. Few controlled studies have explored how the implantation age and the duration of CI use influence speech features, leaving substantial gaps in our understanding about the effects of spectral resolution, auditory rehabilitation, and individual auditory-motor processing abilities on vocal and articulatory speech outcomes in CI users. Future studies under the auditory-motor integration framework are warranted to determine how suboptimal CI auditory feedback impacts auditory-motor processing and precise vocal and articulatory control in CI users.

Linking actions and memories: Probing the interplay of action-effect congruency, agency experience, and recognition memory

Adult humans experience agency when their action causes certain events (sense of agency). Moreover, they can later remember what these events were (memory). Here, we investigate how the relationship between actions and events shapes agency experience and memory for the corresponding events. Participants performed actions that produced stimuli that were either congruent or incongruent to the action while memory of these stimuli was probed in a recognition test. Additionally, predictability of the effect was manipulated in Experiment 1 by using either randomly interleaved or blocked ordering of action-congruent and action-incongruent events. In Experiment 2, the size of the action space was manipulated by allowing participants to choose between three or six possible responses. The results indicated a heightened sense of agency following congruent compared to incongruent trials, with this effect being increased given a larger available action space, as well as a greater sense of agency given higher predictability of the effect. Recognition memory was better for stimuli presented in congruent compared to incongruent trials, with no discernible effects of effect predictability or the size of the action space. The results point towards a joint influence of predictive and postdictive processes on agency experience and suggest a link between control and memory. The partial dissociation of influences on agency experience and memory cast doubt on a mediating role of agency experience on the relationship between action-effect congruency and memory. Theoretical accounts for this relationship are discussed.

Neurophysiological evidence of sensory prediction errors driving speech sensorimotor adaptation

The human sensorimotor system has a remarkable ability to quickly and efficiently learn movements from sensory experience. A prominent example is sensorimotor adaptation, learning that characterizes the sensorimotor system's response to persistent sensory errors by adjusting future movements to compensate for those errors. Despite being essential for maintaining and fine-tuning motor control, mechanisms underlying sensorimotor adaptation remain unclear. A component of sensorimotor adaptation is implicit (i.e., the learner is unaware of the learning process) which has been suggested to result from sensory prediction errors-the discrepancies between predicted sensory consequences of motor commands and actual sensory feedback. However, to date no direct neurophysiological evidence that sensory prediction errors drive adaptation has been demonstrated. Here, we examined prediction errors via magnetoencephalography (MEG) imaging of the auditory cortex (n = 34) during sensorimotor adaptation of speech to altered auditory feedback, an entirely implicit adaptation task. Specifically, we measured how speaking-induced suppression (SIS)--a neural representation of auditory prediction errors--changed over the trials of the adaptation experiment. SIS refers to the suppression of auditory cortical response to speech onset (in particular, the M100 response) to self-produced speech when compared to the response to passive listening to identical playback of that speech. SIS was reduced (reflecting larger prediction errors) during the early learning phase compared to the initial unaltered feedback phase. Furthermore, reduction in SIS positively correlated with behavioral adaptation extents, suggesting that larger prediction errors were associated with more learning. In contrast, such a reduction in SIS was not found in a control experiment in which participants heard unaltered feedback and thus did not adapt. In addition, in some participants who reached a plateau in the late learning phase, SIS increased (reflecting smaller prediction errors), demonstrating that prediction errors were minimal when there was no further adaptation. Together, these findings provide the first neurophysiological evidence for the hypothesis that prediction errors drive human sensorimotor adaptation.

Speech-induced suppression and vocal feedback sensitivity in human cortex

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Why motor imagery is not really motoric: towards a re-conceptualization in terms of effect-based action control

Overt and imagined action seem inextricably linked. Both have similar timing, activate shared brain circuits, and motor imagery influences overt action and vice versa. Motor imagery is, therefore, often assumed to recruit the same motor processes that govern action execution, and which allow one to play through or simulate actions offline. Here, we advance a very different conceptualization. Accordingly, the links between imagery and overt action do not arise because action imagery is intrinsically motoric, but because action planning is intrinsically imaginistic and occurs in terms of the perceptual effects one want to achieve. Seen like this, the term 'motor imagery' is a misnomer of what is more appropriately portrayed as 'effect imagery'. In this article, we review the long-standing arguments for effect-based accounts of action, which are often ignored in motor imagery research. We show that such views provide a straightforward account of motor imagery. We review the evidence for imagery-execution overlaps through this new lens and argue that they indeed emerge because every action we execute is planned, initiated and controlled through an imagery-like process. We highlight findings that this new view can now explain and point out open questions.

Pitch corrections occur in natural speech and are abnormal in patients with Alzheimer's disease

Past studies have explored formant centering, a corrective behavior of convergence over the duration of an utterance toward the formants of a putative target vowel. In this study, we establish the existence of a similar centering phenomenon for pitch in healthy elderly controls and examine how such corrective behavior is altered in Alzheimer's Disease (AD). We found the pitch centering response in healthy elderly was similar when correcting pitch errors below and above the target (median) pitch. In contrast, patients with AD showed an asymmetry with a larger correction for the pitch errors below the target phonation than above the target phonation. These findings indicate that pitch centering is a robust compensation behavior in human speech. Our findings also explore the potential impacts on pitch centering from neurodegenerative processes impacting speech in AD.

Audiomotor prediction errors drive speech adaptation even in the absence of overt movement

Observed outcomes of our movements sometimes differ from our expectations. These sensory prediction errors recalibrate the brain's internal models for motor control, reflected in alterations to subsequent movements that counteract these errors (motor adaptation). While leading theories suggest that all forms of motor adaptation are driven by learning from sensory prediction errors, dominant models of speech adaptation argue that adaptation results from integrating time-advanced copies of corrective feedback commands into feedforward motor programs. Here, we tested these competing theories of speech adaptation by inducing planned, but not executed, speech. Human speakers (male and female) were prompted to speak a word and, on a subset of trials, were rapidly cued to withhold the prompted speech. On standard trials, speakers were exposed to real-time playback of their own speech with an auditory perturbation of the first formant to induce single-trial speech adaptation. Speakers experienced a similar sensory error on movement cancelation trials, hearing a perturbation applied to a recording of their speech from a previous trial at the time they would have spoken. Speakers adapted to auditory prediction errors in both contexts, altering the spectral content of spoken vowels to counteract formant perturbations even when no actual movement coincided with the perturbed feedback. These results build upon recent findings in reaching, and suggest that prediction errors, rather than corrective motor commands, drive adaptation in speech.

Does pre-speech auditory modulation reflect processes related to feedback monitoring or speech movement planning?

Previous studies have revealed that auditory processing is modulated during the planning phase immediately prior to speech onset. To date, the functional relevance of this pre-speech auditory modulation (PSAM) remains unknown. Here, we investigated whether PSAM reflects neuronal processes that are associated with preparing auditory cortex for optimized feedback monitoring as reflected in online speech corrections. Combining electroencephalographic PSAM data from a previous data set with new acoustic measures of the same participants' speech, we asked whether individual speakers' extent of PSAM is correlated with the implementation of within-vowel articulatory adjustments during /b/-vowel-/d/ word productions. Online articulatory adjustments were quantified as the extent of change in inter-trial formant variability from vowel onset to vowel midpoint (a phenomenon known as centering). This approach allowed us to also consider inter-trial variability in formant production and its possible relation to PSAM at vowel onset and midpoint separately. Results showed that inter-trial formant variability was significantly smaller at vowel midpoint than at vowel onset. PSAM was not significantly correlated with this amount of change in variability as an index of within-vowel adjustments. Surprisingly, PSAM was negatively correlated with inter-trial formant variability not only in the middle but also at the very onset of the vowels. Thus, speakers with more PSAM produced formants that were already less variable at vowel onset. Findings suggest that PSAM may reflect processes that influence speech acoustics as early as vowel onset and, thus, that are directly involved in motor command preparation (feedforward control) rather than output monitoring (feedback control).

Speech-induced suppression and vocal feedback sensitivity in human cortex

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Pars Opercularis Underlies Efferent Predictions and Successful Auditory Feedback Processing in Speech: Evidence From Left-Hemisphere Stroke

Hearing one's own speech allows for acoustic self-monitoring in real time. Left-hemisphere motor planning regions are thought to give rise to efferent predictions that can be compared to true feedback in sensory cortices, resulting in neural suppression commensurate with the degree of overlap between predicted and actual sensations. Sensory prediction errors thus serve as a possible mechanism of detection of deviant speech sounds, which can then feed back into corrective action, allowing for online control of speech acoustics. The goal of this study was to assess the integrity of this detection-correction circuit in persons with aphasia (PWA) whose left-hemisphere lesions may limit their ability to control variability in speech output. We recorded magnetoencephalography (MEG) while 15 PWA and age-matched controls spoke monosyllabic words and listened to playback of their utterances. From this, we measured speaking-induced suppression of the M100 neural response and related it to lesion profiles and speech behavior. Both speaking-induced suppression and cortical sensitivity to deviance were preserved at the group level in PWA. PWA with more spared tissue in pars opercularis had greater left-hemisphere neural suppression and greater behavioral correction of acoustically deviant pronunciations, whereas sparing of superior temporal gyrus was not related to neural suppression or acoustic behavior. In turn, PWA who made greater corrections had fewer overt speech errors in the MEG task. Thus, the motor planning regions that generate the efferent prediction are integral to performing corrections when that prediction is violated.

Movement-related cortical potential and speech-induced suppression during speech production in younger and older adults

With age, the speech system undergoes important changes that render speech production more laborious, slower and often less intelligible. And yet, the neural mechanisms that underlie these age-related changes remain unclear. In this EEG study, we examined two important mechanisms in speech motor control: pre-speech movement-related cortical potential (MRCP), which reflects speech motor planning, and speaking-induced suppression (SIS), which indexes auditory predictions of speech motor commands, in 20 healthy young and 20 healthy older adults. Participants undertook a vowel production task which was followed by passive listening of their own recorded vowels. Our results revealed extensive differences in MRCP in older compared to younger adults. Further, while longer latencies were observed in older adults on N1 and P2, in contrast, the SIS was preserved. The observed reduced MRCP appears as a potential explanatory mechanism for the known age-related slowing of speech production, while preserved SIS suggests intact motor-to-auditory integration.

Processing of auditory feedback in perisylvian and insular cortex

When we speak, we not only make movements with our mouth, lips, and tongue, but we also hear the sound of our own voice. Thus, speech production in the brain involves not only controlling the movements we make, but also auditory and sensory feedback. Auditory responses are typically suppressed during speech production compared to perception, but how this manifests across space and time is unclear. Here we recorded intracranial EEG in seventeen pediatric, adolescent, and adult patients with medication-resistant epilepsy who performed a reading/listening task to investigate how other auditory responses are modulated during speech production. We identified onset and sustained responses to speech in bilateral auditory cortex, with a selective suppression of onset responses during speech production. Onset responses provide a temporal landmark during speech perception that is redundant with forward prediction during speech production. Phonological feature tuning in these "onset suppression" electrodes remained stable between perception and production. Notably, the posterior insula responded at sentence onset for both perception and production, suggesting a role in multisensory integration during feedback control.

Multiple processes of vocal sensory-motor interaction in primate auditory cortex

Sensory-motor interactions in the auditory system play an important role in vocal self-monitoring and control. These result from top-down corollary discharges, relaying predictions about vocal timing and acoustics. Recent evidence suggests such signals may be two distinct processes, one suppressing neural activity during vocalization and another enhancing sensitivity to sensory feedback, rather than a single mechanism. Single-neuron recordings have been unable to disambiguate due to overlap of motor signals with sensory inputs. Here, we sought to disentangle these processes in marmoset auditory cortex during production of multi-phrased 'twitter' vocalizations. Temporal responses revealed two timescales of vocal suppression: temporally-precise phasic suppression during phrases and sustained tonic suppression. Both components were present within individual neurons, however, phasic suppression presented broadly regardless of frequency tuning (gating), while tonic was selective for vocal frequencies and feedback (prediction). This suggests that auditory cortex is modulated by concurrent corollary discharges during vocalization, with different computational mechanisms.

A randomised controlled trial investigating the causal role of the medial prefrontal cortex in mediating self-agency during speech monitoring and reality monitoring

Self-agency is the awareness of being the agent of one's own thoughts and actions. Self-agency is essential for interacting with the outside world (reality-monitoring). The medial prefrontal cortex (mPFC) is thought to be one neural correlate of self-agency. We investigated whether mPFC activity can causally modulate self-agency on two different tasks of speech-monitoring and reality-monitoring. The experience of self-agency is thought to result from making reliable predictions about the expected outcomes of one's own actions. This self-prediction ability is necessary for the encoding and memory retrieval of one's own thoughts during reality-monitoring to enable accurate judgments of self-agency. This self-prediction ability is also necessary for speech-monitoring where speakers consistently compare auditory feedback (what we hear ourselves say) with what we expect to hear while speaking. In this study, 30 healthy participants are assigned to either 10 Hz repetitive transcranial magnetic stimulation (rTMS) to enhance mPFC excitability (N = 15) or 10 Hz rTMS targeting a distal temporoparietal site (N = 15). High-frequency rTMS to mPFC enhanced self-predictions during speech-monitoring that predicted improved self-agency judgments during reality-monitoring. This is the first study to provide robust evidence for mPFC underlying a causal role in self-agency, that results from the fundamental ability of improving self-predictions across two different tasks.

Discrimination and sensorimotor adaptation of self-produced vowels in cochlear implant users

Humans rely on auditory feedback to monitor and adjust their speech for clarity. Cochlear implants (CIs) have helped over a million people restore access to auditory feedback, which significantly improves speech production. However, there is substantial variability in outcomes. This study investigates the extent to which CI users can use their auditory feedback to detect self-produced sensory errors and make adjustments to their speech, given the coarse spectral resolution provided by their implants. First, we used an auditory discrimination task to assess the sensitivity of CI users to small differences in formant frequencies of their self-produced vowels. Then, CI users produced words with altered auditory feedback in order to assess sensorimotor adaptation to auditory error. Almost half of the CI users tested can detect small, within-channel differences in their self-produced vowels, and they can utilize this auditory feedback towards speech adaptation. An acoustic hearing control group showed better sensitivity to the shifts in vowels, even in CI-simulated speech, and elicited more robust speech adaptation behavior than the CI users. Nevertheless, this study confirms that CI users can compensate for sensory errors in their speech and supports the idea that sensitivity to these errors may relate to variability in production.

When direction matters: Neural correlates of interlimb coordination of rhythm and beat

In a previous experiment, we found evidence for a bodily hierarchy governing interlimb coordination of rhythm and beat, using five effectors: 1) Left foot, 2) Right foot, 3) Left hand, 4) Right hand and 5) Voice. The hierarchy implies that, during simultaneous rhythm and beat performance and using combinations of two of these effectors, executing the task by performing the rhythm with an effector that has a higher number than the beat effector is significantly easier than vice versa. To investigate the neural underpinnings of this proposed bodily hierarchy, we here scanned 46 professional musicians using fMRI as they performed a rhythmic pattern with one effector while keeping the beat with another. The conditions combined the voice and the right hand (V + RH), the right hand and the left hand (RH + LH), and the left hand and the right foot (LH + RF). Each effector combination was performed with and against the bodily hierarchy. Going against the bodily hierarchy increased tapping errors significantly and also increased activity in key brain areas functionally associated with top-down sensorimotor control and bottom-up feedback processing, such as the cerebellum and SMA. Conversely, going with the bodily hierarchy engaged areas functionally associated with the default mode network and regions involved in emotion processing. Theories of general brain function that hold prediction as a key principle, propose that action and perception are governed by the brain's attempt to minimise prediction error at different levels in the brain. Following this viewpoint, our results indicate that going against the hierarchy induces stronger prediction errors, while going with the hierarchy allows for a higher degree of automatization. Our results also support the notion of a bodily hierarchy in motor control that prioritizes certain conductive and supportive tapping roles in specific effector combinations.

Causal role of medial superior frontal cortex on enhancing neural information flow and self-agency judgments in the self-agency network

Self-agency is being aware of oneself as the agent of one's thoughts and actions. Self-agency is necessary for successful interactions with the outside world (reality-monitoring). Prior research has shown that the medial superior prefrontal gyri (mPFC/SFG) may represent one neural correlate underlying self-agency judgments. However, the causal relationship remains unknown. Here, we applied high-frequency 10Hz repetitive transcranial magnetic stimulation (rTMS) to modulate the excitability of the mPFC/SFG site that we have previously shown to mediate self-agency. For the first time, we delineate causal neural mechanisms, revealing precisely how rTMS modulates SFG excitability and impacts directional neural information flow in the self-agency network by implementing innovative magnetoencephalography (MEG) phase-transfer entropy (PTE) metrics, measured from pre-to-post rTMS. We found that, compared to control rTMS, enhancing SFG excitability by rTMS induced significant increases in information flow between SFG and specific cingulate and paracentral regions in the self-agency network in delta-theta, alpha, and gamma bands, which predicted improved self-agency judgments. This is the first multimodal imaging study in which we implement MEG PTE metrics of 5D imaging of space, frequency and time, to provide cutting-edge analyses of the causal neural mechanisms of how rTMS enhances SFG excitability and improves neural information flow between distinct regions in the self-agency network to potentiate improved self-agency judgments. Our findings provide a novel perspective for investigating causal neural mechanisms underlying self-agency and create a path towards developing novel neuromodulation interventions to improve self-agency that will be particularly useful for patients with psychosis who exhibit severe impairments in self-agency.

On the interplay between speech perception and production: insights from research and theories

The study of spoken communication has long been entrenched in a debate surrounding the interdependence of speech production and perception. This mini review summarizes findings from prior studies to elucidate the reciprocal relationships between speech production and perception. We also discuss key theoretical perspectives relevant to speech perception-production loop, including hyper-articulation and hypo-articulation (H&H) theory, speech motor theory, direct realism theory, articulatory phonology, the Directions into Velocities of Articulators (DIVA) and Gradient Order DIVA (GODIVA) models, and predictive coding. Building on prior findings, we propose a revised auditory-motor integration model of speech and provide insights for future research in speech perception and production, focusing on the effects of impaired peripheral auditory systems.

Neurophysiological evidence of motor preparation in inner speech and the effect of content predictability

Self-generated overt actions are preceded by a slow negativity as measured by electroencephalogram, which has been associated with motor preparation. Recent studies have shown that this neural activity is modulated by the predictability of action outcomes. It is unclear whether inner speech is also preceded by a motor-related negativity and influenced by the same factor. In three experiments, we compared the contingent negative variation elicited in a cue paradigm in an active vs. passive condition. In Experiment 1, participants produced an inner phoneme, at which an audible phoneme whose identity was unpredictable was concurrently presented. We found that while passive listening elicited a late contingent negative variation, inner speech production generated a more negative late contingent negative variation. In Experiment 2, the same pattern of results was found when participants were instead asked to overtly vocalize the phoneme. In Experiment 3, the identity of the audible phoneme was made predictable by establishing probabilistic expectations. We observed a smaller late contingent negative variation in the inner speech condition when the identity of the audible phoneme was predictable, but not in the passive condition. These findings suggest that inner speech is associated with motor preparatory activity that may also represent the predicted action-effects of covert actions.

Speaker-induced Suppression in EEG during a Naturalistic Reading and Listening Task

Speaking elicits a suppressed neural response when compared with listening to others' speech, a phenomenon known as speaker-induced suppression (SIS). Previous research has focused on investigating SIS at constrained levels of linguistic representation, such as the individual phoneme and word level. Here, we present scalp EEG data from a dual speech perception and production task where participants read sentences aloud then listened to playback of themselves reading those sentences. Playback was separated into immediate repetition of the previous trial and randomized repetition of a former trial to investigate if forward modeling of responses during passive listening suppresses the neural response. Concurrent EMG was recorded to control for movement artifact during speech production. In line with previous research, ERP analyses at the sentence level demonstrated suppression of early auditory components of the EEG for production compared with perception. To evaluate whether linguistic abstractions (in the form of phonological feature tuning) are suppressed during speech production alongside lower-level acoustic information, we fit linear encoding models that predicted scalp EEG based on phonological features, EMG activity, and task condition. We found that phonological features were encoded similarly between production and perception. However, this similarity was only observed when controlling for movement by using the EMG response as an additional regressor. Our results suggest that SIS operates at a sensory representational level and is dissociated from higher order cognitive and linguistic processing that takes place during speech perception and production. We also detail some important considerations when analyzing EEG during continuous speech production.

A randomised controlled trial investigating the causal role of the medial prefrontal cortex in mediating self-agency during speech monitoring and reality monitoring

Self-agency is being aware of oneself as the agent of one's thoughts and actions. Self agency is necessary for successful interactions with the external world (reality-monitoring). The medial prefrontal cortex (mPFC) is considered to represent one neural correlate underlying self-agency. We investigated whether mPFC activity can causally modulate self-agency on two different tasks involving speech-monitoring and reality-monitoring. The experience of self-agency is thought to result from being able to reliably predict the sensory outcomes of one's own actions. This self-prediction ability is necessary for successfully encoding and recalling one's own thoughts to enable accurate self-agency judgments during reality-monitoring tasks. This self-prediction ability is also necessary during speech-monitoring tasks where speakers compare what we hear ourselves say in auditory feedback with what we predict we will hear while speaking. In this randomised-controlled study, heathy controls (HC) are assigned to either high-frequency transcranial magnetic stimulation (TMS) to enhance mPFC excitability or TMS targeting a control site. After TMS to mPFC, HC improved self-predictions during speech-monitoring tasks that predicted improved self-agency judgments during different reality-monitoring tasks. These first-in-kind findings demonstrate the mechanisms of how mPFC plays a causal role in self-agency that results from the fundamental ability of improving self-predictions across two different tasks.

DIVA Meets EEG: Model Validation Using Formant-Shift Reflex

The neurocomputational model 'Directions into Velocities of Articulators' (DIVA) was developed to account for various aspects of normal and disordered speech production and acquisition. The neural substrates of DIVA were established through functional magnetic resonance imaging (fMRI), providing physiological validation of the model. This study introduces DIVA_EEG an extension of DIVA that utilizes electroencephalography (EEG) to leverage the high temporal resolution and broad availability of EEG over fMRI. For the development of DIVA_EEG, EEG-like signals were derived from original equations describing the activity of the different DIVA maps. Synthetic EEG associated with the utterance of syllables was generated when both unperturbed and perturbed auditory feedback (first formant perturbations) were simulated. The cortical activation maps derived from synthetic EEG closely resembled those of the original DIVA model. To validate DIVA_EEG, the EEG of individuals with typical voices (N = 30) was acquired during an altered auditory feedback paradigm. The resulting empirical brain activity maps significantly overlapped with those predicted by DIVA_EEG. In conjunction with other recent model extensions, DIVA_EEG lays the foundations for constructing a complete neurocomputational framework to tackle vocal and speech disorders, which can guide model-driven personalized interventions.

Impaired Speaking-Induced Suppression in Alzheimer's Disease

Alzheimer's disease (AD) is a neurodegenerative disease involving cognitive impairment and abnormalities in speech and language. Here, we examine how AD affects the fidelity of auditory feedback predictions during speaking. We focus on the phenomenon of speaking-induced suppression (SIS), the auditory cortical responses' suppression during auditory feedback processing. SIS is determined by subtracting the magnitude of auditory cortical responses during speaking from listening to playback of the same speech. Our state feedback control (SFC) model of speech motor control explains SIS as arising from the onset of auditory feedback matching a prediction of that feedback onset during speaking, a prediction that is absent during passive listening to playback of the auditory feedback. Our model hypothesizes that the auditory cortical response to auditory feedback reflects the mismatch with the prediction: small during speaking, large during listening, with the difference being SIS. Normally, during speaking, auditory feedback matches its predictions, then SIS will be large. Any reductions in SIS will indicate inaccuracy in auditory feedback prediction not matching the actual feedback. We investigated SIS in AD patients [n = 20; mean (SD) age, 60.77 (10.04); female (%), 55.00] and healthy controls [n = 12; mean (SD) age, 63.68 (6.07); female (%), 83.33] through magnetoencephalography (MEG)-based functional imaging. We found a significant reduction in SIS at ∼100 ms in AD patients compared with healthy controls (linear mixed effects model, F (1,57.5) = 6.849, p = 0.011). The results suggest that AD patients generate inaccurate auditory feedback predictions, contributing to abnormalities in AD speech.

Modeling Responses to Auditory Feedback Perturbations in Adults, Children, and Children With Complex Speech Sound Disorders: Evidence for Impaired Auditory Self-Monitoring?

PURPOSE

Previous studies have found that typically developing (TD) children were able to compensate and adapt to auditory feedback perturbations to a similar or larger degree compared to young adults, while children with speech sound disorder (SSD) were found to produce predominantly following responses. However, large individual differences lie underneath the group-level results. This study investigates possible mechanisms in responses to formant shifts by modeling parameters of feedback and feedforward control of speech production based on behavioral data.

METHOD

SimpleDIVA was used to model an existing dataset of compensation/adaptation behavior to auditory feedback perturbations collected from three groups of Dutch speakers: 50 young adults, twenty-three 4- to 8-year-old children with TD speech, and seven 4- to 8-year-old children with SSD. Between-groups and individual within-group differences in model outcome measures representing auditory and somatosensory feedback control gain and feedforward learning rate were assessed.

RESULTS

Notable between-groups and within-group variation was found for all outcome measures. Data modeled for individual speakers yielded model fits with varying reliability. Auditory feedback control gain was negative in children with SSD and positive in both other groups. Somatosensory feedback control gain was negative for both groups of children and marginally negative for adults. Feedforward learning rate measures were highest in the children with TD speech followed by children with SSD, compared to adults.

CONCLUSIONS

The SimpleDIVA model was able to account for responses to the perturbation of auditory feedback other than corrective, as negative auditory feedback control gains were associated with following responses to vowel shifts. These preliminary findings are suggestive of impaired auditory self-monitoring in children with complex SSD. Possible mechanisms underlying the nature of following responses are discussed.

Effects of Cortical Stimulation on Feedback-Dependent Vocal Control in Non-Human Primates

OBJECTIVES

Hearing plays an important role in our ability to control voice, and perturbations in auditory feedback result in compensatory changes in vocal production. The auditory cortex (AC) has been proposed as an important mediator of this behavior, but causal evidence is lacking. We tested this in an animal model, hypothesizing that AC is necessary for vocal self-monitoring and feedback-dependent control, and that altering activity in AC during vocalization will interfere with vocal control.

METHODS

We implanted two marmoset monkeys (Callithrix jacchus) with bilateral AC electrode arrays. Acoustic signals were recorded from vocalizing marmosets while altering vocal feedback or electrically stimulating AC during random subsets of vocalizations. Feedback was altered by real-time frequency shifts and presented through headphones and electrical stimulation delivered to individual electrodes. We analyzed recordings to measure changes in vocal acoustics during shifted feedback and stimulation, and to determine their interaction. Results were correlated with the location and frequency tuning of stimulation sites.

RESULTS

Consistent with previous results, we found electrical stimulation alone evoked changes in vocal production. Results were stronger in the right hemisphere, but decreased with lower currents or repeated stimulation. Simultaneous stimulation and shifted feedback significantly altered vocal control for a subset of sites, decreasing feedback compensation at some and increasing it at others. Inhibited compensation was more likely at sites closer to vocal frequencies.

CONCLUSIONS

Results provide causal evidence that the AC is involved in feedback-dependent vocal control, and that it is sufficient and may also be necessary to drive changes in vocal production.

LEVEL OF EVIDENCE

N/A Laryngoscope, 133:1-10, 2023.

How the conception of control influences our understanding of actions

Wilful movement requires neural control. Commonly, neural computations are thought to generate motor commands that bring the musculoskeletal system - that is, the plant - from its current physical state into a desired physical state. The current state can be estimated from past motor commands and from sensory information. Modelling movement on the basis of this concept of plant control strives to explain behaviour by identifying the computational principles for control signals that can reproduce the observed features of movements. From an alternative perspective, movements emerge in a dynamically coupled agent-environment system from the pursuit of subjective perceptual goals. Modelling movement on the basis of this concept of perceptual control aims to identify the controlled percepts and their coupling rules that can give rise to the observed characteristics of behaviour. In this Perspective, we discuss a broad spectrum of approaches to modelling human motor control and their notions of control signals, internal models, handling of sensory feedback delays and learning. We focus on the influence that the plant control and the perceptual control perspective may have on decisions when modelling empirical data, which may in turn shape our understanding of actions.

Learning and change in a dual lexicon model of speech production

Speech motor processes and phonological forms influence one another because speech and language are acquired and used together. This hypothesis underpins the Computational Core (CC) model, which provides a framework for understanding the limitations of perceptually-driven changes to production. The model assumes a lexicon of motor and perceptual wordforms linked to concepts and whole-word production based on these forms. Motor wordforms are built up with speech practice. Perceptual wordforms encode ambient language patterns in detail. Speech production is the integration of the two forms. Integration results in an output trajectory through perceptual-motor space that guides articulation. Assuming successful communication of the intended concept, the output trajectory is incorporated into the existing motor wordform for that concept. Novel word production exploits existing motor wordforms to define a perceptually-acceptable path through motor space that is further modified by the perceptual wordform during integration. Simulation results show that, by preserving a distinction between motor and perceptual wordforms in the lexicon, the CC model can account for practice-based changes in the production of known words and for the effect of expressive vocabulary size on production accuracy of novel words.

Obsessive-Compulsive Disorder from an Embodied Cognition Perspective

Obsessive Compulsive Disorder (OCD) is characterized by problems of control over behavior and cognition. Although almost all of the studies on pathogenesis of OCD point out fronto-striatal dysfunction, it is still not possible to reveal mechanisms to explain the entire clinical course of OCD through these circuits. A more holistic explanation can be given through the Embodied Cognition (EC) perspective, which suggests that the alteration/dysfunction of low-level sensory-motor process may appear as a multifarious extent of dysfunction of high-level cognitive processes. Fronto-striatal circuits play fundamental role in behavioral control. These circuits also have a central role for the feed-forward motor control (FFMC). In FFMC, the internal model of movement is driven by efference copies as templates for motor behavior, without being adjusted by sensory information. If impairment of low-level sensory-motor processing is crucial to occurrence of compulsions, one possible hypothesis about this impairment is the problem which emerges from occurrence of efference copy in FFMC. On the other hand, the efference copy has also pivotal role for subject's feeling of the agency of an action. Therefore, there may be role of failure in successfully reproduction of the efference copy in the background of subjects' experience of losing control on compulsive behaviors. In this paper, we will discuss how the embodied cognition (EC) perspective which can be one of the biological bases of computationalism, which brings neuroscientific explanations on the functioning of nervous system to a more symbolic perspective, may contribute to our understanding of etiopathogenesis of OCD. In this perspective, our method will be to integrate the theoretical basis provided by EC perspective to the current models for OCD, rather than falsifying them.

Auditory feedback control in adults who stutter during metronome-paced speech II. Formant Perturbation

PURPOSE

Prior work has shown that Adults who stutter (AWS) have reduced and delayed responses to auditory feedback perturbations. This study aimed to determine whether external timing cues, which increase fluency, resolve auditory feedback processing disruptions.

METHODS

Fifteen AWS and sixteen adults who do not stutter (ANS) read aloud a multisyllabic sentence either with natural stress and timing or with each syllable paced at the rate of a metronome. On random trials, an auditory feedback formant perturbation was applied, and formant responses were compared between groups and pacing conditions.

RESULTS

During normally paced speech, ANS showed a significant compensatory response to the perturbation by the end of the perturbed vowel, while AWS did not. In the metronome-paced condition, which significantly reduced the disfluency rate, the opposite was true: AWS showed a significant response by the end of the vowel, while ANS did not.

CONCLUSION

These findings indicate a potential link between the reduction in stuttering found during metronome-paced speech and changes in auditory motor integration in AWS.

Event-Related Potential Correlates of Learning to Produce Novel Foreign Phonemes

Learning to pronounce a foreign phoneme requires an individual to acquire a motor program that enables the reproduction of the new acoustic target sound. This process is largely based on the use of auditory feedback to detect pronunciation errors to adjust vocalization. While early auditory evoked neural activity underlies automatic detection and adaptation to vocalization errors, little is known about the neural correlates of acquiring novel speech targets. To investigate the neural processes that mediate the learning of foreign phoneme pronunciation, we recorded event-related potentials when participants (N = 19) pronounced native or foreign phonemes. Behavioral results indicated that the participants' pronunciation of the foreign phoneme improved during the experiment. Early auditory responses (N1 and P2 waves, approximately 85-290 ms after the sound onset) revealed no differences between foreign and native phonemes. In contrast, the amplitude of the frontocentrally distributed late slow wave (LSW, 320-440 ms) was modulated by the pronunciation of the foreign phonemes, and the effect changed during the experiment, paralleling the improvement in pronunciation. These results suggest that the LSW may reflect higher-order monitoring processes that signal successful pronunciation and help learn novel phonemes.

Individual sensorimotor adaptation characteristics are independent across orofacial speech movements and limb reaching movements

Sensorimotor adaptation is critical for human motor control but shows considerable interindividual variability. Efforts are underway to identify factors accounting for individual differences in specific adaptation tasks. However, a fundamental question has remained unaddressed: Is an individual's capability for adaptation effector system specific or does it reflect a generalized adaptation ability? We therefore tested the same participants in analogous adaptation paradigms focusing on distinct sensorimotor systems: speaking with perturbed auditory feedback and reaching with perturbed visual feedback. Each task was completed once with the perturbation introduced gradually (ramped up over 60 trials) and, on a different day, once with the perturbation introduced suddenly. Consistent with studies of each system separately, visuomotor reach adaptation was more complete than auditory-motor speech adaptation (80% vs. 29% of the perturbation). Adaptation was not significantly correlated between the speech and reach tasks. Moreover, considered within tasks, 1) adaptation extent was correlated between the gradual and sudden conditions for reaching but not for speaking, 2) adaptation extent was correlated with additional measures of performance (e.g., trial duration, within-trial corrections) only for reaching and not for speaking, and 3) fitting individual participant adaptation profiles with exponential rather than linear functions offered a larger benefit [lower root mean square error (RMSE)] for the reach task than for the speech task. Combined, results suggest that the ability for sensorimotor adaptation relies on neural plasticity mechanisms that are effector system specific rather than generalized. This finding has important implications for ongoing efforts seeking to identify cognitive, behavioral, and neurochemical predictors of individual sensorimotor adaptation.NEW & NOTEWORTHY This study provides the first detailed demonstration that individual sensorimotor adaptation characteristics are independent across articulatory speech movements and limb reaching movements. Thus, individual sensorimotor learning abilities are effector system specific rather than generalized. Findings regarding one effector system do not necessarily apply to other systems, different underlying mechanisms may be involved, and implications for clinical rehabilitation or performance training also cannot be generalized.

Reinvestigating the Neural Bases Involved in Speech Production of Stutterers: An ALE Meta-Analysis

Background: Stuttering is characterized by dysfluency and difficulty in speech production. Previous research has found abnormalities in the neural function of various brain areas during speech production tasks. However, the cognitive neural mechanism of stuttering has still not been fully determined. Method: Activation likelihood estimation analysis was performed to provide neural imaging evidence on neural bases by reanalyzing published studies. Results: Our analysis revealed overactivation in the bilateral posterior superior temporal gyrus, inferior frontal gyrus, medial frontal gyrus, precentral gyrus, postcentral gyrus, basal ganglia, and cerebellum, and deactivation in the anterior superior temporal gyrus and middle temporal gyrus among the stutterers. The overactivated regions might indicate a greater demand in feedforward planning in speech production, while the deactivated regions might indicate dysfunction in the auditory feedback system among stutterers. Conclusions: Our findings provide updated and direct evidence on the multi-level impairment (feedforward and feedback systems) of stutterers during speech production and show that the corresponding neural bases were differentiated.

Inter-Trial Formant Variability in Speech Production Is Actively Controlled but Does Not Affect Subsequent Adaptation to a Predictable Formant Perturbation

Despite ample evidence that speech production is associated with extensive trial-to-trial variability, it remains unclear whether this variability represents merely unwanted system noise or an actively regulated mechanism that is fundamental for maintaining and adapting accurate speech movements. Recent work on upper limb movements suggest that inter-trial variability may be not only actively regulated based on sensory feedback, but also provide a type of workspace exploration that facilitates sensorimotor learning. We therefore investigated whether experimentally reducing or magnifying inter-trial formant variability in the real-time auditory feedback during speech production (a) leads to adjustments in formant production variability that compensate for the manipulation, (b) changes the temporal structure of formant adjustments across productions, and (c) enhances learning in a subsequent adaptation task in which a predictable formant-shift perturbation is applied to the feedback signal. Results show that subjects gradually increased formant variability in their productions when hearing auditory feedback with reduced variability, but subsequent formant-shift adaptation was not affected by either reducing or magnifying the perceived variability. Thus, findings provide evidence for speakers’ active control of inter-trial formant variability based on auditory feedback from previous trials, but–at least for the current short-term experimental manipulation of feedback variability–not for a role of this variability regulation mechanism in subsequent auditory-motor learning.

Neural correlates of impaired vocal feedback control in post-stroke aphasia

We used left-hemisphere stroke as a model to examine how damage to sensorimotor brain networks impairs vocal auditory feedback processing and control. Individuals with post-stroke aphasia and matched neurotypical control subjects vocalized speech vowel sounds and listened to the playback of their self-produced vocalizations under normal (NAF) and pitch-shifted altered auditory feedback (AAF) while their brain activity was recorded using electroencephalography (EEG) signals. Event-related potentials (ERPs) were utilized as a neural index to probe the effect of vocal production on auditory feedback processing with high temporal resolution, while lesion data in the stroke group was used to determine how brain abnormality accounted for the impairment of such mechanisms. Results revealed that ERP activity was aberrantly modulated during vocalization vs. listening in aphasia, and this effect was accompanied by the reduced magnitude of compensatory vocal responses to pitch-shift alterations in the auditory feedback compared with control subjects. Lesion-mapping revealed that the aberrant pattern of ERP modulation in response to NAF was accounted for by damage to sensorimotor networks within the left-hemisphere inferior frontal, precentral, inferior parietal, and superior temporal cortices. For responses to AAF, neural deficits were predicted by damage to a distinguishable network within the inferior frontal and parietal cortices. These findings define the left-hemisphere sensorimotor networks implicated in auditory feedback processing, error detection, and vocal motor control. Our results provide translational synergy to inform the theoretical models of sensorimotor integration while having clinical applications for diagnosis and treatment of communication disabilities in individuals with stroke and other neurological conditions.

Assessing Ecologically Valid Methods of Auditory Feedback Measurement in Individuals With Typical Speech

PURPOSE

Auditory feedback is thought to contribute to the online control of speech production. Yet, the standard method of estimating auditory feedback control (i.e., reflexive responses to auditory-motor perturbations), although sound, requires specialized instrumentation, meticulous calibration, unnatural tasks, and specific acoustic environments. The purpose of this study was to explore more ecologically valid features of speech production to determine their relationships with auditory feedback mechanisms.

METHOD

Two previously proposed measures of within-utterance variability (centering and baseline variability) were compared with reflexive response magnitudes in 30 adults with typical speech. These three measures were estimated for both the laryngeal and articulatory subsystems of speech.

RESULTS

Regardless of the speech subsystem, neither centering nor baseline variability was shown to be related to reflexive response magnitudes. Likewise, no relationships were found between centering and baseline variability.

CONCLUSIONS

Despite previous suggestions that centering and baseline variability may be related to auditory feedback mechanisms, this study did not support these assertions. However, the detection of such relationships may have required a larger degree of variability in responses, relative to that found in those with typical speech. Future research on these relationships is warranted in populations with more heterogeneous responses, such as children or clinical populations.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.17330546.

Increased upper-limb sensory attenuation with age

The pressure of our own finger on the arm feels differently than the same pressure exerted by an external agent: the latter involves just touch, whereas the former involves a combination of touch and predictive output from the internal model of the body. This internal model predicts the movement of our own finger and hence the intensity of the sensation of the finger press is decreased. A decrease in intensity of the self-produced stimulus is called sensory attenuation. It has been reported that, due to decreased proprioception with age and an increased reliance on the prediction of the internal model, sensory attenuation is increased in older adults. In this study, we used a force-matching paradigm to test if sensory attenuation is also present over the arm and if aging increases sensory attenuation. We demonstrated that, while both young and older adults overestimate a self-produced force, older adults overestimate it even more showing an increased sensory attenuation. In addition, we also found that both younger and older adults self-produce higher forces when activating the homologous muscles of the upper limb. While this is traditionally viewed as evidence for an increased reliance on internal model function in older adults because of decreased proprioception, proprioception appeared unimpaired in our older participants. This begs the question of whether an age-related decrease in proprioception is really responsible for the increased sensory attenuation observed in older people.

The Role of the Medial Prefontal Cortex in Self-Agency in Schizophrenia

Schizophrenia is a disorder of the self. In particular, patients show cardinal deficits in self-agency (i.e., the experience and awareness of being the agent of one’s own thoughts and actions) that directly contribute to positive psychotic symptoms of hallucinations and delusions and distort reality monitoring (defined as distinguishing self-generated information from externally-derived information). Predictive coding models suggest that the experience of self-agency results from a minimal prediction error between the predicted sensory consequence of a self-generated action and the actual outcome. In other words, the experience of self-agency is thought to be driven by making reliable predictions about the expected outcomes of one’s own actions. Most of the agency literature has focused on the motor system; here we present a novel viewpoint that examines agency from a different lens using distinct tasks of reality monitoring and speech monitoring. The self-prediction mechanism that leads to self-agency is necessary for reality monitoring in that self-predictions represent a critical precursor for the successful encoding and memory retrieval of one’s own thoughts and actions during reality monitoring to enable accurate self-agency judgments (i.e., accurate identification of self-generated information). This self-prediction mechanism is also critical for speech monitoring where we continually compare auditory feedback (i.e., what we hear ourselves say) with what we expect to hear. Prior research has shown that the medial prefrontal cortex (mPFC) may represent one potential neural substrate of this self-prediction mechanism. Unfortunately, patients with schizophrenia (SZ) show mPFC hypoactivity associated with self-agency impairments on reality and speech monitoring tasks, as well as aberrant mPFC functional connectivity during intrinsic measures of agency during resting states that predicted worsening psychotic symptoms. Causal neurostimulation and neurofeedback techniques can move the frontiers of schizophrenia research into a new era where we implement techniques to manipulate excitability in key neural regions, such as the mPFC, to modulate patients’ reliance on self-prediction mechanisms on distinct tasks of reality and speech monitoring. We hypothesize these findings will show that mPFC provides a unitary basis for self-agency, driven by reliance on self-prediction mechanisms, which will facilitate the development of new targeted treatments in patients with schizophrenia.

Corollary discharge enables proprioception from lateral line sensory feedback

Animals modulate sensory processing in concert with motor actions. Parallel copies of motor signals, called corollary discharge (CD), prepare the nervous system to process the mixture of externally and self-generated (reafferent) feedback that arises during locomotion. Commonly, CD in the peripheral nervous system cancels reafference to protect sensors and the central nervous system from being fatigued and overwhelmed by self-generated feedback. However, cancellation also limits the feedback that contributes to an animal's awareness of its body position and motion within the environment, the sense of proprioception. We propose that, rather than cancellation, CD to the fish lateral line organ restructures reafference to maximize proprioceptive information content. Fishes' undulatory body motions induce reafferent feedback that can encode the body's instantaneous configuration with respect to fluid flows. We combined experimental and computational analyses of swimming biomechanics and hair cell physiology to develop a neuromechanical model of how fish can track peak body curvature, a key signature of axial undulatory locomotion. Without CD, this computation would be challenged by sensory adaptation, typified by decaying sensitivity and phase distortions with respect to an input stimulus. We find that CD interacts synergistically with sensor polarization to sharpen sensitivity along sensors' preferred axes. The sharpening of sensitivity regulates spiking to a narrow interval coinciding with peak reafferent stimulation, which prevents adaptation and homogenizes the otherwise variable sensor output. Our integrative model reveals a vital role of CD for ensuring precise proprioceptive feedback during undulatory locomotion, which we term external proprioception.

Visual feedback of the tongue influences speech adaptation to a physical modification of the oral cavity

Studies examining sensorimotor adaptation of speech to changing sensory conditions have demonstrated a central role for both auditory and somatosensory feedback in speech motor learning. The potential influence of visual feedback of oral articulators, which is not typically available during speech production but may nonetheless enhance oral motor control, remains poorly understood. The present study explores the influence of ultrasound visual feedback of the tongue on adaptation of speech production (focusing on the sound /s/) to a physical perturbation of the oral articulators (prosthesis altering the shape of the hard palate). Two visual feedback groups were tested that differed in the two-dimensional plane being imaged (coronal or sagittal) during practice producing /s/ words, along with a no-visual-feedback control group. Participants in the coronal condition were found to adapt their speech production across a broader range of acoustic spectral moments and syllable contexts than the no-feedback controls. In contrast, the sagittal group showed reduced adaptation compared to no-feedback controls. The results indicate that real-time visual feedback of the tongue is spontaneously integrated during speech motor adaptation, with effects that can enhance or interfere with oral motor learning depending on compatibility of the visual articulatory information with requirements of the speaking task.

Intact Correction for Self-Produced Vowel Formant Variability in Individuals With Cerebellar Ataxia Regardless of Auditory Feedback Availability

Purpose Individuals with cerebellar ataxia (CA) caused by cerebellar degeneration exhibit larger reactive compensatory responses to unexpected auditory feedback perturbations than neurobiologically typical speakers, suggesting they may rely more on feedback control during speech. We test this hypothesis by examining variability in unaltered speech. Previous studies of typical speakers have demonstrated a reduction in formant variability (centering) observed during the initial phase of vowel production from vowel onset to vowel midpoint. Centering is hypothesized to reflect feedback-based corrections for self-produced variability and thus may provide a behavioral assay of feedback control in unperturbed speech in the same manner as the compensatory response does for feedback perturbations. Method To comprehensively compare centering in individuals with CA and controls, we examine centering in two vowels (/i/ and /ɛ/) under two contexts (isolated words and connected speech). As a control, we examine speech produced both with and without noise to mask auditory feedback. Results Individuals with CA do not show increased centering compared to age-matched controls, regardless of vowel, context, or masking. Contrary to previous results in neurobiologically typical speakers, centering was not affected by the presence of masking noise in either group. Conclusions The similar magnitude of centering seen with and without masking noise questions whether centering is driven by auditory feedback. However, if centering is at least partially driven by auditory/somatosensory feedback, these results indicate that the larger compensatory response to altered auditory feedback observed in individuals with CA may not reflect typical motor control processes during normal, unaltered speech production.

Responses to Auditory Feedback Manipulations in Speech May Be Affected by Previous Exposure to Auditory Errors

Purpose Speakers use auditory feedback to guide their speech output, although individuals differ in the magnitude of their compensatory response to perceived errors in feedback. Little is known about the factors that contribute to the compensatory response or how fixed or flexible they are within an individual. Here, we test whether manipulating the perceived reliability of auditory feedback modulates speakers' compensation to auditory perturbations, as predicted by optimal models of sensorimotor control. Method Forty participants produced monosyllabic words in two separate sessions, which differed in the auditory feedback given during an initial exposure phase. In the veridical session exposure phase, feedback was normal. In the noisy session exposure phase, small, random formant perturbations were applied, reducing reliability of auditory feedback. In each session, a subsequent test phase introduced larger unpredictable formant perturbations. We assessed whether the magnitude of within-trial compensation for these larger perturbations differed across the two sessions. Results Compensatory responses to downward (though not upward) formant perturbations were larger in the veridical session than the noisy session. However, in post hoc testing, we found the magnitude of this effect is highly dependent on the choice of analysis procedures. Compensation magnitude was not predicted by other production measures, such as formant variability, and was not reliably correlated across sessions. Conclusions Our results, though mixed, provide tentative support that the feedback control system monitors the reliability of sensory feedback. These results must be interpreted cautiously given the potentially limited stability of auditory feedback compensation measures across analysis choices and across sessions. Supplemental Material https://doi.org/10.23641/asha.14167136.