Parallel processing streams for motor output and sensory prediction during action preparation

The neural network of sensory attenuation: A neuroimaging meta-analysis

Sensory attenuation refers to the reduction in sensory intensity resulting from self-initiated actions compared to stimuli initiated externally. A classic example is scratching oneself without feeling itchy. This phenomenon extends across various sensory modalities, including visual, auditory, somatosensory, and nociceptive stimuli. The internal forward model proposes that during voluntary actions, an efferent copy of the action command is sent out to predict sensory feedback. This predicted sensory feedback is then compared with the actual sensory feedback, leading to the suppression or reduction of sensory stimuli originating from self-initiated actions. To further elucidate the neural mechanisms underlying sensory attenuation effect, we conducted an extensive meta-analysis of functional magnetic resonance imaging (fMRI) and positron emission tomography (PET) studies. Utilizing activation likelihood estimation (ALE) analysis, our results revealed significant activations in a prominent cluster encompassing the right superior temporal gyrus (rSTG), right middle temporal gyrus (rMTG), and right insula when comparing external-generated with self-generated conditions. Additionally, significant activation was observed in the right anterior cerebellum when comparing self-generated to external-generated conditions. Further analysis using meta-analytic connectivity modeling (MACM) unveiled distinct brain networks co-activated with the rMTG and right cerebellum, respectively. Based on these findings, we propose that sensory attenuation arises from the suppression of reflexive inputs elicited by self-initiated actions through the internal forward modeling of a cerebellum-centered action prediction network, enabling the "sensory conflict detection" regions to effectively discriminate between inputs resulting from self-induced actions and those originating externally.

Voluntary self-initiation of the stimuli onset improves working memory and accelerates visual and attentional processing

The ability of an organism to voluntarily control the stimuli onset modulates perceptual and attentional functions. Since stimulus encoding is an essential component of working memory (WM), we conjectured that controlling the initiation of the perceptual process would positively modulate WM. To corroborate this proposition, we tested twenty-five healthy subjects in a modified-Sternberg WM task under three stimuli presentation conditions: an automatic presentation of the stimuli, a self-initiated presentation of the stimuli (through a button press), and a self-initiated presentation with random-delay stimuli onset. Concurrently, we recorded the subjects' electroencephalographic signals during WM encoding. We found that the self-initiated condition was associated with better WM accuracy, and earlier latencies of N1, P2 and P3 evoked potential components representing visual, attentional and mental review of the stimuli processes, respectively. Our work demonstrates that self-initiated stimuli enhance WM performance and accelerate early visual and attentional processes deployed during WM encoding. We also found that self-initiated stimuli correlate with an increased attentional state compared to the other two conditions, suggesting a role for temporal stimuli predictability. Our study remarks on the relevance of self-control of the stimuli onset in sensory, attentional and memory updating processing for WM.

Turning a blind eye to motor differences leads to bias in estimating action-related auditory ERP attenuation

Event-related potential (ERP) studies investigating the processing of self-induced stimuli often rely on the assumption that ballistic actions and motor ERPs are constant across different sets of action effects. Since recent studies challenge this motor equivalence assumption, we examined whether neglecting effect-related motor differences can bias the estimation of auditory ERPs in a typical action-related ERP attenuation paradigm. We increased action variability with a force production task and selected an event subset in which the motor equivalence assumption was true. ERP attenuation estimated in this subset was compared with attenuation obtained in the standard task, where motor differences were not controlled. Violation of the motor equivalence assumption resulted in a positive deflection overlapping auditory ERPs elicited by self-induced sounds, resulting in the overestimation of N1- and underestimation of P2-attenuation. This demonstrates that sensory-effect-related motor differences should be considered when separating sensory and motor components in ERPs elicited by self-induced stimuli.

Mistakes strengthen the temporal binding effect in the context of goal-directed actions

Temporal binding is an illusion in which the temporal interval between two events appears compressed. In the context of intentional actions, this effect is observed as a compression of the perceived interval between these actions and their causal outcomes. This 'intentional binding effect' has been used to investigate the Sense of Agency, which is the experience of intentionally causing an outcome through volitional action. Intentional binding is reduced for negative outcomes such as error feedback, but the role of mistakes (e.g., errors of commission) for binding and agency has not been extensively studied. In our study, participants played a virtual game in which they attempted to 'splat' (hit) visual stimuli that looked like coloured bugs, using mouse clicks. On some trials, stimulus colours changed unpredictably immediately before actions were made, sometimes inducing mistakes. Actions were thus clearly identifiable as mistakes at the time of their onset before any outcome feedback had been provided. Participants reported shorter action-outcome intervals when stimuli changed, but only when this change caused a mistake according to the game's rules. This suggests that intentional binding is strengthened by errors of commission. We discuss how this effect may be accounted for by agency itself and via more general processes such as changes in arousal.

Timing of brain entrainment to the speech envelope during speaking, listening and self-listening

⁠This study investigates the dynamics of speech envelope tracking during speech production, listening and self-listening. We use a paradigm in which participants listen to natural speech (Listening), produce natural speech (Speech Production), and listen to the playback of their own speech (Self-Listening), all while their neural activity is recorded with EEG. After time-locking EEG data collection and auditory recording and playback, we used a Gaussian copula mutual information measure to estimate the relationship between information content in the EEG and auditory signals. In the 2-10 Hz frequency range, we identified different latencies for maximal speech envelope tracking during speech production and speech perception. Maximal speech tracking takes place approximately 110 ms after auditory presentation during perception and 25 ms before vocalisation during speech production. These results describe a specific timeline for speech tracking in speakers and listeners in line with the idea of a speech chain and hence, delays in communication.

Action-locked Neural Responses in Auditory Cortex to Self-generated Sounds

Sensory perception is a product of interactions between the internal state of an organism and the physical attributes of a stimulus. It has been shown across the animal kingdom that perception and sensory-evoked physiological responses are modulated depending on whether or not the stimulus is the consequence of voluntary actions. These phenomena are often attributed to motor signals sent to relevant sensory regions that convey information about upcoming sensory consequences. However, the neurophysiological signature of action-locked modulations in sensory cortex, and their relationship with perception, is still unclear. In the current study, we recorded neurophysiological (using Magnetoencephalography) and behavioral responses from 16 healthy subjects performing an auditory detection task of faint tones. Tones were either generated by subjects' voluntary button presses or occurred predictably following a visual cue. By introducing a constant temporal delay between button press/cue and tone delivery, and applying source-level analysis, we decoupled action-locked and auditory-locked activity in auditory cortex. We show action-locked evoked-responses in auditory cortex following sound-triggering actions and preceding sound onset. Such evoked-responses were not found for button-presses that were not coupled with sounds, or sounds delivered following a predictive visual cue. Our results provide evidence for efferent signals in human auditory cortex that are locked to voluntary actions coupled with future auditory consequences.

Action-related auditory ERP attenuation is not modulated by action effect relevance

Event-related potentials (ERPs) elicited by self-induced sounds are often smaller than ERPs elicited by identical, but externally generated sounds. This action-related auditory ERP attenuation is more pronounced when self-induced sounds are intermixed with similar sounds generated by an external source. The current study explored whether attentional factors contributed to this phenomenon. Participants performed tone-eliciting actions, while the action-tone contingency and the set of additional action effects (tactile only, tactile and visual) were manipulated in a blocked manner. Previous action-tone contingence-effects were replicated, but the addition of other sensory action consequences did not influence the magnitude of auditory ERP attenuation. This suggests that the amount of attention allocated to concurrent non-auditory action effects does not substantially affect the magnitude of action-related auditory ERP attenuation and is on a par with the assumption that action-related auditory ERP attenuation might be related to the process of distinguishing self-induced stimuli from externally generated ones.

Investigating cortico-subcortical circuits during auditory sensory attenuation: A combined magnetoencephalographic and dynamic causal modeling study

Sensory attenuation refers to the decreased intensity of a sensory percept when a sensation is self‐generated compared with when it is externally triggered. However, the underlying brain regions and network interactions that give rise to this phenomenon remain to be determined. To address this issue, we recorded magnetoencephalographic (MEG) data from 35 healthy controls during an auditory task in which pure tones were either elicited through a button press or passively presented. We analyzed the auditory M100 at sensor‐ and source‐level and identified movement‐related magnetic fields (MRMFs). Regression analyses were used to further identify brain regions that contributed significantly to sensory attenuation, followed by a dynamic causal modeling (DCM) approach to explore network interactions between generators. Attenuation of the M100 was pronounced in right Heschl's gyrus (HES), superior temporal cortex (ST), thalamus, rolandic operculum (ROL), precuneus and inferior parietal cortex (IPL). Regression analyses showed that right postcentral gyrus (PoCG) and left precentral gyrus (PreCG) predicted M100 sensory attenuation. In addition, DCM results indicated that auditory sensory attenuation involved bi‐directional information flow between thalamus, IPL, and auditory cortex. In summary, our data show that sensory attenuation is mediated by bottom‐up and top‐down information flow in a thalamocortical network, providing support for the role of predictive processing in sensory‐motor system.

Sensorimotor Integration Can Enhance Auditory Perception

Whenever we move, speak, or play musical instruments, our actions generate auditory sensory input. The sensory consequences of our actions are thought to be predicted via sensorimotor integration, which involves anatomical and functional links between auditory and motor brain regions. The physiological connections are relatively well established, but less is known about how sensorimotor integration affects auditory perception. The sensory attenuation hypothesis suggests that the perceived loudness of self-generated sounds is attenuated to help distinguish self-generated sounds from ambient sounds. Sensory attenuation would work for louder ambient sounds, but could lead to less accurate perception if the ambient sounds were quieter. We hypothesize that a key function of sensorimotor integration is the facilitated processing of self-generated sounds, leading to more accurate perception under most conditions. The sensory attenuation hypothesis predicts better performance for higher but not lower intensity comparisons, whereas sensory facilitation predicts improved perception regardless of comparison sound intensity. A series of experiments tested these hypotheses, with results supporting the enhancement hypothesis. Overall, people were more accurate at comparing the loudness of two sounds when making one of the sounds themselves. We propose that the brain selectively modulates the perception of self-generated sounds to enhance representations of action consequences.

Intact automatic motor inhibition in patients with tourette syndrome

BACKGROUND

Behavioral disinhibition has been proposed as a key mechanism in Tourette syndrome. Yet classic inhibition tasks have yielded inconsistent results, likely reflecting interference by strategies compensating for tic release.

METHODS

We examined a core inhibitory function that is immune to such interference because it suppresses movements automatically. We measured automatic motor inhibition behaviorally in 21 adults with Tourette syndrome and 21 healthy controls via the negative compatibility effect. When a motor response is activated, for example, by a subliminal prime stimulus, but execution is delayed, activation turns into inhibition, increasing reaction time and error. Diminished automatic inhibition could underlie tic release.

RESULTS

Both controls and patients showed strong automatic motor inhibition with no significant group difference. Bayesian statistics, allowing inference on the absence of effects, favored intact inhibition in patients. Our study was well powered.

CONCLUSIONS

Automatic motor inhibition in Tourette syndrome is neither impaired nor harnessed by compensation. © 2018 International Parkinson and Movement Disorder Society.

Gain control in the sensorimotor system

Coordinated movement depends on constant interaction between neural circuits that produce motor output and those that report sensory consequences. Fundamental to this process are mechanisms for controlling the influence that sensory signals have on motor pathways - for example, reducing feedback gains when they are disruptive and increasing gains when advantageous. Sensory gain control comes in many forms and serves diverse purposes - in some cases sensory input is attenuated to maintain movement stability and filter out irrelevant or self-generated signals, or enhanced to facilitate salient signals for improved movement execution and adaptation. The ubiquitous presence of sensory gain control across species at multiple levels of the nervous system reflects the importance of tuning the impact that feedback information has on behavioral output.

Belief of agency changes dynamics in sensorimotor networks

Controlling an event through one's own action usually induces a sense of agency, a feeling that arises when an expected outcome matches the intention. The neural correlates of this feeling remain controversial however, as experimental manipulation of the action-outcome chain often introduces mismatch or prediction errors that strongly correlate with the sense of agency. Here, we took a different approach and manipulated the causal belief (self-attribution vs. computer-attribution) by external cues during matched visuo-motor tapping conditions. With magneto-encephalography, we studied the sense of agency from a network perspective, investigating in source space the modulation of local population activity and changes in functional connectivity with motor cortex. Our results show that during the belief of agency primary motor cortex (M1) shows stronger functional connectivity (mediated by the beta band) to inferior parietal lobe and right middle temporal gyrus (MTG). Furthermore, the local feed-forward activity (gamma band power) in extrastriate body area and MTG disappears with that belief. After changes in action context, left M1 shows stronger connectivity in the alpha band with right premotor cortex and left insular-temporal cortex a network that might support active inference in social action context. Finally, a better tapping performance in this rhythmic task was related to alpha power modulations in the bilateral cerebellum and bilateral fusiform body-area, with power suppression during a more precise performance. These findings highlight the role of multiple networks supporting the sense of agency by changing their relative contribution for different causal beliefs.

From Believing to Belief: A General Theoretical Model

Cognitive neuroscience research has begun to explore the mental processes underlying what a belief and what believing are. Recent evidence suggests that believing involves fundamental brain functions that result in meaningful probabilistic representations, called beliefs. When relatively stable, these beliefs allow for guidance of behavior in individuals and social groups. However, they are also fluid and can be modified by new relevant information, interpersonal contact, social pressure, and situational demands. We present a theoretical model of believing that can account for the formation of both empirically grounded and metaphysical beliefs.

How Movement Modulates Hearing

Hearing is often viewed as a passive process: Sound enters the ear, triggers a cascade of activity through the auditory system, and culminates in an auditory percept. In contrast to a passive process, motor-related signals strongly modulate the auditory system from the eardrum to the cortex. The motor modulation of auditory activity is most well documented during speech and other vocalizations but also can be detected during a wide variety of other sound-generating behaviors. An influential idea is that these motor-related signals suppress neural responses to predictable movement-generated sounds, thereby enhancing sensitivity to environmental sounds during movement while helping to detect errors in learned acoustic behaviors, including speech and musicianship. Findings in humans, monkeys, songbirds, and mice provide new insights into the circuits that convey motor-related signals to the auditory system, while lending support to the idea that these signals function predictively to facilitate hearing and vocal learning.

Integrating prospective and retrospective cues to the sense of agency: a multi-study investigation

Sense of agency (SoA) refers to the experience of voluntary control over one’s own actions, and, through them, over events in the outside world. Recent accounts suggest that SoA involves an integration of various cues. These include prospective cues, for example, related to the fluency of action selection, and retrospective cues, linked to outcome monitoring. It remains unclear whether these cues may have independent effects on SoA, and, in particular, how their relative contributions may change during instrumental learning. In the present study, we explored these issues by conducting a multi-study analysis of seven published and unpublished studies on the role of prospective cues to the SoA. Our main question was how the effects of selection fluency on SoA might change as information about action–outcome contingencies is gathered. Results show that selection fluency can have a general and consistent influence on the SoA, independent of outcome monitoring. This suggests selection fluency is used as a heuristic cue, to prospectively inform our SoA. In addition, our results show that the influence of selection fluency on SoA may change systematically as action–outcome contingencies are gradually learned. We speculate that dysfluent selection may impair formation of mental associations between action and outcome.

The Cortical Processing of Sensorimotor Sequences is Disrupted in Writer's Cramp

Evidence for pre-existing abnormalities in the sensory and motor systems has been previously reported in writer's cramp (WC). However, the processing of somatosensory information during motor planning has received little attention. We hypothesized that sensorimotor integration processes might be impaired partly due to a disruption in the parieto-premotor network. To test this assumption, we designed 2 nonwriting motor tasks in which subjects had to perform a 4-finger motor sequence either on the basis of sensory stimuli previously memorized (SM task) or freely generated (SG task). Brain activity was measured by combining event-related functional magnetic resonance imaging and coherency electroencephalography in 15 WC patients and 15 normal controls. The bold signal was decreased in patients in both tasks during sensory stimulation but not during movement execution. However, the EEG study showed that coherency was decreased in patients compared with controls, during the delay of the SM task and during the execution of the SG task, on both the whole network and for specific couples of electrodes. Overall, these results demonstrate an endophenotypic impairment in the synchronization of cortical areas within the parieto-premotor network during somatosensory processing and motor planning in WC patients.

Analgesia induced by self-initiated electrotactile sensation is mediated by top-down modulations

It is well known that sensory perception can be attenuated when sensory stimuli are controlled by self-initiated actions. This phenomenon is explained by the consistency between forward models of anticipated action effects and actual sensory feedback. Specifically, the brain state related to the binding between motor processing and sensory perception would have inhibitory function by gating sensory information via top-down control. Since the brain state could casually influence the perception of subsequent stimuli of different sensory modalities, we hypothesize that pain evoked by nociceptive stimuli following the self-initiated tactile stimulation would be attenuated as compared to that following externally determined tactile stimulation. Here, we compared psychophysical and neurophysiological responses to identical nociceptive-specific laser stimuli in two different conditions: self-initiated tactile sensation condition (STS) and nonself-initiated tactile sensation condition (N-STS). We observed that pain intensity and unpleasantness, as well as laser-evoked brain responses, were significantly reduced in the STS condition compared to the N-STS condition. In addition, magnitudes of alpha and beta oscillations prior to laser onset were significantly larger in the STS condition than in the N-STS condition. These results confirmed that pain perception and pain-related brain responses were attenuated when the tactile stimulation was initiated by subjects' voluntary actions, and exploited neural oscillations reflecting the binding between motor processing and sensory feedback. Thus, our study elaborated the understanding of underlying neural mechanisms related to top-down modulations of the analgesic effect induced by self-initiated tactile sensation, which provided theoretical basis to improve the analgesic effect in various clinical applications.

How actions shape perception: learning action-outcome relations and predicting sensory outcomes promote audio-visual temporal binding

To maintain a temporally-unified representation of audio and visual features of objects in our environment, the brain recalibrates audio-visual simultaneity. This process allows adjustment for both differences in time of transmission and time for processing of audio and visual signals. In four experiments, we show that the cognitive processes for controlling instrumental actions also have strong influence on audio-visual recalibration. Participants learned that right and left hand button-presses each produced a specific audio-visual stimulus. Following one action the audio preceded the visual stimulus, while for the other action audio lagged vision. In a subsequent test phase, left and right button-press generated either the same audio-visual stimulus as learned initially, or the pair associated with the other action. We observed recalibration of simultaneity only for previously-learned audio-visual outcomes. Thus, learning an action-outcome relation promotes temporal grouping of the audio and visual events within the outcome pair, contributing to the creation of a temporally unified multisensory object. This suggests that learning action-outcome relations and the prediction of perceptual outcomes can provide an integrative temporal structure for our experiences of external events.

Effect Anticipation Affects Perceptual, Cognitive, and Motor Phases of Response Preparation: Evidence from an Event-Related Potential (ERP) Study

The anticipation of action effects is a basic process that can be observed even for key-pressing responses in a stimulus-response paradigm. In Ziessler et al.'s (2012) experiments participants first learned arbitrary effects of key-pressing responses. In the test phase an imperative stimulus determined the response, but participants withheld the response until a Go-stimulus appeared. Reaction times (RTs) were shorter if the Go-stimulus was compatible with the learned response effect. This is strong evidence that effect representations were activated during response planning. Here, we repeated the experiment using event-related potentials (ERPs), and we found that Go-stimulus locked ERPs depended on the compatibility relationship between the Go-stimulus and the response effect. In general, this supports the interpretation of the behavioral data. More specifically, differences in the ERPs between compatible and incompatible Go-stimuli were found for the early perceptual P1 component and the later frontal P2 component. P1 differences were found only in the second half of the experiment and for long stimulus onset asynchronies (SOAs) between imperative stimulus and Go-stimulus, i.e., when the effect was fully anticipated and the perceptual system was prepared for the effect-compatible Go-stimulus. P2 amplitudes, likely associated with evaluation and conflict detection, were larger when Go-stimulus and effect were incompatible; presumably, incompatibility increased the difficulty of effect anticipation. Onset of response-locked lateralized readiness potentials (R-LRPs) occurred earlier under incompatible conditions indicating extended motor processing. Together, these results strongly suggest that effect anticipation affects all (i.e., perceptual, cognitive, and motor) phases of response preparation.

Auditory cortical deactivation during speech production and following speech perception: an EEG investigation of the temporal dynamics of the auditory alpha rhythm

Sensorimotor integration (SMI) across the dorsal stream enables online monitoring of speech. Jenson et al. (2014) used independent component analysis (ICA) and event related spectral perturbation (ERSP) analysis of electroencephalography (EEG) data to describe anterior sensorimotor (e.g., premotor cortex, PMC) activity during speech perception and production. The purpose of the current study was to identify and temporally map neural activity from posterior (i.e., auditory) regions of the dorsal stream in the same tasks. Perception tasks required "active" discrimination of syllable pairs (/ba/ and /da/) in quiet and noisy conditions. Production conditions required overt production of syllable pairs and nouns. ICA performed on concatenated raw 68 channel EEG data from all tasks identified bilateral "auditory" alpha (α) components in 15 of 29 participants localized to pSTG (left) and pMTG (right). ERSP analyses were performed to reveal fluctuations in the spectral power of the α rhythm clusters across time. Production conditions were characterized by significant α event related synchronization (ERS; pFDR < 0.05) concurrent with EMG activity from speech production, consistent with speech-induced auditory inhibition. Discrimination conditions were also characterized by α ERS following stimulus offset. Auditory α ERS in all conditions temporally aligned with PMC activity reported in Jenson et al. (2014). These findings are indicative of speech-induced suppression of auditory regions, possibly via efference copy. The presence of the same pattern following stimulus offset in discrimination conditions suggests that sensorimotor contributions following speech perception reflect covert replay, and that covert replay provides one source of the motor activity previously observed in some speech perception tasks. To our knowledge, this is the first time that inhibition of auditory regions by speech has been observed in real-time with the ICA/ERSP technique.