Self-initiation and temporal cueing of monaural tones reduce the auditory N1 and P2

Sensory Attenuation Deficit and Auditory Hallucinations in Schizophrenia: A Causal Mechanism or a Risk Factor? Evidence From Meta-Analyses on the N1 Event-Related Potential Component

BACKGROUND

Sensory attenuation (SA), the dampened perception of self-generated sensory information, is typically associated with reduced event-related potential signals, such as for the N1 component of auditory event-related potentials. SA, together with efficient monitoring of intentions and actions, should facilitate the distinction between self-generated and externally generated sensory events, thereby optimizing interaction with the world. According to many, SA is deficient in schizophrenia. The question arises whether altered SA reflects a sufficient mechanism to explain positive symptoms such as auditory hallucinations. A systematic association of reduced auditory SA in hallucinating patients would support this hypothesis.

METHODS

We conducted a series of meta-analyses on 15 studies on auditory SA in which the N1 component of event-related potential-electroencephalogram signals was measured during talking (self-generated sensory signals condition) or when listening to prerecorded vocalizations (externally generated sensory signals condition).

RESULTS

We found that individuals with schizophrenia did show some auditory SA because their N1 signal was significantly attenuated in talking conditions compared with listening conditions. However, the magnitude of such attenuation was reduced in individuals with schizophrenia compared to healthy control participants. This phenomenon generalizes independently from the stage of the disease, the severity of positive symptoms, and whether patients have auditory hallucinations or not.

CONCLUSIONS

These findings suggest that reduced SA cannot be a sufficient mechanism for explaining positive symptoms such as auditory hallucinations in schizophrenia. Because reduced SA was also present in participants at risk of schizophrenia, reduced SA may represent a risk factor for the disorder. We discuss the implications of these results for clinical-cognitive models of schizophrenia.

Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies

Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.

Corollary discharge function in healthy controls: Evidence about self-speech and external speech processing

As we speak, corollary discharge mechanisms suppress the auditory conscious perception of the self-generated voice in healthy subjects. This suppression has been associated with the attenuation of the auditory N1 component. To analyse this corollary discharge phenomenon (agency and ownership), we registered the event-related potentials of 42 healthy subjects. The N1 and P2 components were elicited by spoken vowels (talk condition; agency), by played-back vowels recorded with their own voice (listen-self condition; ownership) and by played-back vowels recorded with an external voice (listen-other condition). The N1 amplitude elicited by the talk condition was smaller compared with the listen-self and listen-other conditions. There were no amplitude differences in N1 between listen-self and listen-other conditions. The P2 component did not show differences between conditions. Additionally, a peak latency analysis of N1 and P2 components between the three conditions showed no differences. These findings corroborate previous results showing that the corollary discharge mechanisms dampen sensory responses to self-generated speech (agency experience) and provide new neurophysiological evidence about the similarities in the processing of played-back vowels with our own voice (ownership experience) and with an external voice.

Auditory N1 and P2 Attenuation in Action Observation: An Event-Related Potential Study Considering Effects of Temporal Predictability and Individualism

Tones that are generated by self-performed actions elicit attenuated N1 and P2 amplitudes, as measured by electroencephalography (EEG), compared to identical external tones, which is referred to as neurophysiological sensory attenuation (SA). At the same time, self-generated tones are perceived as less loud compared to external tones (perceptual SA). Action observation led in part to a similar neurophysiological and perceptual SA. The perceptual SA in observers was found in comparison to tones that were temporally predictable, and one study suggested that perceptual SA in observers might depend on the cultural dimension of individualism. In this study, we examined neurophysiological SA for tones elicited by self-performed and observed actions during simultaneous EEG acquisitions in two participants, extending the paradigm with a visual cue condition controlling for effects of temporal predictability. Moreover, we investigated the effect of individualism on neurophysiological SA in action observation. Relative to un-cued external tones, the N1 was only descriptively reduced for tones that were elicited by self-performed or observed actions and significantly attenuated for cued external tones. A P2 attenuation effect relative to un-cued external tones was found in all three conditions, with stronger effects for self- and other-generated tones than for cued external tones. We found no evidence for an effect of individualism. These findings add to previous evidence for neurophysiological SA in action performance and observation with a paradigm well-controlled for the effect of predictability and individualism, showing differential effects of the former on the N1 and P2 components, and no effect of the latter.

The auditory P2 differentiates self- from partner-produced sounds during joint action: Contributions of self-specific attenuation and temporal orienting of attention

Sensory attenuation of the auditory P2 event-related potential (ERP) has been shown to differentiate the sensory consequences of one's own from others' action in joint action contexts. However, recent evidence suggests that when people coordinate joint actions over time, temporal orienting of attention might simultaneously contribute to enhancing the auditory P2. The current study employed a joint tapping task in which partners produced tone sequences together to examine whether temporal orienting influences auditory ERP amplitudes during the time window of self-other differentiation. Our findings demonstrate that the combined requirements of coordinating with a partner toward a joint goal and immediately adjusting to the partner's tone timing enhance P2 amplitudes elicited by the partner's tone onsets. Furthermore, our findings replicate prior evidence for self-specific sensory attenuation of the auditory P2 in joint action, and additionally demonstrate that it occurs regardless of the coordination requirements between partners. Together, these findings provide evidence that temporal orienting and sensory attenuation both modulate the auditory P2 during joint action and suggest that both processes play a role in facilitating precise interpersonal coordination between partners.

My view on your actions: Dynamic changes in viewpoint-dependent auditory ERP attenuation during action observation

It has been suggested that during action observation, a sensory representation of the observed action is mapped onto one's own motor system. However, it is largely unexplored what this may imply for the early processing of the action's sensory consequences, whether the observational viewpoint exerts influence on this and how such a modulatory effect might change over time. We tested whether the event-related potential of auditory effects of actions observed from a first- versus third-person perspective show amplitude reductions compared with externally generated sounds, as revealed for self-generated sounds. Multilevel modeling on trial-level data showed distinct dynamic patterns for the two viewpoints on reductions of the N1, P2, and N2 components. For both viewpoints, an N1 reduction for sounds generated by observed actions versus externally generated sounds was observed. However, only during first-person observation, we found a temporal dynamic within experimental runs (i.e., the N1 reduction only emerged with increasing trial number), indicating time-variant, viewpoint-dependent processes involved in sensorimotor prediction during action observation. For the P2, only a viewpoint-independent reduction was found for sounds elicited by observed actions, which disappeared in the second half of the experiment. The opposite pattern was found in an exploratory analysis concerning the N2, revealing a reduction that increased in the second half of the experiment, and, moreover, a temporal dynamic within experimental runs for the first-person perspective, possibly reflecting an agency-related process. Overall, these results suggested that the processing of auditory outcomes of observed actions is dynamically modulated by the viewpoint over time.

Voluntary self-initiation of the stimuli onset improves working memory and accelerates visual and attentional processing

The ability of an organism to voluntarily control the stimuli onset modulates perceptual and attentional functions. Since stimulus encoding is an essential component of working memory (WM), we conjectured that controlling the initiation of the perceptual process would positively modulate WM. To corroborate this proposition, we tested twenty-five healthy subjects in a modified-Sternberg WM task under three stimuli presentation conditions: an automatic presentation of the stimuli, a self-initiated presentation of the stimuli (through a button press), and a self-initiated presentation with random-delay stimuli onset. Concurrently, we recorded the subjects' electroencephalographic signals during WM encoding. We found that the self-initiated condition was associated with better WM accuracy, and earlier latencies of N1, P2 and P3 evoked potential components representing visual, attentional and mental review of the stimuli processes, respectively. Our work demonstrates that self-initiated stimuli enhance WM performance and accelerate early visual and attentional processes deployed during WM encoding. We also found that self-initiated stimuli correlate with an increased attentional state compared to the other two conditions, suggesting a role for temporal stimuli predictability. Our study remarks on the relevance of self-control of the stimuli onset in sensory, attentional and memory updating processing for WM.

Feedback-related EEG dynamics separately reflect decision parameters, biases, and future choices

Optimal decision making in complex environments requires dynamic learning from unexpected events. To speed up learning, we should heavily weight information that indicates state-action-outcome contingency changes and ignore uninformative fluctuations in the environment. Often, however, unrelated information is hard to ignore and can potentially bias our learning. Here we used computational modelling and EEG to investigate learning behaviour in a modified probabilistic choice task that introduced two task-irrelevant factors that were uninformative for optimal task performance, but nevertheless could potentially bias learning: pay-out magnitudes were varied randomly and, occasionally, feedback presentation was enhanced by visual surprise. We found that participants' overall good learning performance was biased by distinct effects of these non-normative factors. On the neural level, these parameters are represented in a dynamic and spatiotemporally dissociable sequence of EEG activity. Later in feedback processing the different streams converged on a central to centroparietal positivity reflecting a signal that is interpreted by downstream learning processes that adjust future behaviour.

Actions of a Shaken Heart: Interoception Interacts with Action Processing

In the present study, we investigated the modulatory influence of the unconscious, bodily arousal on motor-related embodied information. Specifically, we examined how the interoceptive prediction error interacts with the event-related potentials linked to action-effect processing. Participants were asked to perform a task with self-initiated or externally-triggered sounds while receiving synchronous or false auditory cardiac feedback. The results found that interaction of interoceptive manipulation and action-effect processing modulates the frontal subcomponent of the P3 response. During the synchronous cardiac feedback, the P3 response to self-initiated tones was enhanced. During the false cardiac feedback, the frontal cortical response was reversed. N1 and P2 components were affected by the interoceptive manipulation, but not by the interaction of interoception and action processing. These findings provide experimental support for the theoretical accounts of the interaction between interoception and action processing within a framework of predictive coding, manifested particularly in the higher stages of action processing.

Movement Planning Determines Sensory Suppression: An Event-related Potential Study

Sensory suppression refers to the phenomenon that sensory input generated by our own actions, such as moving a finger to press a button to hear a tone, elicits smaller neural responses than sensory input generated by external agents. This observation is usually explained via the internal forward model in which an efference copy of the motor command is used to compute a corollary discharge, which acts to suppress sensory input. However, because moving a finger to press a button is accompanied by neural processes involved in preparing and performing the action, it is unclear whether sensory suppression is the result of movement planning, movement execution, or both. To investigate this, in two experiments, we compared ERPs to self-generated tones that were produced by voluntary, semivoluntary, or involuntary button-presses, with externally generated tones that were produced by a computer. In Experiment 1, the semivoluntary and involuntary button-presses were initiated by the participant or experimenter, respectively, by electrically stimulating the median nerve in the participant's forearm, and in Experiment 2, by applying manual force to the participant's finger. We found that tones produced by voluntary button-presses elicited a smaller N1 component of the ERP than externally generated tones. This is known as N1-suppression. However, tones produced by semivoluntary and involuntary button-presses did not yield significant N1-suppression. We also found that the magnitude of N1-suppression linearly decreased across the voluntary, semivoluntary, and involuntary conditions. These results suggest that movement planning is a necessary condition for producing sensory suppression. We conclude that the most parsimonious account of sensory suppression is the internal forward model.

Vocalizing and singing reveal complex patterns of corollary discharge function in schizophrenia

INTRODUCTION

As we vocalize, our brains generate predictions of the sounds we produce to enable suppression of neural responses when intentions match vocalizations and to make adjustments when they do not. This may be instantiated by efference copy and corollary discharge mechanisms, which are impaired in people with schizophrenia (SZ). Although innate, these mechanisms can be affected by intentions. We asked if attending to pitch during vocalizations would take these mechanisms "off-line" and reduce suppression.

METHODS

Event-related potentials (ERP) were recorded from 96 SZ and 92 healthy controls (HC) as they vocalized triplets in monotone (Phrase) or sang triplets in ascending thirds (Pitch). Pre-vocalization activity (Bereitschaftspotential, BP), N1, and P2 ERP components to sounds were compared during vocalization and playback.

RESULTS

N1 was not as suppressed during Pitch as during Phrase. N1 suppression was not affected by SZ in either task when all data were collapsed across pitches (Pitch) and positions (Phrase). However, when binned according to vocalization performance, SZ showed less N1 suppression than HC at longer (>2 s) inter-stimulus intervals (Phrase) and inconsistent suppression across pitches (Pitch). Unlike N1, P2 was more suppressed during Pitch than Phrase and not affected by SZ. BP was greater during vocalization than playback but did not contribute to N1 or P2 effects. Pitch variability was inversely related to negative symptoms.

CONCLUSIONS

Neural processing is not suppressed when patients and controls sing, and corollary discharge abnormalities in schizophrenia are only seen at long vocalization intervals.

Neural correlates of implicit agency during the transition from adolescence to adulthood: An ERP study

Sense of agency (SoA), the experience of being in control of our voluntary actions and their outcomes, is a key feature of normal human experience. Frontoparietal brain circuits associated with SoA undergo a major maturational process during adolescence. To examine whether this translates to neurodevelopmental changes in agency experience, we investigated two key neural processes associated with SoA, the activity that is leading to voluntary action (Readiness Potential) and the activity that is associated with the action outcome processing (attenuation of auditory N1 and P2 event related potentials, ERPs) in mid-adolescents (13-14), late-adolescents (18-20) and adults (25-28) while they perform an intentional binding task. In this task, participants pressed a button (action) that delivered a tone (outcome) after a small delay and reported the time of the tone using the Libet clock. This action-outcome condition alternated with a no-action condition where an identical tone was triggered by a computer. Mid-adolescents showed greater outcome binding, such that they perceived self-triggered tones as being temporally closer to their actions compared to adults. Suggesting greater agency experience over the outcomes of their voluntary actions during mid-adolescence. Consistent with this, greater levels of attenuated neural response to self-triggered auditory tones (specifically P2 attenuation) were found during mid-adolescence compared to older age groups. This enhanced attenuation decreased with age as observed in outcome binding. However, there were no age-related differences in the readiness potential leading to the voluntary action (button press) as well as in the N1 attenuation to the self-triggered tones. Notably, in mid-adolescents greater outcome binding scores were positively associated with greater P2 attenuation, and smaller negativity in the late readiness potential. These findings suggest that the greater experience of implicit agency observed during mid-adolescence may be mediated by a neural over-suppression of action outcomes (auditory P2 attenuation), and over-reliance on motor preparation (late readiness potential), which we found to become adult-like during late-adolescence. Implications for adolescent development and SoA related neurodevelopmental disorders are discussed.

Sensory attenuation is modulated by the contrasting effects of predictability and control

Self-generated stimuli have been found to elicit a reduced sensory response compared with externally-generated stimuli. However, much of the literature has not adequately controlled for differences in the temporal predictability and temporal control of stimuli. In two experiments, we compared the N1 (and P2) components of the auditory-evoked potential to self- and externally-generated tones that differed with respect to these two factors. In Experiment 1 (n = 42), we found that increasing temporal predictability reduced N1 amplitude in a manner that may often account for the observed reduction in sensory response to self-generated sounds. We also observed that reducing temporal control over the tones resulted in a reduction in N1 amplitude. The contrasting effects of temporal predictability and temporal control on N1 amplitude meant that sensory attenuation prevailed when controlling for each. Experiment 2 (n = 38) explored the potential effect of selective attention on the results of Experiment 1 by modifying task requirements such that similar levels of attention were allocated to the visual stimuli across conditions. The results of Experiment 2 replicated those of Experiment 1, and suggested that the observed effects of temporal control and sensory attenuation were not driven by differences in attention. Given that self- and externally-generated sensations commonly differ with respect to both temporal predictability and temporal control, findings of the present study may necessitate a re-evaluation of the experimental paradigms used to study sensory attenuation.

Illusion of control affects ERP amplitude reductions for auditory outcomes of self-generated actions

The reduction of neural responses to self-generated stimuli compared to external stimuli is thought to result from the matching of motor-based sensory predictions and sensory reafferences and to serve the identification of changes in the environment as caused by oneself. The amplitude of the auditory event-related potential (ERP) component N1 seems to closely reflect this matching process, while the later positive component (P2/ P3a) has been associated with judgments of agency, which are also sensitive to contextual top-down information. In this study, we examined the effect of perceived control over sound production on the processing of self-generated and external stimuli, as reflected in these components. We used a new version of a classic two-button choice task to induce different degrees of the illusion of control (IoC) and recorded ERPs for the processing of self-generated and external sounds in a subsequent task. N1 amplitudes were reduced for self-generated compared to external sounds, but not significantly affected by IoC. P2/3a amplitudes were affected by IoC: We found reduced P2/3a amplitudes after a high compared to a low IoC induction training, but only for self-generated, not for external sounds. These findings suggest that prior contextual belief information induced by an IoC affects later processing as reflected in the P2/P3a, possibly for the formation of agency judgments, while early processing reflecting motor-based predictions is not affected.

Similarities and Differences between Performers and Observers in Processing Auditory Action Consequences: Evidence from Simultaneous EEG Acquisition

In our social environment, we easily distinguish stimuli caused by our own actions (e.g., water splashing when I fill my glass) from stimuli that have an external source (e.g., water splashing in a fountain). Accumulating evidence suggests that processing the auditory consequences of self-performed actions elicits N1 and P2 ERPs of reduced amplitude compared to physically identical but externally generated sounds, with such reductions being ascribed to neural predictive mechanisms. It is unexplored, however, whether the sensory processing of action outcomes is similarly modulated by action observation (e.g., water splashing when I observe you filling my glass). We tested 40 healthy participants by applying a methodological approach for the simultaneous EEG recording of two persons: An observer observed button presses executed by a performer in real time. For the performers, we replicated previous findings of a reduced N1 amplitude for self- versus externally generated sounds. This pattern differed significantly from the one in observers, whose N1 for sounds generated by observed button presses was not attenuated. In turn, the P2 amplitude was reduced for processing action- versus externally generated sounds for both performers and observers. These findings show that both action performance and observation affect the processing of action-generated sounds. There are, however, important differences between the two in the timing of the effects, probably related to differences in the predictability of the actions and thus also the associated stimuli. We discuss how these differences might contribute to recognizing the stimulus as caused by self versus others.

Rhythm Complexity Modulates Behavioral and Neural Dynamics During Auditory–Motor Synchronization

We addressed how rhythm complexity influences auditory–motor synchronization in musically trained individuals who perceived and produced complex rhythms while EEG was recorded. Participants first listened to two-part auditory sequences (Listen condition). Each part featured a single pitch presented at a fixed rate; the integer ratio formed between the two rates varied in rhythmic complexity from low (1:1) to moderate (1:2) to high (3:2). One of the two parts occurred at a constant rate across conditions. Then, participants heard the same rhythms as they synchronized their tapping at a fixed rate (Synchronize condition). Finally, they tapped at the same fixed rate (Motor condition). Auditory feedback from their taps was present in all conditions. Behavioral effects of rhythmic complexity were evidenced in all tasks; detection of missing beats (Listen) worsened in the most complex (3:2) rhythm condition, and tap durations (Synchronize) were most variable and least synchronous with stimulus onsets in the 3:2 condition. EEG power spectral density was lowest at the fixed rate during the 3:2 rhythm and greatest during the 1:1 rhythm (Listen and Synchronize). ERP amplitudes corresponding to an N1 time window were smallest for the 3:2 rhythm and greatest for the 1:1 rhythm (Listen). Finally, synchronization accuracy (Synchronize) decreased as amplitudes in the N1 time window became more positive during the high rhythmic complexity condition (3:2). Thus, measures of neural entrainment corresponded to synchronization accuracy, and rhythmic complexity modulated the behavioral and neural measures similarly.

To believe or not to believe? How voice and accent information in speech alter listener impressions of trust

Our decision to believe what another person says can be influenced by vocally expressed confidence in speech and by whether the speaker–listener are members of the same social group. The dynamic effects of these two information sources on neurocognitive processes that promote believability impressions from vocal cues are unclear. Here, English Canadian listeners were presented personal statements ( She has access to the building) produced in a confident or doubtful voice by speakers of their own dialect (in-group) or speakers from two different “out-groups” (regional or foreign-accented English). Participants rated how believable the speaker is for each statement and event-related potentials (ERPs) were analysed from utterance onset. Believability decisions were modulated by both the speaker’s vocal confidence level and their perceived in-group status. For in-group speakers, ERP effects revealed an early differentiation of vocally expressed confidence (i.e., N100, P200), highlighting the motivational significance of doubtful voices for drawing believability inferences. These early effects on vocal confidence perception were qualitatively different or absent when speakers had an accent; evaluating out-group voices was associated with increased demands on contextual integration and re-analysis of a non-native representation of believability (i.e., increased N400, late negativity response). Accent intelligibility and experience with particular out-group accents each influenced how vocal confidence was processed for out-group speakers. The N100 amplitude was sensitive to out-group attitudes and predicted actual believability decisions for certain out-group speakers. We propose a neurocognitive model in which vocal identity information (social categorization) dynamically influences how vocal expressions are decoded and used to derive social inferences during person perception.

Electrical Brain Responses Reveal Sequential Constraints on Planning during Music Performance

Elements in speech and music unfold sequentially over time. To produce sentences and melodies quickly and accurately, individuals must plan upcoming sequence events, as well as monitor outcomes via auditory feedback. We investigated the neural correlates of sequential planning and monitoring processes by manipulating auditory feedback during music performance. Pianists performed isochronous melodies from memory at an initially cued rate while their electroencephalogram was recorded. Pitch feedback was occasionally altered to match either an immediately upcoming Near-Future pitch (next sequence event) or a more distant Far-Future pitch (two events ahead of the current event). Near-Future, but not Far-Future altered feedback perturbed the timing of pianists' performances, suggesting greater interference of Near-Future sequential events with current planning processes. Near-Future feedback triggered a greater reduction in auditory sensory suppression (enhanced response) than Far-Future feedback, reflected in the P2 component elicited by the pitch event following the unexpected pitch change. Greater timing perturbations were associated with enhanced cortical sensory processing of the pitch event following the Near-Future altered feedback. Both types of feedback alterations elicited feedback-related negativity (FRN) and P3a potentials and amplified spectral power in the theta frequency range. These findings suggest similar constraints on producers' sequential planning to those reported in speech production.

Machiavellianism and early neural responses to others' facial expressions caused by one's own decisions

The processing of social stimuli generated by one's own voluntary behavior is an element of social adaptation. It is known that self-generated stimuli induce attenuated sensory experiences compared with externally generated stimuli. The present study aimed to examine this self-specific attenuation effect on early stimulus processing in the case of others' facial expressions during interpersonal interactions. In addition, this study explored the possibility that the self-specific attenuation effect on social cognition is modulated by antisocial personality traits such as Machiavellianism. We analyzed early components of the event-related brain potential in participants elicited by happy and sad facial expressions of others when the participant's decision was responsible for the others' emotions and when the others' facial expressions were independent of the participant's decision. Compared to the non-responsible condition, the responsible condition showed an attenuated amplitude of the N170 component in response to sad faces. Moreover, Machiavellianism explained individual differences in the self-specific attenuation effect depending on the affective valence of social signals. The present findings support the possibility that the self-specific attenuation effect extends to interpersonal interactions and imply that distorted cognition of others' emotions caused by one's own behavior is associated with personality disorders that promote antisocial behaviors.

Attenuation of visual evoked responses to hand and saccade-initiated flashes

Sensory attenuation refers to reduced brain responses to self-initiated sensations relative to those produced by the external world. It is a low-level process that may be linked to higher-level cognitive tasks such as reality monitoring. The phenomenon is often explained by prediction error mechanisms of universal applicability to sensory modality; however, it is most widely reported for auditory stimuli resulting from self-initiated hand movements. The present series of event-related potential (ERP) experiments explored the generalizability of sensory attenuation to the visual domain by exposing participants to flashes initiated by either their own button press or volitional saccade and comparing these conditions to identical, computer-initiated stimuli. The key results showed that the largest reduction of anterior visual N1 amplitude occurred for saccade-initiated flashes, while button press-initiated flashes evoked an intermediary response between the saccade-initiated and externally initiated conditions. This indicates that sensory attenuation occurs for visual stimuli and suggests that the degree of electrophysiological attenuation may relate to the causal likelihood of pairings between the type of motor action and the modality of its sensory response.

The function and failure of sensory predictions

Humans and other primates are equipped with neural mechanisms that allow them to automatically make predictions about future events, facilitating processing of expected sensations and actions. Prediction-driven control and monitoring of perceptual and motor acts are vital to normal cognitive functioning. This review provides an overview of corollary discharge mechanisms involved in predictions across sensory modalities and discusses consequences of predictive coding for cognition and behavior. Converging evidence now links impairments in corollary discharge mechanisms to neuropsychiatric symptoms such as hallucinations and delusions. We review studies supporting a prediction-failure hypothesis of perceptual and cognitive disturbances. We also outline neural correlates underlying prediction function and failure, highlighting similarities across the visual, auditory, and somatosensory systems. In linking basic psychophysical and psychophysiological evidence of visual, auditory, and somatosensory prediction failures to neuropsychiatric symptoms, our review furthers our understanding of disease mechanisms.

Timing in Predictive Coding: The Roles of Task Relevance and Global Probability

Predictive coding models of attention propose that attention and prediction operate synergistically to optimize perception, as reflected in interactive effects on early sensory neural responses. It is yet unclear whether attention and prediction based on the temporal attributes of expected events operate in a similar fashion. We investigated how attention and prediction based on timing interact by manipulating the task relevance and a priori probability of auditory stimulus onset timing within a go/no-go task while recording EEG. Preparatory activity, as indexed via the contingent negative variation, reflected temporally specific anticipation as a function of both attention and prediction. Higher stimulus probability led to significant predictive N1 suppression; however, we failed to find an effect of task relevance on N1 amplitude and an interaction of task relevance with prediction. We suggest the predictability of sensory timing is the predominant influence on early sensory responses where a priori probabilities allow for strong prior beliefs. When this is the case, we find that the effects of temporal prediction on early sensory responses are independent of the task relevance of sensory stimuli. Our findings contribute to the expansion of predictive coding frameworks to include the role of timing in sensory processing.

Studying auditory verbal hallucinations using the RDoC framework

In this paper, I explain why I adopted a Research Domain Criteria (RDoC) approach to study the neurobiology of auditory verbal hallucinations (AVH), or voices. I explain that the RDoC construct of "agency" fits well with AVH phenomenology. To the extent that voices sound nonself, voice hearers lack a sense of agency over the voices. Using a vocalization paradigm like those used with nonhuman primates to study mechanisms subserving the sense of agency, we find that the auditory N1 ERP is suppressed during vocalization, that EEG synchrony preceding speech onset is related to N1 suppression, and that both are reduced in patients with schizophrenia. Reduced cortical suppression is also seen across multiple psychotic disorders and in clinically high-risk youth, but it is not related to AVH. The motor activity preceding talking and connectivity between frontal and temporal lobes during talking have both proved sensitive to AVH, suggesting neural activity and connectivity associated with intentions to act may be a better way to study agency and predictions based on agency.

Self-initiated actions result in suppressed auditory but amplified visual evoked components in healthy participants

Self-suppression refers to the phenomenon that sensations initiated by our own movements are typically less salient, and elicit an attenuated neural response, compared to sensations resulting from changes in the external world. Evidence for self-suppression is provided by previous ERP studies in the auditory modality, which have found that healthy participants typically exhibit a reduced auditory N1 component when auditory stimuli are self-initiated as opposed to externally initiated. However, the literature investigating self-suppression in the visual modality is sparse, with mixed findings and experimental protocols. An EEG study was conducted to expand our understanding of self-suppression across different sensory modalities. Healthy participants experienced either an auditory (tone) or visual (pattern-reversal) stimulus following a willed button press (self-initiated), a random interval (externally initiated, unpredictable onset), or a visual countdown (externally initiated, predictable onset-to match the intrinsic predictability of self-initiated stimuli), while EEG was continuously recorded. Reduced N1 amplitudes for self- versus externally initiated tones indicated that self-suppression occurred in the auditory domain. In contrast, the visual N145 component was amplified for self- versus externally initiated pattern reversals. Externally initiated conditions did not differ as a function of their predictability. These findings highlight a difference in sensory processing of self-initiated stimuli across modalities, and may have implications for clinical disorders that are ostensibly associated with abnormal self-suppression.

The role of mechanical impact in action-related auditory attenuation

A number of studies have shown that sounds temporally close to one's own finger movements elicit lower-amplitude auditory event-related potentials (ERPs) than do the same tones when they are only listened to. In these studies, the actions have involved making a mechanical contact with an object. In the present study, the role of mechanical contact with an object was investigated in action-related auditory attenuation. In three experiments, participants performed a time-interval production task. In each experiment, in one condition the action involved touching an object, but no mechanical contact was made in the other. The estimated tone-related ERP contributions to the action-tone coincidence ERP waveforms (calculated by subtracting the action-related ERP from the coincidence ERP) were more attenuated when the action involved moving the finger and making a mechanical contact at the end of the movement. However, when participants kept their finger on a piezoelectric element and applied pressure impulses without moving their finger, the action did not result in stronger attenuation of the tone-related auditory ERP estimates. Although these results may suggest that auditory ERP attenuation is stronger for actions resulting in mechanical impact, they also imply that mechanical impact may confound and lead to the overestimation of auditory ERP attenuation in such paradigms, because the impact may result in faint but audible sounds.

Action-related auditory ERP attenuation: Paradigms and hypotheses

A number studies have shown that the auditory N1 event-related potential (ERP) is attenuated when elicited by self-induced or self-generated sounds. Because N1 is a correlate of auditory feature- and event-detection, it was generally assumed that N1-attenuation reflected the cancellation of auditory re-afference, enabled by the internal forward modeling of the predictable sensory consequences of the given action. Focusing on paradigms utilizing non-speech actions, the present review summarizes recent progress on action-related auditory attenuation. Following a critical analysis of the most widely used, contingent paradigm, two further hypotheses on the possible causes of action-related auditory ERP attenuation are presented. The attention hypotheses suggest that auditory ERP attenuation is brought about by a temporary division of attention between the action and the auditory stimulation. The pre-activation hypothesis suggests that the attenuation is caused by the activation of a sensory template during the initiation of the action, which interferes with the incoming stimulation. Although each hypothesis can account for a number of findings, none of them can accommodate the whole spectrum of results. It is suggested that a better understanding of auditory ERP attenuation phenomena could be achieved by systematic investigations of the types of actions, the degree of action-effect contingency, and the temporal characteristics of action-effect contingency representation-buildup and -deactivation. This article is part of a Special Issue entitled SI: Prediction and Attention.

Implicit Agency in Observed Actions: Evidence for N1 Suppression of Tones Caused by Self-made and Observed Actions

Every day we make attributions about how our actions and the actions of others cause consequences in the world around us. It is unknown whether we use the same implicit process in attributing causality when observing others' actions as we do when making our own. The aim of this research was to investigate the neural processes involved in the implicit sense of agency we form between actions and effects, for both our own actions and when watching others' actions. Using an interval estimation paradigm to elicit intentional binding in self-made and observed actions, we measured the EEG responses indicative of anticipatory processes before an action and the ERPs in response to the sensory consequence. We replicated our previous findings that we form a sense of implicit agency over our own and others' actions. Crucially, EEG results showed that tones caused by either self-made or observed actions both resulted in suppression of the N1 component of the sensory ERP, with no difference in suppression between consequences caused by observed actions compared with self-made actions. Furthermore, this N1 suppression was greatest for tones caused by observed goal-directed actions rather than non-action or non-goal-related visual events. This suggests that top–down processes act upon the neural responses to sensory events caused by goal-directed actions in the same way for events caused by the self or those made by other agents.

Attention and prediction in human audition: a lesson from cognitive psychophysiology

Attention is a hypothetical mechanism in the service of perception that facilitates the processing of relevant information and inhibits the processing of irrelevant information. Prediction is a hypothetical mechanism in the service of perception that considers prior information when interpreting the sensorial input. Although both (attention and prediction) aid perception, they are rarely considered together. Auditory attention typically yields enhanced brain activity, whereas auditory prediction often results in attenuated brain responses. However, when strongly predicted sounds are omitted, brain responses to silence resemble those elicited by sounds. Studies jointly investigating attention and prediction revealed that these different mechanisms may interact, e.g. attention may magnify the processing differences between predicted and unpredicted sounds. Following the predictive coding theory, we suggest that prediction relates to predictions sent down from predictive models housed in higher levels of the processing hierarchy to lower levels and attention refers to gain modulation of the prediction error signal sent up to the higher level. As predictions encode contents and confidence in the sensory data, and as gain can be modulated by the intention of the listener and by the predictability of the input, various possibilities for interactions between attention and prediction can be unfolded. From this perspective, the traditional distinction between bottom-up/exogenous and top-down/endogenous driven attention can be revisited and the classic concepts of attentional gain and attentional trace can be integrated.

Motor Intention Determines Sensory Attenuation of Brain Responses to Self-initiated Sounds

One of the functions of the brain is to predict sensory consequences of our own actions. In auditory processing, self-initiated sounds evoke a smaller brain response than passive sound exposure of the same sound sequence. Previous work suggests that this response attenuation reflects a predictive mechanism to differentiate the sensory consequences of one's own actions from other sensory input, which seems to form the basis for the sense of agency (recognizing oneself as the agent of the movement). This study addresses the question whether attenuation of brain responses to self-initiated sounds can be explained by brain activity involved in movement planning rather than movement execution. We recorded ERPs in response to sounds initiated by button presses. In one condition, participants moved a finger to press the button voluntarily, whereas in another condition, we initiated a similar, but involuntary, finger movement by stimulating the corresponding region of the primary motor cortex with TMS. For involuntary movements, no movement intention (and no feeling of agency) could be formed; thus, no motor plans were available to the forward model. A portion of the brain response evoked by the sounds, the N1-P2 complex, was reduced in amplitude following voluntary, self-initiated movements, but not following movements initiated by motor cortex stimulation. Our findings demonstrate that movement intention and the corresponding feeling of agency determine sensory attenuation of brain responses to self-initiated sounds. The present results support the assumptions of a predictive internal forward model account operating before primary motor cortex activation.

Did I do that? Abnormal predictive processes in schizophrenia when button pressing to deliver a tone

Motor actions are preceded by an efference copy of the motor command, resulting in a corollary discharge of the expected sensation in sensory cortex. These mechanisms allow animals to predict sensations, suppress responses to self-generated sensations, and thereby process sensations efficiently and economically. During talking, patients with schizophrenia show less evidence of pretalking activity and less suppression of the speech sound, consistent with dysfunction of efference copy and corollary discharge, respectively. We asked if patterns seen in talking would generalize to pressing a button to hear a tone, a paradigm translatable to less vocal animals. In 26 patients [23 schizophrenia, 3 schizoaffective (SZ)] and 22 healthy controls (HC), suppression of the N1 component of the auditory event-related potential was estimated by comparing N1 to tones delivered by button presses and N1 to those tones played back. The lateralized readiness potential (LRP) associated with the motor plan preceding presses to deliver tones was estimated by comparing right and left hemispheres' neural activity. The relationship between N1 suppression and LRP amplitude was assessed. LRP preceding button presses to deliver tones was larger in HC than SZ, as was N1 suppression. LRP amplitude and N1 suppression were correlated in both groups, suggesting stronger efference copies are associated with stronger corollary discharges. SZ have reduced N1 suppression, reflecting corollary discharge action, and smaller LRPs preceding button presses to deliver tones, reflecting the efference copy of the motor plan. Effects seen during vocalization largely extend to other motor acts more translatable to lab animals.

Suppression of the auditory N1-component for heartbeat-related sounds reflects interoceptive predictive coding

Although many studies have elucidated the neurocognitive mechanisms supporting the processing of externally generated sensory signals, less is known about the processing of interoceptive signals related to the viscera. Drawing a parallel with research on agency and the perception of self-generated action effects, in the present EEG study we report a reduced auditory N1 component when participants listened to heartbeat-related sounds compared to externally generated sounds. The auditory suppression for heartbeat sounds was robust and persisted after controlling for ECG-related artifacts, the number of trials involved and the phase of the cardiac cycle. In addition, the auditory N1 suppression for heartbeat-related sounds had a comparable scalp distribution as the N1 suppression observed for actively generated sounds. This finding indicates that the brain automatically differentiates between heartbeat-related and externally generated sounds through a process of sensory suppression, suggesting that a comparable predictive mechanism may underlie the processing of heartbeat and action-related information. Extending recent behavioral data about cardio-visual integration, the present cardio-auditory EEG data reveal that the processing of sounds in auditory cortex is systematically modulated by an interoceptive cardiac signal. The findings are discussed with respect to theories of interoceptive awareness, emotion, predictive coding, and their relevance to bodily self-consciousness.

Differential effects of temporal regularity on auditory-evoked response amplitude: a decrease in silence and increase in noise

Background

In daily life, we are continuously exposed to temporally regular and irregular sounds. Previous studies have demonstrated that the temporal regularity of sound sequences influences neural activity. However, it remains unresolved how temporal regularity affects neural activity in noisy environments, when attention of the listener is not focused on the sound input.

Methods

In the present study, using magnetoencephalography we investigated the effects of temporal regularity in sound signal sequencing (regular vs. irregular) in silent versus noisy environments during distracted listening.

Results

The results demonstrated that temporal regularity differentially affected the auditory-evoked N1m response depending on the background acoustic environment: the N1m amplitudes elicited by the temporally regular sounds were smaller in silence and larger in noise than those elicited by the temporally irregular sounds.

Conclusions

Our results indicate that the human auditory system is able to involuntarily utilize temporal regularity in sound signals to modulate the neural activity in the auditory cortex in accordance with the surrounding acoustic environment.

What does motor efference copy represent? Evidence from speech production

How precisely does the brain predict the sensory consequences of our actions? Efference copy is thought to reflect the predicted sensation of self-produced motor acts, such as the auditory feedback heard while speaking. Here, we use magnetoencephalographic imaging (MEG-I) in human speakers to demonstrate that efference copy prediction does not track movement variability across repetitions of the same motor task. Specifically, spoken vowels were less accurately predicted when they were less similar to a speaker's median production, even though the prediction is thought to be based on the very motor commands that generate each vowel. Auditory cortical responses to less prototypical speech productions were less suppressed, resembling responses to speech errors, and were correlated with later corrective movement, suggesting that the suppression may be functionally significant for error correction. The failure of the motor system to accurately predict less prototypical speech productions suggests that the efferent-driven suppression does not reflect a sensory prediction, but a sensory goal.

The ups and downs of temporal orienting: a review of auditory temporal orienting studies and a model associating the heterogeneous findings on the auditory N1 with opposite effects of attention and prediction

The temporal orienting of attention refers to the process of focusing (neural) resources on a particular time point in order to boost the processing of and the responding to sensory events. Temporal attention is manipulated by varying the task-relevance of events at different time points or by inducing expectations that an event occurs at a particular time point. Notably, the electrophysiological correlates of these manipulations at early processing stages are not identical: Auditory studies operationalizing temporal attention through task-relevance consistently found enhancements of early, sensory processing, as shown in the N1 component of the auditory event-related potential (ERP). By contrast, previous work on temporal orienting based on expectations showed mixed results: early, sensory processing was either enhanced or attenuated or not affected at all. In the present work, I will review existing findings on temporal orienting with a special focus on the auditory modality and present a working model to reconcile the previously heterogeneous results. Specifically, I will suggest that when expectations are used to manipulate attention, this will lead both to an orienting of attention and to the generation of precise predictions about the upcoming event. Attention and prediction are assumed to have opposite effects on early auditory processing, with temporal attention increasing and temporal predictions decreasing the associated ERP correlate, the auditory N1. The heterogeneous findings of studies manipulating temporal orienting by inducing expectations may thus be the consequence of differences in the relative contribution of attention and prediction processes. The model's predictions will be discussed in the context of a functional interpretation of the auditory N1 as an attention call signal, as presented in a recent model on auditory processing.

Prediction errors in self- and externally-generated deviants

Sounds generated by one's own action elicit attenuated brain responses compared to brain responses to identical sounds that are externally-generated. The present study tested whether the suppression effect indexed by the N1- and P2-components of the event-related potential (ERP) is larger when self-generated sounds are correctly predicted than when they are not. Furthermore, sounds violating a prediction lead to a particular prediction error signal (i.e., N2b, P3a). Thus, we tested whether these error signals increase for self-generated sounds (i.e., enhanced N2b, P3a). We compared ERPs elicited by self- and externally-generated sounds that were of frequent standard and of infrequent deviant pitch. The results confirmed an N1- and P2-suppression effect elicited by self-generated standard sounds. The N1-suppression was smaller in response to self-initiated deviant sounds, indicating the specificity of predictions for self-generated sounds. In addition, an enhancement of N2b and P3a for self-generated deviants revealed the saliency of prediction error signals.