Attention and prediction in human audition: a lesson from cognitive psychophysiology

Violation of identity-specific action-effect prediction increases pupil size and attenuates auditory event-related potentials at P2 latencies when action-effects are behaviorally relevant

Self-initiated sensory action effects are widely assumed to lead to less intense perception and reduced neural responses compared to externally triggered stimuli (sensory attenuation). However, it is unclear if sensory attenuation occurs in all cases of action-effect prediction. Specifically, when predicted action-effects are relevant to determine follow-up actions attenuation could be detrimental. We quantified auditory event-related potentials (ERP) in electroencephalography (EEG) when human participants created two-sound sequences by pressing two keys on a keyboard associated with different pitch, giving rise to identity-specific action-effect prediction after the first keypress. The first sound corresponded to (congruent) or violated (incongruent) the predicted pitch and was either relevant for the selection of the second keypress to correctly complete the sequence (Relevance) or irrelevant (Control Movement), or there was only one keypress and sound (Baseline). We found a diminished P2-timed ERP component in incongruent compared to congruent trials when the sound was relevant for the subsequent action. This effect of action-effect prediction was due to an ERP reduction for incongruent relevant sounds compared to incongruent irrelevant sounds at P2 latencies and correlated negatively with modulations of pupil dilation. Contrary to our expectation, we did not observe an N1 modulation by congruency in any condition. Attenuation of the N1 component seems absent for predicted identity-specific auditory action effects, while P2-timed ERPs as well as pupil size are sensitive to predictability, at least when action effects are relevant for the selection of the next action. Incongruent relevant stimuli thereby take a special place and seem to be subject to attentional modulations and error processing.

Sensory Attenuation Deficit and Auditory Hallucinations in Schizophrenia: A Causal Mechanism or a Risk Factor? Evidence From Meta-Analyses on the N1 Event-Related Potential Component

BACKGROUND

Sensory attenuation (SA), the dampened perception of self-generated sensory information, is typically associated with reduced event-related potential signals, such as for the N1 component of auditory event-related potentials. SA, together with efficient monitoring of intentions and actions, should facilitate the distinction between self-generated and externally generated sensory events, thereby optimizing interaction with the world. According to many, SA is deficient in schizophrenia. The question arises whether altered SA reflects a sufficient mechanism to explain positive symptoms such as auditory hallucinations. A systematic association of reduced auditory SA in hallucinating patients would support this hypothesis.

METHODS

We conducted a series of meta-analyses on 15 studies on auditory SA in which the N1 component of event-related potential-electroencephalogram signals was measured during talking (self-generated sensory signals condition) or when listening to prerecorded vocalizations (externally generated sensory signals condition).

RESULTS

We found that individuals with schizophrenia did show some auditory SA because their N1 signal was significantly attenuated in talking conditions compared with listening conditions. However, the magnitude of such attenuation was reduced in individuals with schizophrenia compared to healthy control participants. This phenomenon generalizes independently from the stage of the disease, the severity of positive symptoms, and whether patients have auditory hallucinations or not.

CONCLUSIONS

These findings suggest that reduced SA cannot be a sufficient mechanism for explaining positive symptoms such as auditory hallucinations in schizophrenia. Because reduced SA was also present in participants at risk of schizophrenia, reduced SA may represent a risk factor for the disorder. We discuss the implications of these results for clinical-cognitive models of schizophrenia.

Do actions structure auditory memory? Action-based event segmentation effects on sensory responses, pupil dilation and sequential memory

Our actions shape our everyday experience: what we experience, how we perceive, and remember it are deeply affected by how we interact with the world. Performing an action to deliver a stimulus engages neurophysiological processes which are reflected in the modulation of sensory and pupil responses. We hypothesized that these processes shape memory encoding, parsing the experience by grouping self- and externally generated stimuli into differentiated events. Participants encoded sound sequences, in which either the first or last few sounds were self-generated and the rest externally generated. We tested recall of the sequential order of sounds that had originated from the same (within event) or different sources (across events). Memory performance was not higher for within-event sounds, suggesting that actions did not structure the memory representation. However, during encoding, we observed the expected electrophysiological response attenuation for self-generated sounds, together with increased pupil dilation triggered by actions. Moreover, at the boundary between events, physiological responses to the first sound from the new source were influenced by the direction of the source switch. Our results suggest that introducing actions creates a stronger contextual shift than removing them, even though actions do not directly contribute to memory performance. This study contributes to our understanding of how interacting with sensory input shapes experiences by exploring the relationships between action effects on sensory responses, pupil dilation, and memory encoding. Importantly, it challenges the notion of a meaningful contribution from low-level neurophysiological mechanisms associated with action execution in the modulation of the self-generation effect.

Suppression and omission effects in auditory predictive processing-Two of the same?

Recent theories describe perception as an inferential process based on internal predictive models that are adjusted by prediction violations (prediction error). Two different modulations of the auditory N1 event-related brain potential component are often discussed as an expression of auditory predictive processing. The sound-related N1 component is attenuated for self-generated sounds compared to the N1 elicited by externally generated sounds (N1 suppression). An omission-related component in the N1 time-range is elicited when the self-generated sounds are occasionally omitted (omission N1). Both phenomena were explained by action-related forward modelling, which takes place when the sensory input is predictable: prediction error signals are reduced when predicted sensory input is presented (N1 suppression) and elicited when predicted sensory input is omitted (omission N1). This common theoretical account is appealing but has not yet been directly tested. We manipulated the predictability of a sound in a self-generation paradigm in which, in two conditions, either 80% or 50% of the button presses did generate a sound, inducing a strong or a weak expectation for the occurrence of the sound. Consistent with the forward modelling account, an omission N1 was observed in the 80% but not in the 50% condition. However, N1 suppression was highly similar in both conditions. Thus, our results demonstrate a clear effect of predictability for the omission N1 but not for the N1 suppression. These results imply that the two phenomena rely (at least in part) on different mechanisms and challenge prediction related accounts of N1 suppression.

When performing actions with robots, attribution of intentionality affects the sense of joint agency

Sense of joint agency (SoJA) is the sense of control experienced by humans when acting with others to bring about changes in the shared environment. SoJA is proposed to arise from the sensorimotor predictive processes underlying action control and monitoring. Because SoJA is a ubiquitous phenomenon occurring when we perform actions with other humans, it is of great interest and importance to understand whether-and under what conditions-SoJA occurs in collaborative tasks with humanoid robots. In this study, using behavioral measures and neural responses measured by electroencephalography (EEG), we aimed to evaluate whether SoJA occurs in joint action with the humanoid robot iCub and whether its emergence is influenced by the perceived intentionality of the robot. Behavioral results show that participants experienced SoJA with the robot partner when it was presented as an intentional agent but not when it was presented as a mechanical artifact. EEG results show that the mechanism that influences the emergence of SoJA in the condition when the robot is presented as an intentional agent is the ability to form similarly accurate predictions about the sensory consequences of our own and others' actions, leading to similar modulatory activity over sensory processing. Together, our results shed light on the joint sensorimotor processing mechanisms underlying the emergence of SoJA in human-robot interaction and underscore the importance of attribution of intentionality to the robot in human-robot collaboration.

Motor dominance and movement-outcome congruency influence the electrophysiological correlates of sensory attenuation for self-induced visual stimuli

This study explores the impact of movement-outcome congruency and motor dominance on the action-associated modulations of early visual event-related potentials (ERPs). Employing the contingent paradigm, participants with varying degrees of motor dominance were exposed to stimuli depicting left or right human hands in the corresponding visual hemifields. Stimuli were either passively observed or evoked by voluntary button-presses with the dominant or non-dominant hand, in a manner that was either congruent or incongruent with stimulus laterality and hemifield. Early occipital responses (C1 and P1 components) revealed modulations consistent with sensory attenuation (SA) for self-evoked stimuli. Our findings suggest that sensory attenuation during the initial stages of visual processing (C1 component) is a general phenomenon across all degrees of handedness and stimulus/movement combinations. However, the magnitude of C1 suppression was modulated by handedness and movement-stimulus congruency, reflecting stronger SA in right-handed participants for stimuli depicting the right hand, when elicited by actions of the corresponding hand, and measured above the contralateral occipital lobe. P1 modulation suggested concurrent but opposing influences of attention and sensory prediction, with more pronounced suppression following stimulus-congruent button-presses over the hemisphere contralateral to movement, especially in left-handed individuals. We suggest that effects of motor dominance on the degree of SA may stem from functional/anatomical asymmetries in the processing of body parts (C1) and attention networks (P1). Overall, our results demonstrate the modulating effect of hand dominance and movement-outcome congruency on SA, underscoring the need for deeper exploration of their interplay. Additional empirical evidence in this direction could substantiate a premotor account for action-associated modulation of early sensory processing in the visual domain.

Prime-induced illusion of control: The influence of unconscious priming on self-initiated actions and the role of regression to the mean

To what degree human cognition is influenced by subliminal stimuli is a controversial empirical question. One striking example was reported by Linser and Goschke (2007): participants overestimated how much control they had over objectively uncontrollable stimuli when masked congruent primes were presented immediately before the action. Critically, however, unawareness of the masked primes was established by post hoc data selection. In our preregistered study we sought to explore these findings while adjusting prime visibility based on individual thresholds, so that each participant underwent both visible and non-visible conditions. In experiment 1, N = 39 participants engaged in a control judgement task: following the presentation of a semantic prime, they freely selected between two keys, which triggered the appearance of a colored circle. The color of the circles, however, was independent of the key-press. Subsequently, participants assessed their perceived control over the circle's color, based on their key-presses, via a rating scale that ranged from 0 % (no control) to 100 % (complete control). Contrary to Linser and Goschke (2007)'s findings, this experiment demonstrated that predictive information influenced the experience of agency only when primes were consciously processed. In experiment 2, utilizing symbolic (arrow) primes, N = 35 participants had to rate their feeling of control over the effect-stimulus' identity during a two-choice identification paradigm (i.e., they were instructed to press a key corresponding to a target stimulus; with a contingency between target and effect stimulus of 75 %/25 %). The results revealed no significant influence of subliminal priming on agency perceptions. In summary, this study implies that unconscious stimuli may not exert a substantial influence on the conscious experience of agency, underscoring the need for careful consideration of methodological aspects and experimental design's impact on observed phenomena.

High visual salience of alert signals can lead to a counterintuitive increase of reaction times

It is often assumed that rendering an alert signal more salient yields faster responses to this alert. Yet, there might be a trade-off between attracting attention and distracting from task execution. Here we tested this in four behavioral experiments with eye-tracking using an abstract alert-signal paradigm. Participants performed a visual discrimination task (primary task) while occasional alert signals occurred in the visual periphery accompanied by a congruently lateralized tone. Participants had to respond to the alert before proceeding with the primary task. When visual salience (contrast) or auditory salience (tone intensity) of the alert were increased, participants directed their gaze to the alert more quickly. This confirms that more salient alerts attract attention more efficiently. Increasing auditory salience yielded quicker responses for the alert and primary tasks, apparently confirming faster responses altogether. However, increasing visual salience did not yield similar benefits: instead, it increased the time between fixating the alert and responding, as high-salience alerts interfered with alert-task execution. Such task interference by high-salience alert-signals counteracts their more efficient attentional guidance. The design of alert signals must be adapted to a "sweet spot" that optimizes this stimulus-dependent trade-off between maximally rapid attentional orienting and minimal task interference.

Tracking the habituation of the event-related EEG potential in automatic change detection using an auditory two-tone oddball paradigm

The mismatch negativity and the P3a of the event-related EEG potential reflect the electrocortical response to a deviant stimulus in a series of stimuli. Although both components have been investigated in various paradigms, these paradigms usually incorporate many repetitions of the same deviant, thus leaving open whether both components vary as a function of the deviant's position in a series of deviant stimuli-i.e. whether they are subject to qualitative/quantitative habituation from one instantiation of a deviant to the next. This is so because the detection of mismatch negativity/P3a in the event-related EEG potential requires an averaging over dozens or hundreds of stimuli, i.e. over many instantiations of the deviant per participant. The present study addresses this research gap. We used a two-tone oddball paradigm implementing only a small number of (deviant) stimuli per participant, but applying it to a large number of participants (n > 230). Our data show that the mismatch negativity amplitude exhibits no decrease as a function of the deviant's position in a series of (standard and) deviant stimuli. Importantly, only after the very first deviant stimulus, a distinct P3a could be detected, indicative of an orienting reaction and an attention shift, and thus documenting a dissociation of mismatch negativity and P3a.

Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network

Selective attention-related top-down modulation plays a significant role in separating relevant speech from irrelevant background speech when vocal attributes separating concurrent speakers are small and continuously evolving. Electrophysiological studies have shown that such top-down modulation enhances neural tracking of attended speech. Yet, the specific cortical regions involved remain unclear due to the limited spatial resolution of most electrophysiological techniques. To overcome such limitations, we collected both electroencephalography (EEG) (high temporal resolution) and functional magnetic resonance imaging (fMRI) (high spatial resolution), while human participants selectively attended to speakers in audiovisual scenes containing overlapping cocktail party speech. To utilise the advantages of the respective techniques, we analysed neural tracking of speech using the EEG data and performed representational dissimilarity-based EEG-fMRI fusion. We observed that attention enhanced neural tracking and modulated EEG correlates throughout the latencies studied. Further, attention-related enhancement of neural tracking fluctuated in predictable temporal profiles. We discuss how such temporal dynamics could arise from a combination of interactions between attention and prediction as well as plastic properties of the auditory cortex. EEG-fMRI fusion revealed attention-related iterative feedforward-feedback loops between hierarchically organised nodes of the ventral auditory object related processing stream. Our findings support models where attention facilitates dynamic neural changes in the auditory cortex, ultimately aiding discrimination of relevant sounds from irrelevant ones while conserving neural resources.

Somatosensory omissions reveal action-related predictive processing

The intricate relation between action and somatosensory perception has been studied extensively in the past decades. Generally, a forward model is thought to predict the somatosensory consequences of an action. These models propose that when an action is reliably coupled to a tactile stimulus, unexpected absence of the stimulus should elicit prediction error. Although such omission responses have been demonstrated in the auditory modality, it remains unknown whether this mechanism generalizes across modalities. This study therefore aimed to record action-induced somatosensory omission responses using EEG in humans. Self-paced button presses were coupled to somatosensory stimuli in 88% of trials, allowing a prediction, or in 50% of trials, not allowing a prediction. In the 88% condition, stimulus omission resulted in a neural response consisting of multiple components, as revealed by temporal principal component analysis. The oN1 response suggests similar sensory sources as stimulus-evoked activity, but an origin outside primary cortex. Subsequent oN2 and oP3 responses, as previously observed in the auditory domain, likely reflect modality-unspecific higher order processes. Together, findings straightforwardly demonstrate somatosensory predictions during action and provide evidence for a partially amodal mechanism of prediction error generation.

Cardio-audio synchronization elicits neural and cardiac surprise responses in human wakefulness and sleep

The human brain can encode auditory regularities with fixed sound-to-sound intervals and with sound onsets locked to cardiac inputs. Here, we investigated auditory and cardio-audio regularity encoding during sleep, when bodily and environmental stimulus processing may be altered. Using electroencephalography and electrocardiography in healthy volunteers (N = 26) during wakefulness and sleep, we measured the response to unexpected sound omissions within three regularity conditions: synchronous, where sound and heartbeat are temporally coupled, isochronous, with fixed sound-to-sound intervals, and a control condition without regularity. Cardio-audio regularity encoding manifested as a heartbeat deceleration upon omissions across vigilance states. The synchronous and isochronous sequences induced a modulation of the omission-evoked neural response in wakefulness and N2 sleep, the former accompanied by background oscillatory activity reorganization. The violation of cardio-audio and auditory regularity elicits cardiac and neural responses across vigilance states, laying the ground for similar investigations in altered consciousness states such as coma and anaesthesia.

Self-initiation enhances perceptual processing of auditory stimuli in an online study

Understanding how the brain incorporates sensory and motor information will enable better theory building on human perception and behavior. In this study, we aimed to estimate the influence of predictive mechanisms on the magnitude and variability of sensory attenuation in two online samples. After the presentation of a visual cue stimulus, participants (Experiment 1: N = 224, Experiment 2: N = 84) compared the loudness of two consecutive tones in a two-alternative forced-choice task. In Experiment 1, the first tone was either self-initiated or not; in Experiment 2, the second tone was either self-initiated or not (active and passive condition, respectively). We further manipulated identity prediction (i.e., the congruence of pre-learned cue-sound combinations; congruent vs. incongruent), and the duration of the onset delay (to account for effects of attentional differences between the passive and active condition, 50 ms vs. 0 ms). We critically discuss our results within the framework of both classical (i.e., motor-based forward models) and contemporary approaches (i.e., predictive processing framework). Contrary to our preregistered hypothesis, we observed enhanced perceptual processing, instead of attenuation, for self-initiated auditory sensory input. Further, our results reveal an effect of fixed sound delays on the processing of motor and non-motor-based predictive information, and may point to according shifts in attention, leading to a perceptual bias. These results might best be captured by a hybrid explanatory model, combining predictions based on self-initiated motor action with a global predictive mechanism.

Aberrant hyperfocusing in schizophrenia indicated by elevated theta phase-gamma amplitude coupling

OBJECTIVE

We aimed to investigate electroencephalographic (EEG) markers of aberrant hyperfocusing, a novel framework of impaired selective attention, in schizophrenia patients by using theta phase-gamma amplitude coupling (TGC).

METHODS

Fifty-four schizophrenia patients and 73 healthy controls (HCs) underwent EEG recording during an auditory oddball paradigm. For the standard and target conditions, TGC was calculated using the source signals from 25 brain regions of interest (ROIs) related to attention networks and sensory processing; TGC values were then compared across groups and conditions using two-way analysis of covariance. Correlations of altered TGC with performance on the Trail Making Test Parts A and B (TMT-A/B), were explored.

RESULTS

Compared to HCs, schizophrenia patients showed elevated TGC in the left inferior frontal gyrus (IFG) and superior temporal gyrus in the standard condition but not in the target condition. Correlation analyses revealed that the TGC in the left IFG was positively correlated with the TMT-A/B completion times.

CONCLUSIONS

Aberrant hyperfocusing, as reflected by elevated TGC in attention-related brain regions, was related to behavioral performance on the TMT-A/B in schizophrenia patients.

SIGNIFICANCE

This study suggests that TGC is a electrophysiological marker for aberrant hyperfocusing of attentional processes that may result in cognitive impairments in schizophrenia patients.

Alpha oscillations encode Bayesian belief updating underlying attentional allocation in dynamic environments

In a dynamic environment, expectations of the future constantly change based on updated evidence and affect the dynamic allocation of attention. To further investigate the neural mechanisms underlying attentional expectancies, we employed a modified Central Cue Posner Paradigm in which the probability of cues being valid (that is, accurately indicated the upcoming target location) was manipulated. Attentional deployment to the cued location (α), which was governed by precision of predictions on previous trials, was estimated using a hierarchical Bayesian model and was included as a regressor in the analyses of electrophysiological (EEG) data. Our results revealed that before the target appeared, alpha oscillations (8∼13 Hz) for high-predictability cues (88 % valid) were significantly predicted by precision-dependent attention (α). This relationship was not observed under low-predictability conditions (69 % and 50 % valid cues). After the target appeared, precision-dependent attention (α) correlated with alpha band oscillations only in the valid cue condition and not in the invalid condition. Further analysis under conditions of significant attentional modulation by precision suggested a separate effect of cue orientation. These results provide new insights on how trial-by-trial Bayesian belief updating relates to alpha band encoding of environmentally-sensitive allocation of visual spatial attention.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Elevated EEG heartbeat-evoked potentials in adolescents with more ADHD symptoms

INTRODUCTION

Symptoms of attention deficit hyperactivity disorder (ADHD) are associated with a variety of mental abnormalities, but little is known about the perception and processing of internal signals, i.e., interoception, in individuals with ADHD symptoms. This study aimed to investigate the association between ADHD symptoms and the heartbeat-evoked potential (HEP), known as a neural correlate of automatic interoceptive processing of cardiac signals, in adolescents.

METHODS

HEPs of 47 healthy adolescent participants (53.2 % female) with a mean age of 14.29 years were measured during an emotional face recognition task. In addition, participants completed a self-report screening for ADHD symptoms.

RESULTS

ADHD symptoms were positively related to the HEP activity during the task in three of eight EEG sectors in the left hemisphere, as well as in all sectors in the right hemisphere.

DISCUSSION

This study is the first to demonstrate preliminary a relationship between the strength of HEP activity and ADHD symptoms in awake subjects. This finding of higher HEP amplitudes in subjects with more ADHD symptoms can be interpreted in terms of (i) increased arousal, (ii) altered neural processing of internal processes in an emotion-relevant task, and (iii) a misaligned precision-weighting process of task-irrelevant stimuli according to the predictive coding framework. These different interpretations could be reflected by previous studies showing heterogeneity of psychological deficits in individuals with ADHD symptoms. However, the generalizability to patients with diagnosed ADHD is limited due to the measurement tool for ADHD symptoms and the sample characteristics.

Gender congruence and emotion effects in cross-modal associative learning: Insights from ERPs and pupillary responses

Social and emotional cues from faces and voices are highly relevant and have been reliably demonstrated to attract attention involuntarily. However, there are mixed findings as to which degree associating emotional valence to faces occurs automatically. In the present study, we tested whether inherently neutral faces gain additional relevance by being conditioned with either positive, negative, or neutral vocal affect bursts. During learning, participants performed a gender-matching task on face-voice pairs without explicit emotion judgments of the voices. In the test session on a subsequent day, only the previously associated faces were presented and had to be categorized regarding gender. We analyzed event-related potentials (ERPs), pupil diameter, and response times (RTs) of N = 32 subjects. Emotion effects were found in auditory ERPs and RTs during the learning session, suggesting that task-irrelevant emotion was automatically processed. However, ERPs time-locked to the conditioned faces were mainly modulated by the task-relevant information, that is, the gender congruence of the face and voice, but not by emotion. Importantly, these ERP and RT effects of learned congruence were not limited to learning but extended to the test session, that is, after removing the auditory stimuli. These findings indicate successful associative learning in our paradigm, but it did not extend to the task-irrelevant dimension of emotional relevance. Therefore, cross-modal associations of emotional relevance may not be completely automatic, even though the emotion was processed in the voice.

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Mismatch negativity as a marker of auditory pattern separation

To what extent does incidental encoding of auditory stimuli influence subsequent episodic memory for the same stimuli? We examined whether the mismatch negativity (MMN), an event-related potential generated by auditory change detection, is correlated with participants' ability to discriminate those stimuli (i.e. targets) from highly similar lures and from dissimilar foils. We measured the MMN in 30 young adults (18-32 years, 18 females) using a passive auditory oddball task with standard and deviant 5-tone sequences differing in pitch contour. After exposure, all participants completed an incidental memory test for old targets, lures, and foils. As expected, participants at test exhibited high sensitivity in recognizing target items relative to foils and lower sensitivity in recognizing target items relative to lures. Notably, we found a significant correlation between MMN amplitude and lure discrimination, but not foil discrimination. Our investigation shows that our capacity to discriminate sensory inputs at encoding, as measured by the MMN, translates into precision in memory for those inputs.

Prerequisites of language acquisition in the newborn brain

Learning to decode and produce speech is one of the most demanding tasks faced by infants. Nevertheless, infants typically utter their first words within a year, and phrases soon follow. Here we review cognitive abilities of newborn infants that promote language acquisition, focusing primarily on studies tapping neural activity. The results of these studies indicate that infants possess core adult auditory abilities already at birth, including statistical learning and rule extraction from variable speech input. Thus, the neonatal brain is ready to categorize sounds, detect word boundaries, learn words, and separate speech streams: in short, to acquire language quickly and efficiently from everyday linguistic input.

Neural correlates of visual and tactile path integration and their task related modulation

Self-motion induces sensory signals that allow to determine travel distance (path integration). For veridical path integration, one must distinguish self-generated from externally induced sensory signals. Predictive coding has been suggested to attenuate self-induced sensory responses, while task relevance can reverse the attenuating effect of prediction. But how is self-motion processing affected by prediction and task demands, and do effects generalize across senses? In this fMRI study, we investigated visual and tactile self-motion processing and its modulation by task demands. Visual stimuli simulated forward self-motion across a ground plane. Tactile self-motion stimuli were delivered by airflow across the subjects' forehead. In one task, subjects replicated a previously observed distance (Reproduction/Active; high behavioral demand) of passive self-displacement (Reproduction/Passive). In a second task, subjects travelled a self-chosen distance (Self/Active; low behavioral demand) which was recorded and played back to them (Self/Passive). For both tasks and sensory modalities, Active as compared to Passive trials showed enhancement in early visual areas and suppression in higher order areas of the inferior parietal lobule (IPL). Contrasting high and low demanding active trials yielded supramodal enhancement in the anterior insula. Suppression in the IPL suggests this area to be a comparator of sensory self-motion signals and predictions thereof.

Neuronal responses to omitted tones in the auditory brain: A neuronal correlate for predictive coding

Prediction provides key advantages for survival, and cognitive studies have demonstrated that the brain computes multilevel predictions. Evidence for predictions remains elusive at the neuronal level because of the complexity of separating neural activity into predictions and stimulus responses. We overcome this challenge by recording from single neurons from cortical and subcortical auditory regions in anesthetized and awake preparations, during unexpected stimulus omissions interspersed in a regular sequence of tones. We find a subset of neurons that responds reliably to omitted tones. In awake animals, omission responses are similar to anesthetized animals, but larger and more frequent, indicating that the arousal and attentional state levels affect the degree to which predictions are neuronally represented. Omission-sensitive neurons also responded to frequency deviants, with their omission responses getting emphasized in the awake state. Because omission responses occur in the absence of sensory input, they provide solid and empirical evidence for the implementation of a predictive process.

Exploring the internal forward model: action-effect prediction and attention in sensorimotor processing

Action-effect predictions are believed to facilitate movement based on its association with sensory objectives and suppress the neurophysiological response to self- versus externally generated stimuli (i.e. sensory attenuation). However, research is needed to explore theorized differences in the use of action-effect prediction based on whether movement is uncued (i.e. volitional) or in response to external cues (i.e. stimulus-driven). While much of the sensory attenuation literature has examined effects involving the auditory N1, evidence is also conflicted regarding this component's sensitivity to action-effect prediction. In this study (n = 64), we explored the influence of action-effect contingency on event-related potentials associated with visually cued and uncued movement, as well as resultant stimuli. Our findings replicate recent evidence demonstrating reduced N1 amplitude for tones produced by stimulus-driven movement. Despite influencing motor preparation, action-effect contingency was not found to affect N1 amplitudes. Instead, we explore electrophysiological markers suggesting that attentional mechanisms may suppress the neurophysiological response to sound produced by stimulus-driven movement. Our findings demonstrate lateralized parieto-occipital activity that coincides with the auditory N1, corresponds to a reduction in its amplitude, and is topographically consistent with documented effects of attentional suppression. These results provide new insights into sensorimotor coordination and potential mechanisms underlying sensory attenuation.

Omission responses in local field potentials in rat auditory cortex

BACKGROUND

Non-invasive recordings of gross neural activity in humans often show responses to omitted stimuli in steady trains of identical stimuli. This has been taken as evidence for the neural coding of prediction or prediction error. However, evidence for such omission responses from invasive recordings of cellular-scale responses in animal models is scarce. Here, we sought to characterise omission responses using extracellular recordings in the auditory cortex of anaesthetised rats. We profiled omission responses across local field potentials (LFP), analogue multiunit activity (AMUA), and single/multi-unit spiking activity, using stimuli that were fixed-rate trains of acoustic noise bursts where 5% of bursts were randomly omitted.

RESULTS

Significant omission responses were observed in LFP and AMUA signals, but not in spiking activity. These omission responses had a lower amplitude and longer latency than burst-evoked sensory responses, and omission response amplitude increased as a function of the number of preceding bursts.

CONCLUSIONS

Together, our findings show that omission responses are most robustly observed in LFP and AMUA signals (relative to spiking activity). This has implications for models of cortical processing that require many neurons to encode prediction errors in their spike output.

The neurobiology of functional neurological disorders characterised by impaired awareness

We review the neurobiology of Functional Neurological Disorders (FND), i.e., neurological disorders not explained by currently identifiable histopathological processes, in order to focus on those characterised by impaired awareness (functionally impaired awareness disorders, FIAD), and especially, on the paradigmatic case of Resignation Syndrome (RS). We thus provide an improved more integrated theory of FIAD, able to guide both research priorities and the diagnostic formulation of FIAD. We systematically address the diverse spectrum of clinical presentations of FND with impaired awareness, and offer a new framework for understanding FIAD. We find that unraveling the historical development of neurobiological theory of FIAD is of paramount importance for its current understanding. Then, we integrate contemporary clinical material in order to contextualise the neurobiology of FIAD within social, cultural, and psychological perspectives. We thus review neuro-computational insights in FND in general, to arrive at a more coherent account of FIAD. FIAD may be based on maladaptive predictive coding, shaped by stress, attention, uncertainty, and, ultimately, neurally encoded beliefs and their updates. We also critically appraise arguments in support of and against such Bayesian models. Finally, we discuss implications of our theoretical account and provide pointers towards an improved clinical diagnostic formulation of FIAD. We suggest directions for future research towards a more unified theory on which future interventions and management strategies could be based, as effective treatments and clinical trial evidence remain limited.

A generic neural factor linking resting-state neural dynamics and the brain's response to unexpectedness in multilevel cognition

The brain's response to change is fundamental to learning and adaptation; this implies the presence of a universal neural mechanism under various contexts. We hypothesized that this mechanism manifests in neural activity patterns across low and high levels of cognition during task processing as well as in resting-state neural dynamics, because both these elements are different facets of the same dynamical system. We tested our hypothesis by (i) characterizing (a) the neural response to changes in low-level continuous information stream and unexpectedness at different cognitive levels and (b) the spontaneous neural dynamics in resting state, and (ii) examining the associations among the dynamics according to cross-individual variability (n = 200). Our results showed that the brain's response magnitude was monotonically correlated with the magnitude of information fluctuation in a low-level task, forming a simple psychophysical function; moreover, this effect was found to be associated with the brain's response to unexpectedness in high-level cognitive tasks (including language processing). These coherent multilevel neural effects in task processing were also shown to be strongly associated with resting-state neural dynamics characterized by the waxing and waning of Alpha oscillation. Taken together, our results revealed large-scale consistency between the neural dynamic system and multilevel cognition.

Being active over one's own motion: Considering predictive mechanisms in self-motion perception

Self-motion perception is a key element guiding pilots' behavior. Its importance is mostly revealed when impaired, leading in most cases to spatial disorientation which is still today a major factor of accidents occurrence. Self-motion perception is known as mainly based on visuo-vestibular integration and can be modulated by the physical properties of the environment with which humans interact. For instance, several studies have shown that the respective weight of visual and vestibular information depends on their reliability. More recently, it has been suggested that the internal state of an operator can also modulate multisensory integration. Interestingly, the systems' automation can interfere with this internal state through the loss of the intentional nature of movements (i.e., loss of agency) and the modulation of associated predictive mechanisms. In this context, one of the new challenges is to better understand the relationship between automation and self-motion perception. The present review explains how linking the concepts of agency and self-motion is a first approach to address this issue.

Actions do not clearly impact auditory memory

When memorizing a list of words, those that are read aloud are remembered better than those read silently, a phenomenon known as the production effect. There have been several attempts to understand the production effect, however, actions alone have not been examined as possible contributors. Stimuli that coincide with our own actions are processed differently compared to stimuli presented passively to us. These sensory response modulations may have an impact on how action-revolving inputs are stored in memory. In this study, we investigated whether actions could impact auditory memory. Participants listened to sounds presented either during or in between their actions. We measured electrophysiological responses to the sounds and tested participants' memory of them. Results showed attenuation of sensory responses for action-coinciding sounds. However, we did not find a significant effect on memory performance. The absence of significant behavioral findings suggests that the production effect may be not dependent on the effects of actions per se. We conclude that action alone is not sufficient to improve memory performance, and thus elicit a production effect.

Voluntary self-initiation of the stimuli onset improves working memory and accelerates visual and attentional processing

The ability of an organism to voluntarily control the stimuli onset modulates perceptual and attentional functions. Since stimulus encoding is an essential component of working memory (WM), we conjectured that controlling the initiation of the perceptual process would positively modulate WM. To corroborate this proposition, we tested twenty-five healthy subjects in a modified-Sternberg WM task under three stimuli presentation conditions: an automatic presentation of the stimuli, a self-initiated presentation of the stimuli (through a button press), and a self-initiated presentation with random-delay stimuli onset. Concurrently, we recorded the subjects' electroencephalographic signals during WM encoding. We found that the self-initiated condition was associated with better WM accuracy, and earlier latencies of N1, P2 and P3 evoked potential components representing visual, attentional and mental review of the stimuli processes, respectively. Our work demonstrates that self-initiated stimuli enhance WM performance and accelerate early visual and attentional processes deployed during WM encoding. We also found that self-initiated stimuli correlate with an increased attentional state compared to the other two conditions, suggesting a role for temporal stimuli predictability. Our study remarks on the relevance of self-control of the stimuli onset in sensory, attentional and memory updating processing for WM.

Magnetoencephalography recordings reveal the spatiotemporal dynamics of recognition memory for complex versus simple auditory sequences

Auditory recognition is a crucial cognitive process that relies on the organization of single elements over time. However, little is known about the spatiotemporal dynamics underlying the conscious recognition of auditory sequences varying in complexity. To study this, we asked 71 participants to learn and recognize simple tonal musical sequences and matched complex atonal sequences while their brain activity was recorded using magnetoencephalography (MEG). Results reveal qualitative changes in neural activity dependent on stimulus complexity: recognition of tonal sequences engages hippocampal and cingulate areas, whereas recognition of atonal sequences mainly activates the auditory processing network. Our findings reveal the involvement of a cortico-subcortical brain network for auditory recognition and support the idea that stimulus complexity qualitatively alters the neural pathways of recognition memory.

Brain activity during shadowing of audiovisual cocktail party speech, contributions of auditory-motor integration and selective attention

Selective listening to cocktail-party speech involves a network of auditory and inferior frontal cortical regions. However, cognitive and motor cortical regions are differentially activated depending on whether the task emphasizes semantic or phonological aspects of speech. Here we tested whether processing of cocktail-party speech differs when participants perform a shadowing (immediate speech repetition) task compared to an attentive listening task in the presence of irrelevant speech. Participants viewed audiovisual dialogues with concurrent distracting speech during functional imaging. Participants either attentively listened to the dialogue, overtly repeated (i.e., shadowed) attended speech, or performed visual or speech motor control tasks where they did not attend to speech and responses were not related to the speech input. Dialogues were presented with good or poor auditory and visual quality. As a novel result, we show that attentive processing of speech activated the same network of sensory and frontal regions during listening and shadowing. However, in the superior temporal gyrus (STG), peak activations during shadowing were posterior to those during listening, suggesting that an anterior-posterior distinction is present for motor vs. perceptual processing of speech already at the level of the auditory cortex. We also found that activations along the dorsal auditory processing stream were specifically associated with the shadowing task. These activations are likely to be due to complex interactions between perceptual, attention dependent speech processing and motor speech generation that matches the heard speech. Our results suggest that interactions between perceptual and motor processing of speech relies on a distributed network of temporal and motor regions rather than any specific anatomical landmark as suggested by some previous studies.

Laminar functional magnetic resonance imaging in vision research

Magnetic resonance imaging (MRI) scanners at ultra-high magnetic fields have become available to use in humans, thus enabling researchers to investigate the human brain in detail. By increasing the spatial resolution, ultra-high field MR allows both structural and functional characterization of cortical layers. Techniques that can differentiate cortical layers, such as histological studies and electrode-based measurements have made critical contributions to the understanding of brain function, but these techniques are invasive and thus mainly available in animal models. There are likely to be differences in the organization of circuits between humans and even our closest evolutionary neighbors. Thus research on the human brain is essential. Ultra-high field MRI can observe differences between cortical layers, but is non-invasive and can be used in humans. Extensive previous literature has shown that neuronal connections between brain areas that transmit feedback and feedforward information terminate in different layers of the cortex. Layer-specific functional MRI (fMRI) allows the identification of layer-specific hemodynamic responses, distinguishing feedback and feedforward pathways. This capability has been particularly important for understanding visual processing, as it has allowed researchers to test hypotheses concerning feedback and feedforward information in visual cortical areas. In this review, we provide a general overview of successful ultra-high field MRI applications in vision research as examples of future research.

Intention-based predictive information modulates auditory deviance processing

The human brain is highly responsive to (deviant) sounds violating an auditory regularity. Respective brain responses are usually investigated in situations when the sounds were produced by the experimenter. Acknowledging that humans also actively produce sounds, the present event-related potential study tested for differences in the brain responses to deviants that were produced by the listeners by pressing one of two buttons. In one condition, deviants were unpredictable with respect to the button-sound association. In another condition, deviants were predictable with high validity yielding correctly predicted deviants and incorrectly predicted (mispredicted) deviants. Temporal principal component analysis revealed deviant-specific N1 enhancement, mismatch negativity (MMN) and P3a. N1 enhancements were highly similar for each deviant type, indicating that the underlying neural mechanism is not affected by intention-based expectation about the self-produced forthcoming sound. The MMN was abolished for predictable deviants, suggesting that the intention-based prediction for a deviant can overwrite the prediction derived from the auditory regularity (predicting a standard). The P3a was present for each deviant type but was largest for mispredicted deviants. It is argued that the processes underlying P3a not only evaluate the deviant with respect to the fact that it violates an auditory regularity but also with respect to the intended sensorial effect of an action. Overall, our results specify current theories of auditory predictive processing, as they reveal that intention-based predictions exert different effects on different deviance-specific brain responses.

Distraction by violation of sensory predictions: Functional distinction between deviant sounds and unexpected silences

It has been established that participants performing a continuous categorization task respond significantly slower following the presentation of unexpected, task-irrelevant, auditory stimuli, compared to a repetitive (standard) sound. Evidence indicates that such distraction emerges because of the violation of sensory predictions. This has typically been studied by measuring the impact of replacing the repeated sound by a different sound on rare and unpredictable trials. Here, we examine the impact of a different type of violation: the mere omission of the standard sound. Capitalizing upon the recent finding that deviant sounds exert distinct effects on response times as a function of whether participants produced or withheld a response on the previous trial, we present the results of an experiment seeking to disentangle two potential effects of sound omission: deviance distraction and the removal of an unspecific warning signal. The results indicate that deviant sound and the unexpected omission of the standard sound impact response times through, at least partially, distinct mechanisms. Deviant sounds affect performance by triggering the orienting of attention towards a new sensory input. Sound omissions, in contrast, appear to affect performance in part because responses no longer benefit from an unspecific warning signal to prepare for action.

Violated Expectations for Spatial and Feature Attributes of Visual Trajectories Modulate Event-Related Potential Amplitudes across the Visual Processing Hierarchy

During visual perception the brain must combine its predictions about what is to be perceived with incoming relevant information. The present study investigated how this process interacts with attention by using event-related potentials that index these cognitive mechanisms. Specifically, this study focused on examining how the amplitudes of the N170, N2pc, and N300 would be modulated by violations of expectations for spatial and featural attributes of visual stimuli. Participants viewed a series of shape stimuli in which a salient shape moved across a set of circular locations so that the trajectory of the shape implied the final position and shape of the stimulus. The final salient stimuli occurred in one of four possible outcomes: predictable position and shape, predictable position but unpredictable shape, unpredictable position but predictable shape, and unpredictable position and shape. The N170 was enhanced by unpredictable positions and shapes, whereas the N300 was enlarged only by unpredictable positions. The N2pc was not modulated by violations of expectation for shapes or positions. Additionally, it was observed post-hoc that the P1pc amplitude was increased by unpredictable shapes. These findings revealed that incorrect prediction increases neural activity. Furthermore, they suggest that prediction and attention interact differently in different stages of visual perception, depending on the type of attention being engaged: The N170 indexes initial prediction error signalling irrespective of the type of information (spatial or featural) in which error occurs, followed by the N300 as a marker of prediction updating involving reorientation of spatial attention.

Sensory suppression and increased neuromodulation during actions disrupt memory encoding of unpredictable self-initiated stimuli

Actions modulate sensory processing by attenuating responses to self- compared to externally generated inputs, which is traditionally attributed to stimulus-specific motor predictions. Yet, suppression has been also found for stimuli merely coinciding with actions, pointing to unspecific processes that may be driven by neuromodulatory systems. Meanwhile, the differential processing for self-generated stimuli raises the possibility of producing effects also on memory for these stimuli; however, evidence remains mixed as to the direction of the effects. Here, we assessed the effects of actions on sensory processing and memory encoding of concomitant, but unpredictable sounds, using a combination of self-generation and memory recognition task concurrently with EEG and pupil recordings. At encoding, subjects performed button presses that half of the time generated a sound (motor-auditory; MA) and listened to passively presented sounds (auditory-only; A). At retrieval, two sounds were presented and participants had to respond which one was present before. We measured memory bias and memory performance by having sequences where either both or only one of the test sounds were presented at encoding, respectively. Results showed worse memory performance - but no differences in memory bias -, attenuated responses, and larger pupil diameter for MA compared to A sounds. Critically, the larger the sensory attenuation and pupil diameter, the worse the memory performance for MA sounds. Nevertheless, sensory attenuation did not correlate with pupil dilation. Collectively, our findings suggest that sensory attenuation and neuromodulatory processes coexist during actions, and both relate to disrupted memory for concurrent, albeit unpredictable sounds.

Dissociable effects of attention and expectation on perceptual sensitivity to action-outcomes

Self-generated sensations evoke attenuated neural response - physiological attenuation - and is perceived with less intensity - perceptual attenuation. This phenomenon is referred as sensory attenuation and is proposed to reflect the silencing of predicted sensations. The present study aimed to investigate the independent contribution of expectation and attention on sensory attenuation. The expectation associated with the stimulus feature and the focus of attention was manipulated independently by orthogonal cues. We found pronounced sensory attenuation at the unattended location when the stimulus was self-generated (Experiment 1). When the stimulus was externally-generated (Experiment 2), sensory attenuation was observed at the attended location. Sensory attenuation of expected action-outcome was not observed when the attention cue was uninformative (Experiment 3A). The findings corroborate the claim from Bayesian models that attention mediates sensory attenuation. The results also highlight the paradoxes in Bayesian proposals of perception-action interaction.

Tactile suppression stems from specific sensorimotor predictions

Tactile sensations on a moving hand are perceived weaker than when presented on the same but stationary hand. There is an ongoing debate about whether this weaker perception is based on sensorimotor predictions or is due to a blanket reduction in sensitivity. Here, we show greater suppression of sensations matching predicted sensory feedback. This reinforces the idea of precise estimations of future body sensory states suppressing the predicted sensory feedback. Our results shine light on the mechanisms of human sensorimotor control and are relevant for understanding clinical phenomena related to predictive processes.

The ability to sample sensory information with our hands is crucial for smooth and efficient interactions with the world. Despite this important role of touch, tactile sensations on a moving hand are perceived weaker than when presented on the same but stationary hand. This phenomenon of tactile suppression has been explained by predictive mechanisms, such as internal forward models, that estimate future sensory states of the body on the basis of the motor command and suppress the associated predicted sensory feedback. The origins of tactile suppression have sparked a lot of debate, with contemporary accounts claiming that suppression is independent of sensorimotor predictions and is instead due to an unspecific mechanism. Here, we target this debate and provide evidence for specific tactile suppression due to precise sensorimotor predictions. Participants stroked with their finger over textured objects that caused predictable vibrotactile feedback signals on that finger. Shortly before touching the texture, we probed tactile suppression by applying external vibrotactile probes on the moving finger that either matched or mismatched the frequency generated by the stroking movement along the texture. We found stronger suppression of the probes that matched the predicted sensory feedback. These results show that tactile suppression is specifically tuned to the predicted sensory states of a movement.

Understanding Design Features of Music and Language: The Choric/Dialogic Distinction

Music and spoken language share certain characteristics: both consist of sequences of acoustic elements that are combinatorically combined, and these elements partition the same continuous acoustic dimensions (frequency, formant space and duration). However, the resulting categories differ sharply: scale tones and note durations of small integer ratios appear in music, while speech uses phonemes, lexical tone, and non-isochronous durations. Why did music and language diverge into the two systems we have today, differing in these specific features? We propose a framework based on information theory and a reverse-engineering perspective, suggesting that design features of music and language are a response to their differential deployment along three different continuous dimensions. These include the familiar propositional-aesthetic ('goal') and repetitive-novel ('novelty') dimensions, and a dialogic-choric ('interactivity') dimension that is our focus here. Specifically, we hypothesize that music exhibits specializations enhancing coherent production by several individuals concurrently-the 'choric' context. In contrast, language is specialized for exchange in tightly coordinated turn-taking-'dialogic' contexts. We examine the evidence for our framework, both from humans and non-human animals, and conclude that many proposed design features of music and language follow naturally from their use in distinct dialogic and choric communicative contexts. Furthermore, the hybrid nature of intermediate systems like poetry, chant, or solo lament follows from their deployment in the less typical interactive context.

The sound of silence: Predictive error responses to unexpected sound omission in adults

The human auditory system excels at detecting patterns needed for processing speech and music. According to predictive coding, the brain predicts incoming sounds, compares predictions to sensory input, and generates a prediction error whenever a mismatch between the prediction and sensory input occurs. Predictive coding can be indexed in EEG with the mismatch negativity (MMN) and P3a components, two ERP components that are elicited by infrequent deviant sounds (e.g., differing in pitch, duration, loudness) in a stream of frequent sounds. If these components reflect prediction error, they should also be elicited by omitting an expected sound, but few studies have examined this. We compared ERPs elicited by infrequent randomly occurring omissions (unexpected silences) in tone sequences presented at 2 tones/sec to ERPs elicited by frequent, regularly occurring omissions (expected silences) within a sequence of tones and resting state EEG (a constant silence). We found that unexpected silences elicited significant MMN and P3a, although the magnitude of these components was quite small and variable. These results provide evidence for hierarchical predictive coding, indicating that the brain predicts silences as well as sounds.

Sound omission related brain responses in children

Action is an important way for children to learn about the world. Recent theories suggest that action is inherently accompanied by the sensory prediction of its effects. Such predictions can be revealed by rarely omitting the expected sensory consequence of the action, resulting in an omission response that is observable in the EEG. Although prediction errors play an important role in models of learning and development, little is known about omission-related brain responses in children. This study used a motor-auditory omission paradigm, testing a group of 6-8-year-old children and an adult group (N = 31 each). In an identity-specific condition, the sound coupled to the motor action was predictable, while in an identity unspecific condition the sound was unpredictable. Results of a temporal principal component analysis revealed that sound-related brain responses underlying the N1-complex differed considerably between age groups. Despite these developmental differences, omission responses (oN1) were similar between age groups. Two subcomponents of the oN1 were differently affected by specific and unspecific predictions. Results demonstrate that children, independent from the maturation of sound processing mechanisms, can implement specific and unspecific predictions as flexibly as adults. This supports theories that regard action and prediction error as important drivers of cognitive development.

Making sense of periodicity glimpses in a prediction-update-loop-A computational model of attentive voice tracking

Humans are able to follow a speaker even in challenging acoustic conditions. The perceptual mechanisms underlying this ability remain unclear. A computational model of attentive voice tracking, consisting of four computational blocks: (1) sparse periodicity-based auditory features (sPAF) extraction, (2) foreground-background segregation, (3) state estimation, and (4) top-down knowledge, is presented. The model connects the theories about auditory glimpses, foreground-background segregation, and Bayesian inference. It is implemented with the sPAF, sequential Monte Carlo sampling, and probabilistic voice models. The model is evaluated by comparing it with the human data obtained in the study by Woods and McDermott [Curr. Biol. 25(17), 2238-2246 (2015)], which measured the ability to track one of two competing voices with time-varying parameters [fundamental frequency (F0) and formants (F1,F2)]. Three model versions were tested, which differ in the type of information used for the segregation: version (a) uses the oracle F0, version (b) uses the estimated F0, and version (c) uses the spectral shape derived from the estimated F0 and oracle F1 and F2. Version (a) simulates the optimal human performance in conditions with the largest separation between the voices, version (b) simulates the conditions in which the separation in not sufficient to follow the voices, and version (c) is closest to the human performance for moderate voice separation.

Neural Substrates and Models of Omission Responses and Predictive Processes

Predictive coding theories argue that deviance detection phenomena, such as mismatch responses and omission responses, are generated by predictive processes with possibly overlapping neural substrates. Molecular imaging and electrophysiology studies of mismatch responses and corollary discharge in the rodent model allowed the development of mechanistic and computational models of these phenomena. These models enable translation between human and non-human animal research and help to uncover fundamental features of change-processing microcircuitry in the neocortex. This microcircuitry is characterized by stimulus-specific adaptation and feedforward inhibition of stimulus-selective populations of pyramidal neurons and interneurons, with specific contributions from different interneuron types. The overlap of the substrates of different types of responses to deviant stimuli remains to be understood. Omission responses, which are observed both in corollary discharge and mismatch response protocols in humans, are underutilized in animal research and may be pivotal in uncovering the substrates of predictive processes. Omission studies comprise a range of methods centered on the withholding of an expected stimulus. This review aims to provide an overview of omission protocols and showcase their potential to integrate and complement the different models and procedures employed to study prediction and deviance detection.This approach may reveal the biological foundations of core concepts of predictive coding, and allow an empirical test of the framework’s promise to unify theoretical models of attention and perception.

Predictive Processing in Poetic Language: Event-Related Potentials Data on Rhythmic Omissions in Metered Speech

Predictions during language comprehension are currently discussed from many points of view. One area where predictive processing may play a particular role concerns poetic language that is regularized by meter and rhyme, thus allowing strong predictions regarding the timing and stress of individual syllables. While there is growing evidence that these prosodic regularities influence language processing, less is known about the potential influence of prosodic preferences (binary, strong-weak patterns) on neurophysiological processes. To this end, the present electroencephalogram (EEG) study examined whether the predictability of strong and weak syllables within metered speech would differ as a function of meter (trochee vs. iamb). Strong, i.e., accented positions within a foot should be more predictable than weak, i.e., unaccented positions. Our focus was on disyllabic pseudowords that solely differed between trochaic and iambic structure, with trochees providing the preferred foot in German. Methodologically, we focused on the omission Mismatch Negativity (oMMN) that is elicited when an anticipated auditory stimulus is omitted. The resulting electrophysiological brain response is particularly interesting because its elicitation does not depend on a physical stimulus. Omissions in deviant position of a passive oddball paradigm occurred at either first- or second-syllable position of the aforementioned pseudowords, resulting in a 2-by-2 design with the factors foot type and omission position. Analyses focused on the mean oMMN amplitude and latency differences across the four conditions. The result pattern was characterized by an interaction of the effects of foot type and omission position for both amplitudes and latencies. In first position, omissions resulted in larger and earlier oMMNs for trochees than for iambs. In second position, omissions resulted in larger oMMNs for iambs than for trochees, but the oMMN latency did not differ. The results suggest that omissions, particularly in initial position, are modulated by a trochaic preference in German. The preferred strong-weak pattern may have strengthened the prosodic prediction, especially for matching, trochaic stimuli, such that the violation of this prediction led to an earlier and stronger prediction error. Altogether, predictive processing seems to play a particular role in metered speech, especially if the meter is based on the preferred foot type.

Towards understanding how we pay attention in naturalistic visual search settings

Research on attentional control has largely focused on single senses and the importance of behavioural goals in controlling attention. However, everyday situations are multisensory and contain regularities, both likely influencing attention. We investigated how visual attentional capture is simultaneously impacted by top-down goals, the multisensory nature of stimuli, and the contextual factors of stimuli's semantic relationship and temporal predictability. Participants performed a multisensory version of the Folk et al. (1992) spatial cueing paradigm, searching for a target of a predefined colour (e.g. a red bar) within an array preceded by a distractor. We manipulated: 1) stimuli's goal-relevance via distractor's colour (matching vs. mismatching the target), 2) stimuli's multisensory nature (colour distractors appearing alone vs. with tones), 3) the relationship between the distractor sound and colour (arbitrary vs. semantically congruent) and 4) the temporal predictability of distractor onset. Reaction-time spatial cueing served as a behavioural measure of attentional selection. We also recorded 129-channel event-related potentials (ERPs), analysing the distractor-elicited N2pc component both canonically and using a multivariate electrical neuroimaging framework. Behaviourally, arbitrary target-matching distractors captured attention more strongly than semantically congruent ones, with no evidence for context modulating multisensory enhancements of capture. Notably, electrical neuroimaging of surface-level EEG analyses revealed context-based influences on attention to both visual and multisensory distractors, in how strongly they activated the brain and type of activated brain networks. For both processes, the context-driven brain response modulations occurred long before the N2pc time-window, with topographic (network-based) modulations at ∼30 ms, followed by strength-based modulations at ∼100 ms post-distractor onset. Our results reveal that both stimulus meaning and predictability modulate attentional selection, and they interact while doing so. Meaning, in addition to temporal predictability, is thus a second source of contextual information facilitating goal-directed behaviour. More broadly, in everyday situations, attention is controlled by an interplay between one's goals, stimuli's perceptual salience, meaning and predictability. Our study calls for a revision of attentional control theories to account for the role of contextual and multisensory control.

Sensory Attenuation in the Auditory Modality as a Window Into Predictive Processing

Self-generated auditory input is perceived less loudly than the same sounds generated externally. The existence of this phenomenon, called Sensory Attenuation (SA), has been studied for decades and is often explained by motor-based forward models. Recent developments in the research of SA, however, challenge these models. We review the current state of knowledge regarding theoretical implications about the significance of Sensory Attenuation and its role in human behavior and functioning. Focusing on behavioral and electrophysiological results in the auditory domain, we provide an overview of the characteristics and limitations of existing SA paradigms and highlight the problem of isolating SA from other predictive mechanisms. Finally, we explore different hypotheses attempting to explain heterogeneous empirical findings, and the impact of the Predictive Coding Framework in this research area.