Early electrophysiological indicators for predictive processing in audition: A review

Predicting the Irrelevant: Neural Effects of Distractor Predictability Depend on Load

Distraction is ubiquitous in human environments. Distracting input is often predictable, but we do not understand when or how humans can exploit this predictability. Here, we ask whether predictable distractors are able to reduce uncertainty in updating the internal predictive model. We show that utilising a predictable distractor identity is not fully automatic but in part depends on available resources. In an auditory spatial n-back task, listeners (n = 33) attended to spoken numbers presented to one ear and detected repeating items. Distracting numbers presented to the other ear either followed a predictable (i.e., repetitive) sequence or were unpredictable. We used electroencephalography (EEG) to uncover neural responses to predictable versus unpredictable auditory distractors, as well as their dependence on perceptual and cognitive load. Neurally, pairs of targets and unpredictable distractors induced a sign-reversed lateralisation of pre-stimulus alpha oscillations (~10 Hz) and larger amplitude of the stimulus-evoked P2 event-related potential component. Under low versus high memory load, distractor predictability increased the magnitude of the frontal negativity component. Behaviourally, predictable distractors under low task demands (i.e., good signal-to-noise ratio and low memory load) made participants adopt a less biased response strategy. We conclude that predictable distractors decrease uncertainty and reduce the need for updating the internal predictive model. In turn, unpredictable distractors might mislead proactive spatial attention orientation, elicit larger neural responses and put higher demand on memory.

Euterpe music therapy methodology and procedure algorithms

Introduction

As highlighted by the scientific literature, music therapy (MT) represents a significant non-pharmacological intervention within neurorehabilitation programs. MT offers benefits in the recovery process and enhances the quality of life for patients with neurodevelopmental disorders. A review of the literature reveals a lack of MT models focusing on real-time personalized composition using electronic music techniques. Furthermore, studies on MT conducted within a multisensory therapeutic context are limited. Recent literature reviews on MT in telerehabilitation have highlighted that the application of the Euterpe Method (EM) is complex due to limited technical information available and the combined background required for music therapists to replicate the EM protocol.

Methods

This paper presents a manual which specifies the procedures and algorithms of the EM, developed during a research program conducted in a pediatric hospital in Italy. The prerogative of the EM is the use of procedures aimed at creating personalized therapeutic compositions within a multisensory environment.

Discussion

The efficacy and resilience of the EM have been demonstrated in two experimental studies. The first focused on the use of telerehabilitation in children with developmental disorders, while the second involved hospitalized children with cerebral palsy.

Conclusion

This study integrates medicine, neuroscience, and MT to develop personalized interventions in pediatrics, fostering collaboration among specialists and families, enhancing patient well-being, and opening new therapeutic perspectives, while ensuring the replicability of the EM approach.

Coordinated changes in a cortical circuit sculpt effects of novelty on neural dynamics

Recent studies have found dramatic cell-type-specific responses to stimulus novelty, highlighting the importance of analyzing the cortical circuitry at this granularity to understand brain function. Although initial work characterized activity by cell type, the alterations in cortical circuitry due to interacting novelty effects remain unclear. We investigated circuit mechanisms underlying the observed neural dynamics in response to novel stimuli using a large-scale public dataset of electrophysiological recordings in behaving mice and a population network model. The model was constrained by multi-patch synaptic physiology and electron microscopy data. We found generally weaker connections under novel stimuli, with shifts in the balance between somatostatin (SST) and vasoactive intestinal polypeptide (VIP) populations and increased excitatory influences on parvalbumin (PV) and SST populations. These findings systematically characterize how cortical circuits adapt to stimulus novelty.

Parallel EEG assessment of different sound predictability levels in tinnitus

Tinnitus denotes the perception of a non-environmental sound and might result from aberrant auditory prediction. Successful prediction of formal (e.g., type) and temporal sound characteristics facilitates the filtering of irrelevant information, also labelled as 'sensory gating' (SG). Here, we explored if and how parallel manipulations of formal prediction violations and temporal predictability affect SG in persons with and without tinnitus. Age-, education- and sex-matched persons with and without tinnitus (N = 52) participated and listened to paired-tone oddball sequences, varying in formal (standard vs. deviant pitch) and temporal predictability (isochronous vs. random timing). EEG was recorded from 128 channels and data were analyzed by means of temporal spatial principal component analysis (tsPCA). SG was assessed by amplitude suppression for the 2nd tone in a pair and was observed in P50-like activity in both timing conditions and groups. Correspondingly, deviants elicited overall larger amplitudes than standards. However, only persons without tinnitus displayed a larger N100-like deviance response in the isochronous compared to the random timing condition. This result might imply that persons with tinnitus do not benefit similarly as persons without tinnitus from temporal predictability in deviance processing. Thus, persons with tinnitus might display less temporal sensitivity in auditory processing than persons without tinnitus.

Effects of expectations and sensory unreliability on voice detection - A preregistered study

The phenomenon of "hearing voices" can be found not only in psychotic disorders, but also in the general population, with individuals across cultures reporting auditory perceptions of supernatural beings. In our preregistered study, we investigated a possible mechanism of such experiences, grounded in the predictive processing model of agency detection. We predicted that in a signal detection task, expecting less or more voices than actually present would drive the response bias toward a more conservative and liberal response strategy, respectively. Moreover, we hypothesized that including sensory noise would enhance these expectancy effects. In line with our predictions, the findings show that detection of voices relies on expectations and that this effect is especially pronounced in the case of unreliable sensory data. As such, the study contributes to our understanding of the predictive processes in hearing and the building blocks of voice hearing experiences.

Understanding music and aging through the lens of Bayesian inference

Bayesian inference has recently gained momentum in explaining music perception and aging. A fundamental mechanism underlying Bayesian inference is the notion of prediction. This framework could explain how predictions pertaining to musical (melodic, rhythmic, harmonic) structures engender action, emotion, and learning, expanding related concepts of music research, such as musical expectancies, groove, pleasure, and tension. Moreover, a Bayesian perspective of music perception may shed new insights on the beneficial effects of music in aging. Aging could be framed as an optimization process of Bayesian inference. As predictive inferences refine over time, the reliance on consolidated priors increases, while the updating of prior models through Bayesian inference attenuates. This may affect the ability of older adults to estimate uncertainties in their environment, limiting their cognitive and behavioral repertoire. With Bayesian inference as an overarching framework, this review synthesizes the literature on predictive inferences in music and aging, and details how music could be a promising tool in preventive and rehabilitative interventions for older adults through the lens of Bayesian inference.

Relationships between the expectations based on the regularity of preceding sound sequences and the medial olivocochlear reflex

Rhythms are the most natural cue for temporal anticipation because many sounds in our living environment have rhythmic structures. Humans have cortical mechanisms that can predict the arrival of the next sound based on rhythm and periodicity. Herein, we showed that temporal anticipation, based on the regularity of sound sequences, modulates peripheral auditory responses via efferent innervation. The medial olivocochlear reflex (MOCR), a sound-activated efferent feedback mechanism that controls outer hair cell motility, was inferred noninvasively by measuring the suppression of otoacoustic emissions (OAE). First, OAE suppression was compared between conditions in which sound sequences preceding the MOCR elicitor were presented at regular (predictable condition) or irregular (unpredictable condition) intervals. We found that OAE suppression in the predictable condition was stronger than that in the unpredictable condition. This implies that the MOCR is strengthened by the regularity of preceding sound sequences. In addition, to examine how many regularly presented preceding sounds are required to enhance the MOCR, we compared OAE suppression within stimulus sequences with 0-3 preceding tones. The OAE suppression was strengthened only when there were at least three regular preceding tones. This suggests that the MOCR was not automatically enhanced by a single stimulus presented immediately before the MOCR elicitor, but rather that it was enhanced by the regularity of the preceding sound sequences.

Suppression and omission effects in auditory predictive processing-Two of the same?

Recent theories describe perception as an inferential process based on internal predictive models that are adjusted by prediction violations (prediction error). Two different modulations of the auditory N1 event-related brain potential component are often discussed as an expression of auditory predictive processing. The sound-related N1 component is attenuated for self-generated sounds compared to the N1 elicited by externally generated sounds (N1 suppression). An omission-related component in the N1 time-range is elicited when the self-generated sounds are occasionally omitted (omission N1). Both phenomena were explained by action-related forward modelling, which takes place when the sensory input is predictable: prediction error signals are reduced when predicted sensory input is presented (N1 suppression) and elicited when predicted sensory input is omitted (omission N1). This common theoretical account is appealing but has not yet been directly tested. We manipulated the predictability of a sound in a self-generation paradigm in which, in two conditions, either 80% or 50% of the button presses did generate a sound, inducing a strong or a weak expectation for the occurrence of the sound. Consistent with the forward modelling account, an omission N1 was observed in the 80% but not in the 50% condition. However, N1 suppression was highly similar in both conditions. Thus, our results demonstrate a clear effect of predictability for the omission N1 but not for the N1 suppression. These results imply that the two phenomena rely (at least in part) on different mechanisms and challenge prediction related accounts of N1 suppression.

When performing actions with robots, attribution of intentionality affects the sense of joint agency

Sense of joint agency (SoJA) is the sense of control experienced by humans when acting with others to bring about changes in the shared environment. SoJA is proposed to arise from the sensorimotor predictive processes underlying action control and monitoring. Because SoJA is a ubiquitous phenomenon occurring when we perform actions with other humans, it is of great interest and importance to understand whether-and under what conditions-SoJA occurs in collaborative tasks with humanoid robots. In this study, using behavioral measures and neural responses measured by electroencephalography (EEG), we aimed to evaluate whether SoJA occurs in joint action with the humanoid robot iCub and whether its emergence is influenced by the perceived intentionality of the robot. Behavioral results show that participants experienced SoJA with the robot partner when it was presented as an intentional agent but not when it was presented as a mechanical artifact. EEG results show that the mechanism that influences the emergence of SoJA in the condition when the robot is presented as an intentional agent is the ability to form similarly accurate predictions about the sensory consequences of our own and others' actions, leading to similar modulatory activity over sensory processing. Together, our results shed light on the joint sensorimotor processing mechanisms underlying the emergence of SoJA in human-robot interaction and underscore the importance of attribution of intentionality to the robot in human-robot collaboration.

Conditional deviant repetition in the oddball paradigm modulates processing at the level of P3a but not MMN

The auditory system has an amazing ability to rapidly encode auditory regularities. Evidence comes from the popular oddball paradigm, in which frequent (standard) sounds are occasionally exchanged for rare deviant sounds, which then elicit signs of prediction error based on their unexpectedness (e.g., MMN and P3a). Here, we examine the widely neglected characteristics of deviants being bearers of predictive information themselves; naive participants listened to sound sequences constructed according to a new, modified version of the oddball paradigm including two types of deviants that followed diametrically opposed rules: one deviant sound occurred mostly in pairs (repetition rule), the other deviant sound occurred mostly in isolation (non-repetition rule). Due to this manipulation, the sound following a first deviant (either the same deviant or a standard) was either predictable or unpredictable based on its conditional probability associated with the preceding deviant sound. Our behavioral results from an active deviant detection task replicate previous findings that deviant repetition rules (based on conditional probability) can be extracted when behaviorally relevant. Our electrophysiological findings obtained in a passive listening setting indicate that conditional probability also translates into differential processing at the P3a level. However, MMN was confined to global deviants and was not sensitive to conditional probability. This suggests that higher-level processing concerned with stimulus selection and/or evaluation (reflected in P3a) but not lower-level sensory processing (reflected in MMN) considers rarely encountered rules.

Decoding predicted musical notes from omitted stimulus potentials

Electrophysiological studies have investigated predictive processing in music by examining event-related potentials (ERPs) elicited by the violation of musical expectations. While several studies have reported that the predictability of stimuli can modulate the amplitude of ERPs, it is unclear how specific the representation of the expected note is. The present study addressed this issue by recording the omitted stimulus potentials (OSPs) to avoid contamination of bottom-up sensory processing with top-down predictive processing. Decoding of the omitted content was attempted using a support vector machine, which is a type of machine learning. ERP responses to the omission of four target notes (E, F, A, and C) at the same position in familiar and unfamiliar melodies were recorded from 25 participants. The results showed that the omission N1 were larger in the familiar melody condition than in the unfamiliar melody condition. The decoding accuracy of the four omitted notes was significantly higher in the familiar melody condition than in the unfamiliar melody condition. These results suggest that the OSPs contain discriminable predictive information, and the higher the predictability, the more the specific representation of the expected note is generated.

Strong Prediction: Language Model Surprisal Explains Multiple N400 Effects

Theoretical accounts of the N400 are divided as to whether the amplitude of the N400 response to a stimulus reflects the extent to which the stimulus was predicted, the extent to which the stimulus is semantically similar to its preceding context, or both. We use state-of-the-art machine learning tools to investigate which of these three accounts is best supported by the evidence. GPT-3, a neural language model trained to compute the conditional probability of any word based on the words that precede it, was used to operationalize contextual predictability. In particular, we used an information-theoretic construct known as surprisal (the negative logarithm of the conditional probability). Contextual semantic similarity was operationalized by using two high-quality co-occurrence-derived vector-based meaning representations for words: GloVe and fastText. The cosine between the vector representation of the sentence frame and final word was used to derive contextual cosine similarity estimates. A series of regression models were constructed, where these variables, along with cloze probability and plausibility ratings, were used to predict single trial N400 amplitudes recorded from healthy adults as they read sentences whose final word varied in its predictability, plausibility, and semantic relationship to the likeliest sentence completion. Statistical model comparison indicated GPT-3 surprisal provided the best account of N400 amplitude and suggested that apparently disparate N400 effects of expectancy, plausibility, and contextual semantic similarity can be reduced to variation in the predictability of words. The results are argued to support predictive coding in the human language network.

Contra assertions, feedback improves word recognition: How feedback and lateral inhibition sharpen signals over noise

Whether top-down feedback modulates perception has deep implications for cognitive theories. Debate has been vigorous in the domain of spoken word recognition, where competing computational models and agreement on at least one diagnostic experimental paradigm suggest that the debate may eventually be resolvable. Norris and Cutler (2021) revisit arguments against lexical feedback in spoken word recognition models. They also incorrectly claim that recent computational demonstrations that feedback promotes accuracy and speed under noise (Magnuson et al., 2018) were due to the use of the Luce choice rule rather than adding noise to inputs (noise was in fact added directly to inputs). They also claim that feedback cannot improve word recognition because feedback cannot distinguish signal from noise. We have two goals in this paper. First, we correct the record about the simulations of Magnuson et al. (2018). Second, we explain how interactive activation models selectively sharpen signals via joint effects of feedback and lateral inhibition that boost lexically-coherent sublexical patterns over noise. We also review a growing body of behavioral and neural results consistent with feedback and inconsistent with autonomous (non-feedback) architectures, and conclude that parsimony supports feedback. We close by discussing the potential for synergy between autonomous and interactive approaches.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Altered corollary discharge signaling in the auditory cortex of a mouse model of schizophrenia predisposition

The ability to distinguish sensations that are self-generated from those caused by external events is disrupted in schizophrenia patients. However, the neural circuit abnormalities underlying this sensory impairment and its relationship to the risk factors for the disease is not well understood. To address this, we examined the processing of self-generated sounds in male Df(16)A+/- mice, which model one of the largest genetic risk factors for schizophrenia, the 22q11.2 microdeletion. We find that auditory cortical neurons in Df(16)A+/- mice fail to attenuate their responses to self-generated sounds, recapitulating deficits seen in schizophrenia patients. Notably, the auditory cortex of Df(16)A+/- mice displayed weaker motor-related signals and received fewer inputs from the motor cortex, suggesting an anatomical basis underlying the sensory deficit. These results provide insights into the mechanisms by which a major genetic risk factor for schizophrenia disrupts the top-down processing of sensory information.

Auditory learning of recurrent tone sequences is present in the newborn's brain

The seemingly effortless ability of our auditory system to rapidly detect new events in a dynamic environment is crucial for survival. Whether the underlying brain processes are innate is unknown. To answer this question, electroencephalography was recorded while regularly patterned (REG) versus random (RAND) tone sequences were presented to sleeping neonates. Regular relative to random sequences elicited differential neural responses after only a single repetition of the pattern indicating the existence of an innate capacity of the auditory system to detect auditory sequential regularities. We show that the newborn auditory system accumulates evidence only somewhat longer than the minimum amount determined by the ideal Bayesian observer model (the prediction from a variable-order Markov chain model) before detecting a repeating pattern. Thus, newborns can quickly form representations for regular features of the sound input, preparing the way for learning the contingencies of the environment.

Coordinated changes in a cortical circuit sculpt effects of novelty on neural dynamics

Recent studies have found dramatic cell-type specific responses to stimulus novelty, highlighting the importance of analyzing the cortical circuitry at the cell-type specific level of granularity to understand brain function. Although initial work classified and characterized activity for each cell type, the specific alterations in cortical circuitry-particularly when multiple novelty effects interact-remain unclear. To address this gap, we employed a large-scale public dataset of electrophysiological recordings in the visual cortex of awake, behaving mice using Neuropixels probes and designed population network models to investigate the observed changes in neural dynamics in response to a combination of distinct forms of novelty. The model parameters were rigorously constrained by publicly available structural datasets, including multi-patch synaptic physiology and electron microscopy data. Our systematic optimization approach identified tens of thousands of model parameter sets that replicate the observed neural activity. Analysis of these solutions revealed generally weaker connections under novel stimuli, as well as a shift in the balance e between SST and VIP populations. Along with this, PV and SST populations experienced overall more excitatory influences compared to excitatory and VIP populations. Our results also highlight the role of VIP neurons in multiple aspects of visual stimulus processing and altering gain and saturation dynamics under novel conditions. In sum, our findings provide a systematic characterization of how the cortical circuit adapts to stimulus novelty by combining multiple rich public datasets.

Short-term neuronal and synaptic plasticity act in synergy for deviance detection in spiking networks

Sensory areas of cortex respond more strongly to infrequent stimuli when these violate previously established regularities, a phenomenon known as deviance detection (DD). Previous modeling work has mainly attempted to explain DD on the basis of synaptic plasticity. However, a large fraction of cortical neurons also exhibit firing rate adaptation, an underexplored potential mechanism. Here, we investigate DD in a spiking neuronal network model with two types of short-term plasticity, fast synaptic short-term depression (STD) and slower threshold adaptation (TA). We probe the model with an oddball stimulation paradigm and assess DD by evaluating the network responses. We find that TA is sufficient to elicit DD. It achieves this by habituating neurons near the stimulation site that respond earliest to the frequently presented standard stimulus (local fatigue), which diminishes the response and promotes the recovery (global fatigue) of the wider network. Further, we find a synergy effect between STD and TA, where they interact with each other to achieve greater DD than the sum of their individual effects. We show that this synergy is caused by the local fatigue added by STD, which inhibits the global response to the frequently presented stimulus, allowing greater recovery of TA-mediated global fatigue and making the network more responsive to the deviant stimulus. Finally, we show that the magnitude of DD strongly depends on the timescale of stimulation. We conclude that highly predictable information can be encoded in strong local fatigue, which allows greater global recovery and subsequent heightened sensitivity for DD.

Corollary discharge function in healthy controls: Evidence about self-speech and external speech processing

As we speak, corollary discharge mechanisms suppress the auditory conscious perception of the self-generated voice in healthy subjects. This suppression has been associated with the attenuation of the auditory N1 component. To analyse this corollary discharge phenomenon (agency and ownership), we registered the event-related potentials of 42 healthy subjects. The N1 and P2 components were elicited by spoken vowels (talk condition; agency), by played-back vowels recorded with their own voice (listen-self condition; ownership) and by played-back vowels recorded with an external voice (listen-other condition). The N1 amplitude elicited by the talk condition was smaller compared with the listen-self and listen-other conditions. There were no amplitude differences in N1 between listen-self and listen-other conditions. The P2 component did not show differences between conditions. Additionally, a peak latency analysis of N1 and P2 components between the three conditions showed no differences. These findings corroborate previous results showing that the corollary discharge mechanisms dampen sensory responses to self-generated speech (agency experience) and provide new neurophysiological evidence about the similarities in the processing of played-back vowels with our own voice (ownership experience) and with an external voice.

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Babies, bugs and brains: How the early microbiome associates with infant brain and behavior development

Growing evidence is demonstrating the connection between the microbiota gut-brain axis and neurodevelopment. Microbiota colonization occurs before the maturation of many neural systems and is linked to brain health. Because of this it has been hypothesized that the early microbiome interactions along the gut-brain axis evolved to promote advanced cognitive functions and behaviors. Here, we performed a pilot study with a multidisciplinary approach to test if the microbiota composition of infants is associated with measures of early cognitive development, in particular neural rhythm tracking; language (forward speech) versus non-language (backwards speech) discrimination; and social joint attention. Fecal samples were collected from 56 infants between four and six months of age and sequenced by shotgun metagenomic sequencing. Of these, 44 performed the behavioral Point and Gaze test to measure joint attention. Infants were tested on either language discrimination using functional near-infrared spectroscopy (fNIRS; 25 infants had usable data) or neural rhythm tracking using electroencephalogram (EEG; 15 had usable data). Infants who succeeded at the Point and Gaze test tended to have increased Actinobacteria and reduced Firmicutes at the phylum level; and an increase in Bifidobacterium and Eggerthella along with a reduction in Hungatella and Streptococcus at the genus level. Measurements of neural rhythm tracking associated negatively to the abundance of Bifidobacterium and positively to the abundance of Clostridium and Enterococcus for the bacterial abundances, and associated positively to metabolic pathways that can influence neurodevelopment, including branched chain amino acid biosynthesis and pentose phosphate pathways. No associations were found for the fNIRS language discrimination measurements. Although the tests were underpowered due to the small pilot sample sizes, potential associations were identified between the microbiome and measurements of early cognitive development that are worth exploring further.

Habituation, Adaptation and Prediction Processes in Neurodevelopmental Disorders: A Comprehensive Review

Habituation, the simplest form of learning preserved across species and evolution, is characterized by a response decrease as a stimulus is repeated. This adaptive function has been shown to be altered in some psychiatric and neurodevelopmental disorders such as autism spectrum disorder (ASD), attention-deficit/hyperactivity disorder (ADHD) or schizophrenia. At the brain level, habituation is characterized by a decrease in neural activity as a stimulation is repeated, referred to as neural adaptation. This phenomenon influences the ability to make predictions and to detect change, two processes altered in some neurodevelopmental and psychiatric disorders. In this comprehensive review, the objectives are to characterize habituation, neural adaptation, and prediction throughout typical development and in neurodevelopmental disorders; and to evaluate their implication in symptomatology, specifically in sensitivity to change or need for sameness. A summary of the different approaches to investigate adaptation will be proposed, in which we report the contribution of animal studies as well as electrophysiological studies in humans to understanding of underlying neuronal mechanisms.

Using event-related brain potentials to evaluate motor-auditory latencies in virtual reality

Actions in the real world have immediate sensory consequences. Mimicking these in digital environments is within reach, but technical constraints usually impose a certain latency (delay) between user actions and system responses. It is important to assess the impact of this latency on the users, ideally with measurement techniques that do not interfere with their digital experience. One such unobtrusive technique is electroencephalography (EEG), which can capture the users' brain activity associated with motor responses and sensory events by extracting event-related potentials (ERPs) from the continuous EEG recording. Here we exploit the fact that the amplitude of sensory ERP components (specifically, N1 and P2) reflects the degree to which the sensory event was perceived as an expected consequence of an own action (self-generation effect). Participants (N = 24) elicit auditory events in a virtual-reality (VR) setting by entering codes on virtual keypads to open doors. In a within-participant design, the delay between user input and sound presentation is manipulated across blocks. Occasionally, the virtual keypad is operated by a simulated robot instead, yielding a control condition with externally generated sounds. Results show that N1 (but not P2) amplitude is reduced for self-generated relative to externally generated sounds, and P2 (but not N1) amplitude is modulated by delay of sound presentation in a graded manner. This dissociation between N1 and P2 effects maps back to basic research on self-generation of sounds. We suggest P2 amplitude as a candidate read-out to assess the quality and immersiveness of digital environments with respect to system latency.

DIVA Meets EEG: Model Validation Using Formant-Shift Reflex

The neurocomputational model 'Directions into Velocities of Articulators' (DIVA) was developed to account for various aspects of normal and disordered speech production and acquisition. The neural substrates of DIVA were established through functional magnetic resonance imaging (fMRI), providing physiological validation of the model. This study introduces DIVA_EEG an extension of DIVA that utilizes electroencephalography (EEG) to leverage the high temporal resolution and broad availability of EEG over fMRI. For the development of DIVA_EEG, EEG-like signals were derived from original equations describing the activity of the different DIVA maps. Synthetic EEG associated with the utterance of syllables was generated when both unperturbed and perturbed auditory feedback (first formant perturbations) were simulated. The cortical activation maps derived from synthetic EEG closely resembled those of the original DIVA model. To validate DIVA_EEG, the EEG of individuals with typical voices (N = 30) was acquired during an altered auditory feedback paradigm. The resulting empirical brain activity maps significantly overlapped with those predicted by DIVA_EEG. In conjunction with other recent model extensions, DIVA_EEG lays the foundations for constructing a complete neurocomputational framework to tackle vocal and speech disorders, which can guide model-driven personalized interventions.

Extensive representation of sensory deviance in the responses to auditory gaps in unanesthetized rats

Unexpected changes in incoming sensory streams are associated with large errors in predicting the deviant stimulus relative to a memory trace of past stimuli. Mismatch negativity (MMN) in human studies and the release from stimulus-specific adaptation (SSA) in animal models correlate with prediction errors and deviance detection.¹ In human studies, violation of expectations elicited by an unexpected stimulus omission resulted in an omission MMN.^2,3,4,5 These responses are evoked after the expected occurrence time of the omitted stimulus, implying that they reflect the violation of a temporal expectancy.⁶ Because they are often time locked to the end of the omitted stimulus,^4,6,7 they resemble off responses. Indeed, suppression of cortical activity after the termination of the gap disrupts gap detection, suggesting an essential role for offset responses.⁸ Here, we demonstrate that brief gaps in short noise bursts in the auditory cortex of unanesthetized rats frequently evoke offset responses. Importantly, we show that omission responses are elicited when these gaps are expected but are omitted. These omission responses, together with the release from SSA of both onset and offset responses to rare gaps, form a rich and varied representation of prediction-related signals in the auditory cortex of unanesthetized rats, extending substantially and refining the representations described previously in anesthetized rats.

Neuronal responses to omitted tones in the auditory brain: A neuronal correlate for predictive coding

Prediction provides key advantages for survival, and cognitive studies have demonstrated that the brain computes multilevel predictions. Evidence for predictions remains elusive at the neuronal level because of the complexity of separating neural activity into predictions and stimulus responses. We overcome this challenge by recording from single neurons from cortical and subcortical auditory regions in anesthetized and awake preparations, during unexpected stimulus omissions interspersed in a regular sequence of tones. We find a subset of neurons that responds reliably to omitted tones. In awake animals, omission responses are similar to anesthetized animals, but larger and more frequent, indicating that the arousal and attentional state levels affect the degree to which predictions are neuronally represented. Omission-sensitive neurons also responded to frequency deviants, with their omission responses getting emphasized in the awake state. Because omission responses occur in the absence of sensory input, they provide solid and empirical evidence for the implementation of a predictive process.

Updating the relationship of the Ne/ERN to task-related behavior: A brief review and suggestions for future research

The error negativity/error-related negativity (Ne/ERN) is one of the most well-studied event-related potential (ERP) components in the electroencephalography (EEG) literature. Peaking about 50 ms after the commission of an error, the Ne/ERN is a negative deflection in the ERP waveform that is thought to reflect error processing in the brain. While its relationships to trait constructs such as anxiety are well-documented, there is still little known about how the Ne/ERN may subsequently influence task-related behavior. In other words, does the occurrence of the Ne/ERN trigger any sort of error corrective process, or any other behavioral adaptation to avoid errors? Several theories have emerged to explain how the Ne/ERN may implement or affect behavior on a task, but evidence supporting each has been mixed. In the following manuscript, we review these theories, and then systematically discuss the reasons that there may be discrepancies in the literature. We review both the inherent biological factors of the neural regions that underlie error-processing in the brain, and some of the researcher-induced factors in analytic and experimental choices that may be exacerbating these discrepancies. We end with a table of recommendations for future researchers who aim to understand the relationship between the Ne/ERN and behavior.

The neuroscience of music – towards ecological validity

Studies in the neuroscience of music gained momentum in the 1990s as an integrated part of the well-controlled experimental research tradition. However, during the past two decades, these studies have moved toward more naturalistic, ecologically valid paradigms. Here, I introduce this move in three frameworks: (i) sound stimulation and empirical paradigms, (ii) study participants, and (iii) methods and contexts of data acquisition. I wish to provide a narrative historical overview of the development of the field and, in parallel, to stimulate innovative thinking to further advance the ecological validity of the studies without overlooking experimental rigor.

A developmental shift in habituation to pain in human neonates

Habituation to recurrent non-threatening or unavoidable noxious stimuli is an important aspect of adaptation to pain. Neonates, especially if preterm, are exposed to repeated noxious procedures during their clinical care. They can mount strong behavioral, autonomic, spinal, and cortical responses to a single noxious stimulus; however, it is not known whether the developing nervous system can adapt to the recurrence of these inputs. Here, we used electroencephalography to investigate changes in cortical microstates (representing the complex sequential processing of noxious inputs) following two consecutive clinically required heel lances in term and preterm infants. We show that stimulus repetition dampens the engagement of initial microstates and associated behavioral and autonomic responses in term infants, while preterm infants do not show signs of habituation. Nevertheless, both groups engage different longer-latency cortical microstates to each lance, which is likely to reflect changes in higher-level stimulus processing with repeated stimulation. These data suggest that while both age groups are capable of encoding contextual differences in pain, the preterm brain does not regulate the initial cortical, behavioral, and autonomic responses to repeated noxious stimuli. Habituation mechanisms to pain are already in place at term age but mature over the equivalent of the last trimester of gestation and are not fully functional in preterm neonates.

Disrupted auditory N1, theta power and coherence suppression to willed speech in people with schizophrenia

The phenomenon of sensory self-suppression - also known as sensory attenuation - occurs when a person generates a perceptible stimulus (such as a sound) by performing an action (such as speaking). The sensorimotor control system is thought to actively predict and then suppress the vocal sound in the course of speaking, resulting in lowered cortical responsiveness when speaking than when passively listening to an identical sound. It has been hypothesized that auditory hallucinations in schizophrenia result from a reduction in self-suppression due to a disruption of predictive mechanisms required to anticipate and suppress a specific, self-generated sound. It has further been hypothesized that this suppression is evident primarily in theta band activity. Fifty-one people, half of whom had a diagnosis of schizophrenia, were asked to repeatedly utter a single syllable, which was played back to them concurrently over headphones while EEG was continuously recorded. In other conditions, recordings of the same spoken syllables were played back to participants while they passively listened, or were played back with their onsets preceded by a visual cue. All participants experienced these conditions with their voice artificially shifted in pitch and also with their unaltered voice. Suppression was measured using event-related potentials (N1 component), theta phase coherence and power. We found that suppression was generally reduced on all metrics in the patient sample, and when voice alteration was applied. We additionally observed reduced theta coherence and power in the patient sample across all conditions. Visual cueing affected theta coherence only. In aggregate, the results suggest that sensory self-suppression of theta power and coherence is disrupted in schizophrenia.

Neuroprotection in late life attention-deficit/hyperactivity disorder: A review of pharmacotherapy and phenotype across the lifespan

For decades, psychostimulants have been the gold standard pharmaceutical treatment for attention-deficit/hyperactivity disorder (ADHD). In the United States, an astounding 9% of all boys and 4% of girls will be prescribed stimulant drugs at some point during their childhood. Recent meta-analyses have revealed that individuals with ADHD have reduced brain volume loss later in life (>60 y.o.) compared to the normal aging brain, which suggests that either ADHD or its treatment may be neuroprotective. Crucially, these neuroprotective effects were significant in brain regions (e.g., hippocampus, amygdala) where severe volume loss is linked to cognitive impairment and Alzheimer's disease. Historically, the ADHD diagnosis and its pharmacotherapy came about nearly simultaneously, making it difficult to evaluate their effects in isolation. Certain evidence suggests that psychostimulants may normalize structural brain changes typically observed in the ADHD brain. If ADHD itself is neuroprotective, perhaps exercising the brain, then psychostimulants may not be recommended across the lifespan. Alternatively, if stimulant drugs are neuroprotective, then this class of medications may warrant further investigation for their therapeutic effects. Here, we take a bottom-up holistic approach to review the psychopharmacology of ADHD in the context of recent models of attention. We suggest that future studies are greatly needed to better appreciate the interactions amongst an ADHD diagnosis, stimulant treatment across the lifespan, and structure-function alterations in the aging brain.

Selection history and task predictability determine the precision expectations in attentional control

Predictive processing frameworks have demonstrated the central role that prediction plays in a range of cognitive processes including bottom-up and top-down mechanisms of attention control. However, relatively little is understood about how predictive processes interact with the third main determinant of attentional priority - selection history. In this experiment, participants developed a history of either color or shape selection while we observed the impact of these histories in an additional singleton search task using behavioral measures and ERP measures of attentional control. Throughout the experiment, participants were encouraged to predict the upcoming display, but prediction errors were either high or low depending on session. Persistent group differences in our results showed that selection history contributes to the precision weighting of a stimulus, and that this is mediated by overall prediction error. Color-singleton distractors captured attention and required greater suppression when participants had a history of color selection; however, these participants gained large benefits when the upcoming stimuli were highly predictable. We suggest that selection history modulates the precision expectations for a feature in a persistent and implicit way, producing an attentional bias that predictability can help to counteract, but cannot prevent or eliminate entirely.

Visually Perceived Negative Emotion Enhances Mismatch Negativity but Fails to Compensate for Age-Related Impairments

Objective: Automatic detection of auditory stimuli, represented by the mismatch negativity (MMN), facilitates rapid processing of salient stimuli in the environment. The amplitude of MMN declines with ageing. However, whether automatic detection of auditory stimuli is affected by visually perceived negative emotions with normal ageing remains unclear. We aimed to evaluate how fearful facial expressions affect the MMN amplitude under ageing.

Methods: We used a modified oddball paradigm to analyze the amplitude of N100 (N1) and MMN in 22 young adults and 21 middle-aged adults.

Results: We found that the amplitude of N1 elicited by standard tones was smaller under fearful facial expressions than neutral facial expressions and was more negative for young adults than middle-aged adults. The MMN amplitude under fearful facial expressions was greater than neutral facial expressions, but the amplitude in middle-aged adults was smaller than in young adults.

Conclusion: Visually perceived negative emotion promotes the extraction of auditory features. Additionally, it enhances the effect of auditory change detection in middle-aged adults but fails to compensate for this decline with normal ageing.

Significance: The study may help to understand how visually perceived emotion affects the early stage of auditory information processing from an event process perspective.

Action effect predictions in 'what', 'when', and 'whether' intentional actions

It has been proposed that intentional action can be separated into three major types depending on the nature of the action choice - what (selecting what to do), when (selecting when to act) and whether (to perform the action or not). While many theories on action control assume that intentional action involves the prediction of action effects, there has not been any attempt to compare the three types of intentional actions (what, when, whether) with respect to action-effect prediction. Here, we employ an action-effect prediction paradigm where participants select the action on every trial based on either the what (choosing between alternative actions), when (choosing to respond at different time points) or whether (choosing to perform an action or not) action components, and each action choice is followed by either a predicted (standard) or a mispredicted (deviant) tone. We found a significant P2 difference between standard/deviant tones reflecting the formation of action-effect predictions regardless of whether the action choice was based on the 'what', 'when' or 'whether' decision. Furthermore, our analysis revealed that this P2 difference for the prediction effect was not observable in non-action trials within the 'whether' condition, which suggests an action-specific prediction process.

Benefits of choir singing on complex auditory encoding in the aging brain: An ERP study

Aging is accompanied by difficulties in auditory information processing, especially in more complex sound environments. Choir singing requires efficient processing of multiple sound features and could, therefore, mitigate the detrimental effects of aging on complex auditory encoding. We recorded auditory event-related potentials during passive listening of sounds in healthy older adult (≥ 60 years) choir singers and nonsinger controls. We conducted a complex oddball condition involving encoding of abstract regularities in combinations of pitch and location features, as well as in two simple oddball conditions, in which only either the pitch or spatial location of the sounds was varied. We analyzed change-related mismatch negativity (MMN) and obligatory P1 and N1 responses in each condition. In the complex condition, the choir singers showed a larger MMN than the controls, which also correlated with better performance in a verbal fluency test. In the simple pitch and location conditions, the choir singers had smaller N1 responses compared to the control subjects, whereas the MMN responses did not differ between groups. These results suggest that regular choir singing is associated both with more enhanced encoding of complex auditory regularities and more effective adaptation to simple sound features.

The Role of Action-Effect Contingency on Sensory Attenuation in the Absence of Movement

Stimuli that have been generated by a person's own willed motor actions generally elicit a suppressed electrophysiological, as well as phenomenological, response than identical stimuli that have been externally generated. This well-studied phenomenon, known as sensory attenuation, has mostly been studied by comparing ERPs evoked by self-initiated and externally generated sounds. However, most studies have assumed a uniform action-effect contingency, in which a motor action leads to a resulting sensation 100% of the time. In this study, we investigated the effect of manipulating the probability of action-effect contingencies on the sensory attenuation effect. In Experiment 1, participants watched a moving, marked tickertape while EEG was recorded. In the full-contingency (FC) condition, participants chose whether to press a button by a certain mark on the tickertape. If a button press had not occurred by the mark, a sound would be played a second later 100% of the time. If the button was pressed before the mark, the sound was not played. In the no-contingency (NC) condition, participants observed the same tickertape; in contrast, however, if participants did not press the button by the mark, a sound would occur only 50% of the time (NC-inaction). Furthermore, in the NC condition, if a participant pressed the button before the mark, a sound would also play 50% of the time (NC-action). In Experiment 2, the design was identical, except that a willed action (as opposed to a willed inaction) triggered the sound in the FC condition. The results were consistent across the two experiments: Although there were no differences in N1 amplitude between conditions, the amplitude of the Tb and P2 components were smaller in the FC condition compared with the NC-inaction condition, and the amplitude of the P2 component was also smaller in the FC condition compared with the NC-action condition. The results suggest that the effect of contingency on electrophysiological indices of sensory attenuation may be indexed primarily by the Tb and P2 components, rather than the N1 component which is most commonly studied.

Predictive Processing in Sign Languages: A Systematic Review

The objective of this article was to review existing research to assess the evidence for predictive processing (PP) in sign language, the conditions under which it occurs, and the effects of language mastery (sign language as a first language, sign language as a second language, bimodal bilingualism) on the neural bases of PP. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework. We searched peer-reviewed electronic databases (SCOPUS, Web of Science, PubMed, ScienceDirect, and EBSCO host) and gray literature (dissertations in ProQuest). We also searched the reference lists of records selected for the review and forward citations to identify all relevant publications. We searched for records based on five criteria (original work, peer-reviewed, published in English, research topic related to PP or neural entrainment, and human sign language processing). To reduce the risk of bias, the remaining two authors with expertise in sign language processing and a variety of research methods reviewed the results. Disagreements were resolved through extensive discussion. In the final review, 7 records were included, of which 5 were published articles and 2 were dissertations. The reviewed records provide evidence for PP in signing populations, although the underlying mechanism in the visual modality is not clear. The reviewed studies addressed the motor simulation proposals, neural basis of PP, as well as the development of PP. All studies used dynamic sign stimuli. Most of the studies focused on semantic prediction. The question of the mechanism for the interaction between one’s sign language competence (L1 vs. L2 vs. bimodal bilingual) and PP in the manual-visual modality remains unclear, primarily due to the scarcity of participants with varying degrees of language dominance. There is a paucity of evidence for PP in sign languages, especially for frequency-based, phonetic (articulatory), and syntactic prediction. However, studies published to date indicate that Deaf native/native-like L1 signers predict linguistic information during sign language processing, suggesting that PP is an amodal property of language processing.

More efficient formation of longer-term representations for word forms at birth can be linked to better language skills at 2 years

Infants are able to extract words from speech early in life. Here we show that the quality of forming longer-term representations for word forms at birth predicts expressive language ability at the age of two years. Seventy-five neonates were familiarized with two spoken disyllabic pseudowords. We then tested whether the neonate brain predicts the second syllable from the first one by presenting a familiarized pseudoword frequently, and occasionally violating the learned syllable combination by different rare pseudowords. Distinct brain responses were elicited by predicted and unpredicted word endings, suggesting that the neonates had learned the familiarized pseudowords. The difference between responses to predicted and unpredicted pseudowords indexing the quality of word-form learning during familiarization significantly correlated with expressive language scores (the mean length of utterance) at 24 months in the same infant. These findings suggest that 1) neonates can memorize disyllabic words so that a learned first syllable generates predictions for the word ending, and 2) early individual differences in the quality of word-form learning correlate with language skills. This relationship helps early identification of infants at risk for language impairment.

Neural Sources of Prediction Errors Detect Unrealistic VR Interactions

Objective Neural interfaces hold significant promise to implicitly track user experience. Their application in VR/AR simulations is especially favorable as it allows user assessment without breaking the immersive experience. In VR, designing immersion is one key challenge. Subjective questionnaires are the established metrics to assess the effectiveness of immersive VR simulations. However, administering such questionnaires requires breaking the immersive experience they are supposed to assess. Approach We present a complimentary metric based on a ERPs. For the metric to be robust, the neural signal employed must be reliable. Hence, it is beneficial to target the neural signal's cortical origin directly, efficiently separating signal from noise. To test this new complementary metric, we designed a reach-to-tap paradigm in VR to probe EEG and movement adaptation to visuo-haptic glitches. Our working hypothesis was, that these glitches, or violations of the predicted action outcome, may indicate a disrupted user experience. Main Results Using prediction error negativity features, we classified VR glitches with ~77\% accuracy. We localized the EEG sources driving the classification and found midline cingulate EEG sources and a distributed network of parieto-occipital EEG sources to enable the classification success. Significance Prediction error signatures from these sources reflect violations of user's predictions during interaction with AR/VR, promising a robust and targeted marker for adaptive user interfaces.

Evidence for Top-down Meter Perception in Infancy as Shown by Primed Neural Responses to an Ambiguous Rhythm

From auditory rhythm patterns, listeners extract the underlying steady beat, and perceptually group beats to form meters. While previous studies show infants discriminate different auditory meters, it remains unknown whether they can maintain (imagine) a metrical interpretation of an ambiguous rhythm through top-down processes. We investigated this via electroencephalographic mismatch responses. We primed 6-month-old infants (N = 24) to hear a 6-beat ambiguous rhythm either in duple meter (n = 13), or in triple meter (n = 11) through loudness accents either on every second or every third beat. Periods of priming were inserted before sequences of the ambiguous unaccented rhythm. To elicit mismatch responses, occasional pitch deviants occurred on either beat 4 (strong beat in triple meter; weak in duple) or beat 5 (strong in duple; weak in triple) of the unaccented trials. At frontal left sites, we found a significant interaction between beat and priming group in the predicted direction. Post-hoc analyses showed mismatch response amplitudes were significantly larger for beat 5 in the duple- than triple-primed group (p = .047) and were non-significantly larger for beat 4 in the triple- than duple-primed group. Further, amplitudes were generally larger in infants with musically experienced parents. At frontal right sites, mismatch responses were generally larger for those in the duple compared to triple group, which may reflect a processing advantage for duple meter. These results indicate infants can impose a top-down, internally generated meter on ambiguous auditory rhythms, an ability that would aid early language and music learning.

The sound of silence: Predictive error responses to unexpected sound omission in adults

The human auditory system excels at detecting patterns needed for processing speech and music. According to predictive coding, the brain predicts incoming sounds, compares predictions to sensory input, and generates a prediction error whenever a mismatch between the prediction and sensory input occurs. Predictive coding can be indexed in EEG with the mismatch negativity (MMN) and P3a components, two ERP components that are elicited by infrequent deviant sounds (e.g., differing in pitch, duration, loudness) in a stream of frequent sounds. If these components reflect prediction error, they should also be elicited by omitting an expected sound, but few studies have examined this. We compared ERPs elicited by infrequent randomly occurring omissions (unexpected silences) in tone sequences presented at 2 tones/sec to ERPs elicited by frequent, regularly occurring omissions (expected silences) within a sequence of tones and resting state EEG (a constant silence). We found that unexpected silences elicited significant MMN and P3a, although the magnitude of these components was quite small and variable. These results provide evidence for hierarchical predictive coding, indicating that the brain predicts silences as well as sounds.

Sound omission related brain responses in children

Action is an important way for children to learn about the world. Recent theories suggest that action is inherently accompanied by the sensory prediction of its effects. Such predictions can be revealed by rarely omitting the expected sensory consequence of the action, resulting in an omission response that is observable in the EEG. Although prediction errors play an important role in models of learning and development, little is known about omission-related brain responses in children. This study used a motor-auditory omission paradigm, testing a group of 6-8-year-old children and an adult group (N = 31 each). In an identity-specific condition, the sound coupled to the motor action was predictable, while in an identity unspecific condition the sound was unpredictable. Results of a temporal principal component analysis revealed that sound-related brain responses underlying the N1-complex differed considerably between age groups. Despite these developmental differences, omission responses (oN1) were similar between age groups. Two subcomponents of the oN1 were differently affected by specific and unspecific predictions. Results demonstrate that children, independent from the maturation of sound processing mechanisms, can implement specific and unspecific predictions as flexibly as adults. This supports theories that regard action and prediction error as important drivers of cognitive development.

Neural Substrates and Models of Omission Responses and Predictive Processes

Predictive coding theories argue that deviance detection phenomena, such as mismatch responses and omission responses, are generated by predictive processes with possibly overlapping neural substrates. Molecular imaging and electrophysiology studies of mismatch responses and corollary discharge in the rodent model allowed the development of mechanistic and computational models of these phenomena. These models enable translation between human and non-human animal research and help to uncover fundamental features of change-processing microcircuitry in the neocortex. This microcircuitry is characterized by stimulus-specific adaptation and feedforward inhibition of stimulus-selective populations of pyramidal neurons and interneurons, with specific contributions from different interneuron types. The overlap of the substrates of different types of responses to deviant stimuli remains to be understood. Omission responses, which are observed both in corollary discharge and mismatch response protocols in humans, are underutilized in animal research and may be pivotal in uncovering the substrates of predictive processes. Omission studies comprise a range of methods centered on the withholding of an expected stimulus. This review aims to provide an overview of omission protocols and showcase their potential to integrate and complement the different models and procedures employed to study prediction and deviance detection.This approach may reveal the biological foundations of core concepts of predictive coding, and allow an empirical test of the framework's promise to unify theoretical models of attention and perception.

Expectations of the timing and intensity of a stimulus propagate to the auditory periphery through the medial olivocochlear reflex

Expectations concerning the timing of a stimulus enhance attention at the time at which the event occurs, which confers significant sensory and behavioral benefits. Herein, we show that temporal expectations modulate even the sensory transduction in the auditory periphery via the descending pathway. We measured the medial olivocochlear reflex (MOCR), a sound-activated efferent feedback that controls outer hair cell motility and optimizes the dynamic range of the sensory system. MOCR was noninvasively assessed using otoacoustic emissions. We found that the MOCR was enhanced by a visual cue presented at a fixed interval before a sound but was unaffected if the interval was changing between trials. The MOCR was also observed to be stronger when the learned timing expectation matched with the timing of the sound but remained unvaried when these two factors did not match. This implies that the MOCR can be voluntarily controlled in a stimulus- and goal-directed manner. Moreover, we found that the MOCR was enhanced by the expectation of a strong but not a weak, sound intensity. This asymmetrical enhancement could facilitate antimasking and noise protective effects without disrupting the detection of faint signals. Therefore, the descending pathway conveys temporal and intensity expectations to modulate auditory processing.

Frontotemporal network in automatic / pre-attentive detection of abstract change: An event-related optical signal (EROS) study

The human brain constantly monitors the environment for unexpected changes. Under the prediction violation account, the Inferior Frontal Cortex (IFC) is involved in prediction-related processes for deviance detection processes in the Superior Temporal Cortex (STC). Consistent with this account, previous studies revealed an IFC-to-STC-followed-by-IFC mismatch response pattern to physical changes using event-related optical signals (EROS). However, detecting physical changes can be achieved by direct comparison of physical features between stimuli without making predictions, thus direct evidence supporting the prediction nature of the IFC-STC network in pre-attentive change detection was lacking. To address this issue, this study examined the EROS mismatch responses of the IFC-STC network when detecting the violation of an abstract rule. The rule "the higher the frequency of a tone, the stronger the intensity" established by standards was violated by deviants of 12 deviance levels. When deviants were preceded by a short train of standards, early IFC, STC, and late IFC EROS mismatch responses linearly increased with the deviance levels. When deviants were preceded by a longer train of standards, the STC but not the early or late IFC EROS mismatch responses were elicited by all the deviants without modulation by deviance levels. These results demonstrate a functional role of the IFC in the abstract change detection when insufficient rule-conforming information could be extracted from the preceding standards and are consistent with the predictive violation account of pre-attentive change detection.

Temporal–spectral signaling of sensory information and expectations in the cerebral processing of pain

Pain is not only shaped by sensory information but also by an individual’s expectations. Here, we investigated how commonly analyzed electroencephalography (EEG) responses to pain signal sensory information, expectations, and discrepancies thereof (prediction errors) in the processing of pain. Bayesian analysis confirmed that pain perception was shaped by objective sensory information and expectations. In contrast, EEG responses at different latencies (including the N1, N2, and P2 components) and frequencies (including alpha, beta, and gamma oscillations) were shaped by sensory information but not by expectations. Thus, EEG responses to pain are more involved in signaling sensory information than in signaling expectations or prediction errors. Expectation effects are obviously mediated by other brain mechanisms than the effects of sensory information on pain.

The perception of pain is shaped by somatosensory information about threat. However, pain is also influenced by an individual’s expectations. Such expectations can result in clinically relevant modulations and abnormalities of pain. In the brain, sensory information, expectations (predictions), and discrepancies thereof (prediction errors) are signaled by an extended network of brain areas which generate evoked potentials and oscillatory responses at different latencies and frequencies. However, a comprehensive picture of how evoked and oscillatory brain responses signal sensory information, predictions, and prediction errors in the processing of pain is lacking so far. Here, we therefore applied brief painful stimuli to 48 healthy human participants and independently modulated sensory information (stimulus intensity) and expectations of pain intensity while measuring brain activity using electroencephalography (EEG). Pain ratings confirmed that pain intensity was shaped by both sensory information and expectations. In contrast, Bayesian analyses revealed that stimulus-induced EEG responses at different latencies (the N1, N2, and P2 components) and frequencies (alpha, beta, and gamma oscillations) were shaped by sensory information but not by expectations. Expectations, however, shaped alpha and beta oscillations before the painful stimuli. These findings indicate that commonly analyzed EEG responses to painful stimuli are more involved in signaling sensory information than in signaling expectations or mismatches of sensory information and expectations. Moreover, they indicate that the effects of expectations on pain are served by brain mechanisms which differ from those conveying effects of sensory information on pain.

Speech-related auditory salience detection in the posterior superior temporal region

Processing auditory human speech requires both detection (early and transient) and analysis (sustained). We analyzed high gamma (70-110 Hz) activity of intracranial electroencephalography waveforms acquired during an auditory task that paired forward speech, reverse speech, and signal correlated noise. We identified widespread superior temporal sites with sustained activity responding only to forward and reverse speech regardless of paired order. More localized superior temporal auditory onset sites responded to all stimulus types when presented first in a pair and responded in recurrent fashion to the second paired stimulus in select conditions even in the absence of interstimulus silence; a novel finding. Auditory onset activity to a second paired sound recurred according to relative salience, with evidence of partial suppression during linguistic processing. We propose that temporal lobe auditory onset sites facilitate a salience detector function with hysteresis of 200 ms and are influenced by cortico-cortical feedback loops involving linguistic processing and articulation.

Prediction under uncertainty: Dissociating sensory from cognitive expectations in highly uncertain musical contexts

Predictive models in the brain rely on the continuous extraction of regularities from the environment. These models are thought to be updated by novel information, as reflected in prediction error responses such as the mismatch negativity (MMN). However, although in real life individuals often face situations in which uncertainty prevails, it remains unclear whether and how predictive models emerge in high-uncertainty contexts. Recent research suggests that uncertainty affects the magnitude of MMN responses in the context of music listening. However, musical predictions are typically studied with MMN stimulation paradigms based on Western tonal music, which are characterized by relatively high predictability. Hence, we developed an MMN paradigm to investigate how the high uncertainty of atonal music modulates predictive processes as indexed by the MMN and behavior. Using MEG in a group of 20 subjects without musical training, we demonstrate that the magnetic MMN in response to pitch, intensity, timbre, and location deviants is evoked in both tonal and atonal melodies, with no significant differences between conditions. In contrast, in a separate behavioral experiment involving 39 non-musicians, participants detected pitch deviants more accurately and rated confidence higher in the tonal than in the atonal musical context. These results indicate that contextual tonal uncertainty modulates processing stages in which conscious awareness is involved, although deviants robustly elicit low-level pre-attentive responses such as the MMN. The achievement of robust MMN responses, despite high tonal uncertainty, is relevant for future studies comparing groups of listeners' MMN responses to increasingly ecological music stimuli.