Adaptation patterns and their associations with mismatch negativity: An electroencephalogram (EEG) study with controlled expectations

Adaptation refers to the decreased neural response that occurs after repeated exposure to a stimulus. While many electroencephalogram (EEG) studies have investigated adaptation by using either single or multiple repetitions, the adaptation patterns under controlled expectations manifested in the two main auditory components, N1 and P2, are still largely unknown. Additionally, although multiple repetitions are commonly used in mismatch negativity (MMN) experiments, it is unclear how adaptation at different time windows contributes to this phenomenon. In this study, we conducted an EEG experiment with 37 healthy adults using a random stimulus arrangement and extended tone sequences to control expectations. We tracked the amplitudes of the N1 and P2 components across the first 10 tones to examine adaptation patterns. Our findings revealed an L-shaped adaptation pattern characterised by a significant decrease in N1 amplitude after the first repetition (N1 initial adaptation), followed by a continuous, linear increase in P2 amplitude after the first repetition (P2 subsequent adaptation), possibly indicating model adjustment. Regression analysis demonstrated that the peak amplitudes of both the N1 initial adaptation and the P2 subsequent adaptation significantly accounted for variance in MMN amplitude. These results suggest distinct adaptation patterns for multiple repetitions across different components and indicate that the MMN reflects a combination of two processes: the initial adaptation in the N1 and a continuous model adjustment effect in the P2. Understanding these processes separately could have implications for models of cognitive processing and clinical disorders.

The Complex Pattern Mismatch Negativity as a Potential Indicator of Psychosis Across all Phases of Illness: A Meta-Analysis

Over the past decade, there has been extensive research on the mismatch negativity (MMN) and its promise as a biomarker of illness in people with schizophrenia (SZ). Nevertheless, when attempting to assess the early stages of illness progression, the utility of MMN has been inconsistent. Recently, researchers have been investigating a more advanced MMN paradigm (the complex MMN [cMMN]) which is believed to index higher-order cognitive processing and has been suggested to be a more effective indicator of the early phases of SZ. The cMMN is defined as a paradigm that relies on alterations within a pre-established pattern of stimuli. In this meta-analysis, we investigated cMMN deficits in individuals with SZ, including an analysis involving those in the first 5 years of illness. Our search also included individuals with bipolar disorder who experience psychosis; however, no related papers were found and thus, no findings are reported. Our findings indicate a small/moderate effect (d = 0.47), suggesting that individuals with SZ exhibit reduced cMMN amplitudes compared to individuals without SZ. Interestingly, this effect seems to be more pronounced in individuals within the first 5 years of their illness (d = 0.58), suggesting that cMMN might be a more sensitive biomarker in the early phases of SZ compared to traditional paradigms.

Repetition-Dependent Adaptation and Prediction Error Signalling in Schizophrenia Patients With Auditory Hallucinations: A Roving Mismatch Negativity Study

BACKGROUND

Dysregulated prediction error-signalling may explain auditory hallucinations in schizophrenia (SZ-AH). Roving mismatch negativity (rMMN) is an event-related potential (ERP) index where the deviant tone becomes the new standard with repetitions. Longer repetitions of standard stimuli yield a more positive sensory-adaptation response (Repetition Positivity-RP), elicit a stronger deviance-detection when interrupted (deviant negativity-DN), and the difference waveform between them reflects the strength of prediction-error signalling (mismatch negativity-MMN).

METHODS

Twenty-three SZ-AH patients and twenty-three healthy controls (HC) underwent rMMN assessment. Various standard stimuli were repeated in sets of 3, 8 and 33 yielding three components for RP (RP3, RP8, RP33), DN (DN3, DN8, DN33), and MMN (MMN3, MMN8, MMN33). Amplitudes and latencies were compared across groups. Correlation between (a) rMMN amplitudes and latencies, and clinical variables in SZ-AH, and (b) the RP-DN amplitude pair for all three repetition sets (3, 8, 33) were also examined.

RESULTS

All DN and MMN33 amplitudes were significantly suppressed in SZ-AH, while RP amplitudes were not. MMN33 latency was significantly longer in SZ-AH than HC. A few amplitudes and latencies significantly correlated with the frequency of AH. HC showed a significant positive correlation between RP-DN amplitude pairs for sets of 3 and 8 but not for 33; SZ-AH group's correlation profile was opposite to this.

DISCUSSION

The link between repetition-dependent sensory-adaptation and deviance-detection is perturbed in SZ-AH. The unimpaired RP profile in SZ-AH is due to potential interference of AH with auditory information processing, and does not indicate a preserved short-term plasticity of the echoic memory trace.

An EEG-Based Neuroplastic Approach to Predictive Coding in People With Schizophrenia or Traumatic Brain Injury

Despite different etiologies, people with schizophrenia (SCZ) or with traumatic brain injury (TBI) both show aberrant neuroplasticity. One neuroplastic mechanism that may be affected is prediction error coding. We used a roving mismatch negativity (rMMN) paradigm which uses different lengths of standard tone trains and is optimized to assess predictive coding. Twenty-five SCZ, 22 TBI (mild to moderate), and 25 healthy controls were assessed. We used a frequency-deviant rMMN in which the number of standards preceding the deviant was either 2, 6, or 36. We evaluated repetition positivity to the standard tone immediately preceding a deviant tone (repetition positivity [RP], to assess formation of the memory trace), deviant negativity to the deviant stimulus (deviant negativity [DN], which reflects signaling of a prediction error), and the difference wave between the 2 (the MMN). We found that SCZ showed reduced DN and MMN compared with healthy controls and with people with mild to moderate TBI. We did not detect impairments in any index (RP, DN, or MMN) in people with TBI compared to controls. Our findings suggest that prediction error coding assessed with rMMN is aberrant in SCZ but intact in TBI, though there is a suggestion that severity of head injury results in poorer prediction error coding.

Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies

Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.

Time-resolved dynamic computational modeling of human EEG recordings reveals gradients of generative mechanisms for the MMN response

Despite attempts to unify the different theoretical accounts of the mismatch negativity (MMN), there is still an ongoing debate on the neurophysiological mechanisms underlying this complex brain response. On one hand, neuronal adaptation to recurrent stimuli is able to explain many of the observed properties of the MMN, such as its sensitivity to controlled experimental parameters. On the other hand, several modeling studies reported evidence in favor of Bayesian learning models for explaining the trial-to-trial dynamics of the human MMN. However, direct comparisons of these two main hypotheses are scarce, and previous modeling studies suffered from methodological limitations. Based on reports indicating spatial and temporal dissociation of physiological mechanisms within the timecourse of mismatch responses in animals, we hypothesized that different computational models would best fit different temporal phases of the human MMN. Using electroencephalographic data from two independent studies of a simple auditory oddball task (n = 82), we compared adaptation and Bayesian learning models' ability to explain the sequential dynamics of auditory deviance detection in a time-resolved fashion. We first ran simulations to evaluate the capacity of our design to dissociate the tested models and found that they were sufficiently distinguishable above a certain level of signal-to-noise ratio (SNR). In subjects with a sufficient SNR, our time-resolved approach revealed a temporal dissociation between the two model families, with high evidence for adaptation during the early MMN window (from 90 to 150-190 ms post-stimulus depending on the dataset) and for Bayesian learning later in time (170-180 ms or 200-220ms). In addition, Bayesian model averaging of fixed-parameter models within the adaptation family revealed a gradient of adaptation rates, resembling the anatomical gradient in the auditory cortical hierarchy reported in animal studies.

Why mismatch negativity continues to hold potential in probing altered brain function in schizophrenia

The brain potential known as mismatch negativity (MMN) is one of the most studied indices of altered brain function in schizophrenia. This review looks at what has been learned about MMN in schizophrenia over the last three decades and why the level of interest and activity in this field of research remains strong. A diligent consideration of available evidence suggests that MMN can serve as a biomarker in schizophrenia, but perhaps not the kind of biomarker that early research supposed. This review concludes that MMN measurement is likely to be most useful as a monitoring and response biomarker enabling tracking of an underlying pathology and efficacy of interventions, respectively. The role of, and challenges presented by, pre-clinical models is discussed as well as the merits of different methodologies that can be brought to bear in pursuing a deeper understanding of pathophysiology that might explain smaller MMN in schizophrenia.

The impact of spatial variance on precision estimates in an auditory oddball paradigm

Predictive processing theories suggest that a principal function of the brain is to reduce the surprise of incoming sensory information by creating accurate and precise models of the environment. These models are commonly explored by looking at the prediction errors elicited when experience departs from predictions. One such prediction error is the mismatch negativity (MMN). Using this component, it is possible to examine the effect of external noise on the precision of the developed model. Recent studies have shown that the brain may not update its model every time there is a change in the environment, rather it will only update it when doing so will increase precision and or accuracy of the model. The current study examined this process using oddball sound sequences with high and low spatial variability and examining how this affected the elicited MMN to a duration deviant sound. The results showed a strong null effect of spatial variance both at a local and sequence levels. These results indicate that variability in the sound sequence will not invariably affect model precision estimates and thus the amplitude of the MMN component.

Saccades and presaccadic stimulus repetition alter cortical network topology and dynamics: evidence from EEG and graph theoretical analysis

Parietal and frontal cortex are involved in saccade generation, and their output signals modify visual signals throughout cortex. Local signals associated with these interactions are well described, but their large-scale progression and network dynamics are unknown. Here, we combined source localized electroencephalography (EEG) and graph theory analysis (GTA) to understand how saccades and presaccadic visual stimuli interactively alter cortical network dynamics in humans. Twenty-one participants viewed 1-3 vertical/horizontal grids, followed by grid with the opposite orientation just before a horizontal saccade or continued fixation. EEG signals from the presaccadic interval (or equivalent fixation period) were used for analysis. Source localization-through-time revealed a rapid frontoparietal progression of presaccadic motor signals and stimulus-motor interactions, with additional band-specific modulations in several frontoparietal regions. GTA analysis revealed a saccade-specific functional network with major hubs in inferior parietal cortex (alpha) and the frontal eye fields (beta), and major saccade-repetition interactions in left prefrontal (theta) and supramarginal gyrus (gamma). This network showed enhanced segregation, integration, synchronization, and complexity (compared with fixation), whereas stimulus repetition interactions reduced synchronization and complexity. These cortical results demonstrate a widespread influence of saccades on both regional and network dynamics, likely responsible for both the motor and perceptual aspects of saccades.

Action effect predictions in 'what', 'when', and 'whether' intentional actions

It has been proposed that intentional action can be separated into three major types depending on the nature of the action choice - what (selecting what to do), when (selecting when to act) and whether (to perform the action or not). While many theories on action control assume that intentional action involves the prediction of action effects, there has not been any attempt to compare the three types of intentional actions (what, when, whether) with respect to action-effect prediction. Here, we employ an action-effect prediction paradigm where participants select the action on every trial based on either the what (choosing between alternative actions), when (choosing to respond at different time points) or whether (choosing to perform an action or not) action components, and each action choice is followed by either a predicted (standard) or a mispredicted (deviant) tone. We found a significant P2 difference between standard/deviant tones reflecting the formation of action-effect predictions regardless of whether the action choice was based on the 'what', 'when' or 'whether' decision. Furthermore, our analysis revealed that this P2 difference for the prediction effect was not observable in non-action trials within the 'whether' condition, which suggests an action-specific prediction process.

Relevance to the higher order structure may govern auditory statistical learning in neonates

Hearing is one of the earliest senses to develop and is quite mature by birth. Contemporary theories assume that regularities in sound are exploited by the brain to create internal models of the environment. Through statistical learning, internal models extrapolate from patterns to predictions about subsequent experience. In adults, altered brain responses to sound enable us to infer the existence and properties of these models. In this study, brain potentials were used to determine whether newborns exhibit context-dependent modulations of a brain response that can be used to infer the existence and properties of internal models. Results are indicative of significant context-dependence in the responsivity to sound in newborns. When common and rare sounds continue in stable probabilities over a very long period, neonates respond to all sounds equivalently (no differentiation). However, when the same common and rare sounds at the same probabilities alternate over time, the neonate responses show clear differentiations. The context-dependence is consistent with the possibility that the neonate brain produces more precise internal models that discriminate between contexts when there is an emergent structure to be discovered but appears to adopt broader models when discrimination delivers little or no additional information about the environment.

Electrophysiological correlates of perceptual prediction error are attenuated in dyslexia

A perceptual adaptation deficit often accompanies reading difficulty in dyslexia, manifesting in poor perceptual learning of consistent stimuli and reduced neurophysiological adaptation to stimulus repetition. However, it is not known how adaptation deficits relate to differences in feedforward or feedback processes in the brain. Here we used electroencephalography (EEG) to interrogate the feedforward and feedback contributions to neural adaptation as adults with and without dyslexia viewed pairs of faces and words in a paradigm that manipulated whether there was a high probability of stimulus repetition versus a high probability of stimulus change. We measured three neural dependent variables: expectation (the difference between prestimulus EEG power with and without the expectation of stimulus repetition), feedforward repetition (the difference between event-related potentials (ERPs) evoked by an expected change and an unexpected repetition), and feedback-mediated prediction error (the difference between ERPs evoked by an unexpected change and an expected repetition). Expectation significantly modulated prestimulus theta- and alpha-band EEG in both groups. Unexpected repetitions of words, but not faces, also led to significant feedforward repetition effects in the ERPs of both groups. However, neural prediction error when an unexpected change occurred instead of an expected repetition was significantly weaker in dyslexia than the control group for both faces and words. These results suggest that the neural and perceptual adaptation deficits observed in dyslexia reflect the failure to effectively integrate perceptual predictions with feedforward sensory processing. In addition to reducing perceptual efficiency, the attenuation of neural prediction error signals would also be deleterious to the wide range of perceptual and procedural learning abilities that are critical for developing accurate and fluent reading skills.

Expectations about dynamic visual objects facilitates early sensory processing of congruent sounds

The perception of a moving object can lead to the expectation of its sound, yet little is known about how visual expectations influence auditory processing. We examined how visual perception of an object moving continuously across the visual field influences early auditory processing of a sound that occurred congruently or incongruently with the object's motion. In Experiment 1, electroencephalogram (EEG) activity was recorded from adults who passively viewed a ball that appeared either on the left or right boundary of a display and continuously traversed along the horizontal midline to make contact and elicit a bounce sound off the opposite boundary. Our main analysis focused on the auditory-evoked event-related potential. For audio-visual (AV) trials, a sound accompanied the visual input when the ball contacted the opposite boundary (AV-synchronous), or the sound occurred before contact (AV-asynchronous). We also included audio-only and visual-only trials. AV-synchronous sounds elicited an earlier and attenuated auditory response relative to AV-asynchronous or audio-only events. In Experiment 2, we examined the roles of expectancy and multisensory integration in influencing this response. In addition to the audio-only, AV-synchronous, and AV-asynchronous conditions, participants were shown a ball that became occluded prior to reaching the boundary of the display, but elicited an expected sound at the point of occluded collision. The auditory response during the AV-occluded condition resembled that of the AV-synchronous condition, suggesting that expectations induced by a moving object can influence early auditory processing. Broadly, the results suggest that dynamic visual stimuli can help generate expectations about the timing of sounds, which then facilitates the processing of auditory information that matches these expectations.

Shorter Contextual Timescale Rather Than Memory Deficit in Aging

Many aspects of cognitive ability and brain function that change as we age look like deficits on account of measurable differences in comparison to younger adult groups. One such difference occurs in auditory sensory responses that index perceptual learning. Meta-analytic findings show reliable age-related differences in auditory responses to repetitive patterns of sound and to rare violations of those patterns, variously attributed to deficits in auditory sensory memory and inhibition. Here, we determine whether proposed deficits would render older adults less prone to primacy effects, robustly observed in young adults, which present as a tendency for first learning to have a disproportionate influence over later perceptual inference. The results confirm this reduced sensitivity to primacy effects but do not support impairment in auditory sensory memory as the origin of this difference. Instead, the aging brain produces data consistent with shorter timescales of contextual reference. In conclusion, age-related differences observed previously for perceptual inference appear highly context-specific necessitating reconsideration of whether and to what function the notion of deficit should be attributed, and even whether the notion of deficit is appropriate at all.

Attention modulates repetition effects in a context of low periodicity

Stimulus repetition can result in a reduction in neural responses (i.e., repetition suppression) in neuroimaging studies. Predictive coding models of perception postulate that this phenomenon largely reflects the top-down attenuation of prediction errors. Electroencephalography research further demonstrated that repetition effects consist of sequentially ordered attention-independent and attention-dependent components in a context of high periodicity. However, the statistical structure of our auditory environment is richer than that of a fixed pattern. It remains unclear if the attentional modulation of repetition effects can be generalised to a setting which better represents the nature of our auditory environment. Here we used electroencephalography to investigate whether the attention-independent and attention-dependent components of repetition effects previously described in the auditory modality remain in a context of low periodicity where temporary disruption might be absent/present. Participants were presented with repetition trains of various lengths, with/without temporary disruptions. We found attention-independent and attention-dependent repetition effects on, respectively, the P2 and P3a event-related potential components. This pattern of results is in line with previous research, confirming that the attenuation of prediction errors upon stimulus repetition is first registered regardless of attentional state before further attenuation of attended but not unattended prediction errors takes place. However, unlike previous reports, these effects manifested on later components. This divergence from previous studies is discussed in terms of the possible contribution of contextual factors.

Model-based prediction of muscarinic receptor function from auditory mismatch negativity responses

Drugs affecting neuromodulation, for example by dopamine or acetylcholine, take centre stage among therapeutic strategies in psychiatry. These neuromodulators can change both neuronal gain and synaptic plasticity and therefore affect electrophysiological measures. An important goal for clinical diagnostics is to exploit this effect in the reverse direction, i.e., to infer the status of specific neuromodulatory systems from electrophysiological measures. In this study, we provide proof-of-concept that the functional status of cholinergic (specifically muscarinic) receptors can be inferred from electrophysiological data using generative (dynamic causal) models. To this end, we used epidural EEG recordings over two auditory cortical regions during a mismatch negativity (MMN) paradigm in rats. All animals were treated, across sessions, with muscarinic receptor agonists and antagonists at different doses. Together with a placebo condition, this resulted in five levels of muscarinic receptor status. Using a dynamic causal model - embodying a small network of coupled cortical microcircuits - we estimated synaptic parameters and their change across pharmacological conditions. The ensuing parameter estimates associated with (the neuromodulation of) synaptic efficacy showed both graded muscarinic effects and predictive validity between agonistic and antagonistic pharmacological conditions. This finding illustrates the potential utility of generative models of electrophysiological data as computational assays of muscarinic function. In application to EEG data of patients from heterogeneous spectrum diseases, e.g. schizophrenia, such models might help identify subgroups of patients that respond differentially to cholinergic treatments. SIGNIFICANCE STATEMENT: In psychiatry, the vast majority of pharmacological treatments affect actions of neuromodulatory transmitters, e.g. dopamine or acetylcholine. As treatment is largely trial-and-error based, one of the goals for computational psychiatry is to construct mathematical models that can serve as "computational assays" and infer the status of specific neuromodulatory systems in individual patients. This translational neuromodeling strategy has great promise for electrophysiological data in particular but requires careful validation. The present study demonstrates that the functional status of cholinergic (muscarinic) receptors can be inferred from electrophysiological data using dynamic causal models of neural circuits. While accuracy needs to be enhanced and our results must be replicated in larger samples, our current results provide proof-of-concept for computational assays of muscarinic function using EEG.

Mismatch Negativity and Stimulus-Preceding Negativity in Paradigms of Increasing Auditory Complexity: A Possible Role in Predictive Coding

The auditory mismatch negativity (MMN) has been considered a preattentive index of auditory processing and/or a signature of prediction error computation. This study tries to demonstrate the presence of an MMN to deviant trials included in complex auditory stimuli sequences, and its possible relationship to predictive coding. Additionally, the transfer of information between trials is expected to be represented by stimulus-preceding negativity (SPN), which would possibly fit the predictive coding framework. To accomplish these objectives, the EEG of 31 subjects was recorded during an auditory paradigm in which trials composed of stimulus sequences with increasing or decreasing frequencies were intermingled with deviant trials presenting an unexpected ending. Our results showed the presence of an MMN in response to deviant trials. An SPN appeared during the intertrial interval and its amplitude was reduced in response to deviant trials. The presence of an MMN in complex sequences of sounds and the generation of an SPN component, with different amplitudes in deviant and standard trials, would support the predictive coding framework.

Both contextual regularity and selective attention affect the reduction of precision-weighted prediction errors but in distinct manners

Predictive coding model of perception postulates that the primary objective of the brain is to infer the causes of sensory inputs by reducing prediction errors (i.e., the discrepancy between expected and actual information). Moreover, prediction errors are weighted by their precision (i.e., inverse variance), which quantifies the degree of certainty about the variables. There is accumulating evidence that the reduction of precision-weighted prediction errors can be affected by contextual regularity (as an external factor) and selective attention (as an internal factor). However, it is unclear whether the two factors function together or separately. Here we used electroencephalography (EEG) to examine the putative interaction of contextual regularity and selective attention on this reduction process. Participants were presented with pairs of regular and irregular quartets in attended and unattended conditions. We found that contextual regularity and selective attention independently modulated the N1/MMN where the repetition effect was absent. On the P2, the two factors respectively interacted with the repetition effect without interacting with each other. The results showed that contextual regularity and selective attention likely affect the reduction of precision-weighted prediction errors in distinct manners. While contextual regularity finetunes our efficiency at reducing precision-weighted prediction errors, selective attention seems to modulate the reduction process following the Matthew effect of accumulated advantage.

Individuals With Autism Have No Detectable Deficit in Neural Markers of Prediction Error When Presented With Auditory Rhythms of Varied Temporal Complexity

The brain's ability to encode temporal patterns and predict upcoming events is critical for speech perception and other aspects of social communication. Deficits in predictive coding may contribute to difficulties with social communication and overreliance on repetitive predictable environments in individuals with autism spectrum disorder (ASD). Using a mismatch negativity (MMN) task involving rhythmic tone sequences of varying complexity, we tested the hypotheses that (1) individuals with ASD have reduced MMN response to auditory stimuli that deviate in presentation timing from expected patterns, particularly as pattern complexity increases and (2) amplitude of MMN signal is inversely correlated with level of impairment in social communication and repetitive behaviors. Electroencephalography was acquired as individuals (age 6-21 years) listened to repeated five-rhythm tones that varied in the Shannon entropy of the rhythm across three conditions (zero, medium-1 bit, and high-2 bit entropy). The majority of the tones conformed to the established rhythm (standard tones); occasionally the fourth tone was temporally shifted relative to its expected time of occurrence (deviant tones). Social communication and repetitive behaviors were measured using the Social Responsiveness Scale and Repetitive Behavior Scale-Revised. Both neurotypical controls (n = 19) and individuals with ASD (n = 21) show stepwise decreases in MMN as a function of increasing entropy. Contrary to the result forecasted by a predictive coding hypothesis, individuals with ASD do not differ from controls in these neural mechanisms of prediction error to auditory rhythms of varied temporal complexity, and there is no relationship between these signals and social communication or repetitive behavior measures. LAY SUMMARY: We tested the idea that the brain's ability to use previous experience to influence processing of sounds is weaker in individuals with autism spectrum disorder (ASD) than in neurotypical individuals. We found no difference between individuals with ASD and neurotypical controls in brain wave responses to sounds that occurred earlier than expected in either simple or complex rhythms. There was also no relationship between these brain waves and social communication or repetitive behavior scores.

Timing of repetition suppression of event-related potentials to unattended objects

Current theories of object perception emphasize the automatic nature of perceptual inference. Repetition suppression (RS), the successive decrease of brain responses to repeated stimuli, is thought to reflect the optimization of perceptual inference through neural plasticity. While functional imaging studies revealed brain regions that show suppressed responses to the repeated presentation of an object, little is known about the intra-trial time course of repetition effects to everyday objects. Here, we used event-related potentials (ERPs) to task-irrelevant line-drawn objects, while participants engaged in a distractor task. We quantified changes in ERPs over repetitions using three general linear models that modeled RS by an exponential, linear, or categorical "change detection" function in each subject. Our aim was to select the model with highest evidence and determine the within-trial time-course and scalp distribution of repetition effects using that model. Model comparison revealed the superiority of the exponential model indicating that repetition effects are observable for trials beyond the first repetition. Model parameter estimates revealed a sequence of RS effects in three time windows (86-140, 322-360, and 400-446 ms) and with occipital, temporoparietal, and frontotemporal distribution, respectively. An interval of repetition enhancement (RE) was also observed (320-340 ms) over occipitotemporal sensors. Our results show that automatic processing of task-irrelevant objects involves multiple intervals of RS with distinct scalp topographies. These sequential intervals of RS and RE might reflect the short-term plasticity required for optimization of perceptual inference and the associated changes in prediction errors and predictions, respectively, over stimulus repetitions during automatic object processing.

The role of Hebbian learning in human perception: a methodological and theoretical review of the human Visual Long-Term Potentiation paradigm

Long-term potentiation (LTP) is one of the most widely studied forms of neural plasticity, and is thought to be the principle mechanism underlying long-term memory and learning in the brain. Sensory paradigms utilising electroencephalography (EEG) and sensory stimulation to induce LTP have allowed translation from rodent and primate invasive research to non-invasive human investigations. This review focusses on visual sensory LTP induced using repetitive visual stimulation, resulting in changes in the visually evoked response recorded at the scalp with EEG. Across 15 years of use and replication in humans several major paradigm variants for eliciting visual LTP have emerged. The application of different paradigms, and the broad implementation of visual LTP across different populations combines to provide a rich and sensitive account of Hebbian LTP, and potentially non-Hebbian plasticity mechanisms. This review will conclude with a discussion of how these findings have advanced existing theories of perceptual learning by positioning Hebbian learning both alongside and within other major theories such as Predictive Coding and The Free Energy Principle.

Context is everything: How context shapes modulations of responses to unattended sound

The concept of perceptual inferences taking place over multiple timescales simultaneously raises questions about how the brain can balance the demands of remaining sensitive to local rarity while utilising more global longer-term predictability to modulate cortical responses. In the present study auditory evoked potentials to four presentations of the same sound sequence containing predictable structure on a local (milliseconds to seconds) and more global (many minutes) timescales were recorded. The results from 33 participants are used to demonstrate that predictions about both local (internal predictive models) and global (meta-models that define expected precisions associated with familiar internal model states) regularities are formed. The study exposes more local context-based modulations of the P1 but more global order-based modulations of the auditory evoked N2 components. The results are discussed in terms of theoretical links advocating that uncertainty at multiple timescales could lead to differential component modulations, and the importance of considering the broader learning context in auditory evoked potential studies.

Change in the Neural Response to Auditory Deviance Following Cognitive Therapy for Hallucinations in Patients With Schizophrenia

Adjunctive psychotherapeutic approaches recommended for patients with schizophrenia (SZ) who are fully or partially resistant to pharmacotherapy have rarely utilized biomarkers to enhance the understanding of treatment-effective mechanisms. As SZ patients with persistent auditory verbal hallucinations (AVH) frequently evidence reduced neural responsiveness to external auditory stimulation, which may impact cognitive and functional outcomes, this study examined the effects of cognitive behavioral therapy for voices (CBTv) on clinical and AVH symptoms and the sensory processing of auditory deviants as measured with the electroencephalographically derived mismatch negativity (MMN) response. Twenty-four patients with SZ and AVH were randomly assigned to group CBTv treatment or a treatment as usual (TAU) condition. Patients in the group CBTv condition received treatment for 5 months while the matched control patients received TAU for the same period, followed by 5 months of group CBTv. Assessments were conducted at baseline and at the end of treatment. Although not showing consistent changes in the frequency of AVHs, CBTv (vs. TAU) improved patients' appraisal (p = 0.001) of and behavioral/emotional responses to AVHs, and increased both MMN generation (p = 0.001) and auditory cortex current density (p = 0.002) in response to tone pitch deviants. Improvements in AVH symptoms were correlated with change in pitch deviant MMN and current density in left primary auditory cortex. These findings of improved auditory information processing and symptom-response attributable to CBTv suggest potential clinical and functional benefits of psychotherapeutical approaches for patients with persistent AVHs.

Auditory Mismatch Negativity Under Predictive Coding Framework and Its Role in Psychotic Disorders

Traditional neuroscience sees sensory perception as a simple feedforward process. This view is challenged by the predictive coding model in recent years due to the robust evidence researchers had found on how our prediction could influence perception. In the first half of this article, we reviewed the concept of predictive brain and some empirical evidence of sensory prediction in visual and auditory processing. The predictive function along the auditory pathway was mainly studied by mismatch negativity (MMN)-a brain response to an unexpected disruption of regularity. We summarized a range of MMN paradigms and discussed how they could contribute to the theoretical development of the predictive coding neural network by the mechanism of adaptation and deviance detection. Such methodological and conceptual evolution sharpen MMN as a tool to better understand the structural and functional brain abnormality for neuropsychiatric disorder such as schizophrenia.

The Predictive Processing Model of EMDR

Eye Movement Desensitization and Reprocessing Therapy (EMDR) is an effective treatment for Post-traumatic Stress Disorder (PTSD). The Adaptive Information Processing Model (AIP) guides the development and practice of EMDR. The AIP postulates inadequately processed memory as the foundation of PTSD pathology. Predictive Processing postulates that the primary function of the brain is prediction that serves to anticipate the next moment of experience in order to resist the dissipative force of entropy thus facilitating continued survival. Memory is the primary substrate of prediction, and is optimized by an ongoing process of precision weighted prediction error minimization that refines prediction by updating the memories on which it is based. The Predictive Processing model of EMDR postulates that EMDR facilitates the predictive processing of traumatic memory by overcoming the bias against exploration and evidence accumulation. The EMDR protocol brings the traumatic memory into an active state of re-experiencing. Defensive responding and/or low sensory precision preclude evidence accumulation to test the predictions of the traumatic memory in the present. Sets of therapist guided eye movements repeatedly challenge the bias against evidence accumulation and compel sensory sampling of the benign present. Eye movements reset the theta rhythm organizing the flow of information through the brain, facilitating the deployment of both overt and covert attention, and the mnemonic search for associations. Sampling of sensation does not support the predictions of the traumatic memory resulting in prediction error that the brain then attempts to minimize. The net result is a restoration of the integrity of the rhythmic deployment of attention, a recalibration of sensory precision, and the updating (reconsolidation) of the traumatic memory. Thus one prediction of the model is a decrease in Attention Bias Variability, a core dysfunction in PTSD, following successful treatment with EMDR.

Parsing components of auditory predictive coding in schizophrenia using a roving standard mismatch negativity paradigm

BACKGROUND

Mismatch negativity (MMN) is an event-related potential (ERP) component reflecting auditory predictive coding. Repeated standard tones evoke increasing positivity ('repetition positivity'; RP), reflecting strengthening of the standard's memory trace and the prediction it will recur. Likewise, deviant tones preceded by more standard repetitions evoke greater negativity ('deviant negativity'; DN), reflecting stronger prediction error signaling. These memory trace effects are also evident in MMN difference wave. Here, we assess group differences and test-retest reliability of these indices in schizophrenia patients (SZ) and healthy controls (HC).

METHODS

Electroencephalography was recorded twice, 2 weeks apart, from 43 SZ and 30 HC, during a roving standard paradigm. We examined ERPs to the third, eighth, and 33rd standards (RP), immediately subsequent deviants (DN), and the corresponding MMN. Memory trace effects were assessed by comparing amplitudes associated with the three standard repetition trains.

RESULTS

Compared with controls, SZ showed reduced MMNs and DNs, but normal RPs. Both groups showed memory trace effects for RP, MMN, and DN, with a trend for attenuated DNs in SZ. Intraclass correlations obtained via this paradigm indicated good-to-moderate reliabilities for overall MMN, DN and RP, but moderate to poor reliabilities for components associated with short, intermediate, and long standard trains, and poor reliability of their memory trace effects.

CONCLUSION

MMN deficits in SZ reflected attenuated prediction error signaling (DN), with relatively intact predictive code formation (RP) and memory trace effects. This roving standard MMN paradigm requires additional development/validation to obtain suitable levels of reliability for use in clinical trials.

Pre-attentive Mismatch Response and Involuntary Attention Switching to a Deviance in an Earlier-Than-Usual Auditory Stimulus: An ERP Study

An acoustic stimulus elicits an electroencephalographic response called auditory event-related potential (ERP). When some members of a stream of standard auditory stimuli are replaced randomly by a deviant stimulus and this stream is presented to a subject who ignores the stimuli, two different ERPs to deviant and standard stimuli are recorded. If the ERP to standard stimuli is subtracted from the ERP to deviant stimuli, the difference potential (DP) waveform typically exhibits a series of negative-positive-negative deflections called mismatch negativity (MMN), P3a, and reorienting negativity (RON), which are associated with pre-attentive change detection, involuntary attention switching, and reorienting of attention, respectively. The aim of the present study was to investigate how these pre-attentive processes are affected if the change occurs earlier than its usual timing implied by isochronous standard stimuli. In the MMN paradigm employed, 15% of the standards were randomly replaced by deviant stimuli which differed either in their pitch, their earlier onset time, or in both. Event-related responses to these three deviants [timely pitch change (R_TP), earlier onset (R_EO), earlier pitch change (R_EP)] and to standards (R_S) were recorded from 10 reading subjects. To maintain identical stimulation histories for the responses subtracted from each other, "deviant-standard" difference potentials (DP) for "timely" and "early" pitch deviances were derived as follows: DP_TP = R_TP - R_S and DP_EP = R_EP - R_EO. Interestingly, the MMN components of the DPs to timely and early pitch deviances had similar amplitudes, indicating that regularity of stimulus timing does not provide any benefit for the pre-attentive auditory change detection mechanism. However, different scalp current density (SCD) dynamics of the MMN/P3a complexes, elicited by timely and early pitch deviances, suggested that an auditory change in a stimulus occurring earlier-than-usual initiates a faster and more effective call-for-attention and causes stronger attention switching than a timely change. SCD results also indicated that the temporal, frontal, and parietal MMN components are simultaneously present rather than emerging sequentially in time, supporting the MMN models based on parallel deviance processing in the respective cortices. Similarity of the RONs to timely and early pitch deviances indicated that reorienting of attention is of the same strength in two cases.

Individuals with 22q11.2 deletion syndrome show intact prediction but reduced adaptation in responses to repeated sounds: Evidence from Bayesian mapping

One of the most common copy number variants, the 22q11.2 microdeletion, confers an increased risk for schizophrenia. Since schizophrenia has been associated with an aberrant neural response to repeated stimuli through both reduced adaptation and prediction, we here hypothesized that this may also be the case in nonpsychotic individuals with a 22q11.2 deletion. We recorded high-density EEG from 19 individuals with 22q11.2 deletion syndrome (12-25 years), as well as 27 healthy volunteers with comparable age and sex distribution, while they listened to a sequence of sounds arranged in a roving oddball paradigm. Using posterior probability maps and dynamic causal modelling we tested three different models accounting for repetition dependent changes in cortical responses as well as in effective connectivity; namely an adaptation model, a prediction model, and a model including both adaptation and prediction. Repetition-dependent changes were parametrically modulated by a combination of adaptation and prediction and were apparent in both cortical responses and in the underlying effective connectivity. This effect was reduced in individuals with a 22q11.2 deletion and was negatively correlated with negative symptom severity. Follow-up analysis showed that the reduced effect of the combined adaptation and prediction model seen in individuals with 22q11.2 deletion was driven by reduced adaptation rather than prediction failure. Our findings suggest that adaptation is reduced in individuals with a 22q11.2 deletion, which can be interpreted in light of the framework of predictive coding as a failure to suppress prediction errors.

Cortical Areas Associated With Mismatch Negativity: A Connectivity Study Using Propofol Anesthesia

Auditory mismatch negativity (MMN) is an event-related potential (ERP) waveform induced by rare deviant stimuli that occur in a stream of regular auditory stimuli. The generators of MMN are believed to include several different cortical regions like the bilateral temporal and the right inferior frontal gyrus (IFG). However, exact cortical regions associated with MMN remain controversial. In this study, we compared the number of long-distance connections induced by the standard and deviant stimuli during awake state and propofol anesthesia state to identify the cortical areas associated with the generation of MMN. In awake state, we find that deviant stimuli synchronize more information between the right frontal and temporal than standard stimuli. Moreover, we find that the deviant stimuli in awake state activate the bilateral frontal, central areas, the left temporal and parietal areas as compared to the anesthesia state, whereas the standard stimuli do not. These results suggest that, in addition to the bilateral temporal and the right IFG, the bilateral frontal and centro-parietal regions also contribute to the generation of MMN.

Rhesus Monkeys (Macaca mulatta) Sense Isochrony in Rhythm, but Not the Beat: Additional Support for the Gradual Audiomotor Evolution Hypothesis

Charles Darwin suggested the perception of rhythm to be common to all animals. While only recently experimental research is finding some support for this claim, there are also aspects of rhythm cognition that appear to be species-specific, such as the capability to perceive a regular pulse (or beat) in a varying rhythm. In the current study, using EEG, we adapted an auditory oddball paradigm that allows for disentangling the contributions of beat perception and isochrony to the temporal predictability of the stimulus. We presented two rhesus monkeys (Macaca mulatta) with a rhythmic sequence in two versions: an isochronous version, that was acoustically accented such that it could induce a duple meter (like a march), and a jittered version using the same acoustically accented sequence but that was presented in a randomly timed fashion, as such disabling beat induction. The results reveal that monkeys are sensitive to the isochrony of the stimulus, but not its metrical structure. The MMN was influenced by the isochrony of the stimulus, resulting in a larger MMN in the isochronous as opposed to the jittered condition. However, the MMN for both monkeys showed no interaction between metrical position and isochrony. So, while the monkey brain appears to be sensitive to the isochrony of the stimulus, we find no evidence in support of beat perception. We discuss these results in the context of the gradual audiomotor evolution (GAE) hypothesis (Merchant and Honing, 2014) that suggests beat-based timing to be omnipresent in humans but only weakly so or absent in non-human primates.

Altered auditory processing and effective connectivity in 22q11.2 deletion syndrome

22q11.2 deletion syndrome (22q11.2DS) is one of the most common copy number variants and confers a markedly increased risk for schizophrenia. As such, 22q11.2DS is a homogeneous genetic liability model which enables studies to delineate functional abnormalities that may precede disease onset. Mismatch negativity (MMN), a brain marker of change detection, is reduced in people with schizophrenia compared to healthy controls. Using dynamic causal modelling (DCM), previous studies showed that top-down effective connectivity linking the frontal and temporal cortex is reduced in schizophrenia relative to healthy controls in MMN tasks. In the search for early risk-markers for schizophrenia we investigated the neural basis of change detection in a group with 22q11.2DS. We recorded high-density EEG from 19 young non-psychotic 22q11.2 deletion carriers, as well as from 27 healthy non-carriers with comparable age distribution and sex ratio, while they listened to a sequence of sounds arranged in a roving oddball paradigm. Despite finding no significant reduction in the MMN responses, whole-scalp spatiotemporal analysis of responses to the tones revealed a greater fronto-temporal N1 component in the 22q11.2 deletion carriers. DCM showed reduced intrinsic connection within right primary auditory cortex as well as in the top-down, connection from the right inferior frontal gyrus to right superior temporal gyrus for 22q11.2 deletion carriers although not surviving correction for multiple comparison. We discuss these findings in terms of reduced adaptation and a general increased sensitivity to tones in 22q11.2DS.

Indexing sensory plasticity: Evidence for distinct Predictive Coding and Hebbian learning mechanisms in the cerebral cortex

The Roving Mismatch Negativity (MMN), and Visual LTP paradigms are widely used as independent measures of sensory plasticity. However, the paradigms are built upon fundamentally different (and seemingly opposing) models of perceptual learning; namely, Predictive Coding (MMN) and Hebbian plasticity (LTP). The aim of the current study was to compare the generative mechanisms of the MMN and visual LTP, therefore assessing whether Predictive Coding and Hebbian mechanisms co-occur in the brain. Forty participants were presented with both paradigms during EEG recording. Consistent with Predictive Coding and Hebbian predictions, Dynamic Causal Modelling revealed that the generation of the MMN modulates forward and backward connections in the underlying network, while visual LTP only modulates forward connections. These results suggest that both Predictive Coding and Hebbian mechanisms are utilized by the brain under different task demands. This therefore indicates that both tasks provide unique insight into plasticity mechanisms, which has important implications for future studies of aberrant plasticity in clinical populations.

Prior Expectation Modulates Repetition Suppression without Perceptual Awareness

Stimulus repetition induces attenuated brain responses. This phenomenon, termed repetition suppression (RS), is classically held to stem from bottom-up neuronal adaptation. However, recent studies suggest that RS is driven by top-down predictive mechanisms. It remains controversial whether these top-down mechanisms of RS rely on conscious strategies, or if they represent a more fundamental aspect of perception, coding for physical properties of the repeated feature. The presence of top-down effects in the absence of perceptual awareness would indicate that conscious strategies are not sufficient to explain top-down mechanisms of RS. We combined an unconscious priming paradigm with EEG recordings and tested whether RS can be modulated by the probability of encountering a repetition, even in the absence of awareness. Our results show that both behavioural priming and RS near occipital areas are modulated by repetition probability, regardless of prime awareness. This contradicts previous findings that have argued that RS modulation is a by-product of conscious strategies. In contrast, we found that the increase in theta-band power following unrepeated trials – an index of conflict detection – is modulated only by expectations during conscious primes, implicating the use of conscious strategies. Together, our results suggest that the influence of predictions on RS can be either automatic in sensory brain regions or dependent on conscious strategies.

Dissociable auditory mismatch response and connectivity patterns in adolescents with schizophrenia and adolescents with bipolar disorder with psychosis: A magnetoencephalography study

BACKGROUND

There is overlap between schizophrenia and bipolar disorder regarding genetic risk as well as neuropsychological and structural brain deficits. Finding common and distinct event-response potential (ERP) responses and connectivity patterns may offer potential biomarkers to distinguish the disorders.

OBJECTIVE

To examine the neuronal auditory response elicited by a roving mismatch negativity (MMN) paradigm using magnetoencephalography (MEG).

PARTICIPANTS

15 Adolescents with schizophrenia (ASZ), 16 adolescents with bipolar disorder with psychosis (ABP), and 14 typically developing individuals (TD) METHODS: The data were analysed using time-series techniques and dynamic causal modelling (DCM).

OUTCOME MEASURES

MEG difference wave (deviant - standard) at primary auditory (~90ms), MMN (~180ms) and long latency (~300ms).

RESULTS

The amplitude of difference wave showed specific patterns at all latencies. Most notably, it was significantly reduced ABP compared to both controls and ASZ at early latencies. In contrast, the amplitude was significantly reduced in ASZ compared to both controls and ABP. The DCM analysis showed differential connectivity patterns in all three groups. Most notably, inter-hemispheric connections were strongly dominated by the right side in ASZ only.

CONCLUSIONS

Dissociable patterns of the primary auditory response and MMN response indicate possible developmentally sensitive, but separate biomarkers for schizophrenia and bipolar disorder.

Hallucinations, neuroplasticity, and prediction errors in schizophrenia

Auditory hallucinations, a hallmark symptom of psychosis, are experienced by most people with a diagnosis of schizophrenia at some point in their illness. Auditory hallucinations can be understood as a failure in predictive coding, whereby abnormalities in sensory/perceptual processing combine with biased cognitive processes to result in a dampening of normal prediction error signaling. In this paper, we used a roving mismatch negativity (MMN) paradigm to optimize evaluation of prediction error signaling and short-term neuroplasticity in 30 people with schizophrenia (n = 16 with and n = 14 without recent auditory hallucinations) and 20 healthy comparison participants. The recent hallucinations group exhibited an abnormal roving MMN profile [F(2,27) = 3.98, p = 0.03], significantly reduced prediction error signaling [t(28) = -2.25, p = 0.03], and a trend for diminished short-term neuroplasticity [t(28) = 1.80, p = 0.08]. There were no statistically significant differences between the healthy comparison group and the combined schizophrenia group on any of the roving MMN indices. These findings are consistent with a predictive coding account of hallucinations in schizophrenia, which posits reduced prediction error signaling in those who are prone to hallucinations. These results also suggest that plasticity-mediated formation and online updating of predictive coding models may also be disrupted in individuals with recent hallucinations.

Mismatch negativity in preclinical models of schizophrenia

Schizophrenia is a mental disorder associated with profoundly disruptive positive and negative symptomology that result in difficulties building close relationships with others, performing daily tasks and sustaining independent living, resulting in poor social, vocational and occupational attainment (functional outcome). Mismatch Negativity (MMN) is a change in the sensory event-related potential that occurs in response to deviation from an established pattern of stimulation. Patients with schizophrenia show a reduction in MMN that is positively associated with impaired cognition and poor functional outcome. This has led to interest in MMN as a potential clinical and pre-clinical biomarker of fundamental neural processes responsible for reduced functional outcome. To date, relatively few studies have sought to assess MMN in non-human primates or rodents. The validity of these studies will be reviewed using criteria used to identify true deviance detection based MMN responses in human subjects. Although MMN has been difficult to establish in pre-clinical models the weight of evidence suggests that non-human animals show true deviance based MMN.

Impairment in Mismatch Negativity but not Repetition Suppression in Schizophrenia

Schizophrenia is characterized by impaired auditory-evoked potentials (AEPs), mismatch negativity (MMN), and sensory gating of AEPs to repeated stimuli (repetition suppression, RS). In the predictive modeling framework, MMN and RS reflect encoding of prediction error and model sharpening, respectively. We compared P50, N100, P200 RS, and pitch and duration MMN in 26 participants diagnosed with schizophrenia (SZ) and 26 matched healthy controls (HC), and assessed relationships between MMN, RS, and SZ diagnosis. RS was measured by comparing responses to individual tones presented as 5-tone groups (1 kHz, 75 dB, 50 ms, 5 ms rise/fall times, 330 ms SOA), separated by a 750 ms inter-trial interval. For MMN, the same tones were presented, with occasional pitch (1.2 kHz, 10%) or duration deviants (100 ms, 10%) interspersed. Pitch and duration MMN were reduced in SZ (p < 0.01). There were no group differences in P50 RS, N100 RS, or P200 RS (p's > 0.1). Importantly, although pitch and duration MMN both correlated with RS of AEPs within the MMN time range (p's < 0.01), SZ diagnosis predicted MMN over and above RS (p < 0.05) and shared little variance with RS in prediction of MMN amplitude (tolerance > 0.93). We suggest that reduced MMN in SZ is related to deficits in encoding prediction error but not repetition suppression.

Does emotion change auditory prediction and deviance detection?

In the last decades, a growing number of studies provided compelling evidence supporting the interplay of cognitive and affective processes. However, it remains to be clarified whether and how an emotional context affects the prediction and detection of change in unattended sensory events. In an event-related potential (ERP) study, we probed the modulatory role of pleasant, unpleasant and neutral visual contexts on the brain response to automatic detection of change in spectral (intensity) vs. temporal (duration) sound features. Twenty participants performed a passive auditory oddball task. Additionally, we tested the relationship between ERPs and self-reported mood. Participants reported more negative mood after the negative block. The P2 amplitude elicited by standards was increased in a positive context. Mismatch Negativity (MMN) amplitude was decreased in the negative relative to the neutral and positive contexts, and was associated with self-reported mood. These findings suggest that the detection of regularities in the auditory stream was facilitated in a positive context, whereas a negative visual context interfered with prediction error elicitation, through associated mood changes. Both ERP and behavioral effects highlight the intricate links between emotion, perception and cognitive processes.

How regularity representations of short sound patterns that are based on relative or absolute pitch information establish over time: An EEG study

The recognition of sound patterns in speech or music (e.g., a melody that is played in different keys) requires knowledge about pitch relations between successive sounds. We investigated the formation of regularity representations for sound patterns in an event-related potential (ERP) study. A pattern, which consisted of six concatenated 50 ms tone segments differing in fundamental frequency, was presented 1, 2, 3, 6, or 12 times and then replaced by another pattern by randomly changing the pitch of the tonal segments (roving standard paradigm). In an absolute repetition condition, patterns were repeated identically, whereas in a transposed condition, only the pitch relations of the tonal segments of the patterns were repeated, while the entire patterns were shifted up or down in pitch. During ERP measurement participants were not informed about the pattern repetition rule, but were instructed to discriminate rarely occurring targets of lower or higher sound intensity. EPRs for pattern changes (mismatch negativity, MMN; and P3a) and for pattern repetitions (repetition positivity, RP) revealed that the auditory system is able to rapidly extract regularities from unfamiliar complex sound patterns even when absolute pitch varies. Yet, enhanced RP and P3a amplitudes, and improved behavioral performance measured in a post-hoc test, in the absolute as compared with the transposed condition suggest that it is more difficult to encode patterns without absolute pitch information. This is explained by dissociable processing of standards and deviants as well as a back propagation mechanism to early sensory processing stages, which is effective after less repetitions of a standard stimulus for absolute pitch.

Is predictability salient? A study of attentional capture by auditory patterns

In this series of behavioural and electroencephalography (EEG) experiments, we investigate the extent to which repeating patterns of sounds capture attention. Work in the visual domain has revealed attentional capture by statistically predictable stimuli, consistent with predictive coding accounts which suggest that attention is drawn to sensory regularities. Here, stimuli comprised rapid sequences of tone pips, arranged in regular (REG) or random (RAND) patterns. EEG data demonstrate that the brain rapidly recognizes predictable patterns manifested as a rapid increase in responses to REG relative to RAND sequences. This increase is reminiscent of the increase in gain on neural responses to attended stimuli often seen in the neuroimaging literature, and thus consistent with the hypothesis that predictable sequences draw attention. To study potential attentional capture by auditory regularities, we used REG and RAND sequences in two different behavioural tasks designed to reveal effects of attentional capture by regularity. Overall, the pattern of results suggests that regularity does not capture attention.

This article is part of the themed issue ‘Auditory and visual scene analysis’.

Predictive coding of phonological rules in auditory cortex: A mismatch negativity study

The brain is constantly generating predictions of future sensory input to enable efficient adaptation. In the auditory domain, this applies also to the processing of speech. Here we aimed to determine whether the brain predicts the following segments of speech input on the basis of language-specific phonological rules that concern non-adjacent phonemes. Auditory event-related potentials (ERP) were recorded in a mismatch negativity (MMN) paradigm, where the Finnish vowel harmony, determined by the first syllables of pseudowords, either constrained or did not constrain the phonological composition of pseudoword endings. The phonological rule of vowel harmony was expected to create predictions about phonologically legal pseudoword endings. Results showed that MMN responses were larger for phonologically illegal than legal pseudowords, and P3a was elicited only for illegal pseudowords. This supports the hypothesis that speech input is evaluated against context-dependent phonological predictions that facilitate speech processing.

Auditory perceptual objects as generative models: Setting the stage for communication by sound

Communication by sounds requires that the communication channels (i.e. speech/speakers and other sound sources) had been established. This allows to separate concurrently active sound sources, to track their identity, to assess the type of message arriving from them, and to decide whether and when to react (e.g., reply to the message). We propose that these functions rely on a common generative model of the auditory environment. This model predicts upcoming sounds on the basis of representations describing temporal/sequential regularities. Predictions help to identify the continuation of the previously discovered sound sources to detect the emergence of new sources as well as changes in the behavior of the known ones. It produces auditory event representations which provide a full sensory description of the sounds, including their relation to the auditory context and the current goals of the organism. Event representations can be consciously perceived and serve as objects in various cognitive operations.

Spatial auditory regularity encoding and prediction: Human middle-latency and long-latency auditory evoked potentials

By encoding acoustic regularities present in the environment, the human brain can generate predictions of what is likely to occur next. Recent studies suggest that deviations from encoded regularities are detected within 10-50ms after stimulus onset, as indicated by electrophysiological effects in the middle latency response (MLR) range. This is upstream of previously known long-latency (LLR) signatures of deviance detection such as the mismatch negativity (MMN) component. In the present study, we created predictable and unpredictable contexts to investigate MLR and LLR signatures of the encoding of spatial auditory regularities and the generation of predictions from these regularities. Chirps were monaurally delivered in an either regular (predictable: left-right-left-right) or a random (unpredictable left/right alternation or repetition) manner. Occasional stimulus omissions occurred in both types of sequences. Results showed that the Na component (peaking at 34ms after stimulus onset) was attenuated for regular relative to random chirps, albeit no differences were observed for stimulus omission responses in the same latency range. In the LLR range, larger chirp-and omission-evoked responses were elicited for the regular than for the random condition, and predictability effects were more prominent over the right hemisphere. We discuss our findings in the framework of a hierarchical organization of spatial regularity encoding. This article is part of a Special Issue entitled SI: Prediction and Attention.