Mismatch negativity is unaffected by top-down predictive information

Seeking the neural representation of statistical properties in print during implicit processing of visual words

Statistical learning (SL) plays a key role in literacy acquisition. Studies have increasingly revealed the influence of distributional statistical properties of words on visual word processing, including the effects of word frequency (lexical level) and mappings between orthography, phonology, and semantics (sub-lexical level). However, there has been scant evidence to directly confirm that the statistical properties contained in print can be directly characterized by neural activities. Using time-resolved representational similarity analysis (RSA), the present study examined neural representations of different types of statistical properties in visual word processing. From the perspective of predictive coding, an equal probability sequence with low built-in prediction precision and three oddball sequences with high built-in prediction precision were designed with consistent and three types of inconsistent (orthographically inconsistent, orthography-to-phonology inconsistent, and orthography-to-semantics inconsistent) Chinese characters as visual stimuli. In the three oddball sequences, consistent characters were set as the standard stimuli (probability of occurrence p = 0.75) and three types of inconsistent characters were set as deviant stimuli (p = 0.25), respectively. In the equal probability sequence, the same consistent and inconsistent characters were presented randomly with identical occurrence probability (p = 0.25). Significant neural representation activities of word frequency were observed in the equal probability sequence. By contrast, neural representations of sub-lexical statistics only emerged in oddball sequences where short-term predictions were shaped. These findings reveal that the statistical properties learned from long-term print environment continues to play a role in current word processing mechanisms and these mechanisms can be modulated by short-term predictions.

Distinguishing Fine Structure and Summary Representation of Sound Textures from Neural Activity

The auditory system relies on both local and summary representations; acoustic local features exceeding system constraints are compacted into a set of summary statistics. Such compression is pivotal for sound-object recognition. Here, we assessed whether computations subtending local and statistical representations of sounds could be distinguished at the neural level. A computational auditory model was employed to extract auditory statistics from natural sound textures (i.e., fire, rain) and to generate synthetic exemplars where local and statistical properties were controlled. Twenty-four human participants were passively exposed to auditory streams while the electroencephalography (EEG) was recorded. Each stream could consist of short, medium, or long sounds to vary the amount of acoustic information. Short and long sounds were expected to engage local or summary statistics representations, respectively. Data revealed a clear dissociation. Compared with summary-based ones, auditory-evoked responses based on local information were selectively greater in magnitude in short sounds. Opposite patterns emerged for longer sounds. Neural oscillations revealed that local features and summary statistics rely on neural activity occurring at different temporal scales, faster (beta) or slower (theta-alpha). These dissociations emerged automatically without explicit engagement in a discrimination task. Overall, this study demonstrates that the auditory system developed distinct coding mechanisms to discriminate changes in the acoustic environment based on fine structure and summary representations.

Markov chains as a proxy for the predictive memory representations underlying mismatch negativity

Events not conforming to a regularity inherent to a sequence of events elicit prediction error signals of the brain such as the Mismatch Negativity (MMN) and impair behavioral task performance. Events conforming to a regularity lead to attenuation of brain activity such as stimulus-specific adaptation (SSA) and behavioral benefits. Such findings are usually explained by theories stating that the information processing system predicts the forthcoming event of the sequence via detected sequential regularities. A mathematical model that is widely used to describe, to analyze and to generate event sequences are Markov chains: They contain a set of possible events and a set of probabilities for transitions between these events (transition matrix) that allow to predict the next event on the basis of the current event and the transition probabilities. The accuracy of such a prediction depends on the distribution of the transition probabilities. We argue that Markov chains also have useful applications when studying cognitive brain functions. The transition matrix can be regarded as a proxy for generative memory representations that the brain uses to predict the next event. We assume that detected regularities in a sequence of events correspond to (a subset of) the entries in the transition matrix. We apply this idea to the Mismatch Negativity (MMN) research and examine three types of MMN paradigms: classical oddball paradigms emphasizing sound probabilities, between-sound regularity paradigms manipulating transition probabilities between adjacent sounds, and action-sound coupling paradigms in which sounds are associated with actions and their intended effects. We show that the Markovian view on MMN yields theoretically relevant insights into the brain processes underlying MMN and stimulates experimental designs to study the brain's processing of event sequences.

Neural correlates of statistical learning in developmental dyslexia: An electroencephalography study

The human brain extracts statistical regularities from the surrounding environment in a process called statistical learning. Behavioural evidence suggests that developmental dyslexia affects statistical learning. However, surprisingly few studies have assessed how developmental dyslexia affects the neural processing underlying this type of learning. We used electroencephalography to explore the neural correlates of an important aspect of statistical learning - sensitivity to transitional probabilities - in individuals with developmental dyslexia. Adults diagnosed with developmental dyslexia (n = 17) and controls (n = 19) were exposed to a continuous stream of sound triplets. Every so often, a triplet ending had a low transitional probability given the triplet's first two sounds ("statistical deviants"). Furthermore, every so often a triplet ending was presented from a deviant location ("acoustic deviants"). We examined mismatch negativity elicited by statistical deviants (sMMN), and MMN elicited by location deviants (i.e., acoustic changes). Acoustic deviants elicited a MMN which was larger in the control group than in the developmental dyslexia group. Statistical deviants elicited a small, yet significant, sMMN in the control group, but not in the developmental dyslexia group. However, the difference between the groups was not significant. Our findings indicate that the neural mechanisms underlying pre-attentive acoustic change detection and implicit statistical auditory learning are both affected in developmental dyslexia.

Intention-based predictive information modulates auditory deviance processing

The human brain is highly responsive to (deviant) sounds violating an auditory regularity. Respective brain responses are usually investigated in situations when the sounds were produced by the experimenter. Acknowledging that humans also actively produce sounds, the present event-related potential study tested for differences in the brain responses to deviants that were produced by the listeners by pressing one of two buttons. In one condition, deviants were unpredictable with respect to the button-sound association. In another condition, deviants were predictable with high validity yielding correctly predicted deviants and incorrectly predicted (mispredicted) deviants. Temporal principal component analysis revealed deviant-specific N1 enhancement, mismatch negativity (MMN) and P3a. N1 enhancements were highly similar for each deviant type, indicating that the underlying neural mechanism is not affected by intention-based expectation about the self-produced forthcoming sound. The MMN was abolished for predictable deviants, suggesting that the intention-based prediction for a deviant can overwrite the prediction derived from the auditory regularity (predicting a standard). The P3a was present for each deviant type but was largest for mispredicted deviants. It is argued that the processes underlying P3a not only evaluate the deviant with respect to the fact that it violates an auditory regularity but also with respect to the intended sensorial effect of an action. Overall, our results specify current theories of auditory predictive processing, as they reveal that intention-based predictions exert different effects on different deviance-specific brain responses.

The auditory brain in action: Intention determines predictive processing in the auditory system-A review of current paradigms and findings

According to the ideomotor theory, action may serve to produce desired sensory outcomes. Perception has been widely described in terms of sensory predictions arising due to top-down input from higher order cortical areas. Here, we demonstrate that the action intention results in reliable top-down predictions that modulate the auditory brain responses. We bring together several lines of research, including sensory attenuation, active oddball, and action-related omission studies: Together, the results suggest that the intention-based predictions modulate several steps in the sound processing hierarchy, from preattentive to evaluation-related processes, also when controlling for additional prediction sources (i.e., sound regularity). We propose an integrative theoretical framework—the extended auditory event representation system (AERS), a model compatible with the ideomotor theory, theory of event coding, and predictive coding. Initially introduced to describe regularity-based auditory predictions, we argue that the extended AERS explains the effects of action intention on auditory processing while additionally allowing studying the differences and commonalities between intention- and regularity-based predictions—we thus believe that this framework could guide future research on action and perception.

Forecasting Remission From the Psychosis Risk Syndrome With Mismatch Negativity and P300: Potentials and Pitfalls

Clinical outcomes vary for individuals at clinical high risk (CHR) for psychosis, ranging from conversion to a psychotic disorder to full remission from the risk syndrome. Given that most CHR individuals do not convert to psychosis, recent research efforts have turned toward identifying specific predictors of CHR remission, a task that is conceptually and empirically dissociable from the identification of predictors of conversion to psychosis, and one that may reveal specific biological characteristics that confer resilience to psychosis and provide further insights into the mechanisms associated with the pathogenesis of schizophrenia and those underlying a transient CHR syndrome. Such biomarkers may ultimately facilitate the development of novel early interventions and support the optimization of individualized care. In this review, we focus on two event-related brain potential measures, mismatch negativity and P300, that have attracted interest as predictors of future psychosis among CHR individuals. We describe several recent studies examining whether mismatch negativity and P300 predict subsequent CHR remission and suggest that intact mismatch negativity and P300 may reflect the integrity of specific neurocognitive processes that confer resilience against the persistence of the CHR syndrome and its associated risk for future transition to psychosis. We also highlight several major methodological concerns associated with these studies that apply to the broader literature examining predictors of CHR remission. Among them is the concern that studies that predict dichotomous remission versus nonremission and/or dichotomous conversion versus nonconversion outcomes potentially confound remission and conversion effects, a phenomenon we demonstrate with a data simulation.

Electrophysiological evidence of preserved hearing at the end of life

This study attempts to answer the question: “Is hearing the last to go?” We present evidence of hearing among unresponsive actively dying hospice patients. Individual ERP (MMN, P3a, and P3b) responses to deviations in auditory patterns are reported for conscious young, healthy control participants, as well as for hospice patients, both when the latter were conscious, and again when they became unresponsive to their environment. Whereas the MMN (and perhaps too the P3a) is considered an automatic response to auditory irregularities, the P3b is associated with conscious detection of oddball targets. All control participants, and most responsive hospice patients, evidenced a “local” effect (either a MMN, a P3a, or both) and some a “global” effect (P3b) to deviations in tone, or deviations in auditory pattern. Importantly, most unresponsive patients showed evidence of MMN responses to tone changes, and some showed a P3a or P3b response to either tone or pattern changes. Thus, their auditory systems were responding similarly to those of young, healthy controls just hours from end of life. Hearing may indeed be one of the last senses to lose function as humans die.

Putative TAAR5 agonist alpha-NETA affects event-related potentials in oddball paradigm in awake mice

Trace amines have been reported to be neuromodulators of monoaminergic systems. Trace amines receptor 5 (TAAR5) is expressed in several regions of mice central nervous system, such as amygdala, arcuate nucleus and ventromedial hypothalamus, but very limited information is available on its functional role. The purpose of this study is to examine the effect of TAAR5 agonist alpha-NETA on the generation of mismatch negativity (MMN) analogue in C57BL/6 mice. Event-related potentials have been recorded from awake mice in oddball paradigms before and after the alpha-NETA administration. Alpha-NETA has been found to decrease N40 MMN-like difference, which resulted from the increased response to standard stimuli. An opposite effect has been found for the P80 component: the amplitude increased in response both to standard and deviant stimuli. A significant increase in N40 peak latency after the alpha-NETA administration has been found. This may suggest a reduced speed of information processing similar to the increase in P50 and N100 components latencies in schizophrenia patients. These results provide new evidence for a role of TAAR5 in cognitive processes.

Action-induced adjustment of prediction explains no visual mismatch negativity to self-generated deviants

Visual mismatch negativity (VMMN) is an event-related brain potential component elicited by infrequent deviant events embedded among frequent standard events in a visual stimulus sequence. Although VMMN is known to be elicited by deviant events in a stimulus-driven manner, it was recently shown that VMMN can be drastically affected by the participant's voluntary action. With a paradigm in which participants were required to press one button frequently (about 90%) and another button infrequently (10%) in random order, and produce a visual stimulus sequence consisting of deviant and standard events, VMMN was elicited by deviant events triggered by the frequently-performed button press that should generate a standard event, but not by deviant events triggered by the infrequently-performed button press that should generate a corresponding deviant event. The present study replicated these previous findings and further demonstrated that VMMN was elicited by deviant events triggered by the infrequently-performed button press that should generate a different deviant event. These results support the hypothesis that VMMN-generating processes can be adjusted according to the participant's voluntary action, and rule out an alternative hypothesis that VMMN-generating processes are terminated when participants change their action. This adjustment is thought to be implemented so that self-generated deviants that carry no novel information are discarded, while externally-generated deviants that may carry novel information are selectively detected.

Mismatch Negativity But Not P300 Is Associated With Functional Disability in Schizophrenia

Mismatch negativity (MMN) and P300 event-related potential (ERP) reductions in schizophrenia (SZ) reflect preattentive and attention-mediated auditory processing deficits, respectively. Although both have been linked to cognitive deficits in SZ, their relative contributions to real-world functioning are unclear. We sought to determine the functional significance of disrupted auditory processing in SZ by examining MMN and P300 in typically disabled low-functioning patients and in patients with high levels of independent role functioning. MMN to auditory deviants and P300 to infrequent auditory target and nontarget novel stimuli were assessed in 20 high-functioning SZ patients (HF-SZ), 17 low-functioning patients (LF-SZ), and 35 healthy comparison (HC) subjects. There was a group effect on MMN and P300 amplitudes across stimulus types. MMN was significantly diminished in LF-SZ compared to HF-SZ and HC, and HF-SZ demonstrated comparable MMN to HC. In contrast, P300 was significantly reduced in both LF-SZ and HF-SZ compared to HC. Logistic regression suggested independent sensitivity of MMN to functioning in SZ over and above P300 measures. Neither MMN nor P300 were associated with positive or negative symptom severity. Results replicate MMN and P300 abnormalities in SZ, and also suggest that the neural mechanisms associated with the preattentive detection of auditory deviance are most compromised in patients with functional disability. MMN may index pathophysiological processes that are critical for optimal functioning in SZ.

Visual mismatch negativity is unaffected by top-down prediction of the timing of deviant events

Visual mismatch negativity (VMMN) is an event-related brain potential component that is automatically elicited by infrequent (deviant) stimuli that are inserted among frequent (standard) stimuli (i.e., an oddball sequence). Although the elicitation of VMMN is basically determined in a stimulus-driven manner, it can be modulated by top-down control. In a previous study using a "patterned" oddball sequence, where deviant (D) stimuli were regularly inserted among standard (S) stimuli (i.e., repetitions of an SSSSD pattern), VMMN was largely reduced when participants noticed the SSSSD pattern and actively predicted both the identity and timing of the deviant stimuli compared to when they did not notice the SSSSD pattern and did not form such active prediction. The present study further investigated whether or not active prediction of only the timing of deviant stimuli is sufficient for the reduction of VMMN. With the patterned oddball sequence with one deviant (here, deviant stimuli were fixed throughout the block), VMMN was reduced when the participants noticed the SSSSD pattern and actively predicted both the identity and timing of deviant stimuli (i.e., replication of the previous finding). In contrast, with the patterned oddball sequence with two deviants (deviant stimuli were randomly varied between two possibilities), VMMN was not significantly reduced when the participants noticed the SSSSD pattern and actively predicted only the timing of deviant stimuli. These results suggest that active prediction of only the timing of deviant stimuli is not sufficient to reduce VMMN.

Predictive coding in auditory perception: challenges and unresolved questions

Predictive coding is arguably the currently dominant theoretical framework for the study of perception. It has been employed to explain important auditory perceptual phenomena, and it has inspired theoretical, experimental and computational modelling efforts aimed at describing how the auditory system parses the complex sound input into meaningful units (auditory scene analysis). These efforts have uncovered some vital questions, addressing which could help to further specify predictive coding and clarify some of its basic assumptions. The goal of the current review is to motivate these questions and show how unresolved issues in explaining some auditory phenomena lead to general questions of the theoretical framework. We focus on experimental and computational modelling issues related to sequential grouping in auditory scene analysis (auditory pattern detection and bistable perception), as we believe that this is the research topic where predictive coding has the highest potential for advancing our understanding. In addition to specific questions, our analysis led us to identify three more general questions that require further clarification: (1) What exactly is meant by prediction in predictive coding? (2) What governs which generative models make the predictions? and (3) What (if it exists) is the correlate of perceptual experience within the predictive coding framework?

Effects of veridical expectations on syntax processing in music: Event-related potential evidence

Numerous past studies have investigated neurophysiological correlates of music-syntactic processing. However, only little is known about how prior knowledge about an upcoming syntactically irregular event modulates brain correlates of music-syntactic processing. Two versions of a short chord sequence were presented repeatedly to non-musicians (n = 20) and musicians (n = 20). One sequence version ended on a syntactically regular chord, and the other one ended on a syntactically irregular chord. Participants were either informed (cued condition), or not informed (non-cued condition) about whether the sequence would end on the regular or the irregular chord. Results indicate that in the cued condition (compared to the non-cued condition) the peak latency of the early right anterior negativity (ERAN), elicited by irregular chords, was earlier in both non-musicians and musicians. However, the expectations due to the knowledge about the upcoming event (veridical expectations) did not influence the amplitude of the ERAN. These results suggest that veridical expectations modulate only the speed, but not the principle mechanisms, of music-syntactic processing.

Effects of explicit knowledge and predictability on auditory distraction and target performance

This study tested effects of task requirements and knowledge on auditory distraction effects. This was done by comparing the response to a pitch change (an irrelevant, distracting tone feature) that occurred predictably in a tone sequence (every 5th tone) under different task conditions. The same regular sound sequence was presented with task conditions varying in what information the participant was given about the predictability of the pitch change, and when this information was relevant for the task to be performed. In all conditions, participants performed a tone duration judgment task. Behavioral and event-related brain potential (ERP) measures were obtained to measure distraction effects and deviance detection. Predictable deviants produced behavioral distraction effects in all conditions. However, the P3a amplitude evoked by the predictable pitch change was largest when participants were uninformed about the regular structure of the sound sequence, showing an effect of knowledge on involuntary orienting of attention. In contrast, the mismatch negativity (MMN) component was only modulated when the regularity was relevant for the task and not by stimulus predictability itself. P3a and behavioral indices of distraction were not fully concordant. Overall, our results show differential effects of knowledge and predictability on auditory distraction effects indexed by neurophysiological (P3a) and behavioral measures.

Future clinical uses of neurophysiological biomarkers to predict and monitor treatment response for schizophrenia

Advances in psychiatric neuroscience have transformed our understanding of impaired and spared brain functions in psychotic illnesses. Despite substantial progress, few (if any) laboratory tests have graduated to clinics to inform diagnoses, guide treatments, and monitor treatment response. Providers must rely on careful behavioral observation and interview techniques to make inferences about patients' inner experiences and then secondary deductions about impacted neural systems. Development of more effective treatments has also been hindered by a lack of translational quantitative biomarkers that can span the brain-behavior treatment knowledge gap. Here, we describe an example of a simple, low-cost, and translatable electroencephalography (EEG) measure that offers promise for improving our understanding and treatment of psychotic illnesses: mismatch negativity (MMN). MMN is sensitive to and/or predicts response to some pharmacologic and nonpharmacologic interventions and accounts for substantial portions of variance in clinical, cognitive, and psychosocial functioning in schizophrenia (SZ). This measure has recently been validated for use in large-scale multisite clinical studies of SZ. Finally, MMN greatly improves our ability to forecast which individuals at high clinical risk actually develop a psychotic illness. These attributes suggest that MMN can contribute to personalized biomarker-guided treatment strategies aimed at ameliorating or even preventing the onset of psychosis.

Neurophysiological biomarkers informing the clinical neuroscience of schizophrenia: mismatch negativity and prepulse inhibition of startle

With the growing recognition of the heterogeneity of major brain disorders, and particularly the schizophrenias (SZ), biomarkers are being sought that parse patient groups in ways that can be used to predict treatment response, prognosis, and pathophysiology. A primary focus to date has been to identify biomarkers that predict damage or dysfunction within brain systems in SZ patients, that could then serve as targets for interventions designed to "undo" the causative pathology. After almost 50 years as the predominant strategy for developing SZ therapeutics, evidence supporting the value of this "find what's broke and fix it" approach is lacking. Here, we suggest an alternative strategy of using biomarkers to identify evidence of spared neural and cognitive function in SZ patients, and matching these residual neural assets with therapies toward which they can be applied. We describe ways to extract and interpret evidence of "spared function," using neurocognitive, and neurophysiological measures, and, suggest that further evidence of available neuroplasticity might be gleaned from studies in which the response to drug challenges and "practice effects" are measured. Finally, we discuss examples in which "better" (more normal) performance in specific neurophysiological measures predict a positive response to a neurocognitive task or therapeutic intervention. We believe that our field stands to gain tremendous therapeutic leverage by focusing less on what is "wrong" with our patients, and instead, focusing more on what is "right".

Context effects on auditory distraction

The purpose of the study was to test the hypothesis that sound context modulates the magnitude of auditory distraction, indexed by behavioral and electrophysiological measures. Participants were asked to identify tone duration, while irrelevant changes occurred in tone frequency, tone intensity, and harmonic structure. Frequency deviants were randomly intermixed with standards (Uni-Condition), with intensity deviants (Bi-Condition), and with both intensity and complex deviants (Tri-Condition). Only in the Tri-Condition did the auditory distraction effect reflect the magnitude difference among the frequency and intensity deviants. The mixture of the different types of deviants in the Tri-Condition modulated the perceived level of distraction, demonstrating that the sound context can modulate the effect of deviance level on processing irrelevant acoustic changes in the environment. These findings thus indicate that perceptual contrast plays a role in change detection processes that leads to auditory distraction.

The human brain maintains contradictory and redundant auditory sensory predictions

Computational and experimental research has revealed that auditory sensory predictions are derived from regularities of the current environment by using internal generative models. However, so far, what has not been addressed is how the auditory system handles situations giving rise to redundant or even contradictory predictions derived from different sources of information. To this end, we measured error signals in the event-related brain potentials (ERPs) in response to violations of auditory predictions. Sounds could be predicted on the basis of overall probability, i.e., one sound was presented frequently and another sound rarely. Furthermore, each sound was predicted by an informative visual cue. Participants’ task was to use the cue and to discriminate the two sounds as fast as possible. Violations of the probability based prediction (i.e., a rare sound) as well as violations of the visual-auditory prediction (i.e., an incongruent sound) elicited error signals in the ERPs (Mismatch Negativity [MMN] and Incongruency Response [IR]). Particular error signals were observed even in case the overall probability and the visual symbol predicted different sounds. That is, the auditory system concurrently maintains and tests contradictory predictions. Moreover, if the same sound was predicted, we observed an additive error signal (scalp potential and primary current density) equaling the sum of the specific error signals. Thus, the auditory system maintains and tolerates functionally independently represented redundant and contradictory predictions. We argue that the auditory system exploits all currently active regularities in order to optimally prepare for future events.

Prediction errors in self- and externally-generated deviants

Sounds generated by one's own action elicit attenuated brain responses compared to brain responses to identical sounds that are externally-generated. The present study tested whether the suppression effect indexed by the N1- and P2-components of the event-related potential (ERP) is larger when self-generated sounds are correctly predicted than when they are not. Furthermore, sounds violating a prediction lead to a particular prediction error signal (i.e., N2b, P3a). Thus, we tested whether these error signals increase for self-generated sounds (i.e., enhanced N2b, P3a). We compared ERPs elicited by self- and externally-generated sounds that were of frequent standard and of infrequent deviant pitch. The results confirmed an N1- and P2-suppression effect elicited by self-generated standard sounds. The N1-suppression was smaller in response to self-initiated deviant sounds, indicating the specificity of predictions for self-generated sounds. In addition, an enhancement of N2b and P3a for self-generated deviants revealed the saliency of prediction error signals.

Category effects: is top-down control alone sufficient to elicit the mismatch negativity (MMN) component?

This study investigated whether the mismatch negativity (MMN) event-related brain potential (ERP) could be evoked by purely top-down, attentional control. An infrequently occurring tone was designated as a target prior to presenting a randomized sequence of five equi-probably occurring tones. MMN elicitation to the tones categorized as "high", "medium", or "low" frequency, and designated as the target, would indicate that the change detection process can be driven solely by top-down control. However, MMNs were not elicited by the categorized tones. Only the N2b and P3b attention-driven target detection components were elicited. These results suggest that top-down factors alone cannot generate mismatch negativity. Standard formation by stimulus-driven factors is required.

Neural substrates of normal and impaired preattentive sensory discrimination in large cohorts of nonpsychiatric subjects and schizophrenia patients as indexed by MMN and P3a change detection responses

OBJECTIVE

Schizophrenia (SZ) patients have information processing deficits, spanning from low level sensory processing to higher-order cognitive functions. Mismatch negativity (MMN) and P3a are event-related potential (ERP) components that are automatically elicited in response to unattended changes in ongoing, repetitive stimuli that provide a window into abnormal information processing in SZ. MMN and P3a are among the most robust and consistently identified deficits in SZ, yet the neural substrates of these responses and their associated deficits in SZ are not fully understood. This study examined the neural sources of MMN and P3a components in a large cohort of SZ and nonpsychiatric control subjects (NCS) using Exact Low Resolution Electromagnetic Tomography Analyses (eLORETA) in order to identify the neural sources of MMN and P3a as well as the brain regions associated with deficits commonly observed among SZ patients.

METHODS

410 SZ and 247 NCS underwent EEG testing using a duration-deviant auditory oddball paradigm (1-kHz tones, 500ms SOA; standard p=0.90, 50-ms duration; deviant tones P=0.10, 100-ms duration) while passively watching a silent video. Voxel-by-voxel within- (MMN vs. P3a) and between-group (SZ vs. NCS) comparisons were performed using eLORETA.

RESULTS

SZ had robust deficits in MMN and P3a responses measured at scalp electrodes consistent with other studies. These components mapped onto neural sources broadly distributed across temporal, frontal, and parietal regions. MMN deficits in SZ were associated with reduced activations in discrete medial frontal brain regions, including the anterior-posterior cingulate and medial frontal gyri. These early sensory discriminatory MMN impairments were followed by P3a deficits associated with widespread reductions in the activation of attentional networks (frontal, temporal, parietal regions), reflecting impaired orienting or shifts of attention to the infrequent stimuli.

CONCLUSIONS

MMN and P3a are dissociable responses associated with broadly distributed patterns of neural activation. MMN deficits among SZ patients appear to be primarily accounted for by reductions in medial prefrontal brain regions that are followed by widespread dysfunction across cortical networks associated with P3a in a manner that is consistent with hierarchical information processing models of cognitive deficits in SZ patients. Impairments in automatic stimulus discrimination may contribute to higher-order cognitive and psychosocial deficits in SZ.

Mental fatigue impairs pre-attentive processing: a MMN study

Individuals frequently experience mental fatigue during or after prolonged periods of cognitive activity. We investigated the effects of mental fatigue on the ability to detect minor changes in the pre-attentive stage of information processing by recoding MMN of ERP components. The equal probable paradigm was employed to elicit pure memory-comparison-based MMN component. Mental fatigue was induced by the continuous performance for 2h of mental arithmetic tasks. MMN amplitudes at fronto-central electrode sites were significantly decreased in subjects with mental fatigue than in subjects under control conditions, whereas temporal MMN was not affected by mental fatigue. These results suggest that mental fatigue impairs pre-attentive processing.

Effect of complete stimulus predictability on P3 and N2 components: an electroencephalographic study

In everyday life one may encounter both unpredictable and self-initiated, hence anticipated, events. Here, we analyzed the effects of self-initiated auditory stimulus presentation on P3 and N2 components in an oddball paradigm. If the stimulus sequence was fully self-determined, both components were attenuated in comparison with computer-controlled representation. In contrast, both components were increased when only the stimulus onset was self-initiated, yet the forthcoming stimulus type was unknown. We hypothesize that predictive forward models offer an unifying explanation for the modulation of both P3 and N2 through: (a) attenuation of neuronal responses to anticipated stimuli contingent on one's own motor action and (b) enhancement of responses in case of incongruity between an anticipated action effect and the actual perceptual consequences.

Hyperthermia impaired pre-attentive processing: an auditory MMN study

This study investigated the effect of hyperthermia on pre-attentive processing by recording the mismatch negativity (MMN) component of ERPs. 36 right-handed young male undergraduates were divided into two groups, a control group with 1h of exposure at 25°C and a heat group with 1h of exposure at 50°C. MMNs were recorded before and after heat exposure. It was found that, although there was no group difference before heat exposure, MMN declined significantly in the heat group compared to the control group after heat exposure for 1h, indicating that passive heat exposure could damage pre-attentive processing. The MMN component could be a good index to assess cognitive functioning in a hot environment.

Processing Expectancy Violations during Music Performance and Perception: An ERP Study

Musicians are highly trained motor experts with pronounced associations between musical actions and the corresponding auditory effects. However, the importance of auditory feedback for music performance is controversial, and it is unknown how feedback during music performance is processed. The present study investigated the neural mechanisms underlying the processing of auditory feedback manipulations in pianists. To disentangle effects of action-based and perception-based expectations, we compared feedback manipulations during performance to the mere perception of the same stimulus material. In two experiments, pianists performed bimanually sequences on a piano, while at random positions, the auditory feedback of single notes was manipulated, thereby creating a mismatch between an expected and actually perceived action effect (action condition). In addition, pianists listened to tone sequences containing the same manipulations (perception condition). The manipulations in the perception condition were either task-relevant (Experiment 1) or task-irrelevant (Experiment 2). In action and perception conditions, event-related potentials elicited by manipulated tones showed an early fronto-central negativity around 200 msec, presumably reflecting a feedback ERN/N200, followed by a positive deflection (P3a). The early negativity was more pronounced during the action compared to the perception condition. This shows that during performance, the intention to produce specific auditory effects leads to stronger expectancies than the expectancies built up during music perception.

Electroencephalography (EEG) and event-related potentials (ERPs) with human participants

Understanding the basic neural processes that underlie complex higher-order cognitive operations and functional domains is a fundamental goal of cognitive neuroscience. Electroencephalography (EEG) is a non-invasive and relatively inexpensive method for assessing neurophysiological function that can be used to achieve this goal. EEG measures the electrical activity of large, synchronously firing populations of neurons in the brain with electrodes placed on the scalp. This unit outlines the basics of setting up an EEG experiment with human participants, including equipment, and a step-by-step guide to applying and preparing an electrode cap. Also included are support protocols for two event-related potential (ERP) paradigms, P50 suppression, and mismatch negativity (MMN), which are measures of early sensory processing. These paradigms can be used to assess the integrity of early sensory processing in normal individuals and clinical populations, such as individuals with schizophrenia.

Electroencephalography (EEG) and event-related potentials (ERPs) with human participants

Understanding the basic neural processes that underlie complex higher-order cognitive operations and functional domains is a fundamental goal of cognitive neuroscience. Electroencephalography (EEG) is a non-invasive and relatively inexpensive method for assessing neurophysiological function that can be used to achieve this goal. EEG measures the electrical activity of large, synchronously firing populations of neurons in the brain with electrodes placed on the scalp. This unit outlines the basics of setting up an EEG experiment with human participants, including equipment, and a step-by-step guide to applying and preparing an electrode cap. Also included are support protocols for two event-related potential (ERP) paradigms, P50 suppression, and mismatch negativity (MMN), which are measures of early sensory processing. These paradigms can be used to assess the integrity of early sensory processing in normal individuals and clinical populations, such as individuals with schizophrenia.

Single-trial EEG Power and Phase Dynamics Associated with Voluntary Response Inhibition

Human voluntary response inhibition has frequently been investigated using go/no-go RT tasks. Recent studies have indicated that not only the traditional averaging waveforms of EEG activities (ERPs) but also the power and phase dynamics of single-trial EEG are important in studying the neural correlates of various human cognitive functions. Therefore, here, we aimed to undertake a detailed study of the time/frequency power and phase dynamics of single-trial EEG during go/no-go RT tasks, with focus particularly on the no-go-specific power and phase dynamics, which are presumed to involve the voluntary response inhibition processes. Thus, we demonstrated no-go-specific theta band EEG power increases and intertrial phase-locking in the midline-frontal areas, which are related to no-go-specific midline-frontal negative–positive ERP waveforms (no-go N2/no-go P3). In addition, we observed no-go-specific alpha band EEG intertrial phase-locking with an adjacent dephasing phenomenon, which is mainly associated with the early part of no-go N2. The estimated time point when the no-go-specific midline-frontal dephasing phenomenon occurred corresponded to the initial part of the voluntary response inhibition process (decision to withhold). Moreover, the no-go-specific phase dynamics in the midline-frontal areas just before and around the no-go N2 peak latency, unlike the power modulations, were affected by changes in the no-go stimulus probability, suggesting the dependence of only phase dynamics on no-go stimulus probability. From these results, we conclude that the complex power and phase dynamics of the theta and alpha band EEG in the midline-frontal areas are specific to no-go trials, being the underlying bases of the no-go-specific ERP waveforms, and suggest that the phase dynamics just before and around the no-go N2 peak latency may involve, at least, the initial part of the voluntary response inhibition process (decision to withhold).

Neurophysiological measures of sensory registration, stimulus discrimination, and selection in schizophrenia patients

Cortical Neurophysiological event related potentials (ERPs) are multidimensional measures of information processing that are well suited to efficiently parse automatic and controlled components of cognition that span the range of deficits exhibited in schizophrenia patients. Components following a stimulus reflect the sequence of neural processes triggered by the stimulus, beginning with early automatic sensory processes and proceeding through controlled decision and response related processes. Previous studies employing ERP paradigms have reported deficits of information processing in schizophrenia across automatic through attention dependent processes including sensory registration (N1), automatic change detection (MMN), the orienting or covert shift of attention towards novel or infrequent stimuli (P3a), and attentional allocation following successful target detection processes (P3b). These automatic and attention dependent information components are beginning to be recognized as valid targets for intervention in the context of novel treatment development for schizophrenia and related neuropsychiatric disorders. In this review, we describe three extensively studied ERP components (N1, mismatch negativity, P300) that are consistently deficient in schizophrenia patients and may serve as genetic endophenotypes and as quantitative biological markers of response outcome.

The relationship between preattentive sensory processing deficits and age in schizophrenia patients

OBJECTIVE

Auditory mismatch negativity (MMN) and P3a index preattentive detection of rare stimuli. Their amplitudes normally decrease with age. Previous studies have reported generally smaller than normal MMN and P3a in schizophrenia patients. We aimed to further characterize the course of these deficits over schizophrenia patients' lifespan.

METHODS

In 253 schizophrenia patients and 147 normal comparison participants (NCPs) encompassing a wide age range (18-65), event-related potentials were recorded while participants watched a silent video and were presented binaurally with 1-kHz tones 500ms apart, including standards (P=.90, 50-ms duration) and deviants (P=0.10, 100-ms).

RESULTS

Over the entire age range, MMN and P3a were smaller in schizophrenia patients than NCPs. MMN amplitude declined with age in both groups, though slightly less steeply in schizophrenia patients than NCPs. P3a amplitude declined with age in NCPs but not in schizophrenia patients.

CONCLUSIONS

In our cohort of schizophrenia patients, MMN and P3a deficits were already present at the youngest ages. MMN declined further with age, whereas P3a amplitude remained stable.

SIGNIFICANCE

This knowledge about how MMN and P3a amplitudes vary with age in schizophrenia patients compared to NCPs can help improve the utility of these indices as clinical endophenotypes or biomarkers.

Specificity of auditory-guided visual perceptual learning suggests crossmodal plasticity in early visual cortex

Sounds modulate visual perception. Blind humans show altered brain activity in early visual cortex. However, it is still unclear whether crossmodal activity in visual cortex results from unspecific top-down feedback, a lack of visual input, or genuinely reflects crossmodal interactions at early sensory levels. We examined how sounds affect visual perceptual learning in sighted adults. Visual motion discrimination was tested prior to and following eight sessions in which observers were exposed to irrelevant moving dots while detecting sounds. After training, visual discrimination improved more strongly for motion directions that were paired with a relevant sound during training than for other directions. Crossmodal learning was limited to visual field locations that overlapped with the sound source and was little affected by attention. The specificity and automatic nature of these learning effects suggest that sounds automatically guide visual plasticity at a relatively early level of processing.

Neural representations of auditory input accommodate to the context in a dynamically changing acoustic environment

The auditory scene is dynamic, changing from 1 min to the next as sound sources enter and leave our space. How does the brain resolve the problem of maintaining neural representations of the distinct yet changing sound sources? We used an auditory streaming paradigm to test the dynamics of multiple sound source representation, when switching between integrated and segregated sound streams. The mismatch negativity (MMN) component of event-related potentials was used as index of change detection to observe stimulus-driven modulation of the ongoing sound organization. Probe tones were presented randomly within ambiguously organized sound sequences to reveal whether the neurophysiological representation of the sounds was integrated (no MMN) or segregated (MMN). The pattern of results demonstrated context-dependent responses to a single tone that was modulated in dynamic fashion as the auditory environment rapidly changed from integrated to segregated sounds. This suggests a rapid form of auditory plasticity in which the longer-term sound context influences the current state of neural activity when it is ambiguous. These results demonstrate stimulus-driven modulation of neural activity that accommodates to the dynamically changing acoustic environment.

When Loading Working Memory Reduces Distraction: Behavioral and Electrophysiological Evidence from an Auditory-Visual Distraction Paradigm

The sensitivity of involuntary attention to top-down modulation was tested using an auditory-visual distraction task and a working memory (WM) load manipulation in subjects performing a simple visual classification task while ignoring contingent auditory stimulation. The sounds were repetitive standard tones (80%) and environmental novel sounds (20%). Distraction caused by the novel sounds was compared across a 1-back WM condition and a no-memory control condition, both involving the comparison of two digits. Event-related brain potentials (ERPs) to the sounds were recorded, and the N1/MMN (mismatch negativity), novelty-P3, and RON components were identified in the novel minus standard difference waveforms. Distraction was reduced in the WM condition, both behaviorally and as indexed by an attenuation of the late phase of the novelty-P3. The transient/change detection mechanism indexed by MMN was not affected by the WM manipulation. Sustained, slow frontal and parietal waveforms related to WM processes were found on the standard ERPs. The present results indicate that distraction caused by irrelevant novel sounds is reduced when a WM component is involved in the task, and that this modulation by WM load takes place at a late stage of the orienting response, all in all confirming that involuntary attention is under the control of top-down mechanisms. Moreover, as these results contradict predictions of the load theory of selective attention and cognitive control, it is suggested that the WM load effects on distraction depend on the nature of the distractor-target relationships.

Preattentive sensory processing as indexed by the MMN and P3a brain responses is associated with cognitive and psychosocial functioning in healthy adults

Understanding the basic neural processes that underlie complex higher order cognitive operations and psychosocial functioning is a fundamental goal of cognitive neuroscience. Event-related potentials allow investigators to probe the earliest stages of information processing. Mismatch negativity (MMN) and P3a are auditory event-related potential components that reflect automatic sensory discrimination. The aim of the present study was to determine if MMN and P3a are associated with higher order cognitive operations and psychosocial functioning in clinically normal healthy subjects. Twenty adults were assessed using standardized clinical, cognitive, and psychosocial functional instruments. All individuals were within the normal range on cognitive tests and functional ratings. Participants were also tested on a duration-deviant MMN/P3a paradigm (50-msec standard tones, p = .90; 100-msec deviant tones, p = .10; stimulus onset asynchrony [SOA] = 505 msec). Across fronto-central electrode regions, significant correlations were observed between psychosocial functioning and MMN (r = -.62, p < .01) and P3a (r = .63, p < .01) amplitudes. P3a amplitude was also highly associated with immediate and delayed recall of verbal information with robust correlations widely distributed across fronto-central recording areas (e.g., r = .72, p < .001). The latency of the P3a response was significantly associated with both working memory performance (r = -.53, p < .05) and functional ratings (r = -.48, p < .05). Neurophysiological measures of relatively automatic auditory sensory information processing are associated with higher order cognitive abilities and psychosocial functioning in normal subjects. Efficiency at elementary levels of information processing may underlie the successful encoding, retrieval, and discrimination of task-relevant information, which, in turn, facilitates the iterative and responsive processing necessary for adaptive cognitive and social functioning.

The mismatch negativity (MMN) in basic research of central auditory processing: a review

In the present article, the basic research using the mismatch negativity (MMN) and analogous results obtained by using the magnetoencephalography (MEG) and other brain-imaging technologies is reviewed. This response is elicited by any discriminable change in auditory stimulation but recent studies extended the notion of the MMN even to higher-order cognitive processes such as those involving grammar and semantic meaning. Moreover, MMN data also show the presence of automatic intelligent processes such as stimulus anticipation at the level of auditory cortex. In addition, the MMN enables one to establish the brain processes underlying the initiation of attention switch to, conscious perception of, sound change in an unattended stimulus stream.

Cognitive control of involuntary attention and distraction in children and adolescents

The present study focused on the control of involuntary attentional orienting and distraction in children (6-8, 10-12 years) and adolescents (17-18 years). In an auditory distraction paradigm, pitch deviants interspersed in a sequence of standard sounds were presented. In the predictable condition, the type of sound (standard or deviant) was announced by a preceding visual cue. In the unpredictable condition, the cue was not informative with respect to the type of sound. Subjects performed a sound duration discrimination task and were instructed to attend the cues in order to avoid distraction. In the unpredictable condition, regular behavioral and ERP effects of change detection (Mismatch Negativity), attentional orienting (P3a) and distraction (prolonged reaction times) were observed. In the predictable condition, no modulation of Mismatch Negativity amplitude was observed, whereas the amplitude of P3a and reaction time prolongations in deviant trials were reduced in all age groups. Results suggest that even young children are able to voluntarily control involuntary attentional orienting and behavioral distraction. However, significant age effects were observed for the level of behavioral distraction and the selective utilization of the visual cues (reflected by P3b).

A New View on the MMN and Attention Debate

The question of whether the mismatch negativity (MMN) is modulated by attention has been debated for over a decade. Although the MMN is widely regarded as reflecting a preattentive auditory process, many studies have shown attention effects on MMN. So, what does preattentive mean if attention can modulate the MMN? To understand the function of MMN in auditory processing, we need to shed new light on the “MMN and attention” debate. This review will discuss the apparent paradox that MMN can be modulated by attention and still be considered an attention-independent process, and provide a new framework for viewing the MMN system. The new model proposes that the principal factor governing MMN is the sound context. MMN generation relies on multiple processing mechanisms that are part of a larger system of auditory scene analysis.

The effect of visuospatial attentional load on the processing of irrelevant acoustic distractors

This work investigated the role of cognitive control functions in selective attention when task-relevant and -irrelevant stimuli come from different sensory modalities. We parametrically manipulated the load of an attentive tracking task and investigated its effect on irrelevant acoustic change-related processing. While subjects were performing the visual attentive tracking task, event-related potentials (ERPs) were recorded for frequent standard tones and rare deviant tones presented as auditory distractors. The deviant tones elicited two change-related ERP components: the mismatch negativity (MMN) and the P3a. The amplitude of the MMN, which indexes the early detection of irregular changes, increased with increasing attentional load, whereas the subsequent P3a component, which indicates the involuntary orienting of attention to deviants, was significant only in the lowest load condition. These findings suggest that active exclusion of the early detection process of irrelevant acoustic changes depends on available resources of cognitive control, whereas the late involuntary orienting of attention to deviants can be passively suppressed by high demand on central attentional resources. The present study thus reveals opposing visual attentional load effects at different temporal and functional stages in the rejection of deviant auditory distractors and provides a new perspective on the resolution of the long-standing early versus late attention selection debate.

The effect of visual task difficulty and attentional direction on the detection of acoustic change as indexed by the Mismatch Negativity

Näätänen's model of auditory processing purports that attention does not affect the MMN. The present study investigates this claim through two different manipulations. First, the effect of visual task difficulty on the passively elicited MMN is assessed. Second, the MMNs elicited by stimuli under attended and ignored conditions are compared. In Experiment 1, subjects were presented with mixed sequences of equiprobable auditory and visual stimuli. The auditory stimuli consisted of standard (80 dB SPL 1000 Hz), frequency deviant (1050 Hz), and intensity deviant (70 dB SPL) tone pips. In a first instance, subjects were instructed to ignore the auditory stimulation and engage in an easy and difficult visual discrimination task (focused condition). Subsequently, they were asked to attend to both modalities and detect visual and auditory deviant stimuli (divided condition). The results indicate that the passively elicited MMN to frequency and intensity deviants did not significantly vary with visual task difficulty, in spite of the fact that the easy and difficult tasks showed a wide variation in performance. The manipulation of the attentional direction (focused vs. divided conditions) did result in a significant effect on the MMN elicited by the intensity, but not frequency, deviant. The intensity MMN was larger at frontal sites when subjects' attention was directed to both modalities as compared to only the visual modality. The attentional effect on the MMN to the intensity deviants only may be due to the specific deviant feature or the poorer perceptual discriminability of this deviant from the standard. Experiment 2 was designed to address this issue. The methods of Experiment 2 were identical to those of Experiment 1 with the exception that the intensity deviant (60 dB SPL) was made to be more perceptible than the frequency deviant (1016 Hz) when compared to the standard stimulus (80 dB SPL 1000 Hz). The results of Experiment 2 also demonstrated that the passively elicited MMN was not affected by large variations in visual task difficulty; this provides convincing evidence that the MMN is independent of visual task demands. Similarly to Experiment 1, the direction of attention again had a significant effect on the MMN. In Experiment 2, however, the frequency MMN (and not the intensity MMN) was larger at frontal sites during divided attention compared to focused visual attention. The most parsimonious explanation of these results is that attention enhances the discriminability of the deviant from the standard background stimulation. As such, small acoustic changes would benefit from attention whereas the discriminability of larger changes may not be significantly enhanced.