Cortical Generators and Connections Underlying Phoneme Perception: A Mismatch Negativity and P300 Investigation

The cortical generators of the pure tone MMN and P300 have been thoroughly studied. Their nature and interaction with respect to phoneme perception, however, is poorly understood. Accordingly, the cortical sources and functional connections that underlie the MMN and P300 in relation to passive and active speech sound perception were identified. An inattentive and attentive phonemic oddball paradigm, eliciting a MMN and P300 respectively, were administered in 60 healthy adults during simultaneous high-density EEG recording. For both the MMN and P300, eLORETA source reconstruction was performed. The maximal cross-correlation was calculated between ROI-pairs to investigate inter-regional functional connectivity specific to passive and active deviant processing. MMN activation clusters were identified in the temporal (insula, superior temporal gyrus and temporal pole), frontal (rostral middle frontal and pars opercularis) and parietal (postcentral and supramarginal gyrus) cortex. Passive discrimination of deviant phonemes was aided by a network connecting right temporoparietal cortices to left frontal areas. For the P300, clusters with significantly higher activity were found in the frontal (caudal middle frontal and precentral), parietal (precuneus) and cingulate (posterior and isthmus) cortex. Significant intra- and interhemispheric connections between parietal, cingulate and occipital regions constituted the network governing active phonemic target detection. A predominantly bilateral network was found to underly both the MMN and P300. While passive phoneme discrimination is aided by a fronto-temporo-parietal network, active categorization calls on a network entailing fronto-parieto-cingulate cortices. Neural processing of phonemic contrasts, as reflected by the MMN and P300, does not appear to show pronounced lateralization to the language-dominant hemisphere.

Spontaneously emerging internal models of visual sequences combine abstract and event-specific information in the prefrontal cortex

When exposed to sensory sequences, do macaque monkeys spontaneously form abstract internal models that generalize to novel experiences? Here, we show that neuronal populations in macaque ventrolateral prefrontal cortex jointly encode visual sequences by separate codes for the specific pictures presented and for their abstract sequential structure. We recorded prefrontal neurons while macaque monkeys passively viewed visual sequences and sequence mismatches in the local-global paradigm. Even without any overt task or response requirements, prefrontal populations spontaneously form representations of sequence structure, serial order, and image identity within distinct but superimposed neuronal subspaces. Representations of sequence structure rapidly update following single exposure to a mismatch sequence, while distinct populations represent mismatches for sequences of different complexity. Finally, those representations generalize across sequences following the same repetition structure but comprising different images. These results suggest that prefrontal populations spontaneously encode rich internal models of visual sequences reflecting both content-specific and abstract information.

Somatosensory omissions reveal action-related predictive processing

The intricate relation between action and somatosensory perception has been studied extensively in the past decades. Generally, a forward model is thought to predict the somatosensory consequences of an action. These models propose that when an action is reliably coupled to a tactile stimulus, unexpected absence of the stimulus should elicit prediction error. Although such omission responses have been demonstrated in the auditory modality, it remains unknown whether this mechanism generalizes across modalities. This study therefore aimed to record action-induced somatosensory omission responses using EEG in humans. Self-paced button presses were coupled to somatosensory stimuli in 88% of trials, allowing a prediction, or in 50% of trials, not allowing a prediction. In the 88% condition, stimulus omission resulted in a neural response consisting of multiple components, as revealed by temporal principal component analysis. The oN1 response suggests similar sensory sources as stimulus-evoked activity, but an origin outside primary cortex. Subsequent oN2 and oP3 responses, as previously observed in the auditory domain, likely reflect modality-unspecific higher order processes. Together, findings straightforwardly demonstrate somatosensory predictions during action and provide evidence for a partially amodal mechanism of prediction error generation.

Automatic Change Detection in Interwoven Sequences: A Visual Mismatch Negativity Study

In this study, we investigated whether the cognitive system, known to be able to register regular visual event sequences and the violation of these sequences automatically, had the capacity of processing two sequences simultaneously. To this end, we measured the visual mismatch negativity (vMMN) component of ERPs as interwoven event sequences simultaneously presented to the left and right side of the screen. One of the sequences consisted of geometric patterns (diamonds); the other, photographs of human faces. In successive cycles, parts of the stimuli vanished and then re-appeared (the OFF/ON method). The vanishing parts served as either standard (frequently vanishing parts) or infrequent (deviant) events, but these events were task-irrelevant. The 20 adult participants (age 21.40 ± 2.72 years) performed a visual tracking task, with the OFF/ON task being a passive oddball paradigm. According to the results, both OFF and ON events, and both diamond and face stimuli elicited the vMMN component, showing that the system underlying this activity is capable of processing two event sequences if the sequences consist of fairly different kind of objects as stimuli. The sLORETA analysis showed that the source of vMMN was more frequent contralaterally to the deviant event, and the sources comprised loci from ventral and dorsal structures, as well as some anterior loci.

Auditory prediction and prediction error responses evoked through a novel cascade roving paradigm: a human ECoG study

Auditory sensory processing is assumed to occur in a hierarchical structure including the primary auditory cortex (A1), superior temporal gyrus, and frontal areas. These areas are postulated to generate predictions for incoming stimuli, creating an internal model of the surrounding environment. Previous studies on mismatch negativity have indicated the involvement of the superior temporal gyrus in this processing, whereas reports have been mixed regarding the contribution of the frontal cortex. We designed a novel auditory paradigm, the "cascade roving" paradigm, which incorporated complex structures (cascade sequences) into a roving paradigm. We analyzed electrocorticography data from six patients with refractory epilepsy who passively listened to this novel auditory paradigm and detected responses to deviants mainly in the superior temporal gyrus and inferior frontal gyrus. Notably, the inferior frontal gyrus exhibited broader distribution and sustained duration of deviant-elicited responses, seemingly differing in spatio-temporal characteristics from the prediction error responses observed in the superior temporal gyrus, compared with conventional oddball paradigms performed on the same participants. Moreover, we observed that the deviant responses were enhanced through stimulus repetition in the high-gamma range mainly in the superior temporal gyrus. These features of the novel paradigm may aid in our understanding of auditory predictive coding.

Influence of monaural auditory stimulation combined with music on brain activity

Introduction

Recently, the increasing attention to mental states and psychophysical health has fueled the research into methods that can aid in relaxation and recovery. Traditional methods like meditation and sauna, while effective, have their limitations; thus, the need for more accessible and convenient alternatives.

Methods

Our innovative approach combines monaural beats with music, attempting to replicate the relaxing effects of a sauna in the auditory domain.

Results

In comparison to normal music and silent condition, the power of the theta active band significantly increased when listening to our modified music. Furthermore, after listening to modified music, there was a significant increase in mismatch negativity (MMN) amplitude in the oddball task. Additionally, participants' subjective responses to a questionnaire indicated significant changes in body relaxation and other metrics after listening to the processed music.

Discussion

This state is considered similar to the "totonou" state, which manifests in physical and mental feelings of relaxation, pleasure, and mental clarity in the sauna. Thus, the present research proposes a convenient method for achieving relaxation, opening an avenue for individuals to customize their "totonou" music based on personal preferences.

Characteristics of different Mandarin pronunciation element perception: evidence based on a multifeature paradigm for recording MMN and P3a components of phonemic changes in speech sounds

Background

As a tonal language, Mandarin Chinese has the following pronunciation elements for each syllable: the vowel, consonant, tone, duration, and intensity. Revealing the characteristics of auditory-related cortical processing of these different pronunciation elements is interesting.

Methods

A Mandarin pronunciation multifeature paradigm was designed, during which a standard stimulus and five different phonemic deviant stimuli were presented. The electroencephalogram (EEG) data were recorded with 256-electrode high-density EEG equipment. Time-domain and source localization analyses were conducted to demonstrate waveform characteristics and locate the sources of the cortical processing of mismatch negativity (MMN) and P3a components following different stimuli.

Results

Vowel and consonant differences elicited distinct MMN and P3a components, but tone and duration differences did not. Intensity differences elicited distinct MMN components but not P3a components. For MMN and P3a components, the activated cortical areas were mainly in the frontal-temporal lobe. However, the regions and intensities of the cortical activation were significantly different among the components for the various deviant stimuli. The activated cortical areas of the MMN and P3a components elicited by vowels and consonants seemed to be larger and show more intense activation.

Conclusion

The auditory processing centers use different auditory-related cognitive resources when processing different Mandarin pronunciation elements. Vowels and consonants carry more information for speech comprehension; moreover, more neurons in the cortex may be involved in the recognition and cognitive processing of these elements.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Time-resolved dynamic computational modeling of human EEG recordings reveals gradients of generative mechanisms for the MMN response

Despite attempts to unify the different theoretical accounts of the mismatch negativity (MMN), there is still an ongoing debate on the neurophysiological mechanisms underlying this complex brain response. On one hand, neuronal adaptation to recurrent stimuli is able to explain many of the observed properties of the MMN, such as its sensitivity to controlled experimental parameters. On the other hand, several modeling studies reported evidence in favor of Bayesian learning models for explaining the trial-to-trial dynamics of the human MMN. However, direct comparisons of these two main hypotheses are scarce, and previous modeling studies suffered from methodological limitations. Based on reports indicating spatial and temporal dissociation of physiological mechanisms within the timecourse of mismatch responses in animals, we hypothesized that different computational models would best fit different temporal phases of the human MMN. Using electroencephalographic data from two independent studies of a simple auditory oddball task (n = 82), we compared adaptation and Bayesian learning models' ability to explain the sequential dynamics of auditory deviance detection in a time-resolved fashion. We first ran simulations to evaluate the capacity of our design to dissociate the tested models and found that they were sufficiently distinguishable above a certain level of signal-to-noise ratio (SNR). In subjects with a sufficient SNR, our time-resolved approach revealed a temporal dissociation between the two model families, with high evidence for adaptation during the early MMN window (from 90 to 150-190 ms post-stimulus depending on the dataset) and for Bayesian learning later in time (170-180 ms or 200-220ms). In addition, Bayesian model averaging of fixed-parameter models within the adaptation family revealed a gradient of adaptation rates, resembling the anatomical gradient in the auditory cortical hierarchy reported in animal studies.

Mismatch Negativity and Theta Oscillations Evoked by Auditory Deviance in Early Schizophrenia

BACKGROUND

Amplitude reduction of mismatch negativity (MMN), an event-related potential component indexing NMDA receptor-dependent auditory echoic memory and predictive coding, is widely replicated in schizophrenia. Time-frequency analyses of single-trial electroencephalography epochs suggest that theta oscillation abnormalities underlie MMN deficits in schizophrenia. However, this has received less attention in early schizophrenia (ESZ).

METHODS

Patients with ESZ (n = 89), within 5 years of illness onset, and healthy control subjects (n = 105) completed an electroencephalography MMN paradigm (duration-deviant, pitch-deviant, duration + pitch double-deviant). Repeated measures analyses of variance assessed group differences in MMN, theta intertrial phase coherence (ITC), and theta total power from frontocentral electrodes, after normal age adjustment. Group differences were retested after covarying MMN and theta measures.

RESULTS

Relative to healthy control subjects, patients with ESZ showed auditory deviance deficits. Patients with ESZ had MMN deficits for duration-deviants (p = .041), pitch-deviants (ps = .007), and double-deviants (ps < .047). Patients with ESZ had reduced theta ITC for standards (ps < .040) and duration-deviants (ps < .030). Furthermore, patients with ESZ had reduced theta power across deviants at central electrodes (p = .013). MMN group deficits were not fully accounted for by theta ITC and power, and neither were theta ITC group deficits fully accounted for by MMN. Group differences in theta total power were no longer significant after covarying for MMN.

CONCLUSIONS

Patients with ESZ showed reduced MMN and theta total power for all deviant types. Theta ITC showed a relatively specific reduction for duration-deviants. Although MMN and theta ITC were correlated in ESZ, covarying for one did not fully account for deficits in the other, raising the possibility of their sensitivity to dissociable pathophysiological processes.

Mismatch negativity generation in subjects at risk for psychosis: source analysis is more sensitive than surface electrodes in risk prediction

Background

Deficits of mismatch negativity (MMN) in patients with schizophrenia have been demonstrated many times and there is growing evidence that alterations of MMN already exist in individuals at risk for psychosis. The present study examines differences in MMN between subjects fulfilling ultra-high risk (UHR) or only basic symptoms criteria and it addresses the question, if MMN source analysis can improve prediction of transition to psychosis.

Methods

The MMN to duration, frequency, and intensity deviants was recorded in 50 healthy controls and 161 individuals at risk for psychosis classified into three subgroups: only basic symptoms (n = 74), only ultra-high risk (n = 13) and persons who fulfill both risk criteria (n = 74). Based on a three-source model of MMN generation, we conducted an MMN source analysis and compared the amplitudes of surface electrodes and sources among the three groups.

Results

Significant differences in MMN generation among the four groups were revealed at surface electrodes Cz and C4 (p < 0.05) and at the frontal source (p < 0.001) for duration deviant stimuli. The 15 subjects from the risk groups who subsequently developed a manifest psychosis had a significantly lower MMN amplitude at frontal source (p = 0.019) without showing significant differences at surface electrodes. Low activity at frontal MMN source increased the risk of transition to manifest disease by the factor 3.12 in UHR subjects.

Conclusion

MMN activity differed significantly between subjects presenting only basic symptoms and subjects which additionally meet UHR criteria. The largest differences between groups as well as between individuals with and without transition were observed at the frontal source. The present results suggest that source analysis is more sensitive than surface electrodes in psychosis risk prediction by MMN.

Auditory representations for long lasting sounds: Insights from event-related brain potentials and neural oscillations

The basic features of short sounds, such as frequency and intensity including their temporal dynamics, are integrated in a unitary representation. Knowledge on how our brain processes long lasting sounds is scarce. We review research utilizing the Mismatch Negativity event-related potential and neural oscillatory activity for studying representations for long lasting simple versus complex sounds such as sinusoidal tones versus speech. There is evidence for a temporal constraint in the formation of auditory representations: Auditory edges like sound onsets within long lasting sounds open a temporal window of about 350 ms in which the sounds' dynamics are integrated into a representation, while information beyond that window contributes less to that representation. This integration window segments the auditory input into short chunks. We argue that the representations established in adjacent integration windows can be concatenated into an auditory representation of a long sound, thus, overcoming the temporal constraint.

Predictive encoding of pure tones and FM-sweeps in the human auditory cortex

Expectations substantially influence perception, but the neural mechanisms underlying this influence are not fully understood. A prominent view is that sensory neurons encode prediction error with respect to expectations on upcoming sensory input. Although the encoding of prediction error has been previously demonstrated in the human auditory cortex (AC), previous studies often induced expectations using stimulus repetition, potentially confounding prediction error with neural habituation. These studies also measured AC as a single population, failing to consider possible predictive specializations of different AC fields. Moreover, the few studies that considered prediction error to stimuli other than pure tones yielded conflicting results. Here, we used functional magnetic resonance imaging (fMRI) to systematically investigate prediction error to subjective expectations in auditory cortical fields Te1.0, Te1.1, Te1.2, and Te3, and two types of stimuli: pure tones and frequency modulated (FM) sweeps. Our results show that prediction error is elicited with respect to the participants' expectations independently of stimulus repetition and similarly expressed across auditory fields. Moreover, despite the radically different strategies underlying the decoding of pure tones and FM-sweeps, both stimulus modalities were encoded as prediction error in most fields of AC. Altogether, our results provide unequivocal evidence that predictive coding is the general encoding mechanism in AC.

Sensory Target Detection at Local and Global Timescales Reveals a Hierarchy of Supramodal Dynamics in the Human Cortex

To ensure survival in a dynamic environment, the human neocortex monitors input streams from different sensory organs for important sensory events. Which principles govern whether different senses share common or modality-specific brain networks for sensory target detection? We examined whether complex targets evoke sustained supramodal activity while simple targets rely on modality-specific networks with short-lived supramodal contributions. In a series of hierarchical multisensory target detection studies (n = 77, of either sex) using EEG, we applied a temporal cross-decoding approach to dissociate supramodal and modality-specific cortical dynamics elicited by rule-based global and feature-based local sensory deviations within and between the visual, somatosensory, and auditory modality. Our data show that each sense implements a cortical hierarchy orchestrating supramodal target detection responses, which operate at local and global timescales in successive processing stages. Across different sensory modalities, simple feature-based sensory deviations presented in temporal vicinity to a monotonous input stream triggered a mismatch negativity-like local signal which decayed quickly and early, whereas complex rule-based targets tracked across time evoked a P3b-like global neural response which generalized across a late time window. Converging results from temporal cross-modality decoding analyses across different datasets, we reveal that global neural responses are sustained in a supramodal higher-order network, whereas local neural responses canonically thought to rely on modality-specific regions evolve into short-lived supramodal activity. Together, our findings demonstrate that cortical organization largely follows a gradient in which short-lived modality-specific as well as supramodal processes dominate local responses, whereas higher-order processes encode temporally extended abstract supramodal information fed forward from modality-specific cortices.SIGNIFICANCE STATEMENT Each sense supports a cortical hierarchy of processes tracking deviant sensory events at multiple timescales. Conflicting evidence produced a lively debate around which of these processes are supramodal. Here, we manipulated the temporal complexity of auditory, tactile, and visual targets to determine whether cortical local and global ERP responses to sensory targets share cortical dynamics between the senses. Using temporal cross-decoding, we found that temporally complex targets elicit a supramodal sustained response. Conversely, local responses to temporally confined targets typically considered modality-specific rely on early short-lived supramodal activation. Our finding provides evidence for a supramodal gradient supporting sensory target detection in the cortex, with implications for multiple fields in which these responses are studied (e.g., predictive coding, consciousness, and attention).

Temporal and Spectral Properties of the Auditory Mismatch Negativity and P3a Responses in Schizophrenia

The mismatch negativity (MMN) event-related potential (ERP) indexes relatively automatic detection of changes in sensory stimuli and is typically attenuated in individuals with schizophrenia. However, contributions of different frequencies of electroencephalographic (EEG) activity to the MMN and the later P3a attentional orienting response in schizophrenia are poorly understood and were the focus of the present study. Participants with a schizophrenia-spectrum disorder (n = 85) and non-psychiatric control participants (n = 74) completed a passive auditory oddball task containing 10% 50 ms "deviant" tones and 90% 100 ms "standard" tones. EEG data were analyzed using spatial principal component analysis (PCA) applied to wavelet-based time-frequency analysis and MMN and P3a ERPs. The schizophrenia group compared to the control group had smaller MMN amplitudes and lower deviant-minus-standard theta but not alpha event-related spectral perturbation (ERSP) after accounting for participant age and sex. Larger MMN and P3a amplitudes but not latencies were correlated with greater theta and alpha time-frequency activity. Multiple linear regression analyses revealed that control participants showed robust relationships between larger MMN amplitudes and greater deviant-minus-standard theta inter-trial coherence (ITC) and between larger P3a amplitudes and greater deviant-minus-standard theta ERSP, whereas these dynamic neural processes were less tightly coupled in participants with a schizophrenia-spectrum disorder. Study results help clarify frequency-based contributions of time-domain (ie, ERP) responses and indicate a potential disturbance in the neural dynamics of detecting change in sensory stimuli in schizophrenia. Overall, findings add to the growing body of evidence that psychotic illness is associated with widespread neural dysfunction in the theta frequency band.

Neural entrainment via perceptual inferences

Entrainment depends on sequential neural phase reset by regular stimulus onset, a temporal parameter. Entraining to sequences of identical stimuli also entails stimulus feature predictability, but this component is not readily separable from temporal regularity. To test if spectral regularities concur with temporal regularities in determining the strength of auditory entrainment, we devised sound sequences that varied in conditional perceptual inferences based on deviant sound repetition probability: Strong inference (100% repetition probability: If a deviant appears, then it will repeat), weak inference (75% repetition probability), no inference (50%: A deviant may or may not repeat with equal probability). We recorded EEG data from 15 young human participants pre-attentively listening to the experimental sound sequences delivered either isochronously or anisochronously ( ± 20 % jitter), at both delta (1.67 Hz) and theta (6.67 Hz) stimulation rates. Strong perceptual inferences significantly enhanced entrainment at either stimulation rate, and determined positive correlations between precision in phase distribution at the onset of deviant trials, and entrained power. We conclude that both spectral predictability and temporal regularity govern entrainment via neural phase control.

Predictability-Based Source Segregation and Sensory Deviance Detection in Auditory Aging

When multiple sound sources are present at the same time, auditory perception is often challenged with disentangling the resulting mixture and focusing attention on the target source. It has been repeatedly demonstrated that background (distractor) sound sources are easier to ignore when their spectrotemporal signature is predictable. Prior evidence suggests that this ability to exploit predictability for foreground-background segregation degrades with age. On a theoretical level, this has been related with an impairment in elderly adults’ capabilities to detect certain types of sensory deviance in unattended sound sequences. Yet the link between those two capacities, deviance detection and predictability-based sound source segregation, has not been empirically demonstrated. Here we report on a combined behavioral-EEG study investigating the ability of elderly listeners (60–75 years of age) to use predictability as a cue for sound source segregation, as well as their sensory deviance detection capacities. Listeners performed a detection task on a target stream that can only be solved when a concurrent distractor stream is successfully ignored. We contrast two conditions whose distractor streams differ in their predictability. The ability to benefit from predictability was operationalized as performance difference between the two conditions. Results show that elderly listeners can use predictability for sound source segregation at group level, yet with a high degree of inter-individual variation in this ability. In a further, passive-listening control condition, we measured correlates of deviance detection in the event-related brain potential (ERP) elicited by occasional deviations from the same spectrotemporal pattern as used for the predictable distractor sequence during the behavioral task. ERP results confirmed neural signatures of deviance detection in terms of mismatch negativity (MMN) at group level. Correlation analyses at single-subject level provide no evidence for the hypothesis that deviance detection ability (measured by MMN amplitude) is related to the ability to benefit from predictability for sound source segregation. These results are discussed in the frameworks of sensory deviance detection and predictive coding.

Standard Tone Stability as a Manipulation of Precision in the Oddball Paradigm: Modulation of Prediction Error Responses to Fixed-Probability Deviants

Electrophysiological sensory deviance detection signals, such as the mismatch negativity (MMN), have been interpreted from the predictive coding framework as manifestations of prediction error (PE). From a frequentist perspective of the classic oddball paradigm, deviant stimuli are unexpected because of their low probability. However, the amount of PE elicited by a stimulus can be dissociated from its probability of occurrence: when the observer cannot make confident predictions, any event holds little surprise value, no matter how improbable. Here we tested the hypothesis that the magnitude of the neural response elicited to an improbable sound (D) would scale with the precision of the prediction derived from the repetition of another sound (S), by manipulating repetition stability. We recorded the Electroencephalogram (EEG) from 20 participants while passively listening to 4 types of isochronous pure tone sequences differing in the probability of the S tone (880 Hz) while holding constant the probability of the D tone [1,046 Hz; p(D) = 1/11]: Oddball [p(S) = 10/11]; High confidence (7/11); Low confidence (4/11); and Random (1/11). Tones of 9 different frequencies were equiprobably presented as fillers [p(S) + p(D) + p(F) = 1]. Using a mass-univariate non-parametric, cluster-based correlation analysis controlling for multiple comparisons, we found that the amplitude of the deviant-elicited ERP became more negative with increasing S probability, in a time-electrode window consistent with the MMN (ca. 120–200 ms; frontal), suggesting that the strength of a PE elicited to an improbable event indeed increases with the precision of the predictive model.

Somatosensory Deviance Detection ERPs and Their Relationship to Analogous Auditory ERPs and Interoceptive Accuracy

Abstract. Automatic deviance detection has been widely explored in terms of mismatch responses (mismatch negativity or mismatch response) and P3a components of event-related potentials (ERPs) under a predictive coding framework; however, the somatosensory mismatch response has been investigated less often regarding the different types of changes than its auditory counterpart. It is not known whether the deviance detection responses from different modalities correlate, reflecting a general prediction error mechanism of the central nervous system. Furthermore, interoceptive functions have been associated with predictive coding theory, but whether interoceptive accuracy correlates with deviance detection brain responses has rarely been investigated. Here, we measured ERPs to changes in somatosensory stimuli’s location and intensity and in sound intensity in healthy adults ( n = 34). Interoceptive accuracy was measured with a heartbeat discrimination task, where participants indicated whether their heartbeats were simultaneous or non-simultaneous with sound stimuli. We found a mismatch response and a P3a response to somatosensory location and auditory intensity changes, but for somatosensory intensity changes, only a P3a response was found. Unexpectedly, there were neither correlations between the somatosensory location deviance and intensity deviance brain responses nor between auditory and somatosensory brain responses. In addition, the brain responses did not correlate with interoceptive accuracy. The results suggest that although deviance detection in the auditory and somatosensory modalities are likely based on similar neural mechanisms at a cellular level, their ERP indexes do not indicate a linear association in sensitivity for deviance detection between the modalities. Furthermore, although sensory deviance detection and interoceptive detection are both associated with predictive coding functions, under these experimental settings, functional relationships were not observed. These results should be taken into account in the future development of theories related to human sensory functions and in extensions of the predictive coding theory in particular.

Word class and word frequency in the MMN looking glass

The effects of lexical meaning and lexical familiarity on auditory deviance detection were investigated by presenting oddball sequences of words, while participants ignored the stimuli. Stimulus sequences were composed of words that were varied in word class (nouns vs. functions words) and frequency of language use (high vs. low frequency) in a factorial design with the roles of frequently presented stimuli (Standards) and infrequently presented ones (Deviants) were fully crossed. Deviants elicited the Mismatch Negativity component of the event-related brain potential. Modulating effects of lexical meaning were obtained, revealing processing advantages for denotationally meaningful items. However, no effect of word frequency was observed. These results demonstrate that an apparently low-level function, such as auditory deviance detection utilizes information from the mental lexicon even for task-irrelevant stimuli.

A Critical Review of the Deviance Detection Theory of Mismatch Negativity

Mismatch negativity (MMN) is a component of the difference waveform derived from passive auditory oddball stimulation. Since its inception in 1978, this has become one of the most popular event-related potential techniques, with over two-thousand published studies using this method. This is a testament to the ingenuity and commitment of generations of researchers engaging in basic, clinical and animal research. Despite this intensive effort, high-level descriptions of the mechanisms theorized to underpin mismatch negativity have scarcely changed over the past four decades. The prevailing deviance detection theory posits that MMN reflects inattentive detection of difference between repetitive standard and infrequent deviant stimuli due to a mismatch between the unexpected deviant and a memory representation of the standard. Evidence for these mechanisms is inconclusive, and a plausible alternative sensory processing theory considers fundamental principles of sensory neurophysiology to be the primary source of differences between standard and deviant responses evoked during passive oddball stimulation. By frequently being restated without appropriate methods to exclude alternatives, the potentially flawed deviance detection theory has remained largely dominant, which could lead some researchers and clinicians to assume its veracity implicitly. It is important to have a more comprehensive understanding of the source(s) of MMN generation before its widespread application as a clinical biomarker. This review evaluates issues of validity concerning the prevailing theoretical account of mismatch negativity and the passive auditory oddball paradigm, highlighting several limitations regarding its interpretation and clinical application.

The neural basis of counting sequences

Sequence processing is critical for complex behavior, and counting sequences hold a unique place underlying human numerical development. Despite this, the neural bases of counting sequences remain unstudied. We hypothesized that counting sequences in adults would involve representations in sensory, order, magnitude, and linguistic codes that implicate regions in auditory, supplementary motor, posterior parietal, and inferior frontal areas, respectively. In an fMRI scanner, participants heard four-number sequences in a 2 × 2 × 2 design. The sequences were adjacent or not (e.g., 5, 6, 7, 8 vs. 5, 6, 7, 9), ordered or not (e.g., 5, 6, 7, 8 vs. 8, 5, 7, 6), and were spoken by a voice of consistent or variable identity. Then, neural substrates of counting sequences were identified by testing for the effect of consecutiveness (ordered nonadjacent versus ordered adjacent, e.g., 5, 6, 7, 9 > 5, 6, 7, 8) in the hypothesized brain regions. Violations to consecutiveness elicited brain activity in the right inferior frontal gyrus (IFG) and the supplementary motor area (SMA). In contrast, no such activation was observed in the auditory cortex, despite violations in voice identity recruiting strong activity in that region. Also, no activation was observed in the inferior parietal lobule, despite a robust effect of orderedness observed in that brain region. These findings indicate that listening to counting sequences do not automatically elicit sensory or magnitude codes but suggest that the precise increments in the sequence are tracked by the mechanism for processing ordered associations in the SMA and by the mechanism for binding individual lexical items into a cohesive whole in the IFG.

Perceptual Asymmetries and Auditory Processing of Estonian Quantities

Similar to visual perception, auditory perception also has a clearly described “pop-out” effect, where an element with some extra feature is easier to detect among elements without an extra feature. This phenomenon is better known as auditory perceptual asymmetry. We investigated such asymmetry between shorter or longer duration, and level or falling of pitch of linguistic stimuli that carry a meaning in one language (Estonian), but not in another (Russian). For the mismatch negativity (MMN) experiment, we created four different types of stimuli by modifying the duration of the first vowel [ɑ] (170, 290 ms) and pitch contour (level vs. falling pitch) of the stimuli words (‘SATA,’ ‘SAKI’). The stimuli were synthesized from Estonian words (‘SATA,’ ‘SAKI’) and follow the Estonian language three-way quantity system, which incorporates tonal features (falling pitch contour) together with temporal patterns. This made the meaning of the word dependent on the combination of both features and allows us to compare the relative contribution of duration and pitch contour in discrimination of language stimuli in the brain via MMN generation. The participants of the experiment were 12 Russian native speakers with little or no experience in Estonian and living in Estonia short-term, and 12 Estonian native speakers (age 18–27 years). We found that participants’ perception of the linguistic stimuli differed not only according to the physical features but also according to their native language, confirming that the meaning of the word interferes with the early automatic processing of phonological features. The GAMM and ANOVA analysis of the reversed design results showed that the deviant with longer duration among shorter standards elicited a MMN response with greater amplitude than the short deviant among long standards, while changes in pitch contour (falling vs. level pitch) produced neither strong MMN nor asymmetry. Thus, we demonstrate the effect of language background on asymmetric perception of linguistic stimuli that aligns with those of previous studies (Jaramillo et al., 2000), and contributes to the growing body of knowledge supporting auditory perceptual asymmetry.

Evaluation of multi-feature auditory deviance detection in Parkinson's disease: a mismatch negativity study

Behavioral studies on auditory deviance detection in patients with Parkinson's disease (PD) have reported contradictory results. The primary aim of this study was to investigate auditory deviance detection of multiple auditory features in patients with PD by means of objective and reliable electroencephalographic (EEG) measurements. Twelve patients with early-stage PD and twelve age- and gender-matched healthy controls (HCs) were included in this study. Patients with PD participated without their regular dopaminergic medication. All subjects underwent an audiometric screening and performed a passive multi-feature mismatch negativity (MMN) paradigm. Repeated-measures analysis of variance (ANOVA) demonstrated no significant differences between patients with PD and HCs regarding MMN mean amplitude and latency for frequency, duration and gap deviants. Nevertheless, a trend towards increased MMN mean amplitude and latency was found in response to intensity deviants in patients with PD compared to HCs. Increased intensity MMN amplitude may indicate that more neural resources are allocated to the processing of intensity deviances in patients with PD compared to HCs. The interpretation of this intensity-specific MMN alteration is further discussed in the context of a compensatory mechanism for auditory intensity processing and involuntary attention switching in PD.

MEG reveals preference specific increases of sexual-image-evoked responses in paedophilic sexual offenders and healthy controls

OBJECTIVES

Paedophilic disorder is characterised by sexual attraction towards children. Classification of a counterpart as sexually attractive likely occurs rapidly, and involves both conscious and unconscious attentional and cognitive processes. Magnetoencephalography (MEG) is an imaging method especially well-suited to examine visual and attentional processes triggered by sexual images within the range of milliseconds.

METHODS

We investigated brain responses to sexual images depicting adults (frequent) and children (infrequent stimulus) in seventeen paedophilic patients with a history of child sexual offending (P + CSO) and twenty healthy controls (HC) during a passive visual oddball paradigm. Event-related fields (ERF) were measured to extract the magnetic visual mismatch negativity (vMMNm), and how it relates to the processing of different classes of sexual stimuli.

RESULTS

P + CSO exhibited significantly longer vMMNm latencies (100-180 ms post-stimulus) than HC. Moreover, P + CSO showed widespread increased amplitudes in response to child images starting from P3a and P3b components and lasting up to 400 ms post-stimulus presentation localised in frontal and temporal brain regions.

CONCLUSIONS

This study uncovers the first MEG differences in automatic change detection between P + CSO and HC during the presentation of subliminal sexual images of adults and children, contributing towards a better understanding of the neurobiological processes of P + CSO.

Activities of the Right Temporo-Parieto-Occipital Junction Reflect Spatial Hearing Ability in Cochlear Implant Users

Spatial hearing is critical for us not only to orient ourselves in space, but also to follow a conversation with multiple speakers involved in a complex sound environment. The hearing ability of people who suffered from severe sensorineural hearing loss can be restored by cochlear implants (CIs), however, with a large outcome variability. Yet, the causes of the CI performance variability remain incompletely understood. Despite the CI-based restoration of the peripheral auditory input, central auditory processing might still not function fully. Here we developed a multi-modal repetition suppression (MMRS) paradigm that is capable of capturing stimulus property-specific processing, in order to identify the neural correlates of spatial hearing and potential central neural indexes useful for the rehabilitation of sound localization in CI users. To this end, 17 normal hearing and 13 CI participants underwent the MMRS task while their brain activity was recorded with a 256-channel electroencephalography (EEG). The participants were required to discriminate between the probe sound location coming from a horizontal array of loudspeakers. The EEG MMRS response following the probe sound was elicited at various brain regions and at different stages of processing. Interestingly, the more similar this differential MMRS response in the right temporo-parieto-occipital (TPO) junction in CI users was to the normal hearing group, the better was the spatial hearing performance in individual CI users. Based on this finding, we suggest that the differential MMRS response at the right TPO junction could serve as a central neural index for intact or impaired sound localization abilities.

Brain predictive coding processes are associated to COMT gene Val158Met polymorphism

Predicting events in the ever-changing environment is a fundamental survival function intrinsic to the physiology of sensory systems, whose efficiency varies among the population. Even though it is established that a major source of such variations is genetic heritage, there are no studies tracking down auditory predicting processes to genetic mutations. Thus, we examined the neurophysiological responses to deviant stimuli recorded with magnetoencephalography (MEG) in 108 healthy participants carrying different variants of Val158Met single-nucleotide polymorphism (SNP) within the catechol-O-methyltransferase (COMT) gene, responsible for the majority of catecholamines degradation in the prefrontal cortex. Our results showed significant amplitude enhancement of prediction error responses originating from the inferior frontal gyrus, superior and middle temporal cortices in heterozygous genotype carriers (Val/Met) vs homozygous (Val/Val and Met/Met) carriers. Integrating neurophysiology and genetics, this study shows how the neural mechanisms underlying optimal deviant detection vary according to the gene-determined cathecolamine levels in the brain.

Prediction error signaling explains neuronal mismatch responses in the medial prefrontal cortex

The mismatch negativity (MMN) is a key biomarker of automatic deviance detection thought to emerge from 2 cortical sources. First, the auditory cortex (AC) encodes spectral regularities and reports frequency-specific deviances. Then, more abstract representations in the prefrontal cortex (PFC) allow to detect contextual changes of potential behavioral relevance. However, the precise location and time asynchronies between neuronal correlates underlying this frontotemporal network remain unclear and elusive. Our study presented auditory oddball paradigms along with "no-repetition" controls to record mismatch responses in neuronal spiking activity and local field potentials at the rat medial PFC. Whereas mismatch responses in the auditory system are mainly induced by stimulus-dependent effects, we found that auditory responsiveness in the PFC was driven by unpredictability, yielding context-dependent, comparatively delayed, more robust and longer-lasting mismatch responses mostly comprised of prediction error signaling activity. This characteristically different composition discarded that mismatch responses in the PFC could be simply inherited or amplified downstream from the auditory system. Conversely, it is more plausible for the PFC to exert top-down influences on the AC, since the PFC exhibited flexible and potent predictive processing, capable of suppressing redundant input more efficiently than the AC. Remarkably, the time course of the mismatch responses we observed in the spiking activity and local field potentials of the AC and the PFC combined coincided with the time course of the large-scale MMN-like signals reported in the rat brain, thereby linking the microscopic, mesoscopic, and macroscopic levels of automatic deviance detection.

Perceptual learning of tone patterns changes the effective connectivity between Heschl's gyrus and planum temporale

Learning of complex auditory sequences such as music can be thought of as optimizing an internal model of regularities through unpredicted events (or “prediction errors”). We used dynamic causal modeling (DCM) and parametric empirical Bayes on functional magnetic resonance imaging (fMRI) data to identify modulation of effective brain connectivity that takes place during perceptual learning of complex tone patterns. Our approach differs from previous studies in two aspects. First, we used a complex oddball paradigm based on tone patterns as opposed to simple deviant tones. Second, the use of fMRI allowed us to identify cortical regions with high spatial accuracy. These regions served as empirical regions‐of‐interest for the analysis of effective connectivity. Deviant patterns induced an increased blood oxygenation level‐dependent response, compared to standards, in early auditory (Heschl's gyrus [HG]) and association auditory areas (planum temporale [PT]) bilaterally. Within this network, we found a left‐lateralized increase in feedforward connectivity from HG to PT during deviant responses and an increase in excitation within left HG. In contrast to previous findings, we did not find frontal activity, nor did we find modulations of backward connections in response to oddball sounds. Our results suggest that complex auditory prediction errors are encoded by changes in feedforward and intrinsic connections, confined to superior temporal gyrus.

Empirical Bayes evaluation of fused EEG-MEG source reconstruction: Application to auditory mismatch evoked responses

We here turn the general and theoretical question of the complementarity of EEG and MEG for source reconstruction, into a practical empirical one. Precisely, we address the challenge of evaluating multimodal data fusion on real data. For this purpose, we build on the flexibility of Parametric Empirical Bayes, namely for EEG-MEG data fusion, group level inference and formal hypothesis testing. The proposed approach follows a two-step procedure by first using unimodal or multimodal inference to derive a cortical solution at the group level; and second by using this solution as a prior model for single subject level inference based on either unimodal or multimodal data. Interestingly, for inference based on the same data (EEG, MEG or both), one can then formally compare, as alternative hypotheses, the relative plausibility of the two unimodal and the multimodal group priors. Using auditory data, we show that this approach enables to draw important conclusions, namely on (i) the superiority of multimodal inference, (ii) the greater spatial sensitivity of MEG compared to EEG, (iii) the ability of EEG data alone to source reconstruct temporal lobe activity, (iv) the usefulness of EEG to improve MEG based source reconstruction. Importantly, we largely reproduce those findings over two different experimental conditions. We here focused on Mismatch Negativity (MMN) responses for which generators have been extensively investigated with little homogeneity in the reported results. Our multimodal inference at the group level revealed spatio-temporal activity within the supratemporal plane with a precision which, to our knowledge, has never been achieved before with non-invasive recordings.

Neural correlates of auditory sensory memory dynamics in the aging brain

The auditory system allows us to monitor background environmental sound patterns and recognize deviations that may indicate opportunities or threats. The mismatch negativity and P3a potentials have generators in the auditory and inferior frontal cortex and index expected sound patterns (standards) and any aberrations (deviants). The mismatch negativity and P3a waveforms show increased positivity for consecutive standards and deviants preceded by more standards. We hypothesized attenuated repetition effects in older participants, potentially because of differences in prefrontal functions. Young (23 ± 5 years) and older (75 ± 5 years) adults were tested in 2 oddball paradigms with pitch or location deviants. Significant repetition effects were observed in the young standard and deviant waveforms at multiple time windows. Except the earliest time window (30-100 ms), repetition effects were absent in the older group. Repetition effects were significant at frontal but not temporal lobe sites and did not differ among pitch and location deviants. However, P3a repetition was evident in both ages. Findings suggest age differences in the dynamic updating of sensory memory for background sound patterns.

Making Sense of Mismatch Negativity

Evoked potentials provide valuable insight into brain processes that are integral to our ability to interact effectively and efficiently in the world. The mismatch negativity (MMN) component of the evoked potential has proven highly informative on the ways in which sensitivity to regularity contributes to perception and cognition. This review offers a compendium of research on MMN with a view to scaffolding an appreciation for its use as a tool to explore the way regularities contribute to predictions about the sensory environment over many timescales. In compiling this work, interest in MMN as an index of sensory encoding and memory are addressed, as well as attention. Perspectives on the possible underlying computational processes are reviewed as well as recent observations that invite consideration of how MMN relates to how we learn, what we learn, and why.

Auditory deviance detection in the human insula: An intracranial EEG study

The human insula is known to be involved in auditory processing, but knowledge about its precise functional role and the underlying electrophysiology is limited. To assess its role in automatic auditory deviance detection we analyzed the EEG high frequency activity (HFA; 75-145 Hz) and ERPs from 90 intracranial insular channels across 16 patients undergoing pre-surgical intracranial monitoring for epilepsy treatment. Subjects passively listened to a stream of standard and deviant tones differing in four physical dimensions: intensity, frequency, location or time. HFA responses to auditory stimuli were found in the short and long gyri, and the anterior, superior, and inferior segments of the circular sulcus of the insular cortex. Only a subset of channels in the inferior segment of the circular sulcus of the insula showed HFA deviance detection responses, i.e., a greater and longer latency response to specific deviants relative to standards. Auditory deviancy processing was also later in the insula when compared with the superior temporal cortex. ERP results were more widespread and supported the HFA insular findings. These results provide evidence that the human insula is engaged during auditory deviance detection.

Reduced prediction error responses in high-as compared to low-uncertainty musical contexts

Theories of predictive processing propose that prediction error responses are modulated by the certainty of the predictive model or precision. While there is some evidence for this phenomenon in the visual and, to a lesser extent, the auditory modality, little is known about whether it operates in the complex auditory contexts of daily life. Here, we examined how prediction error responses behave in a more complex and ecologically valid auditory context than those typically studied. We created musical tone sequences with different degrees of pitch uncertainty to manipulate the precision of participants' auditory expectations. Magnetoencephalography was used to measure the magnetic counterpart of the mismatch negativity (MMNm) as a neural marker of prediction error in a multi-feature paradigm. Pitch, slide, intensity and timbre deviants were included. We compared high-entropy stimuli, consisting of a set of non-repetitive melodies, with low-entropy stimuli consisting of a simple, repetitive pitch pattern. Pitch entropy was quantitatively assessed with an information-theoretic model of auditory expectation. We found a reduction in pitch and slide MMNm amplitudes in the high-entropy as compared to the low-entropy context. No significant differences were found for intensity and timbre MMNm amplitudes. Furthermore, in a separate behavioral experiment investigating the detection of pitch deviants, similar decreases were found for accuracy measures in response to more fine-grained increases in pitch entropy. Our results are consistent with a precision modulation of auditory prediction error in a musical context, and suggest that this effect is specific to features that depend on the manipulated dimension-pitch information, in this case.

Relationship of auditory electrophysiological responses to magnetic resonance spectroscopy metabolites in Early Phase Psychosis

Both auditory evoked responses and metabolites measured by magnetic resonance spectroscopy (MRS) are altered in schizophrenia and other psychotic disorders, but the relationship between electrophysiological and metabolic changes are not well characterized. We examined the relation of MRS metabolites to cognitive and electrophysiological measures in individuals during the early phase of psychosis (EPP) and in healthy control subjects. The mismatch negativity (MMN) of the auditory event-related potential to duration deviant tones and the auditory steady response (ASSR) to 40 Hz stimulation were assessed. MRS was used to quantify glutamate+glutamine (Glx), N-Acetylasparate (NAA), creatine (Cre), myo-inositol (Ins) and choline (Cho) at a voxel placed medially in the frontal cortex. MMN amplitude and ASSR power did not differ between groups. The MRS metabolites Glx, Cre and Cho were elevated in the psychosis group. Partial least squares analysis in the patient group indicated that elevated levels of MRS metabolites were associated with reduced MMN amplitude and increased 40 Hz ASSR power. There were no correlations between the neurobiological measures and clinical measures. These data suggest that elevated neurometabolites early in psychosis are accompanied by altered auditory neurotransmission, possibly indicative of a neuroinflammatory or excitotoxic disturbance which disrupts a wide range of metabolic processes in the cortex.

Intracranial Recordings and Computational Modeling of Music Reveal the Time Course of Prediction Error Signaling in Frontal and Temporal Cortices

Prediction is held to be a fundamental process underpinning perception, action, and cognition. To examine the time course of prediction error signaling, we recorded intracranial EEG activity from nine presurgical epileptic patients while they listened to melodies whose information theoretical predictability had been characterized using a computational model. We examined oscillatory activity in the superior temporal gyrus (STG), the middle temporal gyrus (MTG), and the pars orbitalis of the inferior frontal gyrus, lateral cortical areas previously implicated in auditory predictive processing. We also examined activity in anterior cingulate gyrus (ACG), insula, and amygdala to determine whether signatures of prediction error signaling may also be observable in these subcortical areas. Our results demonstrate that the information content (a measure of unexpectedness) of musical notes modulates the amplitude of low-frequency oscillatory activity (theta to beta power) in bilateral STG and right MTG from within 100 and 200 msec of note onset, respectively. Our results also show this cortical activity to be accompanied by low-frequency oscillatory modulation in ACG and insula-areas previously associated with mediating physiological arousal. Finally, we showed that modulation of low-frequency activity is followed by that of high-frequency (gamma) power from approximately 200 msec in the STG, between 300 and 400 msec in the left insula, and between 400 and 500 msec in the ACG. We discuss these results with respect to models of neural processing that emphasize gamma activity as an index of prediction error signaling and highlight the usefulness of musical stimuli in revealing the wide-reaching neural consequences of predictive processing.

A Comparison of Auditory Oddball Responses in Dorsolateral Prefrontal Cortex, Basolateral Amygdala, and Auditory Cortex of Macaque

The mismatch negativity (MMN) is an ERP component seen in response to unexpected "novel" stimuli, such as in an auditory oddball task. The MMN is of wide interest and application, but the neural responses that generate it are poorly understood. This is in part due to differences in design and focus between animal and human oddball paradigms. For example, one of the main explanatory models, the "predictive error hypothesis", posits differences in timing and selectivity between signals carried in auditory and prefrontal cortex (PFC). However, these predictions have not been fully tested because (1) noninvasive techniques used in humans lack the combined spatial and temporal precision necessary for these comparisons and (2) single-neuron studies in animal models, which combine necessary spatial and temporal precision, have not focused on higher order contributions to novelty signals. In addition, accounts of the MMN traditionally do not address contributions from subcortical areas known to be involved in novelty detection, such as the amygdala. To better constrain hypotheses and to address methodological gaps between human and animal studies, we recorded single neuron activity from the auditory cortex, dorsolateral PFC, and basolateral amygdala of two macaque monkeys during an auditory oddball paradigm modeled after that used in humans. Consistent with predictions of the predictive error hypothesis, novelty signals in PFC were generally later than in auditory cortex and were abstracted from stimulus-specific effects seen in auditory cortex. However, we found signals in amygdala that were comparable in magnitude and timing to those in PFC, and both prefrontal and amygdala signals were generally much weaker than those in auditory cortex. These observations place useful quantitative constraints on putative generators of the auditory oddball-based MMN and additionally indicate that there are subcortical areas, such as the amygdala, that may be involved in novelty detection in an auditory oddball paradigm.

Semantic prediction-errors are context-dependent: An ERP study

The human brain is an efficient, adaptive, and predictive machine, constructing a generative model of the environment that we then perceive and become conscious of. Here, we show that different types of prediction-errors - the discrepancies between top-down expectations and bottom-up sensory input - are integrated across processing levels and sensory modalities of the cortical hierarchy. We designed a novel, hybrid protocol in which five prediction-establishing sounds were played in rapid succession (e.g., "meow", "meow", "meow", etc.), followed by either a standard (e.g., "meow") or a deviant (e.g., "woof") prime sound, then a visual target word that was either congruent or incongruent (e.g., "cat" or "dog") with the prime sound. We found that the deviants elicited a more negative voltage than the standards at about 150 ms - the mismatch negativity (MMN), an event-related potential (ERP) sensitive to low-level perceptual violations - and that the incongruent words elicited a more negative voltage than the congruent words at about 350 ms - the N400, an ERP sensitive to high-level semantic violations. We also found that the N400 was context-dependent: the N400 was larger when the target words were preceded by a standard than a deviant. Our results suggest that perceptual prediction-errors modulate subsequent semantic prediction-errors. We conclude that our results are consistent with one of the most important assumptions of predictive coding theories: hierarchical prediction-error processing.

A Novel, Fast, Reliable, and Data-Driven Method for Simultaneous Single-Trial Mining and Amplitude-Latency Estimation Based on Proximity Graphs and Network Analysis

Both amplitude and latency of single-trial EEG/MEG recordings provide valuable information regarding functionality of the human brain. In this article, we provided a data-driven graph and network-based framework for mining information from multi-trial event-related brain recordings. In the first part, we provide the general outline of the proposed methodological approach. In the second part, we provide a more detailed illustration, and present the obtained results on every step of the algorithmic procedure. To justify the proposed framework instead of presenting the analytic data mining and graph-based steps, we address the problem of response variability, a prerequisite to reliable estimates for both the amplitude and latency on specific N/P components linked to the nature of the stimuli. The major question addressed in this study is the selection of representative single-trials with the aim of uncovering a less noisey averaged waveform elicited from the stimuli. This graph and network-based algorithmic procedure increases the signal-to-noise (SNR) of the brain response, a key pre-processing step to reveal significant and reliable amplitude and latency at a specific time after the onset of the stimulus and with the right polarity (N or P). We demonstrated the whole approach using electroencephalography (EEG) auditory mismatch negativity (MMN) recordings from 42 young healthy controls. The method is novel, fast and data-driven succeeding first to reveal the true waveform elicited by MMN on different conditions (frequency, intensity, duration, etc.). The proposed graph-oriented algorithmic pipeline increased the SNR of the characteristic waveforms and the reliability of amplitude and latency within the adopted cohort. We also demonstrated how different EEG reference schemes (REST vs. average) can influence amplitude-latency estimation. Simulation results revealed robust amplitude-latency estimations under different SNR and amplitude-latency variations with the proposed algorithm.

Processing of auditory novelty across the cortical hierarchy: An intracranial electrophysiology study

Under the predictive coding hypothesis, specific spatiotemporal patterns of cortical activation are postulated to occur during sensory processing as expectations generate feedback predictions and prediction errors generate feedforward signals. Establishing experimental evidence for this information flow within cortical hierarchy has been difficult, especially in humans, due to spatial and temporal limitations of non-invasive measures of cortical activity. This study investigated cortical responses to auditory novelty using the local/global deviant paradigm, which engages the hierarchical network underlying auditory predictive coding over short ('local deviance'; LD) and long ('global deviance'; GD) time scales. Electrocorticographic responses to auditory stimuli were obtained in neurosurgical patients from regions of interest (ROIs) including auditory, auditory-related and prefrontal cortex. LD and GD effects were assayed in averaged evoked potential (AEP) and high gamma (70-150 Hz) signals, the former likely dominated by local synaptic currents and the latter largely reflecting local spiking activity. AEP LD effects were distributed across all ROIs, with greatest percentage of significant sites in core and non-core auditory cortex. High gamma LD effects were localized primarily to auditory cortex in the superior temporal plane and on the lateral surface of the superior temporal gyrus (STG). LD effects exhibited progressively longer latencies in core, non-core, auditory-related and prefrontal cortices, consistent with feedforward signaling. The spatial distribution of AEP GD effects overlapped that of LD effects, but high gamma GD effects were more restricted to non-core areas. High gamma GD effects had shortest latencies in STG and preceded AEP GD effects in most ROIs. This latency profile, along with the paucity of high gamma GD effects in the superior temporal plane, suggest that the STG plays a prominent role in initiating novelty detection signals over long time scales. Thus, the data demonstrate distinct patterns of information flow in human cortex associated with auditory novelty detection over multiple time scales.

Visual mismatch response and fMRI signal adaptation correlate in the occipital-temporal cortex

Several electrophysiological studies found response differences to a given stimulus when it is repeated frequently as compared to when it occurs rarely in oddball sequences. Initially defined in acoustic perception, such difference also exists in the visual modality and is referred to as visual mismatch negativity (vMMN). However, the repetition of a stimulus also leads to the reduction of the blood oxygen-level dependent (BOLD) signal (fMRI adaptation, fMRIa) when compared to alternating stimuli in fMRI experiments. So far no study compared the vMMN to fMRIa within the same paradigm and participants. Here we tested the possible connection between fMRIa and vMMN in a visual oddball paradigm in two separate sessions, acquiring electrophysiological and neuroimaging data for real and false characters from the same participants. We found significant visual mismatch response (vMM) as well as fMRIa for both character types. Importantly, the magnitude of the vMM over the CP1 electrode cluster showed a significant correlation with the fMRIa within the letter form area, for real characters. This finding suggests that similar neural mechanisms are responsible for the two phenomena.

Early enhanced processing and delayed habituation to deviance sounds in autism spectrum disorder

Children with autism spectrum disorder (ASD) exhibit difficulties processing and encoding sensory information in daily life. Cognitive response to environmental change in control individuals is naturally dynamic, meaning it habituates or reduces over time as one becomes accustomed to the deviance. The origin of atypical response to deviance in ASD may relate to differences in this dynamic habituation. The current study of 133 children and young adults with and without ASD examined classic electrophysiological responses (MMN and P3a), as well as temporal patterns of habituation (i.e., N1 and P3a change over time) in response to a passive auditory oddball task. Individuals with ASD showed an overall heightened sensitivity to change as exhibited by greater P3a amplitude to novel sounds. Moreover, youth with ASD showed dynamic ERP differences, including slower attenuation of the N1 response to infrequent tones and the P3a response to novel sounds. Dynamic ERP responses were related to parent ratings of auditory sensory-seeking behaviors, but not general cognition. As the first large-scale study to characterize temporal dynamics of auditory ERPs in ASD, our results provide compelling evidence that heightened response to auditory deviance in ASD is largely driven by early sensitivity and prolonged processing of auditory deviance.

Deep brain stimulation of the nucleus basalis of Meynert attenuates early EEG components associated with defective sensory gating in patients with Alzheimer disease - a two-case study

Alzheimer's disease (AD) is associated with deterioration of memory and cognitive function and a degeneration of neurons of the nucleus basalis of Meynert (NBM). The NBM is the major input source of acetylcholine (ACh) to the cortex. The decreasing cholinergic innervation of the cortex due to degeneration of the NBM might be the cause of loss of memory function. NBM-Deep brain stimulation (NBM-DBS) is considered to serve as a potential therapeutic option for patients with AD by supporting residual cholinergic transmission to stabilize oscillatory activity in memory-relevant circuits. However, whether DBS could improve sensory memory functions in patients with AD is not clear. Here, in a passive auditory oddball paradigm, patients with AD (N = 2) listened to repetitive background tones (standard tones) randomly interrupted by frequency deviants in two blocks with NBM-DBS OFF and then NBM-DBS ON, while age-matched healthy controls (N = 6) repeated the experiment twice. The mismatch negativity in NBM-DBS OFF significantly differed from controls in both blocks, but not under NBM-DBS, which was likely due to a pronounced P50 increase overlapping with the N1 in NBM-DBS OFF. This early complex of EEG components recovered under stimulation to a normal level as defined by responses in controls. In this temporal interval, we found in patients with NBM-DBS ON (but not with NBM-DBS OFF) and in controls a strong repetition suppression effect to standard tones - with more attenuated responses to frequently repeated standard tones. This highlights the role of NBM-DBS for sensory gating of familiar auditory information into sensory memory.