Left hemispheric dipole locations of the neuromagnetic mismatch negativity to frequency, intensity and duration deviants

Auditory prediction errors in sound frequency and duration generated different cortical activation patterns in the human brain: an ECoG study

Sound frequency and duration are essential auditory components. The brain perceives deviations from the preceding sound context as prediction errors, allowing efficient reactions to the environment. Additionally, prediction error response to duration change is reduced in the initial stages of psychotic disorders. To compare the spatiotemporal profiles of responses to prediction errors, we conducted a human electrocorticography study with special attention to high gamma power in 13 participants who completed both frequency and duration oddball tasks. Remarkable activation in the bilateral superior temporal gyri in both the frequency and duration oddball tasks were observed, suggesting their association with prediction errors. However, the response to deviant stimuli in duration oddball task exhibited a second peak, which resulted in a bimodal response. Furthermore, deviant stimuli in frequency oddball task elicited a significant response in the inferior frontal gyrus that was not observed in duration oddball task. These spatiotemporal differences within the Parasylvian cortical network could account for our efficient reactions to changes in sound properties. The findings of this study may contribute to unveiling auditory processing and elucidating the pathophysiology of psychiatric disorders.

Musicians show more integrated neural processing of contextually relevant acoustic features

Little is known about expertise-related plasticity of neural mechanisms for auditory feature integration. Here, we contrast two diverging hypotheses that musical expertise is associated with more independent or more integrated predictive processing of acoustic features relevant to melody perception. Mismatch negativity (MMNm) was recorded with magnetoencephalography (MEG) from 25 musicians and 25 non-musicians, exposed to interleaved blocks of a complex, melody-like multi-feature paradigm and a simple, oddball control paradigm. In addition to single deviants differing in frequency (F), intensity (I), or perceived location (L), double and triple deviants were included reflecting all possible feature combinations (FI, IL, LF, FIL). Following previous work, early neural processing overlap was approximated in terms of MMNm additivity by comparing empirical MMNms obtained with double and triple deviants to modeled MMNms corresponding to summed constituent single-deviant MMNms. Significantly greater subadditivity was found in musicians compared to non-musicians, specifically for frequency-related deviants in complex, melody-like stimuli. Despite using identical sounds, expertise effects were absent from the simple oddball paradigm. This novel finding supports the integrated processing hypothesis whereby musicians recruit overlapping neural resources facilitating more integrative representations of contextually relevant stimuli such as frequency (perceived as pitch) during melody perception. More generally, these specialized refinements in predictive processing may enable experts to optimally capitalize upon complex, domain-relevant, acoustic cues.

Mismatch negativity in patients with major depressive disorder: A meta-analysis

OBJECTIVE

Deficits of mismatch negativity (MMN), a general index of echoic memory function, have been documented in patients with schizophrenia. However, it remains controversial whether patients with major depressive disorder (MDD) demonstrate MMN defects compared with healthy controls (HC).

METHODS

After screening 41 potential studies identified in PubMed and Medline, 13 studies consisting of 343 HC and 339 patients with MDD were included in the present meta-analysis. The effect sizes (Hedges's g) with a random-effect and inverse-variance weighted model were estimated for the MMN amplitudes and latencies. The effects of different deviant types (i.e., frequency and duration) and of different illness stages (i.e., acute and chronic) on MMN were also examined.

RESULTS

We found that 1) MMN amplitudes (g = 1.273, p < 0.001) and latencies (g = 0.303, p = 0.027) to duration, but not frequency deviants, were significantly impaired in patients with MDD compared to HC; 2), acute patients exhibited lower MMN amplitudes (g = 1.735, p < 0.001) and prolonged MMN latencies (g = 0.461, p = 0.007) for the duration deviants compared to HC. Only the attenuated duration MMN amplitudes were detected in patients with chronic MDD (g = 0.822, p = 0.027); and 3) depressive symptoms did not significantly correlate with MMN responses.

CONCLUSIONS

Patients with MDD demonstrated abnormal MMN responses to duration deviants compared to HC.

SIGNIFICANCE

Duration MMN may constitute an electrophysiological indicator to differentiate HC from patients with MDD, particularly those in the acute stage.

Classification of First-Episode Schizophrenia, Chronic Schizophrenia and Healthy Control Based on Brain Network of Mismatch Negativity by Graph Neural Network

Mismatch negativity (MMN) has been consistently found deficit in schizophrenia, which was considered as a promising biomarker for assessing the impairments in pre-attentive auditory processing. However, the functional connectivity between brain regions based on MMN is not clear. This study provides an in-depth investigation in brain functional connectivity during MMN process among patients with first-episode schizophrenia (FESZ), chronic schizophrenia (CSZ) and healthy control (HC). Electroencephalography (EEG) data of 128 channels is recorded during frequency and duration MMN in 40 FESZ, 40 CSZ patients and 40 matched HC subjects. We reconstruct the cortical endogenous electrical activity from EEG recordings using exact low-resolution electromagnetic tomography and build functional brain networks based on source-level EEG data. Then, graph-theoretic features are extracted from the brain networks with the support vector machine (SVM) to classify FESZ, CSZ and HC groups, since the SVM has good generalization ability and robustness as a universally applicable nonlinear classifier. Furthermore, we introduce the graph neural network (GNN) model to directly learn for the network topology of brain network. Compared to HC, the damaged brain areas of CSZ are more extensive than FESZ, and the damaged area involved the auditory cortex. These results demonstrate the heterogeneity of the impacts of schizophrenia for different disease courses and the association between MMN and the auditory cortex. More importantly, the GNN classification results are significantly better than those of SVM, and hence the EEG-based GNN model of brain networks provides an effective method for discriminating among FESZ, CSZ and HC groups.

A Critical Review of the Deviance Detection Theory of Mismatch Negativity

Mismatch negativity (MMN) is a component of the difference waveform derived from passive auditory oddball stimulation. Since its inception in 1978, this has become one of the most popular event-related potential techniques, with over two-thousand published studies using this method. This is a testament to the ingenuity and commitment of generations of researchers engaging in basic, clinical and animal research. Despite this intensive effort, high-level descriptions of the mechanisms theorized to underpin mismatch negativity have scarcely changed over the past four decades. The prevailing deviance detection theory posits that MMN reflects inattentive detection of difference between repetitive standard and infrequent deviant stimuli due to a mismatch between the unexpected deviant and a memory representation of the standard. Evidence for these mechanisms is inconclusive, and a plausible alternative sensory processing theory considers fundamental principles of sensory neurophysiology to be the primary source of differences between standard and deviant responses evoked during passive oddball stimulation. By frequently being restated without appropriate methods to exclude alternatives, the potentially flawed deviance detection theory has remained largely dominant, which could lead some researchers and clinicians to assume its veracity implicitly. It is important to have a more comprehensive understanding of the source(s) of MMN generation before its widespread application as a clinical biomarker. This review evaluates issues of validity concerning the prevailing theoretical account of mismatch negativity and the passive auditory oddball paradigm, highlighting several limitations regarding its interpretation and clinical application.

Evaluation of multi-feature auditory deviance detection in Parkinson's disease: a mismatch negativity study

Behavioral studies on auditory deviance detection in patients with Parkinson's disease (PD) have reported contradictory results. The primary aim of this study was to investigate auditory deviance detection of multiple auditory features in patients with PD by means of objective and reliable electroencephalographic (EEG) measurements. Twelve patients with early-stage PD and twelve age- and gender-matched healthy controls (HCs) were included in this study. Patients with PD participated without their regular dopaminergic medication. All subjects underwent an audiometric screening and performed a passive multi-feature mismatch negativity (MMN) paradigm. Repeated-measures analysis of variance (ANOVA) demonstrated no significant differences between patients with PD and HCs regarding MMN mean amplitude and latency for frequency, duration and gap deviants. Nevertheless, a trend towards increased MMN mean amplitude and latency was found in response to intensity deviants in patients with PD compared to HCs. Increased intensity MMN amplitude may indicate that more neural resources are allocated to the processing of intensity deviances in patients with PD compared to HCs. The interpretation of this intensity-specific MMN alteration is further discussed in the context of a compensatory mechanism for auditory intensity processing and involuntary attention switching in PD.

Pitch and Duration Mismatch Negativity are Associated With Distinct Auditory Cortex and Inferior Frontal Cortex Volumes in the First-Episode Schizophrenia Spectrum

Background

Pitch and duration mismatch negativity (pMMN/dMMN) are related to left Heschl's gyrus gray matter volumes in first-episode schizophrenia (FESz). Previous methods were unable to delineate functional subregions within and outside Heschl's gyrus. The Human Connectome Project multimodal parcellation (HCP-MMP) atlas overcomes this limitation by parcellating these functional subregions. Further, MMN has generators in inferior frontal cortex, and therefore, may be associated with inferior frontal cortex pathology. With the novel use of the HCP-MMP to precisely parcellate auditory and inferior frontal cortex, we investigated relationships between gray matter and pMMN and dMMN in FESz.

Methods

pMMN and dMMN were measured at Fz from 27 FESz and 27 matched healthy controls. T1-weighted MRI scans were acquired. The HCP-MMP atlas was applied to individuals, and gray matter volumes were calculated for bilateral auditory and inferior frontal cortex parcels and correlated with MMN. FDR correction was used for multiple comparisons.

Results

In FESz only, pMMN was negatively correlated with left medial belt in auditory cortex and area 47L in inferior frontal cortex. Duration MMN negatively correlated with the following auditory parcels: left medial belt, lateral belt, parabelt, TA2, and right A5. Further, dMMN was associated with left area 47L, right area 44, and right area 47L in inferior frontal cortex.

Conclusions

The novel approach revealed overlapping and distinct gray matter associations for pMMN and dMMN in auditory and inferior frontal cortex in FESz. Thus, pMMN and dMMN may serve as biomarkers of underlying pathological deficits in both similar and slightly different cortical areas.

The Rapid Emergence of Auditory Object Representations in Cortex Reflect Central Acoustic Attributes

Human listeners are bombarded by acoustic information that the brain rapidly organizes into coherent percepts of objects and events in the environment, which aids speech and music perception. The efficiency of auditory object recognition belies the critical constraint that acoustic stimuli necessarily require time to unfold. Using magnetoencephalography, we studied the time course of the neural processes that transform dynamic acoustic information into auditory object representations. Participants listened to a diverse set of 36 tokens comprising everyday sounds from a typical human environment. Multivariate pattern analysis was used to decode the sound tokens from the magnetoencephalographic recordings. We show that sound tokens can be decoded from brain activity beginning 90 msec after stimulus onset with peak decoding performance occurring at 155 msec poststimulus onset. Decoding performance was primarily driven by differences between category representations (e.g., environmental vs. instrument sounds), although within-category decoding was better than chance. Representational similarity analysis revealed that these emerging neural representations were related to harmonic and spectrotemporal differences among the stimuli, which correspond to canonical acoustic features processed by the auditory pathway. Our findings begin to link the processing of physical sound properties with the perception of auditory objects and events in cortex.

Cortical Areas Associated With Mismatch Negativity: A Connectivity Study Using Propofol Anesthesia

Auditory mismatch negativity (MMN) is an event-related potential (ERP) waveform induced by rare deviant stimuli that occur in a stream of regular auditory stimuli. The generators of MMN are believed to include several different cortical regions like the bilateral temporal and the right inferior frontal gyrus (IFG). However, exact cortical regions associated with MMN remain controversial. In this study, we compared the number of long-distance connections induced by the standard and deviant stimuli during awake state and propofol anesthesia state to identify the cortical areas associated with the generation of MMN. In awake state, we find that deviant stimuli synchronize more information between the right frontal and temporal than standard stimuli. Moreover, we find that the deviant stimuli in awake state activate the bilateral frontal, central areas, the left temporal and parietal areas as compared to the anesthesia state, whereas the standard stimuli do not. These results suggest that, in addition to the bilateral temporal and the right IFG, the bilateral frontal and centro-parietal regions also contribute to the generation of MMN.

Brain responses to sound intensity changes dissociate depressed participants and healthy controls

Depression is associated with bias in emotional information processing, but less is known about the processing of neutral sensory stimuli. Of particular interest is processing of sound intensity which is suggested to indicate central serotonergic function. We tested weather event-related brain potentials (ERPs) to occasional changes in sound intensity can dissociate first-episode depressed, recurrent depressed and healthy control participants. The first-episode depressed showed larger N1 amplitude to deviant sounds compared to recurrent depression group and control participants. In addition, both depression groups, but not the control group, showed larger N1 amplitude to deviant than standard sounds. Whether these manifestations of sensory over-excitability in depression are directly related to the serotonergic neurotransmission requires further research. The method based on ERPs to sound intensity change is fast and low-cost way to objectively measure brain activation and holds promise as a future diagnostic tool.

Does emotion change auditory prediction and deviance detection?

In the last decades, a growing number of studies provided compelling evidence supporting the interplay of cognitive and affective processes. However, it remains to be clarified whether and how an emotional context affects the prediction and detection of change in unattended sensory events. In an event-related potential (ERP) study, we probed the modulatory role of pleasant, unpleasant and neutral visual contexts on the brain response to automatic detection of change in spectral (intensity) vs. temporal (duration) sound features. Twenty participants performed a passive auditory oddball task. Additionally, we tested the relationship between ERPs and self-reported mood. Participants reported more negative mood after the negative block. The P2 amplitude elicited by standards was increased in a positive context. Mismatch Negativity (MMN) amplitude was decreased in the negative relative to the neutral and positive contexts, and was associated with self-reported mood. These findings suggest that the detection of regularities in the auditory stream was facilitated in a positive context, whereas a negative visual context interfered with prediction error elicitation, through associated mood changes. Both ERP and behavioral effects highlight the intricate links between emotion, perception and cognitive processes.

Snap Your Fingers! An ERP/sLORETA Study Investigating Implicit Processing of Self- vs. Other-Related Movement Sounds Using the Passive Oddball Paradigm

So far, neurophysiological studies have investigated implicit and explicit self-related processing particularly for self-related stimuli such as the own face or name. The present study extends previous research to the implicit processing of self-related movement sounds and explores their spatio-temporal dynamics. Event-related potentials (ERPs) were assessed while participants (N = 12 healthy subjects) listened passively to previously recorded self- and other-related finger snapping sounds, presented either as deviants or standards during an oddball paradigm. Passive listening to low (500 Hz) and high (1000 Hz) pure tones served as additional control. For self- vs. other-related finger snapping sounds, analysis of ERPs revealed significant differences in the time windows of the N2a/MMN and P3. An subsequent source localization analysis with standardized low-resolution brain electromagnetic tomography (sLORETA) revealed increased cortical activation in distinct motor areas such as the supplementary motor area (SMA) in the N2a/mismatch negativity (MMN) as well as the P3 time window during processing of self- and other-related finger snapping sounds. In contrast, brain regions associated with self-related processing [e.g., right anterior/posterior cingulate cortex (ACC/PPC)] as well as the right inferior parietal lobule (IPL) showed increased activation particularly during processing of self- vs. other-related finger snapping sounds in the time windows of the N2a/MMN (ACC/PCC) or the P3 (IPL). None of these brain regions showed enhanced activation while listening passively to low (500 Hz) and high (1000 Hz) pure tones. Taken together, the current results indicate (1) a specific role of motor regions such as SMA during auditory processing of movement-related information, regardless of whether this information is self- or other-related, (2) activation of neural sources such as the ACC/PCC and the IPL during implicit processing of self-related movement stimuli, and (3) their differential temporal activation during deviance (N2a/MMN - ACC/PCC) and target detection (P3 - IPL) of self- vs. other-related movement sounds.

Perceptual Correlates of Turkish Word Stress and Their Contribution to Automatic Lexical Access: Evidence from Early ERP Components

Perceptual correlates of Turkish word stress and their contribution to lexical access were studied using the mismatch negativity (MMN) component in event-related potentials (ERPs). The MMN was expected to indicate if segmentally identical Turkish words were distinguished on the sole basis of prosodic features such as fundamental frequency (f₀), spectral emphasis (SE), and duration. The salience of these features in lexical access was expected to be reflected in the amplitude of MMN responses. In a multi-deviant oddball paradigm, neural responses to changes in f₀, SE, and duration individually, as well as to all three features combined, were recorded for words and pseudowords presented to 14 native speakers of Turkish. The word and pseudoword contrast was used to differentiate language-related effects from acoustic-change effects on the neural responses. First and in line with previous findings, the overall MMN was maximal over frontal and central scalp locations. Second, changes in prosodic features elicited neural responses both in words and pseudowords, confirming the brain's automatic response to any change in auditory input. However, there were processing differences between the prosodic features, most significantly in f₀: While f₀ manipulation elicited a slightly right-lateralized frontally-maximal MMN in words, it elicited a frontal P3a in pseudowords. Considering that P3a is associated with involuntary allocation of attention to salient changes, the manipulations of f₀ in the absence of lexical processing lead to an intentional evaluation of pitch change. f₀ is therefore claimed to be lexically specified in Turkish. Rather than combined features, individual prosodic features differentiate language-related effects from acoustic-change effects. The present study confirms that segmentally identical words can be distinguished on the basis of prosodic information alone, and establishes the salience of f₀ in lexical access.

Mismatch negativity latency and cognitive function in schizophrenia

Background

The Mismatch Negativity (MMN) is an event-related potential (ERP) sensitive to early auditory deviance detection and has been shown to be reduced in schizophrenia patients. Moreover, MMN amplitude reduction to duration deviant tones was found to be related to functional outcomes particularly, to neuropsychological (working memory and verbal domains) and psychosocial measures. While MMN amplitude is thought to be correlated with deficits of early sensory processing, the functional significance of MMN latency remains unclear so far. The present study focused on the investigation of MMN in relation to neuropsychological function in schizophrenia.

Method

Forty schizophrenia patients and 16 healthy controls underwent a passive oddball paradigm (2400 binaural tones; 88% standards [1 kHz, 80 db, 80 ms], 11% frequency deviants [1.2 kHz], 11% duration deviants [40 ms]) and a neuropsychological test-battery. Patients were assessed with regard to clinical symptoms.

Results

Compared to healthy controls schizophrenia patients showed diminished MMN amplitude and shorter MMN latency to both deviants as well as an impaired neuropsychological test performance. Severity of positive symptoms was related to decreased MMN amplitude to duration deviants. Furthermore, enhanced verbal memory performance was associated with prolonged MMN latency to frequency deviants in patients.

Conclusion

The present study corroborates previous results of a diminished MMN amplitude and its association with positive symptoms in schizophrenia patients. Both, the findings of a shorter latency to duration and frequency deviants and the relationship of the latter with verbal memory in patients, emphasize the relevance of the temporal aspect of early auditory discrimination processing in schizophrenia.

Event-related potentials to tones show differences between children with multiple risk factors for dyslexia and control children before the onset of formal reading instruction

Multiple risk factors can affect the development of specific reading problems or dyslexia. In addition to the most prevalent and studied risk factor, phonological processing, auditory discrimination problems have also been found in children and adults with reading difficulties. The present study examined 37 children between the ages of 5 and 6, 11 of which had multiple risk factors for developing reading problems. The children participated in a passive oddball EEG experiment with sinusoidal sounds with changes in sound frequency, duration, or intensity. The responses to the standard stimuli showed a negative voltage shift in children at risk for reading problems compared to control children at 107-215 ms in frontocentral areas corresponding to P1 offset and N250 onset. Source analyses showed that the difference originated from the left and right auditory cortices. Additionally, the children at risk for reading problems had a larger late discriminative negativity (LDN) response in amplitude for sound frequency change than the control children. The amplitudes at the P1-N250 time window showed correlations to letter knowledge and phonological identification whereas the amplitudes at the LDN time window correlated with verbal short-term memory and rapid naming. These results support the view that problems in basic auditory processing abilities precede the onset of reading instruction and can act as one of the risk factors for dyslexia.

Changes in the duration and frequency of deviant stimuli engender different mismatch negativity patterns in temporal lobe epilepsy

Mismatch negativity (MMN) is an event-related potential (ERP) component that reflects preattentive sensory memory functions. Previous research revealed that MMN is generated by distinct sources in the frontal and temporal lobes. Event-related potential abnormalities have been shown in the vicinity of seizure foci in epilepsy. Additionally, no published study has investigated the MMN in response to variations in both frequency and duration deviants in patients with temporal lobe epilepsy (TLE). The aims of this study were to compare MMN changes between the frontocentral sites and the mastoid sites and to compare MMNs related to deviant stimuli with different durations and frequencies in patients with TLE. We recorded MMNs elicited by duration and frequency changes of deviant stimuli from 15 patients with TLE and 15 healthy control subjects. We found that mean MMN amplitudes related to duration deviants were lower in patients with TLE at the mastoid sites relative to controls, whereas the MMN amplitudes at the frontocentral sites did not differ between the two groups. There were no MMN differences related to frequency deviants between TLE subjects and controls at the frontocentral sites or the mastoid sites. Mismatch negativity parameters related to duration deviants did not correlate with those related to deviant frequencies in the group with TLE. The present findings suggest selective impairments among multiple mismatch generators in TLE and suggest that processing of temporal information of auditory stimuli is selectively disturbed in TLE. Changes in MMN amplitudes related to duration deviants at the mastoid sites may represent deficits in time-dependent processing in TLE.

Cortical mapping of mismatch negativity with deviance detection property in rat

Mismatch Negativity (MMN) is an N-methyl-d-aspartic acid (NMDA)-mediated, negative deflection in human auditory evoked potentials in response to a cognitively discriminable change. MMN-like responses have been extensively investigated in animal models, but the existence of MMN equivalent is still controversial. In this study, we aimed to investigate how closely the putative MMN (MMNp) in rats exhibited the comparable properties of human MMN. We used a surface microelectrode array with a grid of 10×7 recording sites within an area of 4.5×3.0 mm to densely map evoked potentials in the auditory cortex of anesthetized rats under the oddball paradigm. Firstly, like human MMN, deviant stimuli elicited negative deflections in auditory evoked potentials following the positive middle-latency response, termed P1. Secondly, MMNp exhibited deviance-detecting property, which could not be explained by simple stimulus specific adaptation (SSA). Thirdly, this MMNp occurred focally in the auditory cortex, including both the core and belt regions, while P1 activation focus was obtained in the core region, indicating that both P1 and MMNp are generated in the auditory cortex, yet the sources of these signals do not completely overlap. Fourthly, MMNp significantly decreased after the application of AP5 (D-(-)-2-amino-5-phosphonopentanoic acid), an antagonist at NMDA receptors. In stark contrast, AP5 affected neither P1 amplitude nor SSA of P1. These results provide compelling evidence that the MMNp we have examined in rats is functionally comparable to human MMN. The present work will stimulate translational research into MMN, which may help bridge the gap between electroencephalography (EEG)/magnetoencephalography (MEG) studies in humans and electrophysiological studies in animals.

Object-related regularities are processed automatically: evidence from the visual mismatch negativity

One of the most challenging tasks of our visual systems is to structure and integrate the enormous amount of incoming information into distinct coherent objects. It is an ongoing debate whether or not the formation of visual objects requires attention. Implicit behavioral measures suggest that object formation can occur for task-irrelevant and unattended visual stimuli. The present study investigated pre-attentive visual object formation by combining implicit behavioral measures and an electrophysiological indicator of pre-attentive visual irregularity detection, the visual mismatch negativity (vMMN) of the event-related potential. Our displays consisted of two symmetrically arranged, task-irrelevant ellipses, the objects. In addition, there were two discs of either high or low luminance presented on the objects, which served as targets. Participants had to indicate whether the targets were of the same or different luminance. In separate conditions, the targets either usually were enclosed in the same object or in two different objects (standards). Occasionally, the regular target-to-object assignment was changed (deviants). That is, standards and deviants were exclusively defined on the basis of the task-irrelevant target-to-object assignment but not on the basis of some feature regularity. Although participants did not notice the regularity nor the occurrence of the deviation in the sequences, task-irrelevant deviations resulted in increased reaction times. Moreover, compared with physically identical standard displays deviating target-to-object assignments elicited a negative potential in the 246–280 ms time window over posterio-temporal electrode positions which was identified as vMMN. With variable resolution electromagnetic tomography (VARETA) object-related vMMN was localized to the inferior temporal gyrus. Our results support the notion that the visual system automatically structures even task-irrelevant aspects of the incoming information into objects.

The mismatch negativity (MMN)--a unique window to disturbed central auditory processing in ageing and different clinical conditions

In this article, we review clinical research using the mismatch negativity (MMN), a change-detection response of the brain elicited even in the absence of attention or behavioural task. In these studies, the MMN was usually elicited by employing occasional frequency, duration or speech-sound changes in repetitive background stimulation while the patient was reading or watching videos. It was found that in a large number of different neuropsychiatric, neurological and neurodevelopmental disorders, as well as in normal ageing, the MMN amplitude was attenuated and peak latency prolonged. Besides indexing decreased discrimination accuracy, these effects may also reflect, depending on the specific stimulus paradigm used, decreased sensory-memory duration, abnormal perception or attention control or, most importantly, cognitive decline. In fact, MMN deficiency appears to index cognitive decline irrespective of the specific symptomatologies and aetiologies of the different disorders involved.

A roadmap for the development and validation of event-related potential biomarkers in schizophrenia research

New efforts to develop treatments for cognitive dysfunction in mental illnesses would benefit enormously from biomarkers that provide sensitive and reliable measures of the neural events underlying cognition. Here, we evaluate the promise of event-related potentials (ERPs) as biomarkers of cognitive dysfunction in schizophrenia. We conclude that ERPs have several desirable properties: (1) they provide a direct measure of electrical activity during neurotransmission; (2) their high temporal resolutions make it possible to measure neural synchrony and oscillations; (3) they are relatively inexpensive and convenient to record; (4) animal models are readily available for several ERP components; (5) decades of research has established the sensitivity and reliability of ERP measures in psychiatric illnesses; and 6) feasibility of large N (>500) multisite studies has been demonstrated for key measures. Consequently, ERPs may be useful for identifying endophenotypes and defining treatment targets, for evaluating new compounds in animals and in humans, and for identifying individuals who are good candidates for early interventions or for specific treatments. However, several challenges must be overcome before ERPs gain widespread use as biomarkers in schizophrenia research, and we make several recommendations for the research that is necessary to develop and validate ERP-based biomarkers that can have a real impact on treatment development.

Enhancing a tone by shifting its frequency or intensity

When a test sound consisting of pure tones with equal intensities is preceded by a precursor sound identical to the test sound except for a reduction in the intensity of one tone, an auditory "enhancement" phenomenon occurs: In the test sound, the tone which was previously softer stands out perceptually. Here, enhancement was investigated using inharmonic sounds made up of five pure tones well resolved in the auditory periphery. It was found that enhancement can be elicited not only by increases in intensity but also by shifts in frequency. In both cases, when the precursor and test sounds are separated by a 500-ms delay, inserting a burst of pink noise during the delay has little effect on enhancement. Presenting the precursor and test sounds to opposite ears rather than to the same ear significantly reduces the enhancement resulting from increases in intensity, but not the enhancement resulting from shifts in frequency. This difference suggests that the mechanisms of enhancement are not identical for the two types of change. For frequency shifts, enhancement may be partly based on the existence of automatic "frequency-shift detectors" [Demany and Ramos, J. Acoust. Soc. Am. 117, 833-841 (2005)].

Change detection in newborns using a multiple deviant paradigm: a study using magnetoencephalography

OBJECTIVE

Mismatch responses are elicited to changes in sound streams in healthy newborns. In the ideal case, these responses can predict cognitive problems later in life. We employed a multiple deviant paradigm for a fast assessment of the ability of the newborn brain to respond to various types of acoustic changes.

METHODS

In 12 healthy newborns, we recorded an electroencephalogram (EEG) and magnetoencephalogram while presenting auditory stimuli. Between repeated stimuli, four types of acoustic changes (frequency, intensity, duration, and a gap) were presented, varying in deviance magnitude.

RESULTS

One major response was present in the neonatal evoked potentials and fields at 250-260 ms. Magnetic mismatch responses were elicited to all change types except for the duration deviant and they were positive in polarity. The frequency deviant elicited more positive EEG amplitudes than the standard, whereas the response to the duration deviant was more negative.

CONCLUSIONS

These results show that newborns can detect changes to at least four types of deviances within a sound stream. Furthermore, the use of magneto- and electroencephalography is complementary in newborns, since the methods may reveal different outcomes.

SIGNIFICANCE

Further studies are warranted to determine whether the present study design can play a role in testing auditory function in clinical infant populations.

Detecting violations of sensory expectancies following cerebellar degeneration: a mismatch negativity study

Two hypotheses concerning cerebellar function and predictive behavior are the sensory prediction hypothesis and the timing hypothesis. The former postulates that the cerebellum is critical in generating expectancies regarding forthcoming sensory information. The latter postulates that this structure is critical in generating expectancies that are precisely timed; for example, the expected duration of an event or the time between events. As such, the timing hypothesis constitutes a more specific form of prediction. The present experiment contrasted these two hypotheses by examining the mismatch negativity (MMN) response in patients with cerebellar cortical atrophy and matched controls. While watching a silent movie, a stream of task-irrelevant sounds was presented. A standard sound was presented 60% of the time, whereas the remaining sounds deviated from the standard on one of four dimensions: duration, intensity, pitch, or location. The timing between stimuli was either periodic or aperiodic. Based on the sensory prediction hypothesis, the MMN for the patients should be abnormal across all four dimensions. In contrast, the timing hypothesis would predict a selective impairment of the duration MMN. Moreover, the timing hypothesis would also predict that the enhancement of the MMN observed in controls when the stimuli are presented periodically should be attenuated in the patients. Compared to controls, the patients exhibited a delayed latency in the MMN to duration deviants and a similar trend for the intensity deviants, while pitch and location MMNs did not differ between groups. Periodicity had limited and somewhat inconsistent effects. The present results are at odds with a general role for the cerebellum in sensory prediction and provide partial support for the timing hypothesis.

Cerebral responses to change in spatial location of unattended sounds

The neural basis of spatial processing in the auditory cortex has been controversial. Human fMRI studies suggest that a part of the planum temporale (PT) is involved in auditory spatial processing, but it was recently argued that this region is active only when the task requires voluntary spatial localization. If this is the case, then this region cannot harbor an ongoing spatial representation of the acoustic environment. In contrast, we show in three fMRI experiments that a region in the human medial PT is sensitive to background auditory spatial changes, even when subjects are not engaged in a spatial localization task, and in fact attend the visual modality. During such times, this area responded to rare location shifts, and even more so when spatial variation increased, consistent with spatially selective adaptation. Thus, acoustic space is represented in the human PT even when sound processing is not required by the ongoing task.

The mismatch negativity (MMN) in basic research of central auditory processing: a review

In the present article, the basic research using the mismatch negativity (MMN) and analogous results obtained by using the magnetoencephalography (MEG) and other brain-imaging technologies is reviewed. This response is elicited by any discriminable change in auditory stimulation but recent studies extended the notion of the MMN even to higher-order cognitive processes such as those involving grammar and semantic meaning. Moreover, MMN data also show the presence of automatic intelligent processes such as stimulus anticipation at the level of auditory cortex. In addition, the MMN enables one to establish the brain processes underlying the initiation of attention switch to, conscious perception of, sound change in an unattended stimulus stream.

Representation of harmonic frequencies in auditory memory: A mismatch negativity study

Most natural sounds are composed of a mixture of frequencies, which activate separate neurons in the tonotopic auditory cortex. Nevertheless, we perceive this mixture as an integrated sound with unique acoustic properties. We used the Mismatch Negativity (MMN), a marker of auditory change detection, to determine whether individual harmonics are represented in sensory memory. The MMN elicited by duration and pitch deviations were compared for harmonic and pure tones. Controlled for acoustic differences between standards and deviants and their relative probabilities, the MMN was larger for harmonic than pure tones for duration but not for pitch deviance. Because the magnitude of the MMN reflects the number of concurrent changes in the acoustic input relative to a preexistent acoustic representation, these results suggest that duration is represented and compared separately for individual frequencies, whereas pitch comparison occurs after integration.

Mismatch responses to pitch changes in early infancy

We investigated the emergence of discriminative responses to pitch by recording 2-, 3-, and 4-month-old infants' electro-encephalogram responses to infrequent pitch changes in piano tones. In all age groups, infants' responses to deviant tones were significantly different from responses to standard tones. However, two types of mismatch responses were observed simultaneously in the difference waves. An increase in the left-lateralized positive slow wave was prominent in 2-month-olds, present in 3-month-olds, but insignificant in 4-month-olds. A faster adultlike mismatch negativity (MMN), lateralized to the right hemisphere, emerged at 2 months of age and became earlier and stronger as age increased. The coexistence and dissociation of two types of mismatch responses suggests different underlying neuromechanisms for the two responses. Furthermore, the earlier emergence of the MMN-like component to changes in pitch compared to other sound features implies that neural circuits involved in generating MMN-like responses have different maturational timetables for different sound features.

Neural responses to auditory stimulus deviance under threat of electric shock revealed by spatially-filtered magnetoencephalography

Stimulus novelty or deviance may be especially salient in anxiety-related states due to sensitization to environmental change, a key symptom of anxiety disorders such as posttraumatic stress disorder (PTSD). We aimed to identify human brain regions that show potentiated responses to stimulus deviance during anticipatory anxiety. Twenty participants (14 men) were presented a passive oddball auditory task in which they were exposed to uniform auditory stimulation of tones with occasional deviations in tone frequency, a procedure that elicits the mismatch negativity (MMN) and its magnetic counterpart (MMNm). These stimuli were presented during threat periods when participants anticipated unpleasant electric shocks, and safe periods when no shocks were anticipated. Neuromagnetic data were collected with a 275-channel whole-head MEG system and event-related beamformer analyses were conducted to estimate source power across the brain in response to stimulus deviance. Source analyses revealed greater right auditory and inferior parietal activity to stimulus deviance under threat relative to safe conditions, consistent with locations of MMN and MMNm sources identified in other studies. Structures related to evaluation of threat, left amygdala and right insula, also showed increased activity to stimulus deviance under threat. As anxiety level increased across participants, right and left auditory cortical as well as right amygdala activity increased to stimulus deviance. These findings fit with evidence of a potentiated MMN in PTSD relative to healthy controls, and warrant closer evaluation of how these structures might form a functional network mediating sensitization to stimulus deviance during anticipatory anxiety.

Distributed cortical networks for focused auditory attention and distraction

We used behavioral measures and functional magnetic resonance imaging (fMRI) to study the effects of parametrically varied task-irrelevant pitch changes in attended sounds on loudness-discrimination performance and brain activity in cortical surface maps. Ten subjects discriminated tone loudness in sequences that also included infrequent task-irrelevant pitch changes. Consistent with results of previous studies, the task-irrelevant pitch changes impaired performance in the loudness discrimination task. Auditory stimulation, attention-enhanced processing of sounds and motor responding during the loudness discrimination task activated supratemporal (auditory cortex) and inferior parietal areas bilaterally and left-hemisphere (contralateral to the hand used for responding) motor areas. Large pitch changes were associated with right hemisphere supratemporal activations as well as widespread bilateral activations in the frontal lobe and along the intraparietal sulcus. Loudness discrimination and distracting pitch changes activated common areas in the right supratemporal gyrus, left medial frontal cortex, left precentral gyrus, and left inferior parietal cortex.

The Frontal Generator of the Mismatch Negativity Revisited

The mismatch negativity (MMN) is an event-related brain potential elicited by the occurrence of a rare event (deviance) in an otherwise regular acoustic environment, and is assumed to reflect a preattentive mechanism for change detection. A widely adopted model holds that MMN has main generators in the superior temporal planes bilaterally, which are responsible for the sensory memory part of change detection, as well as frontal lobe sources responsible for triggering an attention shift upon change detection. Whereas the temporal sources have been documented in numerous studies across species and methodologies, much less is known about the frontal sources. The present review examines the current state of the evidence for their existence, location, and possible function. It confirms that the frontal generator is still a less consistent finding in MMN research than the temporal generator. There is clear evidence from scalp EEG and, especially, current source density studies for the existence of an MMN generator that is functionally distinct from the main supratemporal generator of the MMN. Evidence from fMRI, PET, optical imaging, EEG source imaging, and lesion studies implicates mainly the inferior frontal and possibly also the medial frontal cortex. However, these results should be taken with caution because of the paucity of support from more direct measures like intracranial recordings and MEG, and the negative findings from several fMRI and PET, as well as EEG source imaging studies. Recent studies also raise questions about the exact role of the frontal generator in triggering an attention shift. Delineating the exact cortical locations of frontal MMN generators, the conditions under which they are activated and, consequently, their function, remains an acute challenge.

Audiovisual Events in Sensory Memory

The functional properties of the auditory sensory memory have been extensively studied using the mismatch negativity (MMN) component of the auditory event-related potential (ERP) and its magnetic counterpart recorded using magneto-encephalography (MEG). It has been found that distinct auditory features (such as frequency or intensity) are encoded separately in sensory memory. Nevertheless, the conjunction of these features (auditory “gestalts”) can also be encoded in auditory sensory memory. Here we investigated how auditory and visual features of bimodal events are represented in sensory memory by recording audiovisual MMNs in two different audiovisual oddball paradigms. The results of a first ERP experiment showed that the sensory memory representations of auditory and visual features of audiovisual events lie within the temporal and occipital cortex, respectively, yet with possible interactions between the processing of the unimodal features. In a subsequent MEG experiment, we found some evidence that audiovisual feature conjunctions could also be represented in sensory memory. These results, thus, extend to the audiovisual domain a number of properties of sensory memory already established within the auditory system.

Direct evidence for differential roles of temporal and frontal components of auditory change detection

Automatic change detection is a fundamental capacity of the human brain. In audition, this capacity is indexed by the mismatch negativity (MMN) event-related potential, which is putatively supported by a network consisting of superior temporal and frontal nodes. The aim of this study was to elucidate the roles of these nodes within the neural network of change detection. We used a dichotic paradigm in which subjects (N=14) attended targets defined by either pitch or spatial location in one auditory stream while the MMN was measured in response to unattended deviants of pitch and spatial location in the other stream. The frontal and temporal components of the MMN were examined using current source density (CSD) measurements. Competition for processing resources nearly eliminated the temporal CSD mismatch response, in a highly feature-specific manner: the response to spatial location deviants was reduced when the target dimension was spatial location but not when it was pitch, whereas the reverse occurred for pitch deviants. In contrast, the frontal CSD mismatch response was neither affected by competition nor by general attention demands. Thus, within the network of change detection, the temporal generators are specifically associated with processing feature-specific information, whereas the role of the frontal generators remains unclear. Moreover, the results are inconsistent with a serial model in which the frontal generator is contingent on activation of the temporal generator.

Interactive processing of timbre dimensions: a Garner interference study

Timbre characterizes the identity of a sound source. Psychoacoustic studies have revealed that timbre is a multidimensional perceptual attribute with multiple underlying acoustic dimensions of both temporal and spectral types. Here we investigated the relations among the processing of three major timbre dimensions characterized acoustically by attack time, spectral centroid, and spectrum fine structure. All three pairs of these dimensions exhibited Garner interference: speeded categorization along one timbre dimension was affected by task-irrelevant variations along another timbre dimension. We also observed congruency effects: certain pairings of values along two different dimensions were categorized more rapidly than others. The exact profile of interactions varied across the three pairs of dimensions tested. The results are interpreted within the frame of a model postulating separate channels of processing for auditory attributes (pitch, loudness, timbre dimensions, etc.) with crosstalk between channels.

Separate Neural Processing of Timbre Dimensions in Auditory Sensory Memory

Timbre is a multidimensional perceptual attribute of complex tones that characterizes the identity of a sound source. Our study explores the representation in auditory sensory memory of three timbre dimensions (acoustically related to attack time, spectral centroid, and spectrum fine structure), using the mismatch negativity (MMN) component of the auditory event-related potential. MMN is elicited by a discriminable change in a sound sequence and reflects the detection of the discrepancy between the current stimulus and traces in auditory sensory memory. The stimuli used in the present study were carefully controlled synthetic tones. MMNs were recorded after changes along each of the three timbre dimensions and their combinations. Additivity of unidimensional MMNs and dipole modeling results suggest partially separate MMN generators for different timbre dimensions, reflecting their mainly separate processing in auditory sensory memory. The results expand to timbre dimensions a property of separation of the representation in sensory memory that has already been reported between basic perceptual attributes (pitch, loudness, duration, and location) of sound sources.

Memory-based detection of rare sound feature combinations in anesthetized rats

It is unclear whether the ability of the brain to discriminate rare from frequently repeated combinations of sound features is limited to the normal sleep/wake cycle. We recorded epidural auditory event-related potentials in urethane-anesthetized rats presented with rare tones ('deviants') interspersed with frequently repeated ones ('standards'). Deviants differed from standards either in frequency alone or in frequency combined with intensity. In both cases, deviants elicited event-related potentials exceeding in amplitude event-related potentials to standards between 76 and 108 ms from the stimulus onset, suggesting the independence of the underlying integrative and memory-based change detection mechanisms of the brain from the normal sleep/wake cycle. The relations of these event-related potentials to mismatch negativity and N1 in humans are addressed.

Spatial location is accurately tracked by human auditory sensory memory: evidence from the mismatch negativity

The nature of spatial representation in human auditory cortex remains elusive. In particular, although humans can discriminate the locations of sounds as close as 1-10 degrees apart, such resolution has not been shown in auditory cortex of humans or animals. We used the mismatch negativity (MMN) event related brain potential to measure the neural response to spatial change in humans in narrow 10 degree spatial steps. Twelve participants were tested using a dense array EEG setup while watching a silent movie and ignoring the sounds. The MMN was reliably elicited by infrequent changes of spatial location of sounds in free field. The MMN amplitude was linearly related to the degree of spatial change with a resolution of at least 10 degrees. These electrophysiological responses occurred within a window of 100-200 milliseconds from stimulus onset, and were localized to the posterior superior temporal gyrus. We conclude that azimuthal spatial displacement is rapidly, accurately and automatically represented in auditory sensory memory in humans, at the level of the auditory cortex.

Mechanisms for detecting auditory temporal and spectral deviations operate over similar time windows but are divided differently between the two hemispheres

In order to keep track of potentially relevant information in the acoustic environment, the human brain processes sounds to a high extent even when they are not attended: it extracts basic features, encodes regularities, and detects deviances. Here, we deliver evidence that the initial 300 ms of a sound contribute more to this preattentive processing than the sound's later parts. We directly compared the influence of the temporal distance relative to sound onset on the processing of the sound's duration and frequency information. The mismatch negativity (MMN), an event-related potential indicator for preattentive feature encoding and deviance detection, was measured for infrequent duration deviants and frequency modulation deviants. The onset of either deviancy was at 100, 200, 300, or 400 ms relative to sound onset. MMN was only elicited for deviations occurring within the first 300 ms after sound onset for both types of deviants. Its neural sources were localized in supra-temporal cortices with source current density analyses (SCD) and variable resolution electromagnetic tomography (VARETA), revealing a right-hemispheric preponderance for frequency modulations but not for duration shortenings. This suggests that preattentive deviance detection is based upon partly diverging functional memory registers for temporal and dynamic spectral information. The influence of temporal distance on MMN in both conditions supports the view that temporal and spectral sound properties are integrated into an auditory object representation prior to preattentive deviance detection. Importantly, the decline of MMN to unattended sounds with larger temporal distance suggests that parts beyond 300 ms are less important for preattentive auditory object representation.

Pre-attentive representation of sound duration in the human brain

Studies using a brain index for pre-attentive change detection, the mismatch negativity (MMN), suggested distinct neuronal populations for signaling changes in sound duration and frequency. However, these studies used only durations within the temporal window of loudness summation (ca. 200 ms) in which any duration change is accompanied by a loudness change. Hence, the present study employed stimulus durations both beyond and within this temporal window in order to examine the genuine duration representation in the brain. Magnetic mismatch responses (MMNm) for duration and frequency changes were compared with each other. The equivalent current dipole (ECD) of the duration MMNm was located in the auditory cortex slightly posterior to that for the frequency MMNm irrespective of stimulus duration. The results suggested separate memory representations for sound duration and frequency in the human brain.