Binaural information can converge in abstract memory traces

The mismatch negativity to abstract relationship of tone pairs is independent of attention

The mismatch negativity (MMN) implicating a comparison process between the deviant and the memory trace of the standard can be elicited by not only changes in physical features but also violations of abstract patterns. It is considered pre-attentive, yet the use of the passive design makes it difficult to exclude the possibility of attention leak. In contrast to how this issue has been well addressed with the MMN to physical changes, much less research directly investigated the attentional effect on the MMN to abstract relationships. Here we conducted an electroencephalography (EEG) experiment to study whether and how the MMN to abstract relationships is modulated by attention. We adapted the oddball paradigm of Kujala et al. by presenting occasional descending tone pairs among frequent ascending tone pairs, while additionally implementing a novel control of attention. Participants' attention was either directed away from the sounds (with an engaging task of visual target detection, so that the sounds were task-irrelevant) or toward the sounds (with a conventional task of auditory deviant detection, so that the sounds were task-relevant). The MMN to abstract relationships appeared regardless of attention, confirming the pre-attentive assumption. The attention-independence of the frontocentral and supratemporal components of the MMN supported the notion that attention is not required to generate the MMN. At the individual level, a relatively equal number of participants showed attention enhancement and attention suppression. It is unlike the attentional modulation on the P3b, which was robustly elicited in the attended condition only. The concurrent collection of these two neurophysiological markers in both unattended and attended conditions might be potentially suitable for testing clinical populations showing heterogeneous deficits in auditory function independent/dependent of attention.

Reductions in Complex Mismatch Negativity to Extra Tone Gestalt Pattern Deviance in First-Episode Schizophrenia

Although "simple" mismatch negativity (sMMN) to stimulus parameter changes is robustly reduced in long-term schizophrenia (Sz), it is much less reduced in individuals at their first psychotic episode in the schizophrenia-spectrum (FESz). "Complex" MMN (cMMN) reflecting pre-attentive acoustic pattern analysis is also markedly reduced in Sz, but is little studied in FESz. The computational complexity of pattern analysis reflected in cMMN may more greatly stress auditory processing, providing a more sensitive measure of auditory processing deficits at first break. If so, cMMN would provide information about the underlying pathophysiology early in disease course, and may serve as a biomarker for pathology in the Sz prodrome. Twenty-two FESz individuals were compared to 22 volunteer healthy controls (HC) on sMMN and cMMN tasks. For sMMN, pitch- and duration-deviants were presented among standard repetitive tones. For cMMN, repeated groups of 3 identical tones were presented with occasional (14%) groups including an extra identical 4th tone deviant. FESz did not show reductions of pitch-deviant (Cohen's d = 0.08) or duration-deviant MMNs (d =-0.02), but showed large reduction in extra-tone cMMN (d = 0.83). Reduced cMMN was associated with poor social functioning. Reduction in cMMN but not in sMMNs in FESz suggests impairments in late perceptual pattern processing. cMMN is sensitive to subtle pathology and functioning early in disease course which may, in turn, impact social functioning. Future studies in clinical high risk individuals are needed to determine whether this putative biomarker of disease presence is sensitive to the prodromal stage of schizophrenia.

Making Sense of Mismatch Negativity

Evoked potentials provide valuable insight into brain processes that are integral to our ability to interact effectively and efficiently in the world. The mismatch negativity (MMN) component of the evoked potential has proven highly informative on the ways in which sensitivity to regularity contributes to perception and cognition. This review offers a compendium of research on MMN with a view to scaffolding an appreciation for its use as a tool to explore the way regularities contribute to predictions about the sensory environment over many timescales. In compiling this work, interest in MMN as an index of sensory encoding and memory are addressed, as well as attention. Perspectives on the possible underlying computational processes are reviewed as well as recent observations that invite consideration of how MMN relates to how we learn, what we learn, and why.

Reduced late mismatch negativity and auditory sustained potential to rule-based patterns in schizophrenia

Complex rule-based auditory processing is abnormal in individuals with long-term schizophrenia (SZ), as demonstrated by reduced mismatch negativity (MMN) to deviants in rule-based patterns and reduced auditory sustained potential (ASP) that appears when grouping tones together. Together, this suggests deficits later in the auditory processing hierarchy in Sz. Here, MMN and ASP were elicited by deviations from a complex zig-zag pitch pattern that cannot be predicted by simple linear rules. Twenty-seven SZ and 26 matched healthy controls (HC) participated. Frequent groups of patterns contained eight tones that zig-zagged in a two-up one-down pitch-based paradigm. There were two deviant patterns: the final tone was either higher in pitch than expected (creating a jump in pitch) or was repeated. Simple MMN to pitch-deviants among repetitive tones was measured for comparison. Sz exhibited a smaller pitch MMN compared to HC as expected. HC produced a late MMN in response to the repeat and jump-deviant and a larger ASP to the standard group of tones, all of which were significantly blunted in SZ. In Sz, the amplitude of the late complex MMN was related to neuropsychological functioning, whereas ASP was not. ASP and late MMN did not significantly correlate in HC or in Sz, suggesting that they are not dependent on one another and may originate within distinct processing streams. Together, this suggests multiple deficits later in the auditory sensory-perceptual hierarchy in Sz, with impairments evident in both segmentation and deviance detection abilities.

Mismatch negativity (MMN) elicited by abstract regularity violations in two concurrent auditory streams

The study investigated whether violations of abstract regularities in two parallel auditory stimulus streams can elicit the MMN (mismatch negativity) event-related potential. Tone pairs from a low (220–392 Hz) and a high (1319–2349 Hz) stream were delivered in an alternating order either at a fast or a slow pace. With the slow pace, the pairs were perceptually heard as a single stream obeying an alternating low pair-high pair pattern, whereas with the fast pace, an experience of two separate auditory streams, low and high, emerged. Both streams contained standard and deviant pairs. The standard pairs were either in both streams ascending in the direction of the within-pair pitch change or in the one stream ascending and in the other stream descending. The direction of the deviant pairs was opposite to that of the same-stream standard pairs. The participant's task was either to ignore the auditory stimuli or to detect the deviant pairs in the designated stream. The deviant pairs elicited an MMN both when the directions of the standard pairs in the two streams were the same or when they were opposite. The MMN was present irrespective of the pace of stimulation. The results indicate that the preattentive brain mechanisms, reflected by the MMN, can extract abstract regularities from two concurrent streams even when the regularities are opposite in the two streams, and independently of whether there perceptually exists only one stimulus stream or two segregated streams. These results demonstrate the brain's remarkable ability to model various regularities embedded in the auditory environment and update the models when the regularities are violated. The observed phenomena can be related to several aspects of auditory information processing, e.g., music and speech perception and different forms of attention.

Complex mismatch negativity to tone pair deviants in long-term schizophrenia and in the first-episode schizophrenia spectrum

Mismatch negativity (MMN) is an event-related potential to stimulus change. MMN to infrequent deviant tones that differs in a simple physical parameter from repetitive standard tones is reduced in patients with long-term schizophrenia (Sz; d=~1). However, this simple MMN is not uniformly reduced at the first-episode of schizophrenia-spectrum psychosis (FESz; d<0.1 for pitch; <0.4 for duration). Deviant stimuli that violate pattern rules also evoke MMN. This complex MMN is evoked by deviations in the relation of sounds to each other. The simplest pattern involves tone pairs. Although the pitch of first tone in the pair varies, the second tone's pitch always follows a rule (e.g., always 3 semitones higher). We measured complex MMN to deviant tone pairs that descended in pitch among standard tone pairs that ascended in pitch, never before examined in Sz or in FESz. Experiment 1 showed significant reductions in complex MMN in 20 Sz compared to 22 matched controls. Experiment 2 replicated smaller complex MMN in a shorter protocol in 24 Sz compared to 21 matched controls, but showed no significant complex MMN reduction in 21 FESz compared to 21 matched controls. Although reduced in Sz, indicating deficits in generation of a simple acoustic pattern rule, the tone pair complex MMN was within normal limits in FESz. This suggests that more complex perceptual pattern analysis processes are, at least partially, still intact at the first break. Future work will determine at what point of pattern complexity subtle auditory perception pathophysiology will be revealed in FESz.

Mismatch negativity to pitch pattern deviants in schizophrenia

Simple mismatch negativity (MMN) to infrequent pitch deviants is impaired in individuals with long-term schizophrenia (Sz). The complex MMN elicited by pattern deviance often manifes is cut from here]->ts later after deviant onset than simple MMN and can ascertain deficits in abstracting relationships between stimuli. Sz exhibit reduced complex MMN, but so far this has only been measured when deviance detection relies on a grouping rule. We measured MMN to deviants in pitch-based rules to see whether MMN is also abnormal in Sz under these conditions. Three experiments were conducted. Twenty-seven Sz and 28 healthy matched controls (HC) participated in Experiments 1 and 2, and 24 Sz and 26 HC participated in Experiment 3. Experiment 1 was a standard pitch MMN task, and Sz showed the expected MMN reduction (~ 115 ms) in the simple pitch deviant compared to HC. Experiment 2 comprised standard groups of six tones that ascended in pitch, and deviant groups where the last tone descended in pitch. Complex MMN was late (~ 510 ms) and significantly blunted in Sz. Experiment 3 comprised standard groups of 12 tones (six tones ascending in pitch followed by six tones descending in pitch, like a scale), and deviant groups containing two repetitions of six ascending tones (the scale restarted midstream). Complex MMN was also late (~ 460 ms) and significantly blunted in Sz. These results identify a late pitch pattern deviance-related MMN that is deficient in schizophrenia. This suggests specific deficits in later more complex deviance detection in schizophrenia for abstract patterns.

Event-related potential measures of a violation of an expected increase and decrease in intensity

Unexpected physical increases in the intensity of a frequently occurring “standard” auditory stimulus are experienced as obtrusive. This could either be because of a physical change, the increase in intensity of the “deviant” stimulus, or a psychological change, the violation of the expectancy for the occurrence of the lower intensity standard stimulus. Two experiments were run in which event-related potentials (ERPs) were recorded to determine whether “psychological” increments (violation of an expectancy for a lower intensity) would be processed differently than psychological decrements (violation of an expectancy for a higher intensity). Event-related potentials (ERPs) were recorded while subjects were presented with auditory tones that alternated between low and high intensity. The subjects ignored the auditory stimuli while watching a video. Deviants were created by repeating the same stimulus. In the first experiment, pairs of stimuli alternating in intensity, were presented in separate increment (H-L…H-L…H-H…H-L, in which H = 80 dB SPL and L = 60 dB SPL) and decrement conditions (L-H…L-H…L-L… L-H, in which H = 90 dB SPL and L = 80 dB SPL). The paradigm employed in the second experiment consisted of an alternating intensity pattern (H-L-H-L-H-H-H-L) or (H-L-H-L-L-L-H-L). Importantly, the stimulus prior to the deviant (the standard) and the actual deviants in both increment and decrement conditions in both experiments were physically identical (80 dB SPL tones). The repetition of the lower intensity tone therefore acted as a psychological rather than a physical decrement (a higher intensity tone was expected) while the repetition of the higher intensity tone acted as a psychological increment (a lower intensity tone was expected). The psychological increments in both experiments elicited a larger amplitude mismatch negativity (MMN) than the decrements. Thus, regardless of whether an acoustic change signals a physical increase in intensity or violates an expected decrease in intensity, a large MMN will be elicited.

Effects of a violation of an expected increase or decrease in intensity on detection of change within an auditory pattern

An infrequent physical increase in the intensity of an auditory stimulus relative to an already loud frequently occurring "standard" is processed differently than an equally perceptible physical decrease in intensity. This may be because a physical increment results in increased activation in two different systems, a transient and a change detector system (signalling detection of an increase in transient energy and a change from the past, respectively). By contrast, a decrease in intensity results in increased activation in only the change detector system. The major question asked by the present study was whether a psychological (rather than a physical) increment would continue to be processed differently than a psychological decrement when both stimuli activated only the change detector system. Participants were presented with a sequence of 1000 Hz tones that followed a standard rule-based alternating high-low intensity pattern (LHLHLH). They were asked to watch a silent video and thus ignore the auditory stimuli. A rare "deviant" was created by repeating one of the stimuli (e.g., LHLHLLLH. The repetition of the high intensity stimulus thus acted as a relative, psychological increment compared to what the rule would have predicted (the low intensity); the repetition of the low intensity stimulus acted as a relative, psychological decrement compared to what the rule would have predicted (the high intensity). In different conditions, the intensity difference between the low and high intensity tones was either 3, 9 or 27 dB. A large MMN was elicited only when the separation between the low and high intensities was 27dB. Importantly, this MMN peaked significantly earlier and its amplitude was significantly larger following presentation of the psychological increment. Thus, a deviant representing an increment in intensity relative to what would be predicted by the auditory past is processed differently than a deviant representing a decrement, even when activation of the transient detector system is controlled. The psychological increment did not however elicit a later positivity, the P3a, often thought to reflect the interruption of the central executive and a forced switching of attention.

Investigation of melodic contour processing in the brain using multivariate pattern-based fMRI

Music perception generally involves processing the frequency relationships between successive pitches and extraction of the melodic contour. Previous evidence has suggested that the 'ups' and 'downs' of melodic contour are categorically and automatically processed, but knowledge of the brain regions that discriminate different types of contour is limited. Here, we examined melodic contour discrimination using multivariate pattern analysis (MVPA) of fMRI data. Twelve non-musicians were presented with various ascending and descending melodic sequences while being scanned. Whole-brain MVPA was used to identify regions in which the local pattern of activity accurately discriminated between contour categories. We identified three distinct cortical loci: the right superior temporal sulcus (rSTS), the left inferior parietal lobule (lIPL), and the anterior cingulate cortex (ACC). These results complement previous findings of melodic processing within the rSTS, and extend our understanding of the way in which abstract auditory sequences are categorized by the human brain.

Are auditory-evoked frequency and duration mismatch negativity deficits endophenotypic for schizophrenia? High-density electrical mapping in clinically unaffected first-degree relatives and first-episode and chronic schizophrenia

BACKGROUND

Mismatch negativity (MMN) is a negative-going event-related potential (ERP) component that occurs in response to intermittent changes in constant auditory backgrounds. A consistent finding across a large number of studies has been impaired MMN generation in schizophrenia, which has been interpreted as evidence for fundamental deficits in automatic auditory sensory processing. The aim of this study was to investigate the extent to which dysfunction in MMN generation might represent an endophenotypic marker for schizophrenia.

METHODS

We measured MMN to deviants in duration (25 msec, 1000 Hz) and deviants in pitch (50 msec, 1200 Hz) relative to standard tones (50 msec, 1000 Hz) in 45 chronic schizophrenia patients, 25 of their first-degree unaffected biological relatives, 12 first-episode patients, and 27 healthy control subjects.

RESULTS

In line with previous work, MMN amplitudes to duration deviants (but not to pitch deviants) were significantly reduced in patients with chronic schizophrenia compared with control subjects. However, both duration and pitch MMNs were completely unaffected in the first-degree biological relatives and this was also the case for the first-episode patients. Furthermore, length of illness did not predict the extent of MMN deficit.

CONCLUSIONS

These findings suggest that the MMN deficit seen in schizophrenia patients is most likely a consequence of the disease and that MMN, at least to basic auditory feature deviants, is at best only weakly endophenotypic for schizophrenia.

The mismatch negativity (MMN) in basic research of central auditory processing: a review

In the present article, the basic research using the mismatch negativity (MMN) and analogous results obtained by using the magnetoencephalography (MEG) and other brain-imaging technologies is reviewed. This response is elicited by any discriminable change in auditory stimulation but recent studies extended the notion of the MMN even to higher-order cognitive processes such as those involving grammar and semantic meaning. Moreover, MMN data also show the presence of automatic intelligent processes such as stimulus anticipation at the level of auditory cortex. In addition, the MMN enables one to establish the brain processes underlying the initiation of attention switch to, conscious perception of, sound change in an unattended stimulus stream.

The mismatch negativity in cognitive and clinical neuroscience: Theoretical and methodological considerations

Mismatch negativity (MMN) component of the event-related brain potentials has become popular in cognitive and clinical brain research during the recent years. It is an early response to a violation of an auditory rule such as an infrequent change in the physical feature of a repetitive sound. There is a lot of evidence on the association of the MMN parameters and behavioral discrimination ability, although this relationship is not always straight-forward. Since the MMN reflects sound discrimination accuracy, it can be used for probing how well different groups of individuals perceive sound differences, and how training or remediation affects this ability. In the present review, we first introduce some of the essential MMN findings in probing sound discrimination, memory, and their deficits. Thereafter, issues which need to be taken into account in MMN investigations as well as new improved recording paradigms are discussed.

Mismatch Negativity

Since its discovery by Näätänen and colleagues in 1978, the mismatch negativity (MMN) has been used as an index of auditory sensory memory. The present paper explicates various possibilities of how MMN can assess memory functions, it reveals possible traps when interpreting MMN as an index of auditory memory, and it reviews recent developments of paradigms showing that memory on a short time-scale, consolidation of memory traces, and even implicit memory can be probed with MMN.

Implicit, intuitive, and explicit knowledge of abstract regularities in a sound sequence: an event-related brain potential study

Implicit knowledge has been proposed to be the substrate of intuition because intuitive judgments resemble implicit processes. We investigated whether the automatically elicited mismatch negativity (MMN) component of the auditory event-related potentials (ERPs) can reflect implicit knowledge and whether this knowledge can be utilized for intuitive sound discrimination. We also determined the sensitivity of the attention-and task-dependent P3 component to intuitive versus explicit knowledge. We recorded the ERPs elicited in an "abstract" oddball paradigm. Tone pairs roving over different frequencies but with a constant ascending inter-pair interval, were presented as frequent standard events. The standards were occasionally replaced by deviating, descending tone pairs. The ERPs were recorded under both ignore and attend conditions. Subjects were interviewed and classified on the basis of whether or not they could datect the deviants. The deviants elicited an MMN even in subjects who subsequent to the MMN recording did not express awareness of the deviants. This suggests that these subjects possessed implicit knowledge of the sound-sequence structure. Some of these subjects learned, in an associative training session, to detect the deviants intuitively, that is, they could detect the deviants but did not give a correct description of how the deviants differed from the standards. Intuitive deviant detection was not accompanied by P3 elicitation whereas subjects who developed explicit knowledge of the sound sequence during the training did show a P3 to the detected deviants.

Language outside the focus of attention: The mismatch negativity as a tool for studying higher cognitive processes

Which aspects of language and cognitive processing take place irrespective of whether subjects focus their attention on incoming stimuli and are, in this sense, automatic? The Mismatch Negativity (MMN), a neurophysiological brain response recorded in the EEG and MEG, is elicited by attended and unattended stimuli alike. Recent studies investigating the cognitive processes underlying spoken language processing found that even under attentional withdrawal, MMN size and topography reflect the activation of memory traces for language elements in the human brain. Familiar sounds of one's native language elicit a larger MMN than unfamiliar sounds, and at the level of meaningful language units, words elicit a larger MMN than meaningless pseudowords. This suggests that the MMN reflects the activation of memory networks for language sounds and spoken words. Unattended word stimuli elicit an activation sequence starting in superior-temporal cortex and rapidly progressing to left-inferior-frontal lobe. The spatio-temporal patterns of cortical activation depend on lexical and semantic properties of word stems and affixes, thus indicating that the MMN can give clues about lexico-semantic information processing stored in long term memory. At the syntactic level, MMN size was found to reflect whether a word string conforms to abstract grammatical rules. This growing body of results suggests that lexical, semantic and syntactic information can be processed by the central nervous system outside the focus of attention in a largely automatic manner. Analysis of spatio-temporal patterns of generator activations underlying the MMN to speech may be an important tool for investigating the brain dynamics of spoken language processing and the activated distributed cortical circuits acting at long-term memory traces.

Probability-independent and -dependent ERPs reflecting visual change detection

In ERP studies, two posterior components with different polarities have been identified as ERP correlates of visual change detection. To compare these components in terms of sensitivity to the preceding stimulus sequence, two peripheral stimuli of different colors (red and blue) were presented with equal (50:50) or different probabilities (20:80 or 80:20), while 12 participants performed shape discrimination at a central location. A posterior positivity at around 90-140 ms was observed with similar amplitude to all stimuli immediately preceded by a different stimulus. In contrast, a posterior negativity at around 140-180 ms was observed to increase in amplitude with increasing number of preceding different stimuli. These results suggest the existence of probability-independent and -dependent change processing in the human visual system. The functional significance is discussed in terms of memory-based comparison and stimulus-specific refractoriness.

Automatic Encoding of Polyphonic Melodies in Musicians and Nonmusicians

In music, multiple musical objects often overlap in time. Western polyphonic music contains multiple simultaneous melodic lines (referred to as “voices”) of equal importance. Previous electrophysiological studies have shown that pitch changes in a single melody are automatically encoded in memory traces, as indexed by mismatch negativity (MMN) and its magnetic counterpart (MMNm), and that this encoding process is enhanced by musical experience. In the present study, we examined whether two simultaneous melodies in polyphonic music are represented as separate entities in the auditory memory trace. Musicians and untrained controls were tested in both magnetoencephalogram and behavioral sessions. Polyphonic stimuli were created by combining two melodies (A and B), each consisting of the same five notes but in a different order. Melody A was in the high voice and Melody B in the low voice in one condition, and this was reversed in the other condition. On 50% of trials, a deviant final (5th) note was played either in the high or in the low voice, and it either went outside the key of the melody or remained within the key. These four deviations occurred with equal probability of 12.5% each. Clear MMNm was obtained for most changes in both groups, despite the 50% deviance level, with a larger amplitude in musicians than in controls. The response pattern was consistent across groups, with larger MMNm for deviants in the high voice than in the low voice, and larger MMNm for in-key than out-of-key changes, despite better behavioral performance for out-of-key changes. The results suggest that melodic information in each voice in polyphonic music is encoded in the sensory memory trace, that the higher voice is more salient than the lower, and that tonality may be processed primarily at cognitive stages subsequent to MMN generation.

Mismatch negativity in schizophrenia: a meta-analysis

BACKGROUND

Mismatch negativity (MMN) is an auditory event-related potential that provides an index of automatic context-dependent information processing and auditory sensory memory. Many studies have reported abnormalities in the generation of MMN in schizophrenia. The objective of this study was to assess the magnitude of this deficit and associated factors.

METHOD

Studies of MMN in schizophrenia were identified and included in a meta-analysis to estimate the mean effect size. Effects of duration of illness, gender ratio, age of patients, type of MMN (duration versus frequency MMN) and characteristics of the test paradigms (deviant probability, magnitude of standard-deviant difference) on effect size were assessed.

RESULTS

Of 62 identified studies 32 met our inclusion criteria. The mean effect size was 0.99 (95% confidence intervals: 0.79, 1.29). Overall, no specific factor was significantly associated with MMN deficits, although MMN to stimuli differing in duration appeared more impaired in schizophrenia than MMN to frequency deviants. In addition, effect sizes of frequency MMN were significantly correlated with duration of illness.

CONCLUSIONS

MMN deficits are a robust feature in chronic schizophrenia and indicate abnormalities in automatic context-dependent auditory information processing and auditory sensory memory in these patients. Reports of normal MMN in first-episode schizophrenia and the association of deficits in frequency MMN with illness duration suggest that MMN may index ongoing neuropathological changes in the auditory cortex in schizophrenia.

Auditory event-related potentials as a function of abstract change magnitude

Event-related potentials were recorded in healthy volunteers to test the accuracy of the human brain to extract, preattentively, auditory abstract rules. The abstract rule was determined by the frequency relationship between two pure tones forming a pair. The standard pairs had identical tone frequency, whereas the deviant pairs had the second tone two, four, six or eight musical steps higher or lower in frequency than the first one. All abstract changes elicited mismatch negativity, which was not affected by the magnitude of change. However, the subsequent P3a increased as a function of the magnitude of the abstract change. These results suggest that mismatch negativity detects violations of abstract rules, and the amount of violation is analyzed in subsequent stages of auditory processing.

Deviance-related electrophysiological activity in mice: is there mismatch negativity in mice?

OBJECTIVE

Mismatch negativity (MMN) is an auditory event-related potential (ERP) that provides an index of auditory sensory memory and has become an important tool to investigate auditory sensory memory in cognitive neuroscience and disorders such as schizophrenia and dyslexia. The development of a mouse model of human MMN would permit to investigate the molecular biology of normal and dysfunctional MMN generation. However, the presence of MMN-like electrophysiological activity in mice has not been demonstrated.

METHODS

Deviance-related ERPs were recorded in awake mice using 3 frequency deviance paradigms and one duration deviance paradigm. These paradigms were modelled after paradigms used in human studies to characterize MMN.

RESULTS

Significant deviance-related activity was observed in all paradigms. However, in all frequency deviance paradigms this activity manifested as an enhancement of similar activity to the standard due to differences in stimulation rate between deviant and standard stimuli rather than qualitatively different MMN-like activity. In the duration deviance paradigm negative deflections were observed that showed characteristics typical of human MMN.

CONCLUSIONS

MMN-like activity can be observed in mice in duration deviance paradigms. In frequency deviance paradigms effects of different stimulation rates of deviant and standard stimuli seem to be the main determinants of deviance-related activity.

SIGNIFICANCE

Investigations of MMN-like ERPs in mice may permit to investigate the molecular basis for normal and abnormal MMN generation in neuropsychiatric disorders and dyslexia.

Musical Training Enhances Automatic Encoding of Melodic Contour and Interval Structure

In music, melodic information is thought to be encoded in two forms, a contour code (up/down pattern of pitch changes) and an interval code (pitch distances between successive notes). A recent study recording the mismatch negativity (MMN) evoked by pitch contour and interval deviations in simple melodies demonstrated that people with no formal music education process both contour and interval information in the auditory cortex automatically. However, it is still unclear whether musical experience enhances both strategies of melodic encoding. We designed stimuli to examine contour and interval information separately. In the contour condition there were eight different standard melodies (presented on 80% of trials), each consisting of five notes all ascending in pitch, and the corresponding deviant melodies (20%) were altered to descending on their final note. The interval condition used one five-note standard melody transposed to eight keys from trial to trial, and on deviant trials the last note was raised by one whole tone without changing the pitch contour. There was also a control condition, in which a standard tone (990.7 Hz) and a deviant tone (1111.0 Hz) were presented. The magnetic counterpart of the MMN (MMNm) from musicians and nonmusicians was obtained as the difference between the dipole moment in response to the standard and deviant trials recorded by magnetoencephalography. Significantly larger MMNm was present in musicians in both contour and interval conditions than in nonmusicians, whereas MMNm in the control condition was similar for both groups. The interval MMNm was larger than the contour MMNm in musicians. No hemispheric difference was found in either group. The results suggest that musical training enhances the ability to automatically register abstract changes in the relative pitch structure of melodies.

Feature versus gestalt representation of stimuli in the mismatch negativity system of 7- to 9-year-old children

We examined preattentive auditory change detection in 7- to 9-year-old children. The question of interest was whether the preattentive comparison of stimuli indexed by the scalp-recorded mismatch negativity (MMN) was performed on representations of individual stimulus features or on gestalt representations of their combined attributes. The design of the study, based on a work by D. Deacon, J. Nousak, M. Pilotti, W. Ritter, and C. Yang (Psychophysiology, 1998), was such that both feature and gestalt representations could have been available to the comparator mechanism generating the MMN. The data indicated that for the majority of the children-those that exhibited an inverse relationship between the amplitude of the MMN and the probability of the deviant-the MMN was based on feature-specific information. This study also provides a method to obtain MMNs to deviants in three different features in the time usually required to obtain an MMN to a single acoustic feature.

Preattentive evaluation of multiple perceptual streams in human audition

To analyze an auditory scene, the segregation of the input into separate streams of information is necessary. Here, the mismatch negativity (MMN) of the event-related potential was used to trace the number of simultaneously monitored streams in auditory scene analysis. Subjects passively listened to sounds belonging to either one, two, or three auditory streams defined by spatial position and pitch. An MMN was obtained for deviants within either one, two or three auditory streams albeit with a smaller amplitude in the latter condition. Control experiments ruled out that this effect was due to variations in stimulation rate. Thus, a preattentive deviant detection system based on simple auditory features provides the basis for subsequent attentive processing directed to a selected stream.

Effects of temporal encoding on auditory object formation: a mismatch negativity study

Analysis of auditory scene relies on the appropriate division of the sensory input into meaningful events. The auditory system uses a sequential grouping strategy to segregate different acoustic events in the time domain. As a result of grouping, the organization of sound is expected to include acoustic events spanning different scales of time. It is unclear, however, at which moment the central auditory system begins to introduce changes in the neural representation of the auditory scene as a result of grouping different information units into a larger acoustic event. The present set of experiments examines this issue by using the mismatch negativity (MMN) component of event-related potentials. The MMN is elicited in response to changes in the previously registered auditory regularity whether or not the subject's attention is focused on the auditory stimuli. By presenting three consecutive pairs of alternating tones in serial stimulus trains, we found that across-train repetitions of the tone elicited the MMN with inter-train intervals up to 240 ms. Beyond this interval, only within-train repetitions of the tone elicited the MMN, suggesting that pairs of tones were bound together into a single acoustic event (i.e., train of six tones) within a temporal window not much longer than 240 ms. Furthermore, a different pattern of responses was seen depending on the position of the deviant event within the train and the frequency distance between the alternating tones. These results suggest that grouping discrete auditory inputs may introduce changes in the neural representation of the auditory scene by applying rules to sounds spanning larger temporal scales.

Spectral and temporal stimulus characteristics in the processing of abstract auditory features

The processing of abstract stimulus features in the human brain was studied by presenting the subjects with frequent standard tone pairs and infrequent deviant tone pairs. Both pairs varied randomly over a wide frequency and/or intensity range, there being no physically constant standard stimulus. The common feature of the standard pairs was the direction of change within the pair, e.g. the second tone was louder in intensity and/or higher in frequency than the first tone. Deviant pairs, having opposite feature-change direction, elicited the mismatch-negativity (MMN) event-related potential component. MMN was similar to deviations in the direction of frequency and intensity changes and showed no additivity for simultaneous changes in both feature directions. Moreover, MMN was elicited even when the within-pair interval exceeded the 200 ms limit of auditory temporal integration. Results demonstrate that extraction of abstract features is not limited to frequency-based rules, nor is it dependent on temporal integration mechanisms. The lack of MMN additivity between violations of multiple abstract rules suggests that the processing of higher-order invariances differs from that of simple physical features.

Automatic and controlled processing of melodic contour and interval information measured by electrical brain activity

Most work on how pitch is encoded in the auditory cortex has focused on tonotopic (absolute) pitch maps. However, melodic information is thought to be encoded in the brain in two different "relative pitch" forms, a domain-general contour code (up/down pattern of pitch changes) and a music-specific interval code (exact pitch distances between notes). Event-related potentials were analyzed in nonmusicians from both passive and active oddball tasks where either the contour or the interval of melody-final notes was occasionally altered. The occasional deviant notes generated a right frontal positivity peaking around 350 msec and a central parietal P3b peaking around 580 msec that were present only when participants focused their attention on the auditory stimuli. Both types of melodic information were encoded automatically in the absence of absolute pitch cues, as indexed by a mismatch negativity wave recorded during the passive conditions. The results indicate that even in the absence of musical training, the brain is set up to automatically encode music-specific melodic information, even when absolute pitch information is not available.

Human Event-Related Potentials to Higher-Order Acoustic Spatial Changes

Abstract Human event-related potentials (ERPs) to a tone continuously alternating between its two spatial loci of origin (middle-standards, left-standards), to repetitions of left-standards (oddball-deviants), and to the tones originally representing these repetitions presented alone (alone-deviants) were recorded in free-field conditions. During the recordings (Fz, Cz, Pz, M1, and M2 referenced to nose), the subjects watched a silent movie. Oddball-deviants elicited a spatially diffuse two-peaked deflection of positive polarity. It differed from a deflection elicited by left-standards and commenced earlier than a prominent deflection of negative polarity (N1) elicited by alone-deviants. The results are discussed in the context of the mismatch negativity (MMN) and previous findings of dissociation between spatial and non-spatial information in auditory working memory.

The mismatch negativity as an index of temporal processing in audition

OBJECTIVES

The relation of the mismatch negativity (MMN) elicitation with behavioral stimulus discrimination as well as the replicability of the MMN was evaluated for intervals between paired tones.

METHODS

The MMN, obtained in a passive oddball paradigm in two sessions separated by 4-21 days and behavioral responses (button presses to target stimuli) in a separate session were recorded from 10 adult healthy subjects. The standard stimulus (P=0.79) was a tone pair separated by a 120 ms silent inter-stimulus interval (ISI) and the deviant stimuli were tone pairs with an ISI of 100, 60, and 20 ms (P=0.07 for each).

RESULTS

The 20 and 60 ms ISI deviant tone pairs elicited a significant MMN during both recording sessions and they were also behaviorally discriminated, whereas neither did the 100 ms ISI deviant pair elicit significant MMN nor was it behaviorally discriminated. Furthermore, there was a significant correlation between the MMN and reaction times to the 20 and 60 ms ISI deviant pairs. The 20 ms ISI deviant stimulus elicited highly replicable MMNs (r=0.75), whereas the less well discriminated 60 ms ISI deviant pair did not (r=0.60).

CONCLUSIONS

The MMN reflects discrimination accuracy of temporal sound intervals. Furthermore, when the physical difference between the standard and deviant tone pair in the temporal domain is large, it is elicited with high reliability.

Superior formation of cortical memory traces for melodic patterns in musicians

The human central auditory system has a remarkable ability to establish memory traces for invariant features in the acoustic environment despite continual acoustic variations in the sounds heard. By recording the memory-related mismatch negativity (MMN) component of the auditory electric and magnetic brain responses as well as behavioral performance, we investigated how subjects learn to discriminate changes in a melodic pattern presented at several frequency levels. In addition, we explored whether musical expertise facilitates this learning. Our data show that especially musicians who perform music primarily without a score learn easily to detect contour changes in a melodic pattern presented at variable frequency levels. After learning, their auditory cortex detects these changes even when their attention is directed away from the sounds. The present results thus show that, after perceptual learning during attentive listening has taken place, changes in a highly complex auditory pattern can be detected automatically by the human auditory cortex and, further, that this process is facilitated by musical expertise.

The mismatch negativity in evaluating central auditory dysfunction in dyslexia

The mismatch negativity (MMN), a brain response elicited by a discriminable change in any repetitive aspect of auditory stimulation even in the absence of attention, has been widely used in both basic and clinical research during recent years. The fact that the MMN reflects the accuracy of auditory discrimination and that it can be obtained even from unattentive subjects makes it an especially attractive tool for studying various central auditory-system dysfunctions both in adults and children. In this review, we will discuss the applicability of the MMN to studies in dyslexia, which is currently thought, in the majority of the cases, to primarily result either from a dysfunction of the phonological system or a more general auditory deficit. Recent evidence indicates that the MMN enables one to determine which aspects of auditory information are deficiently processed in dyslexia. The MMN might also be helpful in the early definition of the dyslexia type, which would make it possible to start correctly-targeted training programmes before any major learning delays occur. Furthermore, the MMN holds promise of showing plastic changes in the brain of dyslexic individuals underlying the alleviation or remediation of dyslexia in the course of a successful training programme.

Musical sound processing in the human brain. Evidence from electric and magnetic recordings

Recently, our knowledge regarding the brain's ability to represent invariant features of musical information even during the performance of a simultaneous task (unrelated to the sounds) has accumulated rapidly. Recordings of the change-specific mismatch negativity component of event-related brain potentials have shown that temporally and spectrally complex sounds as well as their relations are automatically processed by human auditory cortex. Furthermore, recent magnetoencephalographic and positron emission topographic investigations indicate that this processing differs between phonetic and musical sounds within and between the cerebral hemispheres. These data thus suggest that despite the focus of listeners' conscious attention, relatively complex sound phenomena can be encoded by neural mechanisms that are specialized for musical sounds.

Differentiating ERAN and MMN: an ERP study

In the present study, the early right-anterior negativity (ERAN) elicited by harmonically inappropriate chords during listening to music was compared to the frequency mismatch negativity (MMN) and the abstract-feature MMN. Results revealed that the amplitude of the ERAN, in contrast to the MMN, is specifically dependent on the degree of harmonic appropriateness. Thus, the ERAN is correlated with the cognitive processing of complex rule-based information, i.e. with the application of music-syntactic rules. Moreover, results showed that the ERAN, compared to the abstract-feature MMN, had both a longer latency, and a larger amplitude. The combined findings indicate that ERAN and MMN reflect different mechanisms of pre-attentive irregularity detection, and that, although both components have several features in common, the ERAN does not easily fit into the classical MMN framework. The present ERPs thus provide evidence for a differentiation of cognitive processes underlying the fast and pre-attentive processing of auditory information.

"Primitive intelligence" in the auditory cortex

The everyday auditory environment consists of multiple simultaneously active sources with overlapping temporal and spectral acoustic properties. Despite the seemingly chaotic composite signal impinging on our ears, the resulting perception is of an orderly "auditory scene" that is organized according to sources and auditory events, allowing us to select messages easily, recognize familiar sound patterns, and distinguish deviant or novel ones. Recent data suggest that these perceptual achievements are mainly based on processes of a cognitive nature ("sensory intelligence") in the auditory cortex. Even higher cognitive processes than previously thought, such as those that organize the auditory input, extract the common invariant patterns shared by a number of acoustically varying sounds, or anticipate the auditory events of the immediate future, occur at the level of sensory cortex (even when attention is not directed towards the sensory input).

Activation of the auditory pre-attentive change detection system by tone repetitions with fast stimulation rate

The human automatic pre-attentive change detection system indexed by the mismatch negativity (MMN) component of the auditory event-related brain potential is known to be highly adaptive. The present study showed that even infrequent repetitions of tones can elicit MMN, independently of attention, when tones of varying frequency are rapidly presented in an isochronous rhythm. This demonstrates that frequency variation can be extracted as an invariant feature of the acoustic environment revealing the capacity for adaptation of the auditory pre-attentive change detection system. It is argued that this capacity is related to the temporal-window of integration.

Effects of spectral complexity and sound duration on automatic complex-sound pitch processing in humans - a mismatch negativity study

The pitch of a spectrally rich sound is known to be more easily perceived than that of a sinusoidal tone. The present study compared the importance of spectral complexity and sound duration in facilitated pitch discrimination. The mismatch negativity (MMN), which reflects automatic neural discrimination, was recorded to a 2. 5% pitch change in pure tones with only one sinusoidal frequency component (500 Hz) and in spectrally rich tones with three (500-1500 Hz) and five (500-2500 Hz) harmonic partials. During the recordings, subjects concentrated on watching a silent movie. In separate blocks, stimuli were of 100 and 250 ms in duration. The MMN amplitude was enhanced with both spectrally rich sounds when compared with pure tones. The prolonged sound duration did not significantly enhance the MMN. This suggests that increased spectral rather than temporal information facilitates pitch processing of spectrally rich sounds.

Towards optimal recording and analysis of the mismatch negativity

In this paper, the conceptual and practical issues related to the measurement of mismatch negativity (MMN) are discussed from the viewpoint of cost-efficiency. First, various criteria for efficiency or optimality of measurements are described, including reliability and signal-to-noise ratio. Then a critical look is taken at some currently used concepts and data analysis methods. Practical guidelines for the measurement and analysis of MMN are given, complementing the earlier reviews on the subject. Finally, reliability studies on MMN are critically reviewed.

Mismatch negativity: different water in the same river

The mismatch negativity (MMN) is a frontal negative deflection in the human event-related potential that typically occurs when a repeating auditory stimulus changes in some manner. The MMN can be elicited by many kinds of stimulus change, varying from simple changes in a single stimulus feature to abstract changes in the relationship between stimuli. The main intracerebral sources for the MMN are located in the auditory cortices of the temporal lobe. Since it occurs whether or not stimuli are being attended, the MMN represents an automatic cerebral process for detecting change. The MMN is clinically helpful in terms of demonstrating disordered sensory processing or disordered memory in groups of patients. Improvements in the techniques for measuring the MMN and in the paradigms for eliciting it will be needed before the MMN can become clinically useful as an objective measurement of such disorders in individual patients.

Neuronal populations in the human brain extracting invariant relationships from acoustic variance

The ability to extract invariant relationships from physically varying stimulation is critical for example to categorical perception of complex auditory information such as speech and music. Human subjects were presented with tone pairs randomly varying over a wide frequency range, there being no physically constant tone pair at all. Instead, the invariant feature was either the direction of the tone pairs (ascending: the second tone was higher in frequency than the first tone) or the frequency ratio (musical interval) of the two tones. The subjects ignored the tone pairs, and instead attended a silent video. Occasional deviant pairs (either descending in direction or having a different frequency ratio) elicited the mismatch negativity (MMN) of the event-related potential, demonstrating the existence of neuronal populations which automatically (independently of attention) extract invariant relationships from acoustical variance.