Event-related brain activity associated with auditory pattern processing

Mismatch negativity as a marker of auditory pattern separation

To what extent does incidental encoding of auditory stimuli influence subsequent episodic memory for the same stimuli? We examined whether the mismatch negativity (MMN), an event-related potential generated by auditory change detection, is correlated with participants' ability to discriminate those stimuli (i.e. targets) from highly similar lures and from dissimilar foils. We measured the MMN in 30 young adults (18-32 years, 18 females) using a passive auditory oddball task with standard and deviant 5-tone sequences differing in pitch contour. After exposure, all participants completed an incidental memory test for old targets, lures, and foils. As expected, participants at test exhibited high sensitivity in recognizing target items relative to foils and lower sensitivity in recognizing target items relative to lures. Notably, we found a significant correlation between MMN amplitude and lure discrimination, but not foil discrimination. Our investigation shows that our capacity to discriminate sensory inputs at encoding, as measured by the MMN, translates into precision in memory for those inputs.

Differential effects of gender on mismatch negativity to violations of simple and pattern acoustic regularities

INTRODUCTION

The effects of gender on the mismatch negativity (MMN) potential have been studied using simple frequency deviants. However, the effects of gender on MMN to violations of abstract regularities have not yet been studied. Here, we addressed this issue and compared the effects of gender on simple and pattern frequency MMNs.

METHODS

MMN response was recorded from 29 healthy young adults, 14 females (mean age = 26.20 ± 2.17) and 15 males (mean age = 27.57 ± 2.24), using 32 scalp electrodes during simple and pattern frequency oddball paradigms and the mean amplitude, peak latency, and scalp topography of MMN evoked by each paradigm were compared between the two genders.

RESULTS

The peak latency of simple MMN was significantly longer in females (p < .05); however, its mean amplitude and topography were similar between the two genders (p > .05). There were no significant differences in peak latency, mean amplitude, and scalp topography of pattern MMN between the two genders (p > .05).

CONCLUSIONS

Based on the obtained results, gender differently affects simple and pattern MMN. These findings may provide preliminary evidence for distinct effects of gender on various types of MMN.

The effect of illusionary perception on mismatch negativity (MMN): An electroencephalography study

Mismatch negativity (MMN) is a unique brain response elicited by any discernible change of features in a tone sequence. Although the occurrence of MMN is dependent upon the difference of a stimulus parameter, such as frequency or intensity, recent studies have suggested that MMN occurs as a result of a comparison between an internal representation created by perception and an incoming tone. The present study aimed to investigate MMN occurs based upon the physical properties of stimuli or as a result of the perception of the scale illusion. A scale illusion occurs during presentation of ascending and descending musical scales between C4 and C5. The tones of these scales are presented to the right and left ear alternately using a dichotic listening paradigm. Although the ascending/descending sequences are alternated between ears after each tone, we perceive the illusion of progressively ascending/descending tones as being separated by ear. The experiment was designed as an oddball task using the illusionary sequence and three different types of tone sequences as control conditions. Brain response to these sequences and infrequently presented deviants was measured using electroencephalography (EEG). All of the control sequences showed MMN in response to the deviant. However, the illusionary sequence did not result in a significant MMN. These results suggest that in the case of scale illusion, the occurrence of MMN is based upon the representation of tones created by perception, but not upon the physical properties of a tone sequence.

The First Call Note Plays a Crucial Role in Frog Vocal Communication

Vocal Communication plays a crucial role in survival and reproductive success in most amphibian species. Although amphibian communication sounds are often complex consisting of many temporal features, we know little about the biological significance of each temporal component. The present study examined the biological significance of notes of the male advertisement calls of the Emei music frog (Babina daunchina) using the optimized electroencephalogram (EEG) paradigm of mismatch negativity (MMN). Music frog calls generally contain four to six notes separated approximately by 150 millisecond intervals. A standard stimulus (white noise) and five deviant stimuli (five notes from one advertisement call) were played back to each subject while simultaneously recording multi-channel EEG signals. The results showed that the MMN amplitude for the first call note was significantly larger than for that of the others. Moreover, the MMN amplitudes evoked from the left forebrain and midbrain were typically larger than those from the right counterpart. These results are consistent with the ideas that the first call note conveys more information than the others for auditory recognition and that there is left-hemisphere dominance for processing information derived from conspecific calls in frogs.

How to get statistically significant effects in any ERP experiment (and why you shouldn't)

ERP experiments generate massive datasets, often containing thousands of values for each participant, even after averaging. The richness of these datasets can be very useful in testing sophisticated hypotheses, but this richness also creates many opportunities to obtain effects that are statistically significant but do not reflect true differences among groups or conditions (bogus effects). The purpose of this paper is to demonstrate how common and seemingly innocuous methods for quantifying and analyzing ERP effects can lead to very high rates of significant but bogus effects, with the likelihood of obtaining at least one such bogus effect exceeding 50% in many experiments. We focus on two specific problems: using the grand-averaged data to select the time windows and electrode sites for quantifying component amplitudes and latencies, and using one or more multifactor statistical analyses. Reanalyses of prior data and simulations of typical experimental designs are used to show how these problems can greatly increase the likelihood of significant but bogus results. Several strategies are described for avoiding these problems and for increasing the likelihood that significant effects actually reflect true differences among groups or conditions.

Abnormal Complex Auditory Pattern Analysis in Schizophrenia Reflected in an Absent Missing Stimulus Mismatch Negativity

The simple mismatch negativity (MMN) to tones deviating physically (in pitch, loudness, duration, etc.) from repeated standard tones is robustly reduced in schizophrenia. Although generally interpreted to reflect memory or cognitive processes, simple MMN likely contains some activity from non-adapted sensory cells, clouding what process is affected in schizophrenia. Research in healthy participants has demonstrated that MMN can be elicited by deviations from abstract auditory patterns and complex rules that do not cause sensory adaptation. Whether persons with schizophrenia show abnormalities in the complex MMN is unknown. Fourteen schizophrenia participants and 16 matched healthy underwent EEG recording while listening to 400 groups of 6 tones 330 ms apart, separated by 800 ms. Occasional deviant groups were missing the 4th or 6th tone (50 groups each). Healthy participants generated a robust response to a missing but expected tone. The schizophrenia group was significantly impaired in activating the missing stimulus MMN, generating no significant activity at all. Schizophrenia affects the ability of "primitive sensory intelligence" and pre-attentive perceptual mechanisms to form implicit groups in the auditory environment. Importantly, this deficit must relate to abnormalities in abstract complex pattern analysis rather than sensory problems in the disorder. The results indicate a deficit in parsing of the complex auditory scene which likely impacts negatively on successful social navigation in schizophrenia. Knowledge of the location and circuit architecture underlying the true novelty-related MMN and its pathophysiology in schizophrenia will help target future interventions.

Brain potentials predict learning, transmission and modification of an artificial symbolic system

It has recently been argued that symbolic systems evolve while they are being transmitted across generations of learners, gradually adapting to the relevant brain structures and processes. In the context of this hypothesis, little is known on whether individual differences in neural processing capacity account for aspects of 'variation' observed in symbolic behavior and symbolic systems. We addressed this issue in the domain of auditory processing. We conducted a combined behavioral and EEG study on 2 successive days. On day 1, participants listened to standard and deviant five-tone sequences: as in previous oddball studies, an mismatch negativity (MMN) was elicited by deviant tones. On day 2, participants learned an artificial signaling system from a trained confederate of the experimenters in a coordination game in which five-tone sequences were associated to affective meanings (emotion-laden pictures of human faces). In a subsequent game with identical structure, participants transmitted and occasionally changed the signaling system learned during the first game. The MMN latency from day 1 predicted learning, transmission and structural modification of signaling systems on day 2. Our study introduces neurophysiological methods into research on cultural transmission and evolution, and relates aspects of variation in symbolic systems to individual differences in neural information processing.

Temporal aspects of prediction in audition: cortical and subcortical neural mechanisms

Tracing the temporal structure of acoustic events is crucial in order to efficiently adapt to dynamic changes in the environment. In turn, regularity in temporal structure may facilitate tracing of the acoustic signal and its likely spatial source. However, temporal processing in audition extends beyond a domain-general facilitatory function. Temporal regularity and temporal order of auditory events correspond to contextually extracted, statistically sampled relations among sounds. These relations are the backbone of prediction in audition, determining both when an event is likely to occur (temporal structure) and also what type of event can be expected at a specific point in time (formal structure, e.g. spectral information). Here, we develop a model of temporal processing in audition and speech that involves a division of labor between the cerebellum and the basal ganglia in tracing acoustic events in time. As for the cerebellum and its associated thalamo-cortical connections, we refer to its role in the automatic encoding of event-based temporal structure with high temporal precision, while the basal ganglia-thalamo-cortical system engages in the attention-dependent evaluation of longer-range intervals. Recent electrophysiological and neurofunctional evidence suggests that neocortical processing of spectral structure relies on concurrent extraction of event-based temporal information. We propose that spectrotemporal predictive processes may be facilitated by subcortical coding of relevant changes in sound energy as temporal event markers.

You had me at "Hello": Rapid extraction of dialect information from spoken words

Research on the neuronal underpinnings of speaker identity recognition has identified voice-selective areas in the human brain with evolutionary homologues in non-human primates who have comparable areas for processing species-specific calls. Most studies have focused on estimating the extent and location of these areas. In contrast, relatively few experiments have investigated the time-course of speaker identity, and in particular, dialect processing and identification by electro- or neuromagnetic means. We show here that dialect extraction occurs speaker-independently, pre-attentively and categorically. We used Standard American English and African-American English exemplars of 'Hello' in a magnetoencephalographic (MEG) Mismatch Negativity (MMN) experiment. The MMN as an automatic change detection response of the brain reflected dialect differences that were not entirely reducible to acoustic differences between the pronunciations of 'Hello'. Source analyses of the M100, an auditory evoked response to the vowels suggested additional processing in voice-selective areas whenever a dialect change was detected. These findings are not only relevant for the cognitive neuroscience of language, but also for the social sciences concerned with dialect and race perception.

Activity associated with stream segregation in human auditory cortex is similar for spatial and pitch cues

Streaming is a perceptual mechanism by which the brain segregates information from multiple sound sources in our environment and assigns them to distinct auditory streams. Examples for streaming cues are differences in frequency spectrum, pitch, or space, and potential neural correlates for streaming based on spectral and pitch cues have been identified in the auditory cortex. Here, magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) were used to evaluate if response enhancement in auditory cortex associated with streaming represents a general pattern that is independent of the stimulus cue. Interaural time differences (ITDs) were used as a spatial streaming cue and were compared with streaming based on fundamental frequency (f(0)) differences. The MEG results showed enhancement of the P(1)m after 60-90 ms that was similar during streaming based on ITD and pitch. Sustained fMRI activity was enhanced at identical sites in Heschl's gyrus and planum temporale for both cues; no topographical specificity for space or pitch was found for the streaming-associated enhancement. These results support the hypothesis of an early convergence of the neural representation for auditory streams that is independent of the acoustic cue that the streaming is based on.

Involvement of the thalamocortical loop in the spontaneous switching of percepts in auditory streaming

Perceptual grouping of successive frequency components, namely, auditory streaming, is essential for auditory scene analysis. Prolonged listening to an unchanging triplet-tone sequence produces a series of illusory switches between a single coherent stream (S1) and two distinct streams (S2). The predominant percept depends on the frequency difference (Deltaf) between high and low tones. Here, we combined the use of different Deltafs with an event-related fMRI design to identify whether the temporal dynamics of brain activity differs depending on the direction of perceptual switches. The results demonstrated that the activity of the medial geniculate body (MGB) in the thalamus occurred earlier during switching from nonpredominant to predominant percepts, whereas that of the auditory cortex (AC) occurred earlier during switching from predominant to nonpredominant percepts, regardless of Deltaf. The asymmetry of temporal precedence indicates that the MGB and AC activations play different roles in perceptual switching and depend on perceptual predominance rather than on S1 and S2 percepts per se. Our results suggest that feedforward and feedback processes in the thalamocortical loop are involved in the formation of percepts in auditory streaming.

Sensory gating: a translational effort from basic to clinical science

Sensory gating (SG) is a prevalent physiological process important for information filtering in complex systems. SG is evaluated by presenting repetitious stimuli and measuring the degree of neural inhibition that occurs. SG has been found to be impaired in several psychiatric disorders. Recent animal and human research has made great progress in the study of SG, and in this review we provide an overview of recent research on SG using different methods. Animal research has uncovered findings that suggest (1) SG is displayed by single neurons and can be similar to SG observed from scalp recordings in humans, (2) SG is found in numerous brain structures located in sensory, motor and limbic subregions, (3) SG can be significantly influenced by state changes of the organism, and (4) SG has a diverse pharmacological profile accented by a strong influence from nicotine receptor activation. Human research has addressed similar issues using deep electrode recordings of brain structures. These experiments have revealed that (1) SG can be found in cortical regions surrounding hippocampus, (2) the order of neural processing places hippocampal involvement during a later stage of sensory processing than originally thought, and (3) multiple subtypes of gating exist that could be dependent on different brain circuits and more or less influenced by alterations in organismal state. Animal and human research both have limitations. We emphasize the need for integrative approaches to understand the process and combine information between basic and clinical fields so that a more complete picture of SG will emerge.

The role of auditory cortex in the formation of auditory streams

Auditory streaming refers to the perceptual parsing of acoustic sequences into "streams", which makes it possible for a listener to follow the sounds from a given source amidst other sounds. Streaming is currently regarded as an important function of the auditory system in both humans and animals, crucial for survival in environments that typically contain multiple sound sources. This article reviews recent findings concerning the possible neural mechanisms behind this perceptual phenomenon at the level of the auditory cortex. The first part is devoted to intra-cortical recordings, which provide insight into the neural "micromechanisms" of auditory streaming in the primary auditory cortex (A1). In the second part, recent results obtained using functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) in humans, which suggest a contribution from cortical areas other than A1, are presented. Overall, the findings concur to demonstrate that many important features of sequential streaming can be explained relatively simply based on neural responses in the auditory cortex.

Rhythm deficits in ‘tone deafness’

It is commonly observed that 'tone deaf' individuals are unable to hear the beat of a tune, yet deficits on simple timing tests have not been found. In this study, we investigated rhythm processing in nine individuals with congenital amusia ('tone deafness') and nine controls. Participants were presented with pairs of 5-note sequences, and were required to detect the presence of a lengthened interval. In different conditions the sound sequences were presented isochronously or in an integer-ratio rhythm, and these were either monotonic or varied randomly in pitch. It was found that the 'tone deaf' participants exhibited inferior rhythm analysis for the sequences that varied in pitch compared to those that did not, whereas the controls obtained equivalent thresholds for these two conditions. These results suggest that the rhythm deficits in congenital amusia result from the pitch-variations in music.

Perceptual organization of tone sequences in the auditory cortex of awake macaques

Acoustic sequences such as speech and music are generally perceived as coherent auditory "streams," which can be individually attended to and followed over time. Although the psychophysical stimulus parameters governing this "auditory streaming" are well established, the brain mechanisms underlying the formation of auditory streams remain largely unknown. In particular, an essential feature of the phenomenon, which corresponds to the fact that the segregation of sounds into streams typically takes several seconds to build up, remains unexplained. Here, we show that this and other major features of auditory-stream formation measured in humans using alternating-tone sequences can be quantitatively accounted for based on single-unit responses recorded in the primary auditory cortex (A1) of awake rhesus monkeys listening to the same sound sequences.

Hemispheric differences in hemodynamics elicited by auditory oddball stimuli

Evidence from neuroimaging studies suggests that the right hemisphere of the human brain might be more specialized for attention than the left hemisphere. However, differences between right and left hemisphere in the magnitude of hemodynamic activity (i.e., 'functional asymmetry') rarely have been explicitly examined in previous neuroimaging studies of attention. This study used a new voxel-based comparison method to examine hemispheric differences in the amplitude of the hemodynamic response in response to infrequent target, infrequent novel, and frequent standard stimuli during an event-related fMRI auditory oddball task in 100 healthy adult participants. Processing of low probability task-relevant target stimuli, or 'oddballs', and low probability task-irrelevant novel stimuli is believed to engage in orienting and attentional processes. It was hypothesized that greater right-hemisphere activation compared to left would be observed to infrequent target and novel stimuli. Consistent with predictions, greater right hemisphere than left frontal, temporal, and parietal lobe activity was observed for target detection and novelty processing. Moreover, asymmetry effects did not differ with respect to age or gender of the participants. The results (1) support the proposal that the right hemisphere is differentially engaged in processing salient stimuli and (2) demonstrate the successful use of a new voxel-based laterality analysis technique for fMRI data.

Left hemispheric dipole locations of the neuromagnetic mismatch negativity to frequency, intensity and duration deviants

The aim of the current study was to differentiate the sources of neuromagnetic mismatch negativity (MMNm) to deviants of different features. For this purpose, the MMNm of twenty-one healthy subjects (seven males) were recorded left-hemispherically. Subjects were stimulated monaurally in an oddball paradigm with standard tones of 1000 Hz and three different kinds of mismatch tones (frequency, duration and intensity deviants). Data analysis revealed mean MMNm dipole locations anterior, inferior and more medial than the N100m dipoles. The mean difference between the N100m and MMNm dipoles was in the range of up to 6 mm in one dimension. The dipole locations of all three kinds of deviants differed significantly from each other. The MMNm dipoles of both frequency and duration deviants were found to be significantly inferior to the corresponding source of intensity deviants, while the MMNm dipoles of duration and frequency deviants significantly differed in anterior-posterior direction. This differentiation between sources emphasizes the importance of feature analysis in MMN(m) generation.

The internal auditory clock: what can evoked potentials reveal about the analysis of temporal sound patterns, and abnormal states of consciousness?

Whereas in vision a large amount of information may in theory be extracted from instantaneous images, sound exists only in its temporal extent, and most of its information is contained in the pattern of changes over time. The "echoic memory" is a pre-attentive auditory sensory store in which sounds are apparently retained in full temporal detail for a period of a few seconds. From the long-latency auditory evoked potentials to spectro-temporal modulation of complex harmonic tones, at least two automatic sound analysis processes can be identified whose time constants suggest participation of the echoic memory. When a steady tone changes its pitch or timbre, "change-type" CP1, CN1 and CP2 potentials are maximally recorded near the vertex. These potentials appear to reflect a process concerned with the distribution of sound energy across the frequency spectrum. When, on the other hand, changes occur in the temporal pattern of tones (in which individual pitch changes are occurring at a rate sufficiently rapid for the C-potentials to be refractory), a large mismatch negativity (or MN1) and following positivity (MP2) are generated. The amplitude of these potentials is influenced by the degree of regularity of the pattern, larger responses being generated to a "deviant" tone when the pitch and time of occurrence of the "standards" are fully specified by the preceding pattern. At the sudden cessation of changes, on resumption of a steady pitch, a mismatch response is generated whose latency is determined with high precision (in the order of a few milliseconds) by the anticipated time of the next change, which did not in fact occur. The mismatch process, therefore, functions as spectro-temporal auditory pattern analyser, whose consequences are manifested each time the pattern changes. Since calibration of the passage of time is essential for all conscious and subconscious behaviour, is it possible that some states of unconsciousness may be directly due to disruption of internal "clocks"? Abnormal mismatch potentials may provide a manifestation of a disordered auditory time-sense, sometimes being abolished in comatose patients while the C-potentials and similar responses to the onset of tones are preserved. Both C- and M-potentials were usually found to be preserved, however, in patients who had emerged from coma and were capable of discriminating sounds. Substantially intact responses were also recorded from three patients who were functionally in a "vegetative" state. The C- and M-potentials were once again dissociated in a group of patients with multiple sclerosis, only the mismatch potentials being found to be significantly delayed. This subclinical impairment of a memory-based process responsible for the detection of change in temporal sound patterns may be related to defects in other memory domains such as working memory.