Attention modulates auditory pattern memory as indexed by event-related brain potentials

Auditory attention—focusing the searchlight on sound

Some fifty years after the first physiological studies of auditory attention, the field is now ripening, with exciting recent insights into the psychophysics, psychology, and neural basis of auditory attention. Current research seeks to unravel the complex interactions of pre-attentive and attentive processing of the acoustic scene, the role of auditory attention in mediating receptive-field plasticity in both auditory spatial and auditory feature processing, the contrasts and parallels between auditory and visual attention pathways and mechanisms, the interplay of bottom-up and top-down attentional mechanisms, the influential role of attention, goals, and expectations in shaping auditory processing, and the orchestration of diverse attentional effects at multiple levels from the cochlea to the cortex.

Hippocampal event-related potentials to tone duration deviance in a passive oddball paradigm in humans

The mismatch negativity (MMN), a component of event-related potentials (ERPs), is assumed to reflect a preattentive auditory discrimination process. Although an involvement of hippocampal structures in deviance detection was shown in animal experiments, invasive recordings in humans have not been able to provide such an evidence so far. In the current study, ERPs were recorded from intrahippocampal and scalp electrodes in 16 epilepsy patients. Stimulation consisted of trains of six tones, with one tone deviating in duration (100 vs. 50 ms). In the rhinal cortex, ERPs elicited by deviants were larger in amplitude than those of standards (around 200 ms). The rhinal activation was succeeded by a long-lasting hippocampal ERP component (around 350 ms). However, in contrast to the rhinal activation, hippocampal activation was also elicited by the 1st stimuli of the train and might, therefore, be related more to salience detection than to deviance detection. The current study provides evidence that the MMN is part of a multistage comparison process and that the rhinal cortex is part of its underlying cortical network.

A mismatch negativity study of local-global auditory processing

We used mismatch negativity (MMN) to examine structural encoding of local and global auditory patterns in perceptual memory. Unlike previous MMN studies of local-global auditory perceptual organization that used interval-contour stimuli, here we presented hierarchical stimuli in which local pattern organization formed global patterns. Importantly, our stimuli allowed independent manipulation of the two structural levels. In separate blocks, participants were exposed to frequent local standard patterns and rare local deviant patterns, or to frequent global standard patterns and rare global deviant patterns. Within each deviant pattern, the variation from the standard pattern could occur at onset (early), towards the end of the pattern (late) or over both time windows (both). To isolate pattern indexing at one level, the other level continuously changed (e.g., in a global standard block, local elements varied trial-by-trial). MMN was found only for global deviant patterns, and only when deviation occurred late in the pattern. In a separate behavioral experiment, global deviants were detected more often than local ones, although initial similarity followed by a late deviation from the standard pattern was not required for explicit deviant detection (as with the MMN). This report demonstrates neural structural encoding for global information, when independently manipulated from local information. Furthermore, it extends previous MMN findings that have revealed indexing of complex abstract auditory information to the realm of hierarchical perceptual organization.

A New View on the MMN and Attention Debate

The question of whether the mismatch negativity (MMN) is modulated by attention has been debated for over a decade. Although the MMN is widely regarded as reflecting a preattentive auditory process, many studies have shown attention effects on MMN. So, what does preattentive mean if attention can modulate the MMN? To understand the function of MMN in auditory processing, we need to shed new light on the “MMN and attention” debate. This review will discuss the apparent paradox that MMN can be modulated by attention and still be considered an attention-independent process, and provide a new framework for viewing the MMN system. The new model proposes that the principal factor governing MMN is the sound context. MMN generation relies on multiple processing mechanisms that are part of a larger system of auditory scene analysis.

The role of attention in the formation of auditory streams

There is controversy over whether stream segregation is an attention-dependent process. Part of the argument is related to the initial formation of auditory streams. It has been suggested that attention is needed only to form the streams, but not to maintain them once they have been segregated. The question of whether covert attention at the beginning of a to-be-ignored set of sounds will be enough to initiate the segregation process remains open. Here, we investigate this question by (1) using a methodology that does not require the participant to make an overt response to assess how the unattended sounds are organized and (2) structuring the test sound sequence to account for the covert attention explanation. The results of four experiments provide evidence to support the view that attention is not always required for the formation of auditory streams.

Implicit, intuitive, and explicit knowledge of abstract regularities in a sound sequence: an event-related brain potential study

Implicit knowledge has been proposed to be the substrate of intuition because intuitive judgments resemble implicit processes. We investigated whether the automatically elicited mismatch negativity (MMN) component of the auditory event-related potentials (ERPs) can reflect implicit knowledge and whether this knowledge can be utilized for intuitive sound discrimination. We also determined the sensitivity of the attention-and task-dependent P3 component to intuitive versus explicit knowledge. We recorded the ERPs elicited in an "abstract" oddball paradigm. Tone pairs roving over different frequencies but with a constant ascending inter-pair interval, were presented as frequent standard events. The standards were occasionally replaced by deviating, descending tone pairs. The ERPs were recorded under both ignore and attend conditions. Subjects were interviewed and classified on the basis of whether or not they could datect the deviants. The deviants elicited an MMN even in subjects who subsequent to the MMN recording did not express awareness of the deviants. This suggests that these subjects possessed implicit knowledge of the sound-sequence structure. Some of these subjects learned, in an associative training session, to detect the deviants intuitively, that is, they could detect the deviants but did not give a correct description of how the deviants differed from the standards. Intuitive deviant detection was not accompanied by P3 elicitation whereas subjects who developed explicit knowledge of the sound sequence during the training did show a P3 to the detected deviants.

Attentional modulation in the detection of irrelevant deviance: a simultaneous ERP/fMRI study

Little is known about the neural mechanisms that control attentional modulation of deviance detection in the auditory modality. In this study, we manipulated the difficulty of a primary task to test the relation between task difficulty and the detection of infrequent, task-irrelevant deviant (D) tones (1,300 Hz) presented among repetitive standard (S) tones (1,000 Hz). Simultaneous functional magnetic resonance imaging (fMRI)/event-related potentials (ERPs) were recorded from 21 subjects performing a two-alternative forced-choice duration discrimination task (short and long tones of equal probability). The duration of the short tone was always 50 msec. The duration of the long tone was 100 msec in the easy task and 60 msec in the difficult task. As expected, response accuracy decreased and response time (RT) increased in the difficult compared with the easy task. Performance was also poorer for D than for S tones, indicating distraction by task-irrelevant frequency information on trials involving D tones. In the difficult task, an amplitude increase was observed in the difference waves for N1 and P3a, ERP components associated with increased attention to deviant sounds. The mismatch negativity (MMN) response, associated with passive deviant detection, was larger in the easy task, demonstrating the susceptibility of this component to attentional manipulations. The fMRI contrast D > S in the difficult task revealed activation on the right superior temporal gyrus (STG) and extending ventrally into the superior temporal sulcus, suggesting this region's involvement in involuntary attention shifting toward unattended, infrequent sounds. Conversely, passive deviance detection, as reflected by the MMN, was associated with more dorsal activation on the STG. These results are consistent with the view that the dorsal STG region is responsive to mismatches between the memory trace of the standard and the incoming deviant sound, whereas the ventral STG region is activated by involuntary shifts of attention to task-irrelevant auditory features.

The effect of visual task difficulty and attentional direction on the detection of acoustic change as indexed by the Mismatch Negativity

Näätänen's model of auditory processing purports that attention does not affect the MMN. The present study investigates this claim through two different manipulations. First, the effect of visual task difficulty on the passively elicited MMN is assessed. Second, the MMNs elicited by stimuli under attended and ignored conditions are compared. In Experiment 1, subjects were presented with mixed sequences of equiprobable auditory and visual stimuli. The auditory stimuli consisted of standard (80 dB SPL 1000 Hz), frequency deviant (1050 Hz), and intensity deviant (70 dB SPL) tone pips. In a first instance, subjects were instructed to ignore the auditory stimulation and engage in an easy and difficult visual discrimination task (focused condition). Subsequently, they were asked to attend to both modalities and detect visual and auditory deviant stimuli (divided condition). The results indicate that the passively elicited MMN to frequency and intensity deviants did not significantly vary with visual task difficulty, in spite of the fact that the easy and difficult tasks showed a wide variation in performance. The manipulation of the attentional direction (focused vs. divided conditions) did result in a significant effect on the MMN elicited by the intensity, but not frequency, deviant. The intensity MMN was larger at frontal sites when subjects' attention was directed to both modalities as compared to only the visual modality. The attentional effect on the MMN to the intensity deviants only may be due to the specific deviant feature or the poorer perceptual discriminability of this deviant from the standard. Experiment 2 was designed to address this issue. The methods of Experiment 2 were identical to those of Experiment 1 with the exception that the intensity deviant (60 dB SPL) was made to be more perceptible than the frequency deviant (1016 Hz) when compared to the standard stimulus (80 dB SPL 1000 Hz). The results of Experiment 2 also demonstrated that the passively elicited MMN was not affected by large variations in visual task difficulty; this provides convincing evidence that the MMN is independent of visual task demands. Similarly to Experiment 1, the direction of attention again had a significant effect on the MMN. In Experiment 2, however, the frequency MMN (and not the intensity MMN) was larger at frontal sites during divided attention compared to focused visual attention. The most parsimonious explanation of these results is that attention enhances the discriminability of the deviant from the standard background stimulation. As such, small acoustic changes would benefit from attention whereas the discriminability of larger changes may not be significantly enhanced.

Effects of spatial separation and stimulus probability on the event-related potentials elicited by occasional changes in sound location

The ability to extract information about the spatial location of sounds plays an important role in auditory scene analysis. The present study examined the effects of spatial separation and stimulus probability on auditory event-related potentials (ERPs) to changes in sound location. In Experiment 1, we found that difference waves between ERPs elicited by standard and deviant stimuli showed a biphasic negative-positive response peaking around 126 and 226 ms after deviant onset. The amplitude of both responses increased with decreasing deviant stimulus probability, and increasing stimulus deviance. When the same stimuli were presented with equal probability for all locations (Experiment 2), there were no significant differences in the ERP amplitude and latency. These results suggest that the data reported in Experiment 1 are the result of contextual changes, rather than changes in simple acoustic features. Brain electrical source analyses are consistent with generators located in auditory cortices posterior to Heschel's gyrus. Although occasional changes in sound location elicit earlier peaks than the mismatch negativity (MMN) response reported for other types of deviation, their topographical distribution and behavior are consistent with MMN. The early latency of MMN for changes in sound location is interpreted in the context of an early-warning system to alert the organism to new sound sources in the environment.

Auditory streaming affects the processing of successive deviant and standard sounds

This study investigated the temporal relation between two early mechanisms of auditory information processing: the segregation of the auditory input into streams and the automatic deviance detection indicated by the mismatch negativity (MMN). To address this question the processing of successive deviant and standard tones within streaming and nonstreaming conditions was analyzed. In the streaming condition the amplitude reduction of MMN elicited by the second of two successive deviants was found to be smaller for successive deviants presented in different than in same streams. No corresponding MMN differences were obtained in a nonstreaming condition. These results demonstrate that stream segregation precedes deviance detection. Moreover, modulations of the N1 amplitudes elicited by successive standard tones in the streaming condition demonstrate that not only deviance-related processing but even initial sound processing is affected by streaming.

Effects of visual attentional load on low-level auditory scene analysis

The sharing of processing resources between the senses was investigated by examining the effects of visual task load on auditory event-related brain potentials (ERPs). In Experiment 1, participants completed both a zero-back and a one-back visual task while a tone pattern or a harmonic series was presented. N1 and P2 waves were modulated by visual task difficulty, but neither mismatch negativity (MMN) elicited by deviant stimuli from the tone pattern nor object-related negativity (ORN) elicited by mistuning from the harmonic series was affected. In Experiment 2, participants responded to identity (what) or location (where) in vision, while ignoring sounds alternating in either pitch (what) or location (where). Auditory ERP modulations were consistent with task difficulty, rather than with task specificity. In Experiment 3, we investigated auditory ERP generation under conditions of no visual task. The results are discussed with respect to a distinction between process-general (N1 and P2) and process-specific (MMN and ORN) auditory ERPs.

“…and were instructed to read a self-selected book while ignoring the auditory stimuli”: The effects of task demands on the mismatch negativity

OBJECTIVE

The Mismatch Negativity (MMN) is commonly recorded while the subject is reading, and instructed to ignore the auditory stimuli. It is generally assumed that the demands of the diversion task will have no effect on the MMN. Several studies, however, have reported that a diversion task presumably requiring strong attentional focus is associated with a smaller MMN than that elicited during a less demanding task. This study examines the effect of variations in the classical reading paradigm on the MMN.

METHODS

In Experiment 1, event-related potentials (ERP) were recorded while subjects were presented with standard (80 dB SPL 1000 Hz) and frequency deviant (1050 Hz) stimuli. Subjects were instructed to ignore the tone pips and, in separate conditions, engage in different tasks. They were asked to read a text or to sit passively. Subjects were informed that they would subsequently be queried or not about the content of the reading. In Experiment 2, the auditory sequence included the same standard (80 dB SPL 1000 Hz) but the deviant was changed to an intensity decrement (70 dB SPL). A different sample of subjects was again asked to ignore the auditory stimuli and engage in different reading tasks that would or not be followed by query.

RESULTS

In all task conditions, MMN was elicited by the frequency and intensity change. The intensity MMN did not significantly vary with task. A significant effect of task was, however, found for the frequency MMN. Its amplitude was largest when subjects were later queried about their reading.

CONCLUSIONS

This finding is counter-intuitive in light of previous research on the attentional modulation of the MMN. The pattern of frequency MMN results may relate to the differences in cortical excitability across tasks.

SIGNIFICANCE

The present results indicate that the nature of the diversion task may affect the MMN. The choice of diversion task during MMN recording should thus be carefully considered.

Functional magnetic resonance imaging measure of automatic and controlled auditory processing

Activity within fronto-striato-temporal regions during processing of unattended auditory deviant tones and an auditory target detection task was investigated using event-related functional magnetic resonance imaging. Activation within the middle frontal gyrus, inferior frontal gyrus, anterior cingulate gyrus, superior temporal gyrus, thalamus, and basal ganglia were analyzed for differences in activity patterns between the two stimulus conditions. Unattended deviant tones elicited robust activation in the superior temporal gyrus; by contrast, attended tones evoked stronger superior temporal gyrus activation and greater frontal and striatal activation. The results suggest that attention enhances neural activation evoked by auditory pitch deviance in auditory brain regions, possibly through top-down control from the dorsolateral prefrontal cortex involved in goal-directed selection and response generation.

The ‘F-complex’ and MMN tap different aspects of deviance

OBJECTIVE

To compare the 'F(fusion)-complex' with the Mismatch negativity (MMN), both components associated with automatic detection of changes in the acoustic stimulus flow.

METHODS

Ten right-handed adult native Hebrew speakers discriminated vowel-consonant-vowel (V-C-V) sequences /ada/ (deviant) and /aga/ (standard) in an active auditory 'Oddball' task, and the brain potentials associated with performance of the task were recorded from 21 electrodes. Stimuli were generated by fusing the acoustic elements of the V-C-V sequences as follows: base was always presented in front of the subject, and formant transitions were presented to the front, left or right in a virtual reality room. An illusion of a lateralized echo (duplex sensation) accompanied base fusion with the lateralized formant locations. Source current density estimates were derived for the net response to the fusion of the speech elements (F-complex) and for the MMN, using low-resolution electromagnetic tomography (LORETA). Statistical non-parametric mapping was used to estimate the current density differences between the brain sources of the F-complex and the MMN.

RESULTS

Occipito-parietal regions and prefrontal regions were associated with the F-complex in all formant locations, whereas the vicinity of the supratemporal plane was bilaterally associated with the MMN, but only in case of front-fusion (no duplex effect).

CONCLUSIONS

MMN is sensitive to the novelty of the auditory object in relation to other stimuli in a sequence, whereas the F-complex is sensitive to the acoustic features of the auditory object and reflects a process of matching them with target categories.

SIGNIFICANCE

The F-complex and MMN reflect different aspects of auditory processing in a stimulus-rich and changing environment: content analysis of the stimulus and novelty detection, respectively.

Effects of lorazepam on the neuromagnetic mismatch negativity (MMNm) and auditory evoked field component N100m

The mismatch negativity (MMN) as an auditory evoked potential is thought to reflect an early, preconscious attention process. While this component has gained great importance in studies on clinical populations and in basic research on auditory information processing, the involvement of different neurotransmitters in the generation of this component is less well understood. We investigated the impact of the benzodiazepine lorazepam as a GABA agonist on the neuromagnetic MMN (MMNm) and auditory evoked field component N100m. A group of 12 healthy subjects was studied in single blind trials under the following three conditions: after the intake of 1.25 mg lorazepam, 100 mg caffeine or placebo. Neuromagnetic recordings were obtained before drug intake and three times after it. Controlled visual attention was tested additionally using a version of the Continuous Performance Test (CPT). The neuromagnetic activity was reconstructed by a single moving dipole, and the dipole moment and its latency were compared between conditions and time points of measurement. Lorazepam diminished the signal detection performance in the CPT 25 min after drug intake. The source of the field component N100m was attenuated, most significantly in the recording 105 min after lorazepam intake. The attenuation of the MMNm under lorazepam became significant at 105 min, but was visually less apparent, because in all conditions a decrease of the MMNm dipole moment within the course of a session was observed. Besides the already known effects of benzodiazepines on controlled attention functions, preconscious attention functions as reflected in the MMN are impaired by acute benzodiazepine intake. MMN studies on clinical populations have to be controlled for the recording time because of the strong habituation of this component.

The dipole location shift within the auditory evoked neuromagnetic field components N100m and mismatch negativity (MMNm)

OBJECTIVE

To investigate whether within the latency range of the neuromagnetic mismatch negativity (MMNm) a similar dipole shift can be observed as found in previous studies for the auditory evoked field component N100m.

METHODS

For this purpose selected neuromagnetic data of 29 subjects were analysed in a time window of 15 ms before and 15 ms beyond the peak maximum of both components. In our oddball paradigm, we applied frequency, duration and intensity deviants within one block. The time course of dipole location was analysed by means of a repeated measure analysis of variance (ANOVA).

RESULTS

As expected, N100m dipoles shifted significantly from superior to inferior and from posterior to anterior within their latency range. In analogy, the MMNm dipoles of duration and intensity deviants also exhibited a significant shift from posterior to anterior within their latency range. However, the MMNm dipoles of all 3 deviants did not shift significantly from superior to inferior. Concerning this direction, the ANOVA revealed a significant TIME*COMPONENT interaction between the N100m and the MMNm of duration and intensity deviants.

CONCLUSIONS

The finding of a different time course of N100m and MMNm dipoles does not support the assumption that the MMN represents an amplitude- and latency-modulated auditory N100 response.

Automatic and controlled processing of acoustic and phonetic contrasts

Changes in the temporal properties of the speech signal provide important cues for phoneme identification. An impairment or inability to detect such changes may adversely affect one's ability to understand spoken speech. The difference in meaning between the Finnish words tuli (fire) and tuuli (wind), for example, lies in the difference between the duration of the vowel /u/. Detecting changes in the temporal properties of the speech signal, therefore, is critical for distinguishing between phonemes and identifying words. In the current study, we tested whether detection of changes in speech sounds, in native Finnish speakers, would vary as a function of the position within the word that the informational changes occurred (beginning, middle, or end) by evaluating how length contrasts in segments of three-syllable Finnish pseudo-words and their acoustic correlates were discriminated. We recorded a combination of cortical components of event-related brain potentials (MMN, N2b, P3b) along with behavioral measures of the perception of the same sounds. It was found that speech sounds were not processed differently than non-speech sounds in the early stages of auditory processing indexed by MMN. Differences occurred only in later stages associated with controlled processes. The effects of position and attention on speech and non-speech stimuli are discussed.

Automatic detection of motion direction changes in the human brain

The possibility that the visual system is able to register unattended changes is still debated in the literature. However, it is difficult to understand how a sensory system becomes aware of unexpected salient changes in the environment if attention is required for detecting them. The ability to automatically detect unusual changes in the sensory environment is an adaptive function which has been confirmed in other sensory modalities (i.e. audition). This deviance detector mechanism has proven to be based on a preattentive nonrefractory memory-comparison process. To investigate whether such automatic change detection mechanism exists in the human visual system, we recorded event-related potentials to sudden changes in a biologically important feature, motion direction. Unattended sinusoidal gratings varying in motion direction in the peripheral field were presented while subjects performed a central task with two levels of difficulty. We found a larger negative displacement in the electrophysiological response elicited by less frequent stimuli (deviant) at posterior scalp locations. Within the latency range of the visual evoked component N2, this differential response was elicited independently of the direction of motion and processing load. Moreover, the results showed that the negativity elicited by deviants was not related to a differential refractory state between the electrophysiological responses to frequent and infrequent directions of motion, and that it was restricted to scalp locations related to motion processing areas. The present results suggest that a change-detection mechanism sensitive to unattended changes in motion direction may exist in the human visual system.

Perceptual learning modulates sensory evoked response during vowel segregation

With practice, people become better at discriminating two similar stimuli, such as two sounds. The neural mechanisms that underlie this type of learning have been of interest to researchers investigating neural plasticity associated with learning and recovery of function following stroke. We utilized event related potentials (ERP) to study the neural substrates underlying auditory discrimination learning. Stimuli were five steady-state American English vowels. On each trial, participants were presented with a pair of vowels created by summing together the digital waveforms of two different vowels. Listeners were instructed to identify both vowels in the pair. ERPs were recorded during two sessions separated by 1 week. Half of the participants practised the discrimination task during the intervening week while the other half served as controls and did not receive any training. Trained listeners showed greater improvement in accuracy than untrained participants. In both groups, vowels generated N1 and P2 waves at the fronto-central and temporal scalp regions. The behavioral effects of training were paralleled by decreased N1 and P2 latencies as well as enhanced P2 amplitude in the trained compared with untrained listeners. The effects of training on sensory evoked responses are consistent with the proposal that perceptual learning is associated with changes in sensory cortices.

Effects of Attentional Load on Auditory Scene Analysis

The effects of attention on the neural processes underlying auditory scene analysis were investigated through the manipulation of auditory task load. Participants were asked to focus their attention on tuned and mistuned stimuli presented to one ear and to ignore similar stimuli presented to the other ear. For both tuned and mistuned sounds, long (standard) and shorter (deviant) duration stimuli were presented in both ears. Auditory task load was manipulated by varying task instructions. In the easier condition, participants were asked to press a button for deviant sounds (target) at the attended location, irrespective of tuning. In the harder condition, participants were further asked to identify whether the targets were tuned or mistuned. Participants were faster in detecting targets defined by duration only than by both duration and tuning. At the unattended location, deviant stimuli generated a mismatch negativity wave at frontocentral sites whose amplitude decreased with increasing task demand. In comparison, standard mistuned stimuli generated an object-related negativity at central sites whose amplitude was not affected by task difficulty. These results show that the processing of sound sequences is differentially affected by attentional load than is the processing of sounds that occur simultaneously (i.e., sequential vs. simultaneous grouping processes), and that they each recruit distinct neural networks.

MMN in the visual modality: a review

The mismatch negativity (MMN) component is an event-related potential (ERP) that can be elicited by any change in the acoustic environment, and it is related to memory-based, automatic processing mechanisms, and attentional capture processes. This component is well defined in the auditory modality. However, there is still a great controversy about its existence in the visual modality. This paper reviews the studies that are relevant with regard to memory-based, automatic deviance detection ERPs in the visual system. The paper discusses the main strengths and limitations of those studies and suggests what directions should be taken for future research.

Nociceptive processing in the human brain of infrequent task-relevant and task-irrelevant noxious stimuli. A study with event-related potentials evoked by CO2 laser radiant heat stimuli

Laser evoked potentials (LEPs) are nociceptive-related brain responses to activation of cutaneous nociceptors by laser radiant heat stimuli. We previously showed that LEP amplitude during the P2 period (approximately 400 ms) was increased by rare noxious stimuli, inside and outside the focus of spatial attention. It was postulated that this effect reflected a P3a response indexing an involuntary shift of attention. In the present study, LEPs were recorded in a three-stimulus oddball paradigm, commonly used to evoke P3a (or novelty-P3). CO(2) laser-induced noxious stimuli were delivered on one hand (80%, frequent). Two series of rare stronger-intensity deviant stimuli were randomly intermixed: target stimuli (10%) were delivered on the same hand while distractor stimuli (10%) were delivered on the other hand. Subjects were instructed to count targets. During an additional session, strong stimuli were delivered alone on one hand without instruction (100%, no-task stimuli). All stimulus types evoked a first positivity around 360 ms (P360). Targets and distractors elicited a late positive complex (LPC) around 465-500 ms. Topography of LPC to distractors was central and significantly more anterior than that of LPC to targets. Distractor LPC corresponds to P3a (or novelty-P3) indexing an involuntary orientation of attention toward an unexpected new/deviant event. It suggests that at least an early part of the LEP positivity (P360) is independent of P3-activities.

Effects of sleep onset on the mismatch negativity (MMN) to frequency deviants using a rapid rate of presentation

This study examined the effects of sleep onset-the transition from a waking, conscious state to one of sleep and unconsciousness-on the mismatch negativity (MMN) following frequency deviants when a rapid rate of stimulus presentation is employed. The MMN is thought to reflect a brief-lasting sensory memory. Rapid rates of stimulus presentation should guard the sensory memory from fading. A 1,000 Hz standard stimulus was presented every 150 ms. At random, on 6.6% of the trials, the standard was changed to either a large 2,000 or a small 1,100 Hz deviant. During alert wakefulness (when subject ignored the stimuli and read a book), the large deviant elicited a larger deviant related negativity (DRN) than did the small deviant. This negativity may be a composite of both N1 and MMN activity while that following the small deviant is probably a 'true' MMN. The large deviant continued to elicit a DRN in relaxed wakefulness (eyes closed) and Stages 1 and 2 of sleep, although it was much reduced in amplitude. A significant MMN was recorded for the small deviant only in alert wakefulness. The failure to observe an MMN to small deviance and the attenuation of the DRN to large deviance at sleep onset therefore is probably not due to a decay of sensory memory. It is more likely that cortical encoding of both the standard and deviant is weakened during sleep onset because of prior thalamic inhibition of sensory input.

MMN and attention: competition for deviance detection

We addressed the question of whether the mismatch negativity (MMN) event-related potential reflects an attention-independent process. Previous studies have shown that the MMN response to intensity deviation was significantly reduced or even abolished when attention was highly focused on a concurrent sound channel, whereas no conclusive evidence of attentional sensitivity has been obtained for frequency deviation. We tested a new hypothesis suggesting that competition between detection of identical deviations in attended and unattended channels and the biasing of this competition induced by the subject's task account for the observed MMN effects. In a fast-paced dichotic paradigm, we set up competition for frequency MMN and removed it for intensity MMN. We found that frequency MMN was now abolished in the unattended channel, whereas the amplitude of the intensity MMN was unaffected. These results support the competition hypothesis and suggest that selective attention in and of itself does not affect the MMN. Top-down processes can determine what information reaches the deviance-detection process when changes in multiple channels vie for the same MMN resource and one of the competing changes is relevant for the subject's task.

The electrophysiological net response ('F-complex') to spatial fusion of speech elements forming an auditory object

OBJECTIVE

The purpose of this study was to define and analyze the brain activity associated with fusion of speech elements to form an auditory object and to study the effects of presenting the elements at different spatial locations (duplex stimulus).

METHODS

Stimuli were formant transitions (presented to the front, left or right of the subject) and base (presented to the front), that fused to result in V-C-V sequences /aga/ and /ada/. Ten right-handed, adult, native Hebrew speakers discriminated each fused stimulus, and the brain potentials associated with performance of the task were recorded from 21 electrodes. The net-fusion response, the 'F(fusion)-complex', was extracted by subtracting the sum of potentials to the base and formant transitions from the potentials to the fused sound. Low resolution electromagnetic tomography analysis (LORETA) was performed to assess the timing and brain location of the fusion process.

RESULTS

The 'F-complex', comprising of the difference N(1), P(2), N(2b) (FN(1), FP(2), FN(2b)) components could be identified for each of the stimuli and reflected a process indicating inhibition, occlusion or both, with right ear advantage in fusion. LORETA analyses indicate sequential processing of speech fusion in the temporal lobes, beginning with right prominence in FN(1) and FP(2) shifting to a more symmetrical pattern in FN(2).

CONCLUSIONS

The electrophysiological correlates of speech fusion highlight the uniqueness of speech perception and the brain areas involved in its analysis.

Left hemispheric dipole locations of the neuromagnetic mismatch negativity to frequency, intensity and duration deviants

The aim of the current study was to differentiate the sources of neuromagnetic mismatch negativity (MMNm) to deviants of different features. For this purpose, the MMNm of twenty-one healthy subjects (seven males) were recorded left-hemispherically. Subjects were stimulated monaurally in an oddball paradigm with standard tones of 1000 Hz and three different kinds of mismatch tones (frequency, duration and intensity deviants). Data analysis revealed mean MMNm dipole locations anterior, inferior and more medial than the N100m dipoles. The mean difference between the N100m and MMNm dipoles was in the range of up to 6 mm in one dimension. The dipole locations of all three kinds of deviants differed significantly from each other. The MMNm dipoles of both frequency and duration deviants were found to be significantly inferior to the corresponding source of intensity deviants, while the MMNm dipoles of duration and frequency deviants significantly differed in anterior-posterior direction. This differentiation between sources emphasizes the importance of feature analysis in MMN(m) generation.

Stepping out of the spotlight: MMN attenuation as a function of distance from the attended location

In this report we present neurophysiological evidence that spatial separation between attended and unattended sound sources influences a listener's ability to register changes in sounds presented outside the focus of attention. Standard and deviant stimuli were presented at three azimuth locations. Participants were asked to press a key whenever they heard a deviant at a designated location. Mismatch negativity waves were generated for deviants at the attended location and were attenuated for deviants occurring 30 degrees away from the attended location. Mismatch negativities were not observed at distances of 60 degrees or more. The results are consistent with a spotlight model of auditory attention in which the processing of stimuli outside the attentional focus is attenuated as a function of increasing distance from the focus.

Temporal integration: intentional sound discrimination does not modulate stimulus-driven processes in auditory event synthesis

OBJECTIVE

Our previous study showed that the auditory context could influence whether two successive acoustic changes occurring within the temporal integration window (approximately 200ms) were pre-attentively encoded as a single auditory event or as two discrete events (Cogn Brain Res 12 (2001) 431). The aim of the current study was to assess whether top-down processes could influence the stimulus-driven processes in determining what constitutes an auditory event.

METHODS

Electroencepholagram (EEG) was recorded from 11 scalp electrodes to frequently occurring standard and infrequently occurring deviant sounds. Within the stimulus blocks, deviants either occurred only in pairs (successive feature changes) or both singly and in pairs. Event-related potential indices of change and target detection, the mismatch negativity (MMN) and the N2b component, respectively, were compared with the simultaneously measured performance in discriminating the deviants.

RESULTS

Even though subjects could voluntarily distinguish the two successive auditory feature changes from each other, which was also indicated by the elicitation of the N2b target-detection response, top-down processes did not modify the event organization reflected by the MMN response.

CONCLUSIONS

Top-down processes can extract elemental auditory information from a single integrated acoustic event, but the extraction occurs at a later processing stage than the one whose outcome is indexed by MMN.

SIGNIFICANCE

Initial processes of auditory event-formation are fully governed by the context within which the sounds occur. Perception of the deviants as two separate sound events (the top-down effects) did not change the initial neural representation of the same deviants as one event (indexed by the MMN), without a corresponding change in the stimulus-driven sound organization.

Hemispheric lateralization of the processing of consonant-vowel syllables (formant transitions): effects of stimulus characteristics and attentional demands on evoked magnetic fields

It is still unsettled in how far temporal resolution of dynamic acoustic events (formant transitions) or phonetic/linguistic processes contribute to predominant left-hemisphere encoding of consonant-vowel syllables. To further elucidate the underlying mechanisms, evoked magnetic fields in response to consonant-vowel events (synthetic versus spoken) were recorded (oddball design: standards=binaural/ba/, deviants=dichotic/ba/-/da/; 20 right-handed subjects) under different attentional conditions (visual distraction versus stimulus identification). Spoken events yielded a left-lateralized peak phase of the mismatch field (MMF; 150-200ms post-stimulus onset) in response to right-ear deviants during distraction. By contrast, pre-attentive processing of synthetic items gave rise to a left-enhanced MMF onset (100ms), but failed to elicit later lateralization effects. In case of directed attention, synthetic deviants elicited a left-pronounced MMF peak resembling the pre-attentive response to natural syllables. These interactions of MMF asymmetry with signal structure and attentional load indicate two distinct successive left-lateralization effects: signal-related operations and representation of 'phonetic traces'. Furthermore, a right-lateralized early MMF component (100ms) emerged in response to natural syllables during pre-attentive processing and to synthetic stimuli in case of directed attention. Conceivably, these effects indicate right hemisphere operations prior to phonetic evaluation such as periodicity representation. Two distinct time windows showed correlations between dichotic listening performance and ear effects on magnetic responses reflecting early gain factors (ca. 75ms post-stimulus onset) and binaural fusion strategies (ca. 200ms), respectively. Finally, gender interacted with MMF lateralization, indicating different processing strategies in case of artificial speech signals.

Top-down effects can modify the initially stimulus-driven auditory organization

We recorded event-related potentials (ERPs) and magnetic fields (ERFs) of the human brain to determine whether top-down control could modulate the initial organization of sound representations in the auditory cortex. We presented identical sound stimulation and manipulated top-down processes by instructing participants to either ignore the sounds (Ignore condition), to detect pitch changes (Attend-pitch condition), or to detect violations of a repeating tone pattern (Attend-pattern condition). The ERP results obtained in the Attend-pattern condition dramatically differed from those obtained with the other two task instructions. The magnetoencephalogram (MEG) findings were fully compatible, showing that the neural populations involved in detecting pattern violations differed from those involved in detecting pitch changes. The results demonstrate a top-down effect on the sound representation maintained in auditory cortex.

Automatic and controlled processing of melodic contour and interval information measured by electrical brain activity

Most work on how pitch is encoded in the auditory cortex has focused on tonotopic (absolute) pitch maps. However, melodic information is thought to be encoded in the brain in two different "relative pitch" forms, a domain-general contour code (up/down pattern of pitch changes) and a music-specific interval code (exact pitch distances between notes). Event-related potentials were analyzed in nonmusicians from both passive and active oddball tasks where either the contour or the interval of melody-final notes was occasionally altered. The occasional deviant notes generated a right frontal positivity peaking around 350 msec and a central parietal P3b peaking around 580 msec that were present only when participants focused their attention on the auditory stimuli. Both types of melodic information were encoded automatically in the absence of absolute pitch cues, as indexed by a mismatch negativity wave recorded during the passive conditions. The results indicate that even in the absence of musical training, the brain is set up to automatically encode music-specific melodic information, even when absolute pitch information is not available.

Effects of water on cortical excitability in humans

The effects of water on cortical excitability, measured using magnetoencephalographic recordings, were investigated in a sample of 19 healthy volunteers in a double-blind, placebo experiment comparing water with saline solution. Spontaneous magnetoencephalogram as well as auditory-evoked magnetic fields were recorded before and after the drinking of 750 mL water (9 subjects) or saline solution (10 subjects) and during and after hyperventilation following the drinking conditions. Hyperventilation was used to enhance the hypothesized synchronizing effect of water on spontaneous magnetoencephalographic activity. In addition, the magnetic fields were measured during a dichotic listening task under attended and unattended conditions. The prediction, that intake of water, because of induced cell swelling, will increase neuronal excitability and lead to an increased synchronization of the spontaneous magnetoencephalogram during hyperventilation was confirmed. Hyperventilation induced an increase of spectral power in all frequency bands particularly theta and delta power after water drinking. Furthermore, there was an increase of magnetic mismatch negativity (MMNm) amplitude in attended conditions and a simultaneous decrease in unattended conditions after water drinking. N1m (magnetic N1 wave) revealed significant changes during experimental conditions: increase after drinking and decrease after hyperventilation in both groups. MMNm for attended conditions showed a high positive correlation with osmolality changes (difference in the mol solute per kg water before and after drinking); N1m and PNm (magnetic processing negativity) as well as MMNm for unattended conditions showed significant correlations with subjective ratings of thirst and mood state.

Involuntary attention in children as a function of sound source location: evidence from event-related potentials

OBJECTIVES

The present study addressed the question of whether location of the auditory stimulation source affects an involuntary attention triggering to the deviant sounds in a passive oddball paradigm in 8-10-year-old children.

METHODS

Using free-field stimulation two late event-related potentials components were examined: the mismatch negativity (MMN), indexing preconscious sound change detection and the P3a, indexing involuntary attention switch. Data were registered to frequency changes in sounds of different complexities in two experimental conditions. In the 'in-front' condition, the sound sequences were presented through the loudspeakers situated in front of a participant on both sides of the video display. In the 'on-sides' condition, the sources of auditory and visual stimuli were separated by moving the loudspeakers to the sides of the participant.

RESULTS

The MMN amplitude or the MMN and P3a latencies varied in neither stimulus class significantly as a function of sound location. However, significantly larger P3 amplitude was found in the 'in-front', as compared to the 'on-sides' condition.

CONCLUSIONS

The present results indicate enhanced involuntary attention switching in children when unattended auditory events occur within the space attended actively for visual modality. Such study design favouring cross-modal integration can be advantageous when studying involuntary auditory attention and its impairment in children.

Mismatch negativity is unaffected by top-down predictive information

The mismatch negativity (MMN) event-related brain potential is assumed to reflect a stimulus-driven change detection process. We examined whether MMN is sensitive to volitional control by testing whether MMN is affected by the subject's foreknowledge of the sound changes. Subjects were instructed to produce a sequence of button presses by pressing one button frequently and another infrequently. In the predictable condition, the frequently pressed button triggered the standard tone, the other button the deviant tone. In the unpredictable condition, each button press triggered the next tone of a prearranged standard/deviant sequence. No difference was found in the MMN amplitude, latency, or scalp distribution between the predictable and unpredictable conditions. This suggests that there is no direct top-down control over the MMN-generating process.

Cortical processing of change detection: dissociation between natural vowels and two-frequency complex tones

We compared magnetoencephalographic responses for natural vowels and for sounds consisting of two pure tones that represent the two lowest formant frequencies of these vowels. Our aim was to determine whether spectral changes in successive stimuli are detected differently for speech and nonspeech sounds. The stimuli were presented in four blocks applying an oddball paradigm (20% deviants, 80% standards): (i) /alpha/ tokens as deviants vs. /i/ tokens as standards; (ii) /e/ vs. /i/; (iii) complex tones representing /alpha/ formants vs. /i/ formants; and (iv) complex tones representing /e/ formants vs. /i/ formants. Mismatch fields (MMFs) were calculated by subtracting the source waveform produced by standards from that produced by deviants. As expected, MMF amplitudes for the complex tones reflected acoustic deviation: the amplitudes were stronger for the complex tones representing /alpha/ than /e/ formants, i.e., when the spectral difference between standards and deviants was larger. In contrast, MMF amplitudes for the vowels were similar despite their different spectral composition, whereas the MMF onset time was longer for /e/ than for /alpha/. Thus the degree of spectral difference between standards and deviants was reflected by the MMF amplitude for the nonspeech sounds and by the MMF latency for the vowels.

Encoding of temporal speech features (formant transients) during binaural and dichotic stimulus application: a whole-head magnetencephalography study

Spoken-word recognition depends upon the encoding of relevant 'information bearing elements' of the acoustic speech signal. For example, relatively rapid shifts of spectral energy distribution (formant transients) cue the perception of stop consonant-vowel (CV) syllables such as /ba/, /ga/, and /da/. A variety of data indicate left-hemisphere superiority with respect to the processing of formant transients. To further delineate the underlying neurophysiological mechanisms, evoked cortical fields in response to CV syllables (oddball design; frequent stimulus=binaural /ga/; four deviant constellations: Binaural /ba/, binaural /da/, left /da/ (left ear deviant)-right /ga/, right /da/ (right ear deviant)-left /ga/) were recorded by means of whole-head magnetencephalography (MEG; 151 channels) under two different conditions of attentional demands (visual distraction versus reaction to prespecified stimuli). (a) During binaural stimulus presentation attention toward target events resulted in a significantly enhanced mismatch field (MMNm, magnetic analogue to the mismatch negativity) over the left as compared to the right hemisphere. In contrast, preattentive processing of the CV syllables failed MMNm lateralization effects. (b) Dichotic application of /da/ elicited a larger contralateral MMNm amplitude in subjects with right ear advantage (REA) at behavioral testing. In addition, right ear deviants yielded a stronger ipsilateral response than the left ear cognates. Taken together, these data indicate bilateral preattentive processing and subsequent attention-related predominant left-hemisphere encoding of formant transients at the level of the supratemporal plane. Furthermore, REA during dichotic application of CV syllables seems to be linked to functional dissociation of the two hemispheres during auditory processing.

Effects of visual attentional load on auditory processing

Auditory evoked potentials were recorded while participants attended to visually presented digits. The difficulty of the visual task was manipulated by requiring participants to process only the current digit (0-back) or both the current and the preceding digit (1-back). Tones deviating in frequency from standard tones elicited a frontal mismatch negativity peaking around 200 ms which did not vary with visual task. However, decreasing the visual task load enhanced a right-temporal positive wave peaking around 200 ms when tones were presented slowly, and a frontocentral negative wave peaking around 450 ms when tones were presented more rapidly. The degree to which task-irrelevant sounds are processed therefore depends on the degree to which a visual task engages attentional resources.

Phonemes, intensity and attention: differential effects on the mismatch negativity (MMN)

Auditory event-related potentials (ERPs) to speech sounds were recorded in a demanding selective attention task to measure how the mismatch negativity (MMN) was affected by attention, deviant feature, and task relevance, i.e., whether the feature was target or nontarget type. With vowel-consonant-vowel (VCV) disyllables randomly presented to the right and left ears, subjects attended to the VCVs in one ear. In different conditions, the subjects responded to either intensity or phoneme deviance in the consonant. The position of the deviance within the VCV also varied, being in the first (VC), second (CV), or both (VC and CV) formant-transition regions. The MMN amplitudes were larger for deviants in the attended ear. Task relevance affected the MMNs to intensity and phoneme deviants differently. Target-type intensity deviants yielded larger MMNs than nontarget types. For phoneme deviants there was no main effect of task relevance, but there was a critical interaction with deviance position. The both position gave the largest MMN amplitudes for target-type phoneme deviants, as it did for target- and nontarget-type intensity deviants. The MMN for nontarget-type phoneme deviants, however, showed an inverse pattern such that the MMN for the both position had the smallest amplitude despite its greater spectro-temporal deviance and its greater detectability when it was the target. These data indicate that the MMN reflects differences in phonetic structure as well as differences in acoustic spectral-energy structure of the deviant stimuli. Furthermore, the task relevance effects demonstrate that top-down controls not only affect the amplitude of the MMN, but can reverse the pattern of MMN amplitudes among different stimuli.

Event-related brain activity associated with auditory pattern processing

One of the basic properties of the auditory system is the ability to analyze complex temporal patterns. Here, we investigated the neural activity associated with auditory pattern processing using event-related brain potentials. Participants were presented with a continuously repeating sequence of four tones with rare changes in either the frequency or timing of one of the tones. Both frequency- and time-deviant sounds generated mismatch negativity (MMN) waves that peaked at midline central electrode sites and inverted in polarity at inferior temporal and occipital sites, consistent with generators in the supratemporal plane. The MMN scalp topography was similar for the frequency- and time-deviant stimuli, suggesting that both spectral and temporal relations among elements of an auditory pattern are encoded in a unified memory trace.

Processing of auditory stimuli during visual attention in patients with schizophrenia

BACKGROUND

The aim of this study was to evaluate attentional functioning in patients with schizophrenia with an emphasis on automatic processes using the mismatch negativity (MMN) component of the event-related brain potential.

METHODS

Participants were asked to perform a challenging visual discrimination task and simultaneously ignore auditory stimuli presented in the background. In different blocks of trials, the background was either a sequence of tones that included rare deviant tones differing in pitch or a sequence of tones that alternated regularly in pitch with occasional deviant repetitions. In a second experiment, participants were asked to actively respond to auditory deviant stimuli.

RESULTS

Visual targets generated smaller N1, N2, and P3b deflections in patients than in control subjects, suggesting deficits in controlled attentional processes. Auditory deviant stimuli elicited an MMN that varied in scalp distribution as a function of the deviant-type (pitch vs. pattern). In patients with schizophrenia, impaired auditory discrimination was associated with altered MMN topography and reduced MMN amplitude.

CONCLUSIONS

These findings are consistent with impaired automatic processes in patients with schizophrenia, which may contribute to their difficulties in processing complex auditory sequences. The timing and scalp topography are consistent with impaired auditory pattern analysis in posterior association cortices.

A distributed cortical network for auditory sensory memory in humans

Auditory sensory memory is a critical first stage in auditory perception that permits listeners to integrate incoming acoustic information with stored representations of preceding auditory events. Here, we investigated the neural circuits of sensory memory using behavioral and electrophysiological measures of auditory processing in patients with unilateral brain damage to dorsolateral prefrontal cortex, posterior association cortex, or the hippocampus. We used a neurophysiological marker of an automatic component of sensory memory, the mismatch negativity (MMN), which can be recorded without overt attention. In comparison with control subjects, temporal-parietal patients had impaired auditory discrimination and reduced MMN amplitudes with both effects evident only following stimuli presented in the ear contralateral to the lesioned hemisphere. This suggests that auditory sensory memories are predominantly stored in auditory cortex contralateral to the ear of presentation. Dorsolateral prefrontal damage impaired performance and reduced MMNs elicited by deviant stimuli presented in either ear, implying that dorsolateral prefrontal cortices have a bilateral facilitatory effect on sensory memory storage. Hippocampal lesions did not affect either performance or electrophysiological measures. The results provide evidence of a temporal-prefrontal neocortical network critical for the transient storage of auditory stimuli.

Event-related brain activity associated with auditory pattern processing

One of the basic properties of the auditory system is the ability to analyse complex temporal patterns. Here, we investigated the neural activity associated with auditory pattern processing using event-related brain potentials. Participants were presented with a continuously repeating sequence of four tones with rare changes in either the frequency or timing of one of the tones. Both frequency- and time-deviant sounds generated mismatch negativity (MMN) waves that peaked at midline central electrode sites and inverted in polarity at inferior temporal and occipital sites, consistent with generators in the supratemporal plane. The MMN scalp topography was similar for the frequency- and time-deviant stimuli, suggesting that both spectral and temporal relations among elements of an auditory pattern are encoded in a unified memory trace.

Temporal dynamics of early perceptual processing

Recordings of electrical and magnetic brain responses to sensory stimulation provide high-resolution measures of the time course of early perceptual processing. Spatio-temporal analyses of brain activity patterns during the first 200 ms after stimulus presentation have characterized the timing of attentional selection processes and different stages of feature encoding and pattern analyses. Recent studies that incorporate blood flow neuroimaging techniques provide support for mechanisms of early selection of attended visual inputs in extrastriate cortical pathways. The spatial tuning properties of early auditory selection have also been delineated. Electrical and magnetic responses that index the encoding of higher-order pattern information have been identified in both visual and auditory modalities and localized to specific cortical areas.