Stepping out of the spotlight: MMN attenuation as a function of distance from the attended location

Enhanced electrophysiological responses to explicitly predicted and pre-imagined inputs, with confirmation from online decoding with neuro-feedback

Neural responses to sensory inputs can scale with the likelihood of encountering the input. This is consistent with the predictive coding framework, in that the human brain is expected to be less responsive to predicted inputs. Typically, however, prediction is not explicitly measured. It is inferred from the probability of encountering an event. When an input is explicitly predicted, responses to predicted inputs can be enhanced. Here, we ask if this effect can be ascribed to a generic priming effect, from pre-cogitating about one of two possible inputs. Consistent with this, we find that P300s (a relatively late event-related potential measured with electroencephalography) are greater for explicitly predicted audio and visual inputs, and that this effect cannot be distinguished from a priming effect from pre-imagining audio or visual presentations. Evidence indicates that participants engaged in pre-imagining presentations, as we were able to decode online what type of presentation (audio or visual) they were imagining with a high success rate (approx. 73%), and we encouraged compliance with neuro-feedback regarding this success rate. Our data confirm that human cortex can be more responsive to inputs that have been subject to pre-cogitation-including explicit predictions. This highlights that while anticipatory processes can reduce responding to likely inputs, they can also enhance responding to explicitly predicted inputs.

Stimulus-Specific Adaptation (SSA) in the Auditory System: Functional Relevance and Underlying Mechanisms

Rapid detection of novel stimuli that appear suddenly in the surrounding environment is crucial for an animal's survival. Stimulus-specific adaptation (SSA) may be an important mechanism underlying novelty detection. In this review, we discuss the latest advances in SSA research by addressing four main aspects: 1) the frequency dependence of SSA and the origin of SSA in the auditory cortex: 2) spatial SSA and its comparison with frequency SSA: 3) feature integration in SSA and its implications in novelty detection: 4) functional significance and the physiological mechanism of SSA. Although SSA has been extensively investigated, the cognitive insights from SSA studies are extremely limited. Future work should aim to bridge these gaps.

Cortical plasticity elicited by acoustically cued monetary losses: an ERP study

Both human and animal studies have demonstrated remarkable findings of experience-induced plasticity in the cortex. Here, we investigated whether the widely used monetary incentive delay (MID) task changes the neural processing of incentive cues that code expected monetary outcomes. We used a novel auditory version of the MID task, where participants responded to acoustic cues that coded expected monetary losses. To investigate task-induced brain plasticity, we presented incentive cues as deviants during passive oddball tasks before and after two sessions of the MID task. During the oddball task, we recorded the mismatch-related negativity (MMN) as an index of cortical plasticity. We found that two sessions of the MID task evoked a significant enhancement of MMN for incentive cues that predicted large monetary losses, specifically when monetary cue discrimination was essential for maximising monetary outcomes. The task-induced plasticity correlated with the learning-related neural activity recorded during the MID task. Thus, our results confirm that the processing of (loss)incentive auditory cues is dynamically modulated by previously learned monetary outcomes.

Feature binding in auditory modality requires attention as indexed by mismatch negativity and N2b in an active discrimination task

Currently, there are two opposing views on feature binding in the auditory modality: according to behavioral studies, this process requires focused attention, whereas electrophysiological studies suggest that feature binding may be fully automatic and independent of attention. Here, we examined whether feature binding depends on higher-level attentional processes by manipulating the attentional focus. We used four auditory stimuli that differed in two features: pitch and location. Two rare deviants could be detected within a sequence of two frequent standards exclusively by feature conjunctions rather than by any single feature alone. Event-related potentials to auditory stimuli were analyzed for four conditions: selective attention to target auditory deviants, selective ignoring of nontarget auditory deviants, nonselective distributed attention to all stimuli within auditory modality, and selective attention diverted from auditory to visual modality. The negative difference (Nd) between event-related potentials to deviants and standards was measured within two time intervals, corresponding to mismatch negativity (100-200 ms) and N2b (200-300 ms). Only under the condition of selective attention to specific feature conjunctions, prominent Nd was observed in mismatch negativity as well in N2b time ranges, whereas no significant Nd was observed in other conditions. As Nd is considered a marker of deviance processing, our results support the view that deviance was not detected unless attention was focused on the stimuli, thus supporting the view that feature binding requires attention.

Indexing sensory plasticity: Evidence for distinct Predictive Coding and Hebbian learning mechanisms in the cerebral cortex

The Roving Mismatch Negativity (MMN), and Visual LTP paradigms are widely used as independent measures of sensory plasticity. However, the paradigms are built upon fundamentally different (and seemingly opposing) models of perceptual learning; namely, Predictive Coding (MMN) and Hebbian plasticity (LTP). The aim of the current study was to compare the generative mechanisms of the MMN and visual LTP, therefore assessing whether Predictive Coding and Hebbian mechanisms co-occur in the brain. Forty participants were presented with both paradigms during EEG recording. Consistent with Predictive Coding and Hebbian predictions, Dynamic Causal Modelling revealed that the generation of the MMN modulates forward and backward connections in the underlying network, while visual LTP only modulates forward connections. These results suggest that both Predictive Coding and Hebbian mechanisms are utilized by the brain under different task demands. This therefore indicates that both tasks provide unique insight into plasticity mechanisms, which has important implications for future studies of aberrant plasticity in clinical populations.

Surprise responses in the human brain demonstrate statistical learning under high concurrent cognitive demand

The ability to learn about regularities in the environment and to make predictions about future events is fundamental for adaptive behaviour. We have previously shown that people can implicitly encode statistical regularities and detect violations therein, as reflected in neuronal responses to unpredictable events that carry a unique prediction error signature. In the real world, however, learning about regularities will often occur in the context of competing cognitive demands. Here we asked whether learning of statistical regularities is modulated by concurrent cognitive load. We compared electroencephalographic metrics associated with responses to pure-tone sounds with frequencies sampled from narrow or wide Gaussian distributions. We showed that outliers evoked a larger response than those in the centre of the stimulus distribution (i.e., an effect of surprise) and that this difference was greater for physically identical outliers in the narrow than in the broad distribution. These results demonstrate an early neurophysiological marker of the brain's ability to implicitly encode complex statistical structure in the environment. Moreover, we manipulated concurrent cognitive load by having participants perform a visual working memory task while listening to these streams of sounds. We again observed greater prediction error responses in the narrower distribution under both low and high cognitive load. Furthermore, there was no reliable reduction in prediction error magnitude under high-relative to low-cognitive load. Our findings suggest that statistical learning is not a capacity limited process, and that it proceeds automatically even when cognitive resources are taxed by concurrent demands.

Attending to auditory memory

Attention to memory describes the process of attending to memory traces when the object is no longer present. It has been studied primarily for representations of visual stimuli with only few studies examining attention to sound object representations in short-term memory. Here, we review the interplay of attention and auditory memory with an emphasis on 1) attending to auditory memory in the absence of related external stimuli (i.e., reflective attention) and 2) effects of existing memory on guiding attention. Attention to auditory memory is discussed in the context of change deafness, and we argue that failures to detect changes in our auditory environments are most likely the result of a faulty comparison system of incoming and stored information. Also, objects are the primary building blocks of auditory attention, but attention can also be directed to individual features (e.g., pitch). We review short-term and long-term memory guided modulation of attention based on characteristic features, location, and/or semantic properties of auditory objects, and propose that auditory attention to memory pathways emerge after sensory memory. A neural model for auditory attention to memory is developed, which comprises two separate pathways in the parietal cortex, one involved in attention to higher-order features and the other involved in attention to sensory information. This article is part of a Special Issue entitled SI: Auditory working memory.

Paying attention to MMN in schizophrenia

The aim of this review is to explore the phenomenon of reduced mismatch negativity (MMN) in persons with schizophrenia and the possible relationship it has with attention impairments. In doing so we discuss (i) the prediction error account of MMN, (ii) reduced MMN as a faulty predictive processing system in persons with schizophrenia, (iii) the role of these systems in relevance filtering and attentional resource protection, (iv) attentional impairments in persons with schizophrenia, and (v) research that has explored MMN and attention in schizophrenia groups. Our review of the literature suggests that no study has appropriately examined the functional impact of smaller MMN in schizophrenia on the performance of a concurrent attention task. We conclude that future research should explore this notion further in the hope that it might embed MMN findings within outcomes of functional significance to individuals with the illness and those providing treatment. This article is part of a Special Issue entitled SI: Prediction and Attention.

Age-related changes in sound localisation ability

Auditory spatial processing is an important ability in everyday life and allows the processing of omnidirectional information. In this review, we report and compare data from psychoacoustic and electrophysiological experiments on sound localisation accuracy and auditory spatial discrimination in infants, children, and young and older adults. The ability to process auditory spatial information changes over lifetime: the perception of the acoustic space develops from an initially imprecise representation in infants and young children to a concise representation of spatial positions in young adults and the respective performance declines again in older adults. Localisation accuracy shows a strong deterioration in older adults, presumably due to declined processing of binaural temporal and monaural spectro-temporal cues. When compared to young adults, the thresholds for spatial discrimination were strongly elevated both in young children and older adults. Despite the consistency of the measured values the underlying causes for the impaired performance might be different: (1) the effect is due to reduced cognitive processing ability and is thus task-related; (2) the effect is due to reduced information about the auditory space and caused by declined processing in auditory brain stem circuits; and (3) the auditory space processing regime in young children is still undergoing developmental changes and the interrelation with spatial visual processing is not yet established. In conclusion, we argue that for studying auditory space processing over the life course, it is beneficial to investigate spatial discrimination ability instead of localisation accuracy because it more reliably indicates changes in the processing ability.

Rapid cortical dynamics associated with auditory spatial attention gradients

Behavioral and EEG studies suggest spatial attention is allocated as a gradient in which processing benefits decrease away from an attended location. Yet the spatiotemporal dynamics of cortical processes that contribute to attentional gradients are unclear. We measured EEG while participants (n = 35) performed an auditory spatial attention task that required a button press to sounds at one target location on either the left or right. Distractor sounds were randomly presented at four non-target locations evenly spaced up to 180° from the target location. Attentional gradients were quantified by regressing ERP amplitudes elicited by distractors against their spatial location relative to the target. Independent component analysis was applied to each subject's scalp channel data, allowing isolation of distinct cortical sources. Results from scalp ERPs showed a tri-phasic response with gradient slope peaks at ~300 ms (frontal, positive), ~430 ms (posterior, negative), and a plateau starting at ~550 ms (frontal, positive). Corresponding to the first slope peak, a positive gradient was found within a central component when attending to both target locations and for two lateral frontal components when contralateral to the target location. Similarly, a central posterior component had a negative gradient that corresponded to the second slope peak regardless of target location. A right posterior component had both an ipsilateral followed by a contralateral gradient. Lateral posterior clusters also had decreases in α and β oscillatory power with a negative slope and contralateral tuning. Only the left posterior component (120-200 ms) corresponded to absolute sound location. The findings indicate a rapid, temporally-organized sequence of gradients thought to reflect interplay between frontal and parietal regions. We conclude these gradients support a target-based saliency map exhibiting aspects of both right-hemisphere dominance and opponent process models.

Neural correlates of auditory stream segregation: an analysis of onset- and change-related responses

The temporal order discrimination of target tone pairs is hindered by the presence of flanker tones but is improved when the flanker tones are captured by a separate stream of tones that match the flankers in frequency [Bregman and Rudnicky (1975). J. Exp. Psychol. 1, 263-267]. In an event-related potential (ERP) study with these stimuli, listeners' mismatch negativity (MMN) responses were temporally linked to the position of the changing target tones, irrespective of streaming. In contrast, N1 response latency varied as a function of the perceived grouping of flanker tones established by previous behavioral studies, providing a neurophysiological index of auditory stream segregation.

How does the extraction of local and global auditory regularities vary with context?

How does the human brain extract regularities from its environment? There is evidence that short range or ‘local’ regularities (within seconds) are automatically detected by the brain while long range or ‘global’ regularities (over tens of seconds or more) require conscious awareness. In the present experiment, we asked whether participants' attention was needed to acquire such auditory regularities, to detect their violation or both. We designed a paradigm in which participants listened to predictable sounds. Subjects could be distracted by a visual task at two moments: when they were first exposed to a regularity or when they detected violations of this regularity. MEG recordings revealed that early brain responses (100–130 ms) to violations of short range regularities were unaffected by visual distraction and driven essentially by local transitional probabilities. Based on global workspace theory and prior results, we expected that visual distraction would eliminate the long range global effect, but unexpectedly, we found the contrary, i.e. late brain responses (300–600 ms) to violations of long range regularities on audio-visual trials but not on auditory only trials. Further analyses showed that, in fact, visual distraction was incomplete and that auditory and visual stimuli interfered in both directions. Our results show that conscious, attentive subjects can learn the long range dependencies present in auditory stimuli even while performing a visual task on synchronous visual stimuli. Furthermore, they acquire a complex regularity and end up making different predictions for the very same stimulus depending on the context (i.e. absence or presence of visual stimuli). These results suggest that while short-range regularity detection is driven by local transitional probabilities between stimuli, the human brain detects and stores long-range regularities in a highly flexible, context dependent manner.

Neurocognitive mechanisms of statistical-sequential learning: what do event-related potentials tell us?

Statistical-sequential learning (SL) is the ability to process patterns of environmental stimuli, such as spoken language, music, or one's motor actions, that unfold in time. The underlying neurocognitive mechanisms of SL and the associated cognitive representations are still not well understood as reflected by the heterogeneity of the reviewed cognitive models. The purpose of this review is: (1) to provide a general overview of the primary models and theories of SL, (2) to describe the empirical research - with a focus on the event-related potential (ERP) literature - in support of these models while also highlighting the current limitations of this research, and (3) to present a set of new lines of ERP research to overcome these limitations. The review is articulated around three descriptive dimensions in relation to SL: the level of abstractness of the representations learned through SL, the effect of the level of attention and consciousness on SL, and the developmental trajectory of SL across the life-span. We conclude with a new tentative model that takes into account these three dimensions and also point to several promising new lines of SL research.

Mismatch negativity-like potential (MMN-like) in the subthalamic nuclei in Parkinson's disease patients

An infrequent change to an otherwise repetitive sequence of stimuli leads to the generation of mismatch negativity (MMN), even in the absence of attention. This evoked negative response occurs in the scalp-recorded electroencephalogram (EEG) over the temporal and frontal cortices, 100-250 ms after onset of the deviant stimulus. The MMN is used to detect sensory information processing. The aim of our study was to investigate whether MMN can be recorded in the subthalamic nuclei (STN) as evidence of auditory information processing on an unconscious level within this structure. To our knowledge, MMN has never been recorded in the human STN. We recorded intracerebral EEG using a MMN paradigm in five patients with Parkinson's disease (PD) who were implanted with depth electrodes in the subthalamic nuclei (STN). We found far-field MMN when intracerebral contacts were connected to an extracranial reference electrode. In all five PD patients (and nine of ten intracerebral electrodes), we also found near-field MMN-like potentials when intracerebral contacts were referenced to one another, and in some electrodes, we observed phase reversals in these potentials. The mean time-to-peak latency of the intracerebral MMN-like potentials was 214 ± 38 ms (median 219 ms). We reveal MMN-like potentials in bilateral STN. This finding provides evidence that STN receives sensory (auditory) information from other structures. The question for further research is whether STN receives such signals through a previously described hyperdirect pathway between STN and frontal cortex (a known generator of the MMN potential) and if the STN contributes to sensorimotor integration.

Demand and modality of directed attention modulate "pre-attentive" sensory processes in schizophrenia patients and nonpsychiatric controls

BACKGROUND

Mismatch negativity (MNN) and P3a are event related potential (ERP) measures of early sensory information processing. These components are usually conceptualized as being "pre-attentive" and therefore immune to changes with variations in attentional functioning. This study aimed to determine whether manipulations of attention influence the amplitudes and latencies of MMN and P3a and, if so, the extent to which these early sensory processes govern concurrent behavioral vigilance performance in schizophrenia patients and normal subjects.

METHODS

Schizophrenia patients (SZ; n = 20) and Nonpsychiatric Control Subjects (NCS; n = 20) underwent auditory ERP testing to assess MMN and P3a across 4 EEG recording sessions in which attentional demand (low vs. high) and sensory modality of directed attention (visual vs. auditory) were experimentally varied.

RESULTS

Across conditions, SZ patients exhibited deficits in MMN and P3a amplitudes. Significant amplitude and latency modulation were observed in both SZ and NCS but there were no group-by-condition interactions. The amount of MMN amplitude attenuation from low- to high-demand tasks was significantly associated with increased vigilance performance in both SZ and NCS groups (r = -0.67 and r = -0.60). Several other robust associations were also observed among neurophysiologic, clinical and cognitive variables.

CONCLUSIONS

Attentional demand and modality of directed attention significantly influence the amplitude and latencies of "pre-attentive" ERP components in both SZ and NCS. Deficits in MMN and P3a were not "normalized" when attention was directed to the auditory stimuli in schizophrenia patients. The adaptive modulation of early sensory information processing appears to govern concurrent attentional task performance. The temporal window reflecting automatic sensory discrimination as indexed as MMN and P3a may serve as a gateway to some higher order cognitive operations necessary for psychosocial functioning.

Aging, spatial cues, and single- versus dual-task performance in competing speech perception

Older individuals often report difficulty coping in situations with multiple conversations in which they at times need to "tune out" the background speech and at other times seek to monitor competing messages. The present study was designed to simulate this type of interaction by examining the cost of requiring listeners to perform a secondary task in conjunction with understanding a target talker in the presence of competing speech. The ability of younger and older adults to understand a target utterance was measured with and without requiring the listener to also determine how many masking voices were presented time-reversed. Also of interest was how spatial separation affected the ability to perform these two tasks. Older adults demonstrated slightly reduced overall speech recognition and obtained less spatial release from masking, as compared to younger listeners. For both younger and older listeners, spatial separation increased the costs associated with performing both tasks together. The meaningfulness of the masker had a greater detrimental effect on speech understanding for older participants than for younger participants. However, the results suggest that the problems experienced by older adults in complex listening situations are not necessarily due to a deficit in the ability to switch and/or divide attention among talkers.

Probing the lifetimes of auditory novelty detection processes

Auditory novelty detection can be fractionated into multiple cognitive processes associated with their respective neurophysiological signatures. In the present study we used high-density scalp event-related potentials (ERPs) during an active version of the auditory oddball paradigm to explore the lifetimes of these processes by varying the stimulus onset asynchrony (SOA). We observed that early MMN (90-160 ms) decreased when the SOA increased, confirming the evanescence of this echoic memory system. Subsequent neural events including late MMN (160-220 ms) and P3a/P3b components of the P3 complex (240-500 ms) did not decay with SOA, but showed a systematic delay effect supporting a two-stage model of accumulation of evidence. On the basis of these observations, we propose a distinction within the MMN complex of two distinct events: (1) an early, pre-attentive and fast-decaying MMN associated with generators located within superior temporal gyri (STG) and frontal cortex, and (2) a late MMN more resistant to SOA, corresponding to the activation of a distributed cortical network including fronto-parietal regions.

The mismatch negativity: a review of underlying mechanisms

The mismatch negativity (MMN) is a brain response to violations of a rule, established by a sequence of sensory stimuli (typically in the auditory domain) [Näätänen R. Attention and brain function. Hillsdale, NJ: Lawrence Erlbaum; 1992]. The MMN reflects the brain's ability to perform automatic comparisons between consecutive stimuli and provides an electrophysiological index of sensory learning and perceptual accuracy. Although the MMN has been studied extensively, the neurophysiological mechanisms underlying the MMN are not well understood. Several hypotheses have been put forward to explain the generation of the MMN; amongst these accounts, the "adaptation hypothesis" and the "model adjustment hypothesis" have received the most attention. This paper presents a review of studies that focus on neuronal mechanisms underlying the MMN generation, discusses the two major explanatory hypotheses, and proposes predictive coding as a general framework that attempts to unify both.

The influence of strongly focused visual attention on the detection of change in an auditory pattern

The mismatch negativity, an ERP that reflects the detection of change in the auditory environment, is considered to be a relatively automatic process. Its automaticity has by in large been studied using the oddball paradigm, in which a physical feature of a frequently presented standard stimulus is changed. In the present study, the automaticity of the MMN is tested using a MMN elicited by a violation of a more abstract auditory pattern. Fourteen subjects were presented with an alternating pattern of two tones (ABABAB) that was occasionally broken by deviant repetitions (e.g., ABABABBBAB). The alternating tones were separated by 1 or 6 semitones in different conditions. The subjects were engaged in a continuous multiple object tracking (MOT) task and thus ignored the auditory stimuli. Difficulty of the MOT task was manipulated by increasing the number of objects to be tracked. Subjects were also asked to read a text and ignore the auditory stimuli in another condition. A much larger MMN was elicited by pattern violations in the 6 than in the 1 semitone condition. The difficult visual task should have presumably required greater attentional focus than the easy task, and performance did deteriorate during the difficult MOT. The MMN, however, was not affected by the demands of the MOT task. This finding suggests that the MMN elicited by the violation of a pattern is not affected by the presumed attentional demands of a difficult continuous task such as multiple object tracking.

The mismatch negativity (MMN) in basic research of central auditory processing: a review

In the present article, the basic research using the mismatch negativity (MMN) and analogous results obtained by using the magnetoencephalography (MEG) and other brain-imaging technologies is reviewed. This response is elicited by any discriminable change in auditory stimulation but recent studies extended the notion of the MMN even to higher-order cognitive processes such as those involving grammar and semantic meaning. Moreover, MMN data also show the presence of automatic intelligent processes such as stimulus anticipation at the level of auditory cortex. In addition, the MMN enables one to establish the brain processes underlying the initiation of attention switch to, conscious perception of, sound change in an unattended stimulus stream.

Auditory attention—focusing the searchlight on sound

Some fifty years after the first physiological studies of auditory attention, the field is now ripening, with exciting recent insights into the psychophysics, psychology, and neural basis of auditory attention. Current research seeks to unravel the complex interactions of pre-attentive and attentive processing of the acoustic scene, the role of auditory attention in mediating receptive-field plasticity in both auditory spatial and auditory feature processing, the contrasts and parallels between auditory and visual attention pathways and mechanisms, the interplay of bottom-up and top-down attentional mechanisms, the influential role of attention, goals, and expectations in shaping auditory processing, and the orchestration of diverse attentional effects at multiple levels from the cochlea to the cortex.

Does attention play a role in dynamic receptive field adaptation to changing acoustic salience in A1?

Acoustic filter properties of A1 neurons can dynamically adapt to stimulus statistics, classical conditioning, instrumental learning and the changing auditory attentional focus. We have recently developed an experimental paradigm that allows us to view cortical receptive field plasticity on-line as the animal meets different behavioral challenges by attending to salient acoustic cues and changing its cortical filters to enhance performance. We propose that attention is the key trigger that initiates a cascade of events leading to the dynamic receptive field changes that we observe. In our paradigm, ferrets were initially trained, using conditioned avoidance training techniques, to discriminate between background noise stimuli (temporally orthogonal ripple combinations) and foreground tonal target stimuli. They learned to generalize the task for a wide variety of distinct background and foreground target stimuli. We recorded cortical activity in the awake behaving animal and computed on-line spectrotemporal receptive fields (STRFs) of single neurons in A1. We observed clear, predictable task-related changes in STRF shape while the animal performed spectral tasks (including single tone and multi-tone detection, and two-tone discrimination) with different tonal targets. A different set of task-related changes occurred when the animal performed temporal tasks (including gap detection and click-rate discrimination). Distinctive cortical STRF changes may constitute a "task-specific signature". These spectral and temporal changes in cortical filters occur quite rapidly, within 2min of task onset, and fade just as quickly after task completion, or in some cases, persisted for hours. The same cell could multiplex by differentially changing its receptive field in different task conditions. On-line dynamic task-related changes, as well as persistent plastic changes, were observed at a single-unit, multi-unit and population level. Auditory attention is likely to be pivotal in mediating these task-related changes since the magnitude of STRF changes correlated with behavioral performance on tasks with novel targets. Overall, these results suggest the presence of an attention-triggered plasticity algorithm in A1 that can swiftly change STRF shape by transforming receptive fields to enhance figure/ground separation, by using a contrast matched filter to filter out the background, while simultaneously enhancing the salient acoustic target in the foreground. These results favor the view of a nimble, dynamic, attentive and adaptive brain that can quickly reshape its sensory filter properties and sensori-motor links on a moment-to-moment basis, depending upon the current challenges the animal faces. In this review, we summarize our results in the context of a broader survey of the field of auditory attention, and then consider neuronal networks that could give rise to this phenomenon of attention-driven receptive field plasticity in A1.

A New View on the MMN and Attention Debate

The question of whether the mismatch negativity (MMN) is modulated by attention has been debated for over a decade. Although the MMN is widely regarded as reflecting a preattentive auditory process, many studies have shown attention effects on MMN. So, what does preattentive mean if attention can modulate the MMN? To understand the function of MMN in auditory processing, we need to shed new light on the “MMN and attention” debate. This review will discuss the apparent paradox that MMN can be modulated by attention and still be considered an attention-independent process, and provide a new framework for viewing the MMN system. The new model proposes that the principal factor governing MMN is the sound context. MMN generation relies on multiple processing mechanisms that are part of a larger system of auditory scene analysis.

Synaptic plasticity and dysconnection in schizophrenia

Current pathophysiological theories of schizophrenia highlight the role of altered brain connectivity. This dysconnectivity could manifest 1) anatomically, through structural changes of association fibers at the cellular level, and/or 2) functionally, through aberrant control of synaptic plasticity at the synaptic level. In this article, we review the evidence for these theories, focusing on the modulation of synaptic plasticity. In particular, we discuss how dysconnectivity, observed between brain regions in schizophrenic patients, could result from abnormal modulation of N-methyl-D-aspartate (NMDA)-dependent plasticity by other neurotransmitter systems. We focus on the implication of the dysconnection hypothesis for functional imaging at the systems level. In particular, we review recent advances in measuring plasticity in the human brain using functional magnetic resonance imaging (fMRI) and electroencephalography (EEG) that can be used to address dysconnectivity in schizophrenia. Promising experimental paradigms include perceptual and reinforcement learning. We describe how theoretical and causal models of brain responses might contribute to a mechanistic understanding of synaptic plasticity in schizophrenia.

Graded visual attention modulates brain responses evoked by task-irrelevant auditory pitch changes

Previous studies suggested that auditory change-specific neural responses are attention-independent and reflect central auditory processing. The automaticity of the brain's response to infrequent changes in pitch within a series of auditory tone pips was examined in parallel functional magnetic resonance imaging (fMRI) and event-related potential (ERP) studies. Subjects performed a continuous perceptual-motor visual tracking task at two levels of difficulty while simultaneously hearing a series of task-irrelevant standard tone pips and infrequent pitch-deviant tones. fMRI results revealed that the unattended pitch-deviant tones strongly activated superior temporal and frontal cortical regions. These activations were significantly modulated by the tracking difficulty of the primary task. ERP results revealed that the amplitude of the scalp-negative component evoked by deviant tones (MMN) was attenuated during the more difficult tracking task. Our results demonstrate that the brain's response to task-irrelevant sensory changes is strongly influenced by intermodal attentional demands.

The effect of visual task difficulty and attentional direction on the detection of acoustic change as indexed by the Mismatch Negativity

Näätänen's model of auditory processing purports that attention does not affect the MMN. The present study investigates this claim through two different manipulations. First, the effect of visual task difficulty on the passively elicited MMN is assessed. Second, the MMNs elicited by stimuli under attended and ignored conditions are compared. In Experiment 1, subjects were presented with mixed sequences of equiprobable auditory and visual stimuli. The auditory stimuli consisted of standard (80 dB SPL 1000 Hz), frequency deviant (1050 Hz), and intensity deviant (70 dB SPL) tone pips. In a first instance, subjects were instructed to ignore the auditory stimulation and engage in an easy and difficult visual discrimination task (focused condition). Subsequently, they were asked to attend to both modalities and detect visual and auditory deviant stimuli (divided condition). The results indicate that the passively elicited MMN to frequency and intensity deviants did not significantly vary with visual task difficulty, in spite of the fact that the easy and difficult tasks showed a wide variation in performance. The manipulation of the attentional direction (focused vs. divided conditions) did result in a significant effect on the MMN elicited by the intensity, but not frequency, deviant. The intensity MMN was larger at frontal sites when subjects' attention was directed to both modalities as compared to only the visual modality. The attentional effect on the MMN to the intensity deviants only may be due to the specific deviant feature or the poorer perceptual discriminability of this deviant from the standard. Experiment 2 was designed to address this issue. The methods of Experiment 2 were identical to those of Experiment 1 with the exception that the intensity deviant (60 dB SPL) was made to be more perceptible than the frequency deviant (1016 Hz) when compared to the standard stimulus (80 dB SPL 1000 Hz). The results of Experiment 2 also demonstrated that the passively elicited MMN was not affected by large variations in visual task difficulty; this provides convincing evidence that the MMN is independent of visual task demands. Similarly to Experiment 1, the direction of attention again had a significant effect on the MMN. In Experiment 2, however, the frequency MMN (and not the intensity MMN) was larger at frontal sites during divided attention compared to focused visual attention. The most parsimonious explanation of these results is that attention enhances the discriminability of the deviant from the standard background stimulation. As such, small acoustic changes would benefit from attention whereas the discriminability of larger changes may not be significantly enhanced.

“…and were instructed to read a self-selected book while ignoring the auditory stimuli”: The effects of task demands on the mismatch negativity

OBJECTIVE

The Mismatch Negativity (MMN) is commonly recorded while the subject is reading, and instructed to ignore the auditory stimuli. It is generally assumed that the demands of the diversion task will have no effect on the MMN. Several studies, however, have reported that a diversion task presumably requiring strong attentional focus is associated with a smaller MMN than that elicited during a less demanding task. This study examines the effect of variations in the classical reading paradigm on the MMN.

METHODS

In Experiment 1, event-related potentials (ERP) were recorded while subjects were presented with standard (80 dB SPL 1000 Hz) and frequency deviant (1050 Hz) stimuli. Subjects were instructed to ignore the tone pips and, in separate conditions, engage in different tasks. They were asked to read a text or to sit passively. Subjects were informed that they would subsequently be queried or not about the content of the reading. In Experiment 2, the auditory sequence included the same standard (80 dB SPL 1000 Hz) but the deviant was changed to an intensity decrement (70 dB SPL). A different sample of subjects was again asked to ignore the auditory stimuli and engage in different reading tasks that would or not be followed by query.

RESULTS

In all task conditions, MMN was elicited by the frequency and intensity change. The intensity MMN did not significantly vary with task. A significant effect of task was, however, found for the frequency MMN. Its amplitude was largest when subjects were later queried about their reading.

CONCLUSIONS

This finding is counter-intuitive in light of previous research on the attentional modulation of the MMN. The pattern of frequency MMN results may relate to the differences in cortical excitability across tasks.

SIGNIFICANCE

The present results indicate that the nature of the diversion task may affect the MMN. The choice of diversion task during MMN recording should thus be carefully considered.

The functional organization of auditory working memory as revealed by fMRI

Spatial and nonspatial auditory tasks preferentially recruit dorsal and ventral brain areas, respectively. However, the extent to which these auditory differences reflect specific aspects of mental processing has not been directly studied. In the present functional magnetic resonance imaging experiment, participants encoded and maintained either the location or the identity of a sound for a delay period of several seconds and then subsequently compared that information with a second sound. Relative to sound localization, sound identification was associated with greater hemodynamic activity in the left rostral superior temporal gyrus. In contrast, localizing sounds recruited greater activity in the parietal cortex, posterior temporal lobe, and superior frontal sulcus. The identification differences were most prominent during the early stage of the trial, whereas the location differences were most evident during the late (i.e., comparison) stage. Accordingly, our results suggest that auditory spatial and identity dissociations as revealed by functional imaging may be dependent to some degree on the type of processing being carried out. In addition, dorsolateral prefrontal and lateral superior parietal areas showed greater activity during the comparison as opposed to the earlier stage of the trial, regardless of the type of auditory task, consistent with results from visual working memory studies.

Spatial auditory attention is modulated by tactile priming

Previous studies have shown that cross-modal processing affects perception at a variety of neuronal levels. In this study, event-related brain responses were recorded via whole-head magnetoencephalography (MEG). Spatial auditory attention was directed via tactile pre-cues (primes) to one of four locations in the peripersonal space (left and right hand versus face). Auditory stimuli were white noise bursts, convoluted with head-related transfer functions, which ensured spatial perception of the four locations. Tactile primes (200-300 ms prior to acoustic onset) were applied randomly to one of these locations. Attentional load was controlled by three different visual distraction tasks. The auditory P50m (about 50 ms after stimulus onset) showed a significant "proximity" effect (larger responses to face stimulation as well as a "contralaterality" effect between side of stimulation and hemisphere). The tactile primes essentially reduced both the P50m and N100m components. However, facial tactile pre-stimulation yielded an enhanced ipsilateral N100m. These results show that earlier responses are mainly governed by exogenous stimulus properties whereas cross-sensory interaction is spatially selective at a later (endogenous) processing stage.

From Sensory to Long-Term Memory

Abstract. Everyday experience tells us that some types of auditory sensory information are retained for long periods of time. For example, we are able to recognize friends by their voice alone or identify the source of familiar noises even years after we last heard the sounds. It is thus somewhat surprising that the results of most studies of auditory sensory memory show that acoustic details, such as the pitch of a tone, fade from memory in ca. 10-15 s. One should, therefore, ask (1) what types of acoustic information can be retained for a longer term, (2) what circumstances allow or help the formation of durable memory records for acoustic details, and (3) how such memory records can be accessed. The present review discusses the results of experiments that used a model of auditory recognition, the auditory memory reactivation paradigm. Results obtained with this paradigm suggest that the brain stores features of individual sounds embedded within representations of acoustic regularities that have been detected for the sound patterns and sequences in which the sounds appeared. Thus, sounds closely linked with their auditory context are more likely to be remembered. The representations of acoustic regularities are automatically activated by matching sounds, enabling object recognition.

Perceptual learning modulates sensory evoked response during vowel segregation

With practice, people become better at discriminating two similar stimuli, such as two sounds. The neural mechanisms that underlie this type of learning have been of interest to researchers investigating neural plasticity associated with learning and recovery of function following stroke. We utilized event related potentials (ERP) to study the neural substrates underlying auditory discrimination learning. Stimuli were five steady-state American English vowels. On each trial, participants were presented with a pair of vowels created by summing together the digital waveforms of two different vowels. Listeners were instructed to identify both vowels in the pair. ERPs were recorded during two sessions separated by 1 week. Half of the participants practised the discrimination task during the intervening week while the other half served as controls and did not receive any training. Trained listeners showed greater improvement in accuracy than untrained participants. In both groups, vowels generated N1 and P2 waves at the fronto-central and temporal scalp regions. The behavioral effects of training were paralleled by decreased N1 and P2 latencies as well as enhanced P2 amplitude in the trained compared with untrained listeners. The effects of training on sensory evoked responses are consistent with the proposal that perceptual learning is associated with changes in sensory cortices.

Effects of Attentional Load on Auditory Scene Analysis

The effects of attention on the neural processes underlying auditory scene analysis were investigated through the manipulation of auditory task load. Participants were asked to focus their attention on tuned and mistuned stimuli presented to one ear and to ignore similar stimuli presented to the other ear. For both tuned and mistuned sounds, long (standard) and shorter (deviant) duration stimuli were presented in both ears. Auditory task load was manipulated by varying task instructions. In the easier condition, participants were asked to press a button for deviant sounds (target) at the attended location, irrespective of tuning. In the harder condition, participants were further asked to identify whether the targets were tuned or mistuned. Participants were faster in detecting targets defined by duration only than by both duration and tuning. At the unattended location, deviant stimuli generated a mismatch negativity wave at frontocentral sites whose amplitude decreased with increasing task demand. In comparison, standard mistuned stimuli generated an object-related negativity at central sites whose amplitude was not affected by task difficulty. These results show that the processing of sound sequences is differentially affected by attentional load than is the processing of sounds that occur simultaneously (i.e., sequential vs. simultaneous grouping processes), and that they each recruit distinct neural networks.