Attentional modulation in the detection of irrelevant deviance: a simultaneous ERP/fMRI study

Discrepancies in the late auditory potentials of post-anoxic patients: watch out for focal brain lesions, a pilot retrospective study

AIMS

Late auditory evoked potentials, and notably mismatch negativity (MMN) and P3 responses, can be used as part of the multimodal prognostic evaluation in post-anoxic disorders of consciousness (DOC). MMN response preferentially stems from the temporal cortex and the arcuate fasciculus. Situations with discrepant evaluations, for example MMN absent but P3 present, are frequent and difficult to interpret. We hypothesize that discrepant MMN-/P3+ results could reflect a higher prevalence of lesions in MMN generating regions. This study presents correlations between neurophysiological and neuroradiological results.

METHODS

This retrospective study was conducted on 38 post-anoxic DOC patients. Brain lesions were analyzed on 3T MRI both anatomically and through computation of the local arcuate fasciculus fractional anisotropy values on Diffusion Tensor Imaging sequences. Neurophysiological data and outcome were also analyzed.

RESULTS

Our cohort included 8 MMN-/P3+, 7 MMN+/P3+, 21 MMN-/P3- and 2 MMN-/P3+ patients, assessed at a median delay of 20.5 days since cardiac arrest. Our results show that MMN-/P3+ patients tended to have fewer temporal and basal ganglia lesions than MMN-/P3- patients, and more than MMN+/P3+ patients (p-values for trend: p=0.02 for temporal and p=0.02 for basal ganglia lesions). There was a statistical difference across groups for mean fractional anisotropy values in the arcuate fasciculus (p=0.008). The percentage of patients regaining consciousness at three months in MMN-/P3+ patients was higher than in MMN-/P3- patients and lower than in MMN+/P3+ patients.

CONCLUSION

This study suggests that discrepancies in late auditory evoked potentials may be linked to focal post-anoxic brain lesions, visible on brain MRI.

Mindfulness Training Improves Attention: Evidence from Behavioral and Event-related Potential Analyses

Mindfulness meditation helps to improve attentional capacity. However, the neural correlates that indicate the mechanism through which mindfulness improves attention are unclear. To address this gap, we aimed to assess the effects of mindfulness training on sustained attentional capacity. Event-related potentials (ERPs) associated with the modified sustained attention response task (mSART) were used in this study. A total of 45 college students were randomly assigned to either the mindfulness group (n = 21) or the control group (n = 24). Participants in the mindfulness group received a three-week mindfulness training. The self-report results showed that the mindfulness group reported higher mindfulness scores (observing and non-judgment of inner experiences) after the training. The mindfulness group also scored lower on the state anxiety than the control group. Behavioral results also showed that self-caught mind wandering in the mindfulness group significantly decreased after the training, and the mindfulness group showed a faster response after the training. The ERP results showed that N2 amplitudes in the post-test were significantly greater than those in the pre-test in the mindfulness group. We did not find any interactions between group and time for P3. The findings suggest that mindfulness training can effectively improve sustained attentional capacity, as indicated by reduced mind wandering and increased N2 responses.

Neural modulations in the auditory cortex during internal and external attention tasks: A single-patient intracranial recording study

Brain sensory processing is not passive, but is rather modulated by our internal state. Different research methods such as non-invasive imaging methods and intracranial recording of the local field potential (LFP) have been used to study to what extent sensory processing and the auditory cortex in particular are modulated by selective attention. However, at the level of the single- or multi-units the selective attention in humans has not been tested. In addition, most previous research on selective attention has explored externally-oriented attention, but attention can be also directed inward (i.e., internal attention), like spontaneous self-generated thoughts and mind-wandering. In the present study we had a rare opportunity to record multi-unit activity (MUA) in the auditory cortex of a patient. To complement, we also analyzed the LFP signal of the macro-contact in the auditory cortex. Our experiment consisted of two conditions with periodic beeping sounds. The participants were asked either to count the beeps (i.e., an "external attention" condition) or to recall the events of the previous day (i.e., an "internal attention" condition). We found that the four out of seven recorded units in the auditory cortex showed increased firing rates in "external attention" compared to "internal attention" condition. The beginning of this attentional modulation varied across multi-units between 30-50 msec and 130-150 msec from stimulus onset, a result that is compatible with an early selection view. The LFP evoked potential and induced high gamma activity both showed attentional modulation starting at about 70-80 msec. As the control, for the same experiment we recorded MUA activity in the amygdala and hippocampus of two additional patients. No major attentional modulation was found in the control regions. Overall, we believe that our results provide new empirical information and support for existing theoretical views on selective attention and spontaneous self-generated cognition.

Brain-correlates of processing local dependencies within a statistical learning paradigm

Statistical learning refers to the implicit mechanism of extracting regularities in our environment. Numerous studies have investigated the neural basis of statistical learning. However, how the brain responds to violations of auditory regularities based on prior (implicit) learning requires further investigation. Here, we used functional magnetic resonance imaging (fMRI) to investigate the neural correlates of processing events that are irregular based on learned local dependencies. A stream of consecutive sound triplets was presented. Unbeknown to the subjects, triplets were either (a) standard, namely triplets ending with a high probability sound or, (b) statistical deviants, namely triplets ending with a low probability sound. Participants (n = 33) underwent a learning phase outside the scanner followed by an fMRI session. Processing of statistical deviants activated a set of regions encompassing the superior temporal gyrus bilaterally, the right deep frontal operculum including lateral orbitofrontal cortex, and the right premotor cortex. Our results demonstrate that the violation of local dependencies within a statistical learning paradigm does not only engage sensory processes, but is instead reminiscent of the activation pattern during the processing of local syntactic structures in music and language, reflecting the online adaptations required for predictive coding in the context of statistical learning.

Auditory and cross-modal attentional bias toward positive natural sounds: Behavioral and ERP evidence

Recently, researchers have expanded the investigation into attentional biases toward positive stimuli; however, few studies have examined attentional biases toward positive auditory information. In three experiments, the present study employed an emotional spatial cueing task using emotional sounds as cues and auditory stimuli (Experiment 1) or visual stimuli (Experiment 2 and Experiment 3) as targets to explore whether auditory or visual spatial attention could be modulated by positive auditory cues. Experiment 3 also examined the temporal dynamics of cross-modal auditory bias toward positive natural sounds using event-related potentials (ERPs). The behavioral results of the three experiments consistently demonstrated that response times to targets were faster after positive auditory cues than they were after neutral auditory cues in the valid condition, indicating that healthy participants showed a selective auditory attentional bias (Experiment 1) and cross-modal attentional bias (Experiment 2 and Experiment 3) toward positive natural sounds. The results of Experiment 3 showed that N1 amplitudes were more negative after positive sounds than they were after neutral sounds, which further provided electrophysiological evidence that positive auditory information enhances attention at early stages in healthy adults. The results of the experiments performed in the present study suggest that humans exhibit an attentional bias toward positive natural sounds.

Frontotemporal network in automatic / pre-attentive detection of abstract change: An event-related optical signal (EROS) study

The human brain constantly monitors the environment for unexpected changes. Under the prediction violation account, the Inferior Frontal Cortex (IFC) is involved in prediction-related processes for deviance detection processes in the Superior Temporal Cortex (STC). Consistent with this account, previous studies revealed an IFC-to-STC-followed-by-IFC mismatch response pattern to physical changes using event-related optical signals (EROS). However, detecting physical changes can be achieved by direct comparison of physical features between stimuli without making predictions, thus direct evidence supporting the prediction nature of the IFC-STC network in pre-attentive change detection was lacking. To address this issue, this study examined the EROS mismatch responses of the IFC-STC network when detecting the violation of an abstract rule. The rule "the higher the frequency of a tone, the stronger the intensity" established by standards was violated by deviants of 12 deviance levels. When deviants were preceded by a short train of standards, early IFC, STC, and late IFC EROS mismatch responses linearly increased with the deviance levels. When deviants were preceded by a longer train of standards, the STC but not the early or late IFC EROS mismatch responses were elicited by all the deviants without modulation by deviance levels. These results demonstrate a functional role of the IFC in the abstract change detection when insufficient rule-conforming information could be extracted from the preceding standards and are consistent with the predictive violation account of pre-attentive change detection.

A cognitive model of response omissions in distraction paradigms

The effects of distraction on responses manifest in three ways: prolonged reaction times, and increased error and response omission rates. However, the latter effect is often ignored or assumed to be due to a separate cognitive process. We investigated omissions occurring in two paradigms that manipulated distraction. One required simple stimulus detection of younger participants, the second required choice responses and was completed by both younger and older participants. We fit data from these paradigms with a model that identifies three causes of omissions: two are related to the process of accumulating the evidence on which a response is based: intrinsic omissions (due to between-trial variation in accumulation rates making it impossible to ever reach the evidence threshold) and design omissions (due to response windows that cause slow responses not to be recorded; a third, contaminant omissions, allows for a cause unrelated to the response process. In both data sets systematic differences in omission rates across conditions were accounted for by task-related omissions. Intrinsic omissions played a lesser role than design omissions, even though the presence of design omissions was not evident in descriptive analyses of the data. The model provided an accurate account of all aspects of the detection data and the choice-response data, but slightly underestimated overall omissions in the choice paradigm, particularly in older participants, suggesting that further investigation of contaminant omission effects is needed.

Dissociation of Connectivity for Syntactic Irregularity and Perceptual Ambiguity in Musical Chord Stimuli

Musical syntax has been studied mainly in terms of “syntactic irregularity” in harmonic/melodic sequences. However, “perceptual ambiguity” referring to the uncertainty of judgment/classification of presented stimuli can in addition be involved in our musical stimuli using three different chord sequences. The present study addresses how “syntactic irregularity” and “perceptual ambiguity” on musical syntax are dissociated, in terms of effective connectivity between the bilateral inferior frontal gyrus (IFGs) and superior temporal gyrus (STGs) by linearized time-delayed mutual information (LTDMI). Three conditions were of five-chord sequences with endings of dominant to tonic, dominant to submediant, and dominant to supertonic. The dominant to supertonic is most irregular, compared with the regular dominant to tonic. The dominant to submediant of the less irregular condition is the most ambiguous condition. In the LTDMI results, connectivity from the right to the left IFG (IFG-LTDMI) was enhanced for the most irregular condition, whereas that from the right to the left STG (STG-LTDMI) was enhanced for the most ambiguous condition (p = 0.024 in IFG-LTDMI, p < 0.001 in STG-LTDMI, false discovery rate (FDR) corrected). Correct rate was negatively correlated with STG-LTDMI, further reflecting perceptual ambiguity (p = 0.026). We found for the first time that syntactic irregularity and perceptual ambiguity coexist in chord stimulus testing musical syntax and that the two processes are dissociated in interhemispheric connectivities in the IFG and STG, respectively.

Increased fronto-temporal connectivity by modified melody in real music

In real music, the original melody may appear intact, with little elaboration only, or significantly modified. Since a melody is most easily perceived in music, hearing significantly modified melody may change a brain connectivity. Mozart KV 265 is comprised of a theme with an original melody of “Twinkle Twinkle Little Star” and its significant variations. We studied whether effective connectivity changes with significantly modified melody, between bilateral inferior frontal gyri (IFGs) and Heschl’s gyri (HGs) using magnetoencephalography (MEG). Among the 12 connectivities, the connectivity from the left IFG to the right HG was consistently increased with significantly modified melody compared to the original melody in 2 separate sets of the same rhythmic pattern with different melody (p = 0.005 and 0.034, Bonferroni corrected). Our findings show that the modification of an original melody in a real music changes the brain connectivity.

Task difficulty modulates voluntary attention allocation, but not distraction in an auditory distraction paradigm

Keeping task-relevant sensory events in the focus of attention while ignoring irrelevant ones is crucial for optimizing task behavior. This attention-distraction balance might change with the perceptual demands of the ongoing task: while easy tasks might be performed with low attentional effort, difficult ones require enhanced attention. The goal of the present study was to investigate how task difficulty affected allocation of attention and distractibility in an auditory distraction paradigm. Participants performed a tone duration discrimination task in which tones were rarely, occasionally presented at a rare pitch (distracters), and task difficulty was manipulated by the duration difference between short and long tones. Short tones were consistently 200 ms long, while long tone duration was 400 ms in the easy, and 260 ms in the difficult condition. Behavioral results and deviant-minus-standard event-related potential (ERP) waveforms suggested similar magnitudes of distraction in both conditions. ERPs without such a subtraction showed that tone onsets were preceded by a negative-going trend, suggesting that participants prepared for tone onsets. In the difficult condition, N1 amplitudes to tone onsets were enhanced, indicating that participants invested more attentional resources. Increased difficulty also slowed down tone offset processing as reflected by significantly delayed offset-related P1 and N1/N2 waveforms. These results suggest that although task difficulty compels participants to attend the tones more strongly, this does not have significant impact on distraction-related processing.

Aberrant timing and oddball detection in Schizophrenia: findings from a signed differential mapping meta-analysis

Schizophrenia (SZ) is associated with deficits in both temporal and salience processing. The underlying neurological dysfunctions in both processes, which are interrelated and share neuroanatomical bases, remain poorly understood. The principal objective of this study was to elucidate whether there are any brain regions that show abnormal response during timing and oddball tasks in patients with SZ. To this end, we conducted a signed differential mapping (SDM) meta-analysis of functional magnetic resonance imaging (fMRI) studies assessing abnormal responses elicited by tasks based on the oddball paradigm in patients with SZ. We conducted a similar SDM meta-analysis of neuroimaging studies of timing tasks in SZ. Finally, we undertook a multimodal meta-analysis to detect the common findings of the two previous meta-analyses. We found that SZ patients showed hypoactivation in cortical and subcortical areas related to timing. The dysfunction observed during timing tasks partially coincided with deficiencies in change-detection functions (particularly in the case of preattentional processing in the mismatch negativity response). We hypothesize that a dysfunctional timing/change detection network underlies the cognitive impairment observed in SZ.

Background Suppression and its Relation to Foreground Processing of Speech Versus Non-speech Streams

Since sound perception takes place against a background with a certain amount of noise, both speech and non-speech processing involve extraction of target signals and suppression of background noise. Previous works on early processing of speech phonemes largely neglected how background noise is encoded and suppressed. This study aimed to fill in this gap. We adopted an oddball paradigm where speech (vowels) or non-speech stimuli (complex tones) were presented with or without a background of amplitude-modulated noise and analyzed cortical responses related to foreground stimulus processing, including mismatch negativity (MMN), N2b, and P300, as well as neural representations of the background noise, that is, auditory steady-state response (ASSR). We found that speech deviants elicited later and weaker MMN, later N2b, and later P300 than non-speech ones, but N2b and P300 had similar strength, suggesting more complex processing of certain acoustic features in speech. Only for vowels, background noise enhanced N2b strength relative to silence, suggesting an attention-related speech-specific process to improve perception of foreground targets. In addition, noise suppression in speech contexts, quantified by ASSR amplitude reduction after stimulus onset, was lateralized towards the left hemisphere. The left-lateralized suppression following N2b was associated with the N2b enhancement in noise for speech, indicating that foreground processing may interact with background suppression, particularly during speech processing. Together, our findings indicate that the differences between perception of speech and non-speech sounds involve not only the processing of target information in the foreground but also the suppression of irrelevant aspects in the background.

A Modulatory Effect of Brief Passive Exposure to Non-linguistic Sounds on Intrinsic Functional Connectivity: Relevance to Cognitive Performance

A growing literature on resting-state fMRI (R-fMRI) has explored the impact of preceding sensory experience on intrinsic functional connectivity (iFC). However, it remains largely unknown how passive exposure to irrelevant auditory stimuli, which is a constant in everyday life, reconfigures iFC. Here, we directly compared pre- and post-exposure R-fMRI scans to examine: 1) modulatory effects of brief passive exposure to repeating non-linguistic sounds on subsequent iFC, and 2) associations between iFC modulations and cognitive abilities. We used an exploratory regional homogeneity (ReHo) approach that indexes local iFC, and performed a linear mixed-effects modeling analysis. A modulatory effect (increase) in ReHo was observed in the right superior parietal lobule (R.SPL) within the parietal attention network. Post hoc seed-based correlation analyses provided further evidence for increased parietal iFC (e.g., R.SPL with the right inferior parietal lobule). Notably, less iFC modulation was associated with better cognitive performance (e.g., word reading). These results suggest that: 1) the parietal attention network dynamically reconfigures its iFC in response to passive (thus irrelevant) non-linguistic sounds, but also 2) minimization of iFC modulation in the same network characterizes better cognitive performance. Our findings may open up new avenues for investigating cognitive disorders that involve impaired sensory processing.

Integrating speech in time depends on temporal expectancies and attention

Sensory information that unfolds in time, such as in speech perception, relies on efficient chunking mechanisms in order to yield optimally-sized units for further processing. Whether or not two successive acoustic events receive a one-unit or a two-unit interpretation seems to depend on the fit between their temporal extent and a stipulated temporal window of integration. However, there is ongoing debate on how flexible this temporal window of integration should be, especially for the processing of speech sounds. Furthermore, there is no direct evidence of whether attention may modulate the temporal constraints on the integration window. For this reason, we here examine how different word durations, which lead to different temporal separations of sound onsets, interact with attention. In an Electroencephalography (EEG) study, participants actively and passively listened to words where word-final consonants were occasionally omitted. Words had either a natural duration or were artificially prolonged in order to increase the separation of speech sound onsets. Omission responses to incomplete speech input, originating in left temporal cortex, decreased when the critical speech sound was separated from previous sounds by more than 250 msec, i.e., when the separation was larger than the stipulated temporal window of integration (125-150 msec). Attention, on the other hand, only increased omission responses for stimuli with natural durations. We complemented the event-related potential (ERP) analyses by a frequency-domain analysis on the stimulus presentation rate. Notably, the power of stimulation frequency showed the same duration and attention effects than the omission responses. We interpret these findings on the background of existing research on temporal integration windows and further suggest that our findings may be accounted for within the framework of predictive coding.

Increased visual task difficulty enhances attentional capture by both visual and auditory distractor stimuli

Previous studies using a three-stimulus oddball task have shown the amplitude of P3a elicited by distractor stimuli increases when perceptual discrimination between standard and target stimuli becomes difficult. This means that the attentional capture by the distractor stimuli is enhanced along with an increase in task difficulty. So far, the increase of P3a has been reported when standard, target, and distractor stimuli were presented within one sensory modality (i.e., visual or auditory). In the present study, we further investigated whether or not the increase of P3a can also be observed when the distractor stimuli are presented in a different modality from the standard and target stimuli. Twelve participants performed a three-stimulus oddball task in which they were required to discriminate between visual standard and target stimuli. As the distractor stimuli, either another visual stimulus or an auditory stimulus was presented in separate blocks. Visual distractor stimuli elicited P3a, and its amplitude increased when visual standard/target discrimination was difficult, replicating previous findings. Auditory distractor stimuli elicited P3a, and importantly, its amplitude also increased when visual standard/target discrimination was difficult. This result means that attentional capture by distractor stimuli can be enhanced even when the distractor stimuli are presented in a different modality from the standard and target stimuli. Possible mechanisms and implications are discussed in terms of the relative saliency of distractor stimuli, influences of temporal/spatial attention, and the load involved in a task.

EEG activity evoked in preparation for multi-talker listening by adults and children

Selective attention is critical for successful speech perception because speech is often encountered in the presence of other sounds, including the voices of competing talkers. Faced with the need to attend selectively, listeners perceive speech more accurately when they know characteristics of upcoming talkers before they begin to speak. However, the neural processes that underlie the preparation of selective attention for voices are not fully understood. The current experiments used electroencephalography (EEG) to investigate the time course of brain activity during preparation for an upcoming talker in young adults aged 18-27 years with normal hearing (Experiments 1 and 2) and in typically-developing children aged 7-13 years (Experiment 3). Participants reported key words spoken by a target talker when an opposite-gender distractor talker spoke simultaneously. The two talkers were presented from different spatial locations (±30° azimuth). Before the talkers began to speak, a visual cue indicated either the location (left/right) or the gender (male/female) of the target talker. Adults evoked preparatory EEG activity that started shortly after (<50 ms) the visual cue was presented and was sustained until the talkers began to speak. The location cue evoked similar preparatory activity in Experiments 1 and 2 with different samples of participants. The gender cue did not evoke preparatory activity when it predicted gender only (Experiment 1) but did evoke preparatory activity when it predicted the identity of a specific talker with greater certainty (Experiment 2). Location cues evoked significant preparatory EEG activity in children but gender cues did not. The results provide converging evidence that listeners evoke consistent preparatory brain activity for selecting a talker by their location (regardless of their gender or identity), but not by their gender alone.

Neural effects of cognitive control load on auditory selective attention

Whether and how working memory disrupts or alters auditory selective attention is unclear. We compared simultaneous event-related potentials (ERP) and functional magnetic resonance imaging (fMRI) responses associated with task-irrelevant sounds across high and low working memory load in a dichotic-listening paradigm. Participants performed n-back tasks (1-back, 2-back) in one ear (Attend ear) while ignoring task-irrelevant speech sounds in the other ear (Ignore ear). The effects of working memory load on selective attention were observed at 130-210ms, with higher load resulting in greater irrelevant syllable-related activation in localizer-defined regions in auditory cortex. The interaction between memory load and presence of irrelevant information revealed stronger activations primarily in frontal and parietal areas due to presence of irrelevant information in the higher memory load. Joint independent component analysis of ERP and fMRI data revealed that the ERP component in the N1 time-range is associated with activity in superior temporal gyrus and medial prefrontal cortex. These results demonstrate a dynamic relationship between working memory load and auditory selective attention, in agreement with the load model of attention and the idea of common neural resources for memory and attention.

Modulation of response patterns in human auditory cortex during a target detection task: an intracranial electrophysiology study

Selective attention enhances cortical activity representing an attended sound stream in human posterolateral superior temporal gyrus (PLST). It is unclear, however, what mechanisms are associated with a target detection task that necessitates sustained attention (vigilance) to a sound stream. We compared responses elicited by target and non-target sounds, and to sounds presented in a passive-listening paradigm. Subjects were neurosurgical patients undergoing invasive monitoring for medically refractory epilepsy. Stimuli were complex tones, band-limited noise bursts and speech syllables. High gamma cortical activity (70-150 Hz) was examined in all subjects using subdural grid electrodes implanted over PLST. Additionally, responses were measured from depth electrodes implanted within Heschl's gyrus (HG) in one subject. Responses to target sounds recorded from PLST were increased when compared to responses elicited by the same sounds when they were not-targets, and when they were presented during passive listening. Increases in high gamma activity to target sounds occurred during later portions (after 250 ms) of the response. These increases were related to the task and not to detailed stimulus characteristics. In contrast, earlier activity that did not vary across conditions did represent stimulus acoustic characteristics. Effects observed on PLST were not noted in HG. No consistent effects were noted in the averaged evoked potentials in either cortical region. We conclude that task dependence modulates later activity in PLST during vigilance. Later activity may represent feedback from higher cortical areas. Study of concurrently recorded activity from frontoparietal areas is necessary to further clarify task-related modulation of activity on PLST.

Positive and negative reinforcement activate human auditory cortex

Prior studies suggest that reward modulates neural activity in sensory cortices, but less is known about punishment. We used functional magnetic resonance imaging and an auditory discrimination task, where participants had to judge the duration of frequency modulated tones. In one session correct performance resulted in financial gains at the end of the trial, in a second session incorrect performance resulted in financial loss. Incorrect performance in the rewarded as well as correct performance in the punishment condition resulted in a neutral outcome. The size of gains and losses was either low or high (10 or 50 Euro cent) depending on the direction of frequency modulation. We analyzed neural activity at the end of the trial, during reinforcement, and found increased neural activity in auditory cortex when gaining a financial reward as compared to gaining no reward and when avoiding financial loss as compared to receiving a financial loss. This was independent on the size of gains and losses. A similar pattern of neural activity for both gaining a reward and avoiding a loss was also seen in right middle temporal gyrus, bilateral insula and pre-supplemental motor area, here however neural activity was lower after correct responses compared to incorrect responses. To summarize, this study shows that the activation of sensory cortices, as previously shown for gaining a reward is also seen during avoiding a loss.

Age-related changes in expectation-based modulation of motion detectability

Expecting motion in some particular direction biases sensitivity to that direction, which speeds detection of motion. However, the neural processes underlying this effect remain underexplored, especially in the context of normal aging. To address this, we examined younger and older adults' performance in a motion detection task. In separate conditions, the probability was either 50% or 100% that a field of dots would move coherently in the direction a participant expected (either vertically or horizontally). Expectation and aging effects were assessed via response times (RT) to detect motion and electroencephalography (EEG). In both age groups, RTs were fastest when motion was similar to the expected direction of motion. RT tuning curves exhibited a characteristic U-shape such that detection time increased with an increasing deviation from the participant's expected direction. Strikingly, EEG results showed an analogous, hyperbolic curve for N1 amplitude, reflecting neural biasing. Though the form of behavioral and EEG curves did not vary with age, older adults displayed a clear decline in the speed of detection and a corresponding reduction in EEG N1 amplitude when horizontal (but not vertical) motion was expected. Our results suggest that expectation-based detection ability varies with age and, for older adults, also with axis of motion.

Stimulus-dependent activations and attention-related modulations in the auditory cortex: a meta-analysis of fMRI studies

We meta-analyzed 115 functional magnetic resonance imaging (fMRI) studies reporting auditory-cortex (AC) coordinates for activations related to active and passive processing of pitch and spatial location of non-speech sounds, as well as to the active and passive speech and voice processing. We aimed at revealing any systematic differences between AC surface locations of these activations by statistically analyzing the activation loci using the open-source Matlab toolbox VAMCA (Visualization and Meta-analysis on Cortical Anatomy). AC activations associated with pitch processing (e.g., active or passive listening to tones with a varying vs. fixed pitch) had median loci in the middle superior temporal gyrus (STG), lateral to Heschl's gyrus. However, median loci of activations due to the processing of infrequent pitch changes in a tone stream were centered in the STG or planum temporale (PT), significantly posterior to the median loci for other types of pitch processing. Median loci of attention-related modulations due to focused attention to pitch (e.g., attending selectively to low or high tones delivered in concurrent sequences) were, in turn, centered in the STG or superior temporal sulcus (STS), posterior to median loci for passive pitch processing. Activations due to spatial processing were centered in the posterior STG or PT, significantly posterior to pitch processing loci (processing of infrequent pitch changes excluded). In the right-hemisphere AC, the median locus of spatial attention-related modulations was in the STS, significantly inferior to the median locus for passive spatial processing. Activations associated with speech processing and those associated with voice processing had indistinguishable median loci at the border of mid-STG and mid-STS. Median loci of attention-related modulations due to attention to speech were in the same mid-STG/STS region. Thus, while attention to the pitch or location of non-speech sounds seems to recruit AC areas less involved in passive pitch or location processing, focused attention to speech predominantly enhances activations in regions that already respond to human vocalizations during passive listening. This suggests that distinct attention mechanisms might be engaged by attention to speech and attention to more elemental auditory features such as tone pitch or location. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

Perceptual demand modulates activation of human auditory cortex in response to task-irrelevant sounds

In the visual modality, perceptual demand on a goal-directed task has been shown to modulate the extent to which irrelevant information can be disregarded at a sensory-perceptual stage of processing. In the auditory modality, the effect of perceptual demand on neural representations of task-irrelevant sounds is unclear. We compared simultaneous ERPs and fMRI responses associated with task-irrelevant sounds across parametrically modulated perceptual task demands in a dichotic-listening paradigm. Participants performed a signal detection task in one ear (Attend ear) while ignoring task-irrelevant syllable sounds in the other ear (Ignore ear). Results revealed modulation of syllable processing by auditory perceptual demand in an ROI in middle left superior temporal gyrus and in negative ERP activity 130-230 msec post stimulus onset. Increasing the perceptual demand in the Attend ear was associated with a reduced neural response in both fMRI and ERP to task-irrelevant sounds. These findings are in support of a selection model whereby ongoing perceptual demands modulate task-irrelevant sound processing in auditory cortex.

Segregating the Neural Correlates of Physical and Perceived Change in Auditory Input using the Change Deafness Effect

Psychophysical experiments show that auditory change detection can be disturbed in situations in which listeners have to monitor complex auditory input. We made use of this change deafness effect to segregate the neural correlates of physical change in auditory input from brain responses related to conscious change perception in an fMRI experiment. Participants listened to two successively presented complex auditory scenes, which consisted of six auditory streams, and had to decide whether scenes were identical or whether the frequency of one stream was changed between presentations. Our results show that physical changes in auditory input, independent of successful change detection, are represented at the level of auditory cortex. Activations related to conscious change perception, independent of physical change, were found in the insula and the ACC. Moreover, our data provide evidence for significant effective connectivity between auditory cortex and the insula in the case of correctly detected auditory changes, but not for missed changes. This underlines the importance of the insula/anterior cingulate network for conscious change detection.

Behavioral Distraction by Auditory Deviance Is Mediated by the Sound’s Informational Value *Li and Parmentier share the first authorship of this study

Sounds deviating from an otherwise repetitive background in some task-irrelevant respect (deviant sounds among standard sounds) capture attention in an obligatory fashion and result in behavioral distraction in an ongoing task. Traditionally, such distraction has been considered as the ineluctable consequence of the deviant sound’s low probability of occurrence relative to that of the standard. Recent evidence from a cross-modal oddball task challenged this idea by showing that deviant sounds only yield distraction in a visual task when auditory distractors (standards and deviants) announce with certainty the imminent presentation of a target stimulus (event information), regardless of whether they predict the target’s temporal onset (temporal information). The present study sought to test for the first time whether this finding may be generalized to a purely auditory oddball task in which distractor and target information form part of the same perceptual stimulus. Participants were asked to judge whether a sound starting from a central location moved left or right while ignoring rare and unpredictable changes in the sound’s identity. By manipulating the temporal and probabilistic relationship between sound onset and movement onset, we disentangled the roles of event and temporal information and found that, as in the auditory-visual oddball task, deviance distraction is mediated by the extent to which distractor information harbingers the presentation of the target information (event information). This finding suggests that the provision of event information by auditory distractors is a fundamental prerequisite of behavioral deviance distraction.

Human striatum is differentially activated by delayed, omitted, and immediate registering feedback

The temporal contingency of feedback during conversations is an essential requirement of a successful dialog. In the current study, we investigated the effects of delayed and omitted registering feedback on fMRI activation and compared both unexpected conditions to immediate feedback. In the majority of trials of an auditory task, participants received an immediate visual feedback which merely indicated that a button press was registered but not whether the response was correct or not. In a minority of trials, and thus unexpectedly, the feedback was omitted, or delayed by 500 ms. The results reveal a response hierarchy of activation strength in the dorsal striatum and the substantia nigra: the response to the delayed feedback was larger compared to immediate feedback and immediate feedback showed a larger activation compared to the omission of feedback. This suggests that brain regions typically involved in reward processing are also activated by non-rewarding, registering feedback. Furthermore, the comparison with immediate feedback revealed that both omitted and delayed feedback significantly modulated activity in a network of brain regions that reflects attentional demand and adjustments in cognitive and action control, i.e., the posterior medial frontal cortex (pMFC), right dorsolateral prefrontal cortex (dlPFC), bilateral anterior insula (aI), inferior frontal gyrus (Gfi), and inferior parietal lobe (Lpi). This finding emphasizes the importance of immediate feedback in human–computer interaction, as the effects of delayed feedback on brain activity in the described network seem to be similar to that of omitted feedback.

Patients with minimal hepatic encephalopathy show impaired mismatch negativity correlating with reduced performance in attention tests

Attention deficit is an early event in the cognitive impairment of patients with minimal hepatic encephalopathy (MHE). The underlying mechanisms remain unclear. Mismatch negativity (MMN) is an auditory event-related potential that reflects an attentional trigger. Patients with schizophrenia show impaired attention and cognitive function, which are reflected in altered MMN. We hypothesized that patients with MHE, similarly to those with schizophrenia, should show MMN alterations related with attention deficits. The aims of this work were to assess whether (1) MMN is altered in cirrhotic patients with MHE, compared to those without MHE, (2) MMN changes in parallel with performance in attention tests and/or MHE in a longitudinal study, and (3) MMN predicts performance in attention tests and/or in the Psychometric Hepatic Encephalopathy Score (PHES). We performed MMN analysis as well as attention and coordination tests in 34 control subjects and in 37 patients with liver cirrhosis without MHE and 23 with MHE. Patients with MHE show reduced performance in selective and sustained attention tests and in visuomotor and bimanual coordination tests. The MMN wave area was reduced in patients with MHE, but not in those without MHE. In the longitudinal study, MMN area improved in parallel with performance in attention tests and PHES in 4 patients and worsened in parallel in another 4. Logistic regression analyses showed that MMN area predicts performance in attention tests and in PHES, but not in other tests or critical flicker frequency. Receiver operating characteristic curve analyses showed that MMN area predicts attention deficits in the number connection tests A and B, Stroop tasks, and MHE, with sensitivities of 75%-90% and specificities of 76%-83%.

CONCLUSION

MMN area is useful to diagnose attention deficits and MHE in patients with liver cirrhosis.

Auditory change detection in fragile X syndrome males: a brain potential study

OBJECTIVE

The present study investigated involuntary change detection in a two-tone pre-attentive auditory discrimination paradigm in order to better understand the information processing mechanisms underlying attention deficits in fragile X syndrome (FXS) males.

METHODS

Sixteen males with the FXS full mutation and 20 age-matched control participants (mean age 29 years) were presented with series of auditory stimuli consisting of standard and deviant tones while watching a silent movie.

RESULTS

Brain potentials recorded to the tones showed that N1 and P2, sensory evoked potentials, were significantly enhanced in FXS compared to age-matched control participants. In contrast to controls, the N1 to standard tones failed to show long-term habituation to stimulus repetition in FXS. Additionally, both mismatch negativity and P3a generation, reflecting automatic change detection and the involuntary switch of attention, respectively, were significantly attenuated in FXS males.

CONCLUSIONS

The current study demonstrates that auditory stimulus discrimination in the FXS brain is already compromised during the pre-attentive stages of information processing. Furthermore, the apparent pre-attentive information processing deficiencies in FXS coincide with a weakness in the involuntary engagement of attentional resources.

SIGNIFICANCE

The stimulus-driven information processing deficiencies in FXS might compromise information processing in several domains and, thus, present a key-deficit in FXS neurocognition.

Task-specific modulation of human auditory evoked response in a delayed-match-to-sample task

In this study, we focus our investigation on task-specific cognitive modulation of early cortical auditory processing in human cerebral cortex. During the experiments, we acquired whole-head magnetoencephalography data while participants were performing an auditory delayed-match-to-sample (DMS) task and associated control tasks. Using a spatial filtering beamformer technique to simultaneously estimate multiple source activities inside the human brain, we observed a significant DMS-specific suppression of the auditory evoked response to the second stimulus in a sound pair, with the center of the effect being located in the vicinity of the left auditory cortex. For the right auditory cortex, a non-invariant suppression effect was observed in both DMS and control tasks. Furthermore, analysis of coherence revealed a beta band (12∼20 Hz) DMS-specific enhanced functional interaction between the sources in left auditory cortex and those in left inferior frontal gyrus, which has been shown to be involved in short-term memory processing during the delay period of DMS task. Our findings support the view that early evoked cortical responses to incoming acoustic stimuli can be modulated by task-specific cognitive functions by means of frontal–temporal functional interactions.

Intracranial study of speech-elicited activity on the human posterolateral superior temporal gyrus

To clarify speech-elicited response patterns within auditory-responsive cortex of the posterolateral superior temporal (PLST) gyrus, time-frequency analyses of event-related band power in the high gamma frequency range (75-175 Hz) were performed on the electrocorticograms recorded from high-density subdural grid electrodes in 8 patients undergoing evaluation for medically intractable epilepsy. Stimuli were 6 stop consonant-vowel (CV) syllables that varied in their consonant place of articulation (POA) and voice onset time (VOT). Initial augmentation was maximal over several centimeters of PLST, lasted about 400 ms, and was often followed by suppression and a local outward expansion of activation. Maximal gamma power overlapped either the Nα or Pβ deflections of the average evoked potential (AEP). Correlations were observed between the relative magnitudes of gamma band responses elicited by unvoiced stop CV syllables (/pa/, /ka/, /ta/) and their corresponding voiced stop CV syllables (/ba/, /ga/, /da/), as well as by the VOT of the stimuli. VOT was also represented in the temporal patterns of the AEP. These findings, obtained in the passive awake state, indicate that PLST discriminates acoustic features associated with POA and VOT and serve as a benchmark upon which task-related speech activity can be compared.

Lost in thoughts: neural markers of low alertness during mind wandering

During concentration tasks, spontaneous attention shifts occurs towards self-centered matters. Little is known about the brain oscillatory activity underlying these mental phenomena. We recorded 128-channels electroencephalographic activity from 12 subjects performing a breath-counting task. Subjects were instructed to press a button whenever, based on their introspective experience, they realized their attention had drifted away from the task. Theta (4-7 Hz) and delta (2-3.5 Hz) EEG activity increased during mind wandering whereas alpha (9-11 Hz) and beta (15-30 Hz) decreased. A passive auditory oddball protocol was presented to the subjects to test brain-evoked responses to perceptual stimuli during mind wandering. Mismatch negativity evoked at 100 ms after oddball stimuli onset decreased during mind wandering whereas the brain-evoked responses at 200 ms after stimuli onset increased. Spectral analyses and evoked related potential results suggest decreased alertness and sensory processing during mind wandering. To our knowledge, our experiment is one of the first neuro-imaging studies that relies purely on subjects' introspective judgment, and shows that such judgment may be used to contrast different brain activity patterns.

Multisensory conflict modulates the spread of visual attention across a multisensory object

Spatial attention to a visual stimulus that occurs synchronously with a task-irrelevant sound from a different location can lead to increased activity not only in the visual cortex, but also the auditory cortex, apparently reflecting the object-related spreading of attention across both space and modality (Busse et al., 2005). The processing of stimulus conflict, including multisensory stimulus conflict, is known to activate the anterior cingulate cortex (ACC), but the interactive influence on the sensory cortices remains relatively unexamined. Here we used fMRI to examine whether the multisensory spread of visual attention across the sensory cortices previously observed will be modulated by whether there is conceptual or object-related conflict between the relevant visual and irrelevant auditory inputs. Subjects visually attended to one of two lateralized visual letter-streams while synchronously occurring, task-irrelevant, letter sounds were presented centrally, which could be either congruent or incongruent with the visual letters. We observed significant enhancements for incongruent versus congruent letter-sound combinations in the ACC and in the contralateral visual cortex when the visual component was attended, presumably reflecting the conflict detection and the need for boosted attention to the visual stimulus during incongruent trials. In the auditory cortices, activity increased bilaterally if the spatially discordant auditory stimulation was incongruent, but only in the left, language-dominant side when congruent. We conclude that a conflicting incongruent sound, even when task-irrelevant, distracts more strongly than a congruent one, leading to greater capture of attention. This greater capture of attention in turn results in increased activity in the auditory cortex.

Non-linguistic auditory processing and working memory update in pre-school children who stutter: an electrophysiological study

Non-linguistic auditory processing and working memory update were examined with event-related potentials (ERPs) in 18 children who stutter (CWS) and 18 children who do not stutter (CWNS). Children heard frequent 1 kHz tones interspersed with rare 2 kHz tones. The two groups did not differ on any measure of the P1 and N1 components, strongly suggesting that early auditory processing of pure tones is unimpaired in CWS. However, as a group, only CWNS exhibited a P3 component to rare tones, suggesting that developmental stuttering may be associated with a less efficient attentional allocation and working memory update in response to auditory change.

Development, validation, and comparison of ICA-based gradient artifact reduction algorithms for simultaneous EEG-spiral in/out and echo-planar fMRI recordings

EEG data acquired in an MRI scanner are heavily contaminated by gradient artifacts that can significantly compromise signal quality. We developed two new methods based on independent component analysis (ICA) for reducing gradient artifacts from spiral in-out and echo-planar pulse sequences at 3 T, and compared our algorithms with four other commonly used methods: average artifact subtraction (Allen, P., Josephs, O., Turner, R., 2000. A method for removing imaging artifact from continuous EEG recorded during functional MRI. NeuroImage 12, 230-239.), principal component analysis (Niazy, R., Beckmann, C., Iannetti, G., Brady, J., Smith, S., 2005. Removal of FMRI environment artifacts from EEG data using optimal basis sets. NeuroImage 28, 720-737.), Taylor series ( Wan, X., Iwata, K., Riera, J., Kitamura, M., Kawashima, R., 2006. Artifact reduction for simultaneous EEG/fMRI recording: adaptive FIR reduction of imaging artifacts. Clin. Neurophysiol. 117, 681-692.) and a conventional temporal ICA algorithm. Models of gradient artifacts were derived from simulations as well as a water phantom and performance of each method was evaluated on datasets constructed using visual event-related potentials (ERPs) as well as resting EEG. Our new methods recovered ERPs and resting EEG below the beta band (<12.5 Hz) with high signal-to-noise ratio (SNR>4). Our algorithms outperformed all of these methods on resting EEG in the theta and alpha bands (SNR>4); however, for all methods, signal recovery was modest (SNR approximately 1) in the beta band and poor (SNR<0.3) in the gamma band and above. We found that the conventional ICA algorithm performed poorly with uniformly low SNR (<0.1). Taken together, our new ICA-based methods offer a more robust technique for gradient artifact reduction when scanning at 3 T using spiral in-out and echo-planar pulse sequences. We provide new insights into the strengths and weaknesses of each method using a unified subspace framework.

Abnormal pitch mismatch negativity in individuals with schizotypal personality disorder

BACKGROUND

The goal of the study was to examine mismatch negativity (MMN) in schizotypal personality disorder (SPD) individuals. Abnormal MMN has been a consistent finding in chronic schizophrenia and there also have been reports of reduced duration MMN in first episode schizophrenia patients [Umbricht, D., Krljes, S., Mismatch negativity in schizophrenia: a meta-analysis. Schizophrenia Research (2005); 76(1):1-23], with some studies finding no pitch MMN amplitude differences [Salisbury, D.F., Shenton, M.E., Griggs, C.B., Bonner-Jackson, A., McCarley, R.W., Mismatch negativity n chronic schizophrenia and first-episode schizophrenia. Archives of General Psychiatry (2002); 59(8):686-694.], while others reporting a modest reduction [Umbricht, D.S., Bates, J.A., Lieberman, J.A., Kane, J.M., Javitt, D.C., Electrophysiological indices of automatic and controlled auditory information processing in first-episode, recent-onset and chronic schizophrenia. Biological Psychiatry (2006); 59(8):762-772], in recent onset schizophrenia patients. To our knowledge no reports exist of MMN in SPD individuals.

METHODS

Twenty six normal (14 females) control and 23 SPD (12 females) individuals were tested using the pitch MMN paradigm. Normal control (NC) and SPD individuals were recruited from the general population and assessed using DSM-IV. SPD individuals were included if they met 5 or more criteria for SPD disorder. The subjects listened to 2000 frequent 1 kHz pure tones and 100 rare 1.2 kHz pure tones while reading a magazine article. MMN was measured from a difference waveform within the latency window of 175-276 ms.

RESULTS

Reduced MMN amplitude was found in SPD relative to NC subjects (p<0.045).

CONCLUSIONS

These results point to potential differences between SPD and schizophrenia, where no reduction in MMN was found in most studies of first episode patients.

The timing of cognitive control in partially incongruent categorization

We designed a novel task, partially incongruent categorization (PIC), to examine the timing of cognitive control. In the PIC task, participants categorized the probe stimulus according to a specific concept, and the number of features corresponding to the concept was varied. When there was one feature (c1 condition), the probe would elicit only categorization, but when there was more than one feature (c2 and c3 conditions), the probe would also elicit cognitive control. Here, the high temporal resolution of event-related potentials (ERPs) was utilized to investigate the temporal patterns of activity during conflict detection and control. Cognitive control elicited a N2 that was much larger in response to c2 and c3 than c1 in stimulus-locked waveforms, and no difference was evident between c2 and c3. The N2 was followed by a P3 that was much less on c2 and c3 than c1 trials, with no difference between c2 and c3. A dipole source analysis for two difference waves, c2-c1 and c3-c1, further showed that the corresponding dipoles of the N2 and P3 in the cognitive control conditions were in the anterior cingulate cortex (ACC) and prefrontal cortex (PFC), respectively. Taken together, the present findings support that ERP components in response to the PIC task reflect the time course of cognitive control: the N2 responds to conflict information and subsequently activates the P3 to control this conflict. The connection between the ACC and PFC is supported by their sequential activation within trials.

Early electrophysiological correlates of meter and rhythm processing in music perception

The two main characteristics of temporal structuring in music are meter and rhythm. The present experiment investigated the event-related potentials (ERP) of these two structural elements with a focus on differential effects of attended and unattended processing. The stimulus material consisted of an auditory rhythm presented repetitively to subjects in which metrical and rhythmical changes as well as pitch changes were inserted. Subjects were to detect and categorize either temporal changes (attended condition) or pitch changes (unattended condition). Furthermore, we compared a group of long-term trained subjects (musicians) to non-musicians. As expected, behavioural data revealed that trained subjects performed significantly better than untrained subjects. This effect was mainly due to the better detection of the meter deviants. Rhythm as well as meter changes elicited an early negative deflection compared to standard tones in the attended processing condition, while in the unattended processing condition only the rhythm change elicited this negative deflection. Both effects were found across all experimental subjects with no difference between the two groups. Thus, our data suggest that meter and rhythm perception could differ with respect to the time course of processing and lend credence to the notion of different neurophysiological processes underlying the auditory perception of rhythm and meter in music. Furthermore, the data indicate that non-musicians are as proficient as musicians when it comes to rhythm perception, suggesting that correct rhythm perception is crucial not only for musicians but for every individual.

Consciousness and hallucinations in schizophrenia: the role of synapse regression

Consciousness takes two forms, transitive and intransitive. Transitive consciousness is a matter of being conscious of something or other whereas intransitive consciousness has no object, as being conscious or awake. Of the different forms of transitive consciousness, perceptual, somatic, kinaesthetic and so on, cognitive neuroscience has concentrated on determining the neural concomitants of perceptual consciousness. To be conscious of a percept is to be aware of it and this requires attending to it. This work sets out a hypothesis as to what brain areas are involved in a schizophrenia subject attending and becoming aware of hallucinations. First, the different areas of cortex that support different visual and auditory illusions of percepts are considered. Next it is argued that endogenous activity in these areas of cortex give rise to hallucinations of percepts that are similar to the percepts that these same areas support during illusions. The basis of such endogenous activity, it is suggested, is to be found in the paucity of afferent synapses to these cortical areas. This may occur as a consequence of loss and regression of synapses due to a degenerative disease or because of abnormal synapse formation and regression during childhood and adolescence, as is likely to be the case in schizophrenia. Finally the neural basis of attention and awareness of these hallucinations are considered for subjects suffering from schizophrenia, and a set of important questions posed that await elucidation through future experimental studies.

Prefrontal neurons predict choices during an auditory same-different task

The detection of stimuli is critical for an animal's survival [1]. However, it is not adaptive for an animal to respond automatically to every stimulus that is present in the environment [2-5]. Given that the prefrontal cortex (PFC) plays a key role in executive function [6-8], we hypothesized that PFC activity should be involved in context-dependent responses to uncommon stimuli. As a test of this hypothesis, monkeys participated in a same-different task, a variant of an oddball task [2]. During this task, a monkey heard multiple presentations of a "reference" stimulus that were followed by a "test" stimulus and reported whether these stimuli were the same or different. While they participated in this task, we recorded from neurons in the ventrolateral prefrontal cortex (vPFC; a cortical area involved in aspects of nonspatial auditory processing [9, 10]). We found that vPFC activity was correlated with the monkeys' choices. This finding demonstrates a direct link between single neurons and behavioral choices in the PFC on a nonspatial auditory task.

An auditory processing abnormality specific to liability for schizophrenia

Abnormal brain activity during the processing of simple sounds is evident in individuals with increased genetic liability for schizophrenia; however, the diagnostic specificity of these abnormalities has yet to be fully examined. Because recent evidence suggests that schizophrenia and bipolar disorder may share aspects of genetic etiology the present study was conducted to determine whether individuals with heightened genetic liability for each disorder manifested distinct neural abnormalities during auditory processing. Utilizing a dichotic listening paradigm, we assessed target tone discrimination and electrophysiological responses in schizophrenia patients, first-degree biological relatives of schizophrenia patients, bipolar disorder patients, first-degree biological relatives of bipolar patients and nonpsychiatric control participants. Schizophrenia patients and relatives of schizophrenia patients demonstrated reductions in an early neural response (i.e. N1) suggestive of deficient sensory registration of auditory stimuli. Bipolar patients and relatives of bipolar patients demonstrated no such abnormality. Both schizophrenia and bipolar patients failed to significantly augment N1 amplitude with attention. Schizophrenia patients also failed to show sensitivity of longer-latency neural processes (N2) to stimulus frequency suggesting a disorder specific deficit in stimulus classification. Only schizophrenia patients exhibited reduced target tone discrimination accuracy. Reduced N1 responses reflective of early auditory processing abnormalities are suggestive of a marker of genetic liability for schizophrenia and may serve as an endophenotype for the disorder.