Effects of acoustic gradient noise from functional magnetic resonance imaging on auditory processing as reflected by event-related brain potentials

When Is Simultaneous Recording Necessary? A Guide for Researchers Considering Combined EEG-fMRI

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) provide non-invasive measures of brain activity at varying spatial and temporal scales, offering different views on brain function for both clinical and experimental applications. Simultaneous recording of these measures attempts to maximize the respective strengths of each method, while compensating for their weaknesses. However, combined recording is not necessary to address all research questions of interest, and experiments may have greater statistical power to detect effects by maximizing the signal-to-noise ratio in separate recording sessions. While several existing papers discuss the reasons for or against combined recording, this article aims to synthesize these arguments into a flow chart of questions that researchers can consider when deciding whether to record EEG and fMRI separately or simultaneously. Given the potential advantages of simultaneous EEG-fMRI, the aim is to provide an initial overview of the most important concepts and to direct readers to relevant literature that will aid them in this decision.

Event-related brain responses while listening to entire pieces of music

Brain responses to discrete short sounds have been studied intensively using the event-related potential (ERP) method, in which the electroencephalogram (EEG) signal is divided into epochs time-locked to stimuli of interest. Here we introduce and apply a novel technique which enables one to isolate ERPs in human elicited by continuous music. The ERPs were recorded during listening to a Tango Nuevo piece, a deep techno track and an acoustic lullaby. Acoustic features related to timbre, harmony, and dynamics of the audio signal were computationally extracted from the musical pieces. Negative deflation occurring around 100 milliseconds after the stimulus onset (N100) and positive deflation occurring around 200 milliseconds after the stimulus onset (P200) ERP responses to peak changes in the acoustic features were distinguishable and were often largest for Tango Nuevo. In addition to large changes in these musical features, long phases of low values that precede a rapid increase - and that we will call Preceding Low-Feature Phases - followed by a rapid increase enhanced the amplitudes of N100 and P200 responses. These ERP responses resembled those to simpler sounds, making it possible to utilize the tradition of ERP research with naturalistic paradigms.

Cortical response variation with different sound pressure levels: a combined event-related potentials and FMRI study

INTRODUCTION

Simultaneous recording of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) provides high spatial and temporal resolution. In this study we combined EEG and fMRI to investigate the structures involved in the processing of different sound pressure levels (SPLs).

METHODS

EEG data were recorded simultaneously with fMRI from 16 healthy volunteers using MR compatible devices at 3 T. Tones with different SPLs were delivered to the volunteers and the N1/P2 amplitudes were included as covariates in the fMRI data analysis in order to compare the structures activated with high and low SPLs. Analysis of variance (ANOVA) and ROI analysis were also performed. Additionally, source localisation analysis was performed on the EEG data.

RESULTS

The integration of averaged ERP parameters into the fMRI analysis showed an extended map of areas exhibiting covariation with the BOLD signal related to the auditory stimuli. The ANOVA and ROI analyses also revealed additional brain areas other than the primary auditory cortex (PAC) which were active with the auditory stimulation at different SPLs. The source localisation analyses showed additional sources apart from the PAC which were active with the high SPLs.

DISCUSSION

The PAC and the insula play an important role in the processing of different SPLs. In the fMRI analysis, additional activation was found in the anterior cingulate cortex, opercular and orbito-frontal cortices with high SPLs. A strong response of the visual cortex was also found with the high SPLs, suggesting the presence of cross-modal effects.

Neuroimaging paradigms for tonotopic mapping (II): the influence of acquisition protocol

Numerous studies on the tonotopic organisation of auditory cortex in humans have employed a wide range of neuroimaging protocols to assess cortical frequency tuning. In the present functional magnetic resonance imaging (fMRI) study, we made a systematic comparison between acquisition protocols with variable levels of interference from acoustic scanner noise. Using sweep stimuli to evoke travelling waves of activation, we measured sound-evoked response signals using sparse, clustered, and continuous imaging protocols that were characterised by inter-scan intervals of 8.8, 2.2, or 0.0 s, respectively. With regard to sensitivity to sound-evoked activation, the sparse and clustered protocols performed similarly, and both detected more activation than the continuous method. Qualitatively, tonotopic maps in activated areas proved highly similar, in the sense that the overall pattern of tonotopic gradients was reproducible across all three protocols. However, quantitatively, we observed substantial reductions in response amplitudes to moderately low stimulus frequencies that coincided with regions of strong energy in the scanner noise spectrum for the clustered and continuous protocols compared to the sparse protocol. At the same time, extreme frequencies became over-represented for these two protocols, and high best frequencies became relatively more abundant. Our results indicate that although all three scanning protocols are suitable to determine the layout of tonotopic fields, an exact quantitative assessment of the representation of various sound frequencies is substantially confounded by the presence of scanner noise. In addition, we noticed anomalous signal dynamics in response to our travelling wave paradigm that suggest that the assessment of frequency-dependent tuning is non-trivially influenced by time-dependent (hemo)dynamics when using sweep stimuli.

Towards neural correlates of auditory stimulus processing: a simultaneous auditory evoked potentials and functional magnetic resonance study using an odd-ball paradigm

Background

The neural underpinnings of auditory information processing have often been investigated using the odd-ball paradigm, in which infrequent sounds (deviants) are presented within a regular train of frequent stimuli (standards). Traditionally, this paradigm has been applied using either high temporal resolution (EEG) or high spatial resolution (fMRI, PET). However, used separately, these techniques cannot provide information on both the location and time course of particular neural processes. The goal of this study was to investigate the neural correlates of auditory processes with a fine spatio-temporal resolution. A simultaneous auditory evoked potentials (AEP) and functional magnetic resonance imaging (fMRI) technique (AEP-fMRI), together with an odd-ball paradigm, were used.

Material/Methods

Six healthy volunteers, aged 20–35 years, participated in an odd-ball simultaneous AEP-fMRI experiment. AEP in response to acoustic stimuli were used to model bioelectric intracerebral generators, and electrophysiological results were integrated with fMRI data.

Results

fMRI activation evoked by standard stimuli was found to occur mainly in the primary auditory cortex. Activity in these regions overlapped with intracerebral bioelectric sources (dipoles) of the N1 component. Dipoles of the N1/P2 complex in response to standard stimuli were also found in the auditory pathway between the thalamus and the auditory cortex. Deviant stimuli induced fMRI activity in the anterior cingulate gyrus, insula, and parietal lobes.

Conclusions

The present study showed that neural processes evoked by standard stimuli occur predominantly in subcortical and cortical structures of the auditory pathway. Deviants activate areas non-specific for auditory information processing.

Using neuroimaging to understand the cortical mechanisms of auditory selective attention

Over the last four decades, a range of different neuroimaging tools have been used to study human auditory attention, spanning from classic event-related potential studies using electroencephalography to modern multimodal imaging approaches (e.g., combining anatomical information based on magnetic resonance imaging with magneto- and electroencephalography). This review begins by exploring the different strengths and limitations inherent to different neuroimaging methods, and then outlines some common behavioral paradigms that have been adopted to study auditory attention. We argue that in order to design a neuroimaging experiment that produces interpretable, unambiguous results, the experimenter must not only have a deep appreciation of the imaging technique employed, but also a sophisticated understanding of perception and behavior. Only with the proper caveats in mind can one begin to infer how the cortex supports a human in solving the "cocktail party" problem. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

A modified oddball paradigm for investigation of neural correlates of attention: a simultaneous ERP-fMRI study

Introduction

The objective of the presented study was to develop and evaluate a P300 experimental protocol for simultaneous registration of event-related potentials (ERPs) and functional MRI (fMRI) data with continuous imaging. It may be useful for investigating attention and working memory processes in specific populations, such as children and neuropsychiatric patients.

Materials and methods

Eleven children were investigated with simultaneous ERP–fMRI. To fulfill requirements of both BOLD and electroencephalographic signal registration, a modified oddball task was used. To verify the ERP–fMRI protocol we also performed a study outside the scanner using a typical two-stimuli oddball paradigm.

Results

Localization of the P300 component of ERPs partially corresponded with fMRI results in the frontal and parietal brain regions. FMRI activations were found in: middle frontal gyrus, insula, SMA, parietal lobule, thalamus, and cerebellum. Our modified oddball task provided ERP–fMRI results with high level of significance (EEG SNR = 35, fMRI p < 0.05–Bonf.). ERPs obtained in the scanner were comparable with those registered outside the scanner, although some differences in the amplitude were noticed, mainly in the N100 component.

Conclusion

In our opinion the presented paradigm may be successfully applied for simultaneous ERP–fMRI registration of neural correlates of attention in vulnerable populations.

A real-time data acquisition and control of gradient coil noise for fMRI identification of hearing disorder in children with history of ear infection

Early ear infection and trauma, from birth to age 12 are known to have a significant effect on sensory and cognitive development. This effect can be demonstrated through the fMRI study of children who have a history of ear infection compared to a control group. A second research question is the extent to which brain plasticity at an early age can reduce the impact of infection on hearing and cognitive development. Functional Magnetic Resonance Imaging (fMRI) provides a mapping of brain activity in cognitive and sensory regions by recording the oxygenation state of the local cerebral blood flow. The gradient coils of fMRI scanners generate intense acoustic noise (GCN) - to which the subject is in close proximity - in the range of 90 to 140 db SPL during the imaging process. Clearly this noise will impress its signature on low level brain response patterns. An Active Noise Canceller (ANC) system can suppress the effect of GCN on the subject's perception of a phonetic stimulus at the phoneme, word or phrase level. Due to a superimposition of the frequency and time domain components of the test signal and GCN for MR test, the ANC filtering system performs its function in real time - we must capture the brain's response to the test signal AFTER the noise has been removed. This goal is achieved through the application of field programmable gate array (FPGA) technology of NI LabVIEW. The presentation (in the noisy fMRI environment) of test words and phrases to hearing impaired children can identify sources of distortion to their perceptual processes associated with GCN. Once this distortion has been identified, learning strategies may be introduced to replace the hearing function distorted by early infection as well as the short term effect of GCN. The study of speech cognition without the confounding effect of GCN and with the varying level of GCN for a repeated test signal at later age can be allowed to a measure of recovery through brain plasticity.

Brain networks of novelty-driven involuntary and cued voluntary auditory attention shifting

In everyday life, we need a capacity to flexibly shift attention between alternative sound sources. However, relatively little work has been done to elucidate the mechanisms of attention shifting in the auditory domain. Here, we used a mixed event-related/sparse-sampling fMRI approach to investigate this essential cognitive function. In each 10-sec trial, subjects were instructed to wait for an auditory "cue" signaling the location where a subsequent "target" sound was likely to be presented. The target was occasionally replaced by an unexpected "novel" sound in the uncued ear, to trigger involuntary attention shifting. To maximize the attention effects, cues, targets, and novels were embedded within dichotic 800-Hz vs. 1500-Hz pure-tone "standard" trains. The sound of clustered fMRI acquisition (starting at t = 7.82 sec) served as a controlled trial-end signal. Our approach revealed notable activation differences between the conditions. Cued voluntary attention shifting activated the superior intra--parietal sulcus (IPS), whereas novelty-triggered involuntary orienting activated the inferior IPS and certain subareas of the precuneus. Clearly more widespread activations were observed during voluntary than involuntary orienting in the premotor cortex, including the frontal eye fields. Moreover, we found -evidence for a frontoinsular-cingular attentional control network, consisting of the anterior insula, inferior frontal cortex, and medial frontal cortices, which were activated during both target discrimination and voluntary attention shifting. Finally, novels and targets activated much wider areas of superior temporal auditory cortices than shifting cues.

The Fate of Incoming Stimuli during NREM Sleep is Determined by Spindles and the Phase of the Slow Oscillation

The present study aimed at identifying the neurophysiological responses associated with auditory stimulation during non-rapid eye movement (NREM) sleep using simultaneous electroencephalography (EEG)/functional magnetic resonance imaging (fMRI) recordings. It was reported earlier that auditory stimuli produce bilateral activation in auditory cortex, thalamus, and caudate during both wakefulness and NREM sleep. However, due to the spontaneous membrane potential fluctuations cortical responses may be highly variable during NREM. Here we now examine the modulation of cerebral responses to tones depending on the presence or absence of sleep spindles and the phase of the slow oscillation. Thirteen healthy young subjects were scanned successfully during stage 2-4 NREM sleep in the first half of the night in a 3 T scanner. Subjects were not sleep-deprived and sounds were post hoc classified according to (i) the presence of sleep spindles or (ii) the phase of the slow oscillation during (±300 ms) tone delivery. These detected sounds were then entered as regressors of interest in fMRI analyses. Interestingly wake-like responses - although somewhat altered in size and location - persisted during NREM sleep, except during present spindles (as previously published in Dang-Vu et al., 2011) and the negative going phase of the slow oscillation during which responses became less consistent or even absent. While the phase of the slow oscillation did not alter brain responses in primary sensory cortex, it did modulate responses at higher cortical levels. In addition EEG analyses show a distinct N550 response to tones during the presence of light sleep spindles and suggest that in deep NREM sleep the brain is more responsive during the positive going slope of the slow oscillation. The presence of short temporal windows during which the brain is open to external stimuli is consistent with the fact that even during deep sleep meaningful events can be detected. Altogether, our results emphasize the notion that spontaneous fluctuations of brain activity profoundly modify brain responses to external information across all behavioral states, including deep NREM sleep.

Assessment of temporal state-dependent interactions between auditory fMRI responses to desired and undesired acoustic sources

A confounding factor in auditory functional magnetic resonance imaging (fMRI) experiments is the presence of the acoustic noise inherently associated with the echo planar imaging acquisition technique. Previous studies have demonstrated that this noise can induce unwanted neuronal responses that can mask stimulus-induced responses. Similarly, activation accumulated over multiple stimuli has been demonstrated to elevate the baseline, thus reducing the dynamic range available for subsequent responses. To best evaluate responses to auditory stimuli, it is necessary to account for the presence of all recent acoustic stimulation, beginning with an understanding of the attenuating effects brought about by interaction between and among induced unwanted neuronal responses, and responses to desired auditory stimuli. This study focuses on the characterization of the duration of this temporal memory and qualitative assessment of the associated response attenuation. Two experimental parameters--inter-stimulus interval (ISI) and repetition time (TR)--were varied during an fMRI experiment in which participants were asked to passively attend to an auditory stimulus. Results present evidence of a state-dependent interaction between induced responses. As expected, attenuating effects of these interactions become less significant as TR and ISI increase and in contrast to previous work, persist up to 18s after a stimulus presentation.

The influence of rest period instructions on the default mode network

The default mode network (DMN) refers to regional brain activity that is greater during rest periods than during attention-demanding tasks; many studies have reported DMN alterations in patient populations. It has also been shown that the DMN is suppressed by scanner background noise (SBN), which is the noise produced by functional magnetic resonance imaging (fMRI). However, it is unclear whether different approaches to "rest" in the noisy MR environment can alter the DMN and constitute a confound in studies investigating the DMN in particular patient populations (e.g., individuals with schizophrenia, Alzheimer's disease). We examined 27 healthy adult volunteers who completed an fMRI experiment with three different instructions for rest: (1) relax and be still, (2) attend to SBN, or (3) ignore SBN. Region of interest analyses were performed to determine the influence of rest period instructions on core regions of the DMN and DMN regions previously reported to be altered in patients with or at risk for Alzheimer's disease or schizophrenia. The dorsal medial prefrontal cortex (dmPFC) exhibited greater activity when specific resting instructions were given (i.e., attend to or ignore SBN) compared to when non-specific resting instructions were given. Condition-related differences in connectivity were also observed between regions of the dmPFC and inferior parietal/posterior superior temporal cortex. We conclude that rest period instructions and SBN levels should be carefully considered for fMRI studies on the DMN, especially studies on clinical populations and groups that may have different approaches to rest, such as first-time research participants and children.

The effect of a movie soundtrack on auditory event-related potentials in children, adolescents, and adults

OBJECTIVE

To determine if an audible movie soundtrack has a degrading effect on the auditory P1, N1, P2, N2, or mismatch negativity (MMN) event-related potentials (ERPs) in children, adolescents, or adults.

METHODS

The auditory ERPs of 36 children, 32 young adolescents, 19 older adolescents, and 10 adults were measured while they watched a movie in two conditions: with an audible soundtrack and with a silent soundtrack.

RESULTS

In children and adolescents, the audible movie soundtrack had a significant impact on amplitude, latency or split-half reliability of the N1, P2, N2, and MMN ERPs. The audible soundtrack had minimal impact on the auditory ERPs of adults.

CONCLUSIONS

These findings challenge previous claims that an audible soundtrack does not degrade the auditory ERPs of children. Further, the reliability of the MMN is poorer than P1, N1, P2, and N2 peaks in both sound-off and sound-on conditions.

SIGNIFICANCE

Researchers should be cautious about using an audible movie soundtrack when measuring auditory ERPs in younger listeners.

Modeling hemodynamic responses in auditory cortex at 1.5 T using variable duration imaging acoustic noise

A confound for functional magnetic resonance imaging (fMRI), especially for auditory studies, is the presence of imaging acoustic noise generated mainly as a byproduct of rapid gradient switching during volume acquisition and, to a lesser extent, the radiofrequency transmit. This work utilized a novel pulse sequence to present actual imaging acoustic noise for characterization of the induced hemodynamic responses and assessment of linearity in the primary auditory cortex with respect to noise duration. Results show that responses to brief duration (46 ms) imaging acoustic noise is highly nonlinear while responses to longer duration (>1 s) imaging acoustic noise becomes approximately linear, with the right primary auditory cortex exhibiting a higher degree of nonlinearity than the left for the investigated noise durations. This study also assessed the spatial extent of activation induced by imaging acoustic noise, showing that the use of modeled responses (specific to imaging acoustic noise) as the reference waveform revealed additional activations in the auditory cortex not observed with a canonical gamma variate reference waveform, suggesting an improvement in detection sensitivity for imaging acoustic noise-induced activity. Longer duration (1.5 s) imaging acoustic noise was observed to induce activity that expanded outwards from Heschl's gyrus to cover the superior temporal gyrus as well as parts of the middle temporal gyrus and insula, potentially affecting higher level acoustic processing.

Simultaneous recording of EEG and BOLD responses: A historical perspective

Electromagnetic fields as measured with electroencephalogram (EEG) are a direct consequence of neuronal activity and feature the same timescale as the underlying cognitive processes, while hemodynamic signals as measured with functional magnetic resonance imaging (fMRI) are related to the energy consumption of neuronal populations. It is obvious that a combination of both techniques is a very attractive aim in neuroscience, in order to achieve both high temporal and spatial resolution for the non-invasive study of cognitive brain function. During the last decade a number of research groups have taken up this challenge. Here, we review the development of the combined EEG-fMRI approach. We summarize the main data integration approaches developed to achieve such a combination, discuss the current state-of-the-art in this field and outline challenges for the future success of this promising approach.

Sound level dependence of auditory evoked potentials: Simultaneous EEG recording and low-noise fMRI

The simultaneous recording of EEG and fMRI offers the advantage of combining precise spatial information about neuronal processing obtained by fMRI data with the high temporal resolution of EEG data. One problem for the analysis of auditory processing, however, is the noisy environment during fMRI measurements, especially when EPI sequences are employed. While EEG studies outside an MRI scanner repeatedly demonstrated a clear sound level-dependent increase of N1 amplitude, this finding was less obvious in simultaneous recordings inside a scanner. Based on the assumption that this inconsistency might be due to the confounding effect of the rather loud EPI noise, we employed a low-noise fMRI protocol. This method was previously used to reveal level-dependent fMRI activation in auditory cortex areas. We combined this method with simultaneous EEG recordings to investigate the effect of different sound intensities on the auditory evoked potentials. Eight participants without hearing deficits took part in our experiment. Frequency modulated tones (FM) were presented monaurally with two sound intensities (60 and 80 dB HL). The task of the participants was to categorize the FM-direction (rising vs. falling). Our results inside the scanner replicate the sound level dependence of AEPs from previous EEG studies outside the scanner. The data analysis revealed a significant shortening of N1 latency and an increase in the N1-P2 peak-to-peak amplitude for the higher sound intensity. On a descriptive level, the 80 dB HL stimulation yielded more activated voxels in fMRI and stronger activations. This effect was pronounced over the right hemisphere. Our results suggest that low-noise sequences might be advantageous for the examination of auditory processing in simultaneous EEG and fMRI recordings.

Vowel-specific mismatch responses in the anterior superior temporal gyrus: an fMRI study

There have been many functional imaging studies that have investigated the neural correlates of speech perception by contrasting neural responses to speech and "speech-like" but unintelligible control stimuli. A potential drawback of this approach is that intelligibility is necessarily conflated with a change in the acoustic parameters of the stimuli. The approach we have adopted is to take advantage of the mismatch response elicited by an oddball paradigm to probe neural responses in temporal lobe structures to a parametrically varied set of deviants in order to identify brain regions involved in vowel processing. Thirteen normal subjects were scanned using a functional magnetic resonance imaging (fMRI) paradigm while they listened to continuous trains of auditory stimuli. Three classes of stimuli were used: 'vowel deviants' and two classes of control stimuli: one acoustically similar ('single formants') and the other distant (tones). The acoustic differences between the standard and deviants in both the vowel and single-formant classes were designed to match each other closely. The results revealed an effect of vowel deviance in the left anterior superior temporal gyrus (aSTG). This was most significant when comparing all vowel deviants to standards, irrespective of their psychoacoustic or physical deviance. We also identified a correlation between perceptual discrimination and deviant-related activity in the dominant superior temporal sulcus (STS), although this effect was not stimulus specific. The responses to vowel deviants were in brain regions implicated in the processing of intelligible or meaningful speech, part of the so-called auditory "what" processing stream. Neural components of this pathway would be expected to respond to sudden, perhaps unexpected changes in speech signal that result in a change to narrative meaning.

Assessing the influence of scanner background noise on auditory processing. II. An fMRI study comparing auditory processing in the absence and presence of recorded scanner noise using a sparse design

Several studies reported decreased signal intensities within auditory areas for experimental designs employing continuous scanner background noise (SBN) in comparison to designs with less or no SBN. This study examined the source for this SBN-induced masking effect of the blood oxygenation level-dependent (BOLD) response by directly comparing two experimental sessions with the same auditory stimulation, which was presented either with or without recorded scanner background noise (RecSBN). Ten subjects listened to a series of four one-syllable words and had to decide whether two of the words were identical. The words were either presented with a silent background or with added RecSBN. This was then contrasted with either silence or RecSBN. A sparse temporal sampling method was used in both sessions, which enabled us to directly assess the influence of RecSBN without varying scanning parameters, acquisition quantities, or auditory stimulations. Our results suggest that previously reported SBN-induced masking of the BOLD response in experimental designs with SBN might be caused by an interaction between increased baseline levels and nonlinearity effects within auditory cortices. Adding SBN to an experimental condition does not enhance signal intensities to the same degree that SBN does when presented with a silent background, and therefore contrasting an experimental and baseline condition that both have SBN may lead to signal decreases. In addition, our study shows this effect is greatest in Heschl's gyrus, but can also be observed in higher-order auditory areas.

The Frontal Generator of the Mismatch Negativity Revisited

The mismatch negativity (MMN) is an event-related brain potential elicited by the occurrence of a rare event (deviance) in an otherwise regular acoustic environment, and is assumed to reflect a preattentive mechanism for change detection. A widely adopted model holds that MMN has main generators in the superior temporal planes bilaterally, which are responsible for the sensory memory part of change detection, as well as frontal lobe sources responsible for triggering an attention shift upon change detection. Whereas the temporal sources have been documented in numerous studies across species and methodologies, much less is known about the frontal sources. The present review examines the current state of the evidence for their existence, location, and possible function. It confirms that the frontal generator is still a less consistent finding in MMN research than the temporal generator. There is clear evidence from scalp EEG and, especially, current source density studies for the existence of an MMN generator that is functionally distinct from the main supratemporal generator of the MMN. Evidence from fMRI, PET, optical imaging, EEG source imaging, and lesion studies implicates mainly the inferior frontal and possibly also the medial frontal cortex. However, these results should be taken with caution because of the paucity of support from more direct measures like intracranial recordings and MEG, and the negative findings from several fMRI and PET, as well as EEG source imaging studies. Recent studies also raise questions about the exact role of the frontal generator in triggering an attention shift. Delineating the exact cortical locations of frontal MMN generators, the conditions under which they are activated and, consequently, their function, remains an acute challenge.

Frequency specific impairment of automatic pitch change detection by fMRI acoustic noise: an MEG study

The loud acoustic noise produced by the magnetic resonance scanner is a major source of interference in auditory fMRI research. Whole-head magnetoencephalography (MEG) was used to investigate the interaction between the frequency range of auditory stimulation and fMRI acoustic noise. Pure tones and 3-harmonic complexes varying between 240 and 1240 Hz in frequency were presented while participants attended to a silent subtitled film. Continuous fMRI acoustic noise was presented during half of the blocks. The activity in six regions of interest was analyzed in 100-200 and 200-300 ms time windows to evaluate the magnetic counterparts of the mismatch negativity (MMN) and P3a brain responses. The results suggested that fMRI noise significantly reduced the amplitude of these responses. The effect of the noise on the automatic processing of the tones was more prominent for the tones with frequencies higher than 500 Hz. It is recommended that in the MMN protocols using continuous fMRI acquisition the sound stimuli should be spectrally separated from the fMRI scanner noise spectrum.

EEG reveals the effect of fMRI scanner noise on noise-sensitive subjects

One drawback of fMRI is that subjects must endure intense noise during testing. This may be annoying to some people and acceptable to others. The aim of this study was to examine, by means of event-related potentials (ERPs), the possible influence of this noise on brain activity while performing a mental reasoning task. Subjects carrying out tasks in a silent environment were compared with two groups executing the same tasks in an "fMRI-like" noisy environment, one of which consisted of subjects who were annoyed by the noise and the other of subjects who tolerated it easily. Subjects who were annoyed performed less well (i.e., produced more errors compared to the "no noise" group) and "not annoyed" subjects showed a speed-accuracy trade-off (i.e., reacted faster but made more errors compared to "no noise" subjects). Noise led to more pronounced N1 and P2 peaks but attenuated N2. As early ERP components are influenced by attention, this observation most likely reflects different attentional requirements. The slow cortical negative shift during task processing was significantly attenuated with "annoyed" subjects compared to "not annoyed" subjects. Emotion-related subcortical structures may be responsible for the observed difference. These findings suggest that individual reactions to fMRI scanner noise should be taken into account when designing fMRI studies and interpreting results.

Artifact reduction for simultaneous EEG/fMRI recording: Adaptive FIR reduction of imaging artifacts

OBJECTIVE

We present a new method of effectively removing imaging artifacts of electroencephalography (EEG) and extensively conserving the time-frequency features of EEG signals during simultaneous functional magnetic resonance imaging (fMRI) scanning under conventional conditions.

METHODS

Under the conventional conditions of a 5000 Hz EEG sampling rate, but in the absence of the MRI slice-timing signals, the imaging artifact during each slice scanning is theoretically inferred to be a linear combination of the average artifact waveform and its derivatives, deduced by band-limited Taylor's expansion. Technically, the imaging artifact reduction algorithm is equivalent to an adaptive finite impulse response (FIR) filter.

RESULTS

The capability of this novel method removing the imaging artifacts of EEG recording during fMRI scanning has been demonstrated by a phantom experiment. Moreover, the effectiveness of this method in conserving the time-frequency features of EEG activity has been evaluated by both visually evoked experiments and alpha waves.

CONCLUSIONS

The adaptive FIR method is an effective method of removing the imaging artifacts under conventional conditions, and also conserving the time-frequency EEG signals.

SIGNIFICANCE

The proposed adaptive FIR method, removing the imaging artifacts, combined with the wavelet-based non-linear noise reduction (WNNR) method [Wan X, Iwata K, Riera J, Ozaki T, Kitamura M, Kawashima R. Artifact reduction for EEG/fMRI recording: Nonlinear reduction of ballistocardiogram artifacts. Clin Neurophysiol 2006;117:668-80], reducing the ballistocardiogram artifacts (BAs), makes it feasible to obtain accurate EEG signals from the simultaneous EEG recordings during fMRI scanning.

Effects of age, age-related hearing loss, and contralateral cafeteria noise on the discrimination of small frequency changes: psychoacoustic and electrophysiological measures

The aim of the study was to examine central auditory processes compromised by age, age-related hearing loss, and the presentation of a distracting cafeteria noise using auditory event-related potentials (ERPs). In addition, the relation of ERPs to behavioral measures of discrimination was investigated. Three groups of subjects participated: young normal hearing, elderly subjects with normal hearing for their age, and elderly hearing-impaired subjects. Psychoacoustic frequency discrimination thresholds for a 1000-Hz pure tone were determined in quiet and in the presence of a contralateral cafeteria noise. To elicit ERPs, small frequency contrasts were presented with and without noise under unattended and attended conditions. In the attended condition, behavioral measures of d' detectability and reaction times were also obtained. Noise affected all measures of behavioral frequency discrimination significantly. Except N1, all ERP components in the standard and difference waveforms decreased significantly in amplitude and increased in latency to the same degree in all three subject groups, arguing against a specific age-related sensitivity to the effects of contralateral background noise. For N1 amplitude, the effect of noise was different in the three subject groups, with a complex interaction of age, hearing loss, and attention. Behavioral frequency discrimination was not affected by age but deteriorated significantly in the elderly subjects with hearing loss. In the electrophysiological test, age-related changes occurred at various levels. The most prominent finding in the response to the standard stimuli was a sustained negativity (N2) following P2 in the young subjects that was absent in the elderly, possibly indicating a deficit in the inhibition of irrelevant information processing. In the attended difference waveform, significantly larger N2b and smaller P3b amplitudes and longer N2b and P3b latencies were observed in the elderly indicating different processing strategies. The pronounced age-related changes in the later cognitive components suggest that the discrimination of difficult contrasts, although behaviorally maintained, becomes more effortful in the elderly.

Change detection in children with autism: An auditory event-related fMRI study

Autism involves impairments in communication and social interaction, as well as high levels of repetitive, stereotypic, and ritualistic behaviours, and extreme resistance to change. This latter dimension, whilst required for a diagnosis, has received less research attention. We hypothesise that this extreme resistance to change in autism is rooted in atypical processing of unexpected stimuli. We tested this using auditory event-related fMRI to determine regional brain activity associated with passive detection of infrequently occurring frequency-deviant and complex novel sounds in a no-task condition. Participants were twelve 10- to 15-year-old children with autism and a group of 12 age- and sex-matched healthy controls. During deviance detection, significant activation common to both groups was located in the superior temporal and inferior frontal gyri. During 'novelty detection', both groups showed activity in the superior temporal gyrus, the temporo-parietal junction, the superior and inferior frontal gyri, and the cingulate gyrus. Children with autism showed reduced activation of the left anterior cingulate cortex during both deviance and novelty detection. During novelty detection, children with autism also showed reduced activation in the bilateral temporo-parietal region and in the right inferior and middle frontal areas. This study confirms previous evidence from ERP studies of atypical brain function related to automatic change detection in autism. Abnormalities involved a cortical network known to have a role in attention switching and attentional resource distribution. These results throw light on the neurophysiological processes underlying autistic 'resistance to change'.

Disruption of immediate memory and brain processes: an auditory ERP protocol

An event-related potential (ERP) protocol is described that can be used to investigate those sound-evoked neural processes that may be implicated in disrupting immediate memory. Conventional electroencephalogram (EEG) is recorded during the performance of a task that involves ignoring irrelevant sounds while trying to hold in memory lists of numbers. Specific bioelectric measures are made to prevent the contamination of recordings by the movements of articulators. An approach is also outlined which controls the timing of ERP components to sounds with different envelopes. Using this approach, it has been shown that the neural processes involved in the elicitation of the auditory N1 ERP response may be involved in the disruption of memory for serial order produced by irrelevant sound.

Superior temporal and inferior frontal cortices are activated by infrequent sound duration decrements: an fMRI study

Functional magnetic resonance imaging (fMRI) was used to examine the processing of infrequent changes occurring in an unattended sound sequence. In event-related brain potentials (ERPs), such sound changes typically elicit several responses, including an enhanced N1, the mismatch negativity (MMN), and the P3a. In the present study, subjects were presented with a repeating sound of 75 ms in duration, which was occasionally replaced, in separate blocks, by a 15-ms, 25-ms, or 35-ms sound (large, medium, and small change, respectively). In the baseline block, only the frequent 75-ms sound was presented. During the scanning, the subjects were instructed to ignore the sounds while watching a silent wildlife documentary. We assumed that in this condition, the MMN mechanism would contribute more to the observed activation than the other change-related processes. We expected sound changes to elicit fMRI activation bilaterally in the supratemporal cortices, where the electric MMN is mainly generated, and that the magnitude of this activation would increase with the magnitude of sound duration change. Unexpectedly, however, we found that only blocks with medium duration changes (25 ms) showed significant activation in the supratemporal cortex. In addition, as reported in some previous EEG and fMRI studies, contrasts between different levels of sound duration change revealed additional activation in the inferior frontal cortex bilaterally. This activation tended to be greater for the small and medium changes than for the large ones.

Simultaneous 3-T fMRI and high-density recording of human auditory evoked potentials

We acquired simultaneous high-field (3 T) functional magnetic resonance imaging (fMRI) and high-density (64- and 128-channel) EEG using a sparse sampling technique to measure auditory cortical activity generated by right ear stimulus presentation. Using dipole source localization, we showed that the anatomical location of the grand mean equivalent dipole of auditory evoked potentials (AEPs) and the center of gravity of fMRI activity were in good agreement in the horizontal plane. However, the grand mean equivalent dipole was located significantly superior in the cortex compared to fMRI activity. Interhemispheric asymmetry was exhibited by fMRI, whereas neither the AEP dipole moments nor the mean global field power (MGFP) of the AEPs showed significant asymmetry. Increasing the number of recording electrodes from 64 to 128 improved the accuracy of the equivalent dipole source localization but decreased the signal-to-noise ratio (SNR) of MR images. This suggests that 64 electrodes may be optimal for use in simultaneous recording of EEG and fMRI.

Long-term exposure to occupational noise alters the cortical organization of sound processing

OBJECTIVE

Long-term exposure to noise may cause an altered hemispheric lateralization of speech processing even in silent conditions. We examined whether this lateralization shift is speech specific or occurs also for other sounds.

METHODS

Brain responses from 10 healthy noise-exposed workers (>5 years) and 10 matched controls were recorded with a 32-channel electroencephalogram in two conditions, one including standard and deviant speech sounds, the other non-speech sounds, with novel sounds in both.

RESULTS

The deviant-sound elicited mismatch negativity (MMN) was larger to non-speech than speech sounds in control subjects, while it did not differ between the sound types in the noise-exposed subjects. Moreover, the MMN to speech sounds was lateralized to the right hemisphere in exposed workers, while it was left-hemisphere predominant in control subjects. No group topography difference was found for non-speech sounds. The deviant sounds that were close in formant space to the standards elicited a longer MMN latency in both speech and non-speech conditions in exposed subjects than controls. No group differences were found for cortical responses to novel sounds.

CONCLUSIONS

Long-term noise exposure altered the strength and the hemispheric organization of speech-sound discrimination and decreased the speed of sound-change processing.

SIGNIFICANCE

Subpathological changes in cortical responses to sounds may occur even in subjects without a peripheral damage but continuously exposed to noisy auditory environments.

Silent fMRI acquisition methods for large acoustic noise during scan

Functional magnetic resonance imaging (fMRI) is now the method of choice for studying neural correlates of various tasks in normal subjects as well as patients. This method, however, is inevitably coupled with the acoustic noise produced during the image acquisition process. This is a problem not only in auditory experiments but also in other cognitive tasks in general. The problems caused by such noise are modulation of auditory activation, impaired perception of auditory stimuli, and deterioration of task performance possibly due to stress from the abnormal circumstances. While both hardware and software solutions have been reported, several methods are introduced here that focus on software solutions that can be implemented in scanners already installed. Their advantages and disadvantages differ depending on the kinds of tasks involved, i.e. whether block design or event-related design, and they are discussed with a view to better utilization.

Effects of noise from functional magnetic resonance imaging on auditory event-related potentials in working memory task

The effects of functional magnetic resonance imaging (fMRI) acoustic noise were investigated on the parameters of event-related responses (ERPs) elicited during auditory matching-to-sample location and pitch working memory tasks. Stimuli were tones with varying location (left or right) and frequency (high or low). Subjects were instructed to memorize and compare either the locations or frequencies of the stimuli with each other. Tape-recorded fMRI acoustic noise was presented in half of the experimental blocks. The fMRI noise considerably enhanced the P1 component, reduced the amplitude and increased the latency of the N1, shortened the latency of the N2, and enhanced the amplitude of the P3 in both tasks. The N1 amplitude was higher in the location than pitch task in both noise and no-noise blocks, whereas the task-related N1 latency difference was present in the no-noise blocks only. Although the task-related differences between spatial and nonspatial auditory responses were partially preserved in noise, the finding that the acoustic gradient noise accompanying functional MR imaging modulated the auditory ERPs implies that the noise may confound the results of auditory fMRI experiments especially when studying higher cognitive processing.

Do video sounds interfere with auditory event-related potentials?

To make the electroencephalogram (EEG) recording procedure more tolerable, listeners have been allowed in some experiments to watch an audible video while their auditory P1, N1, P2, and mismatch negativity (MMN) event-related potentials (ERPs) to experimental sounds have been measured. However, video sounds may degrade auditory ERPs to experimental sounds. This concern was tested with 19 adults who were instructed to ignore standard and deviant tones presented through headphones while they watched a video with the soundtrack audible in one condition and silent in the other. Video sound impaired the size, latency, and split-half reliability of the MMN, and it decreased the size of the P2. However, it had little effect on the P1 or N1 or on the split-half reliability of the P1-N1-P2 waveform, which was significantly more reliable than the MMN waveform regardless of whether the video sound was on or off. The impressive reliability of the P1 and N1 components allows for the use of video sound during EEG recording, and they may prove useful for assessing auditory processing in listeners who cannot tolerate long testing sessions.

Acoustic noise and functional magnetic resonance imaging: current strategies and future prospects

Functional magnetic resonance imaging (fMRI) has become the method of choice for studying the neural correlates of cognitive tasks. Nevertheless, the scanner produces acoustic noise during the image acquisition process, which is a problem in the study of auditory pathway and language generally. The scanner acoustic noise not only produces activation in brain regions involved in auditory processing, but also interferes with the stimulus presentation. Several strategies can be used to address this problem, including modifications of hardware and software. Although reduction of the source of the acoustic noise would be ideal, substantial hardware modifications to the current base of installed MRI systems would be required. Therefore, the most common strategy employed to minimize the problem involves software modifications. In this work we consider three main types of acquisitions: compressed, partially silent, and silent. For each implementation, paradigms using block and event-related designs are assessed. We also provide new data, using a silent event-related (SER) design, which demonstrate higher blood oxygen level-dependent (BOLD) response to a simple auditory cue when compared to a conventional image acquisition.