Spatiotemporal reconstruction of the auditory steady-state response to frequency modulation using magnetoencephalography

Neural Tracking of Sound Rhythms Correlates With Diagnosis, Severity, and Prognosis of Disorders of Consciousness

Effective diagnosis and prognosis of patients with disorders of consciousness (DOC) provides a basis for family counseling, decision-making, and the design of rehabilitation programs. However, effective and objective bedside evaluation is a challenging problem. In this study, we explored electroencephalography (EEG) response tracking sound rhythms as potential neural markers for DOC evaluation. We analyzed the responses to natural speech and tones modulated at 2 and 41 Hz. At the population level, patients with positive outcomes (DOC-P) showed higher cortical synchronization to modulated tones at 41 Hz compared with patients with negative outcomes (DOC-N). At the individual level, phase coherence to modulated tones at 41 Hz was significantly correlated with Coma Recovery Scale-Revised (CRS-R) and Glasgow Outcome Scale-Extended (GOS-E) scores. Furthermore, SVM classifiers, trained using phase coherences in higher frequency bands or combination of the low frequency aSSR and speech tracking responses, performed very well in diagnosis and prognosis of DOC. These findings show that EEG response to auditory rhythms is a potential tool for diagnosis, severity, and prognosis of DOC.

Envelope Following Response to 440 Hz Carrier Chirp-Modulated Tones Show Clinically Relevant Changes in Schizophrenia

The 40 Hz auditory steady-state response (ASSR) impairment is suggested as an electrophysiological biomarker of schizophrenia; however, existing data also points to the deficiency of low and high frequency ASSR responses. In order to obtain the full picture of potential impairment in schizophrenia, it is important to test responses at different frequencies. The current study aims to evaluate a wide frequency range (1-120 Hz) in response to brief low-frequency carrier chirp-modulated tones in a group of patients with schizophrenia. The EEG-derived envelope following responses (EFRs) were obtained in a group of male patients with schizophrenia (N = 18) and matched controls (N = 18). While subjects were watching silent movies, 440 Hz carrier chirp-modulated at 1-120 Hz tones were presented. Phase-locking index and evoked amplitude in response to stimulation were assessed and compared on point-to-point basis. The peak frequency of the low gamma response was estimated. Measures were correlated with psychopathology-positive, negative, total scores of the Positive and Negative Syndrome Scale (PANSS), and hallucination subscale scores. In comparison to controls, patients showed (1) reduced power of theta-beta (4-18 Hz) responses, (2) intact but slower low gamma (30-60 Hz), and (3) reduced high gamma (95-120 Hz) responses. No correlation survived the Bonferroni correction, but a sign of positive association between low gamma phase-locking and the prevalence of hallucinations, and a sign of negative association between high gamma phase-locking and the total PANSS scores were observed. Brain networks showed impaired capabilities to generate EFRs at different frequencies in schizophrenia; moreover, even when responses of patients did not significantly differ from controls on the group level, they still showed potentially clinically relevant variability.

Objective Binaural Loudness Balancing Based on 40-Hz Auditory Steady-State Responses. Part I: Normal Hearing

Psychophysical procedures are used to balance loudness across the ears. However, they can be difficult and require active cooperation. We investigated whether 40-Hz auditory steady-state response (ASSR) amplitudes can be used to objectively estimate the balanced loudness across the ears for a group of young, normal-hearing participants. The 40-Hz ASSRs were recorded using monaural stimuli with carrier frequencies of 500, 1000, or 2000 Hz over a range of levels between 40 and 80 dB SPL. Behavioral loudness balancing was performed for at least one reference level of the left ear. ASSR amplitude growth functions were listener dependent, but median across-ear ratios in ASSR amplitudes were close to 1. The differences between the ASSR-predicted balanced levels and the behaviorally found balanced levels were smaller than 5 dB in 59% of cases and smaller than 10 dB in 85% of cases. The differences between the ASSR-predicted balanced levels and the reference levels were smaller than 5 dB in 54% of cases and smaller than 10 dB in 87% of cases. No clear hemispheric lateralization was found for 40-Hz ASSRs, with the exception of responses evoked by stimulus levels of 40 to 60 dB SPL at 2000 Hz.

Dynamic cortical representations of perceptual filling-in for missing acoustic rhythm

In the phenomenon of perceptual filling-in, missing sensory information can be reconstructed via interpolation or extrapolation from adjacent contextual cues by what is necessarily an endogenous, not yet well understood, neural process. In this investigation, sound stimuli were chosen to allow observation of fixed cortical oscillations driven by contextual (but missing) sensory input, thus entirely reflecting endogenous neural activity. The stimulus employed was a 5 Hz frequency-modulated tone, with brief masker probes (noise bursts) occasionally added. For half the probes, the rhythmic frequency modulation was moreover removed. Listeners reported whether the tone masked by each probe was perceived as being rhythmic or not. Time-frequency analysis of neural responses obtained by magnetoencephalography (MEG) shows that for maskers without the underlying acoustic rhythm, trials where rhythm was nonetheless perceived show higher evoked sustained rhythmic power than trials for which no rhythm was reported. The results support a model in which perceptual filling-in is aided by differential co-modulations of cortical activity at rates directly relevant to human speech communication. We propose that the presence of rhythmically-modulated neural dynamics predicts the subjective experience of a rhythmically modulated sound in real time, even when the perceptual experience is not supported by corresponding sensory data.

The role of phase-locking to the temporal envelope of speech in auditory perception and speech intelligibility

The temporal envelope of speech is important for speech intelligibility. Entrainment of cortical oscillations to the speech temporal envelope is a putative mechanism underlying speech intelligibility. Here we used magnetoencephalography (MEG) to test the hypothesis that phase-locking to the speech temporal envelope is enhanced for intelligible compared with unintelligible speech sentences. Perceptual "pop-out" was used to change the percept of physically identical tone-vocoded speech sentences from unintelligible to intelligible. The use of pop-out dissociates changes in phase-locking to the speech temporal envelope arising from acoustical differences between un/intelligible speech from changes in speech intelligibility itself. Novel and bespoke whole-head beamforming analyses, based on significant cross-correlation between the temporal envelopes of the speech stimuli and phase-locked neural activity, were used to localize neural sources that track the speech temporal envelope of both intelligible and unintelligible speech. Location-of-interest analyses were carried out in a priori defined locations to measure the representation of the speech temporal envelope for both un/intelligible speech in both the time domain (cross-correlation) and frequency domain (coherence). Whole-brain beamforming analyses identified neural sources phase-locked to the temporal envelopes of both unintelligible and intelligible speech sentences. Crucially there was no difference in phase-locking to the temporal envelope of speech in the pop-out condition in either the whole-brain or location-of-interest analyses, demonstrating that phase-locking to the speech temporal envelope is not enhanced by linguistic information.

Effects of contralateral noise on the 20-Hz auditory steady state response--magnetoencephalography study

The auditory steady state response (ASSR) is an oscillatory brain response, which is phase locked to the rhythm of an auditory stimulus. ASSRs have been recorded in response to a wide frequency range of modulation and/or repetition, but the physiological features of the ASSRs are somewhat different depending on the modulation frequency. Recently, the 20-Hz ASSR has been emphasized in clinical examinations, especially in the area of psychiatry. However, little is known about the physiological properties of the 20-Hz ASSR, compared to those of the 40-Hz and 80-Hz ASSRs. The effects of contralateral noise on the ASSR are known to depend on the modulation frequency to evoke ASSR. However, the effects of contralateral noise on the 20-Hz ASSR are not known. Here we assessed the effects of contralateral white noise at a level of 70 dB SPL on the 20-Hz and 40-Hz ASSRs using a helmet-shaped magnetoencephalography system in 9 healthy volunteers (8 males and 1 female, mean age 31.2 years). The ASSRs were elicited by monaural 1000-Hz 5-s tone bursts amplitude-modulated at 20 and 39 Hz and presented at 80 dB SPL. Contralateral noise caused significant suppression of both the 20-Hz and 40-Hz ASSRs, although suppression was significantly smaller for the 20-Hz ASSRs than the 40-Hz ASSRs. Moreover, the greatest suppression of both 20-Hz and 40-Hz ASSRs occurred in the right hemisphere when stimuli were presented to the right ear with contralateral noise. The present study newly showed that 20-Hz ASSRs are suppressed by contralateral noise, which may be important both for characterization of the 20-Hz ASSR and for interpretation in clinical situations. Physicians must be aware that the 20-Hz ASSR is significantly suppressed by sound (e.g. masking noise or binaural stimulation) applied to the contralateral ear.

Oscillatory phase dynamics in neural entrainment underpin illusory percepts of time

Neural oscillatory dynamics are a candidate mechanism to steer perception of time and temporal rate change. While oscillator models of time perception are strongly supported by behavioral evidence, a direct link to neural oscillations and oscillatory entrainment has not yet been provided. In addition, it has thus far remained unaddressed how context-induced illusory percepts of time are coded for in oscillator models of time perception. To investigate these questions, we used magnetoencephalography and examined the neural oscillatory dynamics that underpin pitch-induced illusory percepts of temporal rate change. Human participants listened to frequency-modulated sounds that varied over time in both modulation rate and pitch, and judged the direction of rate change (decrease vs increase). Our results demonstrate distinct neural mechanisms of rate perception: Modulation rate changes directly affected listeners' rate percept as well as the exact frequency of the neural oscillation. However, pitch-induced illusory rate changes were unrelated to the exact frequency of the neural responses. The rate change illusion was instead linked to changes in neural phase patterns, which allowed for single-trial decoding of percepts. That is, illusory underestimations or overestimations of perceived rate change were tightly coupled to increased intertrial phase coherence and changes in cerebro-acoustic phase lag. The results provide insight on how illusory percepts of time are coded for by neural oscillatory dynamics.

Dissociable neural response signatures for slow amplitude and frequency modulation in human auditory cortex

Natural auditory stimuli are characterized by slow fluctuations in amplitude and frequency. However, the degree to which the neural responses to slow amplitude modulation (AM) and frequency modulation (FM) are capable of conveying independent time-varying information, particularly with respect to speech communication, is unclear. In the current electroencephalography (EEG) study, participants listened to amplitude- and frequency-modulated narrow-band noises with a 3-Hz modulation rate, and the resulting neural responses were compared. Spectral analyses revealed similar spectral amplitude peaks for AM and FM at the stimulation frequency (3 Hz), but amplitude at the second harmonic frequency (6 Hz) was much higher for FM than for AM. Moreover, the phase delay of neural responses with respect to the full-band stimulus envelope was shorter for FM than for AM. Finally, the critical analysis involved classification of single trials as being in response to either AM or FM based on either phase or amplitude information. Time-varying phase, but not amplitude, was sufficient to accurately classify AM and FM stimuli based on single-trial neural responses. Taken together, the current results support the dissociable nature of cortical signatures of slow AM and FM. These cortical signatures potentially provide an efficient means to dissect simultaneously communicated slow temporal and spectral information in acoustic communication signals.

Representation of frequency-modulated sounds in the human brain

Frequency-modulation is a ubiquitous sound feature present in communicative sounds of various animal species and humans. Functional imaging of the human auditory system has seen remarkable advances in the last two decades and studies pertaining to frequency-modulation have centered around two major questions: a) are there dedicated feature-detectors encoding frequency-modulation in the brain and b) is there concurrent representation with amplitude-modulation, another temporal sound feature? In this review, we first describe how these two questions are motivated by psychophysical studies and neurophysiology in animal models. We then review how human non-invasive neuroimaging studies have furthered our understanding of the representation of frequency-modulated sounds in the brain. Finally, we conclude with some suggestions on how human neuroimaging could be used in future studies to address currently still open questions on this fundamental sound feature. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

White matter lateralization and interhemispheric coherence to auditory modulations in normal reading and dyslexic adults

Neural activation of slow acoustic variations that are important for syllable identification is more lateralized to the right hemisphere than activation of fast acoustic changes that are important for phoneme identification. It has been suggested that this complementary function at different hemispheres is rooted in a different degree of white matter myelination in the left versus right hemisphere. The present study will investigate this structure-function relationship with Diffusion Tensor Imaging (DTI) and Auditory Steady-State Responses (ASSR), respectively. With DTI we examined white matter lateralization in the cortical auditory and language regions (i.e. posterior region of the superior temporal gyrus and the arcuate fasciculus) and white matter integrity in the splenium of the corpus callosum. With ASSR we examined interhemispheric coherence to slow, syllabic-rate (i.e. 4 Hz) and fast, phonemic-rate (i.e. 20 Hz) modulations. These structural and functional techniques were applied in a group of normal reading adults and a group of dyslexic adults for whom previously reduced functional interhemispheric connectivity at 20 Hz has been reported (Poelmans et al. (2012). Ear and Hearing, 33, 134-143). This sample was chosen since it is hypothesized that in dyslexic readers insufficient hemispheric asymmetry in myelination might relate to their auditory and phonological problems. Results demonstrate reduced white matter lateralization in the posterior superior temporal gyrus and the arcuate fasciculus in the dyslexic readers. Additionally, white matter lateralization in the posterior superior temporal gyrus and white matter integrity in the splenium of the corpus callosum related to interhemispheric coherence to phonemic-rate modulations (i.e. 20 Hz). Interestingly, this correlation pattern was opposite in normal versus dyslexic readers. These results might imply that less pronounced left white matter dominance in dyslexic adults might relate to their problems to process phonemic-rate acoustic information and to integrate them into the phonological system.

Frequency modulation entrains slow neural oscillations and optimizes human listening behavior

The human ability to continuously track dynamic environmental stimuli, in particular speech, is proposed to profit from "entrainment" of endogenous neural oscillations, which involves phase reorganization such that "optimal" phase comes into line with temporally expected critical events, resulting in improved processing. The current experiment goes beyond previous work in this domain by addressing two thus far unanswered questions. First, how general is neural entrainment to environmental rhythms: Can neural oscillations be entrained by temporal dynamics of ongoing rhythmic stimuli without abrupt onsets? Second, does neural entrainment optimize performance of the perceptual system: Does human auditory perception benefit from neural phase reorganization? In a human electroencephalography study, listeners detected short gaps distributed uniformly with respect to the phase angle of a 3-Hz frequency-modulated stimulus. Listeners' ability to detect gaps in the frequency-modulated sound was not uniformly distributed in time, but clustered in certain preferred phases of the modulation. Moreover, the optimal stimulus phase was individually determined by the neural delta oscillation entrained by the stimulus. Finally, delta phase predicted behavior better than stimulus phase or the event-related potential after the gap. This study demonstrates behavioral benefits of phase realignment in response to frequency-modulated auditory stimuli, overall suggesting that frequency fluctuations in natural environmental input provide a pacing signal for endogenous neural oscillations, thereby influencing perceptual processing.

Representations of the temporal envelope of sounds in human auditory cortex: can the results from invasive intracortical "depth" electrode recordings be replicated using non-invasive MEG "virtual electrodes"?

Magnetoencephalography (MEG) beamformer analyses use spatial filters to estimate neuronal activity underlying the magnetic fields measured by the MEG sensors. MEG "virtual electrodes" are the outputs of beamformer spatial filters. The present study aimed to test the hypothesis that MEG virtual electrodes can replicate the findings from intracortical "depth" electrode studies relevant to the processing of the temporal envelopes of sounds [e.g. Nourski et al. (2009) "Temporal envelope of time-compressed speech represented in the human auditory cortex," J. Neurosci. 29:15564-15574]. Specifically we aimed to determine whether it is possible to use non-invasive MEG virtual electrodes to characterise the representation of temporal envelopes of 6-Hz sinusoidal amplitude modulation (SAM) and speech using both auditory evoked fields (AEFs) and patterns of power changes in high-frequency (>70 Hz) bands. MEG signals were analysed using a location of interest (LOI) approach by seeding virtual electrodes in the left and right posteromedial Heschl's gyri. AEFs showed phase-locking to the temporal envelope of SAM and speech stimuli. Time-frequency analyses revealed no clear differences in high gamma power between the pre-stimulus baseline and the post-stimulus presentation periods. Nevertheless the patterns of changes in high gamma power were significantly correlated with the temporal envelopes of 6-Hz SAM and speech in the majority of participants. The present study reveals difficulties in replicating clear augmentations in high gamma power changes using MEG virtual electrodes cf. intracortical "depth" electrode studies (Nourski et al., 2009).

Hemispheric asymmetry of auditory steady-state responses to monaural and diotic stimulation

Amplitude modulations in the speech envelope are crucial elements for speech perception. These modulations comprise the processing rate at which syllabic (~3-7 Hz), and phonemic transitions occur in speech. Theories about speech perception hypothesize that each hemisphere in the auditory cortex is specialized in analyzing modulations at different timescales, and that phonemic-rate modulations of the speech envelope lateralize to the left hemisphere, whereas right lateralization occurs for slow, syllabic-rate modulations. In the present study, neural processing of phonemic- and syllabic-rate modulations was investigated with auditory steady-state responses (ASSRs). ASSRs to speech-weighted noise stimuli, amplitude modulated at 4, 20, and 80 Hz, were recorded in 30 normal-hearing adults. The 80 Hz ASSR is primarily generated by the brainstem, whereas 20 and 4 Hz ASSRs are mainly cortically evoked and relate to speech perception. Stimuli were presented diotically (same signal to both ears) and monaurally (one signal to the left or right ear). For 80 Hz, diotic ASSRs were larger than monaural responses. This binaural advantage decreased with decreasing modulation frequency. For 20 Hz, diotic ASSRs were equal to monaural responses, while for 4 Hz, diotic responses were smaller than monaural responses. Comparison of left and right ear stimulation demonstrated that, with decreasing modulation rate, a gradual change from ipsilateral to right lateralization occurred. Together, these results (1) suggest that ASSR enhancement to binaural stimulation decreases in the ascending auditory system and (2) indicate that right lateralization is more prominent for low-frequency ASSRs. These findings may have important consequences for electrode placement in clinical settings, as well as for the understanding of low-frequency ASSR generation.

Gamma activation in young people with autism spectrum disorders and typically-developing controls when viewing emotions on faces

BACKGROUND

Behavioural studies have highlighted irregularities in recognition of facial affect in children and young people with autism spectrum disorders (ASDs). Recent findings from studies utilising electroencephalography (EEG) and magnetoencephalography (MEG) have identified abnormal activation and irregular maintenance of gamma (>30 Hz) range oscillations when ASD individuals attempt basic visual and auditory tasks.

METHODOLOGY/PRINCIPAL FINDINGS

The pilot study reported here is the first study to use spatial filtering techniques in MEG to explore face processing in children with ASD. We set out to examine theoretical suggestions that gamma activation underlying face processing may be different in a group of children and young people with ASD (n = 13) compared to typically developing (TD) age, gender and IQ matched controls. Beamforming and virtual electrode techniques were used to assess spatially localised induced and evoked activity. While lower-band (3-30 Hz) responses to faces were similar between groups, the ASD gamma response in occipital areas was observed to be largely absent when viewing emotions on faces. Virtual electrode analysis indicated the presence of intact evoked responses but abnormal induced activity in ASD participants.

CONCLUSIONS/SIGNIFICANCE

These findings lend weight to previous suggestions that specific components of the early visual response to emotional faces is abnormal in ASD. Elucidation of the nature and specificity of these findings is worthy of further research.

Steady-state responses in MEG demonstrate information integration within but not across the auditory and visual senses

To form a unified percept of our environment, the human brain integrates information within and across the senses. This MEG study investigated interactions within and between sensory modalities using a frequency analysis of steady-state responses that are elicited time-locked to periodically modulated stimuli. Critically, in the frequency domain, interactions between sensory signals are indexed by crossmodulation terms (i.e. the sums and differences of the fundamental frequencies). The 3 × 2 factorial design, manipulated (1) modality: auditory, visual or audiovisual (2) steady-state modulation: the auditory and visual signals were modulated only in one sensory feature (e.g. visual gratings modulated in luminance at 6 Hz) or in two features (e.g. tones modulated in frequency at 40 Hz & amplitude at 0.2 Hz). This design enabled us to investigate crossmodulation frequencies that are elicited when two stimulus features are modulated concurrently (i) in one sensory modality or (ii) in auditory and visual modalities. In support of within-modality integration, we reliably identified crossmodulation frequencies when two stimulus features in one sensory modality were modulated at different frequencies. In contrast, no crossmodulation frequencies were identified when information needed to be combined from auditory and visual modalities. The absence of audiovisual crossmodulation frequencies suggests that the previously reported audiovisual interactions in primary sensory areas may mediate low level spatiotemporal coincidence detection that is prominent for stimulus transients but less relevant for sustained SSR responses. In conclusion, our results indicate that information in SSRs is integrated over multiple time scales within but not across sensory modalities at the primary cortical level.

Sensitivity to temporal modulation rate and spectral bandwidth in the human auditory system: MEG evidence

Slow acoustic modulations below 20 Hz, of varying bandwidths, are dominant components of speech and many other natural sounds. The dynamic neural representations of these modulations are difficult to study through noninvasive neural-recording methods, however, because of the omnipresent background of slow neural oscillations throughout the brain. We recorded the auditory steady-state responses (aSSR) to slow amplitude modulations (AM) from 14 human subjects using magnetoencephalography. The responses to five AM rates (1.5, 3.5, 7.5, 15.5, and 31.5 Hz) and four types of carrier (pure tone and 1/3-, 2-, and 5-octave pink noise) were investigated. The phase-locked aSSR was detected reliably in all conditions. The response power generally decreases with increasing modulation rate, and the response latency is between 100 and 150 ms for all but the highest rates. Response properties depend only weakly on the bandwidth. Analysis of the complex-valued aSSR magnetic fields in the Fourier domain reveals several neural sources with different response phases. These neural sources of the aSSR, when approximated by a single equivalent current dipole (ECD), are distinct from and medial to the ECD location of the N1m response. These results demonstrate that the globally synchronized activity in the human auditory cortex is phase locked to slow temporal modulations below 30 Hz, and the neural sensitivity decreases with an increasing AM rate, with relative insensitivity to bandwidth.

The neural basis of the right visual field advantage in reading: an MEG analysis using virtual electrodes

Right-handed participants respond more quickly and more accurately to written words presented in the right visual field (RVF) than in the left visual field (LVF). Previous attempts to identify the neural basis of the RVF advantage have had limited success. Experiment 1 was a behavioral study of lateralized word naming which established that the words later used in Experiment 2 showed a reliable RVF advantage which persisted over multiple repetitions. In Experiment 2, the same words were interleaved with scrambled words and presented in the LVF and RVF to right-handed participants seated in an MEG scanner. Participants read the real words silently and responded "pattern" covertly to the scrambled words. A beamformer analysis created statistical maps of changes in oscillatory power within the brain. Those whole-brain maps revealed activation of the reading network by both LVF and RVF words. Virtual electrode analyses used the same beamforming method to reconstruct the responses to real and scrambled words in three regions of interest in both hemispheres. The middle occipital gyri showed faster and stronger responses to contralateral than to ipsilateral stimuli, with evidence of asymmetric channeling of information into the left hemisphere. The left mid fusiform gyrus at the site of the 'visual word form area' responded more strongly to RVF than to LVF words. Activity in speech-motor cortex was lateralized to the left hemisphere, and stronger to RVF than LVF words, which is interpreted as representing the proximal cause of the RVF advantage for naming written words.

Representation of temporal sound features in the human auditory cortex

Temporal information in acoustic signals is important for the perception of environmental sounds, including speech. This review focuses on several aspects of temporal processing within human auditory cortex and its relevance for the processing of speech sounds. Periodic non-speech sounds, such as trains of acoustic clicks and bursts of amplitude-modulated noise or tones, can elicit different percepts depending on the pulse repetition rate or modulation frequency. Such sounds provide convenient methodological tools to study representation of timing information in the auditory system. At low repetition rates of up to 8-10 Hz, each individual stimulus (a single click or a sinusoidal amplitude modulation cycle) within the sequence is perceived as a separate event. As repetition rates increase up to and above approximately 40 Hz, these events blend together, giving rise first to the percept of flutter and then to pitch. The extent to which neural responses of human auditory cortex encode temporal features of acoustic stimuli is discussed within the context of these perceptual classes of periodic stimuli and their relationship to speech sounds. Evidence for neural coding of temporal information at the level of the core auditory cortex in humans suggests possible physiological counterparts to perceptual categorical boundaries for periodic acoustic stimuli. Temporal coding is less evident in auditory cortical fields beyond the core. Finally, data suggest hemispheric asymmetry in temporal cortical processing.

Frequency characteristics of contralateral sound suppression of 40-Hz auditory steady-state response

Sound presented to the contralateral ear suppresses the amplitude of the 40-Hz auditory steady-state response (ASSR). The frequency characteristics of this suppression of the 40-Hz ASSR for amplitude modulated (AM) tones at 1,000 Hz (79-dB SPL) were examined in 12 healthy volunteers (10 males and 2 females, mean age 32.3 years) using contralateral AM tones (500, 1,000, 2,000, and 4,000 Hz) and 1/3 octave-band noise (500, 1,000, 2,000, and 4,000 Hz). The 40-Hz ASSR at 1,000 Hz was suppressed by a relatively wide frequency range of contralateral sound than expected from the known characteristics of psychophysical central masking by contralateral sound: the greatest suppression was obtained with 500- and 1,000-Hz sounds, but considerable suppression was also obtained with 2,000- and 4,000-Hz sounds. Substantial differences in the suppression pattern were not observed between two types of contra-suppressors; i.e., AM tones and 1/3 octave-band noise. Therefore, any sound presented to the contralateral ear, regardless of the frequency, can suppress the 40-Hz ASSR. Moreover, the different frequency characteristics of the contralateral sound effects between the psychophysical central masking and the 40-Hz ASSR would support the idea that the 40-Hz ASSR has an additive role in the processing of auditory signals to simple threshold judgment. Investigation of the type of psychophysical measurement using the AM signal showing similar suppression patterns by the presentation of contralateral sound would be helpful to reveal the functional relevance of ASSRs.

Repetition enhancement for frequency-modulated but not unmodulated sounds: a human MEG study

Background

Decoding of frequency-modulated (FM) sounds is essential for phoneme identification. This study investigates selectivity to FM direction in the human auditory system.

Methodology/Principal Findings

Magnetoencephalography was recorded in 10 adults during a two-tone adaptation paradigm with a 200-ms interstimulus-interval. Stimuli were pairs of either same or different frequency modulation direction. To control that FM repetition effects cannot be accounted for by their on- and offset properties, we additionally assessed responses to pairs of unmodulated tones with either same or different frequency composition. For the FM sweeps, N1m event-related magnetic field components were found at 103 and 130 ms after onset of the first (S1) and second stimulus (S2), respectively. This was followed by a sustained component starting at about 200 ms after S2. The sustained response was significantly stronger for stimulation with the same compared to different FM direction. This effect was not observed for the non-modulated control stimuli.

Conclusions/Significance

Low-level processing of FM sounds was characterized by repetition enhancement to stimulus pairs with same versus different FM directions. This effect was FM-specific; it did not occur for unmodulated tones. The present findings may reflect specific interactions between frequency separation and temporal distance in the processing of consecutive FM sweeps.

Functional asymmetries in the representation of noise-vocoded speech

It is generally accepted that, while speech is processed bilaterally in auditory cortical areas, complementary analyses of the speech signal are carried out across the hemispheres. However, the Asymmetric Sampling in Time (AST) model (Poeppel, 2003) suggests that there is functional asymmetry due to different time scales of temporal integration in each hemisphere. The right hemisphere preferentially processes slow modulations commensurate with the theta frequency band (~4-8 Hz), whereas the left hemisphere is more sensitive to fast temporal modulations in the gamma frequency range (~25-50 Hz). Here we examined the perception of noise-vocoded, i.e. spectrally-degraded, words. Magnetoencephalography (MEG) beamformer analyses were used to determine where and how noise-vocoded speech is represented in terms of changes in power resulting from neuronal activity. The outputs of beamformer spatial filters were used to delineate the temporal dynamics of these changes in power. Beamformer analyses localised low-frequency "delta" (1-4 Hz) and "theta" (3-6 Hz) changes in total power to the left hemisphere and high-frequency "gamma" (60-80 Hz, 80-100 Hz) changes in total power to the right hemisphere. Time-frequency analyses confirmed the frequency content and timing of changes in power in the left and right hemispheres. Together the beamformer and time-frequency analyses demonstrate a functional asymmetry in the representation of noise-vocoded words that is inconsistent with the AST model, at least in brain areas outside of primary auditory cortex.

Temporal dynamics of sinusoidal and non-sinusoidal amplitude modulation

Previous behavioural studies in human subjects have demonstrated the importance of amplitude modulations to the process of intelligible speech perception. In functional neuroimaging studies of amplitude modulation processing, the inherent assumption is that all sounds are decomposed into simple building blocks, i.e. sinusoidal modulations. The encoding of complex and dynamic stimuli is often modelled to be the linear addition of a number of sinusoidal modulations and so, by investigating the response of the cortex to sinusoidal modulation, an experimenter can probe the same mechanisms used to encode speech. The experiment described in this paper used magnetoencephalography to measure the auditory steady-state response produced by six sounds, all modulated in amplitude at the same frequency but which formed a continuum from sinusoidal to pulsatile modulation. Analysis of the evoked response shows that the magnitude of the envelope-following response is highly non-linear, with sinusoidal amplitude modulation producing the weakest steady-state response. Conversely, the phase of the steady-state response was related to the shape of the modulation waveform, with the sinusoidal amplitude modulation producing the shortest latency relative to the other stimuli. It is shown that a point in auditory cortex produces a strong envelope following response to all stimuli on the continuum, but the timing of this response is related to the shape of the modulation waveform. The results suggest that steady-state response characteristics are determined by features of the waveform outside of the modulation domain and that the use of purely sinusoidal amplitude modulations may be misleading, especially in the context of speech encoding.

Neural representations of complex temporal modulations in the human auditory cortex

Natural sounds such as speech contain multiple levels and multiple types of temporal modulations. Because of nonlinearities of the auditory system, however, the neural response to multiple, simultaneous temporal modulations cannot be predicted from the neural responses to single modulations. Here we show the cortical neural representation of an auditory stimulus simultaneously frequency modulated (FM) at a high rate, f(FM) approximately 40 Hz, and amplitude modulation (AM) at a slow rate, f(AM) <15 Hz. Magnetoencephalography recordings show fast FM and slow AM stimulus features evoke two separate but not independent auditory steady-state responses (aSSR) at f(FM) and f(AM), respectively. The power, rather than phase locking, of the aSSR of both decreases with increasing stimulus f(AM). The aSSR at f(FM) is itself simultaneously amplitude modulated and phase modulated with fundamental frequency f(AM), showing that the slow stimulus AM is not only encoded in the neural response at f(AM) but also encoded in the instantaneous amplitude and phase of the neural response at f(FM). Both the amplitude modulation and phase modulation of the aSSR at f(FM) are most salient for low stimulus f(AM) but remain observable at the highest tested f(AM) (13.8 Hz). The instantaneous amplitude of the aSSR at f(FM) is successfully predicted by a model containing temporal integration on two time scales, approximately 25 and approximately 200 ms, followed by a static compression nonlinearity.