BOLD correlates of edge detection in human auditory cortex

Neural dynamics of change detection in crowded acoustic scenes

Two key questions concerning change detection in crowded acoustic environments are the extent to which cortical processing is specialized for different forms of acoustic change and when in the time-course of cortical processing neural activity becomes predictive of behavioral outcomes. Here, we address these issues by using magnetoencephalography (MEG) to probe the cortical dynamics of change detection in ongoing acoustic scenes containing as many as ten concurrent sources. Each source was formed of a sequence of tone pips with a unique carrier frequency and temporal modulation pattern, designed to mimic the spectrotemporal structure of natural sounds. Our results show that listeners are more accurate and quicker to detect the appearance (than disappearance) of an auditory source in the ongoing scene. Underpinning this behavioral asymmetry are change-evoked responses differing not only in magnitude and latency, but also in their spatial patterns. We find that even the earliest (~50 ms) cortical response to change is predictive of behavioral outcomes (detection times), consistent with the hypothesized role of local neural transients in supporting change detection.

Short-term retrospective versus prospective memory processing as emergent properties of the mind and brain: human fMRI evidence

The functional-neuroanatomical substrates for short-term retrospective versus prospective memory processing were examined in a delay task, in which associative choices were made conditionally based on the presenting discriminative/cue stimulus. Delay-period prospection could be of the intended choice and/or the expected response outcome, whereas delay-period retrospection would be of the just-presented cue stimulus. Previous results have shown that the spontaneous process of unique outcome prospection did not implicate the lateral prefrontal cortex (PFC) but instead implicated the lateral posterior parietal cortex (LPPC) in a modality-independent fashion (Mok et al., 2009). Spontaneous retrospection was more dependent on the medial temporal lobe (MTL). Nevertheless, it was anticipated that the more explicit process of prospecting an intended choice would implicate the lateral PFC. To verify this, Mok et al.'s data were further analyzed, with new control data. Healthy, young adults performed delayed discriminative choices under procedures that biased them toward different degrees of delay-period prospection: higher-using cue-unique, differential outcomes (DO); versus lower-using a non-unique, common outcome (CO), or unpredictable, non-differential outcomes (NDO). Experimental participants performed the DO versus CO procedures concurrently, while undergoing event-related functional magnetic resonance imaging (fMRI). Separately, control participants provided data for: the NDO condition; related comparison tasks, which biased them toward different degrees of delay-period retrospection; and null-event trials. Expectedly, the more explicit process of prospecting an intended associative choice implicated the lateral PFC, as part of and together with other components of the multiple-demand network. Comparisons against null-event trials indicated that the sustained delay activity observed in MTL and LPPC, respectively, was part of default brain activity. These results demonstrated that short-term retrospection and prospection may emerge without necessarily relying on working memory-specific brain networks. Furthermore, attention may not necessarily be recruited to realize working memory. When cognitive processes are spontaneously experienced, they may be facilitated by the default brain network.

Functional development in the infant brain for auditory pitch processing

Understanding how the developing brain processes auditory information is a critical step toward the clarification of infants' perception of speech and music. We have reported that the infant brain perceives pitch information in speech sounds. Here, we used multichannel near-infrared spectroscopy to examine whether the infant brain is sensitive to information of pitch changes in auditory sequences. Three types of auditory sequences with distinct temporal structures of pitch changes were presented to 3- and 6-month-old infants: a long condition of 12 successive tones constructing a chromatic scale (600 ms), a short condition of four successive tones constructing a chromatic scale (200 ms), and a random condition of random tone sequences (50 ms per tone). The difference among the conditions was only in the sequential order of the tones, which causes pitch changes between the successive tones. We found that the bilateral temporal regions of both ages of infants showed significant activation under the three conditions. The stimulus-dependent activation was observed in the right temporoparietal region of the both infant groups; the 3- and 6-month-old infants showed the most prominent activation under the random and short conditions, respectively. Our findings indicate that the infant brain, which shows functional differentiation and lateralization in auditory-related areas, is capable of responding to more than single tones of pitch information. These results suggest that the right temporoparietal region of the infants increases sensitivity to auditory sequences, which have temporal structures similar to those of syllables in speech sounds, in the course of development.

Musical training induces functional plasticity in human hippocampus

Training can change the functional and structural organization of the brain, and animal models demonstrate that the hippocampus formation is particularly susceptible to training-related neuroplasticity. In humans, however, direct evidence for functional plasticity of the adult hippocampus induced by training is still missing. Here, we used musicians' brains as a model to test for plastic capabilities of the adult human hippocampus. By using functional magnetic resonance imaging optimized for the investigation of auditory processing, we examined brain responses induced by temporal novelty in otherwise isochronous sound patterns in musicians and musical laypersons, since the hippocampus has been suggested previously to be crucially involved in various forms of novelty detection. In the first cross-sectional experiment, we identified enhanced neural responses to temporal novelty in the anterior left hippocampus of professional musicians, pointing to expertise-related differences in hippocampal processing. In the second experiment, we evaluated neural responses to acoustic temporal novelty in a longitudinal approach to disentangle training-related changes from predispositional factors. For this purpose, we examined an independent sample of music academy students before and after two semesters of intensive aural skills training. After this training period, hippocampal responses to temporal novelty in sounds were enhanced in musical students, and statistical interaction analysis of brain activity changes over time suggests training rather than predisposition effects. Thus, our results provide direct evidence for functional changes of the adult hippocampus in humans related to musical training.

Evaluating an acoustically quiet EPI sequence for use in fMRI studies of speech and auditory processing

Echoplanar MRI is associated with significant acoustic noise, which can interfere with the presentation of auditory stimuli, create a more challenging listening environment, and increase discomfort felt by participants. Here we investigate a scanning sequence that significantly reduces the amplitude of acoustic noise associated with echoplanar imaging (EPI). This is accomplished using a constant phase encoding gradient and a sinusoidal readout echo train to produce a narrow-band acoustic frequency spectrum, which is adapted to the scanner's frequency response function by choosing an optimum gradient switching frequency. To evaluate the effect of these nonstandard parameters we conducted a speech experiment comparing four different EPI sequences: Quiet, Sparse, Standard, and Matched Standard (using the same readout duration as Quiet). For each sequence participants listened to sentences and signal-correlated noise (SCN), which provides an unintelligible amplitude-matched control condition. We used BOLD sensitivity maps to quantify sensitivity loss caused by the longer EPI readout duration used in the Quiet and Matched Standard EPI sequences. We found that the Quiet sequence provided more robust activation for SCN in primary auditory areas and comparable activation in frontal and temporal regions for Sentences>SCN, but less sentence-related activity in inferotemporal cortex. The increased listening effort associated with the louder Standard sequence relative to the Quiet sequence resulted in increased activation in the left temporal and inferior parietal cortices. Together, these results suggest that the Quiet sequence is suitable, and perhaps preferable, for many auditory studies. However, its applicability depends on the specific brain regions of interest.

Hearing illusory sounds in noise: the timing of sensory-perceptual transformations in auditory cortex

Constructive mechanisms in the auditory system may restore a fragmented sound when a gap in this sound is rendered inaudible by noise to yield a continuity illusion. Using combined psychoacoustic and electroencephalography experiments in humans, we found that the sensory-perceptual mechanisms that enable restoration suppress auditory cortical encoding of gaps in interrupted sounds. When physically interrupted tones are perceptually restored, stimulus-evoked synchronization of cortical oscillations at approximately 4 Hz is suppressed as if physically uninterrupted sounds were encoded. The restoration-specific suppression is induced most strongly in primary-like regions in the right auditory cortex during illusorily filled gaps and also shortly before and after these gaps. Our results reveal that spontaneous modulations in slow evoked auditory cortical oscillations that are involved in encoding acoustic boundaries may determine the perceived continuity of sounds in noise. Such fluctuations could facilitate stable hearing of fragmented sounds in natural environments.

Altered lateralisation of emotional prosody processing in schizophrenia

Alterations of cerebral lateralisation in schizophrenia have been reported consistently, and a reduced left-lateralisation has been suggested for language functions. Speech contains non-verbal information, e.g. prosody, and on a behavioural level, the extraction of emotional information from prosody is often impaired in schizophrenia. A previous functional magnetic resonance imaging study suggests increased left-lateralisation in schizophrenia during prosody processing, but did not disentangle effects of speech processing as such and emotional prosody processing. Here, we used meaningless syllables spoken with neutral, angry or fearful speech melody and measured blood oxygen level-dependent (BOLD) responses in 15 in-patients with schizophrenia and 15 healthy control participants matched for age and gender. Lateralisation indices were calculated for responses to emotional versus neutral prosody, and for all types of prosody versus baseline. Compared to control participants, patients with schizophrenia showed an increased right-lateralisation of emotional and non-emotional prosody processing in the temporal and parietal cortex. This right-lateralisation was increased in patients with reduced right-handedness and decreased in patients with stronger negative symptoms, particularly affective blunting, and with longer hospitalisation. Although patients with schizophrenia performed worse in emotion identification, this deficit was not related to lateralisation indices. Enhanced right-lateralisation to prosody resembles previous findings on laterality changes in speech processing and might suggest a common underlying cause in the organization of language functions.

Brain responses to auditory and visual stimulus offset: shared representations of temporal edges

Edges are crucial for the formation of coherent objects from sequential sensory inputs within a single modality. Moreover, temporally coincident boundaries of perceptual objects across different sensory modalities facilitate crossmodal integration. Here, we used functional magnetic resonance imaging in order to examine the neural basis of temporal edge detection across modalities. Onsets of sensory inputs are not only related to the detection of an edge but also to the processing of novel sensory inputs. Thus, we used transitions from input to rest (offsets) as convenient stimuli for studying the neural underpinnings of visual and acoustic edge detection per se. We found, besides modality-specific patterns, shared visual and auditory offset-related activity in the superior temporal sulcus and insula of the right hemisphere. Our data suggest that right hemispheric regions known to be involved in multisensory processing are crucial for detection of edges in the temporal domain across both visual and auditory modalities. This operation is likely to facilitate cross-modal object feature binding based on temporal coincidence.

Illusory Vowels Resulting from Perceptual Continuity: A Functional Magnetic Resonance Imaging Study

We used functional magnetic resonance imaging to study the neural processing of vowels whose perception depends on the continuity illusion. Participants heard sequences of two-formant vowels under a number of listening conditions. In the “vowel conditions,” both formants were always present simultaneously and the stimuli were perceived as speech-like. Contrasted with a range of nonspeech sounds, these vowels elicited activity in the posterior middle temporal gyrus (MTG) and superior temporal sulcus (STS). When the two formants alternated in time, the “speech-likeness” of the sounds was reduced. It could be partially restored by filling the silent gaps in each formant with bands of noise (the “Illusion” condition) because the noise induced an illusion of continuity in each formant region, causing the two formants to be perceived as simultaneous. However, this manipulation was only effective at low formant-to-noise ratios (FNRs). When the FNR was increased, the illusion broke down (the “illusion-break” condition). Activation in vowel-sensitive regions of the MTG was greater in the illusion than in the illusion-break condition, consistent with the perception of Illusion stimuli as vowels. Activity in Heschl's gyri (HG), the approximate location of the primary auditory cortex, showed the opposite pattern, and may depend instead on the number of perceptual onsets in a sound. Our results demonstrate that speech-sensitive regions of the MTG are sensitive not to the physical characteristics of the stimulus but to the perception of the stimulus as speech, and also provide an anatomically distinct, objective physiological correlate of the continuity illusion in human listeners.

Frequency modulation facilitates (modal) auditory restoration of a gap

In this study we further investigated processes of auditory restoration (AR) in recently described stimulus types: the so-called gap-transfer stimulus, the shared-gap stimulus and the pseudo-continuous stimulus. The stimuli typically consist of two crossing sounds of unequal duration. In the shared-gap and pseudo-continuous stimuli, the two crossing sounds share a gap (<45 ms) at their crossing point. In the gap-transfer stimulus, only the long sound contains a gap (100 ms), whereas the short sound is physically continuous. Earlier research has shown that in these stimuli the long sound is subject to AR, in spite of the gap it contains, whereas the gap is perceived in the short sound. Experiment 1 of the present study showed that AR of the stimuli's long sound was facilitated when its slope increased from 0 to 1 oct/s. Experiment 2 showed that the effect of slope on AR of the long sound also occurred when the slope relationship between the long and short sound was fixed. Implications for a tentative sound edge-binding explanation of AR as well as alternative explanations for the effect of slope on AR are discussed.

Auditory temporal edge detection in human auditory cortex

Auditory objects are detected if they differ acoustically from the ongoing background. In simple cases, the appearance or disappearance of an object involves a transition in power, or frequency content, of the ongoing sound. However, it is more realistic that the background and object possess substantial non-stationary statistics, and the task is then to detect a transition in the pattern of ongoing statistics. How does the system detect and process such transitions? We use magnetoencephalography (MEG) to measure early auditory cortical responses to transitions between constant tones, regularly alternating, and randomly alternating tone-pip sequences. Such transitions embody key characteristics of natural auditory temporal edges. Our data demonstrate that the temporal dynamics and response polarity of the neural temporal-edge-detection processes depend in specific ways on the generalized nature of the edge (the context preceding and following the transition) and suggest that distinct neural substrates in core and non-core auditory cortex are recruited depending on the kind of computation (discovery of a violation of regularity, vs. the detection of a new regularity) required to extract the edge from the ongoing fluctuating input entering a listener's ears.

Hearing illusory sounds in noise: sensory-perceptual transformations in primary auditory cortex

A sound that is interrupted by silence is perceived as discontinuous. However, when the silence is replaced by noise, the target sound may be heard as uninterrupted. Understanding the neural basis of this continuity illusion may elucidate the ability to track sounds of interest in noisy auditory scenes, but yet little is known. In the present functional magnetic resonance imaging study in humans we report that activity in primary auditory cortex reflects perceived continuity of illusory tones in noise. Exploiting a parametric manipulation of the illusory stimuli, we show that stimulus-evoked activity does not correlate with the basic acoustic properties of tones or noises, but rather with the abstract dependencies among them. Importantly, changes of neural responses to acoustically identical stimuli parallel changes of listeners' report of perceived continuity of these same stimuli, thus confirming the perceptual nature of these responses. Our findings show that, beyond the sensory representation of an auditory scene, primary auditory areas play a constructive role in the grouping of scene segments into unified auditory percepts.

Rising sound intensity: an intrinsic warning cue activating the amygdala

Human subjects overestimate the change of rising intensity sounds compared with falling intensity sounds. Rising sound intensity has therefore been proposed to be an intrinsic warning cue. In order to test this hypothesis, we presented rising, falling, and constant intensity sounds to healthy humans and gathered psychophysiological and behavioral responses. Brain activity was measured using event-related functional magnetic resonance imaging. We found that rising compared with falling sound intensity facilitates autonomic orienting reflex and phasic alertness to auditory targets. Rising intensity sounds produced neural activity in the amygdala, which was accompanied by activity in intraparietal sulcus, superior temporal sulcus, and temporal plane. Our results indicate that rising sound intensity is an elementary warning cue eliciting adaptive responses by recruiting attentional and physiological resources. Regions involved in cross-modal integration were activated by rising sound intensity, while the right-hemisphere phasic alertness network could not be supported by this study.