Working memory specific activity in auditory cortex: potential correlates of sequential processing and maintenance

Asymmetries and hemispheric interaction in the auditory system of elderly people

Age-related changes of asymmetries in the auditory system and decreasing efficiency of hemispheric interaction have been discussed for some time. This mini-review discusses recent neuroimaging studies on alterations in lateralization of cortical processing and structural changes concerning the division of labor and interaction between hemispheres during auditory processing in elderly people with the focus on people without severe hearing loss. Several changes of asymmetries in anatomy, function and neurotransmitter concentration were observed in auditory cortical areas of older compared to younger adults. It was shown that connections between left and right auditory cortex are reduced during aging. Functionally, aging seems to lead to a reduction in asymmetry of auditory processing. However, the results do not always point into the same direction. Furthermore, correlations between function, anatomy and behavior in the left and right hemisphere appear to differ between younger and older adults. The changes in auditory cortex asymmetries with aging might be due to compensation of declining processing capacities, but at the same time these mechanisms could impair the balanced division of labor between the two hemispheres that is required for the processing of complex auditory stimuli such as speech. Neuroimaging studies are essential to follow the slow changes with aging as in the beginning no behavioral effects might be visible due to compensation. Future studies should control well for peripheral hearing loss and cognitive decline. Furthermore, for the interpretability of results it is necessary to use specific tasks with well-controlled task difficulty.

Effect of age on lateralized auditory processing

The lateralization of processing in the auditory cortex for different acoustic parameters differs depending on stimuli and tasks. Thus, processing complex auditory stimuli requires an efficient hemispheric interaction. Anatomical connectivity decreases with aging and consequently affects the functional interaction between the left and right auditory cortex and lateralization of auditory processing. Here we studied with magnetic resonance imaging the effect of aging on the lateralization of processing and hemispheric interaction during two tasks utilizing the contralateral noise procedure. Categorization of tones according to their direction of frequency modulations (FM) is known to be processed mainly in the right auditory cortex. Sequential comparison of the same tones according to their FM direction strongly involves additionally the left auditory cortex and therefore a stronger hemispheric interaction than the categorization task. The results showed that older adults more strongly recruit the auditory cortex especially during the comparison task that requires stronger hemispheric interaction. This was the case although the task difficulty was adapted to achieve similar performance as the younger adults. Additionally, functional connectivity from auditory cortex to other brain areas was stronger in older than younger adults especially during the comparison task. Diffusion tensor imaging data showed a reduction in fractional anisotropy and an increase in mean diffusivity in the corpus callosum of older adults compared to younger adults. These changes indicate a reduction of anatomical interhemispheric connections in older adults that makes larger processing capacity necessary when tasks require functional hemispheric interaction.

Auditory cortex modelled as a dynamical network of oscillators: understanding event-related fields and their adaptation

Adaptation, the reduction of neuronal responses by repetitive stimulation, is a ubiquitous feature of auditory cortex (AC). It is not clear what causes adaptation, but short-term synaptic depression (STSD) is a potential candidate for the underlying mechanism. In such a case, adaptation can be directly linked with the way AC produces context-sensitive responses such as mismatch negativity and stimulus-specific adaptation observed on the single-unit level. We examined this hypothesis via a computational model based on AC anatomy, which includes serially connected core, belt, and parabelt areas. The model replicates the event-related field (ERF) of the magnetoencephalogram as well as ERF adaptation. The model dynamics are described by excitatory and inhibitory state variables of cell populations, with the excitatory connections modulated by STSD. We analysed the system dynamics by linearising the firing rates and solving the STSD equation using time-scale separation. This allows for characterisation of AC dynamics as a superposition of damped harmonic oscillators, so-called normal modes. We show that repetition suppression of the N1m is due to a mixture of causes, with stimulus repetition modifying both the amplitudes and the frequencies of the normal modes. In this view, adaptation results from a complete reorganisation of AC dynamics rather than a reduction of activity in discrete sources. Further, both the network structure and the balance between excitation and inhibition contribute significantly to the rate with which AC recovers from adaptation. This lifetime of adaptation is longer in the belt and parabelt than in the core area, despite the time constants of STSD being spatially homogeneous. Finally, we critically evaluate the use of a single exponential function to describe recovery from adaptation.

Suppression, Maintenance, and Surprise: Neuronal Correlates of Predictive Processing Specialization for Musical Rhythm

Auditory repetition suppression and omission activation are opposite neural phenomena and manifestations of principles of predictive processing. Repetition suppression describes the temporal decrease in neural activity when a stimulus is constant or repeated in an expected temporal fashion; omission activity is the transient increase in neural activity when a stimulus is temporarily and unexpectedly absent. The temporal, repetitive nature of musical rhythms is ideal for investigating these phenomena. During an fMRI session, 10 healthy participants underwent scanning while listening to musical rhythms with two levels of metric complexity, and with beat omissions with different positional complexity. Participants first listened to 16-s-long presentations of continuous rhythms, before listening to a longer continuous presentation with beat omissions quasi-randomly introduced. We found deactivation in bilateral superior temporal gyri during the repeated presentation of the normal, unaltered rhythmic stimulus, with more suppression of activity in the left hemisphere. Omission activation of bilateral middle temporal gyri was right lateralized. Persistent activity was found in areas including the supplementary motor area, caudate nucleus, anterior insula, frontal areas, and middle and posterior cingulate cortex, not overlapping with either listening, suppression, or omission activation. This suggests that the areas are perhaps specialized for working memory maintenance. We found no effect of metric complexity for either the normal presentation or omissions, but we found evidence for a small effect of omission position—at an uncorrected threshold—where omissions in the more metrical salient position, i.e., the first position in the bar, showed higher activation in anterior cingulate/medial superior frontal gyrus, compared to omissions in the less salient position, in line with the role of the anterior cingulate cortex for saliency detection. The results are consistent with findings in our previous studies on Parkinson’s disease, but are put into a bigger theoretical frameset.

Cortical responses to auditory novelty across task conditions: An intracranial electrophysiology study

Elucidating changes in sensory processing across attentional and arousal states is a major focus in neuroscience. The local/global deviant (LGD) stimulus paradigm engages auditory predictive coding over short (local deviance, LD) and long (global deviance, GD) time scales, and has been used to assay disruption of auditory predictive coding upon loss of consciousness. Our previous work (Nourski et al., 2018, J Neurosci 38:8441-52) examined effects of general anesthesia on short- and long-term novelty detection. GD effects were suppressed at subhypnotic doses of propofol, suggesting that they may be more related to task engagement than consciousness per se. The present study addressed this hypothesis by comparing cortical responses to auditory novelty during passive versus active listening conditions in awake listeners. Subjects were seven adult neurosurgical patients undergoing chronic invasive monitoring for medically intractable epilepsy. LGD stimuli were sequences of four identical vowels followed by a fifth identical or different vowel. In the passive condition, the stimuli were presented to subjects as they watched a silent TV program and were instructed to attend to its content. In the active condition, stimuli were presented in the absence of a TV program, and subjects were instructed to press a button in response to GD target stimuli. Intracranial recordings were made from multiple brain regions, including core and non-core auditory, auditory-related, prefrontal and sensorimotor cortex. Metrics of task performance included hit rate, sensitivity index, and reaction times. Cortical activity was measured as averaged auditory evoked potentials (AEPs) and event-related band power in high gamma (70-150 Hz) and alpha (8-14 Hz) frequency bands. The vowel stimuli and LD elicited robust AEPs in all studied brain areas in both passive and active conditions. High gamma responses to stimulus onset and LD were localized predominantly to the auditory cortex in the superior temporal plane and had a comparable prevalence and spatial extent between the two conditions. In contrast, GD effects (AEPs, high gamma and alpha suppression) were greatly enhanced during the active condition in all studied brain areas. The prevalence of high gamma GD effects was positively correlated with individual subjects' task performance. The data demonstrate distinct task engagement-related effects on responses to auditory novelty across the auditory cortical processing hierarchy. The results motivate a closer examination of effective connectivity underlying attentional modulation of cortical sensory responses, and serve as a foundation for examining changes in sensory processing associated with general anesthesia, sleep and disorders of consciousness.

The impact of task difficulty on the lateralization of processing in the human auditory cortex

Perception of complex auditory stimuli like speech requires the simultaneous processing of different fundamental acoustic parameters. The contribution of left and right auditory cortex (AC) in the processing of these parameters differs. In addition, activity within the AC can vary positively or negatively with task performance depending on the type of task. This might affect the allocation of processing to the left and right AC. Here we studied with functional magnetic resonance imaging the impact of task difficulty on the degree of involvement of the left and right AC in two tasks that have previously been shown to differ in hemispheric involvement: categorization and sequential comparison of the direction of frequency modulations (FM). Task difficulty was manipulated by changing the speed of modulation and by that the frequency range covered by the FM. To study the impact of task‐difficulty despite covarying the stimulus parameters, we utilized the contralateral noise procedure that allows comparing AC activation unconfounded by bottom‐up driven activity. The easiest conditions confirmed the known right AC involvement during the categorization task and the left AC involvement during the comparison task. The involvement of the right AC increased with increasing task difficulty for both tasks presumably due to the common task component of categorizing FM direction. The involvement of left AC varied with task difficulty depending on the task. Thus, task difficulty has a strong impact on lateralized processing in AC. This connection must be taken into account when interpreting future results on lateralized processing in the AC.

Effect of sequential comparison on active processing of sound duration

Previous studies on active duration processing on sounds showed opposing results regarding the predominant involvement of the left or right hemisphere. Duration of an acoustic event is normally judged relative to other sounds. This requires sequential comparison as auditory events unfold over time. We hypothesized that increasing the demand on sequential comparison in a task increases the involvement of the left auditory cortex. With the current fMRI study, we investigated the effect of sequential comparison in active duration discrimination by comparing a categorical with a comparative task. During the categorical task, the participant had to categorize the tones according to their duration (short vs long). During the comparative task, they had to decide for each tone whether its length matched the tone presented before. We used the contralateral noise procedure to reveal the degree of participation of the left and right auditory cortex during these tasks. We found that both tasks more strongly involve the left than the right auditory cortex. Furthermore, the left auditory cortex was more strongly involved during comparison than during categorization. Together with previous studies, this suggests that additional demand for sequential comparison during processing of different basic acoustic parameters leads to an increased recruitment of the left auditory cortex. In addition, the comparison task more strongly involved several brain areas outside the auditory cortex, which may also be related to the demand for additional cognitive resources as compared to the more efficient categorization of sounds. Hum Brain Mapp 38:4459-4469, 2017. © 2017 Wiley Periodicals, Inc.

Persistent neural activity in auditory cortex is related to auditory working memory in humans and nonhuman primates

Working memory is the cognitive capacity of short-term storage of information for goal-directed behaviors. Where and how this capacity is implemented in the brain are unresolved questions. We show that auditory cortex stores information by persistent changes of neural activity. We separated activity related to working memory from activity related to other mental processes by having humans and monkeys perform different tasks with varying working memory demands on the same sound sequences. Working memory was reflected in the spiking activity of individual neurons in auditory cortex and in the activity of neuronal populations, that is, in local field potentials and magnetic fields. Our results provide direct support for the idea that temporary storage of information recruits the same brain areas that also process the information. Because similar activity was observed in the two species, the cellular bases of some auditory working memory processes in humans can be studied in monkeys.

Neural correlates of auditory scale illusion

The auditory illusory perception "scale illusion" occurs when ascending and descending musical scale tones are delivered in a dichotic manner, such that the higher or lower tone at each instant is presented alternately to the right and left ears. Resulting tone sequences have a zigzag pitch in one ear and the reversed (zagzig) pitch in the other ear. Most listeners hear illusory smooth pitch sequences of up-down and down-up streams in the two ears separated in higher and lower halves of the scale. Although many behavioral studies have been conducted, how and where in the brain the illusory percept is formed have not been elucidated. In this study, we conducted functional magnetic resonance imaging using sequential tones that induced scale illusion (ILL) and those that mimicked the percept of scale illusion (PCP), and we compared the activation responses evoked by those stimuli by region-of-interest analysis. We examined the effects of adaptation, i.e., the attenuation of response that occurs when close-frequency sounds are repeated, which might interfere with the changes in activation by the illusion process. Results of the activation difference of the two stimuli, measured at varied tempi of tone presentation, in the superior temporal auditory cortex were not explained by adaptation. Instead, excess activation of the ILL stimulus from the PCP stimulus at moderate tempi (83 and 126 bpm) was significant in the posterior auditory cortex with rightward superiority, while significant prefrontal activation was dominant at the highest tempo (245 bpm). We suggest that the area of the planum temporale posterior to the primary auditory cortex is mainly involved in the illusion formation, and that the illusion-related process is strongly dependent on the rate of tone presentation.

Fast learning of simple perceptual discriminations reduces brain activation in working memory and in high-level auditory regions

Introducing simple stimulus regularities facilitates learning of both simple and complex tasks. This facilitation may reflect an implicit change in the strategies used to solve the task when successful predictions regarding incoming stimuli can be formed. We studied the modifications in brain activity associated with fast perceptual learning based on regularity detection. We administered a two-tone frequency discrimination task and measured brain activation (fMRI) under two conditions: with and without a repeated reference tone. Although participants could not explicitly tell the difference between these two conditions, the introduced regularity affected both performance and the pattern of brain activation. The "No-Reference" condition induced a larger activation in frontoparietal areas known to be part of the working memory network. However, only the condition with a reference showed fast learning, which was accompanied by a reduction of activity in two regions: the left intraparietal area, involved in stimulus retention, and the posterior superior-temporal area, involved in representing auditory regularities. We propose that this joint reduction reflects a reduction in the need for online storage of the compared tones. We further suggest that this change reflects an implicit strategic shift "backwards" from reliance mainly on working memory networks in the "No-Reference" condition to increased reliance on detected regularities stored in high-level auditory networks.

Unilateral auditory cortex lesions impair or improve discrimination learning of amplitude modulated sounds, depending on lesion side

A fundamental principle of brain organization is bilateral symmetry of structures and functions. For spatial sensory and motor information processing, this organization is generally plausible subserving orientation and coordination of a bilaterally symmetric body. However, breaking of the symmetry principle is often seen for functions that depend on convergent information processing and lateralized output control, e.g. left hemispheric dominance for the linguistic speech system. Conversely, a subtle splitting of functions into hemispheres may occur if peripheral information from symmetric sense organs is partly redundant, e.g. auditory pattern recognition, and therefore allows central conceptualizations of complex stimuli from different feature viewpoints, as demonstrated e.g. for hemispheric analysis of frequency modulations in auditory cortex (AC) of mammals including humans. Here we demonstrate that discrimination learning of rapidly but not of slowly amplitude modulated tones is non-uniformly distributed across both hemispheres: While unilateral ablation of left AC in gerbils leads to impairment of normal discrimination learning of rapid amplitude modulations, right side ablations lead to improvement over normal learning. These results point to a rivalry interaction between both ACs in the intact brain where the right side competes with and weakens learning capability maximally attainable by the dominant left side alone.

A neural mechanism for recognizing speech spoken by different speakers

Understanding speech from different speakers is a sophisticated process, particularly because the same acoustic parameters convey important information about both the speech message and the person speaking. How the human brain accomplishes speech recognition under such conditions is unknown. One view is that speaker information is discarded at early processing stages and not used for understanding the speech message. An alternative view is that speaker information is exploited to improve speech recognition. Consistent with the latter view, previous research identified functional interactions between the left- and the right-hemispheric superior temporal sulcus/gyrus, which process speech- and speaker-specific vocal tract parameters, respectively. Vocal tract parameters are one of the two major acoustic features that determine both speaker identity and speech message (phonemes). Here, using functional magnetic resonance imaging (fMRI), we show that a similar interaction exists for glottal fold parameters between the left and right Heschl's gyri. Glottal fold parameters are the other main acoustic feature that determines speaker identity and speech message (linguistic prosody). The findings suggest that interactions between left- and right-hemispheric areas are specific to the processing of different acoustic features of speech and speaker, and that they represent a general neural mechanism when understanding speech from different speakers.

Neural correlates of auditory recognition memory in the primate dorsal temporal pole

Temporal pole (TP) cortex is associated with higher-order sensory perception and/or recognition memory, as human patients with damage in this region show impaired performance during some tasks requiring recognition memory (Olson et al. 2007). The underlying mechanisms of TP processing are largely based on examination of the visual nervous system in humans and monkeys, while little is known about neuronal activity patterns in the auditory portion of this region, dorsal TP (dTP; Poremba et al. 2003). The present study examines single-unit activity of dTP in rhesus monkeys performing a delayed matching-to-sample task utilizing auditory stimuli, wherein two sounds are determined to be the same or different. Neurons of dTP encode several task-relevant events during the delayed matching-to-sample task, and encoding of auditory cues in this region is associated with accurate recognition performance. Population activity in dTP shows a match suppression mechanism to identical, repeated sound stimuli similar to that observed in the visual object identification pathway located ventral to dTP (Desimone 1996; Nakamura and Kubota 1996). However, in contrast to sustained visual delay-related activity in nearby analogous regions, auditory delay-related activity in dTP is transient and limited. Neurons in dTP respond selectively to different sound stimuli and often change their sound response preferences between experimental contexts. Current findings suggest a significant role for dTP in auditory recognition memory similar in many respects to the visual nervous system, while delay memory firing patterns are not prominent, which may relate to monkeys' shorter forgetting thresholds for auditory vs. visual objects.

Source analysis of event-related potentials during pitch discrimination and pitch memory tasks

Our previous studies using fMRI have demonstrated that activations in human auditory cortex (AC) are strongly dependent on the characteristics of the task. The present study tested whether source estimation of scalp-recorded event-related potentials (ERPs) can be used to investigate task-dependent AC activations. Subjects were presented with frequency-varying two-part tones during pitch discrimination, pitch n-back memory, and visual tasks identical to our previous fMRI study (Rinne et al., J Neurosci 29:13338-13343, 2009). ERPs and their minimum-norm source estimates in AC were strongly modulated by task at 200-700 ms from tone onset. As in the fMRI study, the pitch discrimination and pitch memory tasks were associated with distinct AC activation patterns. In the pitch discrimination task, increased activity in the anterior AC was detected relatively late at 300-700 ms from tone onset. Therefore, this activity was probably not associated with enhanced pitch processing but rather with the actual discrimination process (comparison between the two parts of tone). Increased activity in more posterior areas associated with the pitch memory task, in turn, occurred at 200-700 ms suggesting that this activity was related to operations on pitch categories after pitch analysis was completed. Finally, decreased activity associated with the pitch memory task occurred at 150-300 ms consistent with the notion that, in the demanding pitch memory task, spectrotemporal analysis is actively halted as soon as category information has been obtained. These results demonstrate that ERP source analysis can be used to complement fMRI to investigate task-dependent activations of human AC.

Stimulus-dependent activations and attention-related modulations in the auditory cortex: a meta-analysis of fMRI studies

We meta-analyzed 115 functional magnetic resonance imaging (fMRI) studies reporting auditory-cortex (AC) coordinates for activations related to active and passive processing of pitch and spatial location of non-speech sounds, as well as to the active and passive speech and voice processing. We aimed at revealing any systematic differences between AC surface locations of these activations by statistically analyzing the activation loci using the open-source Matlab toolbox VAMCA (Visualization and Meta-analysis on Cortical Anatomy). AC activations associated with pitch processing (e.g., active or passive listening to tones with a varying vs. fixed pitch) had median loci in the middle superior temporal gyrus (STG), lateral to Heschl's gyrus. However, median loci of activations due to the processing of infrequent pitch changes in a tone stream were centered in the STG or planum temporale (PT), significantly posterior to the median loci for other types of pitch processing. Median loci of attention-related modulations due to focused attention to pitch (e.g., attending selectively to low or high tones delivered in concurrent sequences) were, in turn, centered in the STG or superior temporal sulcus (STS), posterior to median loci for passive pitch processing. Activations due to spatial processing were centered in the posterior STG or PT, significantly posterior to pitch processing loci (processing of infrequent pitch changes excluded). In the right-hemisphere AC, the median locus of spatial attention-related modulations was in the STS, significantly inferior to the median locus for passive spatial processing. Activations associated with speech processing and those associated with voice processing had indistinguishable median loci at the border of mid-STG and mid-STS. Median loci of attention-related modulations due to attention to speech were in the same mid-STG/STS region. Thus, while attention to the pitch or location of non-speech sounds seems to recruit AC areas less involved in passive pitch or location processing, focused attention to speech predominantly enhances activations in regions that already respond to human vocalizations during passive listening. This suggests that distinct attention mechanisms might be engaged by attention to speech and attention to more elemental auditory features such as tone pitch or location. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

Representation of frequency-modulated sounds in the human brain

Frequency-modulation is a ubiquitous sound feature present in communicative sounds of various animal species and humans. Functional imaging of the human auditory system has seen remarkable advances in the last two decades and studies pertaining to frequency-modulation have centered around two major questions: a) are there dedicated feature-detectors encoding frequency-modulation in the brain and b) is there concurrent representation with amplitude-modulation, another temporal sound feature? In this review, we first describe how these two questions are motivated by psychophysical studies and neurophysiology in animal models. We then review how human non-invasive neuroimaging studies have furthered our understanding of the representation of frequency-modulated sounds in the brain. Finally, we conclude with some suggestions on how human neuroimaging could be used in future studies to address currently still open questions on this fundamental sound feature. This article is part of a Special Issue entitled Human Auditory Neuroimaging.

Left auditory cortex is involved in pairwise comparisons of the direction of frequency modulated tones

Evaluating series of complex sounds like those in speech and music requires sequential comparisons to extract task-relevant relations between subsequent sounds. With the present functional magnetic resonance imaging (fMRI) study, we investigated whether sequential comparison of a specific acoustic feature within pairs of tones leads to a change in lateralized processing in the auditory cortex (AC) of humans. For this we used the active categorization of the direction (up vs. down) of slow frequency modulated (FM) tones. Several studies suggest that this task is mainly processed in the right AC. These studies, however, tested only the categorization of the FM direction of each individual tone. In the present study we ask the question whether the right lateralized processing changes when, in addition, the FM direction is compared within pairs of successive tones. For this we use an experimental approach involving contralateral noise presentation in order to explore the contributions made by the left and right AC in the completion of the auditory task. This method has already been applied to confirm the right-lateralized processing of the FM direction of individual tones. In the present study, the subjects were required to perform, in addition, a sequential comparison of the FM direction in pairs of tones. The results suggest a division of labor between the two hemispheres such that the FM direction of each individual tone is mainly processed in the right AC whereas the sequential comparison of this feature between tones in a pair is probably performed in the left AC.

A corticostriatal neural system enhances auditory perception through temporal context processing

The temporal context of an acoustic signal can greatly influence its perception. The present study investigated the neural correlates underlying perceptual facilitation by regular temporal contexts in humans. Participants listened to temporally regular (periodic) or temporally irregular (nonperiodic) sequences of tones while performing an intensity discrimination task. Participants performed significantly better on intensity discrimination during periodic than nonperiodic tone sequences. There was greater activation in the putamen for periodic than nonperiodic sequences. Conversely, there was greater activation in bilateral primary and secondary auditory cortices (planum polare and planum temporale) for nonperiodic than periodic sequences. Across individuals, greater putamen activation correlated with lesser auditory cortical activation in both right and left hemispheres. These findings suggest that temporal regularity is detected in the putamen, and that such detection facilitates temporal-lobe cortical processing associated with superior auditory perception. Thus, this study reveals a corticostriatal system associated with contextual facilitation for auditory perception through temporal regularity processing.

Learning-dependent plasticity in human auditory cortex during appetitive operant conditioning

Animal experiments provide evidence that learning to associate an auditory stimulus with a reward causes representational changes in auditory cortex. However, most studies did not investigate the temporal formation of learning-dependent plasticity during the task but rather compared auditory cortex receptive fields before and after conditioning. We here present a functional magnetic resonance imaging study on learning-related plasticity in the human auditory cortex during operant appetitive conditioning. Participants had to learn to associate a specific category of frequency-modulated tones with a reward. Only participants who learned this association developed learning-dependent plasticity in left auditory cortex over the course of the experiment. No differential responses to reward predicting and nonreward predicting tones were found in auditory cortex in nonlearners. In addition, learners showed similar learning-induced differential responses to reward-predicting and nonreward-predicting tones in the ventral tegmental area and the nucleus accumbens, two core regions of the dopaminergic neurotransmitter system. This may indicate a dopaminergic influence on the formation of learning-dependent plasticity in auditory cortex, as it has been suggested by previous animal studies.

Interaction between bottom-up and top-down effects during the processing of pitch intervals in sequences of spoken and sung syllables

The processing of pitch intervals may be differentially influenced when musical or speech stimuli carry the pitch information. Most insights into the neural basis of pitch interval processing come from studies on music perception. However, music, in contrast to speech, contains a stable set of pitch intervals. To converge the investigation of pitch interval processing in music and speech, we used sequences of the same spoken or sung syllables. The pitch of these syllables varied either by semitone steps like in music or by smaller intervals. Participants had to differentiate the sequences according to their different sizes of pitch intervals or to the direction of the last frequency step in the sequence. The results depended strongly on the specific task demands. Whereas the interval-size task itself recruited more regions in right lateralized fronto-parietal brain network, stronger activity on semitone than on non-semitone sequences was found in the left hemisphere (mainly in frontal cortex) during this task. These effects were also influenced by the speech mode (spoken or sung syllables). Our findings suggest that the processing of pitch intervals in sequences of syllables depends on an interaction between bottom-up (speech mode, pitch interval) and top-down effects (task).

Task-dependent activations of human auditory cortex during spatial discrimination and spatial memory tasks

In the present study, we applied high-resolution functional magnetic resonance imaging (fMRI) of the human auditory cortex (AC) and adjacent areas to compare activations during spatial discrimination and spatial n-back memory tasks that were varied parametrically in difficulty. We found that activations in the anterior superior temporal gyrus (STG) were stronger during spatial discrimination than during spatial memory, while spatial memory was associated with stronger activations in the inferior parietal lobule (IPL). We also found that wide AC areas were strongly deactivated during the spatial memory tasks. The present AC activation patterns associated with spatial discrimination and spatial memory tasks were highly similar to those obtained in our previous study comparing AC activations during pitch discrimination and pitch memory (Rinne et al., 2009). Together our previous and present results indicate that discrimination and memory tasks activate anterior and posterior AC areas differently and that this anterior-posterior division is present both when these tasks are performed on spatially invariant (pitch discrimination vs. memory) or spatially varying (spatial discrimination vs. memory) sounds. These results also further strengthen the view that activations of human AC cannot be explained only by stimulus-level parameters (e.g., spatial vs. nonspatial stimuli) but that the activations observed with fMRI are strongly dependent on the characteristics of the behavioral task. Thus, our results suggest that in order to understand the functional structure of AC a more systematic investigation of task-related factors affecting AC activations is needed.

Task-specific modulation of human auditory evoked response in a delayed-match-to-sample task

In this study, we focus our investigation on task-specific cognitive modulation of early cortical auditory processing in human cerebral cortex. During the experiments, we acquired whole-head magnetoencephalography data while participants were performing an auditory delayed-match-to-sample (DMS) task and associated control tasks. Using a spatial filtering beamformer technique to simultaneously estimate multiple source activities inside the human brain, we observed a significant DMS-specific suppression of the auditory evoked response to the second stimulus in a sound pair, with the center of the effect being located in the vicinity of the left auditory cortex. For the right auditory cortex, a non-invariant suppression effect was observed in both DMS and control tasks. Furthermore, analysis of coherence revealed a beta band (12∼20 Hz) DMS-specific enhanced functional interaction between the sources in left auditory cortex and those in left inferior frontal gyrus, which has been shown to be involved in short-term memory processing during the delay period of DMS task. Our findings support the view that early evoked cortical responses to incoming acoustic stimuli can be modulated by task-specific cognitive functions by means of frontal–temporal functional interactions.

Behavioral semantics of learning and crossmodal processing in auditory cortex: the semantic processor concept

Two phenomena of auditory cortex activity have recently attracted attention, namely that the primary field can show different types of learning-related changes of sound representation and that during learning even this early auditory cortex is under strong multimodal influence. Based on neuronal recordings in animal auditory cortex during instrumental tasks, in this review we put forward the hypothesis that these two phenomena serve to derive the task-specific meaning of sounds by associative learning. To understand the implications of this tenet, it is helpful to realize how a behavioral meaning is usually derived for novel environmental sounds. For this purpose, associations with other sensory, e.g. visual, information are mandatory to develop a connection between a sound and its behaviorally relevant cause and/or the context of sound occurrence. This makes it plausible that in instrumental tasks various non-auditory sensory and procedural contingencies of sound generation become co-represented by neuronal firing in auditory cortex. Information related to reward or to avoidance of discomfort during task learning, that is essentially non-auditory, is also co-represented. The reinforcement influence points to the dopaminergic internal reward system, the local role of which for memory consolidation in auditory cortex is well-established. Thus, during a trial of task performance, the neuronal responses to the sounds are embedded in a sequence of representations of such non-auditory information. The embedded auditory responses show task-related modulations of auditory responses falling into types that correspond to three basic logical classifications that may be performed with a perceptual item, i.e. from simple detection to discrimination, and categorization. This hierarchy of classifications determine the semantic "same-different" relationships among sounds. Different cognitive classifications appear to be a consequence of learning task and lead to a recruitment of different excitatory and inhibitory mechanisms and to distinct spatiotemporal metrics of map activation to represent a sound. The described non-auditory firing and modulations of auditory responses suggest that auditory cortex, by collecting all necessary information, functions as a "semantic processor" deducing the task-specific meaning of sounds by learning.

Active stream segregation specifically involves the left human auditory cortex

An important aspect of auditory scene analysis is the sequential grouping of similar sounds into one "auditory stream" while keeping competing streams separate. In the present low-noise fMRI study we presented sequences of alternating high-pitch (A) and low-pitch (B) complex harmonic tones using acoustic parameters that allow the perception of either two separate streams or one alternating stream. However, the subjects were instructed to actively and continuously segregate the A from the B stream. This was controlled by the additional instruction to listen for rare level deviants only in the low-pitch stream. Compared to the control condition in which only one non-separable stream was presented the active segregation of the A from the B stream led to a selective increase of activation in the left auditory cortex (AC). Together with a similar finding from a previous study using a different acoustic cue for streaming, namely timbre, this suggests that the left auditory cortex plays a dominant role in active sequential stream segregation. However, we found cue differences within the left AC: Whereas in the posterior areas, including the planum temporale, activation increased for both acoustic cues, the anterior areas, including Heschl's gyrus, are only involved in stream segregation based on pitch.

Task-dependent activations of human auditory cortex during pitch discrimination and pitch memory tasks

The functional organization of auditory cortex (AC) is still poorly understood. Previous studies suggest segregation of auditory processing streams for spatial and nonspatial information located in the posterior and anterior AC, respectively (Rauschecker and Tian, 2000; Arnott et al., 2004; Lomber and Malhotra, 2008). Furthermore, previous studies have shown that active listening tasks strongly modulate AC activations (Petkov et al., 2004; Fritz et al., 2005; Polley et al., 2006). However, the task dependence of AC activations has not been systematically investigated. In the present study, we applied high-resolution functional magnetic resonance imaging of the AC and adjacent areas to compare activations during pitch discrimination and n-back pitch memory tasks that were varied parametrically in difficulty. We found that anterior AC activations were increased during discrimination but not during memory tasks, while activations in the inferior parietal lobule posterior to the AC were enhanced during memory tasks but not during discrimination. We also found that wide areas of the anterior AC and anterior insula were strongly deactivated during the pitch memory tasks. While these results are consistent with the proposition that the anterior and posterior AC belong to functionally separate auditory processing streams, our results show that this division is present also between tasks using spatially invariant sounds. Together, our results indicate that activations of human AC are strongly dependent on the characteristics of the behavioral task.

Neural codes for perceptual discrimination of acoustic flutter in the primate auditory cortex

We recorded from single neurons of the primary auditory cortex (A1), while trained monkeys reported a decision based on the comparison of 2 acoustic flutter stimuli. Crucially, to form the decision, monkeys had to compare the second stimulus rate to the memory trace of the first stimulus rate. We found that the responses of A1 neurons encode stimulus rates both through their periodicity and through their firing rates during the stimulation periods, but not during the working memory and decision components of this task. Neurometric thresholds based on firing rate were very similar to the monkey's discrimination thresholds, whereas neurometric thresholds based on periodicity were lower than the experimental thresholds. Thus, an observer could solve this task with a precision similar to that of the monkey based only on the firing rates evoked by the stimuli. These results suggest that the A1 is exclusively associated with the sensory and not with the cognitive components of this task.

Perceptual load interacts with stimulus processing across sensory modalities

According to perceptual load theory, processing of task-irrelevant stimuli is limited by the perceptual load of a parallel attended task if both the task and the irrelevant stimuli are presented to the same sensory modality. However, it remains a matter of debate whether the same principles apply to cross-sensory perceptual load and, more generally, what form cross-sensory attentional modulation in early perceptual areas takes in humans. Here we addressed these questions using functional magnetic resonance imaging. Participants undertook an auditory one-back working memory task of low or high perceptual load, while concurrently viewing task-irrelevant images at one of three object visibility levels. The processing of the visual and auditory stimuli was measured in the lateral occipital cortex (LOC) and auditory cortex (AC), respectively. Cross-sensory interference with sensory processing was observed in both the LOC and AC, in accordance with previous results of unisensory perceptual load studies. The present neuroimaging results therefore warrant the extension of perceptual load theory from a unisensory to a cross-sensory context: a validation of this cross-sensory interference effect through behavioural measures would consolidate the findings.

A comparison of five fMRI protocols for mapping speech comprehension systems

AIMS

Many fMRI protocols for localizing speech comprehension have been described, but there has been little quantitative comparison of these methods. We compared five such protocols in terms of areas activated, extent of activation, and lateralization.

METHODS

fMRI BOLD signals were measured in 26 healthy adults during passive listening and active tasks using words and tones. Contrasts were designed to identify speech perception and semantic processing systems. Activation extent and lateralization were quantified by counting activated voxels in each hemisphere for each participant.

RESULTS

Passive listening to words produced bilateral superior temporal activation. After controlling for prelinguistic auditory processing, only a small area in the left superior temporal sulcus responded selectively to speech. Active tasks engaged an extensive, bilateral attention, and executive processing network. Optimal results (consistent activation and strongly lateralized pattern) were obtained by contrasting an active semantic decision task with a tone decision task. There was striking similarity between the network of brain regions activated by the semantic task and the network of brain regions that showed task-induced deactivation, suggesting that semantic processing occurs during the resting state.

CONCLUSIONS

fMRI protocols for mapping speech comprehension systems differ dramatically in pattern, extent, and lateralization of activation. Brain regions involved in semantic processing were identified only when an active, nonlinguistic task was used as a baseline, supporting the notion that semantic processing occurs whenever attentional resources are not controlled. Identification of these lexical-semantic regions is particularly important for predicting language outcome in patients undergoing temporal lobe surgery.

Global versus local processing of frequency-modulated tones in gerbils: an animal model of lateralized auditory cortex functions

Hemispheric asymmetries of speech and music processing might arise from more basic specializations of left and right auditory cortex (AC). It is not clear, however, whether such asymmetries are unique to humans, i.e., consequences of speech and music, or whether comparable lateralized AC functions exist in nonhuman animals, as evolutionary precursors. Here, we investigated the cortical lateralization of perception of linearly frequency-modulated (FM) tones in gerbils, a rodent species with human-like low-frequency hearing. Using a footshock-reinforced shuttle-box avoidance go/no-go procedure in a total of 178 gerbils, we found that (i) the discrimination of direction of continuous FM (rising versus falling sweeps, 250-ms duration) was impaired by right but not left AC lesions; (ii) the discrimination of direction of segmented FM (50-ms segments, 50-ms silent gaps, total duration 250 ms) was impaired by bilateral but not unilateral AC lesions; (iii) the discrimination of gap durations (10-30 ms) in segmented FM was impaired by left but not right AC lesions. AC lesions before and after training resulted in similar effects. Together, these experiments suggest that right and left AC, even in rodents, use different strategies in analyzing FM stimuli. Thus, the right AC, by using global cues, determines the direction of continuous and segmented FM but cannot discriminate gap durations. The left AC, by using local cues, discriminates gap durations and determines FM direction only when additional segmental information is available.

Effects of the task of categorizing FM direction on auditory evoked magnetic fields in the human auditory cortex

We examined effects of the task of categorizing linear frequency-modulated (FM) sweeps into rising and falling on auditory evoked magnetic fields (AEFs) from the human auditory cortex, recorded by means of whole-head magnetoencephalography. AEFs in this task condition were compared with those in a passive condition where subjects had been asked to just passively listen to the same stimulus material. We found that the M100-peak latency was significantly shorter for the task condition than for the passive condition in the left but not in the right hemisphere. Furthermore, the M100-peak latency was significantly shorter in the right than in the left hemisphere for the passive and the task conditions. In contrast, the M100-peak amplitude did not differ significantly between conditions, nor between hemispheres. We also analyzed the activation strength derived from the integral of the absolute magnetic field over constant time windows between stimulus onset and 260 ms. We isolated an early, narrow time range between about 60 ms and 80 ms that showed larger values in the task condition, most prominently in the right hemisphere. These results add to other imaging and lesion studies which suggest a specific role of the right auditory cortex in identifying FM sweep direction and thus in categorizing FM sweeps into rising and falling.

Learning strategy determines auditory cortical plasticity

Learning modifies the primary auditory cortex (A1) to emphasize the processing and representation of behaviorally relevant sounds. However, the factors that determine cortical plasticity are poorly understood. While the type and amount of learning are assumed to be important, the actual strategies used to solve learning problems might be critical. To investigate this possibility, we trained two groups of adult male Sprague-Dawley rats to bar-press (BP) for water contingent on the presence of a 5.0 kHz tone using two different strategies: BP during tone presence or BP from tone-onset until receiving an error signal after tone cessation. Both groups achieved the same high levels of correct performance and both groups revealed equivalent learning of absolute frequency during training. Post-training terminal "mapping" of A1 showed no change in representational area of the tone signal frequency but revealed other substantial cue-specific plasticity that developed only in the tone-onset-to-error strategy group. Threshold was decreased approximately 10 dB and tuning bandwidth was narrowed by approximately 0.7 octaves. As sound onsets have greater perceptual weighting and cortical discharge efficacy than continual sound presence, the induction of specific learning-induced cortical plasticity may depend on the use of learning strategies that best exploit cortical proclivities. The present results also suggest a general principle for the induction and storage of plasticity in learning, viz., that the representation of specific acquired information may be selected by neurons according to a match between behaviorally selected stimulus features and circuit/network response properties.

The cognitive auditory cortex: task-specificity of stimulus representations

Auditory cortex (AC), like subcortical auditory nuclei, represents properties of auditory stimuli by spatiotemporal activation patterns across neurons. A tacit assumption of AC research has been that the multiplicity of functional maps in primary and secondary areas serves a refined continuation of subcortical stimulus processing, i.e. a parallel orderly analysis of distinct properties of a complex sound. This view, which was mainly derived from exposure to parametric sound variation, may not fully capture the essence of cortical processing. Neocortex, in spite of its parcellation into diverse sensory, motor, associative, and cognitive areas, exhibits a rather stereotyped local architecture. The columnar arrangement of the neocortex and the quantitatively dominant connectivity with numerous other cortical areas are two of its key features. This suggests that cortex has a rather common function which lies beyond those usually leading to the distinction of functional areas. We propose that task-relatedness of the way, how any information can be represented in cortex, is one general consequence of the architecture and corticocortical connectivity. Specifically, this hypothesis predicts different spatiotemporal representations of auditory stimuli when concepts and strategies how these stimuli are analysed do change. We will describe, in an exemplary fashion, cortical patterns of local field potentials in gerbil, of unit spiking activity in monkey, and of fMRI signals in human AC during the execution of different tasks mainly in the realm of category formation of sounds. We demonstrate that the representations reflect context- and memory-related, conceptual and executional aspects of a task and that they can predict the behavioural outcome.