Responses of single auditory cortical neurons to tone sequences

Encoding of acquired sound-sequence salience by auditory cortical offset responses

Behaviorally relevant sounds are often composed of distinct acoustic units organized into specific temporal sequences. The meaning of such sound sequences can therefore be fully recognized only when they have terminated. However, the neural mechanisms underlying the perception of sound sequences remain unclear. Here, we use two-photon calcium imaging in the auditory cortex of behaving mice to test the hypothesis that neural responses to termination of sound sequences ("Off-responses") encode their acoustic history and behavioral salience. We find that auditory cortical Off-responses encode preceding sound sequences and that learning to associate a sound sequence with a reward induces enhancement of Off-responses relative to responses during the sound sequence ("On-responses"). Furthermore, learning enhances network-level discriminability of sound sequences by Off-responses. Last, learning-induced plasticity of Off-responses but not On-responses lasts to the next day. These findings identify auditory cortical Off-responses as a key neural signature of acquired sound-sequence salience.

Neuronal Encoding in a High-Level Auditory Area: From Sequential Order of Elements to Grammatical Structure

Sensitivity to the sequential structure of communication sounds is fundamental not only for language comprehension in humans but also for song recognition in songbirds. By quantifying single-unit responses, we first assessed whether the sequential order of song elements, called syllables, in conspecific songs is encoded in a secondary auditory cortex-like region of the zebra finch brain. Based on a habituation/dishabituation paradigm, we show that, after multiple repetitions of the same conspecific song, rearranging syllable order reinstated strong responses. A large proportion of neurons showed sensitivity to song context in which syllables occurred providing support for the nonlinear processing of syllable sequences. Sensitivity to the temporal order of items within a sequence should enable learning its underlying structure, an ability considered a core mechanism of the human language faculty. We show that repetitions of songs that were ordered according to a specific grammatical structure (i.e., ABAB or AABB structures; A and B denoting song syllables) led to different responses in both anesthetized and awake birds. Once responses were decreased due to song repetitions, the transition from one structure to the other could affect the firing rates and/or the spike patterns. Our results suggest that detection was based on local differences rather than encoding of the global song structure as a whole. Our study demonstrates that a high-level auditory region provides neuronal mechanisms to help discriminate stimuli that differ in their sequential structure.SIGNIFICANCE STATEMENT Sequence processing has been proposed as a potential precursor of language syntax. As a sequencing operation, the encoding of the temporal order of items within a sequence may help in recognition of relationships between adjacent items and in learning the underlying structure. Taking advantage of the stimulus-specific adaptation phenomenon observed in a high-level auditory region of the zebra finch brain, we addressed this question at the neuronal level. Reordering elements within conspecific songs reinstated robust responses. Neurons also detected changes in the structure of artificial songs, and this detection depended on local transitions between adjacent or nonadjacent syllables. These findings establish the songbird as a model system for deciphering the mechanisms underlying sequence processing at the single-cell level.

Event-related potentials demonstrate deficits in acoustic segmentation in schizophrenia

Segmentation of the acoustic environment into discrete percepts is an important facet of auditory scene analysis (ASA). Segmentation of auditory stimuli into perceptually meaningful and localizable groups is central to ASA in everyday situations; for example, separation of discrete words from continuous sentences when processing language. This is particularly relevant to schizophrenia, where deficits in perceptual organization have been linked to symptoms and cognitive dysfunction. Here we examined event-related potentials in response to grouped tones to elucidate schizophrenia-related differences in acoustic segmentation. We report for the first time in healthy subjects a sustained potential that begins with group initiation and ends with the last tone of the group. These potentials were reduced in schizophrenia, with the greatest differences in responses to first and final tones. Importantly, reductions in sustained potentials in schizophrenia patients were associated with greater negative symptoms and deficits in IQ, working memory, learning, and social cognition. These results suggest deficits in auditory pattern segmentation in schizophrenia may compound deficits in many higher-order facets of the disorder.

Computational modelling suggests that temporal integration results from synaptic adaptation in auditory cortex

Incoming sounds are represented in the context of preceding events, and this requires a memory mechanism that integrates information over time. Here, it was demonstrated that response adaptation, the suppression of neural responses due to stimulus repetition, might reflect a computational solution that auditory cortex uses for temporal integration. Adaptation is observed in single-unit measurements as two-tone forward masking effects and as stimulus-specific adaptation (SSA). In non-invasive observations, the amplitude of the auditory N1m response adapts strongly with stimulus repetition, and it is followed by response recovery (the so-called mismatch response) to rare deviant events. The current computational simulations described the serial core-belt-parabelt structure of auditory cortex, and included synaptic adaptation, the short-term, activity-dependent depression of excitatory corticocortical connections. It was found that synaptic adaptation is sufficient for columns to respond selectively to tone pairs and complex tone sequences. These responses were defined as combination sensitive, thus reflecting temporal integration, when a strong response to a stimulus sequence was coupled with weaker responses both to the time-reversed sequence and to the isolated sequence elements. The temporal complexity of the stimulus seemed to be reflected in the proportion of combination-sensitive columns across the different regions of the model. Our results suggest that while synaptic adaptation produces facilitation and suppression effects, including SSA and the modulation of the N1m response, its functional significance may actually be in its contribution to temporal integration. This integration seems to benefit from the serial structure of auditory cortex.

Forward masking in the medial nucleus of the trapezoid body of the rat

Perception of acoustic stimuli is modulated by the temporal and spectral relationship between sound components. Forward masking experiments show that the perception threshold for a probe tone is significantly impaired by a preceding masker stimulus. Forward masking has been systematically studied at the level of the auditory nerve, cochlear nucleus, inferior colliculus and auditory cortex, but not yet in the superior olivary complex. The medial nucleus of the trapezoid body (MNTB), a principal cell group of the superior olive, plays an essential role in sound localization. The MNTB receives excitatory input from the contralateral cochlear nucleus via the calyces of Held and innervates the ipsilateral lateral and medial superior olives, as well as the superior paraolivary nucleus. Here, we performed single-unit extracellular recordings in the MNTB of rats. Using a forward masking paradigm previously employed in studies of the inferior colliculus and auditory nerve, we determined response thresholds for a 20-ms characteristic frequency pure tone (the probe), and then presented it in conjunction with another tone (the masker) that was varied in intensity, duration, and frequency; we also systematically varied the masker-to-probe delay. Probe response thresholds increased and response magnitudes decreased when a masker was presented. The forward suppression effects were greater when masker level and masker duration were increased, when the masker frequency approached the MNTB unit's characteristic frequency, and as the masker-to-probe delay was shortened. Probe threshold shifts showed an exponential decay as the masker-to-probe delay increased.

Spectral motion contrast as a speech context effect

Spectral contrast effects may help "normalize" the incoming sound and produce perceptual constancy in the face of the variable acoustics produced by different rooms, talkers, and backgrounds. Recent studies have concentrated on the after-effects produced by the long-term average power spectrum. The present study examined contrast effects based on spectral motion, analogous to visual-motion after-effects. In experiment 1, the existence of spectral-motion after-effects with word-length inducers was established by demonstrating that the identification of the direction of a target spectral glide was influenced by the spectral motion of a preceding inducer glide. In experiment 2, the target glide was replaced with a synthetic sine-wave speech sound, including a formant transition. The speech category boundary was shifted by the presence and direction of the inducer glide. Finally, in experiment 3, stimuli based on synthetic sine-wave speech sounds were used as both context and target stimuli to show that the spectral-motion after-effects could occur even with inducers with relatively short speech-like durations and small frequency excursions. The results suggest that spectral motion may play a complementary role to the long-term average power spectrum in inducing speech context effects.

Why do forward maskers affect auditory intensity discrimination? Evidence from "molecular psychophysics"

Nonsimultaneous maskers can strongly impair performance in an auditory intensity discrimination task. Using methods of molecular psychophysics, we quantified the extent to which (1) a masker-induced impairment of the representation of target intensity (i.e., increase in internal noise) and (2) a systematic influence of the masker intensities on the decision variable contribute to these effects. In a two-interval intensity discrimination procedure, targets were presented in quiet, and combined with forward maskers. The lateralization of the maskers relative to the targets was varied via the interaural time difference. Intensity difference limens (DLs) were strongly elevated under forward masking but less with contralateral than with ipsilateral maskers. For most listeners and conditions, perceptual weights measuring the relation between the target and masker levels and the response in the intensity discrimination task were positive and significant. Higher perceptual weights assigned to the maskers corresponded to stronger elevations of the intensity DL. The maskers caused only a weak increase in internal noise, unrelated to target level and masker lateralization. The results indicate that the effects of forward masking on intensity discrimination are determined by an inclusion of the masker intensities in the decision variable, compatible with the hypothesis that the impairment in performance is to a large part caused by difficulties in directing selective attention to the targets. The effects of masker lateralization are evidence for top-down influences, and the observed positive signs of the masker weights suggest that the relevant mechanisms are located at higher processing stages rather than in the auditory periphery.

Rapid spectrotemporal plasticity in primary auditory cortex during behavior

Complex natural and environmental sounds, such as speech and music, convey information along both spectral and temporal dimensions. The cortical representation of such stimuli rapidly adapts when animals become actively engaged in discriminating them. In this study, we examine the nature of these changes using simplified spectrotemporal versions (upward vs downward shifting tone sequences) with domestic ferrets (Mustela putorius). Cortical processing rapidly adapted to enhance the contrast between the two discriminated stimulus categories, by changing spectrotemporal receptive field properties to encode both the spectral and temporal structure of the tone sequences. Furthermore, the valence of the changes was closely linked to the task reward structure: stimuli associated with negative reward became enhanced relative to those associated with positive reward. These task- and-stimulus-related spectrotemporal receptive field changes occurred only in trained animals during, and immediately following, behavior. This plasticity was independently confirmed by parallel changes in a directionality function measured from the responses to the transition of tone sequences during task performance. The results demonstrate that induced patterns of rapid plasticity reflect closely the spectrotemporal structure of the task stimuli, thus extending the functional relevance of rapid task-related plasticity to the perception and learning of natural sounds such speech and animal vocalizations.

A quantitative analysis of information about past and present stimuli encoded by spikes of A1 neurons

To process the rich temporal structure of their acoustic environment, organisms have to integrate information over time into an appropriate neural response. Previous studies have addressed the modulation of responses of auditory neurons to a current sound in dependence of the immediate stimulation history, but a quantitative analysis of this important computational process has been missing. In this study, we analyzed temporal integration of information in the spike output of 122 single neurons in primary auditory cortex (A1) of four awake ferrets in response to random tone sequences. We quantified the information contained in the responses about both current and preceding sounds in two ways: by estimating directly the mutual information between stimulus and response, and by training linear classifiers to decode information about the stimulus from the neural response. We found that 1) many neurons conveyed a significant amount of information not only about the current tone but also simultaneously about the previous tone, 2) the neural response to tone sequences was a nonlinear combination of responses to the tones in isolation, and 3) nevertheless, much of the information about current and previous tones could be extracted by linear decoders. Furthermore, our analysis of these experimental data shows that methods from information theory and the application of standard machine learning methods for extracting specific information yield quite similar results.

Forward suppression in the auditory cortex is frequency-specific

We investigated how physiologically observed forward suppression interacts with stimulus frequency in neuronal responses in the guinea pig auditory cortex. The temporal order and frequency proximity of sounds influence both their perception and neuronal responses. Psychophysically, preceding sounds (conditioners) can make successive sounds (probes) harder to hear. These effects are larger when the two sounds are spectrally similar. Physiological forward suppression is usually maximal for conditioner tones near to a unit's characteristic frequency (CF), the frequency to which a neuron is most sensitive. However, in most physiological studies, the frequency of the probe tone and CF are identical, so the role of unit CF and probe frequency cannot be distinguished. Here, we systemically varied the frequency of the probe tone, and found that the tuning of suppression was often more closely related to the frequency of the probe tone than to the unit's CF, i.e. suppressed tuning was specific to probe frequency. This relationship was maintained for all measured gaps between the conditioner and the probe tones. However, when the probe frequency and CF were similar, CF tended to determine suppressed tuning. In addition, the bandwidth of suppression was slightly wider for off-CF probes. Changes in tuning were also reflected in the firing rate in response to probe tones, which was maximally reduced when probe and conditioner tones were matched in frequency. These data are consistent with the idea that cortical neurons receive convergent inputs with a wide range of tuning properties that can adapt independently.

Complex spectral interactions encoded by auditory cortical neurons: relationship between bandwidth and pattern

The focus of most research on auditory cortical neurons has concerned the effects of rather simple stimuli, such as pure tones or broad-band noise, or the modulation of a single acoustic parameter. Extending these findings to feature coding in more complex stimuli such as natural sounds may be difficult, however. Generalizing results from the simple to more complex case may be complicated by non-linear interactions occurring between multiple, simultaneously varying acoustic parameters in complex sounds. To examine this issue in the frequency domain, we performed a parametric study of the effects of two global features, spectral pattern (here ripple frequency) and bandwidth, on primary auditory (A1) neurons in awake macaques. Most neurons were tuned for one or both variables and most also displayed an interaction between bandwidth and pattern implying that their effects were conditional or interdependent. A spectral linear filter model was able to qualitatively reproduce the basic effects and interactions, indicating that a simple neural mechanism may be able to account for these interdependencies. Our results suggest that the behavior of most A1 neurons is likely to depend on multiple parameters, and so most are unlikely to respond independently or invariantly to specific acoustic features.

Responses of neurons in the cat primary auditory cortex to sequential sounds

In the natural acoustic environment sounds frequently arrive at the two ears in quick succession. The responses of a cortical neuron to acoustic stimuli can be dramatically altered, usually suppressed, by a preceding sound. The purpose of this study was to determine if the binaural interaction evoked by a preceding sound is involved in subsequent suppressive interactions observed in auditory cortex neurons. Responses of neurons in the primary auditory cortex (AI) exhibiting binaural suppressive interactions (EO/I) were studied in barbiturate-anesthetized cats. For the majority (72.5%) of EO/I neurons studied, the response to a monaural contralateral stimulus was suppressed by a preceding monaural contralateral stimulus, but was not changed by a preceding monaural ipsilateral stimulus. For this subset of EO/I neurons, when a monaural contralateral stimulus was preceded by a binaural stimulus, the level of both the ipsilateral and the contralateral component of the binaural stimulus influenced the response to the subsequent monaural contralateral stimulus. When the contralateral level of the binaural stimulus was constant, increasing its ipsilateral level decreased the suppression of the response to the subsequent monaural contralateral stimulus. When the ipsilateral level of the binaural stimulus was constant, increasing its contralateral level increased the suppression of the response to the subsequent monaural contralateral stimulus. These results demonstrate that the sequential inhibition of responses of AI neurons is a function of the product of a preceding binaural interaction. The magnitude of the response to the contralateral stimulus is related to, but not determined by the magnitude of the response to the preceding binaural stimulus. Possible mechanisms of this sequential interaction are discussed.

Development of infant mismatch responses to auditory pattern changes between 2 and 4 months old

In order to process speech and music, the auditory cortex must learn to process patterns of sounds. Our previous studies showed that with a stream consisting of a repeating (standard) sound, younger infants show an increase in the amplitude of a positive slow wave in response to occasional changes (deviants) in pitch or duration, whereas older infants show a faster negative response that resembles mismatch negativity (MMN) in adults (Trainor et al., 2001, 2003; He et al., 2007). MMN reflects an automatic change-detection process that does not require attention, conscious awareness or behavioural response for its elicitation (Picton et al., 2000; Näätänen et al., 2007). It is an important tool for understanding auditory perception because MMN reflects a change-detection mechanism, and not simply that repetition of a stimulus results in a refractory state of sensory neural circuits while occasional changes to a new sound activate new non-refractory neural circuits (Näätänen et al., 2005). For example, MMN is elicited by a change in the pattern of a repeating note sequence, even when no new notes are introduced that could activate new sensory circuits (Alain et al., 1994, 1999;Schröger et al., 1996). In the present study, we show that in response to a change in the pattern of two repeating tones, MMN in 4-month-olds remains robust whereas the 2-month-old response does not. This indicates that the MMN response to a change in pattern at 4 months reflects the activation of a change-detection mechanism similarly as in adults.

State-dependent computations: spatiotemporal processing in cortical networks

A conspicuous ability of the brain is to seamlessly assimilate and process spatial and temporal features of sensory stimuli. This ability is indispensable for the recognition of natural stimuli. Yet, a general computational framework for processing spatiotemporal stimuli remains elusive. Recent theoretical and experimental work suggests that spatiotemporal processing emerges from the interaction between incoming stimuli and the internal dynamic state of neural networks, including not only their ongoing spiking activity but also their 'hidden' neuronal states, such as short-term synaptic plasticity.

Facilitatory mechanisms underlying selectivity for the direction and rate of frequency modulated sweeps in the auditory cortex

Neurons selective for frequency modulated (FM) sweeps are common in auditory systems across different vertebrate groups and may underlie representation of species-specific vocalizations. Studies on mechanisms of FM sweep selectivity have primarily focused on sideband inhibition. Here, we present the first evidence for facilitatory mechanisms of FM sweep selectivity. Facilitatory interactions were found in 46 of 264 (17%) neurons tuned in the echolocation range (25-60 kHz) in the auditory cortex of the pallid bat. These neurons respond poorly to individual tones but are facilitated by combinations of tones with specific spectral and temporal intervals. Facilitation neurons show remarkable sensitivity to sub-millisecond differences in time delays between the two tones. Interestingly, the range of delays eliciting facilitation is not fixed but varies systematically with frequency difference between the two tones. Properties of facilitation strongly predict selectivity for the direction and rate of FM sweeps. Together with previous studies, there appear to be at least three mechanisms underlying FM rate and direction selectivity: sideband inhibition, duration tuning, and facilitation. Interestingly, similar mechanisms underlie direction and velocity tuning in the visual system, suggesting the evolution of similar computations across sensory systems to process dynamic sensory stimuli.

Early stages of melody processing: stimulus-sequence and task-dependent neuronal activity in monkey auditory cortical fields A1 and R

To explore the effects of acoustic and behavioral context on neuronal responses in the core of auditory cortex (fields A1 and R), two monkeys were trained on a go/no-go discrimination task in which they learned to respond selectively to a four-note target (S+) melody and withhold response to a variety of other nontarget (S-) sounds. We analyzed evoked activity from 683 units in A1/R of the trained monkeys during task performance and from 125 units in A1/R of two naive monkeys. We characterized two broad classes of neural activity that were modulated by task performance. Class I consisted of tone-sequence-sensitive enhancement and suppression responses. Enhanced or suppressed responses to specific tonal components of the S+ melody were frequently observed in trained monkeys, but enhanced responses were rarely seen in naive monkeys. Both facilitatory and suppressive responses in the trained monkeys showed a temporal pattern different from that observed in naive monkeys. Class II consisted of nonacoustic activity, characterized by a task-related component that correlated with bar release, the behavioral response leading to reward. We observed a significantly higher percentage of both Class I and Class II neurons in field R than in A1. Class I responses may help encode a long-term representation of the behaviorally salient target melody. Class II activity may reflect a variety of nonacoustic influences, such as attention, reward expectancy, somatosensory inputs, and/or motor set and may help link auditory perception and behavioral response. Both types of neuronal activity are likely to contribute to the performance of the auditory task.

Nonlinearities and contextual influences in auditory cortical responses modeled with multilinear spectrotemporal methods

The relationship between a sound and its neural representation in the auditory cortex remains elusive. Simple measures such as the frequency response area or frequency tuning curve provide little insight into the function of the auditory cortex in complex sound environments. Spectrotemporal receptive field (STRF) models, despite their descriptive potential, perform poorly when used to predict auditory cortical responses, showing that nonlinear features of cortical response functions, which are not captured by STRFs, are functionally important. We introduce a new approach to the description of auditory cortical responses, using multilinear modeling methods. These descriptions simultaneously account for several nonlinearities in the stimulus-response functions of auditory cortical neurons, including adaptation, spectral interactions, and nonlinear sensitivity to sound level. The models reveal multiple inseparabilities in cortical processing of time lag, frequency, and sound level, and suggest functional mechanisms by which auditory cortical neurons are sensitive to stimulus context. By explicitly modeling these contextual influences, the models are able to predict auditory cortical responses more accurately than are STRF models. In addition, they can explain some forms of stimulus dependence in STRFs that were previously poorly understood.

Tone-sequence analysis in the auditory cortex of awake macaque monkeys

The present study analyzed neuronal responses to two-tone sequences in the auditory cortex of three awake macaque monkeys. The monkeys were passively exposed to 430 different two-tone sequences, in which the frequency of the first tone and the interval between the first and the second tone in the sequence were systematically varied. The frequency of the second tone remained constant and was matched to the single-tone frequency sensitivity of the neurons. Multiunit activity was recorded from 109 sites in the primary auditory cortex and posterior auditory belt. We found that the first tone in the sequence could inhibit or facilitate the response to the second tone. Type and magnitude of poststimulatory effects depended on the sequence parameters and were related to the single-tone frequency sensitivity of neurons, similar to previous observations in the auditory cortex of anesthetized animals. This suggests that some anesthetics produce, at the most, moderate changes of poststimulatory inhibition and facilitation in the auditory cortex. Hence many properties of the sequence-sensitivity of neurons in the auditory cortex measured in anesthetized preparations can be applied to neurons in the auditory cortex of awake subjects.

Sound sequence discrimination learning motivated by reward requires dopaminergic D2 receptor activation in the rat auditory cortex

We have previously reported that sound sequence discrimination learning requires cholinergic inputs to the auditory cortex (AC) in rats. In that study, reward was used for motivating discrimination behavior in rats. Therefore, dopaminergic inputs mediating reward signals may have an important role in the learning. We tested the possibility in the present study. Rats were trained to discriminate sequences of two sound components, and licking behavior in response to one of the two sequences was rewarded with water. To identify the dopaminergic inputs responsible for the learning, dopaminergic afferents to the AC were lesioned with local injection of 6-hydroxydopamine (6-OHDA). The injection attenuated sound sequence discrimination learning, while it had no effect on discrimination between the sound components of the sequence stimuli. Local injection of 6-OHDA into the nucleus accumbens attenuated sound discrimination learning. However, not only discrimination learning of sound sequence but also that of the sound components were impaired. SCH23390 (0.2 mg/kg, i.p.), a D1 receptor antagonist, had no effect on sound sequence discrimination learning, while it attenuated the licking behavior to unfamiliar stimuli. Haloperidol (0.5 mg/kg, i.p.), a D2 family antagonist, attenuated sound sequence discrimination learning, while it had no clear suppressive effect on discrimination of two different sound components and licking. These results suggest that D2 family receptors activated by dopaminergic inputs to the AC are required for sound sequence discrimination learning.

Single-neuron responses to rapidly presented temporal sequences in the primary auditory cortex of the awake macaque monkey

One fundamental process of the auditory system is to process rapidly occurring acoustic stimuli, which are fundamental components of complex stimuli such as animal vocalizations and human speech. Although the auditory cortex is known to subserve the perception of acoustic temporal events, relatively little is currently understood about how single neurons respond to such stimuli. We recorded the responses of single neurons in the primary auditory cortex of alert monkeys performing an auditory task. The stimuli consisted of four tone pips with equal duration and interpip interval, with the first and last pip of the sequence being near the characteristic frequency of the neuron under study. We manipulated the rate of presentation, the frequency of the middle two tone pips, and the order by which they were presented. Our results indicate that single cortical neurons are ineffective at responding to the individual tone pips of the sequence for pip durations of <12 ms, but did begin to respond synchronously to each pip of the sequence at 18-ms durations. In addition, roughly 40% of the neurons tested were able to discriminate the order that the two middle tone pips were presented in at durations of > or =24 ms. These data place the primate primary auditory cortex at an early processing stage of temporal rate discrimination.

Temporal processing and context dependency of phoneme discrimination in patients with aphasia

Standard diagnostic procedures for assessing temporal-processing abilities of adult patients with aphasia have so far not been developed. In our study, temporal-order measurements were conducted using two different experimental procedures to identify a suitable measure for clinical studies. Additionally, phoneme-discrimination abilities were tested on the word, as well as on the sentence level, as a relationship between temporal processing and phoneme-discrimination abilities is assumed. Patients with aphasia displayed significantly higher temporal-order thresholds than control subjects. The detection of an association between temporal processing and speech processing, however, depended on the stimuli and the phoneme-discrimination tasks used. Our results also suggest top-down feedback on phonemic processing.

Stimulus-dependent processing of temporal order

Two distinct conceptualisations of processing mechanisms have been proposed in the research on the perception of temporal order, one that assumes a central-timing mechanism that is involved in the detection of temporal order independent of modality and stimulus type, another one assuming feature-specific mechanisms that are dependent on stimulus properties. In the present study, four different temporal-order judgement tasks were compared to test these two conceptualisations, that is, to determine whether common processes underlie temporal-order thresholds over different modalities and stimulus types or whether distinct processes are related to each task. Measurements varied regarding modality (visual and auditory) and stimulus properties (auditory modality: clicks and tones; visual modality: colour and position). Results indicate that the click and the tone paradigm, as well as the colour and position paradigm, correlate with each other. Besides these intra-modal relationships, cross-modal correlations show dependencies between the click, the colour and the position tasks. Both processing mechanisms seem to influence the detection of temporal order. While two different tones are integrated and processed by a more independent, possibly feature-specific mechanism, a more central, modality-independent timing mechanism contributes to the click, colour and position condition.

Long lasting attenuation by prior sounds in auditory cortex of awake primates

How the brain responds to sequences of sounds is a question of great relevance to a variety of auditory perceptual phenomena. We investigated how long the responses of neurons in the primary auditory cortex of awake monkeys are influenced by the previous sound. We found that responses to the second sound of a two-sound sequence were generally attenuated compared to the response that sound evoked when it was presented first. The attenuation remained evident at the population level even out to inter-stimulus intervals (ISIs) of 5 s, although it was of modest size for ISIs >2 s. Behavioral context (performance versus non-performance of a visual fixation task during sound presentation) did not influence the results. The long time course of the first sound's influence suggests that, under natural conditions, neural responses in auditory cortex are rarely governed solely by the current sound.

Long-Lasting Modulation by Stimulus Context in Primate Auditory Cortex

A sound embedded in an acoustic stream cannot be unambiguously segmented and identified without reference to its stimulus context. To understand the role of stimulus context in cortical processing, we investigated the responses of auditory cortical neurons to 2-sound sequences in awake marmosets, with a focus on stimulus properties other than carrier frequency. Both suppressive and facilitatory modulations of cortical responses were observed by using combinations of modulated tone and noise stimuli. The main findings are as follows. 1) Preceding stimuli could suppress or facilitate responses to succeeding stimuli for durations >1 s. These long-lasting effects were dependent on the duration, sound level, and modulation parameters of the preceding stimulus, in addition to the carrier frequency. They occurred regardless of whether the 2 stimuli were separated by a silent interval. 2) Suppression was often tuned such that preceding stimuli whose parameters were similar to succeeding stimuli produced the strongest suppression. However, the responses of many units could be suppressed, although often weaker, even when the 2 stimuli were dissimilar. In some cases, only a dissimilar preceding stimulus produced suppression in the responses to the succeeding stimulus. 3) In contrast to suppression, facilitation of responses to succeeding stimuli by the preceding stimulus was usually strongest when the 2 stimuli were dissimilar. 4) There was no clear correlation between the firing rate evoked by the preceding stimulus and the change in the firing rate evoked by the succeeding stimulus, indicating that the observed suppression was not simply a result of habituation or spike adaptation. These results demonstrate that persistent modulations of the responses of an auditory cortical neuron to a given stimulus can be induced by preceding stimuli. Decreases or increases of responses to the succeeding stimuli are dependent on the spectral, temporal, and intensity properties of the preceding stimulus. This indicates that cortical auditory responses to a sound are not static, but instead depend on the stimulus context in a stimulus-specific manner. The long-lasting impact of stimulus context and the prevalence of facilitation suggest that such cortical response properties are important for auditory processing beyond forward masking, such as for auditory streaming and segregation.

On the binding of successive sounds: perceiving shifts in nonperceived pitches

It is difficult to hear out individually the components of a "chord" of equal-amplitude pure tones with synchronous onsets and offsets. In the present study, this was confirmed using 300-ms random (inharmonic) chords with components at least 1/2 octave apart. Following each chord, after a variable silent delay, listeners were presented with a single pure tone which was either identical to one component of the chord or halfway in frequency between two components. These two types of sequence could not be reliably discriminated from each other. However, it was also found that if the single tone following the chord was instead slightly (e.g., 1/12 octave) lower or higher in frequency than one of its components, the same listeners were sensitive to this relation. They could perceive a pitch shift in the corresponding direction. Thus, it is possible to perceive a shift in a nonperceived frequency/pitch. This paradoxical phenomenon provides psychophysical evidence for the existence of automatic "frequency-shift detectors" in the human auditory system. The data reported here suggest that such detectors operate at an early stage of auditory scene analysis but can be activated by a pair of sounds separated by a few seconds.

The neural basis of temporal processing

A complete understanding of sensory and motor processing requires characterization of how the nervous system processes time in the range of tens to hundreds of milliseconds (ms). Temporal processing on this scale is required for simple sensory problems, such as interval, duration, and motion discrimination, as well as complex forms of sensory processing, such as speech recognition. Timing is also required for a wide range of motor tasks from eyelid conditioning to playing the piano. Here we review the behavioral, electrophysiological, and theoretical literature on the neural basis of temporal processing. These data suggest that temporal processing is likely to be distributed among different structures, rather than relying on a centralized timing area, as has been suggested in internal clock models. We also discuss whether temporal processing relies on specialized neural mechanisms, which perform temporal computations independent of spatial ones. We suggest that, given the intricate link between temporal and spatial information in most sensory and motor tasks, timing and spatial processing are intrinsic properties of neural function, and specialized timing mechanisms such as delay lines, oscillators, or a spectrum of different time constants are not required. Rather temporal processing may rely on state-dependent changes in network dynamics.

Sound sequence discrimination learning is dependent on cholinergic inputs to the rat auditory cortex

In rat auditory cortex (AC) slices, synaptic potentiation following heterosynaptic stimulation is affected by the stimulus sequence used for induction. It was hypothesized that this sequence-dependent plasticity might be partly involved in the cellular mechanisms underlying sound sequence discrimination. Sequence dependence is abolished by muscarinic receptor antagonists. Therefore, dependence of sound sequence discrimination learning on cholinergic inputs to the rat AC was investigated. Rats were trained to discriminate the sequences of two sound components and a licking behavior in response to one of two possible sequences was rewarded with water. Atropine, a muscarinic receptor antagonist, attenuated sound sequence discrimination learning. The acquired sound sequence discrimination was not affected by atropine. Injections of the cholinergic immunotoxin 192IgG-saporin into the AC suppressed sound sequence discrimination learning, while discrimination between the two sound components was not affected. An inhibitor of M-current, linopirdine, restores the sequence dependence of synaptic potentiation in the AC slices suppressed by atropine. In this study, sound sequence discrimination learning attenuated by 192IgG-saporin was also restored by linopirdine. These similarities between sequence dependent plasticity in the AC slices and sound sequence discrimination learning support the hypothesis that the former is involved in the cellular mechanisms underlying the latter.

Context-dependent adaptive coding of interaural phase disparity in the auditory cortex of awake macaques

In the ascending auditory pathway, the context in which a particular stimulus occurs can influence the character of the responses that encode it. Here we demonstrate that the cortical representation of a binaural cue to sound source location is profoundly context-dependent: spike rates elicited by a 0 degrees interaural phase disparity (IPD) were very different when preceded by 90 degrees versus -90 degrees IPD. The changes in firing rate associated with equivalent stimuli occurring in different contexts are comparable to changes in discharge rate that establish cortical tuning to the cue itself. Single-unit responses to trapezoidally modulated IPD stimuli were recorded in the auditory cortices of awake rhesus monkeys. Each trapezoidal stimulus consisted of linear modulations of IPD between two steady-state IPDs differing by 90 degrees. The stimulus set was constructed so that identical IPDs and sweeps through identical IPD ranges recurred as elements of disparate sequences. We routinely observed orderly context-induced shifts in IPD tuning. These shifts reflected an underlying enhancement of the contrast in the discharge rate representation of different IPDs. This process is subserved by sensitivity to stimulus events in the recent past, involving multiple adaptive mechanisms operating on timescales ranging from tens of milliseconds to seconds. These findings suggest that the cortical processing of dynamic acoustic signals is dominated by an adaptive coding strategy that prioritizes the representation of stimulus changes over actual stimulus values. We show how cortical selectivity for motion direction in real space could emerge as a consequence of this general coding principle.

Integration of cardiac responses to serial stimuli after Pavlovian conditioning in rats

The expression of cardiac responses to sequences of two sounds was studied in restrained rats following discriminative trace or delay conditioning. Stimuli paired with a tail shock 10 sec later (CS1) elicited conditioned bradycardia. Unpaired or neutral stimuli (CS0) elicited mostly tachycardia. Rats did not learn to suppress responding to nonreinforced sequences with an interval of 6 sec between sounds. Responses to the second stimulus were significantly augmented following a CS1 stimulus, but not following a CS0 stimulus. Real-time summation of simple responses provided a more complete and quantitative prediction of dual responses than did resetting or facilitation. These results extend the time range over which summation may be observed from less than 2 sec to at least 16 sec. They appear to be inconsistent with models involving competition between unitary representations of stimuli in short-term memory and suggest the existence of multiple stimulus traces with independent time courses.

Effects of auditory stimulus context on the representation of frequency in the gerbil inferior colliculus

Prior studies of dynamic conditioning have focused on modulation of binaural localization cues, revealing that the responses of inferior colliculus (IC) neurons to particular values of interaural phase and level disparities depend critically on the context in which they occur. Here we show that monaural frequency transitions, which do not simulate azimuthal motion, also condition the responses of IC neurons. We characterized single-unit responses to two frequency transition stimuli: a glide stimulus comprising two tones linked by a linear frequency sweep (origin-sweep-target) and a step stimulus consisting of one tone followed immediately by another (origin-target). Using sets of glide and step stimuli converging on a common target, we constructed conditioned response functions (RFs) depicting the variability in the response to an identical stimulus as a function of the preceding origin frequency. For nearly all cells, the response to the target depended on the origin frequency, even for origins outside the excitatory frequency response area of the cell. Results from conditioned RFs based on long (2-4 s) and short (200 ms) duration step stimuli indicate that conditioning effects can be induced in the absence of the dynamic sweep, and by stimuli of relatively short duration. Because IC neurons are tuned to frequency, changes in the origin frequency often change the "effective" stimulus duty cycle. In many cases, the enhancement of the target response appeared related to the decrease in the "effective" stimulus duty cycle rather than to the prior presentation of a particular origin frequency. Although this implies that nonselective adaptive mechanisms are responsible for conditioned responses, slightly more than half of IC neurons in each paradigm responded significantly differently to targets following origins that elicited statistically indistinguishable responses. The prevailing influence of stimulus context when discharge history is controlled demonstrates that not all the mechanisms governing conditioning depend on the discharge history of the recorded neuron. Selective adaptation among the neuron's variously tuned afferents may help engender stimulus-specific conditioning. The demonstration that conditioning effects reflect sensitivity to spectral as well as spatial stimulus contrast has broad implications for the processing of a wide range of dynamic acoustic signals and sound sequences.

Spectro-temporal analysis of complex tones: two cortical processes dependent on retention of sounds in the long auditory store

OBJECTIVES

To examine whether two cortical processes concerned with spectro-temporal analysis of complex tones, a 'C-process' generating CN1 and CP2 potentials at cf. 100 and 180 ms after sudden change of pitch or timbre, and an 'M-process' generating MN1 and MP2 potentials of similar latency at the sudden cessation of repeated changes, are dependent on accumulation of a sound image in the long auditory store.

METHODS

The durations of steady (440 Hz) and rapidly oscillating (440-494 Hz, 16 changes/s) pitch of a synthesized 'clarinet' tone were reciprocally varied between 0.5 and 4.5 s within a duty cycle of 5 s. Potentials were recorded at the beginning and end of the period of oscillation in 10 non-attending normal subjects.

RESULTS

The CN1 at the beginning of pitch oscillation and the MN1 at the end were both strongly influenced by the duration of the immediately preceding stimulus pattern, mean amplitudes being 3-4 times larger after 4.5 s as compared with 0.5 s.

CONCLUSIONS

The processes responsible for both CN1 and MN1 are influenced by the duration of the preceding sound pattern over a period comparable to that of the 'echoic memory' or long auditory store. The store therefore appears to occupy a key position in spectro-temporal sound analysis. The C-process is concerned with the spectral structure of complex sounds, and may therefore reflect the 'grouping' of frequency components underlying auditory stream segregation. The M-process (mismatch negativity) is concerned with the temporal sound structure, and may play an important role in the extraction of information from sequential sounds.

Functional specificity in the right human auditory cortex for perceiving pitch direction

Previous lesion and functional imaging studies in humans suggest a greater involvement of right rather than left auditory cortical areas in certain aspects of pitch processing. In the present study, adaptive psychophysical procedures were used to determine auditory perceptual thresholds in 14 neurologically normal subjects, and in 31 patients who had undergone surgical resection from either the right or left temporal lobe for the relief of intractable epilepsy. In a subset of the patients, the lesion encroached significantly upon the gyrus of Heschl or its underlying white matter as determined from MRI analysis. Subjects were asked to perform two different perceptual tasks on the same set of stimuli. In a pitch discrimination task, the subject had to decide whether two elements of a pure tone pair were the same or different. In a task requiring the judgement of direction of pitch change, subjects decided whether pitch rose or fell from the first tone to the second. Thresholds were determined by measuring the minimum pitch difference required for correct task performance. Mean thresholds in the pitch discrimination task did not differ between patient groups and control subjects. In contrast, patients with temporal lobe excisions that encroached upon the gyrus of Heschl in the right hemisphere (but not in the left) showed significantly elevated thresholds when judging the direction of pitch change. These findings support a specialization of function linked to right auditory cortical areas for the processing of pitch direction, and specifically suggest a dissociation between simple sensory discrimination and higher order perception.

Processing of sound sequences in macaque auditory cortex: response enhancement

It is well established that the tone-evoked response of neurons in auditory cortex can be attenuated if another tone is presented several hundred milliseconds before. The present study explores in detail a complementary phenomenon in which the tone-evoked response is enhanced by a preceding tone. Action potentials from multiunit groups and single units were recorded from primary and caudomedial auditory cortical fields in lightly anesthetized macaque monkeys. Stimuli were two suprathreshold tones of 100-ms duration, presented in succession. The frequency of the first tone and the stimulus onset asynchrony (SOA) between the two tones were varied systematically, whereas the second tone was fixed. Compared with presenting the second tone in isolation, the response to the second tone was enhanced significantly when it was preceded by the first tone. This was observed in 87 of 130 multiunit groups and in 29 of 69 single units with no obvious difference between different auditory fields. Response enhancement occurred for a wide range of SOA (110-329 ms) and for a wide range of frequencies of the first tone. Most of the first tones that enhanced the response to the second tone evoked responses themselves. The stimulus, which on average produced maximal enhancement, was a pair with a SOA of 120 ms and with a frequency separation of about one octave. The frequency/SOA combinations that induced response enhancement were mostly different from the ones that induced response attenuation. Results suggest that response enhancement, in addition to response attenuation, provides a basic neural mechanism involved in the cortical processing of the temporal structure of sounds.

Event-related brain activity associated with auditory pattern processing

One of the basic properties of the auditory system is the ability to analyze complex temporal patterns. Here, we investigated the neural activity associated with auditory pattern processing using event-related brain potentials. Participants were presented with a continuously repeating sequence of four tones with rare changes in either the frequency or timing of one of the tones. Both frequency- and time-deviant sounds generated mismatch negativity (MMN) waves that peaked at midline central electrode sites and inverted in polarity at inferior temporal and occipital sites, consistent with generators in the supratemporal plane. The MMN scalp topography was similar for the frequency- and time-deviant stimuli, suggesting that both spectral and temporal relations among elements of an auditory pattern are encoded in a unified memory trace.

Cortical processing of complex tone stimuli: mismatch negativity at the end of a period of rapid pitch modulation

In this study, synthesised instrumental tones were used to examine human auditory cortical processes engaged at the end of a period of rapid pitch modulation. It was previously [S.J. Jones, O. Longe, M. Vaz Pato, Auditory evoked potentials to abrupt pitch and timbre change of complex tones: electrophysiological evidence of 'streaming'?, Electroencephalogr. Clin. Neurophysiol., 108 (1998) 131-142] suggested that the 'change-N1' produced by infrequent changes in pitch or timbre of a continuous complex tone represents the activity of a neuronal population topographically distinct from that responsible for the 'onset-N1' at the beginning of the tone. In the present study a superficially similar negativity was produced when the tone came to rest on a steady pitch after a period of rapid (8-16 changes/s) modulation; its scalp maximum was anterior to that of the two previously identified potentials but similar to that of the mismatch negativity elicited by discontinuous tones. By varying the modulation rate the latency was shown to be relatively constant with respect to the time the next pitch change was expected but failed to occur. The largest responses averaging c. 7 microV were evoked at the end of modulation sequences which were both rhythmic and repetitive, but a potential was still produced when there was no rhythmic pattern or repetition of individual notes. This response to non-occurrence of an expected but not necessarily specified change implies an automatic process for comparing the incoming sound with an extrapolated template of the preceding pattern in which timing as well as pitch information is accurately represented. We suggest this technique offers a robust method for eliciting the mismatch negativity, which may extend the opportunities for electrophysiological investigation of higher auditory processes.

Event-related brain activity associated with auditory pattern processing

One of the basic properties of the auditory system is the ability to analyse complex temporal patterns. Here, we investigated the neural activity associated with auditory pattern processing using event-related brain potentials. Participants were presented with a continuously repeating sequence of four tones with rare changes in either the frequency or timing of one of the tones. Both frequency- and time-deviant sounds generated mismatch negativity (MMN) waves that peaked at midline central electrode sites and inverted in polarity at inferior temporal and occipital sites, consistent with generators in the supratemporal plane. The MMN scalp topography was similar for the frequency- and time-deviant stimuli, suggesting that both spectral and temporal relations among elements of an auditory pattern are encoded in a unified memory trace.

Auditory cortical event-related potentials to pitch deviances in rats

We recorded epidural event-related potentials (ERPs) from the auditory cortex in anesthetized rats when pitch-deviant tones were presented in a homogeneous series of standard tones (oddball condition). Additionally, deviant tones were presented without standard tones (deviant-alone condition). ERPs to deviant tones in the oddball condition differed significantly from ERPs to standard tones at the latency range of 63-243 ms. On the other hand, ERPs to deviant tones in the deviant-alone condition did not differ from ERPs to standard tones until 196 ms from stimulus onset. The results suggest that oddball stimuli can be neurophysiologically discriminated in anesthetized rats. Furthermore, as the difference between ERPs to deviant tones and those to standard tones at the 63-196 ms latency range could be detected only when standard tones precede deviant tones it shows concordance with mismatch negativity in humans.

Functional anatomy of musical processing in listeners with absolute pitch and relative pitch

We used both structural and functional brain imaging techniques to investigate the neural basis of absolute pitch (AP), a specialized skill present in some musicians. By using positron emission tomography, we measured cerebral blood flow during the presentation of musical tones to AP possessors and to control musicians without AP. Listening to musical tones resulted in similar patterns of increased cerebral blood flow in auditory cortical areas in both groups, as expected. The AP group also demonstrated activation of the left posterior dorsolateral frontal cortex, an area thought to be related to learning conditional associations. However, a similar pattern of left dorsolateral frontal activity was also observed in non-AP subjects when they made relative pitch judgments of intervals, such as minor or major. Conversely, activity within the right inferior frontal cortex was observed in control but not in AP subjects during the interval-judgment task, suggesting that AP possessors need not access working memory mechanisms in this task. MRI measures of cortical volume indicated a larger left planum temporale in the AP group, which correlated with performance on an pitch-naming task. Our findings suggest that AP may not be associated with a unique pattern of cerebral activity but rather may depend on the recruitment of a specialized network involved in the retrieval and manipulation of verbal-tonal associations.

Auditory evoked potentials to abrupt pitch and timbre change of complex tones: electrophysiological evidence of 'streaming'?

Examination of the cortical auditory evoked potentials to complex tones changing in pitch and timbre suggests a useful new method for investigating higher auditory processes, in particular those concerned with 'streaming' and auditory object formation. The main conclusions were: (i) the N1 evoked by a sudden change in pitch or timbre was more posteriorly distributed than the N1 at the onset of the tone, indicating at least partial segregation of the neuronal populations responsive to sound onset and spectral change; (ii) the T-complex was consistently larger over the right hemisphere, consistent with clinical and PET evidence for particular involvement of the right temporal lobe in the processing of timbral and musical material; (iii) responses to timbral change were relatively unaffected by increasing the rate of interspersed changes in pitch, suggesting a mechanism for detecting the onset of a new voice in a constantly modulated sound stream; (iv) responses to onset, offset and pitch change of complex tones were relatively unaffected by interfering tones when the latter were of a different timbre, suggesting these responses must be generated subsequent to auditory stream segregation.

Syntax processing by auditory cortical neurons in the FM-FM area of the mustached bat Pteronotus parnellii

Syntax denotes a rule system that allows one to predict the sequencing of communication signals. Despite its significance for both human speech processing and animal acoustic communication, the representation of syntactic structure in the mammalian brain has not been studied electrophysiologically at the single-unit level. In the search for a neuronal correlate for syntax, we used playback of natural and temporally destructured complex species-specific communication calls-so-called composites-while recording extracellularly from neurons in a physiologically well defined area (the FM-FM area) of the mustached bat's auditory cortex. Even though this area is known to be involved in the processing of target distance information for echolocation, we found that units in the FM-FM area were highly responsive to composites. The finding that neuronal responses were strongly affected by manipulation in the time domain of the natural composite structure lends support to the hypothesis that syntax processing in mammals occurs at least at the level of the nonprimary auditory cortex.

Short-term plasticity in thalamocortical pathways: cellular mechanisms and functional roles

Information reaches the neocortex through different types of thalamocortical pathways. These differ in many morphological and physiological properties. One interesting aspect in which thalamocortical pathways differ is in their temporal dynamics, such as their short-term plasticity. Primary pathways display frequency-dependent depression, while secondary pathways display frequency-dependent enhancement. The cellular mechanisms underlying these dynamic responses involve pre- and post-synaptic and circuit properties. They may serve to synchronize, amplify and/or filter neural activity in neocortex depending on behavioral demands, and thus to adapt each pathway to its specific function.

Time course of forward masking tuning curves in cat primary auditory cortex

Nonsimultaneous two-tone interactions were studied in the primary auditory cortex of anesthetized cats. Poststimulatory effects of pure tone bursts (masker) on the evoked activity of a fixed tone burst (probe) were investigated. The temporal interval from masker onset to probe onset (stimulus onset asynchrony), masker frequency, and intensity were parametrically varied. For all of the 53 single units and 58 multiple-unit clusters, the neural activity of the probe signal was either inhibited, facilitated, and/or delayed by a limited set of masker stimuli. The stimulus range from which forward inhibition of the probe was induced typically was centered at and had approximately the size of the neuron's excitatory receptive field. This "masking tuning curve" was usually V shaped, i.e., the frequency range of inhibiting masker stimuli increased with the masker intensity. Forward inhibition was induced at the shortest stimulus onset asynchrony between masker and probe. With longer stimulus onset asynchronies, the frequency range of inhibiting maskers gradually became smaller. Recovery from forward inhibition occurred first at the lower- and higher-frequency borders of the masking tuning curve and lasted the longest for frequencies close to the neuron's characteristic frequency. The maximal duration of forward inhibition was measured as the longest period over which reduction of probe responses was observed. It was in the range of 53-430 ms, with an average of 143 +/- 71 (SD) ms. Amount, duration and type of forward inhibition were weakly but significantly correlated with "static" neural receptive field properties like characteristic frequency, bandwidth, and latency. For the majority of neurons, the minimal inhibitory masker intensity increased when the stimulus onset asynchrony became longer. In most cases the highest masker intensities induced the longest forward inhibition. A significant number of neurons, however, exhibited longest periods of inhibition after maskers of intermediate intensity. The results show that the ability of cortical cells to respond with an excitatory activity depends on the temporal stimulus context. Neurons can follow higher repetition rates of stimulus sequences when successive stimuli differ in their spectral content. The differential sensitivity to temporal sound sequences within the receptive field of cortical cells as well as across different cells could contribute to the neural processing of temporally structured stimuli like speech and animal vocalizations.