Comparison between offset and onset responses of primary auditory cortex ON-OFF neurons in awake cats

A general model unifying the adaptive, transient and sustained properties of ON and OFF auditory neural responses

Sounds are temporal stimuli decomposed into numerous elementary components by the auditory nervous system. For instance, a temporal to spectro-temporal transformation modelling the frequency decomposition performed by the cochlea is a widely adopted first processing step in today's computational models of auditory neural responses. Similarly, increments and decrements in sound intensity (i.e., of the raw waveform itself or of its spectral bands) constitute critical features of the neural code, with high behavioural significance. However, despite the growing attention of the scientific community on auditory OFF responses, their relationship with transient ON, sustained responses and adaptation remains unclear. In this context, we propose a new general model, based on a pair of linear filters, named AdapTrans, that captures both sustained and transient ON and OFF responses into a unifying and easy to expand framework. We demonstrate that filtering audio cochleagrams with AdapTrans permits to accurately render known properties of neural responses measured in different mammal species such as the dependence of OFF responses on the stimulus fall time and on the preceding sound duration. Furthermore, by integrating our framework into gold standard and state-of-the-art machine learning models that predict neural responses from audio stimuli, following a supervised training on a large compilation of electrophysiology datasets (ready-to-deploy PyTorch models and pre-processed datasets shared publicly), we show that AdapTrans systematically improves the prediction accuracy of estimated responses within different cortical areas of the rat and ferret auditory brain. Together, these results motivate the use of our framework for computational and systems neuroscientists willing to increase the plausibility and performances of their models of audition.

Extensive representation of sensory deviance in the responses to auditory gaps in unanesthetized rats

Unexpected changes in incoming sensory streams are associated with large errors in predicting the deviant stimulus relative to a memory trace of past stimuli. Mismatch negativity (MMN) in human studies and the release from stimulus-specific adaptation (SSA) in animal models correlate with prediction errors and deviance detection.¹ In human studies, violation of expectations elicited by an unexpected stimulus omission resulted in an omission MMN.^2,3,4,5 These responses are evoked after the expected occurrence time of the omitted stimulus, implying that they reflect the violation of a temporal expectancy.⁶ Because they are often time locked to the end of the omitted stimulus,^4,6,7 they resemble off responses. Indeed, suppression of cortical activity after the termination of the gap disrupts gap detection, suggesting an essential role for offset responses.⁸ Here, we demonstrate that brief gaps in short noise bursts in the auditory cortex of unanesthetized rats frequently evoke offset responses. Importantly, we show that omission responses are elicited when these gaps are expected but are omitted. These omission responses, together with the release from SSA of both onset and offset responses to rare gaps, form a rich and varied representation of prediction-related signals in the auditory cortex of unanesthetized rats, extending substantially and refining the representations described previously in anesthetized rats.

More than the end: OFF response plasticity as a mnemonic signature of a sound’s behavioral salience

In studying how neural populations in sensory cortex code dynamically varying stimuli to guide behavior, the role of spiking after stimuli have ended has been underappreciated. This is despite growing evidence that such activity can be tuned, experience-and context-dependent and necessary for sensory decisions that play out on a slower timescale. Here we review recent studies, focusing on the auditory modality, demonstrating that this so-called OFF activity can have a more complex temporal structure than the purely phasic firing that has often been interpreted as just marking the end of stimuli. While diverse and still incompletely understood mechanisms are likely involved in generating phasic and tonic OFF firing, more studies point to the continuing post-stimulus activity serving a short-term, stimulus-specific mnemonic function that is enhanced when the stimuli are particularly salient. We summarize these results with a conceptual model highlighting how more neurons within the auditory cortical population fire for longer duration after a sound’s termination during an active behavior and can continue to do so even while passively listening to behaviorally salient stimuli. Overall, these studies increasingly suggest that tonic auditory cortical OFF activity holds an echoic memory of specific, salient sounds to guide behavioral decisions.

Cerebellar modulation of memory encoding in the periaqueductal grey and fear behaviour

The pivotal role of the periaqueductal grey (PAG) in fear learning is reinforced by the identification of neurons in male rat ventrolateral PAG (vlPAG) that encode fear memory through signalling the onset and offset of an auditory-conditioned stimulus during presentation of the unreinforced conditioned tone (CS+) during retrieval. Some units only display CS+ onset or offset responses, and the two signals differ in extinction sensitivity, suggesting that they are independent of each other. In addition, understanding cerebellar contributions to survival circuits is advanced by the discovery that (i) reversible inactivation of the medial cerebellar nucleus (MCN) during fear consolidation leads in subsequent retrieval to (a) disruption of the temporal precision of vlPAG offset, but not onset responses to CS+, and (b) an increase in duration of freezing behaviour. And (ii) chemogenetic manipulation of the MCN-vlPAG projection during fear acquisition (a) reduces the occurrence of fear-related ultrasonic vocalisations, and (b) during subsequent retrieval, slows the extinction rate of fear-related freezing. These findings show that the cerebellum is part of the survival network that regulates fear memory processes at multiple timescales and in multiple ways, raising the possibility that dysfunctional interactions in the cerebellar-survival network may underlie fear-related disorders and comorbidities.

Anxiety disorders are a cluster of mental health conditions characterised by persistent and excessive amounts of fear and worry. They affect millions of people worldwide, but treatments can sometimes be ineffective and have unwanted side effects. Understanding which brain regions are involved in fear and anxiety-related behaviours, and how those areas are connected, is the first step towards designing more effective treatments.

A region known as the periaqueductal grey (or PAG) sits at the centre of the brain’s fear and anxiety network, regulating pain, encoding fear memories and responding to threats and stressors. It also controls survival behaviours such as the ‘freeze’ response, when an animal is frightened.

A more recent addition to the fear and anxiety network is the cerebellum, which sits at the base of the brain. Two-way connections between this region and the PAG have been well described, but how the cerebellum might influence fear and anxiety-related behaviours remains unclear.

To explore this role, Lawrenson, Paci et al. investigated whether the cerebellum modulates brain activity within the PAG and if so, how this relates to fear behaviours. Rats had electrodes implanted in their brains to record the activity of nerve cells within the PAG. A common fear-conditioning task was then used to elicit ‘freeze’ responses: a sound was paired with mild foot shocks until the animals learned to fear the auditory signal. In the rats, a subset of neurons within the PAG responded to the tone, consistent with those cells encoding a fear memory. But when a drug blocked the cerebellum’s output during fear conditioning, the timing of the PAG response was less precise and the rats’ freeze response lasted longer.

Lawrenson, Paci et al. concluded that the cerebellum, through its interactions with the brain’s fear and anxiety network, might be responsible for coordinating the most appropriate behavioural response to fear, and how long ‘freezing’ lasts.

In summary, these findings show that the cerebellum is a part of the brain’s survival network which regulates fear-memory processes. It raises the possibility that disruption of the cerebellum might underlie anxiety and other fear-related disorders, thereby providing a new target for future therapies.

Emergence and function of cortical offset responses in sound termination detection

Offset responses in auditory processing appear after a sound terminates. They arise in neuronal circuits within the peripheral auditory system, but their role in the central auditory system remains unknown. Here, we ask what the behavioral relevance of cortical offset responses is and what circuit mechanisms drive them. At the perceptual level, our results reveal that experimentally minimizing auditory cortical offset responses decreases the mouse performance to detect sound termination, assigning a behavioral role to offset responses. By combining in vivo electrophysiology in the auditory cortex and thalamus of awake mice, we also demonstrate that cortical offset responses are not only inherited from the periphery but also amplified and generated de novo. Finally, we show that offset responses code more than silence, including relevant changes in sound trajectories. Together, our results reveal the importance of cortical offset responses in encoding sound termination and detecting changes within temporally discontinuous sounds crucial for speech and vocalization.

Encoding of acquired sound-sequence salience by auditory cortical offset responses

Behaviorally relevant sounds are often composed of distinct acoustic units organized into specific temporal sequences. The meaning of such sound sequences can therefore be fully recognized only when they have terminated. However, the neural mechanisms underlying the perception of sound sequences remain unclear. Here, we use two-photon calcium imaging in the auditory cortex of behaving mice to test the hypothesis that neural responses to termination of sound sequences ("Off-responses") encode their acoustic history and behavioral salience. We find that auditory cortical Off-responses encode preceding sound sequences and that learning to associate a sound sequence with a reward induces enhancement of Off-responses relative to responses during the sound sequence ("On-responses"). Furthermore, learning enhances network-level discriminability of sound sequences by Off-responses. Last, learning-induced plasticity of Off-responses but not On-responses lasts to the next day. These findings identify auditory cortical Off-responses as a key neural signature of acquired sound-sequence salience.

Individual bitter-sensing neurons in Drosophila exhibit both ON and OFF responses that influence synaptic plasticity

The brain generates internal representations that translate sensory stimuli into appropriate behavior. In the taste system, different tastes activate distinct populations of sensory neurons. We investigated the temporal properties of taste responses in Drosophila and discovered that different types of taste sensory neurons show striking differences in their response dynamics. Strong responses to stimulus onset (ON responses) and offset (OFF responses) were observed in bitter-sensing neurons in the labellum, whereas bitter neurons in the leg and other classes of labellar taste neurons showed only an ON response. Individual labellar bitter neurons generate both ON and OFF responses through a cell-intrinsic mechanism that requires canonical bitter receptors. A single receptor complex likely generates both ON and OFF responses to a given bitter ligand. These ON and OFF responses in the periphery are propagated to dopaminergic neurons that mediate aversive learning, and the presence of the OFF response impacts synaptic plasticity when bitter is used as a reinforcement cue. These studies reveal previously unknown features of taste responses that impact neural circuit function and may be important for behavior. Moreover, these studies show that OFF responses can dramatically influence timing-based synaptic plasticity, which is thought to underlie associative learning.

Contralateral proximal interference

A contralateral "cue" tone presented in continuous broadband noise both lowers the threshold of a signal tone by guiding attention to it and raises its threshold by interference. Here, signal tones were fixed in duration (40 ms, 52 ms with ramps), frequency (1500 Hz), timing, and level, so attention did not need guidance. Interference by contralateral cues was studied in relation to cue-signal proximity, cue-signal temporal overlap, and cue-signal order (cue after: backward interference, BI; or cue first: forward interference, FI). Cues, also ramped, were 12 dB above the signal level. Long cues (300 or 600 ms) raised thresholds by 5.3 dB when the signal and cue overlapped and by 5.1 dB in FI and 3.2 dB in BI when cues and signals were separated by 40 ms. Short cues (40 ms) raised thresholds by 4.5 dB in FI and 4.0 dB in BI for separations of 7 to 40 ms, but by ∼13 dB when simultaneous and in phase. FI and BI are comparable in magnitude and hardly increase when the signal is close in time to abrupt cue transients. These results do not support the notion that masking of the signal is due to the contralateral cue onset/offset transient response. Instead, sluggish attention or temporal integration may explain contralateral proximal interference.

Phasic Off responses of auditory cortex underlie perception of sound duration

It has been proposed that sound information is separately streamed into onset and offset pathways for parallel processing. However, how offset responses contribute to auditory perception remains unclear. Here, loose-patch and whole-cell recordings in awake mouse primary auditory cortex (A1) reveal that a subset of pyramidal neurons exhibit a transient "Off" response, with its onset tightly time-locked to the sound termination and its frequency tuning similar to that of the transient "On" response. Both responses are characterized by excitation briefly followed by inhibition, with the latter mediated by parvalbumin (PV) inhibitory neurons. Optogenetically manipulating sound-evoked A1 responses at different temporal phases or artificially creating phantom sounds in A1 further reveals that the A1 phasic On and Off responses are critical for perceptual discrimination of sound duration. Our results suggest that perception of sound duration is dependent on precisely encoding its onset and offset timings by phasic On and Off responses.

Network dynamics underlying OFF responses in the auditory cortex

Across sensory systems, complex spatio-temporal patterns of neural activity arise following the onset (ON) and offset (OFF) of stimuli. While ON responses have been widely studied, the mechanisms generating OFF responses in cortical areas have so far not been fully elucidated. We examine here the hypothesis that OFF responses are single-cell signatures of recurrent interactions at the network level. To test this hypothesis, we performed population analyses of two-photon calcium recordings in the auditory cortex of awake mice listening to auditory stimuli, and compared them to linear single-cell and network models. While the single-cell model explained some prominent features of the data, it could not capture the structure across stimuli and trials. In contrast, the network model accounted for the low-dimensional organization of population responses and their global structure across stimuli, where distinct stimuli activated mostly orthogonal dimensions in the neural state-space.

Post-stimulatory activity in primate auditory cortex evoked by sensory stimulation during passive listening

Under certain circumstances, cortical neurons are capable of elevating their firing for long durations in the absence of a stimulus. Such activity has typically been observed and interpreted in the context of performance of a behavioural task. Here we investigated whether post-stimulatory activity is observed in auditory cortex and the medial geniculate body of the thalamus in the absence of any explicit behavioural task. We recorded spiking activity from single units in the auditory cortex (fields A1, R and RT) and auditory thalamus of awake, passively-listening marmosets. We observed post-stimulatory activity that lasted for hundreds of milliseconds following the termination of the acoustic stimulus. Post-stimulatory activity was observed following both adapting, sustained and suppressed response profiles during the stimulus. These response types were observed across all cortical fields tested, but were largely absent from the auditory thalamus. As well as being of shorter duration, thalamic post-stimulatory activity emerged following a longer latency than in cortex, indicating that post-stimulatory activity may be generated within auditory cortex during passive listening. Given that these responses were observed in the absence of an explicit behavioural task, post-stimulatory activity in sensory cortex may play a functional role in processes such as echoic memory and temporal integration that occur during passive listening.

Late fMRI Response Components Are Altered in Autism Spectrum Disorder

Disrupted cortical neural inhibition has been hypothesized to be a primary contributor to the pathophysiology of autism spectrum disorder (ASD). This hypothesis predicts that ASD will be associated with an increase in neural responses. We tested this prediction by comparing fMRI response magnitudes to simultaneous visual, auditory, and motor stimulation in ASD and neurotypical (NT) individuals. No increases in the initial transient response in any brain region were observed in ASD, suggesting that there is no increase in overall cortical neural excitability. Most notably, there were widespread fMRI magnitude increases in the ASD response following stimulation offset, approximately 6–8 s after the termination of sensory and motor stimulation. In some regions, the higher fMRI offset response in ASD could be attributed to a lack of an “undershoot”—an often observed feature of fMRI responses believed to reflect inhibitory processing. Offset response magnitude was associated with reaction times (RT) in the NT group and may explain an overall reduced RT in the ASD group. Overall, our results suggest that increases in neural responsiveness are present in ASD but are confined to specific components of the neural response, are particularly strong following stimulation offset, and are linked to differences in RT.

Parallel Processing of Sound Dynamics across Mouse Auditory Cortex via Spatially Patterned Thalamic Inputs and Distinct Areal Intracortical Circuits

Natural sounds have rich spectrotemporal dynamics. Spectral information is spatially represented in the auditory cortex (ACX) via large-scale maps. However, the representation of temporal information, e.g., sound offset, is unclear. We perform multiscale imaging of neuronal and thalamic activity evoked by sound onset and offset in awake mouse ACX. ACX areas differed in onset responses (On-Rs) and offset responses (Off-Rs). Most excitatory L2/3 neurons show either On-Rs or Off-Rs, and ACX areas are characterized by differing fractions of On and Off-R neurons. Somatostatin and parvalbumin interneurons show distinct temporal dynamics, potentially amplifying Off-Rs. Functional network analysis shows that ACX areas contain distinct parallel onset and offset networks. Thalamic (MGB) terminals show either On-Rs or Off-Rs, indicating a thalamic origin of On and Off-R pathways. Thus, ACX areas spatially represent temporal features, and this representation is created by spatial convergence and co-activation of distinct MGB inputs and is refined by specific intracortical connectivity.

Experience-Dependent Coding of Time-Dependent Frequency Trajectories by Off Responses in Secondary Auditory Cortex

Time-dependent frequency trajectories are an inherent feature of many behaviorally relevant sounds, such as species-specific vocalizations. Dynamic frequency trajectories, even in short sounds, often convey meaningful information, which may be used to differentiate sound categories. However, it is not clear what and where neural responses in the auditory cortical pathway are critical for conveying information about behaviorally relevant frequency trajectories, and how these responses change with experience. Here, we uncover tuning to subtle variations in frequency trajectories in auditory cortex of female mice. We found that auditory cortical responses could be modulated by variations in a pure tone trajectory as small as 1/24th of an octave, comparable to what has been reported in primates. In particular, late spiking after the end of a sound stimulus was more often sensitive to the sound's subtle frequency variation compared with spiking during the sound. Such “Off” responses in the adult A2, but not those in core auditory cortex, were plastic in a way that may enhance the representation of a newly acquired, behaviorally relevant sound category. We illustrate this with the maternal mouse paradigm for natural vocalization learning. By using an ethologically inspired paradigm to drive auditory responses in higher-order neurons, our results demonstrate that mouse auditory cortex can track fine frequency changes, which allows A2 Off responses in particular to better respond to pitch trajectories that distinguish behaviorally relevant, natural sound categories.

SIGNIFICANCE STATEMENT A whistle's pitch conveys meaning to its listener, as when dogs learn that distinct pitch trajectories whistled by their owner differentiate specific commands. Many species use pitch trajectories in their own vocalizations to distinguish sound categories, such as in human languages, such as Mandarin. How and where auditory neural activity encodes these pitch trajectories as their meaning is learned but not well understood, especially for short-duration sounds. We studied this in mice, where infants use ultrasonic whistles to communicate to adults. We found that late neural firing after a sound ends can be tuned to how the pitch changes in time, and that this response in a secondary auditory cortical field changes with experience to acquire a pitch change's meaning.

A Cortico-Collicular Amplification Mechanism for Gap Detection

Auditory cortex (AC) is necessary for the detection of brief gaps in ongoing sounds, but not for the detection of longer gaps or other stimuli such as tones or noise. It remains unclear why this is so, and what is special about brief gaps in particular. Here, we used both optogenetic suppression and conventional lesions to show that the cortical dependence of brief gap detection hinges specifically on gap termination. We then identified a cortico-collicular gap detection circuit that amplifies cortical gap termination responses before projecting to inferior colliculus (IC) to impact behavior. We found that gaps evoked off-responses and on-responses in cortical neurons, which temporally overlapped for brief gaps, but not long gaps. This overlap specifically enhanced cortical responses to brief gaps, whereas IC neurons preferred longer gaps. Optogenetic suppression of AC reduced collicular responses specifically to brief gaps, indicating that under normal conditions, the enhanced cortical representation of brief gaps amplifies collicular gap responses. Together these mechanisms explain how and why AC contributes to the behavioral detection of brief gaps, which are critical cues for speech perception, perceptual grouping, and auditory scene analysis.

Using Neural Circuit Interrogation in Rodents to Unravel Human Speech Decoding

The neural circuits responsible for social communication are among the least understood in the brain. Human studies have made great progress in advancing our understanding of the global computations required for processing speech, and animal models offer the opportunity to discover evolutionarily conserved mechanisms for decoding these signals. In this review article, we describe some of the most well-established speech decoding computations from human studies and describe animal research designed to reveal potential circuit mechanisms underlying these processes. Human and animal brains must perform the challenging tasks of rapidly recognizing, categorizing, and assigning communicative importance to sounds in a noisy environment. The instructions to these functions are found in the precise connections neurons make with one another. Therefore, identifying circuit-motifs in the auditory cortices and linking them to communicative functions is pivotal. We review recent advances in human recordings that have revealed the most basic unit of speech decoded by neurons is a phoneme, and consider circuit-mapping studies in rodents that have shown potential connectivity schemes to achieve this. Finally, we discuss other potentially important processing features in humans like lateralization, sensitivity to fine temporal features, and hierarchical processing. The goal is for animal studies to investigate neurophysiological and anatomical pathways responsible for establishing behavioral phenotypes that are shared between humans and animals. This can be accomplished by establishing cell types, connectivity patterns, genetic pathways and critical periods that are relevant in the development and function of social communication.

Age-related changes in sound onset and offset intensity coding in auditory cortical fields A1 and CL of rhesus macaques

Inhibition plays a key role in shaping sensory processing in the central auditory system and has been implicated in sculpting receptive field properties such as sound intensity coding and also in shaping temporal patterns of neuronal firing such as onset- or offset-evoked responses. There is substantial evidence supporting a decrease in inhibition throughout the ascending auditory pathway in geriatric animals. We therefore examined intensity coding of onset (ON) and offset (OFF) responses in auditory cortex of aged and young monkeys. A large proportion of cells in the primary auditory cortex (A1) and the caudolateral field (CL) displayed nonmonotonic rate-level functions for OFF responses in addition to nonmonotonic coding of ON responses. Aging differentially affected ON and OFF responses; the magnitude of effects was generally greater for ON responses. In addition to higher firing rates, neurons in old monkeys exhibited a significant increase in the proportion of monotonic rate-level functions and had higher best intensities than those in young monkeys. OFF responses in young monkeys displayed a range of intensity coding relationships with ON responses of the same cells, ranging from highly similar to highly dissimilar. Dissimilarity in ON/OFF coding was greater in CL and was reduced with aging, which was largely explained by a preferential decrease in the percentage of cells with nonmonotonic coding of ON and OFF responses. The changes we observed are consistent with previously demonstrated alterations in inhibition in the ascending auditory pathway of primates and could be involved in age-related deficits in the temporal processing of sounds.NEW & NOTEWORTHY Aging has a major impact on intensity coding of neurons in auditory cortex of rhesus macaques. Neural responses to sound onset and offset were affected to different extents, and their rate-level functions became more mutually similar, which could be accounted for by the loss of nonmonotonic intensity coding in geriatric monkeys. These findings were consistent with weakened inhibition in the central auditory system and could contribute to auditory processing deficits in elderly subjects.

A generic deviance detection principle for cortical On/Off responses, omission response, and mismatch negativity

Neural responses to sudden changes can be observed in many parts of the sensory pathways at different organizational levels. For example, deviants that violate regularity at various levels of abstraction can be observed as simple On/Off responses of individual neurons or as cumulative responses of neural populations. The cortical deviance-related responses supporting different functionalities (e.g., gap detection, chunking, etc.) seem unlikely to arise from different function-specific neural circuits, given the relatively uniform and self-similar wiring patterns across cortical areas and spatial scales. Additionally, reciprocal wiring patterns (with heterogeneous combinations of excitatory and inhibitory connections) in the cortex naturally speak in favor of a generic deviance detection principle. Based on this concept, we propose a network model consisting of reciprocally coupled neural masses as a blueprint of a universal change detector. Simulation examples reproduce properties of cortical deviance-related responses including the On/Off responses, the omitted-stimulus response (OSR), and the mismatch negativity (MMN). We propose that the emergence of change detectors relies on the involvement of disinhibition. An analysis of network connection settings further suggests a supportive effect of synaptic adaptation and a destructive effect of N-methyl-D-aspartate receptor (NMDA-r) antagonists on change detection. We conclude that the nature of cortical reciprocal wiring gives rise to a whole range of local change detectors supporting the notion of a generic deviance detection principle. Several testable predictions are provided based on the network model. Notably, we predict that the NMDA-r antagonists would generally dampen the cortical Off response, the cortical OSR, and the MMN.

Distinct processing of tone offset in two primary auditory cortices

In the rodent auditory system, the primary cortex is subdivided into two regions, both receiving direct inputs from the auditory thalamus: the primary auditory cortex (A1) and the anterior auditory field (AAF). Although neurons in the two regions display different response properties, like response latency, firing threshold or tuning bandwidth, it is still not clear whether they process sound in a distinct way. Using in vivo electrophysiological recordings in the mouse auditory cortex, we found that AAF neurons have significantly stronger responses to tone offset than A1 neurons. AAF neurons also display faster and more transient responses than A1 neurons. Additionally, offset responses in AAF – unlike in A1, increase with sound duration. Local field potential (LFP) and laminar analyses suggest that the differences in sound responses between these two primary cortices are both of subcortical and intracortical origin. These results emphasize the potentially critical role of AAF for temporal processing. Our study reveals a distinct role of two primary auditory cortices in tone processing and highlights the complexity of sound encoding at the cortical level.

ON-OFF receptive fields in auditory cortex diverge during development and contribute to directional sweep selectivity

Neurons in the auditory cortex exhibit distinct frequency tuning to the onset and offset of sounds, but the cause and significance of ON and OFF receptive field (RF) organisation are not understood. Here we demonstrate that distinct ON and OFF frequency tuning is largely absent in immature mouse auditory cortex and is thus a consequence of cortical development. Simulations using a novel implementation of a standard Hebbian plasticity model show that the natural alternation of sound onset and offset is sufficient for the formation of non-overlapping adjacent ON and OFF RFs in cortical neurons. Our model predicts that ON/OFF RF arrangement contributes towards direction selectivity to frequency-modulated tone sweeps, which we confirm by neuronal recordings. These data reveal that a simple and universally accepted learning rule can explain the organisation of ON and OFF RFs and direction selectivity in the developing auditory cortex.

Auditory cortex neurons exhibit distinct frequency tuning to sound onset and offset. Here the authors demonstrate that during development ON-OFF receptive fields diverge to occupy adjacent frequency ranges that may underlie their direction selective responses to frequency modulated sweeps.

Spectral and spatial tuning of onset and offset response functions in auditory cortical fields A1 and CL of rhesus macaques

The mammalian auditory cortex is necessary for spectral and spatial processing of acoustic stimuli. Most physiological studies of single neurons in the auditory cortex have focused on the onset and sustained portions of evoked responses, but there have been far fewer studies on the relationship between onset and offset responses. In the current study, we compared spectral and spatial tuning of onset and offset responses of neurons in primary auditory cortex (A1) and the caudolateral (CL) belt area of awake macaque monkeys. Several different metrics were used to determine the relationship between onset and offset response profiles in both frequency and space domains. In the frequency domain, a substantial proportion of neurons in A1 and CL displayed highly dissimilar best stimuli for onset- and offset-evoked responses, although even for these neurons, there was usually a large overlap in the range of frequencies that elicited onset, and offset responses and distributions of tuning overlap metrics were mostly unimodal. In the spatial domain, the vast majority of neurons displayed very similar best locations for onset- and offset-evoked responses, along with unimodal distributions of all tuning overlap metrics considered. Finally, for both spectral and spatial tuning, a slightly larger fraction of neurons in A1 displayed nonoverlapping onset and offset response profiles, relative to CL, which supports hierarchical differences in the processing of sounds in the two areas. However, these differences are small compared with differences in proportions of simple cells (low overlap) and complex cells (high overlap) in primary and secondary visual areas.NEW & NOTEWORTHY In the current study, we examine the relationship between the tuning of neural responses evoked by the onset and offset of acoustic stimuli in the primary auditory cortex, as well as a higher-order auditory area-the caudolateral belt field-in awake rhesus macaques. In these areas, the relationship between onset and offset response profiles in frequency and space domains formed a continuum, ranging from highly overlapping to highly nonoverlapping.

Auditory cortical field coding long-lasting tonal offsets in mice

Although temporal information processing is important in auditory perception, the mechanisms for coding tonal offsets are unknown. We investigated cortical responses elicited at the offset of tonal stimuli using flavoprotein fluorescence imaging in mice. Off-responses were clearly observed at the offset of tonal stimuli lasting for 7 s, but not after stimuli lasting for 1 s. Off-responses to the short stimuli appeared in a similar cortical region, when conditioning tonal stimuli lasting for 5–20 s preceded the stimuli. MK-801, an inhibitor of NMDA receptors, suppressed the two types of off-responses, suggesting that disinhibition produced by NMDA receptor-dependent synaptic depression might be involved in the off-responses. The peak off-responses were localized in a small region adjacent to the primary auditory cortex, and no frequency-dependent shift of the response peaks was found. Frequency matching of preceding tonal stimuli with short test stimuli was not required for inducing off-responses to short stimuli. Two-photon calcium imaging demonstrated significantly larger neuronal off-responses to stimuli lasting for 7 s in this field, compared with off-responses to stimuli lasting for 1 s. The present results indicate the presence of an auditory cortical field responding to long-lasting tonal offsets, possibly for temporal information processing.

Perceptual Temporal Asymmetry Associated with Distinct ON and OFF Responses to Time-Varying Sounds with Rising versus Falling Intensity: A Magnetoencephalography Study

This magnetoencephalography (MEG) study investigated evoked ON and OFF responses to ramped and damped sounds in normal-hearing human adults. Two pairs of stimuli that differed in spectral complexity were used in a passive listening task; each pair contained identical acoustical properties except for the intensity envelope. Behavioral duration judgment was conducted in separate sessions, which replicated the perceptual bias in favour of the ramped sounds and the effect of spectral complexity on perceived duration asymmetry. MEG results showed similar cortical sites for the ON and OFF responses. There was a dominant ON response with stronger phase-locking factor (PLF) in the alpha (8–14 Hz) and theta (4–8 Hz) bands for the damped sounds. In contrast, the OFF response for sounds with rising intensity was associated with stronger PLF in the gamma band (30–70 Hz). Exploratory correlation analysis showed that the OFF response in the left auditory cortex was a good predictor of the perceived temporal asymmetry for the spectrally simpler pair. The results indicate distinct asymmetry in ON and OFF responses and neural oscillation patterns associated with the dynamic intensity changes, which provides important preliminary data for future studies to examine how the auditory system develops such an asymmetry as a function of age and learning experience and whether the absence of asymmetry or abnormal ON and OFF responses can be taken as a biomarker for certain neurological conditions associated with auditory processing deficits.

Mind the Gap: Two Dissociable Mechanisms of Temporal Processing in the Auditory System

High temporal acuity of auditory processing underlies perception of speech and other rapidly varying sounds. A common measure of auditory temporal acuity in humans is the threshold for detection of brief gaps in noise. Gap-detection deficits, observed in developmental disorders, are considered evidence for "sluggish" auditory processing. Here we show, in a mouse model of gap-detection deficits, that auditory brain sensitivity to brief gaps in noise can be impaired even without a general loss of central auditory temporal acuity. Extracellular recordings in three different subdivisions of the auditory thalamus in anesthetized mice revealed a stimulus-specific, subdivision-specific deficit in thalamic sensitivity to brief gaps in noise in experimental animals relative to controls. Neural responses to brief gaps in noise were reduced, but responses to other rapidly changing stimuli unaffected, in lemniscal and nonlemniscal (but not polysensory) subdivisions of the medial geniculate body. Through experiments and modeling, we demonstrate that the observed deficits in thalamic sensitivity to brief gaps in noise arise from reduced neural population activity following noise offsets, but not onsets. These results reveal dissociable sound-onset-sensitive and sound-offset-sensitive channels underlying auditory temporal processing, and suggest that gap-detection deficits can arise from specific impairment of the sound-offset-sensitive channel.

SIGNIFICANCE STATEMENT

The experimental and modeling results reported here suggest a new hypothesis regarding the mechanisms of temporal processing in the auditory system. Using a mouse model of auditory temporal processing deficits, we demonstrate the existence of specific abnormalities in auditory thalamic activity following sound offsets, but not sound onsets. These results reveal dissociable sound-onset-sensitive and sound-offset-sensitive mechanisms underlying auditory processing of temporally varying sounds. Furthermore, the findings suggest that auditory temporal processing deficits, such as impairments in gap-in-noise detection, could arise from reduced brain sensitivity to sound offsets alone.

Neural dynamics of change detection in crowded acoustic scenes

Two key questions concerning change detection in crowded acoustic environments are the extent to which cortical processing is specialized for different forms of acoustic change and when in the time-course of cortical processing neural activity becomes predictive of behavioral outcomes. Here, we address these issues by using magnetoencephalography (MEG) to probe the cortical dynamics of change detection in ongoing acoustic scenes containing as many as ten concurrent sources. Each source was formed of a sequence of tone pips with a unique carrier frequency and temporal modulation pattern, designed to mimic the spectrotemporal structure of natural sounds. Our results show that listeners are more accurate and quicker to detect the appearance (than disappearance) of an auditory source in the ongoing scene. Underpinning this behavioral asymmetry are change-evoked responses differing not only in magnitude and latency, but also in their spatial patterns. We find that even the earliest (~50 ms) cortical response to change is predictive of behavioral outcomes (detection times), consistent with the hypothesized role of local neural transients in supporting change detection.

Local field potential correlates of auditory working memory in primate dorsal temporal pole

Dorsal temporal pole (dTP) is a cortical region at the rostral end of the superior temporal gyrus that forms part of the ventral auditory object processing pathway. Anatomical connections with frontal and medial temporal areas, as well as a recent single-unit recording study, suggest this area may be an important part of the network underlying auditory working memory (WM). To further elucidate the role of dTP in auditory WM, local field potentials (LFPs) were recorded from the left dTP region of two rhesus macaques during an auditory delayed matching-to-sample (DMS) task. Sample and test sounds were separated by a 5-s retention interval, and a behavioral response was required only if the sounds were identical (match trials). Sensitivity of auditory evoked responses in dTP to behavioral significance and context was further tested by passively presenting the sounds used as auditory WM memoranda both before and after the DMS task. Average evoked potentials (AEPs) for all cue types and phases of the experiment comprised two small-amplitude early onset components (N20, P40), followed by two broad, large-amplitude components occupying the remainder of the stimulus period (N120, P300), after which a final set of components were observed following stimulus offset (N80OFF, P170OFF). During the DMS task, the peak amplitude and/or latency of several of these components depended on whether the sound was presented as the sample or test, and whether the test matched the sample. Significant differences were also observed among the DMS task and passive exposure conditions. Comparing memory-related effects in the LFP signal with those obtained in the spiking data raises the possibility some memory-related activity in dTP may be locally produced and actively generated. The results highlight the involvement of dTP in auditory stimulus identification and recognition and its sensitivity to the behavioral significance of sounds in different contexts. This article is part of a Special Issue entitled SI: Auditory working memory.

Syllable Structure Universals and Native Language Interference in Second Language Perception and Production: Positional Asymmetry and Perceptual Links to Accentedness

The present study investigated how syllable structure differences between the first Language (L1) and the second language (L2) affect L2 consonant perception and production at syllable-initial and syllable-final positions. The participants were Mandarin-speaking college students who studied English as a second language. Monosyllabic English words were used in the perception test. Production was recorded from each Chinese subject and rated for accentedness by two native speakers of English. Consistent with previous studies, significant positional asymmetry effects were found across speech sound categories in terms of voicing, place of articulation, and manner of articulation. Furthermore, significant correlations between perception and accentedness ratings were found at the syllable onset position but not for the coda. Many exceptions were also found, which could not be solely accounted for by differences in L1-L2 syllabic structures. The results show a strong effect of language experience at the syllable level, which joins force with acoustic, phonetic, and phonemic properties of individual consonants in influencing positional asymmetry in both domains of L2 segmental perception and production. The complexities and exceptions call for further systematic studies on the interactions between syllable structure universals and native language interference with refined theoretical models to specify the links between perception and production in second language acquisition.

Anesthetic effects of isoflurane on the tonotopic map and neuronal population activity in the rat auditory cortex

Since its discovery nearly four decades ago, sequential microelectrode mapping using hundreds of recording sites has been able to reveal a precise tonotopic organization of the auditory cortex. Despite concerns regarding the effects that anesthesia might have on neuronal responses to tones, anesthesia was essential for these experiments because such dense mapping was elaborate and time-consuming. Here, taking an 'all-at-once' approach, we investigated how isoflurane modifies spatiotemporal activities by using a dense microelectrode array. The array covered the entire auditory cortex in rats, including the core and belt cortices. By comparing neuronal activity in the awake state with activity under isoflurane anesthesia, we made four observations. First, isoflurane anesthesia did not modify the tonotopic topography within the auditory cortex. Second, in terms of general response properties, isoflurane anesthesia decreased the number of active single units and increased their response onset latency. Third, in terms of tuning properties, isoflurane anesthesia shifted the response threshold without changing the shape of the frequency response area and decreased the response quality. Fourth, in terms of population activities, isoflurane anesthesia increased the noise correlations in discharges and phase synchrony in local field potential (LFP) oscillations, suggesting that the anesthesia made neuronal activities redundant at both single-unit and LFP levels. Thus, while isoflurane anesthesia had little effect on the tonotopic topography, its profound effects on neuronal activities decreased the encoding capacity of the auditory cortex.

Diverse cortical codes for scene segmentation in primate auditory cortex

The temporal coherence of amplitude fluctuations is a critical cue for segmentation of complex auditory scenes. The auditory system must accurately demarcate the onsets and offsets of acoustic signals. We explored how and how well the timing of onsets and offsets of gated tones are encoded by auditory cortical neurons in awake rhesus macaques. Temporal features of this representation were isolated by presenting otherwise identical pure tones of differing durations. Cortical response patterns were diverse, including selective encoding of onset and offset transients, tonic firing, and sustained suppression. Spike train classification methods revealed that many neurons robustly encoded tone duration despite substantial diversity in the encoding process. Excellent discrimination performance was achieved by neurons whose responses were primarily phasic at tone offset and by those that responded robustly while the tone persisted. Although diverse cortical response patterns converged on effective duration discrimination, this diversity significantly constrained the utility of decoding models referenced to a spiking pattern averaged across all responses or averaged within the same response category. Using maximum likelihood-based decoding models, we demonstrated that the spike train recorded in a single trial could support direct estimation of stimulus onset and offset. Comparisons between different decoding models established the substantial contribution of bursts of activity at sound onset and offset to demarcating the temporal boundaries of gated tones. Our results indicate that relatively few neurons suffice to provide temporally precise estimates of such auditory "edges," particularly for models that assume and exploit the heterogeneity of neural responses in awake cortex.

Duration estimation entails predicting when

The estimation of duration can be affected by context and surprise. Using MagnetoEncephaloGraphy (MEG), we tested whether increased neural activity during surprise and following neural suppression in two different contexts supported subjective time dilation (Eagleman and Pariyadath, 2009; Pariyadath and Eagleman, 2012). Sequences of three 300 ms frequency-modulated (FM, control) or pure tones (test) were presented and followed by a fourth FM varying in duration. In test, the last FM was perceived as significantly longer than veridical duration (Tse et al., 2004) but did not differ from the perceived duration in control. Several novel and distinct neural signatures were observed in duration estimation: first, neural suppression of standard stimuli was observed for the onset but not for the offset auditory evoked responses. Second, ramping activity increased with veridical duration in control whereas at the same latency in test, the amplitude of the midlatency response increased with the distance of deviant durations. Third, in both conditions, the amplitude of the offset auditory evoked responses accounted well for participants' performance: the longer the perceived duration, the larger the offset response. Fourth, neural duration demarcated by the peak latencies of the onset and ramping evoked activities indexed a systematic time compression that reliably predicted subjective time perception. Our findings suggest that interval timing undergoes time compression by capitalizing on the predicted offset of an auditory event.

Echoic memory: investigation of its temporal resolution by auditory offset cortical responses

Previous studies showed that the amplitude and latency of the auditory offset cortical response depended on the history of the sound, which implicated the involvement of echoic memory in shaping a response. When a brief sound was repeated, the latency of the offset response depended precisely on the frequency of the repeat, indicating that the brain recognized the timing of the offset by using information on the repeat frequency stored in memory. In the present study, we investigated the temporal resolution of sensory storage by measuring auditory offset responses with magnetoencephalography (MEG). The offset of a train of clicks for 1 s elicited a clear magnetic response at approximately 60 ms (Off-P50m). The latency of Off-P50m depended on the inter-stimulus interval (ISI) of the click train, which was the longest at 40 ms (25 Hz) and became shorter with shorter ISIs (2.5∼20 ms). The correlation coefficient r² for the peak latency and ISI was as high as 0.99, which suggested that sensory storage for the stimulation frequency accurately determined the Off-P50m latency. Statistical analysis revealed that the latency of all pairs, except for that between 200 and 400 Hz, was significantly different, indicating the very high temporal resolution of sensory storage at approximately 5 ms.

Quantitative analysis of neuronal response properties in primary and higher-order auditory cortical fields of awake house mice (Mus musculus)

Because of its great genetic potential, the mouse (Mus musculus) has become a popular model species for studies on hearing and sound processing along the auditory pathways. Here, we present the first comparative study on the representation of neuronal response parameters to tones in primary and higher-order auditory cortical fields of awake mice. We quantified 12 neuronal properties of tone processing in order to estimate similarities and differences of function between the fields, and to discuss how far auditory cortex (AC) function in the mouse is comparable to that in awake monkeys and cats. Extracellular recordings were made from 1400 small clusters of neurons from cortical layers III/IV in the primary fields AI (primary auditory field) and AAF (anterior auditory field), and the higher-order fields AII (second auditory field) and DP (dorsoposterior field). Field specificity was shown with regard to spontaneous activity, correlation between spontaneous and evoked activity, tone response latency, sharpness of frequency tuning, temporal response patterns (occurrence of phasic responses, phasic-tonic responses, tonic responses, and off-responses), and degree of variation between the characteristic frequency (CF) and the best frequency (BF) (CF-BF relationship). Field similarities were noted as significant correlations between CFs and BFs, V-shaped frequency tuning curves, similar minimum response thresholds and non-monotonic rate-level functions in approximately two-thirds of the neurons. Comparative and quantitative analyses showed that the measured response characteristics were, to various degrees, susceptible to influences of anesthetics. Therefore, studies of neuronal responses in the awake AC are important in order to establish adequate relationships between neuronal data and auditory perception and acoustic response behavior.

The function of offset neurons in auditory information processing

Offset neurons which respond to the termination of the sound stimulation may play important roles in auditory temporal information processing, sound signal recognition, and complex distinction. Two additional possible mechanisms were reviewed: neural inhibition and the intrinsic conductance property of offset neuron membranes. The underlying offset response was postulated to be located in the superior paraolivary nucleus of mice. The biological significance of the offset neurons was discussed as well.

Response characteristics of primary auditory cortex neurons underlying perceptual asymmetry of ramped and damped sounds

Sound envelope plays a crucial role in perception: ramped sounds (slow attack and quick decay) are louder in strength and longer in subjective duration than damped sounds (quick attack and slow decay) even if they are equal in intensity and physical duration. To explain the asymmetrical perception, the perceptual constancy hypothesis supposes that the listener eliminates the slow decay of damped sounds from the judgment of perception, while the persistence of perception hypothesis supposes asymmetrical neural responses after the source has stopped. To understand neural mechanisms underlying the perceptual asymmetry, we explored response properties of the primary auditory cortex (A1) neurons during ramped and damped stimuli in awake cats. We found two distinct types of cells tuned to specific features of the sound envelope: edge cells sensitive to the temporal edge, such as quick attack and decay, while slope cells sensitive to slow attack and decay. The former needs a short (<2.5 ms) period of stimulus duration for evoking maximal peak responses, while the latter needs a long (20 ms) period, suggesting that the timescale of processing underlies differential sensitivity between the cell types. The findings suggest that perceptual constancy is not yet be executed at A1 because the specific cells distinguishing the direction of amplitude change (attack or decay) are lacking in A1. On the other hand, there is evidence of persistence of perception: overall response duration during ramped sound reached 1.4 times longer than that during damped sound, originating mainly from the response asymmetry of the edge cell (sensitive to the quick decay of ramped sounds but not to the slow decay of damped sounds), and neuronal persistence of excitation after the termination of ramped sounds was substantially longer than that of damped sounds, corresponding to the psychological evidence of persistence of perception.

Sensitivity of offset and onset cortical auditory evoked potentials to signals in noise

OBJECTIVE

The purpose of this study was to determine the effects of SNR and signal level on the offset response of the cortical auditory evoked potential (CAEP). Successful listening often depends on how well the auditory system can extract target signals from competing background noise. Both signal onsets and offsets are encoded neurally and contribute to successful listening in noise. Neural onset responses to signals in noise demonstrate a strong sensitivity to signal-to-noise ratio (SNR) rather than signal level; however, the sensitivity of neural offset responses to these cues is not known.

METHODS

We analyzed the offset response from two previously published datasets for which only the onset response was reported. For both datasets, CAEPs were recorded from young normal-hearing adults in response to a 1000-Hz tone. For the first dataset, tones were presented at seven different signal levels without background noise, while the second dataset varied both signal level and SNR.

RESULTS

Offset responses demonstrated sensitivity to absolute signal level in quiet, SNR, and to absolute signal level in noise.

CONCLUSIONS

Offset sensitivity to signal level when presented in noise contrasts with previously published onset results.

SIGNIFICANCE

This sensitivity suggests a potential clinical measure of cortical encoding of signal level in noise.

Analysis of stimulus-related activity in rat auditory cortex using complex spectral coefficients

The neural mechanisms of sensory responses recorded from the scalp or cortical surface remain controversial. Evoked vs. induced response components (i.e., changes in mean vs. variance) are associated with bottom-up vs. top-down processing, but trial-by-trial response variability can confound this interpretation. Phase reset of ongoing oscillations has also been postulated to contribute to sensory responses. In this article, we present evidence that responses under passive listening conditions are dominated by variable evoked response components. We measured the mean, variance, and phase of complex time-frequency coefficients of epidurally recorded responses to acoustic stimuli in rats. During the stimulus, changes in mean, variance, and phase tended to co-occur. After the stimulus, there was a small, low-frequency offset response in the mean and modest, prolonged desynchronization in the alpha band. Simulations showed that trial-by-trial variability in the mean can account for most of the variance and phase changes observed during the stimulus. This variability was state dependent, with smallest variability during periods of greatest arousal. Our data suggest that cortical responses to auditory stimuli reflect variable inputs to the cortical network. These analyses suggest that caution should be exercised when interpreting variance and phase changes in terms of top-down cortical processing.

Analogues of simple and complex cells in rhesus monkey auditory cortex

Receptive fields (RFs) of neurons in primary visual cortex have traditionally been subdivided into two major classes: "simple" and "complex" cells. Simple cells were originally defined by the existence of segregated subregions within their RF that respond to either the on- or offset of a light bar and by spatial summation within each of these regions, whereas complex cells had ON and OFF regions that were coextensive in space [Hubel DH, et al. (1962) J Physiol 160:106-154]. Although other definitions based on the linearity of response modulation have been proposed later [Movshon JA, et al. (1978) J Physiol 283:53-77; Skottun BC, et al. (1991) Vision Res 31(7-8):1079-1086], the segregation of ON and OFF subregions has remained an important criterion for the distinction between simple and complex cells. Here we report that response profiles of neurons in primary auditory cortex of monkeys show a similar distinction: one group of cells has segregated ON and OFF subregions in frequency space; and another group shows ON and OFF responses within largely overlapping response profiles. This observation is intriguing for two reasons: (i) spectrotemporal dissociation in the auditory domain provides a basic neural mechanism for the segregation of sounds, a fundamental prerequisite for auditory figure-ground discrimination; and (ii) the existence of similar types of RF organization in visual and auditory cortex would support the existence of a common canonical processing algorithm within cortical columns.

Gating of sensory input by spontaneous cortical activity

The activity of neural populations is determined not only by sensory inputs but also by internally generated patterns. During quiet wakefulness, the brain produces spontaneous firing events that can spread over large areas of cortex and have been suggested to underlie processes such as memory recall and consolidation. Here we demonstrate a different role for spontaneous activity in sensory cortex: gating of sensory inputs. We show that population activity in rat auditory cortex is composed of transient 50-100 ms packets of spiking activity that occur irregularly during silence and sustained tone stimuli, but reliably at tone onset. Population activity within these packets had broadly consistent spatiotemporal structure, but the rate and also precise relative timing of action potentials varied between stimuli. Packet frequency varied with cortical state, with desynchronized state activity consistent with superposition of multiple overlapping packets. We suggest that such packets reflect the sporadic opening of a "gate" that allows auditory cortex to broadcast a representation of external sounds to other brain regions.

Comparison of neural responses to cat meows and human vowels in the anterior and posterior auditory field of awake cats

For humans and animals, the ability to discriminate speech and conspecific vocalizations is an important physiological assignment of the auditory system. To reveal the underlying neural mechanism, many electrophysiological studies have investigated the neural responses of the auditory cortex to conspecific vocalizations in monkeys. The data suggest that vocalizations may be hierarchically processed along an anterior/ventral stream from the primary auditory cortex (A1) to the ventral prefrontal cortex. To date, the organization of vocalization processing has not been well investigated in the auditory cortex of other mammals. In this study, we examined the spike activities of single neurons in two early auditory cortical regions with different anteroposterior locations: anterior auditory field (AAF) and posterior auditory field (PAF) in awake cats, as the animals were passively listening to forward and backward conspecific calls (meows) and human vowels. We found that the neural response patterns in PAF were more complex and had longer latency than those in AAF. The selectivity for different vocalizations based on the mean firing rate was low in both AAF and PAF, and not significantly different between them; however, more vocalization information was transmitted when the temporal response profiles were considered, and the maximum transmitted information by PAF neurons was higher than that by AAF neurons. Discrimination accuracy based on the activities of an ensemble of PAF neurons was also better than that of AAF neurons. Our results suggest that AAF and PAF are similar with regard to which vocalizations they represent but differ in the way they represent these vocalizations, and there may be a complex processing stream between them.

Detection of appearing and disappearing objects in complex acoustic scenes

The ability to detect sudden changes in the environment is critical for survival. Hearing is hypothesized to play a major role in this process by serving as an "early warning device," rapidly directing attention to new events. Here, we investigate listeners' sensitivity to changes in complex acoustic scenes-what makes certain events "pop-out" and grab attention while others remain unnoticed? We use artificial "scenes" populated by multiple pure-tone components, each with a unique frequency and amplitude modulation rate. Importantly, these scenes lack semantic attributes, which may have confounded previous studies, thus allowing us to probe low-level processes involved in auditory change perception. Our results reveal a striking difference between "appear" and "disappear" events. Listeners are remarkably tuned to object appearance: change detection and identification performance are at ceiling; response times are short, with little effect of scene-size, suggesting a pop-out process. In contrast, listeners have difficulty detecting disappearing objects, even in small scenes: performance rapidly deteriorates with growing scene-size; response times are slow, and even when change is detected, the changed component is rarely successfully identified. We also measured change detection performance when a noise or silent gap was inserted at the time of change or when the scene was interrupted by a distractor that occurred at the time of change but did not mask any scene elements. Gaps adversely affected the processing of item appearance but not disappearance. However, distractors reduced both appearance and disappearance detection. Together, our results suggest a role for neural adaptation and sensitivity to transients in the process of auditory change detection, similar to what has been demonstrated for visual change detection. Importantly, listeners consistently performed better for item addition (relative to deletion) across all scene interruptions used, suggesting a robust perceptual representation of item appearance.

Inferring the role of inhibition in auditory processing of complex natural stimuli

Intracellular studies have revealed the importance of cotuned excitatory and inhibitory inputs to neurons in auditory cortex, but typical spectrotemporal receptive field models of neuronal processing cannot account for this overlapping tuning. Here, we apply a new nonlinear modeling framework to extracellular data recorded from primary auditory cortex (A1) that enables us to explore how the interplay of excitation and inhibition contributes to the processing of complex natural sounds. The resulting description produces more accurate predictions of observed spike trains than the linear spectrotemporal model, and the properties of excitation and inhibition inferred by the model are furthermore consistent with previous intracellular observations. It can also describe several nonlinear properties of A1 that are not captured by linear models, including intensity tuning and selectivity to sound onsets and offsets. These results thus offer a broader picture of the computational role of excitation and inhibition in A1 and support the hypothesis that their interactions play an important role in the processing of natural auditory stimuli.

Multiplexed and robust representations of sound features in auditory cortex

We can recognize the melody of a familiar song when it is played on different musical instruments. Similarly, an animal must be able to recognize a warning call whether the caller has a high-pitched female or a lower-pitched male voice, and whether they are sitting in a tree to the left or right. This type of perceptual invariance to "nuisance" parameters comes easily to listeners, but it is unknown whether or how such robust representations of sounds are formed at the level of sensory cortex. In this study, we investigate whether neurons in both core and belt areas of ferret auditory cortex can robustly represent the pitch, formant frequencies, or azimuthal location of artificial vowel sounds while the other two attributes vary. We found that the spike rates of the majority of cortical neurons that are driven by artificial vowels carry robust representations of these features, but the most informative temporal response windows differ from neuron to neuron and across five auditory cortical fields. Furthermore, individual neurons can represent multiple features of sounds unambiguously by independently modulating their spike rates within distinct time windows. Such multiplexing may be critical to identifying sounds that vary along more than one perceptual dimension. Finally, we observed that formant information is encoded in cortex earlier than pitch information, and we show that this time course matches ferrets' behavioral reaction time differences on a change detection task.

Unanesthetized auditory cortex exhibits multiple codes for gaps in cochlear implant pulse trains

Cochlear implant listeners receive auditory stimulation through amplitude-modulated electric pulse trains. Auditory nerve studies in animals demonstrate qualitatively different patterns of firing elicited by low versus high pulse rates, suggesting that stimulus pulse rate might influence the transmission of temporal information through the auditory pathway. We tested in awake guinea pigs the temporal acuity of auditory cortical neurons for gaps in cochlear implant pulse trains. Consistent with results using anesthetized conditions, temporal acuity improved with increasing pulse rates. Unlike the anesthetized condition, however, cortical neurons responded in the awake state to multiple distinct features of the gap-containing pulse trains, with the dominant features varying with stimulus pulse rate. Responses to the onset of the trailing pulse train (Trail-ON) provided the most sensitive gap detection at 1,017 and 4,069 pulse-per-second (pps) rates, particularly for short (25 ms) leading pulse trains. In contrast, under conditions of 254 pps rate and long (200 ms) leading pulse trains, a sizeable fraction of units demonstrated greater temporal acuity in the form of robust responses to the offsets of the leading pulse train (Lead-OFF). Finally, TONIC responses exhibited decrements in firing rate during gaps, but were rarely the most sensitive feature. Unlike results from anesthetized conditions, temporal acuity of the most sensitive units was nearly as sharp for brief as for long leading bursts. The differences in stimulus coding across pulse rates likely originate from pulse rate-dependent variations in adaptation in the auditory nerve. Two marked differences from responses to acoustic stimulation were: first, Trail-ON responses to 4,069 pps trains encoded substantially shorter gaps than have been observed with acoustic stimuli; and second, the Lead-OFF gap coding seen for <15 ms gaps in 254 pps stimuli is not seen in responses to sounds. The current results may help to explain why moderate pulse rates around 1,000 pps are favored by many cochlear implant listeners.