Top-down gain control of the auditory space map by gaze control circuitry in the barn owl

Common and distinct neural mechanisms of attention

Despite a constant deluge of sensory stimulation, only a fraction of it is used to guide behavior. This selective processing is generally referred to as attention, and much research has focused on the neural mechanisms controlling it. Recently, research has broadened to include more ways by which different species selectively process sensory information, whether due to the sensory input itself or to different behavioral and brain states. This work has produced a complex and disjointed body of evidence across different species and forms of attention. However, it has also provided opportunities to better understand the breadth of attentional mechanisms. Here, we summarize the evidence that suggests that different forms of selective processing are supported by mechanisms both common and distinct.

Auditory Competition and Coding of Relative Stimulus Strength across Midbrain Space Maps of Barn Owls

The natural environment challenges the brain to prioritize the processing of salient stimuli. The barn owl, a sound localization specialist, exhibits a circuit called the midbrain stimulus selection network, dedicated to representing locations of the most salient stimulus in circumstances of concurrent stimuli. Previous competition studies using unimodal (visual) and bimodal (visual and auditory) stimuli have shown that relative strength is encoded in spike response rates. However, open questions remain concerning auditory-auditory competition on coding. To this end, we present diverse auditory competitors (concurrent flat noise and amplitude-modulated noise) and record neural responses of awake barn owls of both sexes in subsequent midbrain space maps, the external nucleus of the inferior colliculus (ICx) and optic tectum (OT). While both ICx and OT exhibit a topographic map of auditory space, OT also integrates visual input and is part of the global-inhibitory midbrain stimulus selection network. Through comparative investigation of these regions, we show that while increasing strength of a competitor sound decreases spike response rates of spatially distant neurons in both regions, relative strength determines spike train synchrony of nearby units only in the OT. Furthermore, changes in synchrony by sound competition in the OT are correlated to gamma range oscillations of local field potentials associated with input from the midbrain stimulus selection network. The results of this investigation suggest that modulations in spiking synchrony between units by gamma oscillations are an emergent coding scheme representing relative strength of concurrent stimuli, which may have relevant implications for downstream readout.

Single trial Bayesian inference by population vector readout in the barn owl's sound localization system

Bayesian models have proven effective in characterizing perception, behavior, and neural encoding across diverse species and systems. The neural implementation of Bayesian inference in the barn owl's sound localization system and behavior has been previously explained by a non-uniform population code model. This model specifies the neural population activity pattern required for a population vector readout to match the optimal Bayesian estimate. While prior analyses focused on trial-averaged comparisons of model predictions with behavior and single-neuron responses, it remains unknown whether this model can accurately approximate Bayesian inference on single trials under varying sensory reliability, a fundamental condition for natural perception and behavior. In this study, we utilized mathematical analysis and simulations to demonstrate that decoding a non-uniform population code via a population vector readout approximates the Bayesian estimate on single trials for varying sensory reliabilities. Our findings provide additional support for the non-uniform population code model as a viable explanation for the barn owl's sound localization pathway and behavior.

Eye movements track prioritized auditory features in selective attention to natural speech

Over the last decades, cognitive neuroscience has identified a distributed set of brain regions that are critical for attention. Strong anatomical overlap with brain regions critical for oculomotor processes suggests a joint network for attention and eye movements. However, the role of this shared network in complex, naturalistic environments remains understudied. Here, we investigated eye movements in relation to (un)attended sentences of natural speech. Combining simultaneously recorded eye tracking and magnetoencephalographic data with temporal response functions, we show that gaze tracks attended speech, a phenomenon we termed ocular speech tracking. Ocular speech tracking even differentiates a target from a distractor in a multi-speaker context and is further related to intelligibility. Moreover, we provide evidence for its contribution to neural differences in speech processing, emphasizing the necessity to consider oculomotor activity in future research and in the interpretation of neural differences in auditory cognition.

Dissociable components of attention exhibit distinct neuronal signatures in primate visual cortex

Attention can be deployed in multiple forms and facilitates behavior by influencing perceptual sensitivity and choice bias. Attention is also associated with a myriad of changes in sensory neural activity. Yet, the relationship between the behavioral components of attention and the accompanying changes in neural activity remains largely unresolved. We examined this relationship by quantifying sensitivity and bias in monkeys performing a task that dissociated eye movement responses from the focus of covert attention. Unexpectedly, bias, not sensitivity, increased at the focus of covert attention, whereas sensitivity increased at the location of planned eye movements. Furthermore, neuronal activity within visual area V4 varied robustly with bias, but not sensitivity, at the focus of covert attention. In contrast, correlated variability between neuronal pairs was lowest at the location of planned eye movements, and varied with sensitivity, but not bias. Thus, dissociable behavioral components of attention exhibit distinct neuronal signatures within the visual cortex.

Saccadic modulation of neural excitability in auditory areas of the neocortex

In natural "active" vision, humans and other primates use eye movements (saccades) to sample bits of information from visual scenes. In the visual cortex, non-retinal signals linked to saccades shift visual cortical neurons into a high excitability state as each saccade ends. The extent of this saccadic modulation outside of the visual system is unknown. Here, we show that during natural viewing, saccades modulate excitability in numerous auditory cortical areas with a temporal pattern complementary to that seen in visual areas. Control somatosensory cortical recordings indicate that the temporal pattern is unique to auditory areas. Bidirectional functional connectivity patterns suggest that these effects may arise from regions involved in saccade generation. We propose that by using saccadic signals to yoke excitability states in auditory areas to those in visual areas, the brain can improve information processing in complex natural settings.

An Effect of Gaze Direction in Cocktail Party Listening

It is well established that gaze direction can influence auditory spatial perception, but the implications of this interaction for performance in complex listening tasks is unclear. In the current study, we investigated whether there is a measurable effect of gaze direction on speech intelligibility in a "cocktail party" listening situation. We presented sequences of digits from five loudspeakers positioned at 0°,  ±  15°, and ± 30° azimuth, and asked participants to repeat back the digits presented from a designated target loudspeaker. In different blocks of trials, the participant visually fixated on a cue presented at the target location or at a nontarget location. Eye position was tracked continuously to monitor compliance. Performance was best when fixation was on-target (vs. off-target) and the size of this effect depended on the specific configuration. This result demonstrates an influence of gaze direction in multitalker mixtures, even in the absence of visual speech information.

Representational Coding of Overt and Covert Orienting of Visuospatial Attention in the Frontoparietal Network

Orienting of visuospatial attention refers to reallocation of attentional focus from one target or location to another and can occur either with (overt) or without (covert) eye movement. Although it has been demonstrated that both types of orienting commonly involve frontal and parietal brain regions as the frontoparietal network (FPN), the underlying representational coding of these two types of orienting remains unclear. In this functional magnetic resonance imaging study, participants performed a task that elicited overt and covert orienting to endogenously or exogenously cued targets with eye-tracking to monitor eye movement. Although the FPN was commonly activated for both overt and covert orienting, multivariate patterns of the activation of voxels in the FPN accurately predicted whether eye movements were involved or not during orienting. These overt- and covert-preferred voxels were topologically distributed as distinct and interlaced clusters in a millimeter scale. Inclusion of the two types of clusters predicted orienting type more accurately than one type of clusters alone. These findings suggest that overt and covert orienting are represented by interdependent functional clusters of neuronal populations in regions of the FPN, which might reflect a generalizable principle in the nervous system for functional organization of closely associated processes.

Recruitment of frontal sensory circuits during visual discrimination

A long-range circuit linking the medial frontal cortex to the primary visual cortex (V1) has been proposed to mediate visual selective attention in mice during visually guided behavior. Here, we use in vivo two-photon functional imaging to measure the endogenous activity of axons of A24b/M2 neurons from this region projecting to layer 1 of V1 (A24b/M2-V1_axons) in mice either passively viewing stimuli or performing a go/no-go visually guided task. We observe that while A24b/M2-V1_axons are recruited under these conditions, this is not linked to enhancement of neural or behavioral measures of sensory coding. Instead, A24b/M2-V1_axon activity is associated with licking behavior, modulated by reward, and biased toward the sensory cortical hemisphere representing the stimulus currently being discriminated.

•

Endogenous A24b/M2-V1 axon activity elevation does not enhance sensory processing

•

A24b/M2-V1 axon activity is correlated with licking

•

A24b/M2-V1 axon lick-correlated activity is modulated by reward

Organizational Conservation and Flexibility in the Evolution of Birdsong and Avian Motor Control

Birds and mammals have independently evolved complex behavioral and cognitive capabilities yet have markedly different brain structures. An open question is to what extent, despite these differences in anatomy, birds and mammals have evolved similar neural solutions to complex motor control and at what level of organization these similarities might lie. Courtship song in songbirds, a learned motor skill that is similar to the fine motor skills of many mammals including human speech, provides a powerful system in which to study the links connecting the development and evolution of cells, circuits, and behavior. Until recently, obtaining cellular-resolution views of the specialized neural circuitry that subserves birdsong was impossible due to a lack of molecular tools for songbirds. However, the ongoing revolution in cellular profiling and genomics offers unprecedented opportunities for molecular analysis in organisms that lack a traditional genetic infrastructure but have tractable, well-defined behaviors. Here, I describe recent efforts to understand the evolutionary relationships between birdsong control circuitry and mammalian neocortical circuitry using new approaches to measure gene expression in single cells. These results, combined with foundational work relating avian and mammalian brains at a range of biological levels, present an emerging view that amniote pallium evolution is a story of diverse neural circuit architectures employing conserved neuronal elements within a conserved topological framework. This view suggests that one locus of pallial neural circuit evolution lies at the intersection between the gene regulatory programs that regulate regional patterning and those that specify functional identity. Modifications to this intersection may underlie the evolution of pallial motor control in birds in general and to the evolutionary and developmental relationships of these circuits to the avian pallial amygdala.

Surround Modulation Properties of Tectal Neurons in Pigeons Characterized by Moving and Flashed Stimuli

Simple Summary

Surround modulation is a basic visual attribute of sensory neurons in many species and has been extensively characterized in mammal primary visual cortex, lateral geniculate nucleus, and superior colliculus. Little attention has been paid to birds, which have a highly developed visual system. We undertook a systematic analysis on surround modulation properties of tectal neurons in pigeons (Columba livia). This study complements existing studies on surrounding modulation properties in non-mammalian species and deepens the understanding of mechanisms of figure–background segmentation performed by avians.

Abstract

Surround modulation has been abundantly studied in several mammalian brain areas, including the primary visual cortex, lateral geniculate nucleus, and superior colliculus (SC), but systematic analysis is lacking in the avian optic tectum (OT, homologous to mammal SC). Here, multi-units were recorded from pigeon (Columba livia) OT, and responses to different sizes of moving, flashed squares, and bars were compared. The statistical results showed that most tectal neurons presented suppressed responses to larger stimuli in both moving and flashed paradigms, and suppression induced by flashed squares was comparable with moving ones when the stimuli center crossed the near classical receptive field (CRF) center, which corresponded to the full surrounding condition. Correspondingly, the suppression grew weaker when the stimuli center moved across the CRF border, equivalent to partially surrounding conditions. Similarly, suppression induced by full surrounding flashed squares was more intense than by partially surrounding flashed bars. These results suggest that inhibitions performed on tectal neurons appear to be full surrounding rather than locally lateral. This study enriches the understanding of surround modulation properties of avian tectum neurons and provides possible hypotheses about the arrangement of inhibitions from other nuclei, both of which are important for clarifying the mechanism of target detection against clutter background performed by avians.

Behavioral and neuronal study of inhibition of return in barn owls

Inhibition of return (IOR) is the reduction of detection speed and/or detection accuracy of a target in a recently attended location. This phenomenon, which has been discovered and studied thoroughly in humans, is believed to reflect a brain mechanism for controlling the allocation of spatial attention in a manner that enhances efficient search. Findings showing that IOR is robust, apparent at a very early age and seemingly dependent on midbrain activity suggest that IOR is a universal attentional mechanism in vertebrates. However, studies in non-mammalian species are scarce. To explore this hypothesis comparatively, we tested for IOR in barn owls (Tyto alba) using the classical Posner cueing paradigm. Two barn owls were trained to initiate a trial by fixating on the center of a computer screen and then turning their gaze to the location of a target. A short, non-informative cue appeared before the target, either at a location predicting the target (valid) or a location not predicting the target (invalid). In one barn owl, the response times (RT) to the valid targets compared to the invalid targets shifted from facilitation (lower RTs) to inhibition (higher RTs) when increasing the time lag between the cue and the target. The second owl mostly failed to maintain fixation and responded to the cue before the target onset. However, when including in the analysis only the trials in which the owl maintained fixation, an inhibition in the valid trials could be detected. To search for the neural correlates of IOR, we recorded multiunit responses in the optic tectum (OT) of four head-fixed owls passively viewing a cueing paradigm as in the behavioral experiments. At short cue to target lags (<100 ms), neural responses to the target in the receptive field (RF) were usually enhanced if the cue appeared earlier inside the RF (valid) and were suppressed if the cue appeared earlier outside the RF (invalid). This was reversed at longer lags: neural responses were suppressed in the valid conditions and were unaffected in the invalid conditions. The findings support the notion that IOR is a basic mechanism in the evolution of vertebrate behavior and suggest that the effect appears as a result of the interaction between lateral and forward inhibition in the tectal circuitry.

Toric Spines at a Site of Learning

We discovered a new type of dendritic spine. It is found on space-specific neurons in the barn owl inferior colliculus, a site of experience-dependent plasticity. Connectomic analysis revealed dendritic protrusions of unusual morphology including topological holes, hence termed "toric" spines (n = 76). More significantly, presynaptic terminals converging onto individual toric spines displayed numerous active zones (up to 49) derived from multiple axons (up to 11) with incoming trajectories distributed widely throughout 3D space. This arrangement is suited to integrate input sources. Dense reconstruction of two toric spines revealed that they were unconnected with the majority (∼84%) of intertwined axons, implying a high capacity for information storage. We developed an ex vivo slice preparation and provide the first published data on space-specific neuron intrinsic properties, including cellular subtypes with and without toric-like spines. We propose that toric spines are a cellular locus of sensory integration and behavioral learning.

More than Just a "Motor": Recent Surprises from the Frontal Cortex

Motor and premotor cortices are crucial for the control of movements. However, we still know little about how these areas contribute to higher-order motor control, such as deciding which movements to make and when to make them. Here we focus on rodent studies and review recent findings, which suggest that-in addition to motor control-neurons in motor cortices play a role in sensory integration, behavioral strategizing, working memory, and decision-making. We suggest that these seemingly disparate functions may subserve an evolutionarily conserved role in sensorimotor cognition and that further study of rodent motor cortices could make a major contribution to our understanding of the evolution and function of the mammalian frontal cortex.

Somatosensory interactions reveal feature-dependent computations

Our ability to perceive and discriminate textures is based on the processing of high-frequency vibrations generated on the fingertip as it scans across a surface. Although much is known about the processing of vibration amplitude and frequency information when cutaneous stimulation is experienced at a single location on the body, how these stimulus features are processed when touch occurs at multiple locations is poorly understood. We evaluated participants’ ability to discriminate tactile cues (100–300 Hz) on one hand while they ignored distractor cues experienced on their other hand. We manipulated the relative positions of the hands to characterize how limb position influenced cutaneous touch interactions. In separate experiments, participants judged either the frequency or intensity of mechanical vibrations. We found that vibrations experienced on one hand always systematically modulated the perception of vibrations on the other hand. Notably, bimanual interaction patterns and their sensitivity to hand locations differed according to stimulus feature. Somatosensory interactions in intensity perception were only marked by attenuation that was invariant to hand position manipulations. In contrast, interactions in frequency perception consisted of both bias and sensitivity changes that were more pronounced when the hands were held in close proximity. We implemented models to infer the neural computations that mediate somatosensory interactions in the intensity and frequency dimensions. Our findings reveal obligatory and feature-dependent somatosensory interactions that may be supported by both feature-specific and feature-general operations.

NEW & NOTEWORTHY Little is known about the neural computations mediating feature-specific sensory interactions between the hands. We show that vibrations experienced on one hand systematically modulate the perception of vibrations felt on the other hand. Critically, interaction patterns and their dependence on the relative positions of the hands differed depending on whether participants judged vibration intensity or frequency. These results, which we recapitulate with models, imply that somatosensory interactions are mediated by feature-dependent neural computations.

Influence of Stimulus Intensity on Multimodal Integration in the Startle Escape System of Goldfish

Processing of multimodal information is essential for an organism to respond to environmental events. However, how multimodal integration in neurons translates into behavior is far from clear. Here, we investigate integration of biologically relevant visual and auditory information in the goldfish startle escape system in which paired Mauthner-cells (M-cells) initiate the behavior. Sound pips and visual looms as well as multimodal combinations of these stimuli were tested for their effectiveness of evoking the startle response. Results showed that adding a low intensity sound early during a visual loom (low visual effectiveness) produced a supralinear increase in startle responsiveness as compared to an increase expected from a linear summation of the two unimodal stimuli. In contrast, adding a sound pip late during the loom (high visual effectiveness) increased responsiveness consistent with a linear multimodal integration of the two stimuli. Together the results confirm the Inverse Effectiveness Principle (IEP) of multimodal integration proposed in other species. Given the well-established role of the M-cell as a multimodal integrator, these results suggest that IEP is computed in individual neurons that initiate vital behavioral decisions.

Auditory spatial attention is encoded in a retinotopic reference frame across eye-movements

The retinal location of visual information changes each time we move our eyes. Although it is now known that visual information is remapped in retinotopic coordinates across eye-movements (saccades), it is currently unclear how head-centered auditory information is remapped across saccades. Keeping track of the location of a sound source in retinotopic coordinates requires a rapid multi-modal reference frame transformation when making saccades. To reveal this reference frame transformation, we designed an experiment where participants attended an auditory or visual cue and executed a saccade. After the saccade had landed, an auditory or visual target could be presented either at the prior retinotopic location or at an uncued location. We observed that both auditory and visual targets presented at prior retinotopic locations were reacted to faster than targets at other locations. In a second experiment, we observed that spatial attention pointers obtained via audition are available in retinotopic coordinates immediately after an eye-movement is made. In a third experiment, we found evidence for an asymmetric cross-modal facilitation of information that is presented at the retinotopic location. In line with prior single cell recording studies, this study provides the first behavioral evidence for immediate auditory and cross-modal transsaccadic updating of spatial attention. These results indicate that our brain has efficient solutions for solving the challenges in localizing sensory input that arise in a dynamic context.

Sensory overamplification in layer 5 auditory corticofugal projection neurons following cochlear nerve synaptic damage

Layer 5 (L5) cortical projection neurons innervate far-ranging brain areas to coordinate integrative sensory processing and adaptive behaviors. Here, we characterize a plasticity in L5 auditory cortex (ACtx) neurons that innervate the inferior colliculus (IC), thalamus, lateral amygdala and striatum. We track daily changes in sound processing using chronic widefield calcium imaging of L5 axon terminals on the dorsal cap of the IC in awake, adult mice. Sound level growth functions at the level of the auditory nerve and corticocollicular axon terminals are both strongly depressed hours after noise-induced damage of cochlear afferent synapses. Corticocollicular response gain rebounded above baseline levels by the following day and remained elevated for several weeks despite a persistent reduction in auditory nerve input. Sustained potentiation of excitatory ACtx projection neurons that innervate multiple limbic and subcortical auditory centers may underlie hyperexcitability and aberrant functional coupling of distributed brain networks in tinnitus and hyperacusis.

Dynamic representation of 3D auditory space in the midbrain of the free-flying echolocating bat

Essential to spatial orientation in the natural environment is a dynamic representation of direction and distance to objects. Despite the importance of 3D spatial localization to parse objects in the environment and to guide movement, most neurophysiological investigations of sensory mapping have been limited to studies of restrained subjects, tested with 2D, artificial stimuli. Here, we show for the first time that sensory neurons in the midbrain superior colliculus (SC) of the free-flying echolocating bat encode 3D egocentric space, and that the bat's inspection of objects in the physical environment sharpens tuning of single neurons, and shifts peak responses to represent closer distances. These findings emerged from wireless neural recordings in free-flying bats, in combination with an echo model that computes the animal's instantaneous stimulus space. Our research reveals dynamic 3D space coding in a freely moving mammal engaged in a real-world navigation task.

Oxytocin signaling in the medial amygdala is required for sex discrimination of social cues

The neural control of social behaviors in rodents requires the encoding of pheromonal cues by the vomeronasal system. Here we show that the typical preference of male mice for females is eliminated in mutants lacking oxytocin, a neuropeptide modulating social behaviors in many species. Ablation of the oxytocin receptor in aromatase-expressing neurons of the medial amygdala (MeA) fully recapitulates the elimination of female preference in males. Further, single-unit recording in the MeA uncovered significant changes in the sensory representation of conspecific cues in the absence of oxytocin signaling. Finally, acute manipulation of oxytocin signaling in adults is sufficient to alter social interaction preferences in males as well as responses of MeA neurons to chemosensory cues. These results uncover the critical role of oxytocin signaling in a molecularly defined neuronal population in order to modulate the behavioral and physiological responses of male mice to females on a moment-to-moment basis.

Envelope contributions to the representation of interaural time difference in the forebrain of barn owls

Birds and mammals use the interaural time difference (ITD) for azimuthal sound localization. While barn owls can use the ITD of the stimulus carrier frequency over nearly their entire hearing range, mammals have to utilize the ITD of the stimulus envelope to extend the upper frequency limit of ITD-based sound localization. ITD is computed and processed in a dedicated neural circuit that consists of two pathways. In the barn owl, ITD representation is more complex in the forebrain than in the midbrain pathway because of the combination of two inputs that represent different ITDs. We speculated that one of the two inputs includes an envelope contribution. To estimate the envelope contribution, we recorded ITD response functions for correlated and anticorrelated noise stimuli in the barn owl's auditory arcopallium. Our findings indicate that barn owls, like mammals, represent both carrier and envelope ITDs of overlapping frequency ranges, supporting the hypothesis that carrier and envelope ITD-based localization are complementary beyond a mere extension of the upper frequency limit.NEW & NOTEWORTHY The results presented in this study show for the first time that the barn owl is able to extract and represent the interaural time difference (ITD) information conveyed by the envelope of a broadband acoustic signal. Like mammals, the barn owl extracts the ITD of the envelope and the carrier of a signal from the same frequency range. These results are of general interest, since they reinforce a trend found in neural signal processing across different species.

Audience gaze while appreciating a multipart musical performance

Visual information has been observed to be crucial for audience members during musical performances. The present study used an eye tracker to investigate audience members' gazes while appreciating an audiovisual musical ensemble performance, based on evidence of the dominance of musical part in auditory attention when listening to multipart music that contains different melody lines and the joint-attention theory of gaze. We presented singing performances, by a female duo. The main findings were as follows: (1) the melody part (soprano) attracted more visual attention than the accompaniment part (alto) throughout the piece, (2) joint attention emerged when the singers shifted their gazes toward their co-performer, suggesting that inter-performer gazing interactions that play a spotlight role mediated performer-audience visual interaction, and (3) musical part (melody or accompaniment) strongly influenced the total duration of gazes among audiences, while the spotlight effect of gaze was limited to just after the singers' gaze shifts.

Cue Reliability Represented in the Shape of Tuning Curves in the Owl's Sound Localization System

Optimal use of sensory information requires that the brain estimates the reliability of sensory cues, but the neural correlate of cue reliability relevant for behavior is not well defined. Here, we addressed this issue by examining how the reliability of spatial cue influences neuronal responses and behavior in the owl's auditory system. We show that the firing rate and spatial selectivity changed with cue reliability due to the mechanisms generating the tuning to the sound localization cue. We found that the correlated variability among neurons strongly depended on the shape of the tuning curves. Finally, we demonstrated that the change in the neurons' selectivity was necessary and sufficient for a network of stochastic neurons to predict behavior when sensory cues were corrupted with noise. This study demonstrates that the shape of tuning curves can stand alone as a coding dimension of environmental statistics.

SIGNIFICANCE STATEMENT

In natural environments, sensory cues are often corrupted by noise and are therefore unreliable. To make the best decisions, the brain must estimate the degree to which a cue can be trusted. The behaviorally relevant neural correlates of cue reliability are debated. In this study, we used the barn owl's sound localization system to address this question. We demonstrated that the mechanisms that account for spatial selectivity also explained how neural responses changed with degraded signals. This allowed for the neurons' selectivity to capture cue reliability, influencing the population readout commanding the owl's sound-orienting behavior.

Dissecting neural circuits for multisensory integration and crossmodal processing

We rely on rich and complex sensory information to perceive and understand our environment. Our multisensory experience of the world depends on the brain's remarkable ability to combine signals across sensory systems. Behavioural, neurophysiological and neuroimaging experiments have established principles of multisensory integration and candidate neural mechanisms. Here we review how targeted manipulation of neural activity using invasive and non-invasive neuromodulation techniques have advanced our understanding of multisensory processing. Neuromodulation studies have provided detailed characterizations of brain networks causally involved in multisensory integration. Despite substantial progress, important questions regarding multisensory networks remain unanswered. Critically, experimental approaches will need to be combined with theory in order to understand how distributed activity across multisensory networks collectively supports perception.

Midbrain auditory selectivity to natural sounds

This study investigated auditory stimulus selectivity in the midbrain superior colliculus (SC) of the echolocating bat, an animal that relies on hearing to guide its orienting behaviors. Multichannel, single-unit recordings were taken across laminae of the midbrain SC of the awake, passively listening big brown bat, Eptesicus fuscus. Species-specific frequency-modulated (FM) echolocation sound sequences with dynamic spectrotemporal features served as acoustic stimuli along with artificial sound sequences matched in bandwidth, amplitude, and duration but differing in spectrotemporal structure. Neurons in dorsal sensory regions of the bat SC responded selectively to elements within the FM sound sequences, whereas neurons in ventral sensorimotor regions showed broad response profiles to natural and artificial stimuli. Moreover, a generalized linear model (GLM) constructed on responses in the dorsal SC to artificial linear FM stimuli failed to predict responses to natural sounds and vice versa, but the GLM produced accurate response predictions in ventral SC neurons. This result suggests that auditory selectivity in the dorsal extent of the bat SC arises through nonlinear mechanisms, which extract species-specific sensory information. Importantly, auditory selectivity appeared only in responses to stimuli containing the natural statistics of acoustic signals used by the bat for spatial orientation-sonar vocalizations-offering support for the hypothesis that sensory selectivity enables rapid species-specific orienting behaviors. The results of this study are the first, to our knowledge, to show auditory spectrotemporal selectivity to natural stimuli in SC neurons and serve to inform a more general understanding of mechanisms guiding sensory selectivity for natural, goal-directed orienting behaviors.

Enhanced sensory sampling precedes self-initiated locomotion in an electric fish

Cortical activity precedes self-initiated movements by several seconds in mammals; this observation has led into inquiries on the nature of volition. Preparatory neural activity is known to be associated with decision making and movement planning. Self-initiated locomotion has been linked to increased active sensory sampling; however, the precise temporal relationship between sensory acquisition and voluntary movement initiation has not been established. Based on long-term monitoring of sensory sampling activity that is readily observable in freely behaving pulse-type electric fish, we show that heightened sensory acquisition precedes spontaneous initiation of swimming. Gymnotus sp. revealed a bimodal distribution of electric organ discharge rate (EODR) demonstrating down- and up-states of sensory sampling and neural activity; movements only occurred during up-states and up-states were initiated before movement onset. EODR during voluntary swimming initiation exhibited greater trial-to-trial variability than the sound-evoked increases in EODR. The sampling variability declined after voluntary movement onset as previously observed for the neural variability associated with decision making in primates. Spontaneous movements occurred randomly without a characteristic timescale, and no significant temporal correlation was found between successive movement intervals. Using statistical analyses of spontaneous exploratory behaviours and associated preparatory sensory sampling increase, we conclude that electric fish exhibit key attributes of volitional movements, and that voluntary behaviours in vertebrates may generally be preceded by increased sensory sampling. Our results suggest that comparative studies of the neural basis of volition may therefore be possible in pulse-type electric fish, given the substantial homologies between the telencephali of teleost fish and mammals.

Selective disinhibition: A unified neural mechanism for predictive and post hoc attentional selection

The natural world presents us with a rich and ever-changing sensory landscape containing diverse stimuli that constantly compete for representation in the brain. When the brain selects a stimulus as the highest priority for attention, it differentially enhances the representation of the selected, "target" stimulus and suppresses the processing of other, distracting stimuli. A stimulus may be selected for attention while it is still present in the visual scene (predictive selection) or after it has vanished (post hoc selection). We present a biologically inspired computational model that accounts for the prioritized processing of information about targets that are selected for attention either predictively or post hoc. Central to the model is the neurobiological mechanism of "selective disinhibition" - the selective suppression of inhibition of the representation of the target stimulus. We demonstrate that this mechanism explains major neurophysiological hallmarks of selective attention, including multiplicative neural gain, increased inter-trial reliability (decreased variability), and reduced noise correlations. The same mechanism also reproduces key behavioral hallmarks associated with target-distracter interactions. Selective disinhibition exhibits several distinguishing and advantageous features over alternative mechanisms for implementing target selection, and is capable of explaining the effects of selective attention over a broad range of real-world conditions, involving both predictive and post hoc biasing of sensory competition and decisions.

Spatial cue reliability drives frequency tuning in the barn Owl's midbrain

The robust representation of the environment from unreliable sensory cues is vital for the efficient function of the brain. However, how the neural processing captures the most reliable cues is unknown. The interaural time difference (ITD) is the primary cue to localize sound in horizontal space. ITD is encoded in the firing rate of neurons that detect interaural phase difference (IPD). Due to the filtering effect of the head, IPD for a given location varies depending on the environmental context. We found that, in barn owls, at each location there is a frequency range where the head filtering yields the most reliable IPDs across contexts. Remarkably, the frequency tuning of space-specific neurons in the owl's midbrain varies with their preferred sound location, matching the range that carries the most reliable IPD. Thus, frequency tuning in the owl's space-specific neurons reflects a higher-order feature of the code that captures cue reliability.

Influence of double stimulation on sound-localization behavior in barn owls

Barn owls do not immediately approach a source after they hear a sound, but wait for a second sound before they strike. This represents a gain in striking behavior by avoiding responses to random incidents. However, the first stimulus is also expected to change the threshold for perceiving the subsequent second sound, thus possibly introducing some costs. We mimicked this situation in a behavioral double-stimulus paradigm utilizing saccadic head turns of owls. The first stimulus served as an adapter, was presented in frontal space, and did not elicit a head turn. The second stimulus, emitted from a peripheral source, elicited the head turn. The time interval between both stimuli was varied. Data obtained with double stimulation were compared with data collected with a single stimulus from the same positions as the second stimulus in the double-stimulus paradigm. Sound-localization performance was quantified by the response latency, accuracy, and precision of the head turns. Response latency was increased with double stimuli, while accuracy and precision were decreased. The effect depended on the inter-stimulus interval. These results suggest that waiting for a second stimulus may indeed impose costs on sound localization by adaptation and this reduces the gain obtained by waiting for a second stimulus.

Descending control of neural bias and selectivity in a spatial attention network: rules and mechanisms

The brain integrates stimulus-driven (exogenous) activity with internally generated (endogenous) activity to compute the highest priority stimulus for gaze and attention. Little is known about how this computation is accomplished neurally. We explored the underlying functional logic in a critical component of the spatial attention network, the optic tectum (OT, superior colliculus in mammals), in awake barn owls. We found that space-specific endogenous influences, evoked by activating descending forebrain pathways, bias competition among exogenous influences, and substantially enhance the quality of the categorical neural pointer to the highest priority stimulus. These endogenous influences operate across sensory modalities. Biologically grounded modeling revealed that the observed effects on network bias and selectivity require a simple circuit mechanism: endogenously driven gain modulation of feedback inhibition among competing channels. Our findings reveal fundamental principles by which internal and external information combine to guide selection of the next target for gaze and attention.

Why do forward maskers affect auditory intensity discrimination? Evidence from "molecular psychophysics"

Nonsimultaneous maskers can strongly impair performance in an auditory intensity discrimination task. Using methods of molecular psychophysics, we quantified the extent to which (1) a masker-induced impairment of the representation of target intensity (i.e., increase in internal noise) and (2) a systematic influence of the masker intensities on the decision variable contribute to these effects. In a two-interval intensity discrimination procedure, targets were presented in quiet, and combined with forward maskers. The lateralization of the maskers relative to the targets was varied via the interaural time difference. Intensity difference limens (DLs) were strongly elevated under forward masking but less with contralateral than with ipsilateral maskers. For most listeners and conditions, perceptual weights measuring the relation between the target and masker levels and the response in the intensity discrimination task were positive and significant. Higher perceptual weights assigned to the maskers corresponded to stronger elevations of the intensity DL. The maskers caused only a weak increase in internal noise, unrelated to target level and masker lateralization. The results indicate that the effects of forward masking on intensity discrimination are determined by an inclusion of the masker intensities in the decision variable, compatible with the hypothesis that the impairment in performance is to a large part caused by difficulties in directing selective attention to the targets. The effects of masker lateralization are evidence for top-down influences, and the observed positive signs of the masker weights suggest that the relevant mechanisms are located at higher processing stages rather than in the auditory periphery.

Alignment of sound localization cues in the nucleus of the brachium of the inferior colliculus

Accurate sound localization is based on three acoustic cues (interaural time and intensity difference and spectral cues from directional filtering by the pinna). In natural listening conditions, every spatial position of a sound source provides a unique combination of these three cues in "natural alignment." Although neurons in the central nucleus (ICC) of the inferior colliculus (IC) are sensitive to multiple cues, they do not favor their natural spatial alignment. We tested for sensitivity to cue alignment in the nucleus of the brachium of the IC (BIN) in unanesthetized marmoset monkeys. The BIN receives its predominant auditory input from ICC and projects to the topographic auditory space map in the superior colliculus. Sound localization cues measured in each monkey were used to synthesize broadband stimuli with aligned and misaligned cues; spike responses to these stimuli were recorded in the BIN. We computed mutual information (MI) between the set of spike rates and the stimuli containing either aligned or misaligned cues. The results can be summarized as follows: 1) BIN neurons encode more information about auditory space when cues are aligned compared with misaligned. 2) Significantly more units prefer aligned cues in the BIN than in ICC. 3) An additive model based on summing the responses to stimuli with the localization cues varying individually accurately predicts the alignment preference with all cues varying. Overall, the results suggest that the BIN is the first site in the ascending mammalian auditory system that is tuned to natural combinations of sound localization cues.

Directing eye gaze enhances auditory spatial cue discrimination

The present study demonstrates, for the first time, a specific enhancement of auditory spatial cue discrimination due to eye gaze. Whereas the region of sharpest visual acuity, called the fovea, can be directed at will by moving one's eyes, auditory spatial information is derived primarily from head-related acoustic cues. Past auditory studies have found better discrimination in front of the head [1-3] but have not manipulated subjects' gaze, thus overlooking potential oculomotor influences. Electrophysiological studies have shown that the inferior colliculus, a critical auditory midbrain nucleus, shows visual and oculomotor responses [4-6] and modulations of auditory activity [7-9], and that auditory neurons in the superior colliculus show shifting receptive fields [10-13]. How the auditory system leverages this crossmodal information at the behavioral level remains unknown. Here we directed subjects' gaze (with an eccentric dot) or auditory attention (with lateralized noise) while they performed an auditory spatial cue discrimination task. We found that directing gaze toward a sound significantly enhances discrimination of both interaural level and time differences, whereas directing auditory spatial attention does not. These results show that oculomotor information variably enhances auditory spatial resolution even when the head remains stationary, revealing a distinct behavioral benefit possibly arising from auditory-oculomotor interactions at an earlier level of processing than previously demonstrated.

Ongoing activity in the optic tectum is correlated on a trial-by-trial basis with the pupil dilation response

The selection of the appropriate stimulus to induce an orienting response is a basic task thought to be partly achieved by tectal circuitry. Here we addressed the relationship between neural activity in the optic tectum (OT) and orienting behavioral responses. We recorded multiunit activity in the intermediate/deep layers of the OT of the barn owl simultaneously with pupil dilation responses (PDR, a well-known orienting response common to birds and mammals). A trial-by-trial analysis of the responses revealed that the PDR generally did not correlate with the evoked neural responses but significantly correlated with the rate of ongoing neural activity measured shortly before the stimulus. Following this finding, we characterized ongoing activity in the OT and showed that in the intermediate/deep layers it tended to fluctuate spontaneously. It is characterized by short periods of high ongoing activity during which the probability of a PDR to an auditory stimulus inside the receptive field is increased. These high-ongoing activity periods were correlated with increase in the power of gamma band local field potential oscillations. Through dual recordings, we showed that the correlation coefficients of ongoing activity decreased as a function of distance between recording sites in the tectal map. Significant correlations were also found between recording sites in the OT and the forebrain entopallium. Our results suggest that an increase of ongoing activity in the OT reflects an internal state during which coupling between sensory stimulation and behavioral responses increases.

Saliency mapping in the optic tectum and its relationship to habituation

Habituation of the orienting response has long served as a model system for studying fundamental psychological phenomena such as learning, attention, decisions, and surprise. In this article, we review an emerging hypothesis that the evolutionary role of the superior colliculus (SC) in mammals or its homolog in birds, the optic tectum (OT), is to select the most salient target and send this information to the appropriate brain regions to control the body and brain orienting responses. Recent studies have begun to reveal mechanisms of how saliency is computed in the OT/SC, demonstrating a striking similarity between mammals and birds. The saliency of a target can be determined by how different it is from the surrounding objects, by how different it is from its history (that is habituation) and by how relevant it is for the task at hand. Here, we will first review evidence, mostly from primates and barn owls, that all three types of saliency computations are linked in the OT/SC. We will then focus more on neural adaptation in the OT and its possible link to temporal saliency and habituation.

It's all connected: Pathways in visual object recognition and early noun learning

A developmental pathway may be defined as the route, or chain of events, through which a new structure or function forms. For many human behaviors, including object name learning and visual object recognition, these pathways are often complex and multicausal and include unexpected dependencies. This article presents three principles of development that suggest the value of a developmental psychology that explicitly seeks to trace these pathways and uses empirical evidence on developmental dependencies among motor development, action on objects, visual object recognition, and object name learning in 12- to 24-month-old infants to make the case. The article concludes with a consideration of the theoretical implications of this approach. (PsycINFO Database Record (c) 2013 APA, all rights reserved).

Binaural gain modulation of spectrotemporal tuning in the interaural level difference-coding pathway

In the brainstem, the auditory system diverges into two pathways that process different sound localization cues, interaural time differences (ITDs) and level differences (ILDs). We investigated the site where ILD is detected in the auditory system of barn owls, the posterior part of the lateral lemniscus (LLDp). This structure is equivalent to the lateral superior olive in mammals. The LLDp is unique in that it is the first place of binaural convergence in the brainstem where monaural excitatory and inhibitory inputs converge. Using binaurally uncorrelated noise and a generalized linear model, we were able to estimate the spectrotemporal tuning of excitatory and inhibitory inputs to these cells. We show that the response of LLDp neurons is highly locked to the stimulus envelope. Our data demonstrate that spectrotemporally tuned, temporally delayed inhibition enhances the reliability of envelope locking by modulating the gain of LLDp neurons' responses. The dependence of gain modulation on ILD shown here constitutes a means for space-dependent coding of stimulus identity by the initial stages of the auditory pathway.

Organization of the gymnotiform fish pallium in relation to learning and memory: II. Extrinsic connections

This study describes the extrinsic connections of the dorsal telencephalon (pallium) of gymnotiform fish. We show that the afferents to the dorsolateral and dorsomedial pallial subdivisions of gymnotiform fish arise from the preglomerular complex. The preglomerular complex receives input from four clearly distinct regions: (1) descending input from the pallium itself (dorsomedial and dorsocentral subdivisions and nucleus taenia); (2) other diencephalic nuclei (centroposterior, glomerular, and anterior tuberal nuclei and nucleus of the posterior tuberculum); (3) mesencephalic sensory structures (optic tectum, dorsal and ventral torus semicircularis); and (4) basal forebrain, preoptic area, and hypothalamic nuclei. Previous studies have implicated the majority of the diencephalic and mesencephalic nuclei in electrosensory, visual, and acousticolateral functions. Here we discuss the implications of preglomerular/pallial electrosensory-associated afferents with respect to a major functional dichotomy of the electric sense. The results allow us to hypothesize that a functional distinction between electrocommunication vs. electrolocation is maintained within the input and output pathways of the gymnotiform pallium. Electrocommunication information is conveyed to the pallium through complex indirect pathways that originate in the nucleus electrosensorius, whereas electrolocation processing follows a conservative pathway inherent to all vertebrates, through the optic tectum. We hypothesize that cells responsive to communication signals do not converge onto the same targets in the preglomerular complex as cells responsive to moving objects. We also hypothesize that efferents from the dorsocentral (DC) telencephalon project to the dorsal torus semicircularis to regulate processing of electrocommunication signals, whereas DC efferents to the tectum modulate sensory control of movement.

A shared inhibitory circuit for both exogenous and endogenous control of stimulus selection

The mechanisms by which the brain suppresses distracting stimuli to control the locus of attention are unknown. We found that focal, reversible inactivation of a single inhibitory circuit in the barn owl midbrain tegmentum, the nucleus isthmi pars magnocellularis (Imc), abolished both stimulus-driven (exogenous) and internally-driven (endogenous) competitive interactions in the optic tectum (superior colliculus in mammals), which are vital to the selection of a target among distracters in behaving animals. Imc neurons transformed spatially precise multisensory and endogenous input into powerful inhibitory output that suppressed competing representations across the entire tectal space map. We identified a small, but highly potent, circuit that is employed by both exogenous and endogenous signals to exert competitive suppression in the midbrain selection network. Our findings reveal, for the first time, a neural mechanism for the construction of a priority map that is critical for the selection of the most important stimulus for gaze and attention.

Stimulus encoding within the barn owl optic tectum using gamma oscillations vs. spike rate: a modeling approach

The optic tectum of the barn owl is a multimodal structure with multiple layers, with each layer topographically organized according to spatial receptive field. The response of a site to a stimulus can be measured as either spike rate or local field potential (LFP) gamma (25-90 Hz) power; within superficial layers, spike rate and gamma power spatial tuning curves are narrow and contrast-response functions rise slowly. Within deeper layers, however, spike rate tuning curves broaden and gamma power contrast-response functions sharpen. In this work, we employ a computational model to describe the inputs required to generate these transformations from superficial to deep layers and show that gamma power and spike rate can act as parallel information processing streams.

Stimulus-specific adaptation, habituation and change detection in the gaze control system

This prospect article addresses the neurobiology of detecting and responding to changes or unexpected events. Change detection is an ongoing computational task performed by the brain as part of the broader process of saliency mapping and selection of the next target for attention. In the optic tectum (OT) of the barn owl, the probability of the stimulus has a dramatic influence on the neural response to that stimulus; rare or deviant stimuli induce stronger responses compared to common stimuli. This phenomenon, known as stimulus-specific adaptation, has recently attracted scientific interest because of its possible role in change detection. In the barn owl's OT, it may underlie the ability to orient specifically to unexpected events and is therefore opening new directions for research on the neurobiology of fundamental psychological phenomena such as habituation, attention, and surprise.

Temporal context in speech processing and attentional stream selection: a behavioral and neural perspective

The human capacity for processing speech is remarkable, especially given that information in speech unfolds over multiple time scales concurrently. Similarly notable is our ability to filter out of extraneous sounds and focus our attention on one conversation, epitomized by the 'Cocktail Party' effect. Yet, the neural mechanisms underlying on-line speech decoding and attentional stream selection are not well understood. We review findings from behavioral and neurophysiological investigations that underscore the importance of the temporal structure of speech for achieving these perceptual feats. We discuss the hypothesis that entrainment of ambient neuronal oscillations to speech's temporal structure, across multiple time-scales, serves to facilitate its decoding and underlies the selection of an attended speech stream over other competing input. In this regard, speech decoding and attentional stream selection are examples of 'Active Sensing', emphasizing an interaction between proactive and predictive top-down modulation of neuronal dynamics and bottom-up sensory input.

Transformation from a pure time delay to a mixed time and phase delay representation in the auditory forebrain pathway

Birds and mammals exploit interaural time differences (ITDs) for sound localization. Subsequent to ITD detection by brainstem neurons, ITD processing continues in parallel midbrain and forebrain pathways. In the barn owl, both ITD detection and processing in the midbrain are specialized to extract ITDs independent of frequency, which amounts to a pure time delay representation. Recent results have elucidated different mechanisms of ITD detection in mammals, which lead to a representation of small ITDs in high-frequency channels and large ITDs in low-frequency channels, resembling a phase delay representation. However, the detection mechanism does not prevent a change in ITD representation at higher processing stages. Here we analyze ITD tuning across frequency channels with pure tone and noise stimuli in neurons of the barn owl's auditory arcopallium, a nucleus at the endpoint of the forebrain pathway. To extend the analysis of ITD representation across frequency bands to a large neural population, we employed Fourier analysis for the spectral decomposition of ITD curves recorded with noise stimuli. This method was validated using physiological as well as model data. We found that low frequencies convey sensitivity to large ITDs, whereas high frequencies convey sensitivity to small ITDs. Moreover, different linear phase frequency regimes in the high-frequency and low-frequency ranges suggested an independent convergence of inputs from these frequency channels. Our results are consistent with ITD being remodeled toward a phase delay representation along the forebrain pathway. This indicates that sensory representations may undergo substantial reorganization, presumably in relation to specific behavioral output.

Is the effect of tinnitus on auditory steady-state response amplitude mediated by attention?

Objectives: Auditory steady-state response (ASSR) amplitude enhancement effects have been reported in tinnitus patients. As ASSR amplitude is also enhanced by attention, the effect of tinnitus on ASSR amplitude could be interpreted as an effect of attention mediated by tinnitus. As N1 attention effects are significantly larger than those on the ASSR, if the effect of tinnitus on ASSR amplitude were due to attention, there should be similar amplitude enhancement effects in tinnitus for the N1 component of the auditory-evoked response. Methods: MEG recordings which were previously examined for the ASSR (Diesch et al., 2010a) were analyzed with respect to the N1m component. Like the ASSR previously, the N1m was analyzed in the source domain (source space projection). Stimuli were amplitude-modulated (AM) tones with one of three carrier frequencies matching the tinnitus frequency or a surrogate frequency 1½ octave above the audiometric edge frequency in controls, the audiometric edge frequency, and a frequency below the audiometric edge. Single AM-tones were presented in a single condition and superpositions of three AM-tones differing in carrier and modulation frequency in a composite condition. Results: In the earlier ASSR study (Diesch et al., 2010a), the ASSR amplitude in tinnitus patients, but not in controls, was significantly larger in the (surrogate) tinnitus condition than in the edge condition. Patients showed less evidence than controls of reciprocal inhibition of component ASSR responses in the composite condition. In the present study, N1m amplitudes elicited by stimuli located at the audiometric edge and at the (surrogate) tinnitus frequency were smaller than N1m amplitudes elicited by sub-edge tones both in patients and controls. The relationship of the N1m response in the composite condition to the N1m response in the single condition indicated that reciprocal inhibition among component N1m responses was reduced in patients compared against controls. Conclusions: In the present study, no evidence was found for an N1-amplitude enhancement effect in tinnitus. Compared to controls, reciprocal inhibition is reduced in tinnitus patients. Thus, as there is no effect on N1m that could potentially be attributed to attention, it seems unlikely that the enhancement effect of tinnitus on ASSR amplitude could be accounted for in terms of attention induced by tinnitus.

Competing sound sources reveal spatial effects in cortical processing

Why is spatial tuning in auditory cortex weak, even though location is important to object recognition in natural settings? This question continues to vex neuroscientists focused on linking physiological results to auditory perception. Here we show that the spatial locations of simultaneous, competing sound sources dramatically influence how well neural spike trains recorded from the zebra finch field L (an analog of mammalian primary auditory cortex) encode source identity. We find that the location of a birdsong played in quiet has little effect on the fidelity of the neural encoding of the song. However, when the song is presented along with a masker, spatial effects are pronounced. For each spatial configuration, a subset of neurons encodes song identity more robustly than others. As a result, competing sources from different locations dominate responses of different neural subpopulations, helping to separate neural responses into independent representations. These results help elucidate how cortical processing exploits spatial information to provide a substrate for selective spatial auditory attention.