Space-Specific Deficits in Visual Orientation Discrimination Caused by Lesions in the Midbrain Stimulus Selection Network

Dissociable components of attention exhibit distinct neuronal signatures in primate visual cortex

Attention can be deployed in multiple forms and facilitates behavior by influencing perceptual sensitivity and choice bias. Attention is also associated with a myriad of changes in sensory neural activity. Yet, the relationship between the behavioral components of attention and the accompanying changes in neural activity remains largely unresolved. We examined this relationship by quantifying sensitivity and bias in monkeys performing a task that dissociated eye movement responses from the focus of covert attention. Unexpectedly, bias, not sensitivity, increased at the focus of covert attention, whereas sensitivity increased at the location of planned eye movements. Furthermore, neuronal activity within visual area V4 varied robustly with bias, but not sensitivity, at the focus of covert attention. In contrast, correlated variability between neuronal pairs was lowest at the location of planned eye movements, and varied with sensitivity, but not bias. Thus, dissociable behavioral components of attention exhibit distinct neuronal signatures within the visual cortex.

Costs and benefits of voluntary attention in crows

Behavioural signatures of voluntary, endogenous selective attention have been found in both mammals and birds, but the relationship between performance benefits at attended and costs at unattended locations remains unclear. We trained two carrion crows (Corvus corone) on a Posner-like spatial cueing task with dissociated cue and target locations, using both highly predictive and neutral central cues to compare reaction time (RT) and detection accuracy for validly, invalidly and neutrally cued targets. We found robust RT effects of predictive cueing at varying stimulus-onset asynchronies (SOA) that resulted from both advantages at cued locations and costs at un-cued locations. Both crows showed cueing effects around 15-25 ms with an early onset at 100 ms SOA, comparable to macaques. Our results provide a direct assessment of costs and benefits of voluntary attention in a bird species. They show that crows are able to guide spatial attention using associative cues, and that the processing advantage at attended locations impairs performance at unattended locations.

A Midbrain Inspired Recurrent Neural Network Model for Robust Change Detection

We present a biologically inspired recurrent neural network (RNN) that efficiently detects changes in natural images. The model features sparse, topographic connectivity (st-RNN), closely modeled on the circuit architecture of a "midbrain attention network." We deployed the st-RNN in a challenging change blindness task, in which changes must be detected in a discontinuous sequence of images. Compared with a conventional RNN, the st-RNN learned 9x faster and achieved state-of-the-art performance with 15x fewer connections. An analysis of low-dimensional dynamics revealed putative circuit mechanisms, including a critical role for a global inhibitory (GI) motif, for successful change detection. The model reproduced key experimental phenomena, including midbrain neurons' sensitivity to dynamic stimuli, neural signatures of stimulus competition, as well as hallmark behavioral effects of midbrain microstimulation. Finally, the model accurately predicted human gaze fixations in a change blindness experiment, surpassing state-of-the-art saliency-based methods. The st-RNN provides a novel deep learning model for linking neural computations underlying change detection with psychophysical mechanisms.SIGNIFICANCE STATEMENT For adaptive survival, our brains must be able to accurately and rapidly detect changing aspects of our visual world. We present a novel deep learning model, a sparse, topographic recurrent neural network (st-RNN), that mimics the neuroanatomy of an evolutionarily conserved "midbrain attention network." The st-RNN achieved robust change detection in challenging change blindness tasks, outperforming conventional RNN architectures. The model also reproduced hallmark experimental phenomena, both neural and behavioral, reported in seminal midbrain studies. Lastly, the st-RNN outperformed state-of-the-art models at predicting human gaze fixations in a laboratory change blindness experiment. Our deep learning model may provide important clues about key mechanisms by which the brain efficiently detects changes.

Directional Preference in Avian Midbrain Saliency Computing Nucleus Reflects a Well-Designed Receptive Field Structure

Simple Summary

Directional preference neurons has been found in many vertebrate sensory systems. The isthmi pars magnocellularis (Imc) in avian midbrain, playing a key role in visual selective attention, shows impressive motion directional preference, but little is known about the physiological basis of this phenomenon. Herein, artificial visual stimuli, statistical analyses, and a neural computational model were used to unravel this mystery. This study deepens the understanding of the relationship between the directional preference and special receptive field structure of pigeon’s (Columba livia) Imc neuron.

Abstract

Neurons responding sensitively to motions in several rather than all directions have been identified in many sensory systems. Although this directional preference has been demonstrated by previous studies to exist in the isthmi pars magnocellularis (Imc) of pigeon (Columba livia), which plays a key role in the midbrain saliency computing network, the dynamic response characteristics and the physiological basis underlying this phenomenon are unclear. Herein, dots moving in 16 directions and a biologically plausible computational model were used. We found that pigeon Imc’s significant responses for objects moving in preferred directions benefit the long response duration and high instantaneous firing rate. Furthermore, the receptive field structures predicted by a computational model, which captures the actual directional tuning curves, agree with the real data collected from population Imc units. These results suggested that directional preference in Imc may be internally prebuilt by elongating the vertical axis of the receptive field, making predators attack from the dorsal-ventral direction and conspecifics flying away in the ventral-dorsal direction, more salient for avians, which is of great ecological and physiological significance for survival.

Early cortical signals in visual stimulus detection

During visual conscious perception, the earliest responses linked to signal detection are little known. The current study aims to reveal the cortical neural activity changes in the earliest stages of conscious perception using recordings from intracranial electrodes. Epilepsy patients (N=158) were recruited from a multi-center collaboration and completed a visual word recall task. Broadband gamma activity (40-115Hz) was extracted with a band-pass filter and gamma power was calculated across subjects on a common brain surface. Our results show early gamma power increases within 0-50ms after stimulus onset in bilateral visual processing cortex, right frontal cortex (frontal eye fields, ventral medial/frontopolar, orbital frontal) and bilateral medial temporal cortex regardless of whether the word was later recalled. At the same early times, decreases were seen in the left rostral middle frontal gyrus. At later times after stimulus onset, gamma power changes developed in multiple cortical regions. These included sustained changes in visual and other association cortical networks, and transient decreases in the default mode network most prominently at 300-650ms. In agreement with prior work in this verbal memory task, we also saw greater increases in visual and medial temporal regions as well as prominent later (> 300ms) increases in left hemisphere language areas for recalled versus not recalled stimuli. These results suggest an early signal detection network in the frontal, medial temporal, and visual cortex is engaged at the earliest stages of conscious visual perception.

Anatomical and electrophysiological analysis of cholinergic inputs from the parabigeminal nucleus to the superficial superior colliculus

Superior colliculus (SC) is a midbrain structure that integrates sensory inputs and generates motor commands to initiate innate motor behaviors. Its retinorecipient superficial layers (sSC) receive dense cholinergic projections from the parabigeminal nucleus (PBN). Our previous in vitro study revealed that acetylcholine induces fast inward current followed by prominent GABAergic inhibition within the sSC circuits (Endo T, Yanagawa Y, Obata K, Isa T. J Neurophysiol 94: 3893-3902, 2005). Acetylcholine-mediated facilitation of GABAergic inhibition may play an important role in visual signal processing in the sSC; however, both the anatomical and physiological properties of cholinergic inputs from PBN have not been studied in detail in vivo. In this study, we specifically visualized and optogenetically manipulated the cholinergic neurons in the PBN after focal injections of Cre-dependent viral vectors in mice that express Cre in cholinergic neurons. We revealed that the cholinergic projections terminated densely in the medial part of the mouse sSC. This suggests that the cholinergic inputs mediate visual processing in the upper visual field, which would be critical for predator detection. We further analyzed the physiological roles of the cholinergic inputs by recording looming-evoked visual responses from sSC neurons during optogenetic activation or inactivation of PBN cholinergic neurons in anesthetized mice. We found that optogenetic manipulations in either direction induced response suppression in most neurons, whereas response facilitation was observed in a few neurons after the optogenetic activation. These results support a circuit model that suggests that the PBN cholinergic inputs enhance functions of the sSC in detecting visual targets by facilitating the center excitation-surround inhibition.NEW & NOTEWORTHY The modulatory role of the cholinergic inputs from the parabigeminal nucleus in the visual responses in the superficial superior colliculus (sSC) remains unknown. Here we report that the cholinergic projections terminate densely in the medial sSC and optogenetic manipulations of the cholinergic inputs affect the looming-evoked response and enhance surround inhibition in the sSC. Our data suggest that cholinergic inputs to the sSC contribute to the visual detection of predators.

Self-motion trajectories can facilitate orientation-based figure-ground segregation

Segregation of objects from the background is a basic and essential property of the visual system. We studied the neural detection of objects defined by orientation difference from background in barn owls (Tyto alba). We presented wide-field displays of densely packed stripes with a dominant orientation. Visual objects were created by orienting a circular patch differently from the background. In head-fixed conditions, neurons in both tecto- and thalamofugal visual pathways (optic tectum and visual Wulst) were weakly responsive to these objects in their receptive fields. However, notably, in freely viewing conditions, barn owls occasionally perform peculiar side-to-side head motions (peering) when scanning the environment. In the second part of the study we thus recorded the neural response from head-fixed owls while the visual displays replicated the peering conditions; i.e., the displays (objects and backgrounds) were shifted along trajectories that induced a retinal motion identical to sampled peering motions during viewing of a static object. These conditions induced dramatic neural responses to the objects, in the very same neurons that where unresponsive to the objects in static displays. By reverting to circular motions of the display, we show that the pattern of the neural response is mostly shaped by the orientation of the background relative to motion and not the orientation of the object. Thus our findings provide evidence that peering and/or other self-motions can facilitate orientation-based figure-ground segregation through interaction with inhibition from the surround.NEW & NOTEWORTHY Animals frequently move their sensory organs and thereby create motion cues that can enhance object segregation from background. We address a special example of such active sensing, in barn owls. When scanning the environment, barn owls occasionally perform small-amplitude side-to-side head movements called peering. We show that the visual outcome of such peering movements elicit neural detection of objects that are rotated from the dominant orientation of the background scene and which are otherwise mostly undetected. These results suggest a novel role for self-motions in sensing objects that break the regular orientation of elements in the scene.

Evolution of neural processing for visual perception in vertebrates

Visual perception requires both visual information and attention. This review compares, across classes of vertebrates, the functional and anatomical characteristics of (a) the neural pathways that process visual information about objects, and (b) stimulus selection pathways that determine the objects to which an animal attends. Early in the evolution of vertebrate species, visual perception was dominated by information transmitted via the midbrain (retinotectal) visual pathway, and attention was probably controlled primarily by a selection network in the midbrain. In contrast, in primates, visual perception is dominated by information transmitted via the forebrain (retinogeniculate) visual pathway, and attention is mediated largely by networks in the forebrain. In birds and nonprimate mammals, both the retinotectal and retinogeniculate pathways contribute critically to visual information processing, and both midbrain and forebrain networks play important roles in controlling attention. The computations and processing strategies in birds and mammals share some strikingly similar characteristics despite over 300 million years of independent evolution and being implemented by distinct brain architectures. The similarity of these functional characteristics suggests that they provide valuable advantages to visual perception in advanced visual systems. A schema is proposed that describes the evolution of the pathways and computations that enable visual perception in vertebrate species.

Neural Circuits That Mediate Selective Attention: A Comparative Perspective

Selective attention is central to cognition. Dramatic advances have been made in understanding the neural circuits that mediate selective attention. Forebrain networks, most elaborated in primates, control all forms of attention based on task demands and the physical salience of stimuli. These networks contain circuits that distribute top-down signals to sensory processing areas and enhance information processing in those areas. A midbrain network, most elaborated in birds, controls spatial attention. It contains circuits that continuously compute the highest priority stimulus location and route sensory information from the selected location to forebrain networks that make cognitive decisions. The identification of these circuits, their functions and mechanisms represent a major advance in our understanding of how the vertebrate brain mediates selective attention.