Primate V2 Receptive Fields Derived from Anatomically Identified Large-Scale V1 Inputs

In the primate visual system, visual object recognition involves a series of cortical areas arranged hierarchically along the ventral visual pathway. As information flows through this hierarchy, neurons become progressively tuned to more complex image features. The circuit mechanisms and computations underlying the increasing complexity of these receptive fields (RFs) remain unidentified. To understand how this complexity emerges in the secondary visual area (V2), we investigated the functional organization of inputs from the primary visual cortex (V1) to V2 by combining retrograde anatomical tracing of these inputs with functional imaging of feature maps in macaque monkey V1 and V2. We found that V1 neurons sending inputs to single V2 orientation columns have a broad range of preferred orientations, but are strongly biased towards the orientation represented at the injected V2 site. For each V2 site, we then constructed a feedforward model based on the linear combination of its anatomically-identified large-scale V1 inputs, and studied the response proprieties of the generated V2 RFs. We found that V2 RFs derived from the linear feedforward model were either elongated versions of V1 filters or had spatially complex structures. These modeled RFs predicted V2 neuron responses to oriented grating stimuli with high accuracy. Remarkably, this simple model also explained the greater selectivity to naturalistic textures of V2 cells compared to their V1 input cells. Our results demonstrate that simple linear combinations of feedforward inputs can account for the orientation selectivity and texture sensitivity of V2 RFs.

An optrode array for spatiotemporally-precise large-scale optogenetic stimulation of deep cortical layers in non-human primates

Optogenetics has transformed studies of neural circuit function, but remains challenging to apply to non-human primates (NHPs). A major challenge is delivering intense, spatiotemporally-precise, patterned photostimulation across large volumes in deep tissue. Such stimulation is critical, for example, to modulate selectively deep-layer corticocortical feedback circuits. To address this need, we have developed the Utah Optrode Array (UOA), a 10×10 glass needle waveguide array fabricated atop a novel opaque optical interposer, and bonded to an electrically addressable µLED array. In vivo experiments with the UOA demonstrated large-scale, spatiotemporally precise, activation of deep circuits in NHP cortex. Specifically, the UOA permitted both focal (confined to single layers/columns), and widespread (multiple layers/columns) optogenetic activation of deep layer neurons, as assessed with multi-channel laminar electrode arrays, simply by varying the number of activated µLEDs and/or the irradiance. Thus, the UOA represents a powerful optoelectronic device for targeted manipulation of deep-layer circuits in NHP models.

An Optrode Array for Spatiotemporally Precise Large-Scale Optogenetic Stimulation of Deep Cortical Layers in Non-human Primates

Optogenetics has transformed studies of neural circuit function, but remains challenging to apply in non-human primates (NHPs). A major challenge is delivering intense and spatially precise patterned photostimulation across large volumes in deep tissue. Here, we have developed and validated the Utah Optrode Array (UOA) to meet this critical need. The UOA is a 10×10 glass waveguide array bonded to an electrically-addressable μLED array. In vivo electrophysiology and immediate early gene (c-fos) immunohistochemistry demonstrated the UOA allows for large-scale spatiotemporally precise neuromodulation of deep tissue in macaque primary visual cortex. Specifically, the UOA permits both focal (single layers or columns), and large-scale (across multiple layers or columns) photostimulation of deep cortical layers, simply by varying the number of simultaneously activated μLEDs and/or the light irradiance. These results establish the UOA as a powerful tool for studying targeted neural populations within single or across multiple deep layers in complex NHP circuits.

A direct interareal feedback-to-feedforward circuit in primate visual cortex

The mammalian sensory neocortex consists of hierarchically organized areas reciprocally connected via feedforward (FF) and feedback (FB) circuits. Several theories of hierarchical computation ascribe the bulk of the computational work of the cortex to looped FF-FB circuits between pairs of cortical areas. However, whether such corticocortical loops exist remains unclear. In higher mammals, individual FF-projection neurons send afferents almost exclusively to a single higher-level area. However, it is unclear whether FB-projection neurons show similar area-specificity, and whether they influence FF-projection neurons directly or indirectly. Using viral-mediated monosynaptic circuit tracing in macaque primary visual cortex (V1), we show that V1 neurons sending FF projections to area V2 receive monosynaptic FB inputs from V2, but not other V1-projecting areas. We also find monosynaptic FB-to-FB neuron contacts as a second motif of FB connectivity. Our results support the existence of FF-FB loops in primate cortex, and suggest that FB can rapidly and selectively influence the activity of incoming FF signals.

Improving the Usability of Virtual Reality Neuron Tracing with Topological Elements

Researchers in the field of connectomics are working to reconstruct a map of neural connections in the brain in order to understand at a fundamental level how the brain processes information. Constructing this wiring diagram is done by tracing neurons through high-resolution image stacks acquired with fluorescence microscopy imaging techniques. While a large number of automatic tracing algorithms have been proposed, these frequently rely on local features in the data and fail on noisy data or ambiguous cases, requiring time-consuming manual correction. As a result, manual and semi-automatic tracing methods remain the state-of-the-art for creating accurate neuron reconstructions. We propose a new semi-automatic method that uses topological features to guide users in tracing neurons and integrate this method within a virtual reality (VR) framework previously used for manual tracing. Our approach augments both visualization and interaction with topological elements, allowing rapid understanding and tracing of complex morphologies. In our pilot study, neuroscientists demonstrated a strong preference for using our tool over prior approaches, reported less fatigue during tracing, and commended the ability to better understand possible paths and alternatives. Quantitative evaluation of the traces reveals that users' tracing speed increased, while retaining similar accuracy compared to a fully manual approach.

Stream-specific feedback inputs to the primate primary visual cortex

The sensory neocortex consists of hierarchically-organized areas reciprocally connected via feedforward and feedback circuits. Feedforward connections shape the receptive field properties of neurons in higher areas within parallel streams specialized in processing specific stimulus attributes. Feedback connections have been implicated in top-down modulations, such as attention, prediction and sensory context. However, their computational role remains unknown, partly because we lack knowledge about rules of feedback connectivity to constrain models of feedback function. For example, it is unknown whether feedback connections maintain stream-specific segregation, or integrate information across parallel streams. Using viral-mediated labeling of feedback connections arising from specific cytochrome-oxidase stripes of macaque visual area V2, here we show that feedback to the primary visual cortex (V1) is organized into parallel streams resembling the reciprocal feedforward pathways. This suggests that functionally-specialized V2 feedback channels modulate V1 responses to specific stimulus attributes, an organizational principle potentially extending to feedback pathways in other sensory systems.

An Open Resource for Non-human Primate Optogenetics

Optogenetics has revolutionized neuroscience in small laboratory animals, but its effect on animal models more closely related to humans, such as non-human primates (NHPs), has been mixed. To make evidence-based decisions in primate optogenetics, the scientific community would benefit from a centralized database listing all attempts, successful and unsuccessful, of using optogenetics in the primate brain. We contacted members of the community to ask for their contributions to an open science initiative. As of this writing, 45 laboratories around the world contributed more than 1,000 injection experiments, including precise details regarding their methods and outcomes. Of those entries, more than half had not been published. The resource is free for everyone to consult and contribute to on the Open Science Framework website. Here we review some of the insights from this initial release of the database and discuss methodological considerations to improve the success of optogenetic experiments in NHPs.

Top-down feedback controls spatial summation and response amplitude in primate visual cortex

Sensory information travels along feedforward connections through a hierarchy of cortical areas, which, in turn, send feedback connections to lower-order areas. Feedback has been implicated in attention, expectation, and sensory context, but the mechanisms underlying these diverse feedback functions are unknown. Using specific optogenetic inactivation of feedback connections from the secondary visual area (V2), we show how feedback affects neural responses in the primate primary visual cortex (V1). Reducing feedback activity increases V1 cells' receptive field (RF) size, decreases their responses to stimuli confined to the RF, and increases their responses to stimuli extending into the proximal surround, therefore reducing surround suppression. Moreover, stronger reduction of V2 feedback activity leads to progressive increase in RF size and decrease in response amplitude, an effect predicted by a recurrent network model. Our results indicate that feedback modulates RF size, surround suppression and response amplitude, similar to the modulatory effects of visual spatial attention.

A Virtual Reality Visualization Tool for Neuron Tracing

Tracing neurons in large-scale microscopy data is crucial to establishing a wiring diagram of the brain, which is needed to understand how neural circuits in the brain process information and generate behavior. Automatic techniques often fail for large and complex datasets, and connectomics researchers may spend weeks or months manually tracing neurons using 2D image stacks. We present a design study of a new virtual reality (VR) system, developed in collaboration with trained neuroanatomists, to trace neurons in microscope scans of the visual cortex of primates. We hypothesize that using consumer-grade VR technology to interact with neurons directly in 3D will help neuroscientists better resolve complex cases and enable them to trace neurons faster and with less physical and mental strain. We discuss both the design process and technical challenges in developing an interactive system to navigate and manipulate terabyte-sized image volumes in VR. Using a number of different datasets, we demonstrate that, compared to widely used commercial software, consumer-grade VR presents a promising alternative for scientists.

ISAVS: Interactive Scalable Analysis and Visualization System

Modern science is inundated with ever increasing data sizes as computational capabilities and image acquisition techniques continue to improve. For example, simulations are tackling ever larger domains with higher fidelity, and high-throughput microscopy techniques generate larger data that are fundamental to gather biologically and medically relevant insights. As the image sizes exceed memory, and even sometimes local disk space, each step in a scientific workflow is impacted. Current software solutions enable data exploration with limited interactivity for visualization and analytic tasks. Furthermore analysis on HPC systems often require complex hand-written parallel implementations of algorithms that suffer from poor portability and maintainability. We present a software infrastructure that simplifies end-to-end visualization and analysis of massive data. First, a hierarchical streaming data access layer enables interactive exploration of remote data, with fast data fetching to test analytics on subsets of the data. Second, a library simplifies the process of developing new analytics algorithms, allowing users to rapidly prototype new approaches and deploy them in an HPC setting. Third, a scalable runtime system automates mapping analysis algorithms to whatever computational hardware is available, reducing the complexity of developing scaling algorithms. We demonstrate the usability and performance of our system using a use case from neuroscience: filtering, registration, and visualization of tera-scale microscopy data. We evaluate the performance of our system using a leadership-class supercomputer, Shaheen II.

Circuits and Mechanisms for Surround Modulation in Visual Cortex

Surround modulation (SM) is a fundamental property of sensory neurons in many species and sensory modalities. SM is the ability of stimuli in the surround of a neuron's receptive field (RF) to modulate (typically suppress) the neuron's response to stimuli simultaneously presented inside the RF, a property thought to underlie optimal coding of sensory information and important perceptual functions. Understanding the circuit and mechanisms for SM can reveal fundamental principles of computations in sensory cortices, from mouse to human. Current debate is centered over whether feedforward or intracortical circuits generate SM, and whether this results from increased inhibition or reduced excitation. Here we present a working hypothesis, based on theoretical and experimental evidence, that SM results from feedforward, horizontal, and feedback interactions with local recurrent connections, via synaptic mechanisms involving both increased inhibition and reduced recurrent excitation. In particular, strong and balanced recurrent excitatory and inhibitory circuits play a crucial role in the computation of SM.

A Scalable Cyberinfrastructure for Interactive Visualization of Terascale Microscopy Data

The goal of the recently emerged field of connectomics is to generate a wiring diagram of the brain at different scales. To identify brain circuitry, neuroscientists use specialized microscopes to perform multichannel imaging of labeled neurons at a very high resolution. CLARITY tissue clearing allows imaging labeled circuits through entire tissue blocks, without the need for tissue sectioning and section-to-section alignment. Imaging the large and complex non-human primate brain with sufficient resolution to identify and disambiguate between axons, in particular, produces massive data, creating great computational challenges to the study of neural circuits. Researchers require novel software capabilities for compiling, stitching, and visualizing large imagery. In this work, we detail the image acquisition process and a hierarchical streaming platform, ViSUS, that enables interactive visualization of these massive multi-volume datasets using a standard desktop computer. The ViSUS visualization framework has previously been shown to be suitable for 3D combustion simulation, climate simulation and visualization of large scale panoramic images. The platform is organized around a hierarchical cache oblivious data layout, called the IDX file format, which enables interactive visualization and exploration in ViSUS, scaling to the largest 3D images. In this paper we showcase the VISUS framework used in an interactive setting with the microscopy data.

High-resolution mapping of anatomical connections in marmoset extrastriate cortex reveals a complete representation of the visual field bordering dorsal V2

The primate visual cortex consists of many areas. The posterior areas (V1, V2, V3, and middle temporal) are thought to be common to all primate species. However, the organization of cortex immediately anterior to area V2 (the "third tier" cortex) remains controversial, particularly in New World primates. The main point of contention has been whether the third tier cortex consists of a single area V3, representing lower and upper visual quadrants in dorsal and ventral cortex, respectively, or of 2 distinct areas (the dorsomedial [DM] area and a V3-like area). Resolving this controversy is crucial to understand the function and evolution of the third tier cortex. We have addressed this issue in marmosets, by performing high-precision mapping of corticocortical connections in cortex bordering dorsal V2. Multiple closely spaced neuroanatomical tracer injections were placed across the full width of dorsal V2 or adjacent anterior cortex, and the location of resulting labeled cells mapped throughout whole flattened visual cortex. The resulting topographic patterns of labeled connections allowed us to define areas and their boundaries. We found that a complete representation of the visual field borders dorsal V2 and that the third tier cortex consists of 2 distinct areas. These results unequivocally support the DM model.

Anatomical evidence for classical and extra-classical receptive field completion across the discontinuous horizontal meridian representation of primate area V2

In primates, a split of the horizontal meridian (HM) representation at the V2 rostral border divides this area into dorsal (V2d) and ventral (V2v) halves (representing lower and upper visual quadrants, respectively), causing retinotopically neighboring loci across the HM to be distant within V2. How is perceptual continuity maintained across this discontinuous HM representation? Injections of neuroanatomical tracers in marmoset V2d demonstrated that cells near the V2d rostral border can maintain retinotopic continuity within their classical and extra-classical receptive field (RF), by making both local and long-range intra- and interareal connections with ventral cortex representing the upper visual quadrant. V2d neurons located <0.9-1.3 mm from the V2d rostral border, whose RFs presumably do not cross the HM, make nonretinotopic horizontal connections with V2v neurons in the supra- and infragranular layers. V2d neurons located <0.6-0.9 mm from the border, whose RFs presumably cross the HM, in addition make retinotopic local connections with V2v neurons in layer 4. V2d neurons also make interareal connections with upper visual field regions of extrastriate cortex, but not of MT or MTc outside the foveal representation. Labeled connections in ventral cortex appear to represent the "missing" portion of the connectional fields in V2d across the HM. We conclude that connections between dorsal and ventral cortex can create visual field continuity within a second-order discontinuous visual topography.