The relationship between voltage-sensitive dye imaging signals and spiking activity of neural populations in primate V1

Disparate nonlinear neural dynamics measured with different techniques in macaque and human V1

Diverse neuro-imaging techniques measure different aspects of neural responses with distinct spatial and temporal resolutions. Relating measured neural responses across different methods has been challenging. Here, we take a step towards overcoming this challenge, by comparing the nonlinearity of neural dynamics measured across methods. We used widefield voltage-sensitive dye imaging (VSDI) to measure neural population responses in macaque V1 to visual stimuli with a wide range of temporal waveforms. We found that stimulus-evoked VSDI responses are surprisingly near-additive in time. These results are qualitatively different from the strong sub-additive dynamics previously measured using fMRI and electrocorticography (ECoG) in human visual cortex with a similar set of stimuli. To test whether this discrepancy is specific to VSDI-a signal dominated by subthreshold neural activity, we repeated our measurements using widefield imaging of a genetically encoded calcium indicator (GcaMP6f)-a signal dominated by spiking activity, and found that GCaMP signals in macaque V1 are also near-additive. Therefore, the discrepancies in the extent of sub-additivity between the macaque and the human measurements are unlikely due to differences between sub- and supra-threshold neural responses. Finally, we use a simple yet flexible delayed normalization model to capture these different dynamics across measurements (with different model parameters). The model can potentially generalize to a broader set of stimuli, which aligns with previous suggestion that dynamic gain-control is a canonical computation contributing to neural processing in the brain.

Neural correlates of perceptual similarity masking in primate V1

Visual detection is a fundamental natural task. Detection becomes more challenging as the similarity between the target and the background in which it is embedded increases, a phenomenon termed 'similarity masking'. To test the hypothesis that V1 contributes to similarity masking, we used voltage sensitive dye imaging (VSDI) to measure V1 population responses while macaque monkeys performed a detection task under varying levels of target-background similarity. Paradoxically, we find that during an initial transient phase, V1 responses to the target are enhanced, rather than suppressed, by target-background similarity. This effect reverses in the second phase of the response, so that in this phase V1 signals are positively correlated with the behavioral effect of similarity. Finally, we show that a simple model with delayed divisive normalization can qualitatively account for our findings. Overall, our results support the hypothesis that a nonlinear gain control mechanism in V1 contributes to perceptual similarity masking.

Mesoscopic calcium imaging in a head-unrestrained male non-human primate using a lensless microscope

Mesoscopic calcium imaging enables studies of cell-type specific neural activity over large areas. A growing body of literature suggests that neural activity can be different when animals are free to move compared to when they are restrained. Unfortunately, existing systems for imaging calcium dynamics over large areas in non-human primates (NHPs) are table-top devices that require restraint of the animal's head. Here, we demonstrate an imaging device capable of imaging mesoscale calcium activity in a head-unrestrained male non-human primate. We successfully miniaturize our system by replacing lenses with an optical mask and computational algorithms. The resulting lensless microscope can fit comfortably on an NHP, allowing its head to move freely while imaging. We are able to measure orientation columns maps over a 20 mm2 field-of-view in a head-unrestrained macaque. Our work establishes mesoscopic imaging using a lensless microscope as a powerful approach for studying neural activity under more naturalistic conditions.

NEURAL CORRELATES OF PERCEPTUAL SIMILARITY MASKING IN PRIMATE V1

Visual detection is a fundamental natural task. Detection becomes more challenging as the similarity between the target and the background in which it is embedded increases, a phenomenon termed "similarity masking". To test the hypothesis that V1 contributes to similarity masking, we used voltage sensitive dye imaging (VSDI) to measure V1 population responses while macaque monkeys performed a detection task under varying levels of target-background similarity. Paradoxically, we find that during an initial transient phase, V1 responses to the target are enhanced, rather than suppressed, by target-background similarity. This effect reverses in the second phase of the response, so that in this phase V1 signals are positively correlated with the behavioral effect of similarity. Finally, we show that a simple model with delayed divisive normalization can qualitatively account for our findings. Overall, our results support the hypothesis that a nonlinear gain control mechanism in V1 contributes to perceptual similarity masking.

Activity-dependent feedback regulation of thalamocortical axon development by Lhx2 in cortical layer 4 neurons

Establishing neuronal circuits requires interactions between pre- and postsynaptic neurons. While presynaptic neurons were shown to play instructive roles for the postsynaptic neurons, how postsynaptic neurons provide feedback to regulate the presynaptic neuronal development remains elusive. To elucidate the mechanisms for circuit formation, we study the development of barrel cortex (the primary sensory cortex, S1), whose development is instructed by presynaptic thalamocortical axons (TCAs). In the first postnatal weeks, TCA terminals arborize in layer (L) 4 to fill in the barrel center, but it is unclear how TCA development is regulated. Here, we reported that the deletion of Lhx2 specifically in the cortical neurons in the conditional knockout (cKO) leads to TCA arborization defects, which is accompanied with deficits in sensory-evoked and spontaneous cortical activities and impaired lesion-induced plasticity following early whisker follicle ablation. Reintroducing Lhx2 back in L4 neurons in cKO ameliorated TCA arborization and plasticity defects. By manipulating L4 neuronal activity, we further demonstrated that Lhx2 induces TCA arborization via an activity-dependent mechanism. Additionally, we identified the extracellular signaling protein Sema7a as an activity-dependent downstream target of Lhx2 in regulating TCA branching. Thus, we discovered a bottom-up feedback mechanism for the L4 neurons to regulate TCA development.

Identification of a Developmental Switch in Information Transfer between Whisker S1 and S2 Cortex in Mice

The whiskers of rodents are a key sensory organ that provides critical tactile information for animal navigation and object exploration throughout life. Previous work has explored the developmental sensory-driven activation of the primary sensory cortex processing whisker information (wS1), also called barrel cortex. This body of work has shown that the barrel cortex is already activated by sensory stimuli during the first postnatal week. However, it is currently unknown when over the course of development these stimuli begin being processed by higher-order cortical areas, such as secondary whisker somatosensory area (wS2). Here we investigate the developmental engagement of wS2 by whisker stimuli and the emergence of corticocortical communication from wS1 to wS2. Using in vivo wide-field imaging and multielectrode recordings in control and conditional KO mice of either sex with thalamocortical innervation defects, we find that wS1 and wS2 are able to process bottom-up information coming from the thalamus from birth. We also identify that it is only at the end of the first postnatal week that wS1 begins to provide functional excitation into wS2, switching to more inhibitory actions after the second postnatal week. Therefore, we have uncovered a developmental window when information transfer between wS1 and wS2 reaches mature function.SIGNIFICANCE STATEMENT At the end of the first postnatal week, the primary whisker somatosensory area starts providing excitatory input to the secondary whisker somatosensory area 2. This excitatory drive weakens during the second postnatal week and switches to inhibition in the adult.

Stereo slant discrimination of planar 3D surfaces: Frontoparallel versus planar matching

Binocular stereo cues are important for discriminating 3D surface orientation, especially at near distances. We devised a single-interval task where observers discriminated the slant of a densely textured planar test surface relative to a textured planar surround reference surface. Although surfaces were rendered with correct perspective, the stimuli were designed so that the binocular cues dominated performance. Slant discrimination performance was measured as a function of the reference slant and the level of uncorrelated white noise added to the test-plane images in the left and right eyes. We compared human performance with an approximate ideal observer (planar matching [PM]) and two subideal observers. The PM observer uses the image in one eye and back projection to predict a test image in the other eye for all possible slants, tilts, and distances. The estimated slant, tilt, and distance are determined by the prediction that most closely matches the measured image in the other eye. The first subideal observer (local planar matching [LPM]) applies PM over local neighborhoods and then pools estimates across the test plane. The second suboptimal observer (local frontoparallel matching [LFM]) uses only location disparity. We find that the ideal observer (PM) and the first subideal observer (LPM) outperforms the second subideal observer (LFM), demonstrating the additional benefit of pattern disparities. We also find that all three model observers can account for human performance, if two free parameters are included: a fixed small level of internal estimation noise, and a fixed overall efficiency scalar on slant discriminability.

Similar neural and perceptual masking effects of low-power optogenetic stimulation in primate V1

Can direct stimulation of primate V1 substitute for a visual stimulus and mimic its perceptual effect? To address this question, we developed an optical-genetic toolkit to 'read' neural population responses using widefield calcium imaging, while simultaneously using optogenetics to 'write' neural responses into V1 of behaving macaques. We focused on the phenomenon of visual masking, where detection of a dim target is significantly reduced by a co-localized medium-brightness mask (Cornsweet and Pinsker, 1965; Whittle and Swanston, 1974). Using our toolkit, we tested whether V1 optogenetic stimulation can recapitulate the perceptual masking effect of a visual mask. We find that, similar to a visual mask, low-power optostimulation can significantly reduce visual detection sensitivity, that a sublinear interaction between visual- and optogenetic-evoked V1 responses could account for this perceptual effect, and that these neural and behavioral effects are spatially selective. Our toolkit and results open the door for further exploration of perceptual substitutions by direct stimulation of sensory cortex.

Similar masking effects of natural backgrounds on detection performances in humans, macaques, and macaque-V1 population responses

Visual systems evolve to process the stimuli that arise in the organism's natural environment, and hence, to fully understand the neural computations in the visual system, it is important to measure behavioral and neural responses to natural visual stimuli. Here, we measured psychometric and neurometric functions in the macaque monkey for detection of a windowed sine-wave target in uniform backgrounds and in natural backgrounds of various contrasts. The neurometric functions were obtained by near-optimal decoding of voltage-sensitive-dye-imaging (VSDI) responses at the retinotopic scale in primary visual cortex (V1). The results were compared with previous human psychophysical measurements made under the same conditions. We found that human and macaque behavioral thresholds followed the generalized Weber's law as function of contrast, and that both the slopes and the intercepts of the threshold as a function of background contrast match each other up to a single scale factor. We also found that the neurometric thresholds followed the generalized Weber's law with slopes and intercepts matching the behavioral slopes and intercepts up to a single scale factor. We conclude that human and macaque ability to detect targets in natural backgrounds are affected in the same way by background contrast, that these effects are consistent with population decoding at the retinotopic scale by down-stream circuits, and that the macaque monkey is an appropriate animal model for gaining an understanding of the neural mechanisms in humans for detecting targets in natural backgrounds. Finally, we discuss limitations of the current study and potential next steps.NEW & NOTEWORTHY We measured macaque detection performance in natural images and compared their performance to the detection sensitivity of neurophysiological responses recorded in the primary visual cortex (V1), and to the performance of human subjects. We found that 1) human and macaque behavioral performances are in quantitative agreement and 2) are consistent with near-optimal decoding of V1 population responses.

An Implantable Cranial Window Using a Collagen Membrane for Chronic Voltage-Sensitive Dye Imaging

Incorporating optical methods into implantable neural sensing devices is a challenging approach for brain-machine interfacing. Specifically, voltage-sensitive dye (VSD) imaging is a powerful tool enabling visualization of the network activity of thousands of neurons at high spatiotemporal resolution. However, VSD imaging usually requires removal of the dura mater for dye staining, and thereafter the exposed cortex needs to be protected using an optically transparent artificial dura. This is a major disadvantage that limits repeated VSD imaging over the long term. To address this issue, we propose to use an atelocollagen membrane as the dura substitute. We fabricated a small cranial chamber device, which is a tubular structure equipped with a collagen membrane at one end of the tube. We implanted the device into rats and monitored neural activity in the frontal cortex 1 week following surgery. The results indicate that the collagen membrane was chemically transparent, allowing VSD staining across the membrane material. The membrane was also optically transparent enough to pass light; forelimb-evoked neural activity was successfully visualized through the artificial dura. Because of its ideal chemical and optical manipulation capability, this collagen membrane may be widely applicable in various implantable neural sensors.

Advanced Circuit and Cellular Imaging Methods in Nonhuman Primates

Novel genetically encoded tools and advanced microscopy methods have revolutionized neural circuit analyses in insects and rodents over the last two decades. Whereas numerous technical hurdles originally barred these methodologies from success in nonhuman primates (NHPs), current research has started to overcome those barriers. In some cases, methodological advances developed with NHPs have even surpassed their precursors. One such advance includes new ultra-large imaging windows on NHP cortex, which are larger than the entire rodent brain and allow analysis unprecedented ultra-large-scale circuits. NHP imaging chambers now remain patent for periods longer than a mouse's lifespan, allowing for long-term all-optical interrogation of identified circuits and neurons over timeframes that are relevant to human cognitive development. Here we present some recent imaging advances brought forth by research teams using macaques and marmosets. These include technical developments in optogenetics; voltage-, calcium- and glutamate-sensitive dye imaging; two-photon and wide-field optical imaging; viral delivery; and genetic expression of indicators and light-activated proteins that result in the visualization of tens of thousands of identified cortical neurons in NHPs. We describe a subset of the many recent advances in circuit and cellular imaging tools in NHPs focusing here primarily on the research presented during the corresponding mini-symposium at the 2019 Society for Neuroscience annual meeting.

Suppressive Traveling Waves Shape Representations of Illusory Motion in Primary Visual Cortex of Awake Primate

How does the brain link visual stimuli across space and time? Visual illusions provide an experimental paradigm to study these processes. When two stationary dots are flashed in close spatial and temporal succession, human observers experience a percept of apparent motion. Large spatiotemporal separation challenges the visual system to keep track of object identity along the apparent motion path, the so-called "correspondence problem." Here, we use voltage-sensitive dye imaging in primary visual cortex (V1) of awake monkeys to show that intracortical connections within V1 can solve this issue by shaping cortical dynamics to represent the illusory motion. We find that the appearance of the second stimulus in V1 creates a systematic suppressive wave traveling toward the retinotopic representation of the first. Using a computational model, we show that the suppressive wave is the emergent property of a recurrent gain control fed by the intracortical network. This suppressive wave acts to explain away ambiguous correspondence problems and contributes to precisely encode the expected motion velocity at the surface of V1. Together, these results demonstrate that the nonlinear dynamics within retinotopic maps can shape cortical representations of illusory motion. Understanding these dynamics will shed light on how the brain links sensory stimuli across space and time, by preformatting population responses for a straightforward read-out by downstream areas.SIGNIFICANCE STATEMENT Traveling waves have recently been observed in different animal species, brain areas, and behavioral states. However, it is still unclear what are their functional roles. In the case of cortical visual processing, waves propagate across retinotopic maps and can hereby generate interactions between spatially and temporally separated instances of feedforward driven activity. Such interactions could participate in processing long-range apparent motion stimuli, an illusion for which no clear neuronal mechanisms have yet been proposed. Using this paradigm in awake monkeys, we show that suppressive traveling waves produce a spatiotemporal normalization of apparent motion stimuli. Our study suggests that cortical waves shape the representation of illusory moving stimulus within retinotopic maps for a straightforward read-out by downstream areas.

Inverted Encoding Models Reconstruct an Arbitrary Model Response, Not the Stimulus

Probing how large populations of neurons represent stimuli is key to understanding sensory representations as many stimulus characteristics can only be discerned from population activity and not from individual single-units. Recently, inverted encoding models have been used to produce channel response functions from large spatial-scale measurements of human brain activity that are reminiscent of single-unit tuning functions and have been proposed to assay "population-level stimulus representations" (Sprague et al., 2018a). However, these channel response functions do not assay population tuning. We show by derivation that the channel response function is only determined up to an invertible linear transform. Thus, these channel response functions are arbitrary, one of an infinite family and therefore not a unique description of population representation. Indeed, simulations demonstrate that bimodal, even random, channel basis functions can account perfectly well for population responses without any underlying neural response units that are so tuned. However, the approach can be salvaged by extending it to reconstruct the stimulus, not the assumed model. We show that when this is done, even using bimodal and random channel basis functions, a unimodal function peaking at the appropriate value of the stimulus is recovered which can be interpreted as a measure of population selectivity. More precisely, the recovered function signifies how likely any value of the stimulus is, given the observed population response. Whether an analysis is recovering the hypothetical responses of an arbitrary model rather than assessing the selectivity of population representations is not an issue unique to the inverted encoding model and human neuroscience, but a general problem that must be confronted as more complex analyses intervene between measurement of population activity and presentation of data.

Nonlinear Lateral Interactions in V1 Population Responses Explained by a Contrast Gain Control Model

How do cortical responses to local image elements combine to form a spatial pattern of population activity in primate V1? Here, we used voltage-sensitive dye imaging, which measures summed membrane potential activity, to examine the rules that govern lateral interactions between the representations of two small local-oriented elements in macaque (Macaca mulatta) V1. We find strong subadditive and mostly orientation-independent interactions for nearby elements [2-4 mm interelement cortical distance (IED)] that gradually become linear at larger separations (>6 mm IED). These results are consistent with a population gain control model describing nonlinear V1 population responses to single oriented elements. However, because of the membrane potential-to-spiking accelerating nonlinearity, the model predicts supra-additive lateral interactions of spiking responses for intermediate separations at a range of locations between the two elements, consistent with some prior facilitatory effects observed in electrophysiology and psychophysics. Overall, our results suggest that population-level lateral interactions in V1 are primarily explained by a simple orientation-independent contrast gain control mechanism.SIGNIFICANCE STATEMENT Interactions between representations of simple visual elements such as oriented edges in primary visual cortex (V1) are thought to contribute to our ability to easily integrate contours and segment surfaces, but the mechanisms that govern these interactions are primarily unknown. Our study provides novel evidence that lateral interactions at the population level are governed by a simple contrast gain-control mechanism, and we show how this divisive gain-control mechanism can give rise to apparently facilitatory spiking responses.

Scale-Invariant Visual Capabilities Explained by Topographic Representations of Luminance and Texture in Primate V1

Humans have remarkable scale-invariant visual capabilities. For example, our orientation discrimination sensitivity is largely constant over more than two orders of magnitude of variations in stimulus spatial frequency (SF). Orientation-selective V1 neurons are likely to contribute to orientation discrimination. However, because at any V1 location neurons have a limited range of receptive field (RF) sizes, we predict that at low SFs V1 neurons will carry little orientation information. If this were the case, what could account for the high behavioral sensitivity at low SFs? Using optical imaging in behaving macaques, we show that, as predicted, V1 orientation-tuned responses drop rapidly with decreasing SF. However, we reveal a surprising coarse-scale signal that corresponds to the projection of the luminance layout of low-SF stimuli to V1's retinotopic map. This homeomorphic and distributed representation, which carries high-quality orientation information, is likely to contribute to our striking scale-invariant visual capabilities.

In Vivo Two-Photon Voltage Imaging with Sulfonated Rhodamine Dyes

Optical methods that rely on fluorescence for mapping changes in neuronal membrane potential in the brains of awake animals provide a powerful way to interrogate the activity of neurons that underlie neural computations ranging from sensation and perception to learning and memory. To achieve this goal, fluorescent indicators should be bright, highly sensitive to small changes in membrane potential, nontoxic, and excitable with infrared light. We report a new class of fluorescent, voltage-sensitive dyes: sulfonated rhodamine voltage reporters (sRhoVR), synthetic fluorophores with high voltage sensitivity, excellent two-photon performance, and compatibility in intact mouse brains. sRhoVR dyes are based on a tetramethyl rhodamine fluorophore coupled to a phenylenevinylene molecular wire/diethyl aniline voltage-sensitive domain. When applied to cells, sRhoVR dyes localize to the plasma membrane and respond to membrane depolarization with a fluorescence increase. The best of the new dyes, sRhoVR 1, displays a 44% ΔF/F increase in fluorescence per 100 mV change, emits at 570 nm, and possesses excellent two-photon absorption of approximately 200 GM at 840 nm. sRhoVR 1 can detect action potentials in cultured rat hippocampal neurons under both single- and two-photon illumination with sufficient speed and sensitivity to report on action potentials in single trials, without perturbing underlying physiology or membrane properties. The combination of speed, sensitivity, and brightness under two-photon illumination makes sRhoVR 1 a promising candidate for in vivo imaging in intact brains. We show sRhoVR powerfully complements electrode-based modes of neuronal activity recording in the mouse brain by recording neuronal transmembrane potentials from the neuropil of layer 2/3 of the mouse barrel cortex in concert with extracellularly recorded local field potentials (LFPs). sRhoVR imaging reveals robust depolarization in response to whisker stimulation; concurrent electrode recordings reveal negative deflections in the LFP recording, consistent with the canonical thalamocortical response. Importantly, sRhoVR 1 can be applied in mice with chronic optical windows, presaging its utility in dissecting and resolving voltage dynamics using two-photon functional imaging in awake, behaving animals.

Linking V1 Activity to Behavior

A long-term goal of visual neuroscience is to develop and test quantitative models that account for the moment-by-moment relationship between neural responses in early visual cortex and human performance in natural visual tasks. This review focuses on efforts to address this goal by measuring and perturbing the activity of primary visual cortex (V1) neurons while nonhuman primates perform demanding, well-controlled visual tasks. We start by describing a conceptual approach-the decoder linking model (DLM) framework-in which candidate decoding models take neural responses as input and generate predicted behavior as output. The ultimate goal in this framework is to find the actual decoder-the model that best predicts behavior from neural responses. We discuss key relevant properties of primate V1 and review current literature from the DLM perspective. We conclude by discussing major technological and theoretical advances that are likely to accelerate our understanding of the link between V1 activity and behavior.

A Multidisciplinary Approach Reveals an Age-Dependent Expression of a Novel Bioactive Peptide, Already Involved in Neurodegeneration, in the Postnatal Rat Forebrain

The basal forebrain has received much attention due to its involvement in multiple cognitive functions, but little is known about the basic neuronal mechanisms underlying its development, nor those mediating its primary role in Alzheimer’s disease. We have previously suggested that a novel 14-mer peptide, ‘T14’, could play a pivotal role in Alzheimer’s disease, via reactivation of a developmental signaling pathway. In this study, we have characterized T14 in the context of post-natal rat brain development, using a combination of different techniques. Ex-vivo rat brain slices containing the basal forebrain, at different stages of development, were used to investigate large-scale neuronal network activity in real time with voltage-sensitive dye imaging. Subsequent Western blot analysis revealed the expression profile of endogenous T14, its target alpha7 nicotinic receptor and the familiar markers of Alzheimer’s: amyloid beta and phosphorylated Tau. Results indicated maximal neuronal activity at the earliest ages during development, reflected in a concomitant profile of T14 peptide levels and related proteins. In conclusion, these findings show that the peptide, already implicated in neurodegenerative events, has an age-dependent expression, suggesting a possible contribution to the physiological mechanisms underlying brain maturation.

High-performance, inexpensive setup for simultaneous multisite recording of electrophysiological signals and mesoscale voltage imaging in the mouse cortex

Simultaneous recording of optical and electrophysiological signals from multiple cortical areas may provide crucial information to expand our understanding of cortical function. However, the insertion of multiple electrodes into the brain may compromise optical imaging by both restricting the field of view and interfering with the approaches used to stabilize the specimen. Existing methods that combine electrophysiological recording and optical imaging in vivo implement either multiple surface electrodes, silicon probes, or a single electrode for deeper recordings. To address such limitation, we built a microelectrode array (hyperdrive, patent US5928143 A) compatible with wide-field imaging that allows insertion of up to 12 probes into a large brain area (8 mm diameter). The hyperdrive is comprised of a circle of individual microdrives where probes are positioned at an angle leaving a large brain area unobstructed for wide-field imaging. Multiple tetrodes and voltage-sensitive dye imaging were used for acute simultaneous registration of spontaneous and evoked cortical activity in anesthetized mice. The electrophysiological signals were used to extract local field potential (LFP) traces, multiunit, and single-unit spiking activity. To demonstrate our approach, we compared LFP and VSD signals over multiple regions of the cortex and analyzed the relationship between single-unit and global cortical population activities. The study of the interactions between cortical activity at local and global scales, such as the one presented in this work, can help to expand our knowledge of brain function.

The Features and Functions of Neuronal Assemblies: Possible Dependency on Mechanisms beyond Synaptic Transmission

"Neuronal assemblies" are defined here as coalitions within the brain of millions of neurons extending in space up to 1-2 mm, and lasting for hundreds of milliseconds: as such they could potentially link bottom-up, micro-scale with top-down, macro-scale events. The perspective first compares the features in vitro versus in vivo of this underappreciated "meso-scale" level of brain processing, secondly considers the various diverse functions in which assemblies may play a pivotal part, and thirdly analyses whether the surprisingly spatially extensive and prolonged temporal properties of assemblies can be described exclusively in terms of classic synaptic transmission or whether additional, different types of signaling systems are likely to operate. Based on our own voltage-sensitive dye imaging (VSDI) data acquired in vitro we show how restriction to only one signaling process, i.e., synaptic transmission, is unlikely to be adequate for modeling the full profile of assemblies. Based on observations from VSDI with its protracted spatio-temporal scales, we suggest that two other, distinct processes are likely to play a significant role in assembly dynamics: "volume" transmission (the passive diffusion of diverse bioactive transmitters, hormones, and modulators), as well as electrotonic spread via gap junctions. We hypothesize that a combination of all three processes has the greatest potential for deriving a realistic model of assemblies and hence elucidating the various complex brain functions that they may mediate.

The need for calcium imaging in nonhuman primates: New motor neuroscience and brain-machine interfaces

A central goal of neuroscience is to understand how populations of neurons coordinate and cooperate in order to give rise to perception, cognition, and action. Nonhuman primates (NHPs) are an attractive model with which to understand these mechanisms in humans, primarily due to the strong homology of their brains and the cognitively sophisticated behaviors they can be trained to perform. Using electrode recordings, the activity of one to a few hundred individual neurons may be measured electrically, which has enabled many scientific findings and the development of brain-machine interfaces. Despite these successes, electrophysiology samples sparsely from neural populations and provides little information about the genetic identity and spatial micro-organization of recorded neurons. These limitations have spurred the development of all-optical methods for neural circuit interrogation. Fluorescent calcium signals serve as a reporter of neuronal responses, and when combined with post-mortem optical clearing techniques such as CLARITY, provide dense recordings of neuronal populations, spatially organized and annotated with genetic and anatomical information. Here, we advocate that this methodology, which has been of tremendous utility in smaller animal models, can and should be developed for use with NHPs. We review here several of the key opportunities and challenges for calcium-based optical imaging in NHPs. We focus on motor neuroscience and brain-machine interface design as representative domains of opportunity within the larger field of NHP neuroscience.

Probing the functional impact of sub-retinal prosthesis

Retinal prostheses are promising tools for recovering visual functions in blind patients but, unfortunately, with still poor gains in visual acuity. Improving their resolution is thus a key challenge that warrants understanding its origin through appropriate animal models. Here, we provide a systematic comparison between visual and prosthetic activations of the rat primary visual cortex (V1). We established a precise V1 mapping as a functional benchmark to demonstrate that sub-retinal implants activate V1 at the appropriate position, scalable to a wide range of visual luminance, but with an aspect-ratio and an extent much larger than expected. Such distorted activation profile can be accounted for by the existence of two sources of diffusion, passive diffusion and activation of ganglion cells’ axons en passant. Reverse-engineered electrical pulses based on impedance spectroscopy is the only solution we tested that decreases the extent and aspect-ratio, providing a promising solution for clinical applications.

DOI:http://dx.doi.org/10.7554/eLife.12687.001

One of the most common causes of blindness is a disorder called retinitis pigmentosa. In a healthy eye, the surface at the back of the eye – called the retina – contains cells called photoreceptors that detect light and convert it into electrical signals for the brain to process. In people with retinitis pigmentosa, these photoreceptor cells die off gradually, which leads to loss of vision.

The only treatment available for retinitis pigmentosa is to have an artificial retina implanted into the eye. The artificial retina consists of an array of tiny electrodes, which take over from the damaged photoreceptors and generate electrical signals. The person with the implant perceives these electrical signals as bright flashes called “phosphenes”. However, the phosphenes are too large and imprecise to provide the person with vision that is good enough for tasks such as walking unaided or reading.

To find out why artificial retinas produce such poor resolution, Roux et al. compared how a rat’s brain responds to either natural visual stimuli or activation of implanted an array of micro-electrodes. Both the micro-electrodes and the natural stimuli activated the same areas of the brain. However, the micro-electrodes produced larger and more elongated patterns of activation. This is because the electrical currents generated by the micro-electrodes diffused throughout the retinal tissue and activated other neurons besides those intended. To overcome this problem, Roux et al. tested different ways of stimulating the micro-electrodes in order to identify those that induce the desired patterns of brain activity. This approach – known as reverse engineering – did indeed improve the performance of the micro-electrode array.

The next step is to extend these findings, which were obtained in healthy rats, to non-human primates or animal models of retinitis pigmentosa to better understand the condition in humans. In addition, combining the current approach with other existing techniques should further improve the vision that can be achieved with artificial retinas.

DOI:http://dx.doi.org/10.7554/eLife.12687.002

Calcium imaging with genetically encoded indicators in behaving primates

Understanding the neural basis of behaviour requires studying brain activity in behaving subjects using complementary techniques that measure neural responses at multiple spatial scales, and developing computational tools for understanding the mapping between these measurements. Here we report the first results of widefield imaging of genetically encoded calcium indicator (GCaMP6f) signals from V1 of behaving macaques. This technique provides a robust readout of visual population responses at the columnar scale over multiple mm² and over several months. To determine the quantitative relation between the widefield GCaMP signals and the locally pooled spiking activity, we developed a computational model that sums the responses of V1 neurons characterized by prior single unit measurements. The measured tuning properties of the GCaMP signals to stimulus contrast, orientation and spatial position closely match the predictions of the model, suggesting that widefield GCaMP signals are linearly related to the summed local spiking activity.

DOI:http://dx.doi.org/10.7554/eLife.16178.001

An important question in brain research is how neurons and the circuits they form process information to produce behavior. To understand what happens in a human brain, it is necessary to study a brain of similar complexity, such as that of a primate. Examining how the neurons in a brain region called the visual cortex process information about what we see is especially informative. This is because animals can be taught to perform different visual tasks, and because the visual cortex is relatively easy to access. In principle, therefore, it should be possible to use modern genetic and imaging techniques to study the primate visual system, but, until now, that has not been the case.

Like much of the brain, the visual cortex consists of different classes of neurons that can excite, inhibit or modulate the activity of neighboring neurons. One way to study how these different classes of neurons interact with each other is to alter the animal’s DNA, such that only one cell type stands out during the experiment, allowing its role in the brain to be closely monitored. This technique has been used to study the interactions among neurons in the rodent brain, because rodent DNA is easy to alter. However, it is not easy to manipulate primate DNA.

Seidemann et al. have, therefore, developed a new technique that can target a specific class of neurons, allowing the activity of just these cells to be distinguished from the rest. The method uses specially designed harmless viruses to produce foreign proteins in the excitatory neurons of the visual cortex in an adult macaque. The optical properties of the proteins change when the neuron they are in is active, allowing the activity of the excitatory neurons to be detected and tracked in awake animals while they perform a visual task.

Previously, the activity of neurons in the primate visual cortex could only be measured using dyes that indiscriminately reported the activity of all the neurons present. Seidemann et al. found that, in addition to being more selective than the dye-based method, the new technique also more accurately depicted neuronal action potentials, which are the primary units of information in the brain.

Seidemann et al. now plan to use a similar method to study the activity of the inhibitory neurons of the primate visual cortex. Further examination of both excitatory and inhibitory neurons at much higher magnification, using a different microscopy technique, will also reveal more subtle features of their responses during visual tasks.

DOI:http://dx.doi.org/10.7554/eLife.16178.002

Temporal Asymmetry in Dark-Bright Processing Initiates Propagating Activity across Primary Visual Cortex

Differences between visual pathways representing darks and lights have been shown to affect spatial resolution and detection timing. Both psychophysical and physiological studies suggest an underlying retinal origin with amplification in primary visual cortex (V1). Here we show that temporal asymmetries in the processing of darks and lights create motion in terms of propagating activity across V1. Exploiting the high spatiotemporal resolution of voltage-sensitive dye imaging, we captured population responses to abrupt local changes of luminance in cat V1. For stimulation we used two neighboring small squares presented on either bright or dark backgrounds. When a single square changed from dark to bright or vice versa, we found coherent population activity emerging at the respective retinal input locations. However, faster rising and decay times were obtained for the bright to dark than the dark to bright changes. When the two squares changed luminance simultaneously in opposite polarities, we detected a propagating wave front of activity that originated at the cortical location representing the darkened square and rapidly expanded toward the region representing the brightened location. Thus, simultaneous input led to sequential activation across cortical retinotopy. Importantly, this effect was independent of the squares' contrast with the background. We suggest imbalance in dark-bright processing as a driving force in the generation of wave-like activity. Such propagation may convey motion signals and influence perception of shape whenever abrupt shifts in visual objects or gaze cause counterchange of luminance at high-contrast borders.

SIGNIFICANCE STATEMENT

An elementary process in vision is the detection of darks and lights through the retina via ON and OFF channels. Psychophysical and physiological studies suggest that differences between these channels affect spatial resolution and detection thresholds. Here we show that temporal asymmetries in the processing of darks and lights create motion signals across visual cortex. Using two neighboring squares, which simultaneously counterchanged luminance, we discovered propagating activity that was strictly drawn out from cortical regions representing the darkened location. Thus, a synchronous stimulus event translated into sequential wave-like brain activation. Such propagation may convey motion signals accessible in higher brain areas, whenever abrupt shifts in visual objects or gaze cause counterchange of luminance at high-contrast borders.

Effects of GABAA kinetics on cortical population activity: computational studies and physiological confirmations

Voltage-sensitive dye (VSD) imaging produces an unprecedented real-time and high-resolution mesoscopic signal to measure the cortical population activity. We have previously shown that the neuronal compartments contributions to the signal are dynamic and stimulus-dependent (Chemla S, Chavane F. Neuroimage 53: 420-438, 2010). Moreover, the VSD signal can also be strongly affected by the network state, such as in anesthetized vs. awake preparations. Here, we investigated the impact of the network state, through GABAA receptors modulation, on the VSD signal using a computational approach. We therefore systematically measured the effect of the GABAA-mediated inhibitory postsynaptic potentials (IPSPs) decay time constant (τG) on our modeled VSD response to an input stimulus of increasing strength. Our simulations suggest that τG strongly modulates the dynamics of the VSD signal, affecting the amplitude, input response function, and the transient balance of excitation and inhibition. We confirmed these predictions experimentally on awake and anesthetized monkeys, comparing VSD responses to drifting gratings stimuli of various contrasts. Lastly, one in vitro study has suggested that GABAA receptors may also be directly affected by the VSDs themselves (Mennerick S, Chisari M, Shu H, Taylor A, Vasek M, Eisenman L, Zorumski C. J Neurosci 30: 2871-2879, 2010). Our modeling approach suggests that the type of modulation described in this study would actually have a negligible influence on the population response. This study highlights that functional results acquired with different techniques and network states must be compared with caution. Biophysical models are proposed here as an adequate tool to delineate the domain of VSD data interpretation.

Integrating Levels of Analysis in Systems and Cognitive Neurosciences: Selective Attention as a Case Study

Neuroscience is inherently interdisciplinary, rapidly expanding beyond its roots in biological sciences to many areas of the social and physical sciences. This expansion has led to more sophisticated ways of thinking about the links between brains and behavior and has inspired the development of increasingly advanced tools to characterize the activity of large populations of neurons. However, along with these advances comes a heightened risk of fostering confusion unless efforts are made to better integrate findings across different model systems and to develop a better understanding about how different measurement techniques provide mutually constraining information. Here we use selective visuospatial attention as a case study to highlight the importance of these issues, and we suggest that exploiting multiple measures can better constrain models that relate neural activity to animal behavior.

Primary visual cortex represents the difference between past and present

The visual system is confronted with rapidly changing stimuli in everyday life. It is not well understood how information in such a stream of input is updated within the brain. We performed voltage-sensitive dye imaging across the primary visual cortex (V1) to capture responses to sequences of natural scene contours. We presented vertically and horizontally filtered natural images, and their superpositions, at 10 or 33 Hz. At low frequency, the encoding was found to represent not the currently presented images, but differences in orientation between consecutive images. This was in sharp contrast to more rapid sequences for which we found an ongoing representation of current input, consistent with earlier studies. Our finding that for slower image sequences, V1 does no longer report actual features but represents their relative difference in time counteracts the view that the first cortical processing stage must always transfer complete information. Instead, we show its capacities for change detection with a new emphasis on the role of automatic computation evolving in the 100-ms range, inevitably affecting information transmission further downstream.

Long-range traveling waves of activity triggered by local dichoptic stimulation in V1 of behaving monkeys

Traveling waves of cortical activity, in which local stimulation triggers lateral spread of activity to distal locations, have been hypothesized to play an important role in cortical function. However, there is conflicting physiological evidence for the existence of spreading traveling waves of neural activity triggered locally. Dichoptic stimulation, in which the two eyes view dissimilar monocular patterns, can lead to dynamic wave-like fluctuations in visual perception and therefore, provides a promising means for identifying and studying cortical traveling waves. Here, we used voltage-sensitive dye imaging to test for the existence of traveling waves of activity in the primary visual cortex of awake, fixating monkeys viewing dichoptic stimuli. We find clear traveling waves that are initiated by brief, localized contrast increments in one of the monocular patterns and then, propagate at speeds of ∼ 30 mm/s. These results demonstrate that under an appropriate visual context, circuitry in visual cortex in alert animals is capable of supporting long-range traveling waves triggered by local stimulation.

Voltage-sensitive dye imaging of transcranial magnetic stimulation-induced intracortical dynamics

Transcranial magnetic stimulation (TMS) is widely used in clinical interventions and basic neuroscience. Additionally, it has become a powerful tool to drive plastic changes in neuronal networks. However, highly resolved recordings of the immediate TMS effects have remained scarce, because existing recording techniques are limited in spatial or temporal resolution or are interfered with by the strong TMS-induced electric field. To circumvent these constraints, we performed optical imaging with voltage-sensitive dye (VSD) in an animal experimental setting using anaesthetized cats. The dye signals reflect gradual changes in the cells' membrane potential across several square millimeters of cortical tissue, thus enabling direct visualization of TMS-induced neuronal population dynamics. After application of a single TMS pulse across visual cortex, brief focal activation was immediately followed by synchronous suppression of a large pool of neurons. With consecutive magnetic pulses (10 Hz), widespread activity within this "basin of suppression" increased stepwise to suprathreshold levels and spontaneous activity was enhanced. Visual stimulation after repetitive TMS revealed long-term potentiation of evoked activity. Furthermore, loss of the "deceleration-acceleration" notch during the rising phase of the response, as a signature of fast intracortical inhibition detectable with VSD imaging, indicated weakened inhibition as an important driving force of increasing cortical excitability. In summary, our data show that high-frequency TMS changes the balance between excitation and inhibition in favor of an excitatory cortical state. VSD imaging may thus be a promising technique to trace TMS-induced changes in excitability and resulting plastic processes across cortical maps with high spatial and temporal resolutions.

Wide-field in vivo neocortical calcium dye imaging using a convection-enhanced loading technique combined with simultaneous multiwavelength imaging of voltage-sensitive dyes and hemodynamic signals

In vivo calcium imaging is an incredibly powerful technique that provides simultaneous information on fast neuronal events, such as action potentials and subthreshold synaptic activity, as well as slower events that occur in the glia and surrounding neuropil. Bulk-loading methods that involve multiple injections can be used for single-cell as well as wide-field imaging studies. However, multiple injections result in inhomogeneous loading as well as multiple sites of potential cortical injury. We used convection-enhanced delivery to create smooth, continuous loading of a large area of the cortical surface through a solitary injection site and demonstrated the efficacy of the technique using confocal microscopy imaging of single cells and physiological responses to single-trial events of spontaneous activity, somatosensory-evoked potentials, and epileptiform events. Combinations of calcium imaging with voltage-sensitive dye and intrinsic signal imaging demonstrate the utility of this technique in neurovascular coupling investigations. Convection-enhanced loading of calcium dyes may be a useful technique to advance the study of cortical processing when widespread loading of a wide-field imaging is required.

An illusion predicted by V1 population activity implicates cortical topography in shape perception

Mammalian primary visual cortex (V1) is topographically organized such that the pattern of neural activation in V1 reflects the location and spatial extent of visual elements in the retinal image, but it is unclear whether this organization contributes to visual perception. We combined computational modeling, voltage-sensitive dye imaging (VSDI) in behaving monkeys and behavioral measurements in humans to investigate whether the large-scale topography of V1 population responses influences shape judgments. Specifically, we used a computational model to design visual stimuli that had the same physical shape, but were predicted to elicit variable V1 response spread. We confirmed these predictions with VSDI. Finally, we designed a behavioral task in which human observers judged the shapes of these stimuli and found that their judgments were systematically distorted by the spread of V1 activity. This illusion suggests that the topographic pattern of neural population responses in visual cortex contributes to visual perception.

Representation of the visual field in the primary visual area of the marmoset monkey: magnification factors, point-image size, and proportionality to retinal ganglion cell density

The primary visual area (V1) forms a systematic map of the visual field, in which adjacent cell clusters represent adjacent points of visual space. A precise quantification of this map is key to understanding the anatomical relationships between neurons located in different stations of the visual pathway, as well as the neural bases of visual performance in different regions of the visual field. We used computational methods to quantify the visual topography of V1 in the marmoset (Callithrix jacchus), a small diurnal monkey. The receptive fields of neurons throughout V1 were mapped in two anesthetized animals using electrophysiological recordings. Following histological reconstruction, precise 3D reconstructions of the V1 surface and recording sites were generated. We found that the areal magnification factor (M(A) ) decreases with eccentricity following a function that has the same slope as that observed in larger diurnal primates, including macaque, squirrel, and capuchin monkeys, and humans. However, there was no systematic relationship between M(A) and polar angle. Despite individual variation in the shape of V1, the relationship between M(A) and eccentricity was preserved across cases. Comparison between V1 and the retinal ganglion cell density demonstrated preferential magnification of central space in the cortex. The size of the cortical compartment activated by a punctiform stimulus decreased from the foveal representation towards the peripheral representation. Nonetheless, the relationship between the receptive field sizes of V1 cells and the density of ganglion cells suggested that each V1 cell receives information from a similar number of retinal neurons, throughout the visual field.

Temporally-structured acquisition of multidimensional optical imaging data facilitates visualization of elusive cortical representations in the behaving monkey

Fundamental understanding of higher cognitive functions can greatly benefit from imaging of cortical activity with high spatiotemporal resolution in the behaving non-human primate. To achieve rapid imaging of high-resolution dynamics of cortical representations of spontaneous and evoked activity, we designed a novel data acquisition protocol for sensory stimulation by rapidly interleaving multiple stimuli in continuous sessions of optical imaging with voltage-sensitive dyes. We also tested a new algorithm for the "temporally structured component analysis" (TSCA) of a multidimensional time series that was developed for our new data acquisition protocol, but was tested only on simulated data (Blumenfeld, 2010). In addition to the raw data, the algorithm incorporates prior knowledge about the temporal structure of the data as well as input from other information. Here we showed that TSCA can successfully separate functional signal components from other signals referred to as noise. Imaging of responses to multiple visual stimuli, utilizing voltage-sensitive dyes, was performed on the visual cortex of awake monkeys. Multiple cortical representations, including orientation and ocular dominance maps as well as the hitherto elusive retinotopic representation of orientation stimuli, were extracted in only 10s of imaging, approximately two orders of magnitude faster than accomplished by conventional methods. Since the approach is rather general, other imaging techniques may also benefit from the same stimulation protocol. This methodology can thus facilitate rapid optical imaging explorations in monkeys, rodents and other species with a versatility and speed that were not feasible before.

Cortical long-range interactions embed statistical knowledge of natural sensory input: a voltage-sensitive dye imaging study

How is contextual processing as demonstrated with simplified stimuli, cortically enacted in response to ecologically relevant complex and dynamic stimuli? Using voltage-sensitive dye imaging, we captured mesoscopic population dynamics across several square millimeters of cat primary visual cortex. By presenting natural movies locally through either one or two adjacent apertures, we show that simultaneous presentation leads to mutual facilitation of activity. These synergistic effects were most effective when both movie patches originated from the same natural movie, thus forming a coherent stimulus in which the inherent spatio-temporal structure of natural movies were preserved in accord with Gestalt principles of perceptual organization. These results suggest that natural sensory input triggers cooperative mechanisms that are imprinted into the cortical functional architecture as early as in primary visual cortex.

Attentional modulations related to spatial gating but not to allocation of limited resources in primate V1

Attention can modulate neural responses in sensory cortical areas and improve behavioral performance in perceptual tasks. However, the nature and purpose of these modulations remain under debate. Here we used voltage-sensitive dye imaging (VSDI) to measure V1 population responses while monkeys performed a difficult detection task under focal or distributed attention. We found that V1 responses at attended locations are significantly elevated relative to actively ignored or irrelevant locations, consistent with the hypothesis that an important goal of attention in V1 is to highlight task-relevant information. Surprisingly, these modulations were indistinguishable under focal and distributed attention, suggesting a minor or no role for attention as a mechanism for allocating limited representational resources in V1. The response elevation at attended locations is additive, is widespread, and starts shortly before stimulus onset. This elevation could contribute to spatial gating by biasing competition in subsequent processing stages in favor of attended stimuli.