Assessment of optogenetically-driven strategies for prosthetic restoration of cortical vision in large-scale neural simulation of V1

A virtual patient simulation modeling the neural and perceptual effects of human visual cortical stimulation, from pulse trains to percepts

The field of cortical sight restoration prostheses is making rapid progress with three clinical trials of visual cortical prostheses underway. However, as yet, we have only limited insight into the perceptual experiences produced by these implants. Here we describe a computational model or 'virtual patient', based on the neurophysiological architecture of V1, which successfully predicts the perceptual experience of participants across a wide range of previously published human cortical stimulation studies describing the location, size, brightness and spatiotemporal shape of electrically induced percepts in humans. Our simulations suggest that, in the foreseeable future the perceptual quality of cortical prosthetic devices is likely to be limited by the neurophysiological organization of visual cortex, rather than engineering constraints.

Bridging model and experiment in systems neuroscience with Cleo: the Closed-Loop, Electrophysiology, and Optophysiology simulation testbed

Systems neuroscience has experienced an explosion of new tools for reading and writing neural activity, enabling exciting new experiments such as all-optical or closed-loop control that effect powerful causal interventions. At the same time, improved computational models are capable of reproducing behavior and neural activity with increasing fidelity. Unfortunately, these advances have drastically increased the complexity of integrating different lines of research, resulting in the missed opportunities and untapped potential of suboptimal experiments. Experiment simulation can help bridge this gap, allowing model and experiment to better inform each other by providing a low-cost testbed for experiment design, model validation, and methods engineering. Specifically, this can be achieved by incorporating the simulation of the experimental interface into our models, but no existing tool integrates optogenetics, two-photon calcium imaging, electrode recording, and flexible closed-loop processing with neural population simulations. To address this need, we have developed Cleo: the Closed-Loop, Electrophysiology, and Optophysiology experiment simulation testbed. Cleo is a Python package enabling injection of recording and stimulation devices as well as closed-loop control with realistic latency into a Brian spiking neural network model. It is the only publicly available tool currently supporting two-photon and multi-opsin/wavelength optogenetics. To facilitate adoption and extension by the community, Cleo is open-source, modular, tested, and documented, and can export results to various data formats. Here we describe the design and features of Cleo, validate output of individual components and integrated experiments, and demonstrate its utility for advancing optogenetic techniques in prospective experiments using previously published systems neuroscience models.

Theoretical prediction of broadband ambient light optogenetic vision restoration with ChRmine and its mutants

Vision restoration is one of the most promising applications of optogenetics. However, it is limited due to the poor-sensitivity, slow-kinetics and narrow band absorption spectra of opsins. Here, a detailed theoretical study of retinal ganglion neurons (RGNs) expressed with ChRmine, ReaChR, CoChR, CatCh and their mutants, with near monochromatic LEDs, and broadband sunlight, halogen lamp, RGB LED light, and pure white light sources has been presented. All the opsins exhibit improved light sensitivity and larger photocurrent on illuminating with broadband light sources compared to narrow band LEDs. ChRmine allows firing at ambient sunlight (1.5 nW/mm2) and pure white light (1.2 nW/mm2), which is lowest among the opsins considered. The broadband activation spectrum of ChRmine and its mutants is also useful to restore color sensitivity. Although ChRmine exhibits slower turn-off kinetics with broadband light, high-fidelity spikes can be evoked upto 50 Hz. This limit extends upto 80 Hz with the improved hsChRmine mutant although it requires double the irradiance compared to ChRmine. The present study shows that ChRmine and its mutants allow activation of RGNs with ambient light which is useful for goggle-free white light optogenetic retinal prostheses with improved quality of restored vision.

Optogenetic activation of visual thalamus generates artificial visual percepts

The lateral geniculate nucleus (LGN), a retinotopic relay center where visual inputs from the retina are processed and relayed to the visual cortex, has been proposed as a potential target for artificial vision. At present, it is unknown whether optogenetic LGN stimulation is sufficient to elicit behaviorally relevant percepts, and the properties of LGN neural responses relevant for artificial vision have not been thoroughly characterized. Here, we demonstrate that tree shrews pretrained on a visual detection task can detect optogenetic LGN activation using an AAV2-CamKIIα-ChR2 construct and readily generalize from visual to optogenetic detection. Simultaneous recordings of LGN spiking activity and primary visual cortex (V1) local field potentials (LFPs) during optogenetic LGN stimulation show that LGN neurons reliably follow optogenetic stimulation at frequencies up to 60 Hz and uncovered a striking phase locking between the V1 LFP and the evoked spiking activity in LGN. These phase relationships were maintained over a broad range of LGN stimulation frequencies, up to 80 Hz, with spike field coherence values favoring higher frequencies, indicating the ability to relay temporally precise information to V1 using light activation of the LGN. Finally, V1 LFP responses showed sensitivity values to LGN optogenetic activation that were similar to the animal's behavioral performance. Taken together, our findings confirm the LGN as a potential target for visual prosthetics in a highly visual mammal closely related to primates.

An in-silico framework for modeling optimal control of neural systems

Introduction

Brain-machine interfaces have reached an unprecedented capacity to measure and drive activity in the brain, allowing restoration of impaired sensory, cognitive or motor function. Classical control theory is pushed to its limit when aiming to design control laws that are suitable for large-scale, complex neural systems. This work proposes a scalable, data-driven, unified approach to study brain-machine-environment interaction using established tools from dynamical systems, optimal control theory, and deep learning.

Methods

To unify the methodology, we define the environment, neural system, and prosthesis in terms of differential equations with learnable parameters, which effectively reduce to recurrent neural networks in the discrete-time case. Drawing on tools from optimal control, we describe three ways to train the system: Direct optimization of an objective function, oracle-based learning, and reinforcement learning. These approaches are adapted to different assumptions about knowledge of system equations, linearity, differentiability, and observability.

Results

We apply the proposed framework to train an in-silico neural system to perform tasks in a linear and a nonlinear environment, namely particle stabilization and pole balancing. After training, this model is perturbed to simulate impairment of sensor and motor function. We show how a prosthetic controller can be trained to restore the behavior of the neural system under increasing levels of perturbation.

Discussion

We expect that the proposed framework will enable rapid and flexible synthesis of control algorithms for neural prostheses that reduce the need for in-vivo testing. We further highlight implications for sparse placement of prosthetic sensor and actuator components.

Theoretical analysis of optogenetic spiking with ChRmine, bReaChES and CsChrimson-expressing neurons for retinal prostheses

Objective.Optogenetics has emerged as a promising technique for neural prosthetics, especially retinal prostheses, with unprecedented spatiotemporal resolution. Newly discovered opsins with high light sensitivity and fast temporal kinetics can provide sufficient temporal resolution at safe light powers and overcome the limitations of presently used opsins. It is also important to formulate accurate mathematical models for optogenetic retinal prostheses, which can facilitate optimization of photostimulation factors to improve the performance.Approach.A detailed theoretical analysis of optogenetic excitation of model retinal ganglion neurons (RGNs) and hippocampal neurons expressed with already tested opsins for retinal prostheses, namely, ChR2, ReaChR and ChrimsonR, and also with recently discovered potent opsins CsChrimson, bReaChES and ChRmine, was carried out.Main results.Under continuous illumination, ChRmine-expressing RGNs begin to respond at very low irradiances ∼10^-4mW mm^-2, and evoke firing upto ∼280 Hz, highest among other opsin-expressing RGNs, at 10^-2mW mm^-2. Under pulsed illumination at randomized photon fluxes, ChRmine-expressing RGNs respond to changes in pulse to pulse irradiances upto four logs, although very bright pulses >10¹⁴photons mm^-2s^-1block firing in these neurons. The minimum irradiance threshold for ChRmine-expressing RGNs is lower by two orders of magnitude, whereas, the first spike latency in ChRmine-expressing RGNs is shorter by an order of magnitude, alongwith stable latency of subsequest spikes compared to others. Further, a good set of photostimulation parameters were determined to achieve high-frequency control with single spike resolution at minimal power. Although ChrimsonR enables spiking upto 100 Hz in RGNs, it requires very high irradiances. ChRmine provides control at light powers that are two orders of magnitude smaller than that required with experimentally studied opsins, while maintaining single spike temporal resolution upto 40 Hz.Significance.The present study highlights the importance of ChRmine as a potential opsin for optogenetic retinal prostheses.