Design strategies for dynamic closed-loop optogenetic neurocontrol in vivo

Bridging model and experiment in systems neuroscience with Cleo: the Closed-Loop, Electrophysiology, and Optophysiology simulation testbed

Systems neuroscience has experienced an explosion of new tools for reading and writing neural activity, enabling exciting new experiments such as all-optical or closed-loop control that effect powerful causal interventions. At the same time, improved computational models are capable of reproducing behavior and neural activity with increasing fidelity. Unfortunately, these advances have drastically increased the complexity of integrating different lines of research, resulting in the missed opportunities and untapped potential of suboptimal experiments. Experiment simulation can help bridge this gap, allowing model and experiment to better inform each other by providing a low-cost testbed for experiment design, model validation, and methods engineering. Specifically, this can be achieved by incorporating the simulation of the experimental interface into our models, but no existing tool integrates optogenetics, two-photon calcium imaging, electrode recording, and flexible closed-loop processing with neural population simulations. To address this need, we have developed Cleo: the Closed-Loop, Electrophysiology, and Optophysiology experiment simulation testbed. Cleo is a Python package enabling injection of recording and stimulation devices as well as closed-loop control with realistic latency into a Brian spiking neural network model. It is the only publicly available tool currently supporting two-photon and multi-opsin/wavelength optogenetics. To facilitate adoption and extension by the community, Cleo is open-source, modular, tested, and documented, and can export results to various data formats. Here we describe the design and features of Cleo, validate output of individual components and integrated experiments, and demonstrate its utility for advancing optogenetic techniques in prospective experiments using previously published systems neuroscience models.

Robust adaptive deep brain stimulation control of in-silico non-stationary Parkinsonian neural oscillatory dynamics

Objective. Closed-loop deep brain stimulation (DBS) is a promising therapy for Parkinson's disease (PD) that works by adjusting DBS patterns in real time from the guidance of feedback neural activity. Current closed-loop DBS mainly uses threshold-crossing on-off controllers or linear time-invariant (LTI) controllers to regulate the basal ganglia (BG) Parkinsonian beta band oscillation power. However, the critical cortex-BG-thalamus network dynamics underlying PD are nonlinear, non-stationary, and noisy, hindering accurate and robust control of Parkinsonian neural oscillatory dynamics.Approach. Here, we develop a new robust adaptive closed-loop DBS method for regulating the Parkinsonian beta oscillatory dynamics of the cortex-BG-thalamus network. We first build an adaptive state-space model to quantify the dynamic, nonlinear, and non-stationary neural activity. We then construct an adaptive estimator to track the nonlinearity and non-stationarity in real time. We next design a robust controller to automatically determine the DBS frequency based on the estimated Parkinsonian neural state while reducing the system's sensitivity to high-frequency noise. We adopt and tune a biophysical cortex-BG-thalamus network model as an in-silico simulation testbed to generate nonlinear and non-stationary Parkinsonian neural dynamics for evaluating DBS methods.Main results. We find that under different nonlinear and non-stationary neural dynamics, our robust adaptive DBS method achieved accurate regulation of the BG Parkinsonian beta band oscillation power with small control error, bias, and deviation. Moreover, the accurate regulation generalizes across different therapeutic targets and consistently outperforms current on-off and LTI DBS methods.Significance. These results have implications for future designs of closed-loop DBS systems to treat PD.

Event detection and classification from multimodal time series with application to neural data

The detection of events in time-series data is a common signal-processing problem. When the data can be modeled as a known template signal with an unknown delay in Gaussian noise, detection of the template signal can be done with a traditional matched filter. However, in many applications, the event of interest is represented in multimodal data consisting of both Gaussian and point-process time series. Neuroscience experiments, for example, can simultaneously record multimodal neural signals such as local field potentials (LFPs), which can be modeled as Gaussian, and neuronal spikes, which can be modeled as point processes. Currently, no method exists for event detection from such multimodal data, and as such our objective in this work is to develop a method to meet this need. Here we address this challenge by developing the multimodal event detector (MED) algorithm which simultaneously estimates event times and classes. To do this, we write a multimodal likelihood function for Gaussian and point-process observations and derive the associated maximum likelihood estimator of simultaneous event times and classes. We additionally introduce a cross-modal scaling parameter to account for model mismatch in real datasets. We validate this method in extensive simulations as well as in a neural spike-LFP dataset recorded during an eye-movement task, where the events of interest are eye movements with unknown times and directions. We show that the MED can successfully detect eye movement onset and classify eye movement direction. Further, the MED successfully combines information across data modalities, with multimodal performance exceeding unimodal performance. This method can facilitate applications such as the discovery of latent events in multimodal neural population activity and the development of brain-computer interfaces for naturalistic settings without constrained tasks or prior knowledge of event times.

Dynamic corticothalamic modulation of the somatosensory thalamocortical circuit during wakefulness

The feedback projections from cortical layer 6 (L6CT) to the sensory thalamus have long been implicated in playing a primary role in gating sensory signaling but remain poorly understood. To causally elucidate the full range of effects of these projections, we targeted silicon probe recordings to the whisker thalamocortical circuit of awake mice selectively expressing Channelrhodopsin-2 in L6CT neurons. Through optogenetic manipulation of L6CT neurons, multi-site electrophysiological recordings, and modeling of L6CT circuitry, we establish L6CT neurons as dynamic modulators of ongoing spiking in the ventral posteromedial nucleus of the thalamus (VPm), either suppressing or enhancing VPm spiking depending on L6CT neurons' firing rate and synchrony. Differential effects across the cortical excitatory and inhibitory sub-populations point to an overall influence of L6CT feedback on cortical excitability that could have profound implications for regulating sensory signaling across a range of ethologically relevant conditions.

Multimodal subspace identification for modeling discrete-continuous spiking and field potential population activity

Objective.Learning dynamical latent state models for multimodal spiking and field potential activity can reveal their collective low-dimensional dynamics and enable better decoding of behavior through multimodal fusion. Toward this goal, developing unsupervised learning methods that are computationally efficient is important, especially for real-time learning applications such as brain-machine interfaces (BMIs). However, efficient learning remains elusive for multimodal spike-field data due to their heterogeneous discrete-continuous distributions and different timescales.Approach.Here, we develop a multiscale subspace identification (multiscale SID) algorithm that enables computationally efficient learning for modeling and dimensionality reduction for multimodal discrete-continuous spike-field data. We describe the spike-field activity as combined Poisson and Gaussian observations, for which we derive a new analytical SID method. Importantly, we also introduce a novel constrained optimization approach to learn valid noise statistics, which is critical for multimodal statistical inference of the latent state, neural activity, and behavior. We validate the method using numerical simulations and with spiking and local field potential population activity recorded during a naturalistic reach and grasp behavior.Main results.We find that multiscale SID accurately learned dynamical models of spike-field signals and extracted low-dimensional dynamics from these multimodal signals. Further, it fused multimodal information, thus better identifying the dynamical modes and predicting behavior compared to using a single modality. Finally, compared to existing multiscale expectation-maximization learning for Poisson-Gaussian observations, multiscale SID had a much lower training time while being better in identifying the dynamical modes and having a better or similar accuracy in predicting neural activity and behavior.Significance.Overall, multiscale SID is an accurate learning method that is particularly beneficial when efficient learning is of interest, such as for online adaptive BMIs to track non-stationary dynamics or for reducing offline training time in neuroscience investigations.

Dynamic corticothalamic modulation of the somatosensory thalamocortical circuit during wakefulness

The feedback projections from cortical layer 6 (L6CT) to sensory thalamus have long been implicated in playing a primary role in gating sensory signaling but remain poorly understood. To causally elucidate the full range of effects of these projections, we targeted silicon probe recordings to the whisker thalamocortical circuit of awake mice selectively expressing Channelrhodopsin-2 in L6CT neurons. Through optogenetic manipulation of L6CT neurons, multi-site electrophysiological recordings, and modeling of L6CT circuitry, we establish L6CT neurons as dynamic modulators of ongoing spiking in the ventro-posterior-medial nucleus of thalamus (VPm), either suppressing or enhancing VPm spiking depending on L6CT neurons' firing rate and synchrony. Differential effects across the cortical excitatory and inhibitory sub-populations point to an overall influence of L6CT feedback on cortical excitability that could have profound implications for regulating sensory signaling across a range of ethologically relevant conditions.

Unsupervised learning of stationary and switching dynamical system models from Poisson observations

Objective. Investigating neural population dynamics underlying behavior requires learning accurate models of the recorded spiking activity, which can be modeled with a Poisson observation distribution. Switching dynamical system models can offer both explanatory power and interpretability by piecing together successive regimes of simpler dynamics to capture more complex ones. However, in many cases, reliable regime labels are not available, thus demanding accurate unsupervised learning methods for Poisson observations. Existing learning methods, however, rely on inference of latent states in neural activity using the Laplace approximation, which may not capture the broader properties of densities and may lead to inaccurate learning. Thus, there is a need for new inference methods that can enable accurate model learning.Approach. To achieve accurate model learning, we derive a novel inference method based on deterministic sampling for Poisson observations called the Poisson Cubature Filter (PCF) and embed it in an unsupervised learning framework. This method takes a minimum mean squared error approach to estimation. Terms that are difficult to find analytically for Poisson observations are approximated in a novel way with deterministic sampling based on numerical integration and cubature rules.Main results. PCF enabled accurate unsupervised learning in both stationary and switching dynamical systems and largely outperformed prior Laplace approximation-based learning methods in both simulations and motor cortical spiking data recorded during a reaching task. These improvements were larger for smaller data sizes, showing that PCF-based learning was more data efficient and enabled more reliable regime identification. In experimental data and unsupervised with respect to behavior, PCF-based learning uncovered interpretable behavior-relevant regimes unlike prior learning methods.Significance. The developed unsupervised learning methods for switching dynamical systems can accurately uncover latent regimes and states in population spiking activity, with important applications in both basic neuroscience and neurotechnology.

Bayesian target optimisation for high-precision holographic optogenetics

Two-photon optogenetics has transformed our ability to probe the structure and function of neural circuits. However, achieving precise optogenetic control of neural ensemble activity has remained fundamentally constrained by the problem of off-target stimulation (OTS): the inadvertent activation of nearby non-target neurons due to imperfect confinement of light onto target neurons. Here we propose a novel computational approach to this problem called Bayesian target optimisation. Our approach uses nonparametric Bayesian inference to model neural responses to optogenetic stimulation, and then optimises the laser powers and optical target locations needed to achieve a desired activity pattern with minimal OTS. We validate our approach in simulations and using data from in vitro experiments, showing that Bayesian target optimisation considerably reduces OTS across all conditions we test. Together, these results establish our ability to overcome OTS, enabling optogenetic stimulation with substantially improved precision.

Delayed closed-loop neurostimulation for the treatment of pathological brain rhythms in mental disorders: a computational study

Mental disorders are among the top most demanding challenges in world-wide health. A large number of mental disorders exhibit pathological rhythms, which serve as the disorders characteristic biomarkers. These rhythms are the targets for neurostimulation techniques. Open-loop neurostimulation employs stimulation protocols, which are rather independent of the patients health and brain state in the moment of treatment. Most alternative closed-loop stimulation protocols consider real-time brain activity observations but appear as adaptive open-loop protocols, where e.g., pre-defined stimulation sets in if observations fulfil pre-defined criteria. The present theoretical work proposes a fully-adaptive closed-loop neurostimulation setup, that tunes the brain activities power spectral density (PSD) according to a user-defined PSD. The utilized brain model is non-parametric and estimated from the observations via magnitude fitting in a pre-stimulus setup phase. Moreover, the algorithm takes into account possible conduction delays in the feedback connection between observation and stimulation electrode. All involved features are illustrated on pathological α- and γ-rhythms known from psychosis. To this end, we simulate numerically a linear neural population brain model and a non-linear cortico-thalamic feedback loop model recently derived to explain brain activity in psychosis.

Predictive neuromodulation of cingulo-frontal neural dynamics in major depressive disorder using a brain-computer interface system: A simulation study

Introduction

Deep brain stimulation (DBS) is a promising therapy for treatment-resistant major depressive disorder (MDD). MDD involves the dysfunction of a brain network that can exhibit complex nonlinear neural dynamics in multiple frequency bands. However, current open-loop and responsive DBS methods cannot track the complex multiband neural dynamics in MDD, leading to imprecise regulation of symptoms, variable treatment effects among patients, and high battery power consumption.

Methods

Here, we develop a closed-loop brain-computer interface (BCI) system of predictive neuromodulation for treating MDD. We first use a biophysically plausible ventral anterior cingulate cortex (vACC)-dorsolateral prefrontal cortex (dlPFC) neural mass model of MDD to simulate nonlinear and multiband neural dynamics in response to DBS. We then use offline system identification to build a dynamic model that predicts the DBS effect on neural activity. We next use the offline identified model to design an online BCI system of predictive neuromodulation. The online BCI system consists of a dynamic brain state estimator and a model predictive controller. The brain state estimator estimates the MDD brain state from the history of neural activity and previously delivered DBS patterns. The predictive controller takes the estimated MDD brain state as the feedback signal and optimally adjusts DBS to regulate the MDD neural dynamics to therapeutic targets. We use the vACC-dlPFC neural mass model as a simulation testbed to test the BCI system and compare it with state-of-the-art open-loop and responsive DBS treatments of MDD.

Results

We demonstrate that our dynamic model accurately predicts nonlinear and multiband neural activity. Consequently, the predictive neuromodulation system accurately regulates the neural dynamics in MDD, resulting in significantly smaller control errors and lower DBS battery power consumption than open-loop and responsive DBS.

Discussion

Our results have implications for developing future precisely-tailored clinical closed-loop DBS treatments for MDD.

Modeling and inference methods for switching regime-dependent dynamical systems with multiscale neural observations

Objective.Realizing neurotechnologies that enable long-term neural recordings across multiple spatial-temporal scales during naturalistic behaviors requires new modeling and inference methods that can simultaneously address two challenges. First, the methods should aggregate information across all activity scales from multiple recording sources such as spiking and field potentials. Second, the methods should detect changes in the regimes of behavior and/or neural dynamics during naturalistic scenarios and long-term recordings. Prior regime detection methods are developed for a single scale of activity rather than multiscale activity, and prior multiscale methods have not considered regime switching and are for stationary cases.Approach.Here, we address both challenges by developing a switching multiscale dynamical system model and the associated filtering and smoothing methods. This model describes the encoding of an unobserved brain state in multiscale spike-field activity. It also allows for regime-switching dynamics using an unobserved regime state that dictates the dynamical and encoding parameters at every time-step. We also design the associated switching multiscale inference methods that estimate both the unobserved regime and brain states from simultaneous spike-field activity.Main results.We validate the methods in both extensive numerical simulations and prefrontal spike-field data recorded in a monkey performing saccades for fluid rewards. We show that these methods can successfully combine the spiking and field potential observations to simultaneously track the regime and brain states accurately. Doing so, these methods lead to better state estimation compared with single-scale switching methods or stationary multiscale methods. Also, for single-scale linear Gaussian observations, the new switching smoother can better generalize to diverse system settings compared to prior switching smoothers.Significance.These modeling and inference methods effectively incorporate both regime-detection and multiscale observations. As such, they could facilitate investigation of latent switching neural population dynamics and improve future brain-machine interfaces by enabling inference in naturalistic scenarios where regime-dependent multiscale activity and behavior arise.

A field-programmable gate array (FPGA)-based data acquisition system for closed-loop experiments

We describe a custom and open source field-programmable gate array (FPGA)-based data acquisition (DAQ) system developed for electrophysiology and generally useful for closed-loop feedback experiments. FPGA acquisition and processing are combined with high-speed analog and digital converters to enable real-time feedback. The digital approach eases experimental setup and repeatability by allowing for system identification and in situ tuning of filter bandwidths. The FPGA system includes I2C and serial peripheral interface controllers, 1 GiB dynamic RAM for data buffering, and a USB3 interface to Python software. The DAQ system uses common HDMI connectors to support daughtercards that can be customized for a given experiment to make the system modular and expandable. The FPGA-based digital signal processing (DSP) is used to generate fourth-order digital infinite impulse response filters and feedback with microsecond latency. The FPGA-based DSP and an analog inner-loop are demonstrated via an experiment that rapidly steps the voltage of a capacitor isolated from the system by a considerable resistance using a feedback approach that adjusts the driving voltage based on the digitized capacitor current.

Thalamic bursting and the role of timing and synchrony in thalamocortical signaling in the awake mouse

The thalamus controls transmission of sensory signals from periphery to cortex, ultimately shaping perception. Despite this significant role, dynamic thalamic gating and the consequences for downstream cortical sensory representations have not been well studied in the awake brain. We optogenetically modulated the ventro-posterior-medial thalamus in the vibrissa pathway of the awake mouse and measured spiking activity in the thalamus and activity in primary somatosensory cortex (S1) using extracellular electrophysiology and genetically encoded voltage imaging. Thalamic hyperpolarization significantly enhanced thalamic sensory-evoked bursting; however, surprisingly, the S1 cortical response was not amplified, but instead, timing precision was significantly increased, spatial activation more focused, and there was an increased synchronization of cortical inhibitory neurons. A thalamocortical network model implicates the modulation of precise timing of feedforward thalamic population spiking, presenting a highly sensitive, timing-based gating of sensory signaling to the cortex.

Designing and Validating a Robust Adaptive Neuromodulation Algorithm for Closed-Loop Control of Brain States

OBJECTIVE

Neuromodulation systems that use closed-loop brain stimulation to control brain states can provide new therapies for brain disorders. To date, closed-loop brain stimulation has largely used linear time-invariant controllers. However, nonlinear time-varying brain network dynamics and external disturbances can appear during real-time stimulation, collectively leading to real-time model uncertainty. Real-time model uncertainty can degrade the performance or even cause instability of time-invariant controllers. Three problems need to be resolved to enable accurate and stable control under model uncertainty. First, an adaptive controller is needed to track the model uncertainty. Second, the adaptive controller additionally needs to be robust to noise and disturbances. Third, theoretical analyses of stability and robustness are needed as prerequisites for stable operation of the controller in practical applications.

APPROACH

We develop a robust adaptive neuromodulation algorithm that solves the above three problems. First, we develop a state-space brain network model that explicitly includes nonlinear terms of real-time model uncertainty and design an adaptive controller to track and cancel the model uncertainty. Second, to improve the robustness of the adaptive controller, we design two linear filters to increase steady-state control accuracy and reduce sensitivity to high-frequency noise and disturbances. Third, we conduct theoretical analyses to prove the stability of the neuromodulation algorithm and establish a trade-off between stability and robustness, which we further use to optimize the algorithm design. Finally, we validate the algorithm using comprehensive Monte Carlo simulations that span a broad range of model nonlinearity, uncertainty, and complexity.

MAIN RESULTS

The robust adaptive neuromodulation algorithm accurately tracks various types of target brain state trajectories, enables stable and robust control, and significantly outperforms state-of-the-art neuromodulation algorithms.

SIGNIFICANCE

Our algorithm has implications for future designs of precise, stable, and robust closed-loop brain stimulation systems to treat brain disorders and facilitate brain functions.

The Future of Neurotoxicology: A Neuroelectrophysiological Viewpoint

Neuroelectrophysiology is an old science, dating to the 18th century when electrical activity in nerves was discovered. Such discoveries have led to a variety of neurophysiological techniques, ranging from basic neuroscience to clinical applications. These clinical applications allow assessment of complex neurological functions such as (but not limited to) sensory perception (vision, hearing, somatosensory function), and muscle function. The ability to use similar techniques in both humans and animal models increases the ability to perform mechanistic research to investigate neurological problems. Good animal to human homology of many neurophysiological systems facilitates interpretation of data to provide cause-effect linkages to epidemiological findings. Mechanistic cellular research to screen for toxicity often includes gaps between cellular and whole animal/person neurophysiological changes, preventing understanding of the complete function of the nervous system. Building Adverse Outcome Pathways (AOPs) will allow us to begin to identify brain regions, timelines, neurotransmitters, etc. that may be Key Events (KE) in the Adverse Outcomes (AO). This requires an integrated strategy, from in vitro to in vivo (and hypothesis generation, testing, revision). Scientists need to determine intermediate levels of nervous system organization that are related to an AO and work both upstream and downstream using mechanistic approaches. Possibly more than any other organ, the brain will require networks of pathways/AOPs to allow sufficient predictive accuracy. Advancements in neurobiological techniques should be incorporated into these AOP-base neurotoxicological assessments, including interactions between many regions of the brain simultaneously. Coupled with advancements in optogenetic manipulation, complex functions of the nervous system (such as acquisition, attention, sensory perception, etc.) can be examined in real time. The integration of neurophysiological changes with changes in gene/protein expression can begin to provide the mechanistic underpinnings for biological changes. Establishment of linkages between changes in cellular physiology and those at the level of the AO will allow construction of biological pathways (AOPs) and allow development of higher throughput assays to test for changes to critical physiological circuits. To allow mechanistic/predictive toxicology of the nervous system to be protective of human populations, neuroelectrophysiology has a critical role in our future.

Closed-loop control of neural spike rate of cultured neurons using a thermoplasmonics-based photothermal neural stimulation

Objective.Photothermal neural stimulation has been developed in a variety of interfaces as an alternative technology that can perturb neural activity. The demonstrations of these techniques have heavily relied on open-loop stimulation or complete suppression of neural activity. To extend the controllability of photothermal neural stimulation, combining it with a closed-loop system is required. In this work, we investigated whether photothermal suppression mechanism can be used in a closed-loop system to reliably modulate neural spike rate to non-zero setpoints.Approach. To incorporate the photothermal inhibition mechanism into the neural feedback system, we combined a thermoplasmonic stimulation platform based on gold nanorods (GNRs) and near-infrared illuminations (808 nm, spot size: 2 mm or 200μm in diameter) with a proportional-integral (PI) controller. The closed-loop feedback control system was implemented to track predetermined target spike rates of hippocampal neuronal networks cultured on GNR-coated microelectrode arrays.Main results. The closed-loop system for neural spike rate control was successfully implemented using a PI controller and the thermoplasmonic neural suppression platform. Compared to the open-loop control, the target-channel spike rates were precisely modulated to remain constant or change in a sinusoidal form in the range below baseline spike rates. The spike rate response behaviors were affected by the choice of the controller gain. We also demonstrated that the functional connectivity of a synchronized bursting network could be altered by controlling the spike rate of one of the participating channels.Significance.The thermoplasmonic feedback controller proved that it can precisely modulate neural spike rate of neural activityin vitro. This technology can be used for studying neuronal network dynamics and might provide insights in developing new neuromodulation techniques in clinical applications.

Improving scalability in systems neuroscience

Emerging technologies to acquire data at increasingly greater scales promise to transform discovery in systems neuroscience. However, current exponential growth in the scale of data acquisition is a double-edged sword. Scaling up data acquisition can speed up the cycle of discovery but can also misinterpret the results or possibly slow down the cycle because of challenges presented by the curse of high-dimensional data. Active, adaptive, closed-loop experimental paradigms use hardware and algorithms optimized to enable time-critical computation to provide feedback that interprets the observations and tests hypotheses to actively update the stimulus or stimulation parameters. In this perspective, we review important concepts of active and adaptive experiments and discuss how selectively constraining the dimensionality and optimizing strategies at different stages of discovery loop can help mitigate the curse of high-dimensional data. Active and adaptive closed-loop experimental paradigms can speed up discovery despite an exponentially increasing data scale, offering a road map to timely and iterative hypothesis revision and discovery in an era of exponential growth in neuroscience.

State-space optimal feedback control of optogenetically driven neural activity

Objective.The rapid acceleration of tools for recording neuronal populations and targeted optogenetic manipulation has enabled real-time, feedback control of neuronal circuits in the brain. Continuously-graded control of measured neuronal activity poses a wide range of technical challenges, which we address through a combination of optogenetic stimulation and a state-space optimal control framework implemented in the thalamocortical circuit of the awake mouse.Approach.Closed-loop optogenetic control of neurons was performed in real-time via stimulation of channelrhodopsin-2 expressed in the somatosensory thalamus of the head-fixed mouse. A state-space linear dynamical system model structure was used to approximate the light-to-spiking input-output relationship in both single-neuron as well as multi-neuron scenarios when recording from multielectrode arrays. These models were utilized to design state feedback controller gains by way of linear quadratic optimal control and were also used online for estimation of state feedback, where a parameter-adaptive Kalman filter provided robustness to model-mismatch.Main results.This model-based control scheme proved effective for feedback control of single-neuron firing rate in the thalamus of awake animals. Notably, the graded optical actuation utilized here did not synchronize simultaneously recorded neurons, but heterogeneity across the neuronal population resulted in a varied response to stimulation. Simulated multi-output feedback control provided better control of a heterogeneous population and demonstrated how the approach generalizes beyond single-neuron applications.Significance.To our knowledge, this work represents the first experimental application of state space model-based feedback control for optogenetic stimulation. In combination with linear quadratic optimal control, the approaches laid out and tested here should generalize to future problems involving the control of highly complex neural circuits. More generally, feedback control of neuronal circuits opens the door to adaptively interacting with the dynamics underlying sensory, motor, and cognitive signaling, enabling a deeper understanding of circuit function and ultimately the control of function in the face of injury or disease.

Thalamic state influences timing precision in the thalamocortical circuit

Sensory signals from the outside world are transduced at the periphery, passing through thalamus before reaching cortex, ultimately giving rise to the sensory representations that enable us to perceive the world. The thalamocortical circuit is particularly sensitive to the temporal precision of thalamic spiking due to highly convergent synaptic connectivity. Thalamic neurons can exhibit burst and tonic modes of firing that strongly influence timing within the thalamus. The impact of these changes in thalamic state on sensory encoding in the cortex, however, remains unclear. Here, we investigated the role of thalamic state on timing in the thalamocortical circuit of the vibrissa pathway in the anesthetized rat. We optogenetically hyperpolarized thalamus while recording single unit activity in both thalamus and cortex. Tonic spike-triggered analysis revealed temporally precise thalamic spiking that was locked to weak white-noise sensory stimuli, whereas thalamic burst spiking was associated with a loss in stimulus-locked temporal precision. These thalamic state-dependent changes propagated to cortex such that the cortical timing precision was diminished during the hyperpolarized (burst biased) thalamic state. Although still sensory driven, the cortical neurons became significantly less precisely locked to the weak white-noise stimulus. The results here suggests a state-dependent differential regulation of spike timing precision in the thalamus that could gate what signals are ultimately propagated to cortex.NEW & NOTEWORTHY The majority of sensory signals are transmitted through the thalamus. There is growing evidence of complex thalamic gating through coordinated firing modes that have a strong impact on cortical sensory representations. Optogenetic hyperpolarization of thalamus pushed it into burst firing that disrupted precise time-locked sensory signaling, with a direct impact on the downstream cortical encoding, setting the stage for a timing-based thalamic gate of sensory signaling.

Adaptive latent state modeling of brain network dynamics with real-time learning rate optimization

Objective. Dynamic latent state models are widely used to characterize the dynamics of brain network activity for various neural signal types. To date, dynamic latent state models have largely been developed for stationary brain network dynamics. However, brain network dynamics can be non-stationary for example due to learning, plasticity or recording instability. To enable modeling these non-stationarities, two problems need to be resolved. First, novel methods should be developed that can adaptively update the parameters of latent state models, which is difficult due to the state being latent. Second, new methods are needed to optimize the adaptation learning rate, which specifies how fast new neural observations update the model parameters and can significantly influence adaptation accuracy.Approach. We develop a Rate Optimized-adaptive Linear State-Space Modeling (RO-adaptive LSSM) algorithm that solves these two problems. First, to enable adaptation, we derive a computation- and memory-efficient adaptive LSSM fitting algorithm that updates the LSSM parameters recursively and in real time in the presence of the latent state. Second, we develop a real-time learning rate optimization algorithm. We use comprehensive simulations of a broad range of non-stationary brain network dynamics to validate both algorithms, which together constitute the RO-adaptive LSSM.Main results. We show that the adaptive LSSM fitting algorithm can accurately track the broad simulated non-stationary brain network dynamics. We also find that the learning rate significantly affects the LSSM fitting accuracy. Finally, we show that the real-time learning rate optimization algorithm can run in parallel with the adaptive LSSM fitting algorithm. Doing so, the combined RO-adaptive LSSM algorithm rapidly converges to the optimal learning rate and accurately tracks non-stationarities.Significance. These algorithms can be used to study time-varying neural dynamics underlying various brain functions and enhance future neurotechnologies such as brain-machine interfaces and closed-loop brain stimulation systems.

Modelling and prediction of the dynamic responses of large-scale brain networks during direct electrical stimulation

Direct electrical stimulation can modulate the activity of brain networks for the treatment of several neurological and neuropsychiatric disorders and for restoring lost function. However, precise neuromodulation in an individual requires the accurate modelling and prediction of the effects of stimulation on the activity of their large-scale brain networks. Here, we report the development of dynamic input-output models that predict multiregional dynamics of brain networks in response to temporally varying patterns of ongoing microstimulation. In experiments with two awake rhesus macaques, we show that the activities of brain networks are modulated by changes in both stimulation amplitude and frequency, that they exhibit damping and oscillatory response dynamics, and that variabilities in prediction accuracy and in estimated response strength across brain regions can be explained by an at-rest functional connectivity measure computed without stimulation. Input-output models of brain dynamics may enable precise neuromodulation for the treatment of disease and facilitate the investigation of the functional organization of large-scale brain networks.

Multiscale low-dimensional motor cortical state dynamics predict naturalistic reach-and-grasp behavior

Motor function depends on neural dynamics spanning multiple spatiotemporal scales of population activity, from spiking of neurons to larger-scale local field potentials (LFP). How multiple scales of low-dimensional population dynamics are related in control of movements remains unknown. Multiscale neural dynamics are especially important to study in naturalistic reach-and-grasp movements, which are relatively under-explored. We learn novel multiscale dynamical models for spike-LFP network activity in monkeys performing naturalistic reach-and-grasps. We show low-dimensional dynamics of spiking and LFP activity exhibited several principal modes, each with a unique decay-frequency characteristic. One principal mode dominantly predicted movements. Despite distinct principal modes existing at the two scales, this predictive mode was multiscale and shared between scales, and was shared across sessions and monkeys, yet did not simply replicate behavioral modes. Further, this multiscale mode's decay-frequency explained behavior. We propose that multiscale, low-dimensional motor cortical state dynamics reflect the neural control of naturalistic reach-and-grasp behaviors.

Closed-Loop Neuromodulation in Physiological and Translational Research

Neuromodulation, the focused delivery of energy to neural tissue to affect neural or physiological processes, is a common method to study the physiology of the nervous system. It is also successfully used as treatment for disorders in which the nervous system is affected or implicated. Typically, neurostimulation is delivered in open-loop mode (i.e., according to a predetermined schedule and independently of the state of the organ or physiological system whose function is sought to be modulated). However, the physiology of the nervous system or the modulated organ can be dynamic, and the same stimulus may have different effects depending on the underlying state. As a result, open-loop stimulation may fail to restore the desired function or cause side effects. In such cases, a neuromodulation intervention may be preferable to be administered in closed-loop mode. In a closed-loop neuromodulation (CLN) system, stimulation is delivered when certain physiological states or conditions are met (responsive neurostimulation); the stimulation parameters can also be adjusted dynamically to optimize the effect of stimulation in real time (adaptive neurostimulation). In this review, the reasons and the conditions for using CLN are discussed, the basic components of a CLN system are described, and examples of CLN systems used in physiological and translational research are presented.

From Novel Technology to Novel Applications: Comment on "An Integrated Brain-Machine Interface Platform With Thousands of Channels" by Elon Musk and Neuralink

Collapse

A point-process matched filter for event detection and decoding from population spike trains

OBJECTIVE

Information encoding in neurons can be described through their response fields. The spatial response field of a neuron is the region of space in which a sensory stimulus or a behavioral event causes that neuron to fire. Neurons can also exhibit temporal response fields (TRFs), which characterize a transient response to stimulus or behavioral event onsets. These neurons can thus be described by a spatio-temporal response field (STRF). The activity of neurons with STRFs can be well-described with point process models that characterize binary spike trains with an instantaneous firing rate that is a function of both time and space. However, developing decoders for point process models of neurons that exhibit TRFs is challenging because it requires prior knowledge of event onset times, which are unknown. Indeed, point process filters (PPF) to date have largely focused on decoding neuronal activity without considering TRFs. Also, neural classifiers have required data to be behavior- or stimulus-aligned, i.e. event times to be known, which is often not possible in real-world applications. Our objective in this work is to develop a viable decoder for neurons with STRFs when event times are unknown.

APPROACH

To enable decoding of neurons with STRFs, we develop a novel point-process matched filter (PPMF) that can detect events and estimate their onset times from population spike trains. We also devise a PPF for neurons with transient responses as characterized by STRFs. When neurons exhibit STRFs and event times are unknown, the PPMF can be combined with the PPF or with discrete classifiers for continuous and discrete brain state decoding, respectively.

MAIN RESULTS

We validate our algorithm on two datasets: simulated spikes from neurons that encode visual saliency in response to stimuli, and prefrontal spikes recorded in a monkey performing a delayed-saccade task. We show that the PPMF can estimate the stimulus times and saccade times accurately. Further, the PPMF combined with the PPF can decode visual saliency maps without knowing the stimulus times. Similarly, the PPMF combined with a point process classifier can decode the saccade direction without knowing the saccade times.

SIGNIFICANCE

These event detection and decoding algorithms can help develop neurotechnologies to decode cognitive states from neural responses that exhibit STRFs.

Cracking the Function of Layers in the Sensory Cortex

Understanding how cortical activity generates sensory perceptions requires a detailed dissection of the function of cortical layers. Despite our relatively extensive knowledge of their anatomy and wiring, we have a limited grasp of what each layer contributes to cortical computation. We need to develop a theory of cortical function that is rooted solidly in each layer's component cell types and fine circuit architecture and produces predictions that can be validated by specific perturbations. Here we briefly review the progress toward such a theory and suggest an experimental road map toward this goal. We discuss new methods for the all-optical interrogation of cortical layers, for correlating in vivo function with precise identification of transcriptional cell type, and for mapping local and long-range activity in vivo with synaptic resolution. The new technologies that can crack the function of cortical layers are finally on the immediate horizon.

A novel device for real-time measurement and manipulation of licking behavior in head-fixed mice

The mouse has become an influential model system for investigating the mammalian nervous system. Technologies in mice enable recording and manipulation of neural circuits during tasks where they respond to sensory stimuli by licking for liquid rewards. Precise monitoring of licking during these tasks provides an accessible metric of sensory-motor processing, particularly when combined with simultaneous neural recordings. There are several challenges in designing and implementing lick detectors during head-fixed neurophysiological experiments in mice. First, mice are small, and licking behaviors are easily perturbed or biased by large sensors. Second, neural recordings during licking are highly sensitive to electrical contact artifacts. Third, submillisecond lick detection latencies are required to generate control signals that manipulate neural activity at appropriate time scales. Here we designed, characterized, and implemented a contactless dual-port device that precisely measures directional licking in head-fixed mice performing visual behavior. We first determined the optimal characteristics of our detector through design iteration and then quantified device performance under ideal conditions. We then tested performance during head-fixed mouse behavior with simultaneous neural recordings in vivo. We finally demonstrate our device's ability to detect directional licks and generate appropriate control signals in real time to rapidly suppress licking behavior via closed-loop inhibition of neural activity. Our dual-port detector is cost effective and easily replicable, and it should enable a wide variety of applications probing the neural circuit basis of sensory perception, motor action, and learning in normal and transgenic mouse models. NEW & NOTEWORTHY Mice readily learn tasks in which they respond to sensory cues by licking for liquid rewards; tasks that involve multiple licking responses allow study of neural circuits underlying decision making and sensory-motor integration. Here we design, characterize, and implement a novel dual-port lick detector that precisely measures directional licking in head-fixed mice performing visual behavior, enabling simultaneous neural recording and closed-loop manipulation of licking.

A High-Resolution Opto-Electrophysiology System With a Miniature Integrated Headstage

This work presents a fully integrated neural interface system in a small form factor (1.9 g), consisting of a μLED silicon optoelectrode (12 μLEDs and 32 recording sites in a 4-shank configuration), an Intan 32-channel recording chip, and a custom optical stimulation chip for controlling 12 μLEDs. High-resolution optical stimulation with approximately 68.5 nW radiant flux resolution is achieved by a custom LED driver ASIC, which enables individual control of up to 48 channels with a current precision of 1 μA, a maximum current of 1.024 mA, and an update rate of >10 kHz. Recording is performed by an off-the-shelf 32-channel digitizing front-end ASIC from Intan. Two compact custom interface printed circuit boards were designed to link the headstage with a PC. The prototype system demonstrates precise current generation, sufficient optical radiant flux generation , and fast turn-on of μLEDs . Single animal in vivo experiments validated the headstage's capability to precisely modulate single neuronal activity and independently modulate activities of separate neuronal populations near neighboring optoelectrode shanks.