Recovery of Dynamics and Function in Spiking Neural Networks with Closed-Loop Control

Disrupting abnormal neuronal oscillations with adaptive delayed feedback control

Closed-loop neuronal stimulation has a strong therapeutic potential for neurological disorders such as Parkinson's disease. However, at the moment, standard stimulation protocols rely on continuous open-loop stimulation and the design of adaptive controllers is an active field of research. Delayed feedback control (DFC), a popular method used to control chaotic systems, has been proposed as a closed-loop technique for desynchronisation of neuronal populations but, so far, was only tested in computational studies. We implement DFC for the first time in neuronal populations and access its efficacy in disrupting unwanted neuronal oscillations. To analyse in detail the performance of this activity control algorithm, we used specialised in vitro platforms with high spatiotemporal monitoring/stimulating capabilities. We show that the conventional DFC in fact worsens the neuronal population oscillatory behaviour, which was never reported before. Conversely, we present an improved control algorithm, adaptive DFC (aDFC), which monitors the ongoing oscillation periodicity and self-tunes accordingly. aDFC effectively disrupts collective neuronal oscillations restoring a more physiological state. Overall, these results support aDFC as a better candidate for therapeutic closed-loop brain stimulation.

Improving scalability in systems neuroscience

Emerging technologies to acquire data at increasingly greater scales promise to transform discovery in systems neuroscience. However, current exponential growth in the scale of data acquisition is a double-edged sword. Scaling up data acquisition can speed up the cycle of discovery but can also misinterpret the results or possibly slow down the cycle because of challenges presented by the curse of high-dimensional data. Active, adaptive, closed-loop experimental paradigms use hardware and algorithms optimized to enable time-critical computation to provide feedback that interprets the observations and tests hypotheses to actively update the stimulus or stimulation parameters. In this perspective, we review important concepts of active and adaptive experiments and discuss how selectively constraining the dimensionality and optimizing strategies at different stages of discovery loop can help mitigate the curse of high-dimensional data. Active and adaptive closed-loop experimental paradigms can speed up discovery despite an exponentially increasing data scale, offering a road map to timely and iterative hypothesis revision and discovery in an era of exponential growth in neuroscience.

Dynamics of multiple interacting excitatory and inhibitory populations with delays

A network consisting of excitatory and inhibitory (EI) neurons is a canonical model for understanding local cortical network activity. In this study, we extended the local circuit model and investigated how its dynamical landscape can be enriched when it interacts with another excitatory (E) population with long transmission delays. Through analysis of a rate model and numerical simulations of a corresponding network of spiking neurons, we studied the transition from stationary to oscillatory states by analyzing the Hopf bifurcation structure in terms of two network parameters: (1) transmission delay between the EI subnetwork and the E population and (2) inhibitory couplings that induced oscillatory activity in the EI subnetwork. We found that the critical coupling strength can strongly modulate as a function of transmission delay, and consequently the stationary state can be interwoven intricately with the oscillatory state. Such a dynamical landscape gave rise to an isolated stationary state surrounded by multiple oscillatory states that generated different frequency modes, and cross-frequency coupling developed naturally at the bifurcation points. We identified the network motifs with short- and long-range inhibitory connections that underlie the emergence of oscillatory states with multiple frequencies. Thus, we provided a mechanistic explanation of how the transmission delay to and from the additional E population altered the dynamical landscape. In summary, our results demonstrated the potential role of long-range connections in shaping the network activity of local cortical circuits.

Controlling Synchronization of Spiking Neuronal Networks by Harnessing Synaptic Plasticity

Disrupting the pathological synchronous firing patterns of neurons with high frequency stimulation is a common treatment for Parkinsonian symptoms and epileptic seizures when pharmaceutical drugs fail. In this paper, our goal is to design a desynchronization strategy for large networks of spiking neurons such that the neuronal activity of the network remains in the desynchronized regime for a long period of time after the removal of the stimulation. We develop a novel "Forced Temporal-Spike Time Stimulation (FTSTS)" strategy that harnesses the spike-timing dependent plasticity to control the synchronization of neural activity in the network by forcing the neurons in the network to artificially fire in a specific temporal pattern. Our strategy modulates the synaptic strengths of selective synapses to achieve a desired synchrony of neural activity in the network. Our simulation results show that the FTSTS strategy can effectively synchronize or desynchronize neural activity in large spiking neuron networks and keep them in the desired state for a long period of time after the removal of the external stimulation. Using simulations, we demonstrate the robustness of our strategy in desynchronizing neural activity of networks against uncertainties in the designed stimulation pulses and network parameters. Additionally, we show in simulation, how our strategy could be incorporated within the existing desynchronization strategies to improve their overall efficacy in desynchronizing large networks. Our proposed strategy provides complete control over the synchronization of neurons in large networks and can be used to either synchronize or desynchronize neural activity based on specific applications. Moreover, it can be incorporated within other desynchronization strategies to improve the efficacy of existing therapies for numerous neurological and psychiatric disorders associated with pathological synchronization.

A theory of how active behavior stabilises neural activity: Neural gain modulation by closed-loop environmental feedback

During active behaviours like running, swimming, whisking or sniffing, motor actions shape sensory input and sensory percepts guide future motor commands. Ongoing cycles of sensory and motor processing constitute a closed-loop feedback system which is central to motor control and, it has been argued, for perceptual processes. This closed-loop feedback is mediated by brainwide neural circuits but how the presence of feedback signals impacts on the dynamics and function of neurons is not well understood. Here we present a simple theory suggesting that closed-loop feedback between the brain/body/environment can modulate neural gain and, consequently, change endogenous neural fluctuations and responses to sensory input. We support this theory with modeling and data analysis in two vertebrate systems. First, in a model of rodent whisking we show that negative feedback mediated by whisking vibrissa can suppress coherent neural fluctuations and neural responses to sensory input in the barrel cortex. We argue this suppression provides an appealing account of a brain state transition (a marked change in global brain activity) coincident with the onset of whisking in rodents. Moreover, this mechanism suggests a novel signal detection mechanism that selectively accentuates active, rather than passive, whisker touch signals. This mechanism is consistent with a predictive coding strategy that is sensitive to the consequences of motor actions rather than the difference between the predicted and actual sensory input. We further support the theory by re-analysing previously published two-photon data recorded in zebrafish larvae performing closed-loop optomotor behaviour in a virtual swim simulator. We show, as predicted by this theory, that the degree to which each cell contributes in linking sensory and motor signals well explains how much its neural fluctuations are suppressed by closed-loop optomotor behaviour. More generally we argue that our results demonstrate the dependence of neural fluctuations, across the brain, on closed-loop brain/body/environment interactions strongly supporting the idea that brain function cannot be fully understood through open-loop approaches alone.

Animals actively exploring or interacting with their surroundings must process a cyclical flow of information from the environment through sensory receptors, the central nervous system, the musculoskeletal system and back to the environment. This closed-loop sensorimotor system is essential for an animal's ability to adapt and survive in complex environments. Importantly, closed loop feedback signals also regulate brainwide neural circuits for behavior. Specifically, the activity of coherent populations of neurons inform motor behaviours and in turn are influenced by sensory feedback signals mediated by the environment. We develop a theory that suggests that this feedback can explain the marked changes in large-scale neural dynamics and sensory processing (together referred to as brain state) that coincide with the onset of active behaviours. This feedback may contribute to flexible context dependent neural computations in brain systems.

Bioelectric Medicine and Devices for the Treatment of Spinal Cord Injury

Recovery of motor control is paramount for patients living with paralysis following spinal cord injury (SCI). While a cure or regenerative intervention remains on the horizon for the treatment of SCI, a number of neuroprosthetic devices have been employed to treat and mitigate the symptoms of paralysis associated with injuries to the spinal column and associated comorbidities. The recent success of epidural stimulation to restore voluntary motor function in the lower limbs of a small cohort of patients has breathed new life into the promise of electric-based medicine. Recently, a number of new organic and inorganic electronic devices have been developed for brain-computer interfaces to bypass the injury, for neurorehabilitation, bladder and bowel control, and the restoration of motor or sensory control. Herein, we discuss the recent advances in neuroprosthetic devices for treating SCI and highlight future design needs for closed-loop device systems.

A Review of Control Strategies in Closed-Loop Neuroprosthetic Systems

It has been widely recognized that closed-loop neuroprosthetic systems achieve more favorable outcomes for users then equivalent open-loop devices. Improved performance of tasks, better usability, and greater embodiment have all been reported in systems utilizing some form of feedback. However, the interdisciplinary work on neuroprosthetic systems can lead to miscommunication due to similarities in well-established nomenclature in different fields. Here we present a review of control strategies in existing experimental, investigational and clinical neuroprosthetic systems in order to establish a baseline and promote a common understanding of different feedback modes and closed-loop controllers. The first section provides a brief discussion of feedback control and control theory. The second section reviews the control strategies of recent Brain Machine Interfaces, neuromodulatory implants, neuroprosthetic systems, and assistive neurorobotic devices. The final section examines the different approaches to feedback in current neuroprosthetic and neurorobotic systems.