Event detection and classification from multimodal time series with application to neural data

The detection of events in time-series data is a common signal-processing problem. When the data can be modeled as a known template signal with an unknown delay in Gaussian noise, detection of the template signal can be done with a traditional matched filter. However, in many applications, the event of interest is represented in multimodal data consisting of both Gaussian and point-process time series. Neuroscience experiments, for example, can simultaneously record multimodal neural signals such as local field potentials (LFPs), which can be modeled as Gaussian, and neuronal spikes, which can be modeled as point processes. Currently, no method exists for event detection from such multimodal data, and as such our objective in this work is to develop a method to meet this need. Here we address this challenge by developing the multimodal event detector (MED) algorithm which simultaneously estimates event times and classes. To do this, we write a multimodal likelihood function for Gaussian and point-process observations and derive the associated maximum likelihood estimator of simultaneous event times and classes. We additionally introduce a cross-modal scaling parameter to account for model mismatch in real datasets. We validate this method in extensive simulations as well as in a neural spike-LFP dataset recorded during an eye-movement task, where the events of interest are eye movements with unknown times and directions. We show that the MED can successfully detect eye movement onset and classify eye movement direction. Further, the MED successfully combines information across data modalities, with multimodal performance exceeding unimodal performance. This method can facilitate applications such as the discovery of latent events in multimodal neural population activity and the development of brain-computer interfaces for naturalistic settings without constrained tasks or prior knowledge of event times.

Robust Removal of Slow Artifactual Dynamics Induced by Deep Brain Stimulation in Local Field Potential Recordings Using SVD-Based Adaptive Filtering

Deep brain stimulation (DBS) is widely used as a treatment option for patients with movement disorders. In addition to its clinical impact, DBS has been utilized in the field of cognitive neuroscience, wherein the answers to several fundamental questions underpinning the mechanisms of neuromodulation in decision making rely on the ways in which a burst of DBS pulses, usually delivered at a clinical frequency, i.e., 130 Hz, perturb participants' choices. It was observed that neural activities recorded during DBS were contaminated with large artifacts, which lasts for a few milliseconds, as well as a low-frequency (slow) signal (~1-2 Hz) that can persist for hundreds of milliseconds. While the focus of most of methods for removing DBS artifacts was on the former, the artifact removal capabilities of the slow signal have not been addressed. In this work, we propose a new method based on combining singular value decomposition (SVD) and normalized adaptive filtering to remove both large (fast) and slow artifacts in local field potentials, recorded during a cognitive task in which bursts of DBS were utilized. Using synthetic data, we show that our proposed algorithm outperforms four commonly used techniques in the literature, namely, (1) normalized least mean square adaptive filtering, (2) optimal FIR Wiener filtering, (3) Gaussian model matching, and (4) moving average. The algorithm's capabilities are further demonstrated by its ability to effectively remove DBS artifacts in local field potentials recorded from the subthalamic nucleus during a verbal Stroop task, highlighting its utility in real-world applications.

From mechanisms to functions: The role of theta and gamma coherence in the intrahippocampal circuits

Brain rhythms are essential for information processing in neuronal networks. Oscillations recorded in different brain regions can be synchronized and have a constant phase difference, that is, they can be coherent. Coherence between local field potential (LFP) signals from different brain regions may be correlated with the performance of cognitive tasks, indicating that these regions of the brain are jointly involved in the information processing. Why does coherence occur and how is it related to the information transfer between different regions of the hippocampal formation? In this article, we discuss possible mechanisms of theta and gamma coherence and its role in the hippocampus-dependent attention and memory processes, since theta and gamma rhythms are most pronounced in these processes. We review in vivo studies of interactions between different regions of the hippocampal formation in theta and gamma frequency bands. The key propositions of the review are as follows: (1) coherence emerges from synchronous postsynaptic currents in principal neurons as a result of synchronization of neuronal spike activity; (2) the synchronization of neuronal spike patterns in two regions of the hippocampal formation can be realized through induction or resonance; (3) coherence at a specific time point reflects the transfer of information between the regions of the hippocampal formation; (4) the physiological roles of theta and gamma coherence are different due to their different functions and mechanisms of generation. All hippocampal neurons are involved in theta activity, and theta coherence arranges the firing order of principal neurons throughout the hippocampal formation. In contrast, gamma coherence reflects the coupling of active neuronal ensembles. Overall, the coherence of LFPs between different areas of the brain is an important physiological process based on the synchronized neuronal firing, and it is essential for cooperative information processing.

Theta Oscillations at Subthalamic Region Predicts Hypomania State After Deep Brain Stimulation in Parkinson's Disease

Subthalamic nucleus (STN) deep brain stimulation (DBS) is an effective treatment for the motor impairments of patients with advanced Parkinson's disease. However, mood or behavioral changes, such as mania, hypomania, and impulsive disorders, can occur postoperatively. It has been suggested that these symptoms are associated with the stimulation of the limbic subregion of the STN. Electrophysiological studies demonstrate that the low-frequency activities in ventral STN are modulated during emotional processing. In this study, we report 22 patients with Parkinson's disease who underwent STN DBS for treatment of motor impairment and presented stimulation-induced mood elevation during initial postoperative programming. The contact at which a euphoric state was elicited by stimulation was termed as the hypomania-inducing contact (HIC) and was further correlated with intraoperative local field potential recorded during the descending of DBS electrodes. The power of four frequency bands, namely, θ (4–7 Hz), α (7–10 Hz), β (13–35 Hz), and γ (40–60 Hz), were determined by a non-linear variation of the spectrogram using the concentration of frequency of time (conceFT). The depth of maximum θ power is located approximately 2 mm below HIC on average and has significant correlation with the location of contacts (r = 0.676, p < 0.001), even after partializing the effect of α and β, respectively (r = 0.474, p = 0.022; r = 0.461, p = 0.027). The occurrence of HIC was not associated with patient-specific characteristics such as age, gender, disease duration, motor or non-motor symptoms before the operation, or improvement after stimulation. Taken together, these data suggest that the location of maximum θ power is associated with the stimulation-induced hypomania and the prediction of θ power is frequency specific. Our results provide further information to refine targeting intraoperatively and select stimulation contacts in programming.

Controlling Clinical States Governed by Different Temporal Dynamics With Closed-Loop Deep Brain Stimulation: A Principled Framework

Closed-loop strategies for deep brain stimulation (DBS) are paving the way for improving the efficacy of existing neuromodulation therapies across neurological disorders. Unlike continuous DBS, closed-loop DBS approaches (cl-DBS) optimize the delivery of stimulation in the temporal domain. However, clinical and neurophysiological manifestations exhibit highly diverse temporal properties and evolve over multiple time-constants. Moreover, throughout the day, patients are engaged in different activities such as walking, talking, or sleeping that may require specific therapeutic adjustments. This broad range of temporal properties, along with inter-dependencies affecting parallel manifestations, need to be integrated in the development of therapies to achieve a sustained, optimized control of multiple symptoms over time. This requires an extended view on future cl-DBS design. Here we propose a conceptual framework to guide the development of multi-objective therapies embedding parallel control loops. Its modular organization allows to optimize the personalization of cl-DBS therapies to heterogeneous patient profiles. We provide an overview of clinical states and symptoms, as well as putative electrophysiological biomarkers that may be integrated within this structure. This integrative framework may guide future developments and become an integral part of next-generation precision medicine instruments.

Differential Effects of Pathological Beta Burst Dynamics Between Parkinson's Disease Phenotypes Across Different Movements

Background: Resting state beta band (13-30 Hz) oscillations represent pathological neural activity in Parkinson's disease (PD). It is unknown how the peak frequency or dynamics of beta oscillations may change among fine, limb, and axial movements and different disease phenotypes. This will be critical for the development of personalized closed loop deep brain stimulation (DBS) algorithms during different activity states. Methods: Subthalamic (STN) and local field potentials (LFPs) were recorded from a sensing neurostimulator (Activa® PC + S, Medtronic PLC.) in fourteen PD participants (six tremor-dominant and eight akinetic-rigid) off medication/off STN DBS during 30 s of repetitive alternating finger tapping, wrist-flexion extension, stepping in place, and free walking. Beta power peaks and beta burst dynamics were identified by custom algorithms and were compared among movement tasks and between tremor-dominant and akinetic-rigid groups. Results: Beta power peaks were evident during fine, limb, and axial movements in 98% of movement trials; the peak frequencies were similar during each type of movement. Burst power and duration were significantly larger in the high beta band, but not in the low beta band, in the akinetic-rigid group compared to the tremor-dominant group. Conclusion: The conservation of beta peak frequency during different activity states supports the feasibility of patient-specific closed loop DBS algorithms driven by the dynamics of the same beta band during different activities. Akinetic-rigid participants had greater power and longer burst durations in the high beta band than tremor-dominant participants during movement, which may relate to the difference in underlying pathophysiology between phenotypes.

Spontaneous and Perturbational Complexity in Cortical Cultures

Dissociated cortical neurons in vitro display spontaneously synchronized, low-frequency firing patterns, which can resemble the slow wave oscillations characterizing sleep in vivo. Experiments in humans, rodents, and cortical slices have shown that awakening or the administration of activating neuromodulators decrease slow waves, while increasing the spatio-temporal complexity of responses to perturbations. In this study, we attempted to replicate those findings using in vitro cortical cultures coupled with micro-electrode arrays and chemically treated with carbachol (CCh), to modulate sleep-like activity and suppress slow oscillations. We adapted metrics such as neural complexity (NC) and the perturbational complexity index (PCI), typically employed in animal and human brain studies, to quantify complexity in simplified, unstructured networks, both during resting state and in response to electrical stimulation. After CCh administration, we found a decrease in the amplitude of the initial response and a marked enhancement of the complexity during spontaneous activity. Crucially, unlike in cortical slices and intact brains, PCI in cortical cultures displayed only a moderate increase. This dissociation suggests that PCI, a measure of the complexity of causal interactions, requires more than activating neuromodulation and that additional factors, such as an appropriate circuit architecture, may be necessary. Exploring more structured in vitro networks, characterized by the presence of strong lateral connections, recurrent excitation, and feedback loops, may thus help to identify the features that are more relevant to support causal complexity.

A Marked Point Process Framework for Extracellular Electrical Potentials

Neuromodulations are an important component of extracellular electrical potentials (EEP), such as the Electroencephalogram (EEG), Electrocorticogram (ECoG) and Local Field Potentials (LFP). This spatially temporal organized multi-frequency transient (phasic) activity reflects the multiscale spatiotemporal synchronization of neuronal populations in response to external stimuli or internal physiological processes. We propose a novel generative statistical model of a single EEP channel, where the collected signal is regarded as the noisy addition of reoccurring, multi-frequency phasic events over time. One of the main advantages of the proposed framework is the exceptional temporal resolution in the time location of the EEP phasic events, e.g., up to the sampling period utilized in the data collection. Therefore, this allows for the first time a description of neuromodulation in EEPs as a Marked Point Process (MPP), represented by their amplitude, center frequency, duration, and time of occurrence. The generative model for the multi-frequency phasic events exploits sparseness and involves a shift-invariant implementation of the clustering technique known as k-means. The cost function incorporates a robust estimation component based on correntropy to mitigate the outliers caused by the inherent noise in the EEP. Lastly, the background EEP activity is explicitly modeled as the non-sparse component of the collected signal to further improve the delineation of the multi-frequency phasic events in time. The framework is validated using two publicly available datasets: the DREAMS sleep spindles database and one of the Brain-Computer Interface (BCI) competition datasets. The results achieve benchmark performance and provide novel quantitative descriptions based on power, event rates and timing in order to assess behavioral correlates beyond the classical power spectrum-based analysis. This opens the possibility for a unifying point process framework of multiscale brain activity where simultaneous recordings of EEP and the underlying single neuron spike activity can be integrated and regarded as marked and simple point processes, respectively.

A neurochemical closed-loop controller for deep brain stimulation: toward individualized smart neuromodulation therapies

Current strategies for optimizing deep brain stimulation (DBS) therapy involve multiple postoperative visits. During each visit, stimulation parameters are adjusted until desired therapeutic effects are achieved and adverse effects are minimized. However, the efficacy of these therapeutic parameters may decline with time due at least in part to disease progression, interactions between the host environment and the electrode, and lead migration. As such, development of closed-loop control systems that can respond to changing neurochemical environments, tailoring DBS therapy to individual patients, is paramount for improving the therapeutic efficacy of DBS. Evidence obtained using electrophysiology and imaging techniques in both animals and humans suggests that DBS works by modulating neural network activity. Recently, animal studies have shown that stimulation-evoked changes in neurotransmitter release that mirror normal physiology are associated with the therapeutic benefits of DBS. Therefore, to fully understand the neurophysiology of DBS and optimize its efficacy, it may be necessary to look beyond conventional electrophysiological analyses and characterize the neurochemical effects of therapeutic and non-therapeutic stimulation. By combining electrochemical monitoring and mathematical modeling techniques, we can potentially replace the trial-and-error process used in clinical programming with deterministic approaches that help attain optimal and stable neurochemical profiles. In this manuscript, we summarize the current understanding of electrophysiological and electrochemical processing for control of neuromodulation therapies. Additionally, we describe a proof-of-principle closed-loop controller that characterizes DBS-evoked dopamine changes to adjust stimulation parameters in a rodent model of DBS. The work described herein represents the initial steps toward achieving a “smart” neuroprosthetic system for treatment of neurologic and psychiatric disorders.