A piecewise probabilistic regression model to decode hand movement trajectories from epidural and subdural ECoG signals

Nine decades of electrocorticography: A comparison between epidural and subdural recordings

In recent years, electrocorticography (ECoG) has arisen as a neural signal recording tool in the development of clinically viable neural interfaces. ECoG electrodes are generally placed below the dura mater (subdural) but can also be placed on top of the dura (epidural). In deciding which of these modalities best suits long-term implants, complications and signal quality are important considerations. Conceptually, epidural placement may present a lower risk of complications as the dura is left intact but also a lower signal quality due to the dura acting as a signal attenuator. The extent to which complications and signal quality are affected by the dura, however, has been a matter of debate. To improve our understanding of the effects of the dura on complications and signal quality, we conducted a literature review. We inventorized the effect of the dura on signal quality, decodability and longevity of acute and chronic ECoG recordings in humans and non-human primates. Also, we compared the incidence and nature of serious complications in studies that employed epidural and subdural ECoG. Overall, we found that, even though epidural recordings exhibit attenuated signal amplitude over subdural recordings, particularly for high-density grids, the decodability of epidural recorded signals does not seem to be markedly affected. Additionally, we found that the nature of serious complications was comparable between epidural and subdural recordings. These results indicate that both epidural and subdural ECoG may be suited for long-term neural signal recordings, at least for current generations of clinical and high-density ECoG grids.

Non-human primate epidural ECoG analysis using explainable deep learning technology

Objective.With the development in the field of neural networks,explainable AI(XAI), is being studied to ensure that artificial intelligence models can be explained. There are some attempts to apply neural networks to neuroscientific studies to explain neurophysiological information with high machine learning performances. However, most of those studies have simply visualized features extracted from XAI and seem to lack an active neuroscientific interpretation of those features. In this study, we have tried to actively explain the high-dimensional learning features contained in the neurophysiological information extracted from XAI, compared with the previously reported neuroscientific results.Approach. We designed a deep neural network classifier using 3D information (3D DNN) and a 3D class activation map (3D CAM) to visualize high-dimensional classification features. We used those tools to classify monkey electrocorticogram (ECoG) data obtained from the unimanual and bimanual movement experiment.Main results. The 3D DNN showed better classification accuracy than other machine learning techniques, such as 2D DNN. Unexpectedly, the activation weight in the 3D CAM analysis was high in the ipsilateral motor and somatosensory cortex regions, whereas the gamma-band power was activated in the contralateral areas during unimanual movement, which suggests that the brain signal acquired from the motor cortex contains information about both contralateral movement and ipsilateral movement. Moreover, the hand-movement classification system used critical temporal information at movement onset and offset when classifying bimanual movements.Significance.As far as we know, this is the first study to use high-dimensional neurophysiological information (spatial, spectral, and temporal) with the deep learning method, reconstruct those features, and explain how the neural network works. We expect that our methods can be widely applied and used in neuroscience and electrophysiology research from the point of view of the explainability of XAI as well as its performance.

Monkey V1 epidural field potentials provide detailed information about stimulus location, size, shape, and color

Brain signal recordings with epidural microarrays constitute a low-invasive approach for recording distributed neuronal signals. Epidural field potentials (EFPs) may serve as a safe and highly beneficial signal source for a variety of research questions arising from both basic and applied neuroscience. A wider use of these signals, however, is constrained by a lack of data on their specific information content. Here, we make use of the high spatial resolution and the columnar organization of macaque primary visual cortex (V1) to investigate whether and to what extent EFP signals preserve information about various visual stimulus features. Two monkeys were presented with different feature combinations of location, size, shape, and color, yielding a total of 375 stimulus conditions. Visual features were chosen to access different spatial levels of functional organization. We found that, besides being highly specific for locational information, EFPs were significantly modulated by small differences in size, shape, and color, allowing for high stimulus classification rates even at the single-trial level. The results support the notion that EFPs constitute a low-invasive, highly beneficial signal source for longer-term recordings for medical and basic research by showing that they convey detailed and reliable information about constituent features of activating stimuli.

Decoding hindlimb kinematics from descending and ascending neural signals during cat locomotion

OBJECTIVE

The main objective of this research is to record both sensory and motor information from the ascending and descending tracts within the spinal cord for decoding the hindlimb kinematics during walking on the treadmill.

APPROACH

Two different experimental paradigms (i.e., active and passive) were used in the current study. During active experiments, five cats were trained to walk bipedally while their hands kept on the front frame of the treadmill for balance or to walk quadrupedally. During passive experiments, the limb was passively moved by the experimenter. Local field potential (LFP) activity was recorded using a microwire array implanted in the dorsal column (DC) and lateral column (LC) of the L3-L4 spinal segments. The amplitude and frequency components of the LFP formed the feature set and the elastic net regularization was used to decode the hindlimb joint angles.

MAIN RESULTS

The results show that there is no significant difference between the information content of the signals recorded from the DC and LC regions during walking on the treadmill, but the information content of the DC is significantly higher than that of the LC during passively applied movement of the hindlimb in the anesthetized cats. Moreover, the decoding performance obtained using the recorded signals from the DC is comparable with that from the LC during locomotion. But, the decoding performance obtained using the recording channels in the DC is significantly better than that obtained using the signals recorded from the LC. The long-term analysis shows that robust decoding performance can be achieved over 2-3 months without a significant decrease in performance.

SIGNIFICANCE

This work presents a promising approach to developing a natural and robust motor neuroprosthesis device using descending neural signals to execute the movement and ascending neural signals as the feedback information for control of the movement.

Decoding hand kinematics from population responses in sensorimotor cortex during grasping

OBJECTIVE

The hand-a complex effector comprising dozens of degrees of freedom of movement-endows us with the ability to flexibly, precisely, and effortlessly interact with objects. The neural signals associated with dexterous hand movements in primary motor cortex (M1) and somatosensory cortex (SC) have received comparatively less attention than have those associated with proximal upper limb control.

APPROACH

To fill this gap, we trained two monkeys to grasp objects varying in size and shape while tracking their hand postures and recording single-unit activity from M1 and SC. We then decoded their hand kinematics across tens of joints from population activity in these areas.

MAIN RESULTS

We found that we could accurately decode kinematics with a small number of neural signals and that different cortical fields carry different amounts of information about hand kinematics. In particular, neural signals in rostral M1 led to better performance than did signals in caudal M1, whereas Brodmann's area 3a outperformed areas 1 and 2 in SC. Moreover, decoding performance was higher for joint angles than joint angular velocities, in contrast to what has been found with proximal limb decoders.

SIGNIFICANCE

We conclude that cortical signals can be used for dexterous hand control in brain machine interface applications and that postural representations in SC may be exploited via intracortical stimulation to close the sensorimotor loop.

A state-based probabilistic method for decoding hand position during movement from ECoG signals in non-human primate

OBJECTIVE

In this study, we proposed a state-based probabilistic method for decoding hand positions during unilateral and bilateral movements using the ECoG signals recorded from the brain of Rhesus monkey.

APPROACH

A customized electrode array was implanted subdurally in the right hemisphere of the brain covering from the primary motor cortex to the frontal cortex. Three different experimental paradigms were considered: ipsilateral, contralateral, and bilateral movements. During unilateral movement, the monkey was trained to get food with one hand, while during bilateral movement, the monkey used its left and right hands alternately to get food. To estimate the hand positions, a state-based probabilistic method was introduced which was based on the conditional probability of the hand movement state (i.e. idle, right hand movement, and left hand movement) and the conditional expectation of the hand position for each state. Moreover, a hybrid feature extraction method based on linear discriminant analysis and partial least squares (PLS) was introduced.

MAIN RESULTS

The proposed method could successfully decode the hand positions during ipsilateral, contralateral, and bilateral movements and significantly improved the decoding performance compared to the conventional Kalman and PLS regression methods [Formula: see text]. The proposed hybrid feature extraction method was found to outperform both the PLS and PCA methods [Formula: see text]. Investigating the kinematic information of each frequency band shows that more informative frequency bands were [Formula: see text] (15-30 Hz) and [Formula: see text](50-100 Hz) for ipsilateral and [Formula: see text] and [Formula: see text] (100-200 Hz) for contralateral movements. It is observed that ipsilateral movement was decoded better than contralateral movement for [Formula: see text] (5-15 Hz) and [Formula: see text] bands, while contralateral movements was decoded better for [Formula: see text] (30-200 Hz) and hfECoG (200-400 Hz) bands.

SIGNIFICANCE

Accurate decoding the bilateral movement using the ECoG recorded from one brain hemisphere is an important issue toward real-life applications of the brain-machine interface technologies.

Visual epidural field potentials possess high functional specificity in single trials

Recordings of epidural field potentials (EFPs) allow neuronal activity to be acquired over a large region of cortical tissue with minimal invasiveness. Because electrodes are placed on top of the dura and do not enter the neuronal tissue, EFPs offer intriguing options for both clinical and basic science research. On the other hand, EFPs represent the integrated activity of larger neuronal populations and possess a higher trial-by-trial variability and a reduced signal-to-noise ratio due the additional barrier of the dura. It is thus unclear whether and to what extent EFPs have sufficient spatial selectivity to allow for conclusions about the underlying functional cortical architecture, and whether single EFP trials provide enough information on the short timescales relevant for many clinical and basic neuroscience purposes. We used the high spatial resolution of primary visual cortex to address these issues and investigated the extent to which very short EFP traces allow reliable decoding of spatial information. We briefly presented different visual objects at one of nine closely adjacent locations and recorded neuronal activity with a high-density epidural multielectrode array in three macaque monkeys. With the use of receiver operating characteristics (ROC) to identify the most informative data, machine-learning algorithms provided close-to-perfect classification rates for all 27 stimulus conditions. A binary classifier applying a simple max function on ROC-selected data further showed that single trials might be classified with 100% performance even without advanced offline classifiers. Thus, although highly variable, EFPs constitute an extremely valuable source of information and offer new perspectives for minimally invasive recording of large-scale networks.NEW & NOTEWORTHY Epidural field potential (EFP) recordings provide a minimally invasive approach to investigate large-scale neural networks, but little is known about whether they possess the required specificity for basic and clinical neuroscience. By making use of the spatial selectivity of primary visual cortex, we show that single-trial information can be decoded with close-to-perfect performance, even without using advanced classifiers and based on very few data. This labels EFPs as a highly attractive and widely usable signal.

A probabilistic recurrent neural network for decoding hind limb kinematics from multi-segment recordings of the dorsal horn neurons

OBJECTIVE

Providing accurate and robust estimates of limb kinematics from recorded neural activities is prominent in closed-loop control of functional electrical stimulation (FES). A major issue in providing accurate decoding the limb kinematics is the decoding model. The primary goal of this study is to develop a decoding approach to model the dynamic interactions of neural systems for accurate decoding. Another critical issue is to find reliable recording sites. Up to now, neural recordings from spinal neural activities were investigated. In this paper, the neural recordings from different vertebrae in decoding limb kinematics are investigated.

APPROACH

In the current study, a new generative probabilistic model with explicit considering the joint density is developed. Then, an adaptive discriminative learning algorithm is proposed for learning the model. It will be shown that the proposed generative process can be implemented by a recurrent neural network (RNN) with specific structure. We record the neural activities from dorsal horn neurons by using three electrodes placed in the L4, L5, and L6 vertebrae in anesthetized cats.

MAIN RESULTS

Information theoretic analysis on single-joint movement and multi-segment recordings implies the rostrocaudal distribution of kinematic information. It is demonstrated that during hip movement, best decoding performance is achieved by L4 recordings. For knee and ankle movements, best decodings are achieved by L5, and L6 recordings respectively. It is also shown that the decoding accuracy using multi-segment recordings outperforms decoding accuracy obtained by single-segment recording in multi-joint movement. The results also confirm the superiority of the proposed probabilistic recurrent neural network (PRNN) over the conventional recurrent neural network and Kalman filter ([Formula: see text]).

SIGNIFICANCE

Multi-segment recordings from dorsal horn neurons as well as the proposed probabilistic recurrent network model provide a promising approach for robust and accurate decoding limb kinematics.