Predominance of Movement Speed Over Direction in Neuronal Population Signals of Motor Cortex: Intracranial EEG Data and A Simple Explanatory Model

Human cortical high-gamma power scales with movement rate in healthy participants and stroke survivors

Motor cortical high-gamma oscillations (60-90 Hz) occur at movement onset and are spatially focused over the contralateral primary motor cortex. Although high-gamma oscillations are widely recognized for their significance in human motor control, their precise function on a cortical level remains elusive. Importantly, their relevance in human stroke pathophysiology is unknown. Because motor deficits are fundamental determinants of symptom burden after stroke, understanding the neurophysiological processes of motor coding could be an important step in improving stroke rehabilitation. We recorded magnetoencephalography data during a thumb movement rate task in 14 chronic stroke survivors, 15 age-matched control participants and 29 healthy young participants. Motor cortical high-gamma oscillations showed a strong relation with movement rate as trials with higher movement rate were associated with greater high-gamma power. Although stroke survivors showed reduced cortical high-gamma power, this reduction primarily reflected the scaling of high-gamma power with movement rate, yet after matching movement rate in stroke survivors and age-matched controls, the reduction of high-gamma power exceeded the effect of their decreased movement rate alone. Even though motor skill acquisition was evident in all three groups, it was not linked to high-gamma power. Our study quantifies high-gamma oscillations after stroke, revealing a reduction in movement-related high-gamma power. Moreover, we provide strong evidence for a pivotal role of motor cortical high-gamma oscillations in encoding movement rate. KEY POINTS: Neural oscillations in the high-gamma frequency range (60-90 Hz) emerge in the human motor cortex during movement. The precise function of these oscillations in motor control remains unclear, and they have never been characterized in stroke survivors. In a magnetoencephalography study, we demonstrate that high-gamma oscillations in motor cortical areas scale with movement rate, and we further explore their temporal and spatial characteristics. Stroke survivors exhibit lower high-gamma power during movement than age-matched control participants, even after matching for movement rate. The results contribute to the understanding of the role of high-gamma oscillations in motor control and have important implications for neuromodulation in stroke rehabilitation.

Antagonistic behavior of brain networks mediated by low-frequency oscillations: electrophysiological dynamics during internal-external attention switching

Antagonistic activity of brain networks likely plays a fundamental role in how the brain optimizes its performance by efficient allocation of computational resources. A prominent example involves externally/internally oriented attention tasks, implicating two anticorrelated, intrinsic brain networks: the default mode network (DMN) and the dorsal attention network (DAN). To elucidate electrophysiological underpinnings and causal interplay during attention switching, we recorded intracranial EEG (iEEG) from 25 epilepsy patients with electrode contacts localized in the DMN and DAN. We show antagonistic network dynamics of activation-related changes in high-frequency (> 50 Hz) and low-frequency (< 30 Hz) power. The temporal profile of information flow between the networks estimated by functional connectivity suggests that the activated network inhibits the other one, gating its activity by increasing the amplitude of the low-frequency oscillations. Insights about inter-network communication may have profound implications for various brain disorders in which these dynamics are compromised.

Timing of Allocentric and Egocentric Spatial Processing in Human Intracranial EEG

Spatial reference frames (RFs) play a key role in spatial cognition, especially in perception, spatial memory, and navigation. There are two main types of RFs: egocentric (self-centered) and allocentric (object-centered). Although many fMRI studies examined the neural correlates of egocentric and allocentric RFs, they could not sample the fast temporal dynamics of the underlying cognitive processes. Therefore, the interaction and timing between these two RFs remain unclear. Taking advantage of the high temporal resolution of intracranial EEG (iEEG), we aimed to determine the timing of egocentric and allocentric information processing and describe the brain areas involved. We recorded iEEG and analyzed broad gamma activity (50-150 Hz) in 37 epilepsy patients performing a spatial judgment task in a three-dimensional circular virtual arena. We found overlapping activation for egocentric and allocentric RFs in many brain regions, with several additional egocentric- and allocentric-selective areas. In contrast to the egocentric responses, the allocentric responses peaked later than the control ones in frontal regions with overlapping selectivity. Also, across several egocentric or allocentric selective areas, the egocentric selectivity appeared earlier than the allocentric one. We identified the maximum number of egocentric-selective channels in the medial occipito-temporal region and allocentric-selective channels around the intraparietal sulcus in the parietal cortex. Our findings favor the hypothesis that egocentric spatial coding is a more primary process, and allocentric representations may be derived from egocentric ones. They also broaden the dominant view of the dorsal and ventral streams supporting egocentric and allocentric space coding, respectively.

Sensing local field potentials with a directional and scalable depth electrode array

Objective. A variety of electrophysiology tools are available to the neurosurgeon for diagnosis, functional therapy, and neural prosthetics. However, no tool can currently address these three critical needs: (a) access to all cortical regions in a minimally invasive manner; (b) recordings with microscale, mesoscale, and macroscale resolutions simultaneously; and (c) access to spatially distant multiple brain regions that constitute distributed cognitive networks.Approach.We modeled, designed, and demonstrated a novel device for recording local field potentials (LFPs) with the form factor of a stereo-electroencephalographic electrode and combined with radially distributed microelectrodes.Main results. Electro-quasistatic models demonstrate that the lead body amplifies and shields LFP sources based on direction, enablingdirectional sensitivity andscalability, referred to as thedirectional andscalable (DISC) array.In vivo,DISC demonstrated significantly improved signal-to-noise ratio, directional sensitivity, and decoding accuracy from rat barrel cortex recordings during whisker stimulation. Critical for future translation, DISC demonstrated a higher signal to noise ratio (SNR) than virtual ring electrodes and a noise floor approaching that of large ring electrodes in an unshielded environment after common average referencing. DISC also revealed independent, stereoscopic current source density measures whose direction was verified after histology.Significance. Directional sensitivity of LFPs may significantly improve brain-computer interfaces and many diagnostic procedures, including epilepsy foci detection and deep brain targeting.

On closed-loop brain stimulation systems for improving the quality of life of patients with neurological disorders

Emerging brain technologies have significantly transformed human life in recent decades. For instance, the closed-loop brain-computer interface (BCI) is an advanced software-hardware system that interprets electrical signals from neurons, allowing communication with and control of the environment. The system then transmits these signals as controlled commands and provides feedback to the brain to execute specific tasks. This paper analyzes and presents the latest research on closed-loop BCI that utilizes electric/magnetic stimulation, optogenetic, and sonogenetic techniques. These techniques have demonstrated great potential in improving the quality of life for patients suffering from neurodegenerative or psychiatric diseases. We provide a comprehensive and systematic review of research on the modalities of closed-loop BCI in recent decades. To achieve this, the authors used a set of defined criteria to shortlist studies from well-known research databases into categories of brain stimulation techniques. These categories include deep brain stimulation, transcranial magnetic stimulation, transcranial direct-current stimulation, transcranial alternating-current stimulation, and optogenetics. These techniques have been useful in treating a wide range of disorders, such as Alzheimer's and Parkinson's disease, dementia, and depression. In total, 76 studies were shortlisted and analyzed to illustrate how closed-loop BCI can considerably improve, enhance, and restore specific brain functions. The analysis revealed that literature in the area has not adequately covered closed-loop BCI in the context of cognitive neural prosthetics and implanted neural devices. However, the authors demonstrate that the applications of closed-loop BCI are highly beneficial, and the technology is continually evolving to improve the lives of individuals with various ailments, including those with sensory-motor issues or cognitive deficiencies. By utilizing emerging techniques of stimulation, closed-loop BCI can safely improve patients' cognitive and affective skills, resulting in better healthcare outcomes.

From thinking fast to moving fast: motor control of fast limb movements in healthy individuals

The ability to produce high movement speeds is a crucial factor in human motor performance, from the skilled athlete to someone avoiding a fall. Despite this relevance, there remains a lack of both an integrative brain-to-behavior analysis of these movements and applied studies linking the known dependence on open-loop, central control mechanisms of these movements to their real-world implications, whether in the sports, performance arts, or occupational setting. In this review, we cover factors associated with the planning and performance of fast limb movements, from the generation of the motor command in the brain to the observed motor output. At each level (supraspinal, peripheral, and motor output), the influencing factors are presented and the changes brought by training and fatigue are discussed. The existing evidence of more applied studies relevant to practical aspects of human performance is also discussed. Inconsistencies in the existing literature both in the definitions and findings are highlighted, along with suggestions for further studies on the topic of fast limb movement control. The current heterogeneity in what is considered a fast movement and in experimental protocols makes it difficult to compare findings in the existing literature. We identified the role of the cerebellum in movement prediction and of surround inhibition in motor slowing, as well as the effects of fatigue and training on central motor control, as possible avenues for further research, especially in performance-driven populations.

Motor Imagery Classification for Brain Computer Interface Using Deep Convolutional Neural Networks and Mixup Augmentation

Goal: Building a DL model that can be trained on small EEG training set of a single subject presents an interesting challenge that this work is trying to address. In particular, this study is trying to avoid the need for long EEG data collection sessions, and without combining multiple subjects training datasets, which has a detrimental effect on the classification performance due to the inter-individual variability among subjects. Methods: A customized Convolutional Neural Network with mixup augmentation was trained with [Formula: see text]120 EEG trials for only one subject per model. Results: Modified ResNet18 and DenseNet121 models with mixup augmentation achieved 0.920 (95% Confidence Interval: 0.908, 0.933) and 0.933 (95% Confidence Interval: 0.922, 0.945) classification accuracy, respectively. Conclusions: We show that the designed classifiers resulted in a higher classification performance in comparison to other DL classifiers of previous studies on the same dataset, despite the limited training dataset used in this work.

Interpretable functional specialization emerges in deep convolutional networks trained on brain signals

OBJECTIVE

Functional specialization is fundamental to neural information processing. Here, we study whether and how functional specialization emerges in artificial deep convolutional neural networks (CNNs) during a brain-computer interfacing (BCI) task.

APPROACH

We trained CNNs to predict hand movement speed from intracranial EEG (iEEG) and delineated how units across the different CNN hidden layers learned to represent the iEEG signal.

MAIN RESULTS

We show that distinct, functionally interpretable neural populations emerged as a result of the training process. While some units became sensitive to either iEEG amplitude or phase, others showed bimodal behavior with significant sensitivity to both features. Pruning of highly-sensitive units resulted in a steep drop of decoding accuracy not observed for pruning of less sensitive units, highlighting the functional relevance of the amplitude- and phase-specialized populations.

SIGNIFICANCE

We anticipate that emergent functional specialization as uncovered here will become a key concept in research towards interpretable deep learning for neuroscience and BCI applications.

Decoding ECoG signal into 3D hand translation using deep learning

Objective.Motor brain-computer interfaces (BCIs) are a promising technology that may enable motor-impaired people to interact with their environment. BCIs would potentially compensate for arm and hand function loss, which is the top priority for individuals with tetraplegia. Designing real-time and accurate BCI is crucial to make such devices useful, safe, and easy to use by patients in a real-life environment. Electrocorticography (ECoG)-based BCIs emerge as a good compromise between invasiveness of the recording device and good spatial and temporal resolution of the recorded signal. However, most ECoG signal decoders used to predict continuous hand movements are linear models. These models have a limited representational capacity and may fail to capture the relationship between ECoG signal features and continuous hand movements. Deep learning (DL) models, which are state-of-the-art in many problems, could be a solution to better capture this relationship.Approach.In this study, we tested several DL-based architectures to predict imagined 3D continuous hand translation using time-frequency features extracted from ECoG signals. The dataset used in the analysis is a part of a long-term clinical trial (ClinicalTrials.gov identifier: NCT02550522) and was acquired during a closed-loop experiment with a tetraplegic subject. The proposed architectures include multilayer perceptron, convolutional neural networks (CNNs), and long short-term memory networks (LSTM). The accuracy of the DL-based and multilinear models was compared offline using cosine similarity.Main results.Our results show that CNN-based architectures outperform the current state-of-the-art multilinear model. The best architecture exploited the spatial correlation between neighboring electrodes with CNN and benefited from the sequential character of the desired hand trajectory by using LSTMs. Overall, DL increased the average cosine similarity, compared to the multilinear model, by up to 60%, from 0.189 to 0.302 and from 0.157 to 0.249 for the left and right hand, respectively.Significance.This study shows that DL-based models could increase the accuracy of BCI systems in the case of 3D hand translation prediction in a tetraplegic subject.

Applying Dimensionality Reduction Techniques in Source-Space Electroencephalography via Template and Magnetic Resonance Imaging-Derived Head Models to Continuously Decode Hand Trajectories

Several studies showed evidence supporting the possibility of hand trajectory decoding from low-frequency electroencephalography (EEG). However, the decoding in the source space via source localization is scarcely investigated. In this study, we tried to tackle the problem of collinearity due to the higher number of signals in the source space by two folds: first, we selected signals in predefined regions of interest (ROIs); second, we applied dimensionality reduction techniques to each ROI. The dimensionality reduction techniques were computing the mean (Mean), principal component analysis (PCA), and locality preserving projections (LPP). We also investigated the effect of decoding between utilizing a template head model and a subject-specific head model during the source localization. The results indicated that applying source-space decoding with PCA yielded slightly higher correlations and signal-to-noise (SNR) ratios than the sensor-space approach. We also observed slightly higher correlations and SNRs when applying the subject-specific head model than the template head model. However, the statistical tests revealed no significant differences between the source-space and sensor-space approaches and no significant differences between subject-specific and template head models. The decoder with Mean and PCA utilizes information mainly from precuneus and cuneus to decode the velocity kinematics similarly in the subject-specific and template head models.

Feel Your Reach: An EEG-Based Framework to Continuously Detect Goal-Directed Movements and Error Processing to Gate Kinesthetic Feedback Informed Artificial Arm Control

Establishing the basic knowledge, methodology, and technology for a framework for the continuous decoding of hand/arm movement intention was the aim of the ERC-funded project "Feel Your Reach". In this work, we review the studies and methods we performed and implemented in the last 6 years, which build the basis for enabling severely paralyzed people to non-invasively control a robotic arm in real-time from electroencephalogram (EEG). In detail, we investigated goal-directed movement detection, decoding of executed and attempted movement trajectories, grasping correlates, error processing, and kinesthetic feedback. Although we have tested some of our approaches already with the target populations, we still need to transfer the "Feel Your Reach" framework to people with cervical spinal cord injury and evaluate the decoders' performance while participants attempt to perform upper-limb movements. While on the one hand, we made major progress towards this ambitious goal, we also critically discuss current limitations.

Workshops of the Eighth International Brain-Computer Interface Meeting: BCIs: The Next Frontier

The Eighth International Brain-Computer Interface (BCI) Meeting was held June 7-9th, 2021 in a virtual format. The conference continued the BCI Meeting series' interactive nature with 21 workshops covering topics in BCI (also called brain-machine interface) research. As in the past, workshops covered the breadth of topics in BCI. Some workshops provided detailed examinations of specific methods, hardware, or processes. Others focused on specific BCI applications or user groups. Several workshops continued consensus building efforts designed to create BCI standards and increase the ease of comparisons between studies and the potential for meta-analysis and large multi-site clinical trials. Ethical and translational considerations were both the primary topic for some workshops or an important secondary consideration for others. The range of BCI applications continues to expand, with more workshops focusing on approaches that can extend beyond the needs of those with physical impairments. This paper summarizes each workshop, provides background information and references for further study, presents an overview of the discussion topics, and describes the conclusion, challenges, or initiatives that resulted from the interactions and discussion at the workshop.

Bradykinesia in motoneuron diseases

OBJECTIVE

Only few studies investigated voluntary movement abnormalities in patients with motoneuron diseases (MNDs) or their neurophysiological correlates. We aimed to kinematically assess finger tapping abnormalities in patients with amyotrophic lateral sclerosis (ALS) and primary lateral sclerosis (PLS), as compared to healthy controls (HCs), and their relationship with motoneuron involvement.

METHODS

Fourteen ALS and 5 PLS patients were enrolled. Finger tapping was assessed by a motion analysis system. Patients underwent a central motor conduction time assessment, a motor nerve conduction study, and needle electromyography. Data were compared to those of 79 HCs using non-parametric tests. Possible relationships between clinical, kinematic, and neurophysiological data were assessed in patients.

RESULTS

As a major finding, ALS and PLS patients performed finger tapping slower than HCs. In both conditions, movement slowness correlated with muscle strength. In ALS, movement slowness also correlated with the amplitude of the compound muscle action potential recorded from the muscles involved in the task and with denervation activity. No correlations were found between slowness, measures of upper motoneuron involvement, and other clinical and neurophysiological data.

CONCLUSIONS

This study provides novel information on voluntary movement abnormalities in MNDs.

SIGNIFICANCE

The results highlight the pathophysiological role of motoneurons in generating movement slowness.

Alpha and high gamma phase amplitude coupling during motor imagery and weighted cross-frequency coupling to extract discriminative cross-frequency patterns

Motor imagery modulates specific neural oscillations like actual movement does. Representatively, suppression of the alpha power (e.g., event-related desynchronization [ERD]) is the typical pattern of motor imagery in the motor cortex. However, in addition to this amplitude-based feature, the coupling across frequencies includes important information about the brain functions and the existence of such complex information has been reported in various invasive studies. Yet, the interaction across multiple frequencies during motor imagery processing is still unclear and has not been widely studied, particularly concerning the non-invasive signals. In this study, we provide empirical evidence of the comodulation between the phase of alpha rhythm and the amplitude of high gamma rhythm during the motor imagery process. We used electroencephalography (EEG) in our investigation during the imagination of left- or right-hand movement recorded from 52 healthy subjects, and quantified the ERD of alpha and phase-amplitude coupling (PAC) which is a relative change of modulation index to the base line period (before the cue). As a result, we found that the coupling between the phase of alpha (8-12 Hz) and the amplitude of high gamma (70-120 Hz) and this PAC decreases during motor imagery and then rebounds to the baseline like alpha ERD (r = 0.29 to 0.42). This correlation between PAC and ERD was particularly stronger in the ipsilateral area. In addition, trials that demonstrated higher alpha power during the ready period (before the cue) showed a larger ERD during motor imagery and similarly, trials with higher modulation index during the ready period yielded a greater decrease in PAC during imagery. In the classification analysis, we found that the effective phase frequency that showed better decoding accuracy in left and right-hand imagery, varied across subjects. Motivated by result, we proposed a weighted cross-frequency coupling (WCFC) method that extracts the maximal discriminative feature by combining band power and CFC. In the evaluation, WCFC with only two electrodes yielded a performance comparable to the conventional algorithm with 64 electrodes in classifying left and right-hand motor imagery. These results indicate that the phase-amplitude frequency plays an important role in motor imagery, and that optimizing this frequency ranges is crucial for extracting information features to decode the motor imagery types.

Mapping the Scene and Object Processing Networks by Intracranial EEG

Human perception and cognition are based predominantly on visual information processing. Much of the information regarding neuronal correlates of visual processing has been derived from functional imaging studies, which have identified a variety of brain areas contributing to visual analysis, recognition, and processing of objects and scenes. However, only two of these areas, namely the parahippocampal place area (PPA) and the lateral occipital complex (LOC), were verified and further characterized by intracranial electroencephalogram (iEEG). iEEG is a unique measurement technique that samples a local neuronal population with high temporal and anatomical resolution. In the present study, we aimed to expand on previous reports and examine brain activity for selectivity of scenes and objects in the broadband high-gamma frequency range (50–150 Hz). We collected iEEG data from 27 epileptic patients while they watched a series of images, containing objects and scenes, and we identified 375 bipolar channels responding to at least one of these two categories. Using K-means clustering, we delineated their brain localization. In addition to the two areas described previously, we detected significant responses in two other scene-selective areas, not yet reported by any electrophysiological studies; namely the occipital place area (OPA) and the retrosplenial complex. Moreover, using iEEG we revealed a much broader network underlying visual processing than that described to date, using specialized functional imaging experimental designs. Here, we report the selective brain areas for scene processing include the posterior collateral sulcus and the anterior temporal region, which were already shown to be related to scene novelty and landmark naming. The object-selective responses appeared in the parietal, frontal, and temporal regions connected with tool use and object recognition. The temporal analyses specified the time course of the category selectivity through the dorsal and ventral visual streams. The receiver operating characteristic analyses identified the PPA and the fusiform portion of the LOC as being the most selective for scenes and objects, respectively. Our findings represent a valuable overview of visual processing selectivity for scenes and objects based on iEEG analyses and thus, contribute to a better understanding of visual processing in the human brain.

Distance- and speed-informed kinematics decoding improves M/EEG based upper-limb movement decoder accuracy

OBJECTIVE

One of the main goals in brain-computer interface (BCI) research is the replacement or restoration of lost function in individuals with paralysis. One line of research investigates the inference of movement kinematics from brain activity during different volitional states. A growing number of electroencephalography (EEG) and magnetoencephalography (MEG) studies suggest that information about directional (e.g. velocity) and nondirectional (e.g. speed) movement kinematics is accessible noninvasively. We sought to assess if the neural information associated with both types of kinematics can be combined to improve the decoding accuracy.

APPROACH

In an offline analysis, we reanalyzed the data of two previous experiments containing the recordings of 34 healthy participants (15 EEG, 19 MEG). We decoded 2D movement trajectories from low-frequency M/EEG signals in executed and observed tracking movements, and compared the accuracy of an unscented Kalman filter (UKF) that explicitly modeled the nonlinear relation between directional and nondirectional kinematics to the accuracies of linear Kalman (KF) and Wiener filters which did not combine both types of kinematics.

MAIN RESULTS

At the group level, posterior-parietal and parieto-occipital (executed and observed movements) and sensorimotor areas (executed movements) encoded kinematic information. Correlations between the recorded position and velocity trajectories and the UKF decoded ones were on average 0.49 during executed and 0.36 during observed movements. Compared to the other filters, the UKF could achieve the best trade-off between maximizing the signal to noise ratio and minimizing the amplitude mismatch between the recorded and decoded trajectories.

SIGNIFICANCE

We present direct evidence that directional and nondirectional kinematic information is simultaneously detectable in low-frequency M/EEG signals. Moreover, combining directional and nondirectional kinematic information significantly improves the decoding accuracy upon a linear KF.

Stability of motor cortex network states during learning-associated neural reorganizations

A substantial reorganization of neural activity and neuron-to-movement relationship in motor cortical circuits accompanies the emergence of reproducible movement patterns during motor learning. Little is known about how this tempest of neural activity restructuring impacts the stability of network states in recurrent cortical circuits. To investigate this issue, we reanalyzed data in which we recorded for 14 days via population calcium imaging the activity of the same neural populations of pyramidal neurons in layer 2/3 and layer 5 of forelimb motor and premotor cortex in mice during the daily learning of a lever-press task. We found that motor cortex network states remained stable with respect to the critical network state during the extensive reorganization of both neural population activity and its relation to lever movement throughout learning. Specifically, layer 2/3 cortical circuits unceasingly displayed robust evidence for operating at the critical network state, a regime that maximizes information capacity and transmission and provides a balance between network robustness and flexibility. In contrast, layer 5 circuits operated away from the critical network state for all 14 days of recording and learning. In conclusion, this result indicates that the wide-ranging malleability of synapses, neurons, and neural connectivity during learning operates within the constraint of a stable and layer-specific network state regarding dynamic criticality, and suggests that different cortical layers operate under distinct constraints because of their specialized goals.NEW & NOTEWORTHY The neural activity reorganizes throughout motor learning, but how this reorganization impacts the stability of network states is unclear. We used two-photon calcium imaging to investigate how the network states in layer 2/3 and layer 5 of forelimb motor and premotor cortex are modulated by motor learning. We show that motor cortex network states are layer-specific and constant regarding criticality during neural activity reorganization, and suggests that layer-specific constraints could be motivated by different functions.

Distinct cortical networks for hand movement initiation and directional processing: An EEG study

Movement preparation and initiation have been shown to involve large scale brain networks. Recent findings suggest that movement preparation and initiation are represented in functionally distinct cortical networks. In electroencephalographic (EEG) recordings, movement initiation is reflected as a strong negative potential at medial central channels that is phase-locked to the movement onset - the movement-related cortical potential (MRCP). Movement preparation describes the process of transforming high level movement goals to low level commands. An integral part of this transformation process is directional processing (i.e., where to move). The processing of movement direction during visuomotor and oculomotor tasks is associated with medial parieto-occipital cortex (PO) activity, phase-locked to the presentation of potential movement goals. We surmised that the network generating the MRCP (movement initiation) would encode less information about movement direction than the parieto-occipital network processing movement direction. Here, we studied delta band EEG activity during center-out reaching movements (2D; 4 directions) in visuomotor and oculomotor tasks. In 15 healthy participants, we found a consistent representation of movement direction in PO 300–400 ​ms after the direction cue irrespective of the task. Despite generating the MRCP, sensorimotor areas (SM) encoded less information about the movement direction than PO. Moreover, the encoded directional information in SM was less consistent across participants and specific to the visuomotor task. In a classification approach, we could infer the four movement directions from the delta band EEG activity with moderate accuracies up to 55.9%. The accuracies for cue-aligned data were significantly higher than for movement onset-aligned data in either task, which also suggests a stronger representation of movement direction during movement preparation. Therefore, we present direct evidence that EEG delta band amplitude modulations carry information about both arm movement initiation and movement direction, and that they are represented in two distinct cortical networks.

•

Delta band EEG carries information about arm movement initiation and direction.

•

Movement initiation and direction are represented in two distinct cortical networks.

•

Information about movement direction is primarily encoded in parieto-occipital areas.

•

The activity in parieto-occipital areas is phase-locked to the direction cue.

Using machine learning to reveal the population vector from EEG signals

OBJECTIVE

Since the discovery of the population vector that directly relates neural spiking activity with arm movement direction, it has become feasible to control robotic arms and neuroprostheses using invasively recorded brain signals. For non-invasive approaches, a direct relation between human brain signals and arm movement direction is yet to be established.

APPROACH

Here, we investigated electroencephalographic (EEG) signals in temporal and spectral domains in a continuous, circular arm movement task. Using machine learning methods that respect the linear mixture of brain activity within EEG signals, we show that directional information is represented in the temporal domain in amplitude modulations of the same frequency as the arm movement, and in the spectral domain in power modulations of the 20-24 Hz frequency band.

MAIN RESULTS

In the temporal domain, the directional information was mainly expressed in primary sensorimotor cortex (SM1) and posterior parietal cortex (PPC) contralateral to the moving arm, while in the spectral domain SM1 and PPC of both hemispheres predicted arm movement direction. The different cortical representations suggest distinct neural representations in both domains.

SIGNIFICANCE

This direct relation between neural activity and arm movement direction in both domains demonstrates the potential of machine learning to reveal neuroscientific insights about the dynamics of human arm movements.

G-Causality Brain Connectivity Differences of Finger Movements between Motor Execution and Motor Imagery

Motor imagery is one of the classical paradigms which have been used in brain-computer interface and motor function recovery. Finger movement-based motor execution is a complex biomechanical architecture and a crucial task for establishing most complicated and natural activities in daily life. Some patients may suffer from alternating hemiplegia after brain stroke and lose their ability of motor execution. Fortunately, the ability of motor imagery might be preserved independently and worked as a backdoor for motor function recovery. The efficacy of motor imagery for achieving significant recovery for the motor cortex after brain stroke is still an open question. In this study, we designed a new paradigm to investigate the neural mechanism of thirty finger movements in two scenarios: motor execution and motor imagery. Eleven healthy participants performed or imagined thirty hand gestures twice based on left and right finger movements. The electroencephalogram (EEG) signal for each subject during sixty trials left and right finger motor execution and imagery were recorded during our proposed experimental paradigm. The Granger causality (G-causality) analysis method was employed to analyze the brain connectivity and its strength between contralateral premotor, motor, and sensorimotor areas. Highest numbers for G-causality trials of 37 ± 7.3, 35.5 ± 8.8, 36.3 ± 10.3, and 39.2 ± 9.0 and lowest Granger causality coefficients of 9.1 ± 3.2, 10.9 ± 3.7, 13.2 ± 0.6, and 13.4 ± 0.6 were achieved from the premotor to motor area during execution/imagination tasks of right and left finger movements, respectively. These results provided a new insight into motor execution and motor imagery based on hand gestures, which might be useful to build a new biomarker of finger motor recovery for partially or even completely plegic patients. Furthermore, a significant difference of the G-causality trial number was observed during left finger execution/imagery and right finger imagery, but it was not observed during the right finger execution phase. Significant difference of the G-causality coefficient was observed during left finger execution and imagery, but it was not observed during right finger execution and imagery phases. These results suggested that different MI-based brain motor function recovery strategies should be taken for right-hand and left-hand patients after brain stroke.

Encoding of kinetic and kinematic movement parameters in the sensorimotor cortex: A Brain-Computer Interface perspective

For severely paralyzed people, Brain-Computer Interfaces (BCIs) can potentially replace lost motor output and provide a brain-based control signal for augmentative and alternative communication devices or neuroprosthetics. Many BCIs focus on neuronal signals acquired from the hand area of the sensorimotor cortex, employing changes in the patterns of neuronal firing or spectral power associated with one or more types of hand movement. Hand and finger movement can be described by two groups of movement features, namely kinematics (spatial and motion aspects) and kinetics (muscles and forces). Despite extensive primate and human research, it is not fully understood how these features are represented in the SMC and how they lead to the appropriate movement. Yet, the available information may provide insight into which features are most suitable for BCI control. To that purpose, the current paper provides an in-depth review on the movement features encoded in the SMC. Even though there is no consensus on how exactly the SMC generates movement, we conclude that some parameters are well represented in the SMC and can be accurately used for BCI control with discrete as well as continuous feedback. However, the vast evidence also suggests that movement should be interpreted as a combination of multiple parameters rather than isolated ones, pleading for further exploration of sensorimotor control models for accurate BCI control.

Attempted Arm and Hand Movements can be Decoded from Low-Frequency EEG from Persons with Spinal Cord Injury

We show that persons with spinal cord injury (SCI) retain decodable neural correlates of attempted arm and hand movements. We investigated hand open, palmar grasp, lateral grasp, pronation, and supination in 10 persons with cervical SCI. Discriminative movement information was provided by the time-domain of low-frequency electroencephalography (EEG) signals. Based on these signals, we obtained a maximum average classification accuracy of 45% (chance level was 20%) with respect to the five investigated classes. Pattern analysis indicates central motor areas as the origin of the discriminative signals. Furthermore, we introduce a proof-of-concept to classify movement attempts online in a closed loop, and tested it on a person with cervical SCI. We achieved here a modest classification performance of 68.4% with respect to palmar grasp vs hand open (chance level 50%).

Cortical and subcortical areas involved in the regulation of reach movement speed in the human brain: An fMRI study

Reach movements are characterized by multiple kinematic variables that can change with age or due to medical conditions such as movement disorders. While the neural control of reach direction is well investigated, the elements of the neural network regulating speed (the nondirectional component of velocity) remain uncertain. Here, we used a custom made magnetic resonance (MR)-compatible arm movement tracking system to capture the real kinematics of the arm movements while measuring brain activation with functional magnetic resonance imaging to reveal areas in the human brain in which BOLD-activation covaries with the speed of arm movements. We found significant activation in multiple cortical and subcortical brain regions positively correlated with endpoint (wrist) speed (speed-related activation), including contralateral premotor cortex (PMC), supplementary motor area (SMA), thalamus (putative VL/VA nuclei), and bilateral putamen. The hand and arm regions of primary sensorimotor cortex (SMC) and a posterior region of thalamus were significantly activated by reach movements but showed a more binary response characteristics (movement present or absent) than with continuously varying speed. Moreover, a subregion of contralateral SMA also showed binary movement activation but no speed-related BOLD-activation. Effect size analysis revealed bilateral putamen as the most speed-specific region among the speed-related clusters whereas primary SMC showed the strongest specificity for movement versus non-movement discrimination, independent of speed variations. The results reveal a network of multiple cortical and subcortical brain regions that are involved in speed regulation among which putamen, anterior thalamus, and PMC show highest specificity to speed, suggesting a basal-ganglia-thalamo-cortical loop for speed regulation.

Data-Driven Transducer Design and Identification for Internally-Paced Motor Brain Computer Interfaces: A Review

Brain-Computer Interfaces (BCIs) are systems that establish a direct communication pathway between the users' brain activity and external effectors. They offer the potential to improve the quality of life of motor-impaired patients. Motor BCIs aim to permit severely motor-impaired users to regain limb mobility by controlling orthoses or prostheses. In particular, motor BCI systems benefit patients if the decoded actions reflect the users' intentions with an accuracy that enables them to efficiently interact with their environment. One of the main challenges of BCI systems is to adapt the BCI's signal translation blocks to the user to reach a high decoding accuracy. This paper will review the literature of data-driven and user-specific transducer design and identification approaches and it focuses on internally-paced motor BCIs. In particular, continuous kinematic biomimetic and mental-task decoders are reviewed. Furthermore, static and dynamic decoding approaches, linear and non-linear decoding, offline and real-time identification algorithms are considered. The current progress and challenges related to the design of clinical-compatible motor BCI transducers are additionally discussed.

EEG source space analysis of the supervised factor analytic approach for the classification of multi-directional arm movement

OBJECTIVE

In electroencephalography (EEG)-based brain-computer interface (BCI) systems for motor control tasks the conventional practice is to decode motor intentions by using scalp EEG. However, scalp EEG only reveals certain limited information about the complex tasks of movement with a higher degree of freedom. Therefore, our objective is to investigate the effectiveness of source-space EEG in extracting relevant features that discriminate arm movement in multiple directions.

APPROACH

We have proposed a novel feature extraction algorithm based on supervised factor analysis that models the data from source-space EEG. To this end, we computed the features from the source dipoles confined to Brodmann areas of interest (BA4a, BA4p and BA6). Further, we embedded class-wise labels of multi-direction (multi-class) source-space EEG to an unsupervised factor analysis to make it into a supervised learning method.

MAIN RESULTS

Our approach provided an average decoding accuracy of 71% for the classification of hand movement in four orthogonal directions, that is significantly higher (>10%) than the classification accuracy obtained using state-of-the-art spatial pattern features in sensor space. Also, the group analysis on the spectral characteristics of source-space EEG indicates that the slow cortical potentials from a set of cortical source dipoles reveal discriminative information regarding the movement parameter, direction.

SIGNIFICANCE

This study presents evidence that low-frequency components in the source space play an important role in movement kinematics, and thus it may lead to new strategies for BCI-based neurorehabilitation.

Human Sensorimotor Cortex Control of Directly Measured Vocal Tract Movements during Vowel Production

During speech production, we make vocal tract movements with remarkable precision and speed. Our understanding of how the human brain achieves such proficient control is limited, in part due to the challenge of simultaneously acquiring high-resolution neural recordings and detailed vocal tract measurements. To overcome this challenge, we combined ultrasound and video monitoring of the supralaryngeal articulators (lips, jaw, and tongue) with electrocorticographic recordings from the cortical surface of 4 subjects (3 female, 1 male) to investigate how neural activity in the ventral sensory-motor cortex (vSMC) relates to measured articulator movement kinematics (position, speed, velocity, acceleration) during the production of English vowels. We found that high-gamma activity at many individual vSMC electrodes strongly encoded the kinematics of one or more articulators, but less so for vowel formants and vowel identity. Neural population decoding methods further revealed the structure of kinematic features that distinguish vowels. Encoding of articulator kinematics was sparsely distributed across time and primarily occurred during the time of vowel onset and offset. In contrast, encoding was low during the steady-state portion of the vowel, despite sustained neural activity at some electrodes. Significant representations were found for all kinematic parameters, but speed was the most robust. These findings enabled by direct vocal tract monitoring demonstrate novel insights into the representation of articulatory kinematic parameters encoded in the vSMC during speech production.SIGNIFICANCE STATEMENT Speaking requires precise control and coordination of the vocal tract articulators (lips, jaw, and tongue). Despite the impressive proficiency with which humans move these articulators during speech production, our understanding of how the brain achieves such control is rudimentary, in part because the movements themselves are difficult to observe. By simultaneously measuring speech movements and the neural activity that gives rise to them, we demonstrate how neural activity in sensorimotor cortex produces complex, coordinated movements of the vocal tract.

Characterization of electrocorticogram high-gamma signal in response to varying upper extremity movement velocity

The mechanism by which the human primary motor cortex (M1) encodes upper extremity movement kinematics is not fully understood. For example, human electrocorticogram (ECoG) signals have been shown to modulate with upper extremity movements; however, this relationship has not been explicitly characterized. To address this issue, we recorded high-density ECoG signals from patients undergoing epilepsy surgery evaluation as they performed elementary upper extremity movements while systematically varying movement speed and duration. Specifically, subjects performed intermittent pincer grasp/release, elbow flexion/extension, and shoulder flexion/extension at slow, moderate, and fast speeds. In all movements, bursts of power in the high-[Formula: see text] band (80-160 Hz) were observed in M1. In addition, the amplitude of these power bursts and the area of M1 with elevated high-[Formula: see text] activity were directly proportional to the movement speed. Likewise, the duration of elevated high-[Formula: see text] activity increased with movement duration. Based on linear regression, M1 high-[Formula: see text] power amplitude and duration covaried with movement speed and duration, respectively, with an average [Formula: see text] of [Formula: see text] and [Formula: see text]. These findings indicate that the encoding of upper extremity movement speed by M1 high-[Formula: see text] activity is primarily linear. Also, the fact that this activity remained elevated throughout a movement suggests that M1 does not merely generate transient instructions for a specific movement duration, but instead is responsible for the entirety of the movement. Finally, the spatial distribution of high-[Formula: see text] activity suggests the presence of a recruitment phenomenon in which higher speeds or increased muscle activity involve activation of larger M1 areas.

Mapping ECoG channel contributions to trajectory and muscle activity prediction in human sensorimotor cortex

Studies on brain-machine interface techniques have shown that electrocorticography (ECoG) is an effective modality for predicting limb trajectories and muscle activity in humans. Motor control studies have also identified distributions of “extrinsic-like” and “intrinsic-like” neurons in the premotor (PM) and primary motor (M1) cortices. Here, we investigated whether trajectories and muscle activity predicted from ECoG were obtained based on signals derived from extrinsic-like or intrinsic-like neurons. Three participants carried objects of three different masses along the same counterclockwise path on a table. Trajectories of the object and upper arm muscle activity were predicted using a sparse linear regression. Weight matrices for the predictors were then compared to determine if the ECoG channels contributed more information about trajectory or muscle activity. We found that channels over both PM and M1 contributed highly to trajectory prediction, while a channel over M1 was the highest contributor for muscle activity prediction.

Individual Differences in Resting Corticospinal Excitability Are Correlated with Reaction Time and GABA Content in Motor Cortex

Individuals differ in the intrinsic excitability of their corticospinal pathways and, perhaps more generally, their entire nervous system. At present, we have little understanding of the mechanisms underlying these differences and how variation in intrinsic excitability relates to behavior. Here, we examined the relationship between individual differences in intrinsic corticospinal excitability, local cortical GABA levels, and reaction time (RT) in a group of 20 healthy human adults. We measured corticospinal excitability at rest with transcranial magnetic stimulation, local concentrations of basal GABA with magnetic resonance spectroscopy, and RT with a behavioral task. All measurements were repeated in two separate sessions, and tests of reliability confirmed the presence of stable individual differences. There was a negative correlation between corticospinal excitability and RT, such that larger motor-evoked potentials (MEPs) measured at rest were associated with faster RTs. Interestingly, larger MEPs were associated with higher levels of GABA in M1, but not in three other cortical regions. Together, these results suggest that individuals with more excitable corticospinal pathways are faster to initiate planned responses and have higher levels of GABA within M1, possibly to compensate for a more excitable motor system.SIGNIFICANCE STATEMENT This study brings together physiological, behavioral, and neurochemical evidence to examine variability in the excitability of the human motor system. Previous work has focused on state-based factors (e.g., preparedness, uncertainty), with little attention given to the influence of inherent stable characteristics. Here, we examined how the excitability of the motor system relates to reaction time and the regional content of the inhibitory neurotransmitter GABA. Importantly, motor pathway excitability and GABA concentrations were measured at rest, outside a task context, providing assays of intrinsic properties of the individuals. Individuals with more excitable motor pathways had faster reaction times and, paradoxically, higher concentrations of GABA. We propose that greater GABA capacity in the motor cortex counteracts an intrinsically more excitable motor system.

From intentions to actions: Neural oscillations encode motor processes through phase, amplitude and phase-amplitude coupling

Goal-directed motor behavior is associated with changes in patterns of rhythmic neuronal activity across widely distributed brain areas. In particular, movement initiation and execution are mediated by patterns of synchronization and desynchronization that occur concurrently across distinct frequency bands and across multiple motor cortical areas. To date, motor-related local oscillatory modulations have been predominantly examined by quantifying increases or suppressions in spectral power. However, beyond signal power, spectral properties such as phase and phase-amplitude coupling (PAC) have also been shown to carry information with regards to the oscillatory dynamics underlying motor processes. Yet, the distinct functional roles of phase, amplitude and PAC across the planning and execution of goal-directed motor behavior remain largely elusive. Here, we address this question with unprecedented resolution thanks to multi-site intracerebral EEG recordings in human subjects while they performed a delayed motor task. To compare the roles of phase, amplitude and PAC, we monitored intracranial brain signals from 748 sites across six medically intractable epilepsy patients at movement execution, and during the delay period where motor intention is present but execution is withheld. In particular, we used a machine-learning framework to identify the key contributions of various neuronal responses. We found a high degree of overlap between brain network patterns observed during planning and those present during execution. Prominent amplitude increases in the delta (2-4Hz) and high gamma (60-200Hz) bands were observed during both planning and execution. In contrast, motor alpha (8-13Hz) and beta (13-30Hz) power were suppressed during execution, but enhanced during the delay period. Interestingly, single-trial classification revealed that low-frequency phase information, rather than spectral power change, was the most discriminant feature in dissociating action from intention. Additionally, despite providing weaker decoding, PAC features led to statistically significant classification of motor states, particularly in anterior cingulate cortex and premotor brain areas. These results advance our understanding of the distinct and partly overlapping involvement of phase, amplitude and the coupling between them, in the neuronal mechanisms underlying motor intentions and executions.