BOLD matches neuronal activity at the mm scale: A combined 7T fMRI and ECoG study in human sensorimotor cortex

Delta waves as a sign of cortical plasticity after full-face transplantation

This study focused on detecting the reflections of healing and change in cortex activation in full-face transplantation and lesions patients on EEG activity. Face transplant patients have facial lesions before transplantation and, to identify pre-face transplant patients' brain activity in the absence of pre-transplant recordings, we used data obtained from pre-transplant facial lesion patients. Ten healthy, four facial lesion and three full-face transplant patients participated in this study. EEG data recorded for four different sensory stimuli (brush from the right face, right hand, left face, and left-hand regions) were analyzed using wavelet packet transform method. EEG waves were analyzed for standard bands. Our findings indicate significant change in the 2-4 Hz frequency range which may be a result of ongoing or previous cortical reorganization for face lesion and transplant patients. Alterations of the delta wave seen in patients with facial lesion and face transplant can also be explained by the intense central plasticity. Our findings show that the delta band differences might be used as a marker in the evaluation of post-transplant cortical plasticity in the future.

Considerations for implanting speech brain computer interfaces based on functional magnetic resonance imaging

Objective.Brain-computer interfaces (BCIs) have the potential to reinstate lost communication faculties. Results from speech decoding studies indicate that a usable speech BCI based on activity in the sensorimotor cortex (SMC) can be achieved using subdurally implanted electrodes. However, the optimal characteristics for a successful speech implant are largely unknown. We address this topic in a high field blood oxygenation level dependent functional magnetic resonance imaging (fMRI) study, by assessing the decodability of spoken words as a function of hemisphere, gyrus, sulcal depth, and position along the ventral/dorsal-axis.Approach.Twelve subjects conducted a 7T fMRI experiment in which they pronounced 6 different pseudo-words over 6 runs. We divided the SMC by hemisphere, gyrus, sulcal depth, and position along the ventral/dorsal axis. Classification was performed on in these SMC areas using multiclass support vector machine (SVM).Main results.Significant classification was possible from the SMC, but no preference for the left or right hemisphere, nor for the precentral or postcentral gyrus for optimal word classification was detected. Classification while using information from the cortical surface was slightly better than when using information from deep in the central sulcus and was highest within the ventral 50% of SMC. Confusion matrices where highly similar across the entire SMC. An SVM-searchlight analysis revealed significant classification in the superior temporal gyrus and left planum temporale in addition to the SMC.Significance.The current results support a unilateral implant using surface electrodes, covering the ventral 50% of the SMC. The added value of depth electrodes is unclear. We did not observe evidence for variations in the qualitative nature of information across SMC. The current results need to be confirmed in paralyzed patients performing attempted speech.

Measurement of the Mapping between Intracranial EEG and fMRI Recordings in the Human Brain

There are considerable gaps in our understanding of the relationship between human brain activity measured at different temporal and spatial scales. Here, electrocorticography (ECoG) measures were used to predict functional MRI changes in the sensorimotor cortex in two brain states: at rest and during motor performance. The specificity of this relationship to spatial co-localisation of the two signals was also investigated. We acquired simultaneous ECoG-fMRI in the sensorimotor cortex of three patients with epilepsy. During motor activity, high gamma power was the only frequency band where the electrophysiological response was co-localised with fMRI measures across all subjects. The best model of fMRI changes across states was its principal components, a parsimonious description of the entire ECoG spectrogram. This model performed much better than any others that were based either on the classical frequency bands or on summary measures of cross-spectral changes. The region-specific fMRI signal is reflected in spatially and spectrally distributed EEG activity.

Brain plasticity in neonatal brachial plexus palsies: quantification and comparison with adults' brachial plexus injuries

PURPOSE

To compare two populations of brachial plexus palsies, one neonatal (NBPP) and the other traumatic (NNBPP) who underwent different nerve transfers, using the plasticity grading scale (PGS) for detecting differences in brain plasticity between both groups.

METHODS

To be included, all patients had to have undergone a nerve transfer as the unique procedure to recover one lost function. The primary outcome was the PGS score. We also assessed patient compliance to rehabilitation using the rehabilitation quality scale (RQS). Statistical analysis of all variables was performed. A p ≤ 0.050 set as criterion for statistical significance.

RESULTS

A total of 153 NNBPP patients and 35 NBPP babies (with 38 nerve transfers) met the inclusion criteria. The mean age at surgery of the NBPP group was 9 months (SD 5.42, range 4 to 23 months). The mean age of NNBPP patients was 22 years (SD 12 years, range 3 to 69). They were operated around sixth months after the trauma. All transfers performed in NBPP patients had a maximum PGS score of 4. This was not the case for the NNBPP population that reached a PGS score of 4 in approximately 20% of the cases. This difference was statistically significant (p < 0.001). The RQS was not significantly different between groups.

CONCLUSION

We found that babies with NBPP have a significantly greater capacity for plastic rewiring than adults with NNBPP. The brain in the very young patient can process the changes induced by the peripheral nerve transfer better than in adults.

Decoding Single and Paired Phonemes Using 7T Functional MRI

Several studies have shown that mouth movements related to the pronunciation of individual phonemes are represented in the sensorimotor cortex. This would theoretically allow for brain computer interfaces that are capable of decoding continuous speech by training classifiers based on the activity in the sensorimotor cortex related to the production of individual phonemes. To address this, we investigated the decodability of trials with individual and paired phonemes (pronounced consecutively with one second interval) using activity in the sensorimotor cortex. Fifteen participants pronounced 3 different phonemes and 3 combinations of two of the same phonemes in a 7T functional MRI experiment. We confirmed that support vector machine (SVM) classification of single and paired phonemes was possible. Importantly, by combining classifiers trained on single phonemes, we were able to classify paired phonemes with an accuracy of 53% (33% chance level), demonstrating that activity of isolated phonemes is present and distinguishable in combined phonemes. A SVM searchlight analysis showed that the phoneme representations are widely distributed in the ventral sensorimotor cortex. These findings provide insights about the neural representations of single and paired phonemes. Furthermore, it supports the notion that speech BCI may be feasible based on machine learning algorithms trained on individual phonemes using intracranial electrode grids.

Brain-computer interface paradigms and neural coding

Brain signal patterns generated in the central nervous system of brain-computer interface (BCI) users are closely related to BCI paradigms and neural coding. In BCI systems, BCI paradigms and neural coding are critical elements for BCI research. However, so far there have been few references that clearly and systematically elaborated on the definition and design principles of the BCI paradigm as well as the definition and modeling principles of BCI neural coding. Therefore, these contents are expounded and the existing main BCI paradigms and neural coding are introduced in the review. Finally, the challenges and future research directions of BCI paradigm and neural coding were discussed, including user-centered design and evaluation for BCI paradigms and neural coding, revolutionizing the traditional BCI paradigms, breaking through the existing techniques for collecting brain signals and combining BCI technology with advanced AI technology to improve brain signal decoding performance. It is expected that the review will inspire innovative research and development of the BCI paradigm and neural coding.

The role of distinct ECoG frequency features in decoding finger movement

Objective.To identify the electrocorticography (ECoG) frequency features that encode distinct finger movement states during repeated finger flexions.Approach.We used the publicly available Stanford ECoG dataset of cue-based, repeated single finger flexions. Using linear regression, we identified the spectral features that contributed most to the encoding of movement dynamics and discriminating movement events from rest, and combined them to predict finger movement trajectories. Furthermore, we also looked into the effect of the used frequency range and the spatial distribution of the identified features.Main results.Two frequency features generate superior performance, each one for a different movement aspect: high gamma band activity distinguishes movement events from rest, whereas the local motor potential (LMP) codes for movement dynamics. Combining these two features in a finger movement decoder outperformed comparable prior work where the entire spectrum was used as the average correlation coefficient with the true trajectories increased from 0.45 to 0.5, both applied to the Stanford dataset, and erroneous predictions during rest were demoted. In addition, for the first time, our results show the influence of the upper cut-off frequency used to extract LMP, yielding a higher performance when this range is adjusted to the finger movement rate.Significance.This study shows the benefit of a detailed feature analysis prior to designing the finger movement decoder.

Using fMRI to localize target regions for implanted brain-computer interfaces in locked-in syndrome

OBJECTIVE

Electrocorticography (ECoG)-based brain-computer interface (BCI) systems have the potential to improve quality of life of people with locked-in syndrome (LIS) by restoring their ability to communicate independently. Before implantation of such a system, it is important to localize ECoG electrode target regions. Here, we assessed the predictive value of functional magnetic resonance imaging (fMRI) for the localization of suitable target regions on the sensorimotor cortex for ECoG-based BCI in people with locked-in syndrome.

METHODS

Three people with locked-in syndrome were implanted with a chronic, fully implantable ECoG-BCI system. We compared pre-surgical fMRI activity with post-implantation ECoG activity from areas known to be active and inactive during attempted hand movement (sensorimotor hand region and dorsolateral prefrontal cortex, respectively).

RESULTS

Results showed a spatial match between fMRI activity and changes in ECoG low and high frequency band power (10 - 30 and 65 - 95 Hz, respectively) during attempted movement. Also, we found that fMRI can be used to select a sub-set of electrodes that show strong task-related signal changes that are therefore likely to generate adequate BCI control.

CONCLUSIONS

Our findings indicate that fMRI is a useful non-invasive tool for the pre-surgical workup of BCI implant candidates.

SIGNIFICANCE

If these results are confirmed in more BCI studies, fMRI might be used for more efficient surgical BCI procedures with focused cortical coverage and lower participant burden.

Current State of Functional MRI in the Presurgical Planning of Brain Tumors

Surgical resection of brain tumors is challenging because of the delicate balance between maximizing tumor removal and preserving vital brain functions. Functional MRI (fMRI) offers noninvasive preoperative mapping of widely distributed brain areas and is increasingly used in presurgical functional mapping. However, its impact on survival and functional outcomes is still not well-supported by evidence. Task-based fMRI (tb-fMRI) maps blood oxygen level-dependent (BOLD) signal changes during specific tasks, while resting-state fMRI (rs-fMRI) examines spontaneous brain activity. rs-fMRI may be useful for patients who cannot perform tasks, but its reliability is affected by tumor-induced changes, challenges in data processing, and noise. Validation studies comparing fMRI with direct cortical stimulation (DCS) show variable concordance, particularly for cognitive functions such as language; however, concordance for tb-fMRI is generally greater than that for rs-fMRI. Preoperative fMRI, in combination with MRI tractography and intraoperative DCS, may result in improved survival and extent of resection and reduced functional deficits. fMRI has the potential to guide surgical planning and help identify targets for intraoperative mapping, but there is currently limited prospective evidence of its impact on patient outcomes. This review describes the current state of fMRI for preoperative assessment in patients undergoing brain tumor resection. Keywords: MR-Functional Imaging, CNS, Brain/Brain Stem, Anatomy, Oncology, Functional MRI, Functional Anatomy, Task-based, Resting State, Surgical Planning, Brain Tumor © RSNA, 2023.

Cortical control of posture in fine motor skills: evidence from inter-utterance rest position

The vocal tract continuously employs tonic muscle activity in the maintenance of postural configurations. Gamma-band activity in the sensorimotor cortex underlies transient movements during speech production, yet little is known about the neural control of postural states in the vocal tract. Simultaneously, there is evidence that sensorimotor beta-band activations contribute to a system of inhibition and state maintenance that is integral to postural control in the body. Here we use electrocorticography to assess the contribution of sensorimotor beta-band activity during speech articulation and postural maintenance, and demonstrate that beta-band activity corresponds to the inhibition of discrete speech movements and the maintenance of tonic postural states in the vocal tract. Our findings identify consistencies between the neural control of posture in speech and what is previously reported in gross motor contexts, providing support for a unified theory of postural control across gross and fine motor skills.

3T vs. 7T fMRI: capturing early human memory consolidation after motor task utilizing the observed higher functional specificity of 7T

Objective

Functional magnetic resonance imaging (fMRI) visualizes brain structures at increasingly higher resolution and better signal-to-noise ratio (SNR) as field strength increases. Yet, mapping the blood oxygen level dependent (BOLD) response to distinct neuronal processes continues to be challenging. Here, we investigated the characteristics of 7 T-fMRI compared to 3 T-fMRI in the human brain beyond the effect of increased SNR and verified the benefits of 7 T-fMRI in the detection of tiny, highly specific modulations of functional connectivity in the resting state following a motor task.

Methods

18 healthy volunteers underwent two resting state and a stimulus driven measurement using a finger tapping motor task at 3 and 7 T, respectively. The SNR for each field strength was adjusted by targeted voxel size variation to minimize the effect of SNR on the field strength specific outcome. Spatial and temporal characteristics of resting state ICA, network graphs, and motor task related activated areas were compared. Finally, a graph theoretical approach was used to detect resting state modulation subsequent to a simple motor task.

Results

Spatial extensions of resting state ICA and motor task related activated areas were consistent between field strengths, but temporal characteristics varied, indicating that 7 T achieved a higher functional specificity of the BOLD response than 3 T-fMRI. Following the motor task, only 7 T-fMRI enabled the detection of highly specific connectivity modulations representing an "offline replay" of previous motor activation. Modulated connections of the motor cortex were directly linked to brain regions associated with memory consolidation.

Conclusion

These findings reveal how memory processing is initiated even after simple motor tasks, and that it begins earlier than previously shown. Thus, the superior capability of 7 T-fMRI to detect subtle functional dynamics promises to improve diagnostics and therapeutic assessment of neurological diseases.

Enhanced clinical task-based fMRI metrics through locally low-rank denoising of complex-valued data

OBJECTIVE

This study investigates a locally low-rank (LLR) denoising algorithm applied to source images from a clinical task-based functional MRI (fMRI) exam before post-processing for improving statistical confidence of task-based activation maps.

METHODS

Task-based motor and language fMRI was obtained in eleven healthy volunteers under an IRB approved protocol. LLR denoising was then applied to raw complex-valued image data before fMRI processing. Activation maps generated from conventional non-denoised (control) data were compared with maps derived from LLR-denoised image data. Four board-certified neuroradiologists completed consensus assessment of activation maps; region-specific and aggregate motor and language consensus thresholds were then compared with nonparametric statistical tests. Additional evaluation included retrospective truncation of exam data without and with LLR denoising; a ROI-based analysis tracked t-statistics and temporal SNR (tSNR) as scan durations decreased. A test-retest assessment was performed; retest data were matched with initial test data and compared for one subject.

RESULTS

fMRI activation maps generated from LLR-denoised data predominantly exhibited statistically significant (p = 4.88×10-4 to p = 0.042; one p = 0.062) increases in consensus t-statistic thresholds for motor and language activation maps. Following data truncation, LLR data showed task-specific increases in t-statistics and tSNR respectively exceeding 20 and 50% compared to control. LLR denoising enabled truncation of exam durations while preserving cluster volumes at fixed thresholds. Test-retest showed variable activation with LLR data thresholded higher in matching initial test data.

CONCLUSION

LLR denoising affords robust increases in t-statistics on fMRI activation maps compared to routine processing, and offers potential for reduced scan duration while preserving map quality.

Functional mapping of sensorimotor activation in the human thalamus at 9.4 Tesla

Although the thalamus is perceived as a passive relay station for almost all sensory signals, the function of individual thalamic nuclei remains unresolved. In the present study, we aimed to identify the sensorimotor nuclei of the thalamus in humans using task-based fMRI at a field strength of 9.4T by assessing the individual subject-specific sensorimotor BOLD response during a combined active motor (finger-tapping) and passive sensory (tactile-finger) stimulation. We demonstrate that both tasks increase BOLD signal response in the lateral nuclei group (VPL, VA, VLa, and VLp), and in the pulvinar nuclei group (PuA, PuM, and PuL). Finger-tapping stimuli evokes a stronger BOLD response compared to the tactile stimuli, and additionally engages the intralaminar nuclei group (CM and Pf). In addition, our results demonstrate reproducible thalamic nuclei activation during motor and tactile stimuli. This work provides important insight into understanding the function of individual thalamic nuclei in processing various input signals and corroborates the benefits of using ultra-high-field MR scanners for functional imaging of fine-scale deeply located brain structures.

The many layers of BOLD. The effect of hypercapnic and hyperoxic stimuli on macro- and micro-vascular compartments quantified by CVR, M, and CBV across cortical depth

Ultra-high field functional magnetic resonance imaging (fMRI) offers the spatial resolution to measure neuronal activity at the scale of cortical layers. However, cortical depth dependent vascularization differences, such as a higher prevalence of macro-vascular compartments near the pial surface, have a confounding effect on depth-resolved blood-oxygen-level dependent (BOLD) fMRI signals. In the current study, we use hypercapnic and hyperoxic breathing conditions to quantify the influence of all venous vascular and micro-vascular compartments on laminar BOLD fMRI, as measured with gradient-echo (GE) and spin-echo (SE) scan sequences, respectively. We find that all venous vascular and micro-vascular compartments are capable of comparable theoretical maximum signal intensities, as represented by the M-value parameter. However, the capacity for vessel dilation, as reflected by the cerebrovascular reactivity (CVR), is approximately two and a half times larger for all venous vascular compartments combined compared to the micro-vasculature at superficial layers. Finally, there is roughly a 35% difference in estimates of CBV changes between all venous vascular and micro-vascular compartments, although this relative difference was approximately uniform across cortical depth. Thus, our results suggest that fMRI BOLD signal differences across cortical depth are likely caused by differences in dilation properties between macro- and micro-vascular compartments.

Morphology, Connectivity, and Encoding Features of Tactile and Motor Representations of the Fingers in the Human Precentral and Postcentral Gyrus

Despite the tight coupling between sensory and motor processing for fine manipulation in humans, it is not yet totally clear which specific properties of the fingers are mapped in the precentral and postcentral gyrus. We used fMRI to compare the morphology, connectivity, and encoding of the motor and tactile finger representations (FRs) in the precentral and postcentral gyrus of 25 5-fingered participants (8 females). Multivoxel pattern and structural and functional connectivity analyses demonstrated the existence of distinct motor and tactile FRs within both the precentral and postcentral gyrus, integrating finger-specific motor and tactile information. Using representational similarity analysis, we found that the motor and tactile FRs in the sensorimotor cortex were described by the perceived structure of the hand better than by the actual hand anatomy or other functional models (finger kinematics, muscles synergies). We then studied a polydactyly individual (i.e., with a congenital 6-fingered hand) showing superior manipulation abilities and divergent anatomic-functional hand properties. The perceived hand model was still the best model for tactile representations in the precentral and postcentral gyrus, while finger kinematics better described motor representations in the precentral gyrus. We suggest that, under normal conditions (i.e., in subjects with a standard hand anatomy), the sensorimotor representations of the 5 fingers in humans converge toward a model of perceived hand anatomy, deviating from the real hand structure, as the best synthesis between functional and structural features of the hand.SIGNIFICANCE STATEMENT Distinct motor and tactile finger representations exist in both the precentral and postcentral gyrus, supported by a finger-specific pattern of anatomic and functional connectivity across modalities. At the representational level, finger representations reflect the perceived structure of the hand, which might result from an adapting process harmonizing (i.e., uniformizing) the encoding of hand function and structure in the precentral and postcentral gyrus. The same analyses performed in an extremely rare polydactyly subject showed that the emergence of such representational geometry is also found in neuromechanical variants with different hand anatomy and function. However, the harmonization process across the precentral and postcentral gyrus might not be possible because of divergent functional-structural properties of the hand and associated superior manipulation abilities.

Improved Selectivity in 7 T Digit Mapping Using VASO-CBV

Functional magnetic resonance imaging (fMRI) at Ultra-high field (UHF, ≥ 7 T) benefits from significant gains in the BOLD contrast-to-noise ratio (CNR) and temporal signal-to-noise ratio (tSNR) compared to conventional field strengths (3 T). Although these improvements enabled researchers to study the human brain to unprecedented spatial resolution, the blood pooling effect reduces the spatial specificity of the widely-used gradient-echo BOLD acquisitions. In this context, vascular space occupancy (VASO-CBV) imaging may be advantageous since it is proposed to have a higher spatial specificity than BOLD. We hypothesized that the assumed higher specificity of VASO-CBV imaging would translate to reduced overlap in fine-scale digit representation maps compared to BOLD-based digit maps. We used sub-millimeter resolution VASO fMRI at 7 T to map VASO-CBV and BOLD responses simultaneously in the motor and somatosensory cortices during individual finger movement tasks. We assessed the cortical overlap in different ways, first by calculating similarity coefficient metrics (DICE and Jaccard) and second by calculating selectivity measures. In addition, we demonstrate a consistent topographical organization of the targeted digit representations (thumb-index-little finger) in the motor areas. We show that the VASO-CBV responses yielded less overlap between the digit clusters than BOLD, and other selectivity measures were higher for VASO-CBV too. In summary, these results were consistent across metrics and participants, confirming the higher spatial specificity of VASO-CBV compared to BOLD.

Cross-Scale Dynamicity of Entropy and Connectivity in the Sleeping Brain

Introduction: The concept of local sleep refers to the phenomenon of local brain activity that modifies neural networks during unresponsive global sleep. Such network rewiring may differ across spatial scales; however, the global and local alterations in brain systems remain elusive in human sleep. Materials and Methods: We examined cross-scale changes of brain networks in sleep. Functional magnetic resonance imaging data were acquired from 28 healthy participants during nocturnal sleep. We adopted both metrics of connectivity (functional connectivity [FC] and regional homogeneity [ReHo]) and complexity (multiscale entropy) to explore the global and local functionality of the neural assembly across nonrapid eye movement sleep stages. Results: Long-range FC decreased with sleep depth, whereas local ReHo peaked at the N2 stage and reached its lowest level at the N3 stage. Entropy exhibited a general decline at the local scale (Scale 1) as sleep deepened, whereas the coarse-scale entropy (Scale 3) was consistent across stages. Discussion: The negative correlation between Scale-1 entropy and ReHo reflects the enhanced signal regularity and synchronization in sleep, identifying the information exchange at the local scale. The N2 stage showed a distinctive pattern toward local information processing with scrambled long-distance information exchange, indicating a specific time window for network reorganization. Collectively, the multidimensional metrics indicated an imbalanced global-local relationship among brain functional networks across sleep-wake stages.

Methodological Recommendations for Studies on the Daily Life Implementation of Implantable Communication-Brain-Computer Interfaces for Individuals With Locked-in Syndrome

Implantable brain-computer interfaces (BCIs) promise to be a viable means to restore communication in individuals with locked-in syndrome (LIS). In 2016, we presented the world-first fully implantable BCI system that uses subdural electrocorticography electrodes to record brain signals and a subcutaneous amplifier to transmit the signals to the outside world, and that enabled an individual with LIS to communicate via a tablet computer by selecting icons in spelling software. For future clinical implementation of implantable communication-BCIs, however, much work is still needed, for example, to validate these systems in daily life settings with more participants, and to improve the speed of communication. We believe the design and execution of future studies on these and other topics may benefit from the experience we have gained. Therefore, based on relevant literature and our own experiences, we here provide an overview of procedures, as well as recommendations, for recruitment, screening, inclusion, imaging, hospital admission, implantation, training, and support of participants with LIS, for studies on daily life implementation of implantable communication-BCIs. With this article, we not only aim to inform the BCI community about important topics of concern, but also hope to contribute to improved methodological standardization of implantable BCI research.

The hand motor hotspot for seed-based functional connectivity of hand motor networks at rest

In the seed-based method for studying functional connectivity (FC), seed selection is relevant. Here, we propose a new methodological approach for resting-state FC analysis of hand motor networks using the individual hand motor hotspot (hMHS) as seed. Nineteen right-handed healthy volunteers underwent a transcranial magnetic stimulation (TMS) session and resting-state fMRI. For each subject, the hMHS in both hemispheres was identified by TMS with the contralateral abductor pollicis brevis muscle as the target, the site eliciting the highest and most reliable motor-evoked potentials. Seed regions were built on coordinates on the cortex corresponding to the individual left and right hMHSs. For comparison, the left and right Brodmann’s area 4 (BA4) masks extracted from a standard atlas were used as seed. The left and right hMHSs showed FC patterns at rest mainly including sensorimotor regions, with a bilateral connectivity only for the left hMHS. The statistical contrast BA4 > hMHS for both hemispheres showed different extension and lateralization of the functionally connected cortical regions. On the contrary, no voxels survived the opposite contrast (hMHS > BA4). This suggests that detection of individual hand motor seeds by TMS allows to identify functionally connected motor networks that are more specific with respect to those obtained starting from the a priori atlas-based identification of the primary motor cortex.

Brain Functional Imaging Anatomy

Human brain function is an increasingly complex framework that has important implications in clinical medicine. In this review, the anatomy of the most commonly assessed brain functions in clinical neuroradiology, including motor, language, and vision, is discussed. The anatomy and function of the primary and secondary sensorimotor areas are discussed with clinical case examples. Next, the dual stream of language processing is reviewed, as well as its implications in clinical medicine and surgical planning. Last, the authors discuss the striate and extrastriate visual cortex and review the dual stream model of visual processing.

Meranzin Hydrate Improves Depression-Like Behaviors and Hypomotility via Ghrelin and Neurocircuitry

OBJECTIVE

To investigate whether meranzin hydrate (MH) can alleviate depression-like behavior and hypomotility similar to Chaihu Shugan Powder (CSP), and further explore the potential common mechanisms.

METHODS

Totally 120 Spraque-Dawley rats were randomly divided into 5-8 groups including sham, vehicle, fluoxetine (20 mg/kg), mosapride (10 mg/kg), CSP (30 g/kg), MH (9.18 mg/kg), [D-Lys3]-GHRP-6 (Dlys, 0.5 mg/kg), and MH+Dlys groups by a random number table, 8 rats in each group. And 32 mice were randomly divided into wild-type, MH (18 mg/kg), growth hormone secretagogue receptor-knockout (GHSR-KO), and GHSR+MH groups, 8 mice in each group. The forced swimming test (FST), open field test (OFT), tail suspension test (TST), gastric emptying (GE) test, and intestinal transit (IT) test were used to assess antidepressant and prokinetic (AP) effects after drug single administration for 30 min with absorbable identification in rats and mice, respectively. The protein expression levels of brain-derived neurotrophic factor (BDNF) and phosphorylated mammalian target of rapamycin (p-mTOR) in the hippocampus of rats were evaluated by Western blot. The differences in functional brain changes were determined via 7.0 T functional magnetic resonance imaging-blood oxygen level-dependent (fMRI-BOLD).

RESULTS

MH treatment improved depression-like behavior (FST, OFT) and hypomotility (GE, IT) in the acute forced swimming (FS) rats (all P<0.05), and the effects are similar to the parent formula CSP. The ghrelin antagonist [D-Lys3]-GHRP-6 inhibited the effect of MH on FST and GE (P<0.05). Similarly, MH treatment also alleviated depression-like behavior (FST, TST) in the wild-type mice, however, no effects were found in the GHSR KO mice. Additionally, administration of MH significantly stimulated BDNF and p-mTOR protein expressions in the hippocampus (both P<0.01), which were also prevented by [D-Lys3]-GHRP-6 (P<0.01). Besides, 3 main BOLD foci following acute FS rats implicated activity in hippocampus-thalamus-basal ganglia (HTB) circuits. The [D-Lys3]-GHRP-6 synchronously inhibited BOLD HTB foci. As expected, prokinetic mosapride only had effects on the thalamus and basal ganglia, but not on the hippocampus. Within the HTB, the hippocampus is implicated in depression and FD.

CONCLUSIONS

MH accounts for part of AP effects of parent formula CSP in acute FS rats, mainly via ghrelin-related shared regulation coupled to BOLD signals in brain areas. This novel functionally connection of HTB following acute stress, treatment, and regulation highlights anti-depression unified theory.

Representational Similarity Scores of Digits in the Sensorimotor Cortex Are Associated with Behavioral Performance

Previous studies aimed to unravel a digit-specific somatotopy in the primary sensorimotor (SM1) cortex. However, it remains unknown whether digit somatotopy is associated with motor preparation and/or motor execution during different types of tasks. We adopted multivariate representational similarity analysis to explore digit activation patterns in response to a finger tapping task (FTT). Sixteen healthy young adults underwent magnetic resonance imaging, and additionally performed an out-of-scanner choice reaction time task (CRTT) to assess digit selection performance. During both the FTT and CRTT, force data of all digits were acquired using force transducers. This allowed us to assess execution-related interference (i.e., digit enslavement; obtained from FTT & CRTT), as well as planning-related interference (i.e., digit selection deficit; obtained from CRTT) and determine their correlation with digit representational similarity scores of SM1. Findings revealed that digit enslavement during FTT was associated with contralateral SM1 representational similarity scores. During the CRTT, digit enslavement of both hands was also associated with representational similarity scores of the contralateral SM1. In addition, right hand digit selection performance was associated with representational similarity scores of left S1. In conclusion, we demonstrate a cortical origin of digit enslavement, and uniquely reveal that digit selection is associated with digit representations in primary somatosensory cortex (S1). Significance statement In current systems neuroscience, it is of critical importance to understand the relationship between brain function and behavioral outcome. With the present work, we contribute significantly to this understanding by uniquely assessing how digit representations in the sensorimotor cortex are associated with planning- and execution-related digit interference during a continuous finger tapping and a choice reaction time task. We observe that digit enslavement (i.e., execution-related interference) finds its origin in contralateral digit representations of SM1, and that deficits in digit selection (i.e., planning-related interference) in the right hand during a choice reaction time task are associated with more overlapping digit representations in left S1. This knowledge sheds new light on the functional contribution of the sensorimotor cortex to everyday motor skills.

Size of the spatial correlation between ECoG and fMRI activity

Electrocorticography (ECoG) is typically employed to accurately identify the seizure focus as well as the location of brain functions to be spared during surgical resection in participants with drug-resistant epilepsy. Increasingly, this technique has become a powerful tool to map cognitive functions onto brain regions. Cortical mapping is more commonly investigated with functional MRI (fMRI), which measures blood-oxygen level dependent (BOLD) changes induced by neuronal activity. The multimodal integration between typical 3T fMRI activity maps and ECoG measurements can provide unique insight into the spatiotemporal aspects of cognition. However, the optimal integration of fMRI and ECoG requires fundamental insight into the spatial smoothness of the BOLD signal under each electrode. Here we use ECoG as ground truth for the extent of activity, as each electrode is thought to record from the cortical tissue directly underneath the contact, to estimate the spatial smoothness of the associated BOLD response at 3T fMRI. We compared the high-frequency broadband (HFB) activity recorded with ECoG while participants performed a motor task. Activity maps were obtained with fMRI at 3T for the same task in the same participant prior to surgery. We then correlated HFB power with the fMRI BOLD signal change in the area around each electrode. This latter measure was quantified by applying a 3D Gaussian kernel of varying width (sigma between 1 mm and 20 mm) to the fMRI maps including only gray-matter. We found that the correlation between HFB and BOLD activity increased sharply up to the point when the kernel width was set to 4 mm, which we defined as the kernel width of maximal spatial specificity. After this point, as the kernel width increased, the highest level of explained variance was reached at a kernel width of 9 mm for most participants. Intriguingly, maximal specificity was also limited to 4 mm for low-frequency bands, such as alpha and beta, but the kernel width with the highest explained variance was less spatially limited than the HFB. In summary, spatial specificity is limited to a kernel width of 4 mm but explained variance keeps on increasing as you average over more and more voxels containing the relatively noisy BOLD signal. Future multimodal studies should choose the kernel width based on their research goal. For maximal spatial specificity, ECoG electrodes are best compared to 3T fMRI with a kernel width of 4 mm. When optimizing the correlation between modalities, highest explained variance can be obtained at larger kernel widths of 9 mm, at the expense of spatial specificity. Finally, we release the complete pipeline so that researchers can estimate the most appropriate kernel width from their multimodal datasets.

Deep learning for neuroimaging-based diagnosis and rehabilitation of Autism Spectrum Disorder: A review

Accurate diagnosis of Autism Spectrum Disorder (ASD) followed by effective rehabilitation is essential for the management of this disorder. Artificial intelligence (AI) techniques can aid physicians to apply automatic diagnosis and rehabilitation procedures. AI techniques comprise traditional machine learning (ML) approaches and deep learning (DL) techniques. Conventional ML methods employ various feature extraction and classification techniques, but in DL, the process of feature extraction and classification is accomplished intelligently and integrally. DL methods for diagnosis of ASD have been focused on neuroimaging-based approaches. Neuroimaging techniques are non-invasive disease markers potentially useful for ASD diagnosis. Structural and functional neuroimaging techniques provide physicians substantial information about the structure (anatomy and structural connectivity) and function (activity and functional connectivity) of the brain. Due to the intricate structure and function of the brain, proposing optimum procedures for ASD diagnosis with neuroimaging data without exploiting powerful AI techniques like DL may be challenging. In this paper, studies conducted with the aid of DL networks to distinguish ASD are investigated. Rehabilitation tools provided for supporting ASD patients utilizing DL networks are also assessed. Finally, we will present important challenges in the automated detection and rehabilitation of ASD and propose some future works.

Decoding attempted phantom hand movements from ipsilateral sensorimotor areas after amputation

Objective.The sensorimotor cortex is often selected as target in the development of a Brain-Computer Interface, as activation patterns from this region can be robustly decoded to discriminate between different movements the user executes. Up until recently, such BCIs were primarily based on activity in the contralateral hemisphere, where decoding movements still works even years after denervation. However, there is increasing evidence for a role of the sensorimotor cortex in controlling the ipsilateral body. The aim of this study is to investigate the effects of denervation on the movement representation on the ipsilateral sensorimotor cortex.Approach.Eight subjects with acquired above-elbow arm amputation and nine controls performed a task in which they made (or attempted to make with their phantom hand) six different gestures from the American Manual Alphabet. Brain activity was measured using 7T functional MRI, and a classifier was trained to discriminate between activation patterns on four different regions of interest (ROIs) on the ipsilateral sensorimotor cortex.Main results.Classification scores showed that decoding was possible and significantly better than chance level for both the phantom and intact hands from all ROIs. Decoding both the left (intact) and right (phantom) hand from the same hemisphere was also possible with above-chance level classification score.Significance.The possibility to decode both hands from the same hemisphere, even years after denervation, indicates that implantation of motor-electrodes for BCI control possibly need only cover a single hemisphere, making surgery less invasive, and increasing options for people with lateralized damage to motor cortex like after stroke.

FMRI and intra-cranial electrocorticography recordings in the same human subjects reveals negative BOLD signal coupled with silenced neuronal activity

Positive blood oxygenation level-dependent (BOLD) responses (PBR), as measured by functional Magnetic Resonance Imaging (fMRI), are the most utilized measurements to non-invasively map activity in the brain. Recent studies have consistently shown that BOLD responses are not exclusively positive. Negative BOLD responses (NBR) have been reported in response to specific sensory stimulations and tasks. However, the exact relationship between NBR and the underlying metabolic and neuronal demand is still under debate. In this study, we investigated the neurophysiological basis of negative BOLD using fMRI and intra-cranial electrophysiology (electrocorticography, ECoG) measurements from the same human participants. We show that, for those electrodes that responded to visual stimulation, PBR are correlated with high-frequency band (HFB) responses. Crucially, NBR were associated with an absence of HFB power responses and an unpredicted decrease in the alpha power responses.

The current state of electrocorticography-based brain-computer interfaces

Brain-computer interfaces (BCIs) provide a way for the brain to interface directly with a computer. Many different brain signals can be used to control a device, varying in ease of recording, reliability, stability, temporal and spatial resolution, and noise. Electrocorticography (ECoG) electrodes provide a highly reliable signal from the human brain surface, and these signals have been used to decode movements, vision, and speech. ECoG-based BCIs are being developed to provide increased options for treatment and assistive devices for patients who have functional limitations. Decoding ECoG signals in real time provides direct feedback to the patient and can be used to control a cursor on a computer or an exoskeleton. In this review, the authors describe the current state of ECoG-based BCIs that are approaching clinical viability for restoring lost communication and motor function in patients with amyotrophic lateral sclerosis or tetraplegia. These studies provide a proof of principle and the possibility that ECoG-based BCI technology may also be useful in the future for assisting in the cortical rehabilitation of patients who have suffered a stroke.

Accurate Offline Asynchronous Detection of Individual Finger Movement From Intracranial Brain Signals Using a Novel Multiway Approach

Asynchronous motor Brain Computer Interfacing (BCI) is characterized by the continuous decoding of intended muscular activity from brain signals. Such applications have gained widespread interest for enabling users to issue commands volitionally. In conventional motor BCIs features extracted from brain signals are concatenated into vector- or matrix-based (or one-/two-way) representations. Nevertheless, when accounting for the original multimodal or multiway signal structure, decoding performance has been shown to improve jointly with result interpretability. However, as multiway decoders are notorious for the extensive computational cost to train them, conventional ones are still preferred. To curb this limitation, we introduce a novel multiway classifier, called Block-Term Tensor Classifier that inherits the improved accuracy of multiway methods while providing fast training. We show that it can outperform state-of-the-art multiway and two-way Linear Discriminant Analysis classifiers in asynchronous detection of individual finger movements from intracranial recordings, an essential feature to achieve a sense of dexterity with hand prosthetics and exoskeletons.

Typical somatomotor physiology of the hand is preserved in a patient with an amputated arm: An ECoG case study

Electrophysiological signals in the human motor system may change in different ways after deafferentation, with some studies emphasizing reorganization while others propose retained physiology. Understanding whether motor electrophysiology is retained over longer periods of time can be invaluable for patients with paralysis (e.g. ALS or brainstem stroke) when signals from sensorimotor areas may be used for communication or control over neural prosthetic devices. In addition, a maintained electrophysiology can potentially benefit the treatment of phantom limb pains through prolonged use of these signals in a brain-machine interface (BCI). Here, we were presented with the unique opportunity to investigate the physiology of the sensorimotor cortex in a patient with an amputated arm using electrocorticographic (ECoG) measurements. While implanted with an ECoG grid for clinical evaluation of electrical stimulation for phantom limb pain, the patient performed attempted finger movements with the contralateral (lost) hand and executed finger movements with the ipsilateral (healthy) hand. The electrophysiology of the sensorimotor cortex contralateral to the amputated hand remained very similar to that of hand movement in healthy people, with a spatially focused increase of high-frequency band (65-175 Hz; HFB) power over the hand region and a distributed decrease in low-frequency band (15-28 Hz; LFB) power. The representation of the three different fingers (thumb, index and little) remained intact and HFB patterns could be decoded using support vector learning at single-trial classification accuracies of >90%, based on the first 1-3 s of the HFB response. These results indicate that hand representations are largely retained in the motor cortex. The intact physiological response of the amputated hand, the high distinguishability of the fingers and fast temporal peak are encouraging for neural prosthetic devices that target the sensorimotor cortex.

Spatial-Temporal Functional Mapping Combined With Cortico-Cortical Evoked Potentials in Predicting Cortical Stimulation Results

Functional human brain mapping is commonly performed during invasive monitoring with intracranial electroencephalographic (iEEG) electrodes prior to resective surgery for drug­ resistant epilepsy. The current gold standard, electrocortical stimulation mapping (ESM), is time ­consuming, sometimes elicits pain, and often induces after discharges or seizures. Moreover, there is a risk of overestimating eloquent areas due to propagation of the effects of stimulation to a broader network of language cortex. Passive iEEG spatial-temporal functional mapping (STFM) has recently emerged as a potential alternative to ESM. However, investigators have observed less correspondence between STFM and ESM maps of language than between their maps of motor function. We hypothesized that incongruities between ESM and STFM of language function may arise due to propagation of the effects of ESM to cortical areas having strong effective connectivity with the site of stimulation. We evaluated five patients who underwent invasive monitoring for seizure localization, whose language areas were identified using ESM. All patients performed a battery of language tasks during passive iEEG recordings. To estimate the effective connectivity of stimulation sites with a broader network of task-activated cortical sites, we measured cortico-cortical evoked potentials (CCEPs) elicited across all recording sites by single-pulse electrical stimulation at sites where ESM was performed at other times. With the combination of high gamma power as well as CCEPs results, we trained a logistic regression model to predict ESM results at individual electrode pairs. The average accuracy of the classifier using both STFM and CCEPs results combined was 87.7%, significantly higher than the one using STFM alone (71.8%), indicating that the correspondence between STFM and ESM results is greater when effective connectivity between ESM stimulation sites and task-activated sites is taken into consideration. These findings, though based on a small number of subjects to date, provide preliminary support for the hypothesis that incongruities between ESM and STFM may arise in part from propagation of stimulation effects to a broader network of cortical language sites activated by language tasks, and suggest that more studies, with larger numbers of patients, are needed to understand the utility of both mapping techniques in clinical practice.

The Dynamics of Language Network Interactions in Lexical Selection: An Intracranial EEG Study

Speaking in sentences requires selection from contextually determined lexical representations. Although posterior temporal cortex (PTC) and Broca's areas play important roles in storage and selection, respectively, of lexical representations, there has been no direct evidence for physiological interactions between these areas on time scales typical of lexical selection. Using intracranial recordings of cortical population activity indexed by high-gamma power (70-150 Hz) modulations, we studied the causal dynamics of cortical language networks while epilepsy surgery patients performed a sentence completion task in which the number of potential lexical responses was systematically varied. Prior to completion of sentences with more response possibilities, Broca's area was not only more active, but also exhibited more local network interactions with and greater top-down influences on PTC, consistent with activation of, and competition between, more lexical representations. These findings provide the most direct experimental support yet for network dynamics playing a role in lexical selection among competing alternatives during speech production.

Functional MRI based simulations of ECoG grid configurations for optimal measurement of spatially distributed hand-gesture information

Objective In electrocorticography (ECoG), the physical characteristics of the electrode grid determine which aspect of the neurophysiology is measured. For particular cases, the ECoG grid may be tailored to capture specific features, such as in the development and use of brain-computer-interfaces (BCI). Neural representations of hand movement are increasingly used to control ECoG based BCIs. However, it remains unclear which grid configurations are the most optimal to capture the dynamics of hand gesture information. Here, we investigate how the design and surgical placement of grids would affect the usability of ECoG measurements. Approach High resolution 7T functional MRI was used as a proxy for neural activity in ten healthy participants to simulate various grid configurations, and evaluated the performance of each configuration for decoding hand gestures. The grid configurations varied in number of electrodes, electrode distance and electrode size. Main results Optimal decoding of hand gestures occurred in grid configurations with a higher number of densely-packed, large-size, electrodes up to a grid of ~5x5 electrodes. When restricting the grid placement to a highly informative region of primary sensorimotor cortex, optimal parameters converged to about 3x3 electrodes, an inter-electrode distance of 8mm, and an electrode size of 3mm radius (performing at ~70% 3-class classification accuracy). Significance Our approach might be used to identify the most informative region, find the optimal grid configuration and assist in positioning of the grid to achieve high BCI performance for the decoding of hand-gestures prior to surgical implantation.

High-density intracranial recordings reveal a distinct site in anterior dorsal precentral cortex that tracks perceived speech

Various brain regions are implicated in speech processing, and the specific function of some of them is better understood than others. In particular, involvement of the dorsal precentral cortex (dPCC) in speech perception remains debated, and attribution of the function of this region is more or less restricted to motor processing. In this study, we investigated high-density intracranial responses to speech fragments of a feature film, aiming to determine whether dPCC is engaged in perception of continuous speech. Our findings show that dPCC exhibited preference to speech over other tested sounds. Moreover, the identified area was involved in tracking of speech auditory properties including speech spectral envelope, its rhythmic phrasal pattern and pitch contour. DPCC also showed the ability to filter out noise from the perceived speech. Comparing these results to data from motor experiments showed that the identified region had a distinct location in dPCC, anterior to the hand motor area and superior to the mouth articulator region. The present findings uncovered with high-density intracranial recordings help elucidate the functional specialization of PCC and demonstrate the unique role of its anterior dorsal region in continuous speech perception.

Spatially and Temporally Distinct Encoding of Muscle and Kinematic Information in Rostral and Caudal Primary Motor Cortex

The organizing principle of human motor cortex does not follow an anatomical body map, but rather a distributed representational structure in which motor primitives are combined to produce motor outputs. Electrophysiological recordings in primates and human imaging data suggest that M1 encodes kinematic features of movements, such as joint position and velocity. However, M1 exhibits well-documented sensory responses to cutaneous and proprioceptive stimuli, raising questions regarding the origins of kinematic motor representations: are they relevant in top-down motor control, or are they an epiphenomenon of bottom-up sensory feedback during movement? Here we provide evidence for spatially and temporally distinct encoding of kinematic and muscle information in human M1 during the production of a wide variety of naturalistic hand movements. Using a powerful combination of high-field functional magnetic resonance imaging and magnetoencephalography, a spatial and temporal multivariate representational similarity analysis revealed encoding of kinematic information in more caudal regions of M1, over 200 ms before movement onset. In contrast, patterns of muscle activity were encoded in more rostral motor regions much later after movements began. We provide compelling evidence that top-down control of dexterous movement engages kinematic representations in caudal regions of M1 prior to movement production.

iEEG: Dura-lining electrodes

Intracranial electroencephalography (iEEG) is measured from electrodes placed in or on the brain. These measurements have an excellent signal-to-noise ratio and iEEG signals have often been used to decode brain activity or drive brain-computer interfaces (BCIs). iEEG recordings are typically done for seizure monitoring in epilepsy patients who have these electrodes placed for a clinical purpose: to localize both brain regions that are essential for function and others where seizures start. Brain regions not involved in epilepsy are thought to function normally and provide a unique opportunity to learn about human neurophysiology. Intracranial electrodes measure the aggregate activity of large neuronal populations and recorded signals contain many features. Different features are extracted by analyzing these signals in the time and frequency domain. The time domain may reveal an evoked potential at a particular time after the onset of an event. Decomposition into the frequency domain may show narrowband peaks in the spectrum at specific frequencies or broadband signal changes that span a wide range of frequencies. Broadband power increases are generally observed when a brain region is active while most other features are highly specific to brain regions, inputs, and tasks. Here we describe the spatiotemporal dynamics of several iEEG signals that have often been used to decode brain activity and drive BCIs.

Efficient de-noising of high-resolution fMRI using local and sub-band information

BACKGROUND

High-resolution fMRI, useful for accurate brain mapping, suffers from low functional sensitivity at a reasonable acquisition time. Conventional smoothing techniques although reduce the noise and boost the sensitivity, but degrade the spatial resolution of fMRI.

NEW METHODS

We propose a novel spatial de-noising technique to increase sensitivity while preserving the boundaries of active regions in the high-resolution fMRI. A modified version of PCA that utilizes adjacent voxels information (LPCA) is first suggested for de-noising. This technique is then further empowered by its application to wavelet sub-bands (WLPCA).

RESULTS

Proposed techniques were assessed on both simulated and experimental data. Identifiablity index was calculated for evaluation of the denoising on the simulated data. Maximum and mean z-scores along with LAE and SSIM were reported on experimental data for two presented techniques as well as Guassian smoothing. WLPCA outperformed other techniques in Identifiablity index, for simulation, and in preserving maximum z-score, for experimental study.

COMPARISON WITH EXISTING METHODS

The presented technique was developed to simultaneously suppress the noise and preserve the boundaries of active areas against leakage. For first aim, its achievable mean z-score was compared to conventional Gaussian. For second aim, its maximum z-score was compared to that of no-smoothing. While Gaussian and no-smoothing can work fine with only one measure, WLPCA was able to improve both measures concurrently.

CONCLUSIONS

The local PCA based methods, and in particular WLPCA, is an effective noise reduction step that preserves the spatial resolution by preventing activity leakage of high-resolution fMRI data.

Human brain function and brain-computer interfaces

Human brain function research has evolved dramatically in the last decades. In this chapter the role of modern methods of recording brain activity in understanding human brain function is explained. Current knowledge of brain function relevant to brain-computer interface (BCI) research is detailed, with an emphasis on the motor system which provides an exceptional level of detail to decoding of intended or attempted movements in paralyzed beneficiaries of BCI technology and translation to computer-mediated actions. BCI technologies that stand to benefit the most of the detailed organization of the human cortex are, and for the foreseeable future are likely to be, reliant on intracranial electrodes. These evolving technologies are expected to enable severely paralyzed people to regain the faculty of movement and speech in the coming decades.

Classification of Articulator Movements and Movement Direction from Sensorimotor Cortex Activity

For people suffering from severe paralysis, communication can be difficult or nearly impossible. Technology systems called brain-computer interfaces (BCIs) are being developed to assist these people with communication by using their brain activity to control a computer without any muscle activity. To benefit the development of BCIs that employ neural activity related to speech, we investigated if neural activity patterns related to different articulator movements can be distinguished from each other. We recorded with electrocorticography (ECoG), the neural activity related to different articulator movements in 4 epilepsy patients and classified which articulator participants moved based on the sensorimotor cortex activity patterns. The same was done for different movement directions of a single articulator, the tongue. In both experiments highly accurate classification was obtained, on average 92% for different articulators and 85% for different tongue directions. Furthermore, the data show that only a small part of the sensorimotor cortex is needed for classification (ca. 1 cm2). We show that recordings from small parts of the sensorimotor cortex contain information about different articulator movements which might be used for BCI control. Our results are of interest for BCI systems that aim to decode neural activity related to (actual or attempted) movements from a contained cortical area.

Encoding of kinetic and kinematic movement parameters in the sensorimotor cortex: A Brain-Computer Interface perspective

For severely paralyzed people, Brain-Computer Interfaces (BCIs) can potentially replace lost motor output and provide a brain-based control signal for augmentative and alternative communication devices or neuroprosthetics. Many BCIs focus on neuronal signals acquired from the hand area of the sensorimotor cortex, employing changes in the patterns of neuronal firing or spectral power associated with one or more types of hand movement. Hand and finger movement can be described by two groups of movement features, namely kinematics (spatial and motion aspects) and kinetics (muscles and forces). Despite extensive primate and human research, it is not fully understood how these features are represented in the SMC and how they lead to the appropriate movement. Yet, the available information may provide insight into which features are most suitable for BCI control. To that purpose, the current paper provides an in-depth review on the movement features encoded in the SMC. Even though there is no consensus on how exactly the SMC generates movement, we conclude that some parameters are well represented in the SMC and can be accurately used for BCI control with discrete as well as continuous feedback. However, the vast evidence also suggests that movement should be interpreted as a combination of multiple parameters rather than isolated ones, pleading for further exploration of sensorimotor control models for accurate BCI control.

Towards an intuitive communication-BCI: decoding visually imagined characters from the early visual cortex using high-field fMRI

Brain-computer interfaces aim to provide people with paralysis with the possibility to use their neural signals to control devices. For communication, most BCIs are based on the selection of letters from a (digital) letter board to spell words and sentences. Visual mental imagery of letters could offer a new, fast and intuitive way to spell in a BCI-communication solution. Here we provide a proof of concept for the decoding of visually imagined characters from the early visual cortex using 7 Tesla functional MRI. Sixteen healthy participants visually imagined three different characters for 3, 5 and 7 s in a slow event-related design. Using single-trial classification, we were able to decode the characters with an average accuracy of 54%, which is significantly above chance level (33%). Furthermore, the imagined characters were classifiable shortly after cue onset and remained classifiable with prolonged imagery. These properties, combined with the cortical location of the early visual cortex and its decodable activity, encourage further research on intracranial interfacing using surface electrodes to bring us closer to such a visual imagery based BCI communication solution.

Resting-State Functional Magnetic Resonance Imaging and Probabilistic Diffusion Tensor Imaging Demonstrate That the Greatest Functional and Structural Connectivity in the Hand Motor Homunculus Occurs in the Area of the Thumb

The primary hand motor region is classically believed to be in the "hand knob" area in the precentral gyrus (PCG). However, hand motor task-based activation is often localized outside this area. The purpose of this study is to investigate the structural and functional connectivity driven by different seed locations corresponding to the little, index, and thumb in the PCG using probabilistic diffusion tractography (PDT) and resting-state functional magnetic resonance imaging (rfMRI). Twelve healthy subjects had three regions of interest (ROIs) placed in the left PCG: lateral to the hand knob (thumb area), within the hand knob (index finger area), and medial to the hand knob (little finger area). Connectivity maps were generated using PDT and rfMRI. Individual and group level analyses were performed. Results show that the greatest hand motor connectivity between both hemispheres was obtained using the ROI positioned just lateral to the hand knob in the PCG (the thumb area). The number of connected voxels in the PCG between the two hemispheres was greatest in the lateral-most ROI (the thumb area): 279 compared with 13 for the medial-most ROI and 9 for the central hand knob ROI. Similarly, the highest white matter connectivity between the two hemispheres resulted from the ROI placed in the lateral portion of PCG (p < 0.003). The maximal functional and structural connectivity of the hand motor area between hemispheres occurs in the thumb area, located laterally at the "hand knob." Thus, this location appears maximal for rfMRI and PDT seeding of the motor area.

Spatial-Temporal Dynamics of the Sensorimotor Cortex: Sustained and Transient Activity

How the sensorimotor cortex is organized with respect to controlling different features of movement is unclear. One unresolved question concerns the relation between the duration of an action and the duration of the associated neuronal activity change in the sensorimotor cortex. Using subdural electrocorticography electrodes, we investigated in five subjects, whether high frequency band (HFB; 75-135 Hz) power changes have a transient or sustained relation to speech duration, during pronunciation of the Dutch /i/ vowel with different durations. We showed that the neuronal activity patterns recorded from the sensorimotor cortex can be directly related to action duration in some locations, whereas in other locations, during the same action, neuronal activity is transient, with a peak in HFB activity at movement onset and/or offset. This data sheds light on the neural underpinnings of motor actions and we discuss the possible mechanisms underlying these different response types.

The influence of prior pronunciations on sensorimotor cortex activity patterns during vowel production

OBJECTIVE

In recent years, brain-computer interface (BCI) systems have been investigated for their potential as a communication device to assist people with severe paralysis. Decoding speech sensorimotor cortex activity is a promising avenue for the generation of BCI control signals, but is complicated by variability in neural patterns, leading to suboptimal decoding. We investigated whether neural pattern variability associated with sound pronunciation can be explained by prior pronunciations and determined to what extent prior speech affects BCI decoding accuracy.

APPROACH

Neural patterns in speech motor areas were evaluated with electrocorticography in five epilepsy patients, who performed a simple speech task that involved pronunciation of the /i/ sound, preceded by either silence, the /a/ sound or the /u/ sound.

MAIN RESULTS

The neural pattern related to the /i/ sound depends on previous sounds and is therefore associated with multiple distinct sensorimotor patterns, which is likely to reflect differences in the movements towards this sound. We also show that these patterns still contain a commonality that is distinct from the other vowel sounds (/a/ and /u/). Classification accuracies for the decoding of different sounds do increase, however, when the multiple patterns for the /i/ sound are taken into account. Simply including multiple forms of the /i/ vowel in the training set for the creation of a single /i/ model performs as well as training individual models for each /i/ variation.

SIGNIFICANCE

Our results are of interest for the development of BCIs that aim to decode speech sounds from the sensorimotor cortex, since they argue that a multitude of cortical activity patterns associated with speech movements can be reduced to a basis set of models which reflect meaningful language units (vowels), yet it is important to account for the variety of neural patterns associated with a single sound in the training process.

Clinical 7 T MRI: Are we there yet? A review about magnetic resonance imaging at ultra-high field

In recent years, ultra-high field MRI (7 T and above) has received more interest for clinical imaging. Indeed, a number of studies have shown the benefits from the application of this powerful tool not only for research purposes, but also in realms of improved diagnostics and patient management. The increased signal-to-noise ratio and higher spatial resolution compared with conventional and high-field clinical scanners allow imaging of small anatomical detail and subtle pathological findings. Furthermore, greater spectral resolution achieved at ultra-high field allows the resolution of metabolites for MR spectroscopic imaging. All these advantages have a significant impact on many neurological diseases, including multiple sclerosis, cerebrovascular disease, brain tumors, epilepsy and neurodegenerative diseases, in part because the pathology can be subtle and lesions small in these diseases, therefore having higher signal and resolution will help lesion detection. In this review, we discuss the main clinical neurological applications and some technical challenges which remain with ultra-high field MRI.

Feasibility of identifying the ideal locations for motor intention decoding using unimodal and multimodal classification at 7T-fMRI

Invasive Brain-Computer Interfaces (BCIs) require surgeries with high health-risks. The risk-to-benefit ratio of the procedure could potentially be improved by pre-surgically identifying the ideal locations for mental strategy classification. We recorded high-spatiotemporal resolution blood-oxygenation-level-dependent (BOLD) signals using functional MRI at 7 Tesla in eleven healthy participants during two motor imagery tasks. BCI diagnostic task isolated the intent to imagine movements, while BCI simulation task simulated the neural states that may be yielded in a real-life BCI-operation scenario. Imagination of movements were classified from the BOLD signals in sub-regions of activation within a single or multiple dorsal motor network regions. Then, the participant's decoding performance during the BCI simulation task was predicted from the BCI diagnostic task. The results revealed that drawing information from multiple regions compared to a single region increased the classification accuracy of imagined movements. Importantly, systematic unimodal and multimodal classification revealed the ideal combination of regions that yielded the best classification accuracy at the individual-level. Lastly, a given participant's decoding performance achieved during the BCI simulation task could be predicted from the BCI diagnostic task. These results show the feasibility of 7T-fMRI with unimodal and multimodal classification being utilized for identifying ideal sites for mental strategy classification.

Repeated Vowel Production Affects Features of Neural Activity in Sensorimotor Cortex

The sensorimotor cortex is responsible for the generation of movements and interest in the ability to use this area for decoding speech by brain–computer interfaces has increased recently. Speech decoding is challenging however, since the relationship between neural activity and motor actions is not completely understood. Non-linearity between neural activity and movement has been found for instance for simple finger movements. Despite equal motor output, neural activity amplitudes are affected by preceding movements and the time between movements. It is unknown if neural activity is also affected by preceding motor actions during speech. We addressed this issue, using electrocorticographic high frequency band (HFB; 75–135 Hz) power changes in the sensorimotor cortex during discrete vowel generation. Three subjects with temporarily implanted electrode grids produced the /i/ vowel at repetition rates of 1, 1.33 and 1.66 Hz. For every repetition, the HFB power amplitude was determined. During the first utterance, most electrodes showed a large HFB power peak, which decreased for subsequent utterances. This result could not be explained by differences in performance. With increasing duration between utterances, more electrodes showed an equal response to all repetitions, suggesting that the duration between vowel productions influences the effect of previous productions on sensorimotor cortex activity. Our findings correspond with previous studies for finger movements and bear relevance for the development of brain-computer interfaces that employ speech decoding based on brain signals, in that past utterances will need to be taken into account for these systems to work accurately.

Neuronal Activation Detection Using Vector Phase Analysis with Dual Threshold Circles: A Functional Near-Infrared Spectroscopy Study

In this paper, a new vector phase diagram differentiating the initial decreasing phase (i.e. initial dip) and the delayed hemodynamic response (HR) phase of oxy-hemoglobin changes ( Δ HbO) of functional near-infrared spectroscopy (fNIRS) is developed. The vector phase diagram displays the trajectories of Δ HbO and deoxy-hemoglobin changes ( Δ HbR), as orthogonal components, in the Δ HbO- Δ HbR polar coordinates. To determine the occurrence of an initial dip, dual threshold circles (an inner circle from the resting state, an outer circle from the peak values of the initial dip and the main HR) are incorporated into the phase diagram for making decisions. The proposed scheme is then applied to a brain-computer interface scheme, and its performance is evaluated in classifying two finger tapping tasks (right-hand thumb and little finger) from the left motor cortex. Three gamma functions are used to model the initial dip, the main HR, and the undershoot in generating the designed HR function. In classifying two tapping tasks, the signal mean and signal minimum values during 0-2.5 s, as features of initial dip, are used. The linear discriminant analysis was utilized as a classifier. The experimental results show that the active brain locations of the two tasks were quite distinctive ( p < 0.05 ), and moreover, spatially specific if using the initial dip map at 4 s in comparison to the map of HRs at 14 s. Also, the average classification accuracy was improved from 59% to 74.9% when using the phase diagram of dual threshold circles.