Electrocorticogram (ECoG) Is Highly Informative in Primate Visual Cortex

Predictive coding for the actions and emotions of others and its deficits in autism spectrum disorders

Traditionally, the neural basis of social perception has been studied by showing participants brief examples of the actions or emotions of others presented in randomized order to prevent participants from anticipating what others do and feel. This approach is optimal to isolate the importance of information flow from lower to higher cortical areas. The degree to which feedback connections and Bayesian hierarchical predictive coding contribute to how mammals process more complex social stimuli has been less explored, and will be the focus of this review. We illustrate paradigms that start to capture how participants predict the actions and emotions of others under more ecological conditions, and discuss the brain activity measurement methods suitable to reveal the importance of feedback connections in these predictions. Together, these efforts draw a richer picture of social cognition in which predictive coding and feedback connections play significant roles. We further discuss how the notion of predicting coding is influencing how we think of autism spectrum disorder.

Aging suppresses subthalamic neuronal activity in patients with Parkinson's disease

Age is a primary risk factor for Parkinson's disease (PD); however, the effects of aging on the Parkinsonian brain remain poorly understood, particularly for deep brain structures. We investigated intraoperative micro-electrode recordings from the subthalamic nucleus (STN) of PD patients aged between 42 and 76 years. Age was associated with decreased oscillatory beta power and non-oscillatory high-frequency power, independent of PD-related variables. Single unit firing and burst rates were also reduced, whereas the coefficient of variation and the structure of burst activity were unchanged. Phase synchronization (debiased weighed phase lag index [dWPLI]) between sites was pronounced in the beta band between electrodes in the superficial STN but was unaffected by age. Our results show that aging is associated with reduced neuronal activity without changes to its temporal structure. We speculate that the loss of activity in the STN may mediate the relationship between PD and age.

Dissociation of Attentional State and Behavioral Outcome Using Local Field Potentials

Successful behavior depends on the attentional state and other factors related to decision-making, which may modulate neuronal activity differently. Here, we investigated whether attentional state and behavioral outcome (i.e., whether a target is detected or missed) are distinguishable using the power and phase of local field potential recorded bilaterally from area V4 of two male rhesus monkeys performing a cued visual attention task. To link each trial's outcome to pairwise measures of attention that are typically averaged across trials, we used several methods to obtain single-trial estimates of spike count correlation and phase consistency. Surprisingly, while attentional location was best discriminated using gamma and high-gamma power, behavioral outcome was best discriminated by alpha power and steady-state visually evoked potential. Power outperformed absolute phase in attentional/behavioral discriminability, although single-trial gamma phase consistency provided reasonably high attentional discriminability. Our results suggest a dissociation between the neuronal mechanisms that regulate attentional focus and behavioral outcome.

Comparison of Subdural and Intracortical Recordings of Somatosensory Evoked Responses

Micro-electrocorticography (µECoG) electrodes have emerged to balance the trade-off between invasiveness and signal quality in brain recordings. However, its large-scale applicability is still hindered by a lack of comparative studies assessing the relationship between ECoG and traditional recording methods such as penetrating electrodes. This study aimed to compare somatosensory evoked potentials (SEPs) through the lenses of a µECoG and an intracortical microelectrode array (MEA). The electrodes were implanted in the pig's primary somatosensory cortex, while SEPs were generated by applying electrical stimulation to the ulnar nerve. The SEP amplitude, signal-to-noise ratio (SNR), power spectral density (PSD), and correlation structure were analysed. Overall, SEPs resulting from MEA recordings had higher amplitudes and contained significantly more spectral power, especially at higher frequencies. However, the SNRs were similar between the interfaces. These results demonstrate the feasibility of using µECoG to decode SEPs with wide-range applications in physiology monitoring and brain-computer interfaces.

Strategic Integration: A Cross-Disciplinary Review of the fNIRS-EEG Dual-Modality Imaging System for Delivering Multimodal Neuroimaging to Applications

Background: Recent years have seen a surge of interest in dual-modality imaging systems that integrate functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) to probe brain function. This review aims to explore the advancements and clinical applications of this technology, emphasizing the synergistic integration of fNIRS and EEG. Methods: The review begins with a detailed examination of the fundamental principles and distinctive features of fNIRS and EEG techniques. It includes critical technical specifications, data-processing methodologies, and analysis techniques, alongside an exhaustive evaluation of 30 seminal studies that highlight the strengths and weaknesses of the fNIRS-EEG bimodal system. Results: The paper presents multiple case studies across various clinical domains-such as attention-deficit hyperactivity disorder, infantile spasms, depth of anesthesia, intelligence quotient estimation, and epilepsy-demonstrating the fNIRS-EEG system's potential in uncovering disease mechanisms, evaluating treatment efficacy, and providing precise diagnostic options. Noteworthy research findings and pivotal breakthroughs further reinforce the developmental trajectory of this interdisciplinary field. Conclusions: The review addresses challenges and anticipates future directions for the fNIRS-EEG dual-modal imaging system, including improvements in hardware and software, enhanced system performance, cost reduction, real-time monitoring capabilities, and broader clinical applications. It offers researchers a comprehensive understanding of the field, highlighting the potential applications of fNIRS-EEG systems in neuroscience and clinical medicine.

Gamma Responses to Colored Natural Stimuli Can Be Predicted from Local Low-Level Stimulus Features

The role of gamma rhythm (30-80 Hz) in visual processing is debated; stimuli like gratings and hue patches generate strong gamma, but many natural images do not. Could image gamma responses be predicted by approximating images as gratings or hue patches? Surprisingly, this question remains unanswered, since the joint dependence of gamma on multiple features is poorly understood. We recorded local field potentials and electrocorticogram from two female monkeys while presenting natural images and parametric stimuli varying along several feature dimensions. Gamma responses to different grating/hue features were separable, allowing for a multiplicative model based on individual features. By fitting a hue patch to the image around the receptive field, this simple model could predict gamma responses to chromatic images across scales with reasonably high accuracy. Our results provide a simple "baseline" model to predict gamma from local image properties, against which more complex models of natural vision can be tested.

Dissociation of attentional state and behavioral outcome using local field potentials

Successful behavior depends on attentional state and other factors related to decision-making, which may modulate neuronal activity differently. Here, we investigated whether attentional state and behavioral outcome (i.e., whether a target is detected or missed) are distinguishable using the power and phase of local field potential (LFP) recorded bilaterally from area V4 of monkeys performing a cued visual attention task. To link each trial's outcome to pairwise measures of attention that are typically averaged across trials, we used several methods to obtain single-trial estimates of spike count correlation and phase consistency. Surprisingly, while attentional location was best discriminated using gamma and high-gamma power, behavioral outcome was best discriminated by alpha power and steady-state visually evoked potential. Power outperformed absolute phase in attentional/behavioral discriminability, although single-trial gamma phase consistency provided reasonably high attentional discriminability. Our results suggest a dissociation between the neuronal mechanisms that regulate attentional focus and behavioral outcome.

Advances in conductive hydrogels for neural recording and stimulation

The brain-computer interface (BCI) allows the human or animal brain to directly interact with the external environment through the neural interfaces, thus playing the role of monitoring, protecting, improving/restoring, enhancing, and replacing. Recording electrophysiological information such as brain neural signals is of great importance in health monitoring and disease diagnosis. According to the electrode position, it can be divided into non-implantable, semi-implantable, and implantable. Among them, implantable neural electrodes can obtain the highest-quality electrophysiological information, so they have the most promising application. However, due to the chemo-mechanical mismatch between devices and tissues, the adverse foreign body response and performance loss over time seriously restrict the development and application of implantable neural electrodes. Given the challenges, conductive hydrogel-based neural electrodes have recently attracted much attention, owing to many advantages such as good mechanical match with the native tissues, negligible foreign body response, and minimal signal attenuation. This review mainly focuses on the current development of conductive hydrogels as a biocompatible framework for neural tissue and conductivity-supporting substrates for the transmission of electrical signals of neural tissue to speed up electrical regeneration and their applications in neural sensing and recording as well as stimulation.

Ramping dynamics and theta oscillations reflect dissociable signatures during rule-guided human behavior

Contextual cues and prior evidence guide human goal-directed behavior. The neurophysiological mechanisms that implement contextual priors to guide subsequent actions in the human brain remain unclear. Using intracranial electroencephalography (iEEG), we demonstrate that increasing uncertainty introduces a shift from a purely oscillatory to a mixed processing regime with an additional ramping component. Oscillatory and ramping dynamics reflect dissociable signatures, which likely differentially contribute to the encoding and transfer of different cognitive variables in a cue-guided motor task. The results support the idea that prefrontal activity encodes rules and ensuing actions in distinct coding subspaces, while theta oscillations synchronize the prefrontal-motor network, possibly to guide action execution. Collectively, our results reveal how two key features of large-scale neural population activity, namely continuous ramping dynamics and oscillatory synchrony, jointly support rule-guided human behavior.

Subspace partitioning in the human prefrontal cortex resolves cognitive interference

The human prefrontal cortex (PFC) constitutes the structural basis underlying flexible cognitive control, where mixed-selective neural populations encode multiple task features to guide subsequent behavior. The mechanisms by which the brain simultaneously encodes multiple task-relevant variables while minimizing interference from task-irrelevant features remain unknown. Leveraging intracranial recordings from the human PFC, we first demonstrate that competition between coexisting representations of past and present task variables incurs a behavioral switch cost. Our results reveal that this interference between past and present states in the PFC is resolved through coding partitioning into distinct low-dimensional neural states; thereby strongly attenuating behavioral switch costs. In sum, these findings uncover a fundamental coding mechanism that constitutes a central building block of flexible cognitive control.

Decoding of attentional state using local field potentials

We review recent efforts to decode visual spatial attention from different types of brain signals, such as spikes and local field potentials (LFPs). Combining signals from more electrodes improves decoding, but the pattern of improvement varies considerably depending on the signal as well as the task (for example, decoding of sensory stimulus/motor intention versus location of attention). We argue that this pattern of results conveys important information not only about the usefulness of a particular brain signal for decoding attention, but also about the spatial scale over which attention operates in the brain. The spatial scale, in turn, likely depends on the extent of underlying mechanisms such as normalization, gain control via excitation-inhibition interactions, and neuromodulatory regulation of attention.

Spatiotemporal dynamics of human high gamma discriminate naturalistic behavioral states

In analyzing the neural correlates of naturalistic and unstructured behaviors, features of neural activity that are ignored in a trial-based experimental paradigm can be more fully studied and investigated. Here, we analyze neural activity from two patients using electrocorticography (ECoG) and stereo-electroencephalography (sEEG) recordings, and reveal that multiple neural signal characteristics exist that discriminate between unstructured and naturalistic behavioral states such as “engaging in dialogue” and “using electronics”. Using the high gamma amplitude as an estimate of neuronal firing rate, we demonstrate that behavioral states in a naturalistic setting are discriminable based on long-term mean shifts, variance shifts, and differences in the specific neural activity’s covariance structure. Both the rapid and slow changes in high gamma band activity separate unstructured behavioral states. We also use Gaussian process factor analysis (GPFA) to show the existence of salient spatiotemporal features with variable smoothness in time. Further, we demonstrate that both temporally smooth and stochastic spatiotemporal activity can be used to differentiate unstructured behavioral states. This is the first attempt to elucidate how different neural signal features contain information about behavioral states collected outside the conventional experimental paradigm.

Gamma oscillations in primate primary visual cortex are severely attenuated by small stimulus discontinuities

Gamma oscillations (30 to 80 Hz) have been hypothesized to play an important role in feature binding, based on the observation that continuous long bars induce stronger gamma in the visual cortex than bars with a small gap. Recently, many studies have shown that natural images, which have discontinuities in several low-level features, do not induce strong gamma oscillations, questioning their role in feature binding. However, the effect of different discontinuities on gamma has not been well studied. To address this, we recorded spikes and local field potential from 2 monkeys while they were shown gratings with discontinuities in 4 attributes: space, orientation, phase, or contrast. We found that while these discontinuities only had a modest effect on spiking activity, gamma power drastically reduced in all cases, suggesting that gamma could be a resonant phenomenon. An excitatory–inhibitory population model with stimulus-tuned recurrent inputs showed such resonant properties. Therefore, gamma could be a signature of excitation–inhibition balance, which gets disrupted due to discontinuities.

Gamma oscillations (30-80 Hz) in visual cortex have been hypothesized to play an important role in feature binding, but this role has recently been questioned. This study shows that visual stimulus-induced gamma oscillations are highly attenuated with even small discontinuities in the stimulus. This "resonant" behaviour can be explained by a simple excitatory-inhibitory model in which discontinuities lead to a small reduction in lateral inputs.

Spike-Gamma Phase Relationship in the Visual Cortex

Gamma oscillations (30-70 Hz) have been hypothesized to play a role in cortical function. Most of the proposed mechanisms involve rhythmic modulation of neuronal excitability at gamma frequencies, leading to modulation of spike timing relative to the rhythm. I first show that the gamma band could be more privileged than other frequencies in observing spike-field interactions even in the absence of genuine gamma rhythmicity and discuss several biases in spike-gamma phase estimation. I then discuss the expected spike-gamma phase according to several hypotheses. Inconsistent with the phase-coding hypothesis (but not with others), the spike-gamma phase does not change with changes in stimulus intensity or attentional state, with spikes preferentially occurring 2-4 ms before the trough, but with substantial variability. However, this phase relationship is expected even when gamma is a byproduct of excitatory-inhibitory interactions. Given that gamma occurs in short bursts, I argue that the debate over the role of gamma is a matter of semantics. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Multi-scale neural decoding and analysis

Objective.

Complex spatiotemporal neural activity encodes rich information related to behavior and cognition. Conventional research has focused on neural activity acquired using one of many different measurement modalities, each of which provides useful but incomplete assessment of the neural code. Multi-modal techniques can overcome tradeoffs in the spatial and temporal resolution of a single modality to reveal deeper and more comprehensive understanding of system-level neural mechanisms. Uncovering multi-scale dynamics is essential for a mechanistic understanding of brain function and for harnessing neuroscientific insights to develop more effective clinical treatment.

Approach.

We discuss conventional methodologies used for characterizing neural activity at different scales and review contemporary examples of how these approaches have been combined. Then we present our case for integrating activity across multiple scales to benefit from the combined strengths of each approach and elucidate a more holistic understanding of neural processes.

Main results.

We examine various combinations of neural activity at different scales and analytical techniques that can be used to integrate or illuminate information across scales, as well the technologies that enable such exciting studies. We conclude with challenges facing future multi-scale studies, and a discussion of the power and potential of these approaches.

Significance.

This roadmap will lead the readers toward a broad range of multi-scale neural decoding techniques and their benefits over single-modality analyses. This Review article highlights the importance of multi-scale analyses for systematically interrogating complex spatiotemporal mechanisms underlying cognition and behavior.

Aperiodic sleep networks promote memory consolidation

Hierarchical synchronization of sleep oscillations establishes communication pathways to support memory reactivation, transfer, and consolidation. From an information-theoretical perspective, oscillations constitute highly structured network states that provide limited information-coding capacity. Recent findings indicate that sleep oscillations occur in transient bursts that are interleaved with aperiodic network states, which were previously considered to be random noise. We argue that aperiodic activity exhibits unique and variable spatiotemporal patterns, providing an ideal information-rich neurophysiological substrate for imprinting new mnemonic patterns onto existing circuits. We discuss novel avenues in conceptualizing and quantifying aperiodic network states during sleep to further understand their relevance and interplay with sleep oscillations in support of memory consolidation.

Behavioral and Neural Variability of Naturalistic Arm Movements

Motor behaviors are central to many functions and dysfunctions of the brain, and understanding their neural basis has consequently been a major focus in neuroscience. However, most studies of motor behaviors have been restricted to artificial, repetitive paradigms, far removed from natural movements performed "in the wild." Here, we leveraged recent advances in machine learning and computer vision to analyze intracranial recordings from 12 human subjects during thousands of spontaneous, unstructured arm reach movements, observed over several days for each subject. These naturalistic movements elicited cortical spectral power patterns consistent with findings from controlled paradigms, but with considerable neural variability across subjects and events. We modeled interevent variability using 10 behavioral and environmental features; the most important features explaining this variability were reach angle and day of recording. Our work is among the first studies connecting behavioral and neural variability across cortex in humans during unstructured movements and contributes to our understanding of long-term naturalistic behavior.

Decoding of Attentional State Using High-Frequency Local Field Potential Is As Accurate As Using Spikes

Local field potentials (LFPs) in visual cortex are reliably modulated when the subject's focus of attention is cued into versus out of the receptive field of the recorded sites, similar to modulation of spikes. However, human psychophysics studies have used an additional attention condition, neutral cueing, for decades. The effect of neutral cueing on spikes was examined recently and found to be intermediate between cued and uncued conditions. However, whether LFPs are also precise enough to represent graded states of attention is unknown. We found in rhesus monkeys that LFPs during neutral cueing were also intermediate between cued and uncued conditions. For a single electrode, attention was more discriminable using high frequency (>30 Hz) LFP power than spikes, which is expected because LFP represents a population signal and therefore is expected to be less noisy than spikes. However, previous studies have shown that when multiple electrodes are used, spikes can outperform LFPs. Surprisingly, in our study, spikes did not outperform LFPs when discriminability was computed using multiple electrodes, even though the LFP activity was highly correlated across electrodes compared with spikes. These results constrain the spatial scale over which attention operates and highlight the usefulness of LFPs in studying attention.

A Review: Electrode and Packaging Materials for Neurophysiology Recording Implants

To date, a wide variety of neural tissue implants have been developed for neurophysiology recording from living tissues. An ideal neural implant should minimize the damage to the tissue and perform reliably and accurately for long periods of time. Therefore, the materials utilized to fabricate the neural recording implants become a critical factor. The materials of these devices could be classified into two broad categories: electrode materials as well as packaging and substrate materials. In this review, inorganic (metals and semiconductors), organic (conducting polymers), and carbon-based (graphene and carbon nanostructures) electrode materials are reviewed individually in terms of various neural recording devices that are reported in recent years. Properties of these materials, including electrical properties, mechanical properties, stability, biodegradability/bioresorbability, biocompatibility, and optical properties, and their critical importance to neural recording quality and device capabilities, are discussed. For the packaging and substrate materials, different material properties are desired for the chronic implantation of devices in the complex environment of the body, such as biocompatibility and moisture and gas hermeticity. This review summarizes common solid and soft packaging materials used in a variety of neural interface electrode designs, as well as their packaging performances. Besides, several biopolymers typically applied over the electrode package to reinforce the mechanical rigidity of devices during insertion, or to reduce the immune response and inflammation at the device-tissue interfaces are highlighted. Finally, a benchmark analysis of the discussed materials and an outlook of the future research trends are concluded.

Functional MRI based simulations of ECoG grid configurations for optimal measurement of spatially distributed hand-gesture information

Objective In electrocorticography (ECoG), the physical characteristics of the electrode grid determine which aspect of the neurophysiology is measured. For particular cases, the ECoG grid may be tailored to capture specific features, such as in the development and use of brain-computer-interfaces (BCI). Neural representations of hand movement are increasingly used to control ECoG based BCIs. However, it remains unclear which grid configurations are the most optimal to capture the dynamics of hand gesture information. Here, we investigate how the design and surgical placement of grids would affect the usability of ECoG measurements. Approach High resolution 7T functional MRI was used as a proxy for neural activity in ten healthy participants to simulate various grid configurations, and evaluated the performance of each configuration for decoding hand gestures. The grid configurations varied in number of electrodes, electrode distance and electrode size. Main results Optimal decoding of hand gestures occurred in grid configurations with a higher number of densely-packed, large-size, electrodes up to a grid of ~5x5 electrodes. When restricting the grid placement to a highly informative region of primary sensorimotor cortex, optimal parameters converged to about 3x3 electrodes, an inter-electrode distance of 8mm, and an electrode size of 3mm radius (performing at ~70% 3-class classification accuracy). Significance Our approach might be used to identify the most informative region, find the optimal grid configuration and assist in positioning of the grid to achieve high BCI performance for the decoding of hand-gestures prior to surgical implantation.

Insights into human cognition from intracranial EEG: A review of audition, memory, internal cognition, and causality

By recording neural activity directly from the human brain, researchers gain unprecedented insight into how neurocognitive processes unfold in real time. We first briefly discuss how intracranial electroencephalography (iEEG) recordings, performed for clinical practice, are used to study human cognition with the spatiotemporal and single-trial precision traditionally limited to non-human animal research. We then delineate how studies using iEEG have informed our understanding of issues fundamental to human cognition: auditory prediction, working and episodic memory, and internal cognition. We also discuss the potential of iEEG to infer causality through the manipulation or 'engineering' of neurocognitive processes via spatiotemporally precise electrical stimulation. We close by highlighting limitations of iEEG, potential of burgeoning techniques to further increase spatiotemporal precision, and implications for future research using intracranial approaches to understand, restore, and enhance human cognition.