Extracting information from neuronal populations: information theory and decoding approaches

A novel DRL-guided sparse voxel decoding model for reconstructing perceived images from brain activity

BACKGROUND

Due to the sparse encoding character of the human visual cortex and the scarcity of paired training samples for {images, fMRIs}, voxel selection is an effective means of reconstructing perceived images from fMRI. However, the existing data-driven voxel selection methods have not achieved satisfactory results.

NEW METHOD

Here, a novel deep reinforcement learning-guided sparse voxel (DRL-SV) decoding model is proposed to reconstruct perceived images from fMRI. We innovatively describe voxel selection as a Markov decision process (MDP), training agents to select voxels that are highly involved in specific visual encoding.

RESULTS

Experimental results on two public datasets verify the effectiveness of the proposed DRL-SV, which can accurately select voxels highly involved in neural encoding, thereby improving the quality of visual image reconstruction.

COMPARISON WITH EXISTING METHODS

We qualitatively and quantitatively compared our results with the state-of-the-art (SOTA) methods, getting better reconstruction results. We compared the proposed DRL-SV with traditional data-driven baseline methods, obtaining sparser voxel selection results, but better reconstruction performance.

CONCLUSIONS

DRL-SV can accurately select voxels involved in visual encoding on few-shot, compared to data-driven voxel selection methods. The proposed decoding model provides a new avenue to improving the image reconstruction quality of the primary visual cortex.

Kinematic coding: Measuring information in naturalistic behaviour

Recent years have seen an explosion of interest in naturalistic behaviour and in machine learning tools for automatically tracking it. However, questions about what to measure, how to measure it, and how to relate naturalistic behaviour to neural activity and cognitive processes remain unresolved. In this Perspective, we propose a general experimental and computational framework - kinematic coding - for measuring how information about cognitive states is encoded in structured patterns of behaviour and how this information is read out by others during social interactions. This framework enables the design of new experiments and the generation of testable hypotheses that link behaviour, cognition, and neural activity at the single-trial level. Researchers can employ this framework to identify single-subject, single-trial encoding and readout computations and address meaningful questions about how information encoded in bodily motion is transmitted and communicated.

Quantitative analyses of how optimally heterogeneous neural codes maximize neural information in jittery transmission environments

Various spike patterns from sensory/motor neurons provide information about the dynamic sensory stimuli. Based on the information theory, neuroscientists have revealed the influence of spike variables on information transmission. Among diverse spike variables, inter-trial heterogeneity, known as jitter, has been observed in physiological neuron activity and responses to artificial stimuli, and it is recognized to contribute to information transmission. However, the relationship between inter-trial heterogeneity and information remains unexplored. Therefore, understanding how jitter impacts the heterogeneity of spiking activities and information encoding is crucial, as it offers insights into stimulus conditions and the efficiency of neural systems. Here, we systematically explored how neural information is altered by number of neurons as well as by each of three fundamental spiking characteristics: mean firing rate (MFR), duration, and cross-correlation (spike time tiling coefficient; STTC). First, we generated groups of spike trains to have specific average values for those characteristics. Second, we quantified the transmitted information rate as a function of each parameter. As population size, MFR, and duration increased, the information rate was enhanced but gradually saturated with further increments in number of cells and MFR. Regarding the cross-correlation level, homogeneous and heterogeneous spike trains (STTCAVG = 0.9 and 0.1) showed the lowest and highest information transmission, respectively. Interestingly however, when jitters were added to mimic physiological noisy environment, the information was reduced by ~ 46% for the spike trains with STTCAVG = 0.1 but rather substantially increased by ~ 63% for the spike trains with STTCAVG = 0.9. Our study suggests that optimizing various spiking characteristics may enhance the robustness and amount of neural information transmitted.

Entropy of Neuronal Spike Patterns

Neuronal spike patterns are the fundamental units of neural communication in the brain, which is still not fully understood. Entropy measures offer a quantitative framework to assess the variability and information content of these spike patterns. By quantifying the uncertainty and informational content of neuronal patterns, entropy measures provide insights into neural coding strategies, synaptic plasticity, network dynamics, and cognitive processes. Here, we review basic entropy metrics and then we provide examples of recent advancements in using entropy as a tool to improve our understanding of neuronal processing. It focuses especially on studies on critical dynamics in neural networks and the relation of entropy to predictive coding and cortical communication. We highlight the necessity of expanding entropy measures from single neurons to encompass multi-neuronal activity patterns, as cortical circuits communicate through coordinated spatiotemporal activity patterns, called neuronal packets. We discuss how the sequential and partially stereotypical nature of neuronal packets influences the entropy of cortical communication. Stereotypy reduces entropy by enhancing reliability and predictability in neural signaling, while variability within packets increases entropy, allowing for greater information capacity. This balance between stereotypy and variability supports both robustness and flexibility in cortical information processing. We also review challenges in applying entropy to analyze such spatiotemporal neuronal spike patterns, notably, the "curse of dimensionality" in estimating entropy for high-dimensional neuronal data. Finally, we discuss strategies to overcome these challenges, including dimensionality reduction techniques, advanced entropy estimators, sparse coding schemes, and the integration of machine learning approaches. Thus, this work summarizes the most recent developments on how entropy measures contribute to our understanding of principles underlying neural coding.

Decoding multi-limb movements from two-photon calcium imaging of neuronal activity using deep learning

Objective.Brain-machine interfaces (BMIs) aim to restore sensorimotor function to individuals suffering from neural injury and disease. A critical step in implementing a BMI is to decode movement intention from recorded neural activity patterns in sensorimotor areas. Optical imaging, including two-photon (2p) calcium imaging, is an attractive approach for recording large-scale neural activity with high spatial resolution using a minimally-invasive technique. However, relating slow two-photon calcium imaging data to fast behaviors is challenging due to the relatively low optical imaging sampling rates. Nevertheless, neural activity recorded with 2p calcium imaging has been used to decode information about stereotyped single-limb movements and to control BMIs. Here, we expand upon prior work by applying deep learning to decode multi-limb movements of running mice from 2p calcium imaging data.Approach.We developed a recurrent encoder-decoder network (LSTM-encdec) in which the output is longer than the input.Main results.LSTM-encdec could accurately decode information about all four limbs (contralateral and ipsilateral front and hind limbs) from calcium imaging data recorded in a single cortical hemisphere.Significance.Our approach provides interpretability measures to validate decoding accuracy and expands the utility of BMIs by establishing the groundwork for control of multiple limbs. Our work contributes to the advancement of neural decoding techniques and the development of next-generation optical BMIs.

KETAMINE: Neural- and network-level changes

Ketamine is a widely used clinical drug that has several functional and clinical applications, including its use as an anaesthetic, analgesic, anti-depressive, anti-suicidal agent, among others. Among its diverse behavioral effects, it influences short-term memory and induces psychedelic effects. At the neural level across different brain areas, it modulates neural firing rates, neural tuning, brain oscillations, and modularity, while promoting hypersynchrony and random connectivity between neurons. In our recent studies we demonstrated that topical application of ketamine on the visual cortex alters neural tuning and promotes vigorous connectivity between neurons by decreasing their firing variability. Here, we begin with a brief review of the literature, followed by results from our lab, where we synthesize a dendritic model of neural tuning and network changes following ketamine application. This model has potential implications for focused modulation of cortical networks in clinical settings. Finally, we identify current gaps in research and suggest directions for future studies, particularly emphasizing the need for more animal experiments to establish a platform for effective translation and synergistic therapies combining ketamine with other protocols such as training and adaptation. In summary, investigating ketamine's broader systemic effects, not only provides deeper insight into cognitive functions and consciousness but also paves the way to advance therapies for neuropsychiatric disorders.

A tradeoff between efficiency and robustness in the hippocampal-neocortical memory network during human and rodent sleep

Sleep constitutes a brain state of disengagement from the external world that supports memory consolidation and restores cognitive resources. The precise mechanisms how sleep and its varied stages support information processing remain largely unknown. Synaptic scaling models imply that daytime learning accumulates neural information, which is then consolidated and downregulated during sleep. Currently, there is a lack of in-vivo data from humans and rodents that elucidate if, and how, sleep renormalizes information processing capacities. From an information-theoretical perspective, a consolidation process should entail a reduction in neural pattern variability over the course of a night. Here, in a cross-species intracranial study, we identify a tradeoff in the neural population code during sleep where information coding efficiency is higher in the neocortex than in hippocampal archicortex in humans than in rodents as well as during wakefulness compared to sleep. Critically, non-REM sleep selectively reduces information coding efficiency through pattern repetition in the neocortex in both species, indicating a transition to a more robust information coding regime. Conversely, the coding regime in the hippocampus remained consistent from wakefulness to non-REM sleep. These findings suggest that new information could be imprinted to the long-term mnemonic storage in the neocortex through pattern repetition during sleep. Lastly, our results show that task engagement increased coding efficiency, while medically-induced unconsciousness disrupted the population code. In sum, these findings suggest that neural pattern variability could constitute a fundamental principle underlying cognitive engagement and memory formation, while pattern repetition reflects robust coding, possibly underlying the consolidation process.

Low-intensity transcranial ultrasound stimulation improves memory behavior in an ADHD rat model by modulating cortical functional network connectivity

Working memory in attention deficit hyperactivity disorder (ADHD) is closely related to cortical functional network connectivity (CFNC), such as abnormal connections between the frontal, temporal, occipital cortices and with other brain regions. Low-intensity transcranial ultrasound stimulation (TUS) has the advantages of non-invasiveness, high spatial resolution, and high penetration depth and can improve ADHD memory behavior. However, how it modulates CFNC in ADHD and the CFNC mechanism that improves working memory behavior in ADHD remain unclear. In this study, we observed working memory impairment in ADHD rats, establishing a corresponding relationship between changes in CFNCs and the behavioral state during the working memory task. Specifically, we noted abnormalities in the information transmission and processing capabilities of CFNC in ADHD rats while performing working memory tasks. These abnormalities manifested in the network integration ability of specific areas, as well as the information flow and functional differentiation of CFNC. Furthermore, our findings indicate that TUS effectively enhances the working memory ability of ADHD rats by modulating information transmission, processing, and integration capabilities, along with adjusting the information flow and functional differentiation of CFNC. Additionally, we explain the CFNC mechanism through which TUS improves working memory in ADHD. In summary, these findings suggest that CFNCs are important in working memory behaviors in ADHD.

Packet information encoding in a cerebellum-like circuit

Packet information encoding of neural signals was proposed for vision about 50 years ago and has recently been revived as a plausible strategy generalizable to natural and artificial sensory systems. It involves discrete image segmentation controlled by feedback and the ability to store and compare packets of information. This article shows that neurons of the cerebellum-like electrosensory lobe (EL) of the electric fish Gymnotus omarorum use spike-count and spike-timing distribution as constitutive variables of packets of information that encode one-by-one the electrosensory images generated by a self-timed series of electric organ discharges (EODs). To evaluate this hypothesis, extracellular unitary activity was recorded from the centro-medial map of the EL. Units recorded in high-decerebrate preparations were classified into six types using hierarchical cluster analysis of post-EOD spiking histograms. Cross-correlation analysis indicated that each EOD strongly influences the unit firing probability within the next inter-EOD interval. Units of the same type were similarly located in the laminar organization of the EL and showed similar stimulus-specific changes in spike count and spike timing after the EOD when a metal object was moved close by, along the fish's body parallel to the skin, or when the longitudinal impedance of a static cylindrical probe placed at the center of the receptive field was incremented in a stepwise manner in repetitive trials. These last experiments showed that spike-counts and the relative entropy, expressing a comparative measure of information before and after the step, were systematically increased with respect to a control in all unit types. The post-EOD spike-timing probability distribution and the relatively independent contribution of spike-timing and number to the content of information in the transmitted packet suggest that these are the constitutive image-encoding variables of the packets. Comparative analysis suggests that packet information transmission is a general principle for processing superposition images in cerebellum-like networks.

Electrical Signaling Beyond Neurons

Neural action potentials (APs) are difficult to interpret as signal encoders and/or computational primitives. Their relationships with stimuli and behaviors are obscured by the staggering complexity of nervous systems themselves. We can reduce this complexity by observing that "simpler" neuron-less organisms also transduce stimuli into transient electrical pulses that affect their behaviors. Without a complicated nervous system, APs are often easier to understand as signal/response mechanisms. We review examples of nonneural stimulus transductions in domains of life largely neglected by theoretical neuroscience: bacteria, protozoans, plants, fungi, and neuron-less animals. We report properties of those electrical signals-for example, amplitudes, durations, ionic bases, refractory periods, and particularly their ecological purposes. We compare those properties with those of neurons to infer the tasks and selection pressures that neurons satisfy. Throughout the tree of life, nonneural stimulus transductions time behavioral responses to environmental changes. Nonneural organisms represent the presence or absence of a stimulus with the presence or absence of an electrical signal. Their transductions usually exhibit high sensitivity and specificity to a stimulus, but are often slow compared to neurons. Neurons appear to be sacrificing the specificity of their stimulus transductions for sensitivity and speed. We interpret cellular stimulus transductions as a cell's assertion that it detected something important at that moment in time. In particular, we consider neural APs as fast but noisy detection assertions. We infer that a principal goal of nervous systems is to detect extremely weak signals from noisy sensory spikes under enormous time pressure. We discuss neural computation proposals that address this goal by casting neurons as devices that implement online, analog, probabilistic computations with their membrane potentials. Those proposals imply a measurable relationship between afferent neural spiking statistics and efferent neural membrane electrophysiology.

Recording Quality Is Systematically Related to Electrode Impedance

Extracellular recordings with planar microelectrodes are the gold standard technique for recording the fast action potentials of neurons in the intact brain. The introduction of microfabrication techniques has revolutionized the in vivo recording of neuronal activity and introduced high-density, multi-electrode arrays that increase the spatial resolution of recordings and the number of neurons that can be simultaneously recorded. Despite these innovations, there is still debate about the ideal electrical transfer characteristics of extracellular electrodes. This uncertainty is partly due to the lack of systematic studies comparing electrodes with different characteristics, particularly for chronically implanted arrays over extended time periods. Here a high-density, flexible, and thin-film array is fabricated and tested, containing four distinct electrode types differing in surface material and surface topology and, thus, impedance. It is found that recording quality is strongly related to electrode impedance with signal amplitude and unit yield negatively correlated to impedance. Electrode impedances are stable for the duration of the experiment (up to 12 weeks) and recording quality does not deteriorate. The findings support the expectation from the theory that recording quality will increase as impedance decreases.

Saccade size predicts onset time of object processing during visual search of an open world virtual environment

OBJECTIVE

To date the vast majority of research in the visual neurosciences have been forced to adopt a highly constrained perspective of the vision system in which stimuli are processed in an open-loop reactive fashion (i.e., abrupt stimulus presentation followed by an evoked neural response). While such constraints enable high construct validity for neuroscientific investigation, the primary outcomes have been a reductionistic approach to isolate the component processes of visual perception. In electrophysiology, of the many neural processes studied under this rubric, the most well-known is, arguably, the P300 evoked response. There is, however, relatively little known about the real-world corollary of this component in free-viewing paradigms where visual stimuli are connected to neural function in a closed-loop. While growing evidence suggests that neural activity analogous to the P300 does occur in such paradigms, it is an open question when this response occurs and what behavioral or environmental factors could be used to isolate this component.

APPROACH

The current work uses convolutional networks to decode neural signals during a free-viewing visual search task in a closed-loop paradigm within an open-world virtual environment. From the decoded activity we construct fixation-locked response profiles that enable estimations of the variable latency of any P300 analogue around the moment of fixation. We then use these estimates to investigate which factors best reduce variable latency and, thus, predict the onset time of the response. We consider measurable, search-related factors encompassing top-down (i.e., goal driven) and bottom-up (i.e., stimulus driven) processes, such as fixation duration and salience. We also consider saccade size as an intermediate factor reflecting the integration of these two systems.

MAIN RESULTS

The results show that of these factors only saccade size reliably determines the onset time of P300 analogous activity for this task. Specifically, we find that for large saccades the variability in response onset is small enough to enable analysis using traditional ensemble averaging methods.

SIGNIFICANCE

The results show that P300 analogous activity does occur during closed-loop, free-viewing visual search while highlighting distinct differences between the open-loop version of this response and its real-world analogue. The results also further establish saccades, and saccade size, as a key factor in real-world visual processing.

Synapse device based neuromorphic system for biomedical applications

Despite holding valuable information, unstructured data pose challenges for efficient recognition due to the difficulties in feature extraction using traditional Von-Neumann architecture systems, which are limited by power and time bottlenecks. Although biological neural signals offer crucial insights, they require more effective recognition solutions due to inherent noise and the vast volumes of data. Inspired by the human brain, neuromorphic systems have emerged as promising alternatives because of their parallelism, low power consumption, and error tolerance. By leveraging deep neural networks (DNNs), these systems can recognize imprecise data through two key processes: learning (feature extraction) and testing (feature matching and recognition). During the learning phase, DNNs extract and store unique features such as weight changes in synapse units. In the testing phase, new data are compared with the stored features for recognition. The parallelization of the neuromorphic system enables the efficient processing of large, imprecise datasets with minimal energy consumption. Nevertheless, the hardware implementation is essential for determining the full potential of DNNs. This paper focuses on synapse devices, which are the core units for hardware DNN implementations, and presents a biomedical application example: a rat neural signal recognition system implemented using a synapse device-based neuromorphic system.

Predicting social experience from dyadic interaction dynamics: the BallGame, a novel paradigm to study social engagement

Theories of embodied cognition suggest that a shared environment and ongoing sensorimotor interaction are central for interpersonal learning and engagement. To investigate the embodied, distributed and hence dynamically unfolding nature of social cognitive capacities, we present a novel laboratory-based coordination task: the BallGame. Our paradigm requires continuous sensing and acting between two players who jointly steer a virtual ball around obstacles towards as many targets as possible. By analysing highly resolved measures of movement coordination and gaming behaviour, game-concurrent experience ratings, semi-structured interviews, and personality questionnaires, we reveal contributions from different levels of observation on social experience. In particular, successful coordination (number of targets collected) and intermittent periods of high versus low movement coordination (variability of relation) emerged as prominent predictors of social experience. Importantly, having the same (but incomplete) view on the game environment strengthened interpersonal coordination, whereas complementary views enhanced engagement and tended to generate more complex interactive behaviour. Overall, we find evidence for a critical balance between similarity and synchrony on the one hand, and variability and difference on the other, for successful engagement in social interactions. Finally, following participant reports, we highlight how interpersonal experience emerges from specific histories of coordination that are closely related to the interaction context in both space and time.

Learning to use landmarks for navigation amplifies their representation in retrosplenial cortex

Visual landmarks provide powerful reference signals for efficient navigation by altering the activity of spatially tuned neurons, such as place cells, head direction cells, and grid cells. To understand the neural mechanism by which landmarks exert such strong influence, it is necessary to identify how these visual features gain spatial meaning. In this study, we characterized visual landmark representations in mouse retrosplenial cortex (RSC) using chronic two-photon imaging of the same neuronal ensembles over the course of spatial learning. We found a pronounced increase in landmark-referenced activity in RSC neurons that, once established, remained stable across days. Changing behavioral context by uncoupling treadmill motion from visual feedback systematically altered neuronal responses associated with the coherence between visual scene flow speed and self-motion. To explore potential underlying mechanisms, we modeled how burst firing, mediated by supralinear somatodendritic interactions, could efficiently mediate context- and coherence-dependent integration of landmark information. Our results show that visual encoding shifts to landmark-referenced and context-dependent codes as these cues take on spatial meaning during learning.

Single-Trial Representations of Decision-Related Variables by Decomposed Frontal Corticostriatal Ensemble Activity

The frontal cortex-striatum circuit plays a pivotal role in adaptive goal-directed behaviors. However, it remains unclear how decision-related signals are mediated through cross-regional transmission between the medial frontal cortex and the striatum by neuronal ensembles in making decision based on outcomes of past action. Here, we analyzed neuronal ensemble activity obtained through simultaneous multiunit recordings in the secondary motor cortex (M2) and dorsal striatum (DS) in rats performing an outcome-based left-or-right choice task. By adopting tensor component analysis (TCA), a single-trial-based unsupervised dimensionality reduction approach, for concatenated ensembles of M2 and DS neurons, we identified distinct three spatiotemporal neural dynamics (TCA components) at the single-trial level specific to task-relevant variables. Choice-position-selective neural dynamics reflected the positions chosen and was correlated with the trial-to-trial fluctuation of behavioral variables. Intriguingly, choice-pattern-selective neural dynamics distinguished whether the incoming choice was a repetition or a switch from the previous choice before a response choice. Other neural dynamics was selective to outcome and increased within-trial activity following response. Our results demonstrate how the concatenated ensembles of M2 and DS process distinct features of decision-related signals at various points in time. Thereby, the M2 and DS collaboratively monitor action outcomes and determine the subsequent choice, whether to repeat or switch, for action selection.

Multiunit Frontal Eye Field Activity Codes the Visuomotor Transformation, But Not Gaze Prediction or Retrospective Target Memory, in a Delayed Saccade Task

Single-unit (SU) activity-action potentials isolated from one neuron-has traditionally been employed to relate neuronal activity to behavior. However, recent investigations have shown that multiunit (MU) activity-ensemble neural activity recorded within the vicinity of one microelectrode-may also contain accurate estimations of task-related neural population dynamics. Here, using an established model-fitting approach, we compared the spatial codes of SU response fields with corresponding MU response fields recorded from the frontal eye fields (FEFs) in head-unrestrained monkeys (Macaca mulatta) during a memory-guided saccade task. Overall, both SU and MU populations showed a simple visuomotor transformation: the visual response coded target-in-eye coordinates, transitioning progressively during the delay toward a future gaze-in-eye code in the saccade motor response. However, the SU population showed additional secondary codes, including a predictive gaze code in the visual response and retention of a target code in the motor response. Further, when SUs were separated into regular/fast spiking neurons, these cell types showed different spatial code progressions during the late delay period, only converging toward gaze coding during the final saccade motor response. Finally, reconstructing MU populations (by summing SU data within the same sites) failed to replicate either the SU or MU pattern. These results confirm the theoretical and practical potential of MU activity recordings as a biomarker for fundamental sensorimotor transformations (e.g., target-to-gaze coding in the oculomotor system), while also highlighting the importance of SU activity for coding more subtle (e.g., predictive/memory) aspects of sensorimotor behavior.

Decoding dynamic visual scenes across the brain hierarchy

Understanding the computational mechanisms that underlie the encoding and decoding of environmental stimuli is a crucial investigation in neuroscience. Central to this pursuit is the exploration of how the brain represents visual information across its hierarchical architecture. A prominent challenge resides in discerning the neural underpinnings of the processing of dynamic natural visual scenes. Although considerable research efforts have been made to characterize individual components of the visual pathway, a systematic understanding of the distinctive neural coding associated with visual stimuli, as they traverse this hierarchical landscape, remains elusive. In this study, we leverage the comprehensive Allen Visual Coding-Neuropixels dataset and utilize the capabilities of deep learning neural network models to study neural coding in response to dynamic natural visual scenes across an expansive array of brain regions. Our study reveals that our decoding model adeptly deciphers visual scenes from neural spiking patterns exhibited within each distinct brain area. A compelling observation arises from the comparative analysis of decoding performances, which manifests as a notable encoding proficiency within the visual cortex and subcortical nuclei, in contrast to a relatively reduced encoding activity within hippocampal neurons. Strikingly, our results unveil a robust correlation between our decoding metrics and well-established anatomical and functional hierarchy indexes. These findings corroborate existing knowledge in visual coding related to artificial visual stimuli and illuminate the functional role of these deeper brain regions using dynamic stimuli. Consequently, our results suggest a novel perspective on the utility of decoding neural network models as a metric for quantifying the encoding quality of dynamic natural visual scenes represented by neural responses, thereby advancing our comprehension of visual coding within the complex hierarchy of the brain.

A synergistic workspace for human consciousness revealed by Integrated Information Decomposition

How is the information-processing architecture of the human brain organised, and how does its organisation support consciousness? Here, we combine network science and a rigorous information-theoretic notion of synergy to delineate a 'synergistic global workspace', comprising gateway regions that gather synergistic information from specialised modules across the human brain. This information is then integrated within the workspace and widely distributed via broadcaster regions. Through functional MRI analysis, we show that gateway regions of the synergistic workspace correspond to the human brain's default mode network, whereas broadcasters coincide with the executive control network. We find that loss of consciousness due to general anaesthesia or disorders of consciousness corresponds to diminished ability of the synergistic workspace to integrate information, which is restored upon recovery. Thus, loss of consciousness coincides with a breakdown of information integration within the synergistic workspace of the human brain. This work contributes to conceptual and empirical reconciliation between two prominent scientific theories of consciousness, the Global Neuronal Workspace and Integrated Information Theory, while also advancing our understanding of how the human brain supports consciousness through the synergistic integration of information.

Multi-day neuron tracking in high-density electrophysiology recordings using earth mover's distance

Accurate tracking of the same neurons across multiple days is crucial for studying changes in neuronal activity during learning and adaptation. Advances in high-density extracellular electrophysiology recording probes, such as Neuropixels, provide a promising avenue to accomplish this goal. Identifying the same neurons in multiple recordings is, however, complicated by non-rigid movement of the tissue relative to the recording sites (drift) and loss of signal from some neurons. Here, we propose a neuron tracking method that can identify the same cells independent of firing statistics, that are used by most existing methods. Our method is based on between-day non-rigid alignment of spike-sorted clusters. We verified the same cell identity in mice using measured visual receptive fields. This method succeeds on datasets separated from 1 to 47 days, with an 84% average recovery rate.

Unravelling consciousness and brain function through the lens of time, space, and information

Disentangling how cognitive functions emerge from the interplay of brain dynamics and network architecture is among the major challenges that neuroscientists face. Pharmacological and pathological perturbations of consciousness provide a lens to investigate these complex challenges. Here, we review how recent advances about consciousness and the brain's functional organisation have been driven by a common denominator: decomposing brain function into fundamental constituents of time, space, and information. Whereas unconsciousness increases structure-function coupling across scales, psychedelics may decouple brain function from structure. Convergent effects also emerge: anaesthetics, psychedelics, and disorders of consciousness can exhibit similar reconfigurations of the brain's unimodal-transmodal functional axis. Decomposition approaches reveal the potential to translate discoveries across species, with computational modelling providing a path towards mechanistic integration.

Stimulus information guides the emergence of behavior-related signals in primary somatosensory cortex during learning

Neurons in the primary cortex carry sensory- and behavior-related information, but it remains an open question how this information emerges and intersects together during learning. Current evidence points to two possible learning-related changes: sensory information increases in the primary cortex or sensory information remains stable, but its readout efficiency in association cortices increases. We investigated this question by imaging neuronal activity in mouse primary somatosensory cortex before, during, and after learning of an object localization task. We quantified sensory- and behavior-related information and estimated how much sensory information was used to instruct perceptual choices as learning progressed. We find that sensory information increases from the start of training, while choice information is mostly present in the later stages of learning. Additionally, the readout of sensory information becomes more efficient with learning as early as in the primary sensory cortex. Together, our results highlight the importance of primary cortical neurons in perceptual learning.

Sampling bias corrections for accurate neural measures of redundant, unique, and synergistic information

Shannon Information theory has long been a tool of choice to measure empirically how populations of neurons in the brain encode information about cognitive variables. Recently, Partial Information Decomposition (PID) has emerged as principled way to break down this information into components identifying not only the unique information carried by each neuron, but also whether relationships between neurons generate synergistic or redundant information. While it has been long recognized that Shannon information measures on neural activity suffer from a (mostly upward) limited sampling estimation bias, this issue has largely been ignored in the burgeoning field of PID analysis of neural activity. We used simulations to investigate the limited sampling bias of PID computed from discrete probabilities (suited to describe neural spiking activity). We found that PID suffers from a large bias that is uneven across components, with synergy by far the most biased. Using approximate analytical expansions, we found that the bias of synergy increases quadratically with the number of discrete responses of each neuron, whereas the bias of unique and redundant information increase only linearly or sub-linearly. Based on the understanding of the PID bias properties, we developed simple yet effective procedures that correct for the bias effectively, and that improve greatly the PID estimation with respect to current state-of-the-art procedures. We apply these PID bias correction procedures to datasets of 53117 pairs neurons in auditory cortex, posterior parietal cortex and hippocampus of mice performing cognitive tasks, deriving precise estimates and bounds of how synergy and redundancy vary across these brain regions.

The role of elasticity on adhesion and clustering of neurons on soft surfaces

The question of whether material stiffness enhances cell adhesion and clustering is still open to debate. Results from the literature are seemingly contradictory, with some reports illustrating that adhesion increases with surface stiffness and others suggesting that the performance of a system of cells is curbed by high values of elasticity. To address the role of elasticity as a regulator in neuronal cell adhesion and clustering, we investigated the topological characteristics of networks of neurons on polydimethylsiloxane (PDMS) surfaces - with values of elasticity (E) varying in the 0.55-2.65 MPa range. Results illustrate that, as elasticity increases, the number of neurons adhering on the surface decreases. Notably, the small-world coefficient - a topological measure of networks - also decreases. Numerical simulations and functional multi-calcium imaging experiments further indicated that the activity of neuronal cells on soft surfaces improves for decreasing E. Experimental findings are supported by a mathematical model, that explains adhesion and clustering of cells on soft materials as a function of few parameters - including the Young's modulus and roughness of the material. Overall, results indicate that - in the considered elasticity interval - increasing the compliance of a material improves adhesion, improves clustering, and enhances communication of neurons.

The impact of spike timing precision and spike emission reliability on decoding accuracy

Precisely timed and reliably emitted spikes are hypothesized to serve multiple functions, including improving the accuracy and reproducibility of encoding stimuli, memories, or behaviours across trials. When these spikes occur as a repeating sequence, they can be used to encode and decode a potential time series. Here, we show both analytically and in simulations that the error incurred in approximating a time series with precisely timed and reliably emitted spikes decreases linearly with the number of neurons or spikes used in the decoding. This was verified numerically with synthetically generated patterns of spikes. Further, we found that if spikes were imprecise in their timing, or unreliable in their emission, the error incurred in decoding with these spikes would be sub-linear. However, if the spike precision or spike reliability increased with network size, the error incurred in decoding a time-series with sequences of spikes would maintain a linear decrease with network size. The spike precision had to increase linearly with network size, while the probability of spike failure had to decrease with the square-root of the network size. Finally, we identified a candidate circuit to test this scaling relationship: the repeating sequences of spikes with sub-millisecond precision in area HVC (proper name) of the zebra finch. This scaling relationship can be tested using both neural data and song-spectrogram-based recordings while taking advantage of the natural fluctuation in HVC network size due to neurogenesis.

Information flow between motor cortex and striatum reverses during skill learning

The coordination of neural activity across brain areas during a specific behavior is often interpreted as neural communication involved in controlling the behavior. However, whether information relevant to the behavior is actually transferred between areas is often untested. Here, we used information-theoretic tools to quantify how motor cortex and striatum encode and exchange behaviorally relevant information about specific reach-to-grasp movement features during skill learning in rats. We found a temporal shift in the encoding of behaviorally relevant information during skill learning, as well as a reversal in the primary direction of behaviorally relevant information flow, from cortex-to-striatum during naive movements to striatum-to-cortex during skilled movements. Standard analytical methods that quantify the evolution of overall neural activity during learning-such as changes in neural signal amplitude or the overall exchange of information between areas-failed to capture these behaviorally relevant information dynamics. Using these standard methods, we instead found a consistent coactivation of overall neural signals during movement production and a bidirectional increase in overall information propagation between areas during learning. Our results show that skill learning is achieved through a transformation in how behaviorally relevant information is routed across cortical and subcortical brain areas and that isolating the components of neural activity relevant to and informative about behavior is critical to uncover directional interactions within a coactive and coordinated network.

Multi-day Neuron Tracking in High Density Electrophysiology Recordings using EMD

Accurate tracking of the same neurons across multiple days is crucial for studying changes in neuronal activity during learning and adaptation. Advances in high density extracellular electrophysiology recording probes, such as Neuropixels, provide a promising avenue to accomplish this goal. Identifying the same neurons in multiple recordings is, however, complicated by non-rigid movement of the tissue relative to the recording sites (drift) and loss of signal from some neurons. Here we propose a neuron tracking method that can identify the same cells independent of firing statistics, that are used by most existing methods. Our method is based on between-day non-rigid alignment of spike sorted clusters. We verified the same cell identity in mice using measured visual receptive fields. This method succeeds on datasets separated from one to 47 days, with an 84% average recovery rate.

Information decomposition and the informational architecture of the brain

To explain how the brain orchestrates information-processing for cognition, we must understand information itself. Importantly, information is not a monolithic entity. Information decomposition techniques provide a way to split information into its constituent elements: unique, redundant, and synergistic information. We review how disentangling synergistic and redundant interactions is redefining our understanding of integrative brain function and its neural organisation. To explain how the brain navigates the trade-offs between redundancy and synergy, we review converging evidence integrating the structural, molecular, and functional underpinnings of synergy and redundancy; their roles in cognition and computation; and how they might arise over evolution and development. Overall, disentangling synergistic and redundant information provides a guiding principle for understanding the informational architecture of the brain and cognition.

Neural signatures of natural behaviour in socializing macaques

Our understanding of the neurobiology of primate behaviour largely derives from artificial tasks in highly controlled laboratory settings, overlooking most natural behaviours that primate brains evolved to produce1-3. How primates navigate the multidimensional social relationships that structure daily life4 and shape survival and reproductive success5 remains largely unclear at the single-neuron level. Here we combine ethological analysis, computer vision and wireless recording technologies to identify neural signatures of natural behaviour in unrestrained, socially interacting pairs of rhesus macaques. Single-neuron and population activity in the prefrontal and temporal cortex robustly encoded 24 species-typical behaviours, as well as social context. Male-female partners demonstrated near-perfect reciprocity in grooming, a key behavioural mechanism supporting friendships and alliances6, and neural activity maintained a running account of these social investments. Confronted with an aggressive intruder, behavioural and neural population responses reflected empathy and were buffered by the presence of a partner. Our findings reveal a highly distributed neurophysiological ledger of social dynamics, a potential computational foundation supporting communal life in primate societies, including our own.

Estimating and approaching the maximum information rate of noninvasive visual brain-computer interface

An essential priority of visual brain-computer interfaces (BCIs) is to enhance the information transfer rate (ITR) to achieve high-speed communication. Despite notable progress, noninvasive visual BCIs have encountered a plateau in ITRs, leaving it uncertain whether higher ITRs are achievable. In this study, we used information theory to study the characteristics and capacity of the visual-evoked channel, which leads us to investigate whether and how we can decode higher information rates in a visual BCI system. Using information theory, we estimate the upper and lower bounds of the information rate with the white noise (WN) stimulus. Consequently, we found out that the information rate is determined by the signal-to-noise ratio (SNR) in the frequency domain, which reflects the spectrum resources of the channel. Based on this discovery, we propose a broadband WN BCI by implementing stimuli on a broader frequency band than the steady-state visual evoked potentials (SSVEPs)-based BCI. Through validation, the broadband BCI outperforms the SSVEP BCI by an impressive 7 bps, setting a record of 50 bps. The integration of information theory and the decoding analysis presented in this study offers valuable insights applicable to general sensory-evoked BCIs, providing a potential direction of next-generation human-machine interaction systems.

Mind In Vitro Platforms: Versatile, Scalable, Robust, and Open Solutions to Interfacing with Living Neurons

Motivated by the unexplored potential of in vitro neural systems for computing and by the corresponding need of versatile, scalable interfaces for multimodal interaction, an accurate, modular, fully customizable, and portable recording/stimulation solution that can be easily fabricated, robustly operated, and broadly disseminated is presented. This approach entails a reconfigurable platform that works across multiple industry standards and that enables a complete signal chain, from neural substrates sampled through micro-electrode arrays (MEAs) to data acquisition, downstream analysis, and cloud storage. Built-in modularity supports the seamless integration of electrical/optical stimulation and fluidic interfaces. Custom MEA fabrication leverages maskless photolithography, favoring the rapid prototyping of a variety of configurations, spatial topologies, and constitutive materials. Through a dedicated analysis and management software suite, the utility and robustness of this system are demonstrated across neural cultures and applications, including embryonic stem cell-derived and primary neurons, organotypic brain slices, 3D engineered tissue mimics, concurrent calcium imaging, and long-term recording. Overall, this technology, termed "mind in vitro" to underscore the computing inspiration, provides an end-to-end solution that can be widely deployed due to its affordable (>10× cost reduction) and open-source nature, catering to the expanding needs of both conventional and unconventional electrophysiology.

Biomimetic computer-to-brain communication enhancing naturalistic touch sensations via peripheral nerve stimulation

Artificial communication with the brain through peripheral nerve stimulation shows promising results in individuals with sensorimotor deficits. However, these efforts lack an intuitive and natural sensory experience. In this study, we design and test a biomimetic neurostimulation framework inspired by nature, capable of "writing" physiologically plausible information back into the peripheral nervous system. Starting from an in-silico model of mechanoreceptors, we develop biomimetic stimulation policies. We then experimentally assess them alongside mechanical touch and common linear neuromodulations. Neural responses resulting from biomimetic neuromodulation are consistently transmitted towards dorsal root ganglion and spinal cord of cats, and their spatio-temporal neural dynamics resemble those naturally induced. We implement these paradigms within the bionic device and test it with patients (ClinicalTrials.gov identifier NCT03350061). He we report that biomimetic neurostimulation improves mobility (primary outcome) and reduces mental effort (secondary outcome) compared to traditional approaches. The outcomes of this neuroscience-driven technology, inspired by the human body, may serve as a model for advancing assistive neurotechnologies.

Bounded contribution of human early visual cortex to the topographic anisotropy in spatial extent perception

To interact successfully with objects, it is crucial to accurately perceive their spatial extent, an enclosed region they occupy in space. Although the topographic representation of space in the early visual cortex (EVC) has been favored as a neural correlate of spatial extent perception, its exact nature and contribution to perception remain unclear. Here, we inspect the topographic representations of human individuals' EVC and perception in terms of how much their anisotropy is influenced by the orientation (co-axiality) and radial position (radiality) of stimuli. We report that while the anisotropy is influenced by both factors, its direction is primarily determined by radiality in EVC but by co-axiality in perception. Despite this mismatch, the individual differences in both radial and co-axial anisotropy are substantially shared between EVC and perception. Our findings suggest that spatial extent perception builds on EVC's spatial representation but requires an additional mechanism to transform its topographic bias.

A prefrontal-thalamic circuit encodes social information for social recognition

Social recognition encompasses encoding social information and distinguishing unfamiliar from familiar individuals to form social relationships. Although the medial prefrontal cortex (mPFC) is known to play a role in social behavior, how identity information is processed and by which route it is communicated in the brain remains unclear. Here we report that a ventral midline thalamic area, nucleus reuniens (Re) that has reciprocal connections with the mPFC, is critical for social recognition in male mice. In vivo single-unit recordings and decoding analysis reveal that neural populations in both mPFC and Re represent different social stimuli, however, mPFC coding capacity is stronger. We demonstrate that chemogenetic inhibitions of Re impair the mPFC-Re neural synchronization and the mPFC social coding. Projection pathway-specific inhibitions by optogenetics reveal that the reciprocal connectivity between the mPFC and the Re is necessary for social recognition. These results reveal an mPFC-thalamic circuit for social information processing.

Gamma-band-based dynamic functional connectivity in pigeon entopallium during sample presentation in a delayed color matching task

Birds have developed visual cognitions, especially in discriminating colors due to their four types of cones in the retina. The entopallium of birds is thought to be involved in the processing of color information during visual cognition. However, there is a lack of understanding about how functional connectivity in the entopallium region of birds changes during color cognition, which is related to various input colors. We therefore trained pigeons to perform a delayed color matching task, in which two colors were randomly presented in sample stimuli phrases, and the neural activity at individual recording site and the gamma band functional connectivity among local population in entopallium during sample presentation were analyzed. Both gamma band energy and gamma band functional connectivity presented dynamics as the stimulus was presented and persisted. The response features in the early-stimulus phase were significantly different from those of baseline and the late-stimulus phase. Furthermore, gamma band energy showed significant differences between different colors during the early-stimulus phase, but the global feature of the gamma band functional network did not. Further decoding results showed that decoding accuracy was significantly enhanced by adding functional connectivity features, suggesting the global feature of the gamma band functional network did not directly contain color information, but was related to it. These results provided insight into information processing rules among local neuronal populations in the entopallium of birds during color cognition, which is important for their daily life.

Selective chronic recording in small nerve fascicles of sciatic nerve with carbon nanotube yarns in rats

Objective. The primary challenge faced in the field of neural rehabilitation engineering is the limited advancement in nerve interface technology, which currently fails to match the mechanical properties of small-diameter nerve fascicles. Novel developments are necessary to enable long-term, chronic recording from a multitude of small fascicles, allowing for the recovery of motor intent and sensory signals.Approach. In this study, we analyze the chronic recording capabilities of carbon nanotube yarn electrodes in the peripheral somatic nervous system. The electrodes were surgically implanted in the sciatic nerve's three individual fascicles in rats, enabling the recording of neural activity during gait. Signal-to-noise ratio (SNR) and information theory were employed to analyze the data, demonstrating the superior recording capabilities of the electrodes. Flat interface nerve electrode and thin-film longitudinal intrafascicular electrode electrodes were used as a references to assess the results from SNR and information theory analysis.Main results. The electrodes exhibited the ability to record chronic signals with SNRs reaching as high as 15 dB, providing 12 bits of information for the sciatic nerve, a significant improvement over previous methods. Furthermore, the study revealed that the SNR and information content of the neural signals remained consistent over a period of 12 weeks across three different fascicles, indicating the stability of the interface. The signals recorded from these electrodes were also analyzed for selectivity using information theory metrics, which showed an information sharing of approximately 1.4 bits across the fascicles.Significance. The ability to safely and reliably record from multiple fascicles of different nerves simultaneously over extended periods of time holds substantial implications for the field of neural and rehabilitation engineering. This advancement addresses the limitation of current nerve interface technologies and opens up new possibilities for enhancing neural rehabilitation and control.

Awake ripples enhance emotional memory encoding in the human brain

Enhanced memory for emotional experiences is hypothesized to depend on amygdala-hippocampal interactions during memory consolidation. Here we show using intracranial recordings from the human amygdala and the hippocampus during an emotional memory encoding and discrimination task increased awake ripples after encoding of emotional, compared to neutrally-valenced stimuli. Further, post-encoding ripple-locked stimulus similarity is predictive of later memory discrimination. Ripple-locked stimulus similarity appears earlier in the amygdala than in hippocampus and mutual information analysis confirms amygdala influence on hippocampal activity. Finally, the joint ripple-locked stimulus similarity in the amygdala and hippocampus is predictive of correct memory discrimination. These findings provide electrophysiological evidence that post-encoding ripples enhance memory for emotional events.

NeuroDecodeR: a package for neural decoding in R

Neural decoding is a powerful method to analyze neural activity. However, the code needed to run a decoding analysis can be complex, which can present a barrier to using the method. In this paper we introduce a package that makes it easy to perform decoding analyses in the R programing language. We describe how the package is designed in a modular fashion which allows researchers to easily implement a range of different analyses. We also discuss how to format data to be able to use the package, and we give two examples of how to use the package to analyze real data. We believe that this package, combined with the rich data analysis ecosystem in R, will make it significantly easier for researchers to create reproducible decoding analyses, which should help increase the pace of neuroscience discoveries.

Stable coding of aversive associations in medial prefrontal populations

The medial prefrontal cortex (mPFC) is at the core of numerous psychiatric conditions, including fear and anxiety-related disorders. Whereas an abundance of evidence suggests a crucial role of the mPFC in regulating fear behaviour, the precise role of the mPFC in this process is not yet entirely clear. While studies at the single-cell level have demonstrated the involvement of this area in various aspects of fear processing, such as the encoding of threat-related cues and fear expression, an increasingly prevalent idea in the systems neuroscience field is that populations of neurons are, in fact, the essential unit of computation in many integrative brain regions such as prefrontal areas. What mPFC neuronal populations represent when we face threats? To address this question, we performed electrophysiological single-unit population recordings in the dorsal mPFC while mice faced threat-predicting cues eliciting defensive behaviours, and performed pharmacological and optogenetic inactivations of this area and the amygdala. Our data indicated that the presence of threat-predicting cues induces a stable coding dynamics of internally driven representations in the dorsal mPFC, necessary to drive learned defensive behaviours. Moreover, these neural population representations primary reflect learned associations rather than specific defensive behaviours, and the construct of such representations relies on the functional integrity of the amygdala.

Strength of predicted information content in the brain biases decision behavior

Prediction-for-perception theories suggest that the brain predicts incoming stimuli to facilitate their categorization.1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17 However, it remains unknown what the information contents of these predictions are, which hinders mechanistic explanations. This is because typical approaches cast predictions as an underconstrained contrast between two categories18,19,20,21,22,23,24-e.g., faces versus cars, which could lead to predictions of features specific to faces or cars, or features from both categories. Here, to pinpoint the information contents of predictions and thus their mechanistic processing in the brain, we identified the features that enable two different categorical perceptions of the same stimuli. We then trained multivariate classifiers to discern, from dynamic MEG brain responses, the features tied to each perception. With an auditory cueing design, we reveal where, when, and how the brain reactivates visual category features (versus the typical category contrast) before the stimulus is shown. We demonstrate that the predictions of category features have a more direct influence (bias) on subsequent decision behavior in participants than the typical category contrast. Specifically, these predictions are more precisely localized in the brain (lateralized), are more specifically driven by the auditory cues, and their reactivation strength before a stimulus presentation exerts a greater bias on how the individual participant later categorizes this stimulus. By characterizing the specific information contents that the brain predicts and then processes, our findings provide new insights into the brain's mechanisms of prediction for perception.

Thermal illusions for thermal displays: a review

Thermal illusions, a subset of haptic illusions, have historically faced technical challenges and limited exploration. They have been underutilized in prior studies related to thermal displays. This review paper primarily aims to comprehensively categorize thermal illusions, offering insights for diverse applications in thermal display design. Recent advancements in the field have spurred a fresh perspective on thermal and pain perception, specifically through the lens of thermal illusions.

Behavioural relevance of redundant and synergistic stimulus information between functionally connected neurons in mouse auditory cortex

Measures of functional connectivity have played a central role in advancing our understanding of how information is transmitted and processed within the brain. Traditionally, these studies have focused on identifying redundant functional connectivity, which involves determining when activity is similar across different sites or neurons. However, recent research has highlighted the importance of also identifying synergistic connectivity-that is, connectivity that gives rise to information not contained in either site or neuron alone. Here, we measured redundant and synergistic functional connectivity between neurons in the mouse primary auditory cortex during a sound discrimination task. Specifically, we measured directed functional connectivity between neurons simultaneously recorded with calcium imaging. We used Granger Causality as a functional connectivity measure. We then used Partial Information Decomposition to quantify the amount of redundant and synergistic information about the presented sound that is carried by functionally connected or functionally unconnected pairs of neurons. We found that functionally connected pairs present proportionally more redundant information and proportionally less synergistic information about sound than unconnected pairs, suggesting that their functional connectivity is primarily redundant. Further, synergy and redundancy coexisted both when mice made correct or incorrect perceptual discriminations. However, redundancy was much higher (both in absolute terms and in proportion to the total information available in neuron pairs) in correct behavioural choices compared to incorrect ones, whereas synergy was higher in absolute terms but lower in relative terms in correct than in incorrect behavioural choices. Moreover, the proportion of redundancy reliably predicted perceptual discriminations, with the proportion of synergy adding no extra predictive power. These results suggest a crucial contribution of redundancy to correct perceptual discriminations, possibly due to the advantage it offers for information propagation, and also suggest a role of synergy in enhancing information level during correct discriminations.

From neural noise to co-adaptability: Rethinking the multifaceted architecture of motor variability

In the last decade, the source and the functional meaning of motor variability have attracted considerable attention in behavioral and brain sciences. This construct classically combined different levels of description, variable internal robustness or coherence, and multifaceted operational meanings. We provide here a comprehensive review of the literature with the primary aim of building a precise lexicon that goes beyond the generic and monolithic use of motor variability. In the pars destruens of the work, we model three domains of motor variability related to peculiar computational elements that influence fluctuations in motor outputs. Each domain is in turn characterized by multiple sub-domains. We begin with the domains of noise and differentiation. However, the main contribution of our model concerns the domain of adaptability, which refers to variation within the same exact motor representation. In particular, we use the terms learning and (social)fitting to specify the portions of motor variability that depend on our propensity to learn and on our largely constitutive propensity to be influenced by external factors. A particular focus is on motor variability in the context of the sub-domain named co-adaptability. Further groundbreaking challenges arise in the modeling of motor variability. Therefore, in a separate pars construens, we attempt to characterize these challenges, addressing both theoretical and experimental aspects as well as potential clinical implications for neurorehabilitation. All in all, our work suggests that motor variability is neither simply detrimental nor beneficial, and that studying its fluctuations can provide meaningful insights for future research.

The effective enhancement of information in 3D small-world networks of biological neuronal cells

The cardiovascular system, the kidney, or the brain, are examples of complex systems - where the properties of the systems arise because of the layout of cells in those systems. One way to characterize systems is using networks, where elements and interactions of the systems are represented as nodes and links of a graph. Network's topology can be, in turn, measured by the small-world coefficient. Small world networks feature increased clustering and shorter paths compared to random or periodic networks of the same size. This suggests that systems with small world attributes can also efficiently transport signals, nutrients, or information within their body. While several reports in literature have illustrated that real biological systems are small-world, yet little is known about how information varies as a function of the small-world-ness (sw) of three dimensional graphs. Here, we used a model of the brain to estimate quantitatively the information processed in 3D networks. In the model, nodes of the graph are neuronal units capable to receive, integrate and transmit signals to other neurons of the system in parallel. The information encoded in the signals was then extracted using the techniques of information theory. In simulations where the topology of networks of400nodes was varied over large intervals, we found that in the0-9swrange information scales linearly with the small world coefficient, with a five-fold increase. Results of the paper and review of the existing literature on model organisms suggest that a small-world architecture may offer an evolutionary advantage to biological systems.

Phase information is conserved in sparse, synchronous population-rate-codes via phase-to-rate recoding

Neural computation is often traced in terms of either rate- or phase-codes. However, most circuit operations will simultaneously affect information across both coding schemes. It remains unclear how phase and rate coded information is transmitted, in the face of continuous modification at consecutive processing stages. Here, we study this question in the entorhinal cortex (EC)- dentate gyrus (DG)- CA3 system using three distinct computational models. We demonstrate that DG feedback inhibition leverages EC phase information to improve rate-coding, a computation we term phase-to-rate recoding. Our results suggest that it i) supports the conservation of phase information within sparse rate-codes and ii) enhances the efficiency of plasticity in downstream CA3 via increased synchrony. Given the ubiquity of both phase-coding and feedback circuits, our results raise the question whether phase-to-rate recoding is a recurring computational motif, which supports the generation of sparse, synchronous population-rate-codes in areas beyond the DG.

Neural signatures of natural behavior in socializing macaques

Our understanding of the neurobiology of primate behavior largely derives from artificial tasks in highly-controlled laboratory settings, overlooking most natural behaviors primate brains evolved to produce1. In particular, how primates navigate the multidimensional social relationships that structure daily life and shape survival and reproductive success remains largely unexplored at the single neuron level. Here, we combine ethological analysis with new wireless recording technologies to uncover neural signatures of natural behavior in unrestrained, socially interacting pairs of rhesus macaques within a larger colony. Population decoding of single neuron activity in prefrontal and temporal cortex unveiled robust encoding of 24 species-typical behaviors, which was strongly modulated by the presence and identity of surrounding monkeys. Male-female partners demonstrated near-perfect reciprocity in grooming, a key behavioral mechanism supporting friendships and alliances, and neural activity maintained a running account of these social investments. When confronted with an aggressive intruder, behavioral and neural population responses reflected empathy and were buffered by the presence of a partner. Surprisingly, neural signatures in prefrontal and temporal cortex were largely indistinguishable and irreducible to visual and motor contingencies. By employing an ethological approach to the study of primate neurobiology, we reveal a highly-distributed neurophysiological record of social dynamics, a potential computational foundation supporting communal life in primate societies, including our own.

A Novel Quantitative Metric Based on a Complete and Unique Characterization of Neural Network Activity: 4D Shannon's Entropy

The human brain comprises an intricate web of connections that generate complex neural networks capable of storing and processing information. This information depends on multiple factors, including underlying network structure, connectivity, and interactions; and thus, methods to characterize neural networks typically aim to unravel and interpret a combination of these factors. Here, we present four-dimensional (4D) Shannon's entropy, a novel quantitative metric of network activity based on the Triple Correlation Uniqueness (TCU) theorem. Triple correlation, which provides a complete and unique characterization of the network, relates three nodes separated by up to four spatiotemporal lags. Here, we evaluate the 4D entropy from the spatiotemporal lag probability distribution function (PDF) of the network activity's triple correlation. Given a spike raster, we compute triple correlation by iterating over time and space. Summing the contributions to the triple correlation over each of the spatial and temporal lag combinations generates a unique 4D spatiotemporal lag distribution, from which we estimate a PDF and compute Shannon's entropy. To outline our approach, we first compute 4D Shannon's entropy from feedforward motif-class patterns in a simulated spike raster. We then apply this methodology to spiking activity recorded from rat cortical cultures to compare our results to previously published results of pairwise (2D) correlated spectral entropy over time. We find that while first- and second-order metrics of activity (spike rate and cross-correlation) show agreement with previously published results, our 4D entropy computation (which also includes third-order interactions) reveals a greater depth of underlying network organization compared to published pairwise entropy. Ultimately, because our approach is based on the TCU, we propose that 4D Shannon's entropy is a more complete tool for neural network characterization.

Integration of landmark and saccade target signals in macaque frontal cortex visual responses

Visual landmarks influence spatial cognition and behavior, but their influence on visual codes for action is poorly understood. Here, we test landmark influence on the visual response to saccade targets recorded from 312 frontal and 256 supplementary eye field neurons in rhesus macaques. Visual response fields are characterized by recording neural responses to various target-landmark combinations, and then we test against several candidate spatial models. Overall, frontal/supplementary eye fields response fields preferentially code either saccade targets (40%/40%) or landmarks (30%/4.5%) in gaze fixation-centered coordinates, but most cells show multiplexed target-landmark coding within intermediate reference frames (between fixation-centered and landmark-centered). Further, these coding schemes interact: neurons with near-equal target and landmark coding show the biggest shift from fixation-centered toward landmark-centered target coding. These data show that landmark information is preserved and influences target coding in prefrontal visual responses, likely to stabilize movement goals in the presence of noisy egocentric signals.

Single neuron responses underlying face recognition in the human midfusiform face-selective cortex

Faces are critical for social interactions and their recognition constitutes one of the most important and challenging functions of the human brain. While neurons responding selectively to faces have been recorded for decades in the monkey brain, face-selective neural activations have been reported with neuroimaging primarily in the human midfusiform gyrus. Yet, the cellular mechanisms producing selective responses to faces in this hominoid neuroanatomical structure remain unknown. Here we report single neuron recordings performed in 5 human subjects (1 male, 4 females) implanted with intracerebral microelectrodes in the face-selective midfusiform gyrus, while they viewed pictures of familiar and unknown faces and places. We observed similar responses to faces and places at the single cell level, but a significantly higher number of neurons responding to faces, thus offering a mechanistic account for the face-selective activations observed in this region. Although individual neurons did not respond preferentially to familiar faces, a population level analysis could consistently determine whether or not the faces (but not the places) were familiar, only about 50 ms after the initial recognition of the stimuli as faces. These results provide insights into the neural mechanisms of face processing in the human brain.

Sequential sparse autoencoder for dynamic heading representation in ventral intraparietal area

To navigate in space, it is important to predict headings in real-time from neural responses in the brain to vestibular and visual signals, and the ventral intraparietal area (VIP) is one of the critical brain areas. However, it remains unexplored in the population level how the heading perception is represented in VIP. And there are no commonly used methods suitable for decoding the headings from the population responses in VIP, given the large spatiotemporal dynamics and heterogeneity in the neural responses. Here, responses were recorded from 210 VIP neurons in three rhesus monkeys when they were performing a heading perception task. And by specifically and separately modelling the both dynamics with sparse representation, we built a sequential sparse autoencoder (SSAE) to do the population decoding on the recorded dataset and tried to maximize the decoding performance. The SSAE relies on a three-layer sparse autoencoder to extract temporal and spatial heading features in the dataset via unsupervised learning, and a softmax classifier to decode the headings. Compared with other population decoding methods, the SSAE achieves a leading accuracy of 96.8% ± 2.1%, and shows the advantages of robustness, low storage and computing burden for real-time prediction. Therefore, our SSAE model performs well in learning neurobiologically plausible features comprising dynamic navigational information.