A Tutorial for Information Theory in Neuroscience

Symptom Network Analysis in a Large Sample of Children and Adults with a Chronic Tic Disorder

BACKGROUND

Chronic tic disorders (CTD) are multifaceted disorders characterized by multiple motor and/or vocal tics. They are often associated with complex tics including echophenomena, paliphenomena, and coprophenomena as well as psychiatric comorbidities such as attention deficit/hyperactivity disorder (ADHD) and obsessive-compulsive disorder (OCD).

OBJECTIVES

Our goal was to uncover the inter-relational structure of CTD and comorbid symptoms in children and adults and to understand changes in symptom structure across development.

METHODS

We used network and graph analyses to uncover the structure of association of symptoms in childhood/adolescence (n = 529) and adulthood (n = 503) and how this structure might change from childhood to adulthood, pinpointing core symptoms as a main target for interventions.

RESULTS

The analysis yielded core symptom networks in young and adult patients with CTD including complex tics and tic-related phenomena as well as touching people and objects. Core symptoms in childhood also included ADHD symptoms, whereas core symptoms in adults included symptoms of OCD instead. Interestingly, self-injurious behavior did not play a core role in the young CTD network, but became one of the central symptoms in adults with CDT. In addition, we found strong connections between complex motor and vocal tics as well as echolalia and echopraxia.

CONCLUSIONS

Next to other complex tics, echophenomena, paliphenomena, and coprophenomena can be regarded core symptoms of CTD. ADHD symptoms are closely related to CTD in childhood, whereas symptoms of OCD and self-injurious behavior are closely associated with CTD in adults. Our results suggest that a differentiation between motor and vocal tics is somewhat arbitrary.

On the higher-order smallest ring-star network of Chialvo neurons under diffusive couplings

Network dynamical systems with higher-order interactions are a current trending topic, pervasive in many applied fields. However, our focus in this work is neurodynamics. We numerically study the dynamics of the smallest higher-order network of neurons arranged in a ring-star topology. The dynamics of each node in this network is governed by the Chialvo neuron map, and they interact via linear diffusive couplings. This model is perceived to imitate the nonlinear dynamical properties exhibited by a realistic nervous system where the neurons transfer information through multi-body interactions. We deploy the higher-order coupling strength as the primary bifurcation parameter. We start by analyzing our model using standard tools from dynamical systems theory: fixed point analysis, Jacobian matrix, and bifurcation patterns. We observe the coexistence of disparate chaotic attractors. We also observe an interesting route to chaos from a fixed point via period-doubling and the appearance of cyclic quasiperiodic closed invariant curves. Furthermore, we numerically observe the existence of codimension-1 bifurcation points: saddle-node, period-doubling, and Neimark-Sacker. We also qualitatively study the typical phase portraits of the system, and numerically quantify chaos and complexity using the 0-1 test and sample entropy measure, respectively. Finally, we study the synchronization behavior among the neurons using the cross correlation coefficient and the Kuramoto order parameter. We conjecture that unfolding these patterns and behaviors of the network model will help us identify different states of the nervous system, further aiding us in dealing with various neural diseases and nervous disorders.

Response inhibition in premotor cortex corresponds to a complex reshuffle of the mesoscopic information network

Recent studies have explored functional and effective neural networks in animal models; however, the dynamics of information propagation among functional modules under cognitive control remain largely unknown. Here, we addressed the issue using transfer entropy and graph theory methods on mesoscopic neural activities recorded in the dorsal premotor cortex of rhesus monkeys. We focused our study on the decision time of a Stop-signal task, looking for patterns in the network configuration that could influence motor plan maturation when the Stop signal is provided. When comparing trials with successful inhibition to those with generated movement, the nodes of the network resulted organized into four clusters, hierarchically arranged, and distinctly involved in information transfer. Interestingly, the hierarchies and the strength of information transmission between clusters varied throughout the task, distinguishing between generated movements and canceled ones and corresponding to measurable levels of network complexity. Our results suggest a putative mechanism for motor inhibition in premotor cortex: a topological reshuffle of the information exchanged among ensembles of neurons.

Intracranial EEG signals disentangle multi-areal neural dynamics of vicarious pain perception

Empathy enables understanding and sharing of others' feelings. Human neuroimaging studies have identified critical brain regions supporting empathy for pain, including the anterior insula (AI), anterior cingulate (ACC), amygdala, and inferior frontal gyrus (IFG). However, to date, the precise spatio-temporal profiles of empathic neural responses and inter-regional communications remain elusive. Here, using intracranial electroencephalography, we investigated electrophysiological signatures of vicarious pain perception. Others' pain perception induced early increases in high-gamma activity in IFG, beta power increases in ACC, but decreased beta power in AI and amygdala. Vicarious pain perception also altered the beta-band-coordinated coupling between ACC, AI, and amygdala, as well as increased modulation of IFG high-gamma amplitudes by beta phases of amygdala/AI/ACC. We identified a necessary combination of neural features for decoding vicarious pain perception. These spatio-temporally specific regional activities and inter-regional interactions within the empathy network suggest a neurodynamic model of human pain empathy.

Emergence of input selective recurrent dynamics via information transfer maximization

Network structures of the brain have wiring patterns specialized for specific functions. These patterns are partially determined genetically or evolutionarily based on the type of task or stimulus. These wiring patterns are important in information processing; however, their organizational principles are not fully understood. This study frames the maximization of information transmission alongside the reduction of maintenance costs as a multi-objective optimization challenge, utilizing information theory and evolutionary computing algorithms with an emphasis on the visual system. The goal is to understand the underlying principles of circuit formation by exploring the patterns of wiring and information processing. The study demonstrates that efficient information transmission necessitates sparse circuits with internal modular structures featuring distinct wiring patterns. Significant trade-offs underscore the necessity of balance in wiring pattern development. The dynamics of effective circuits exhibit moderate flexibility in response to stimuli, in line with observations from prior visual system studies. Maximizing information transfer may allow for the self-organization of information processing functions similar to actual biological circuits, without being limited by modality. This study offers insights into neuroscience and the potential to improve reservoir computing performance.

Causal dynamics of sleep, circadian rhythm, and mood symptoms in patients with major depression and bipolar disorder: insights from longitudinal wearable device data

BACKGROUND

Sleep and circadian rhythm disruptions are common in patients with mood disorders. The intricate relationship between these disruptions and mood has been investigated, but their causal dynamics remain unknown.

METHODS

We analysed data from 139 patients (76 female, mean age = 23.5 ± 3.64 years) with mood disorders who participated in a prospective observational study in South Korea. The patients wore wearable devices to monitor sleep and engaged in smartphone-delivered ecological momentary assessment of mood symptoms. Using a mathematical model, we estimated their daily circadian phase based on sleep data. Subsequently, we obtained daily time series for sleep/circadian phase estimates and mood symptoms spanning >40,000 days. We analysed the causal relationship between the time series using transfer entropy, a non-linear causal inference method.

FINDINGS

The transfer entropy analysis suggested causality from circadian phase disturbance to mood symptoms in both patients with MDD (n = 45) and BD type I (n = 35), as 66.7% and 85.7% of the patients with a large dataset (>600 days) showed causality, but not in patients with BD type II (n = 59). Surprisingly, no causal relationship was suggested between sleep phase disturbances and mood symptoms.

INTERPRETATION

Our findings suggest that in patients with mood disorders, circadian phase disturbances directly precede mood symptoms. This underscores the potential of targeting circadian rhythms in digital medicine, such as sleep or light exposure interventions, to restore circadian phase and thereby manage mood disorders effectively.

FUNDING

Institute for Basic Science, the Human Frontiers Science Program Organization, the National Research Foundation of Korea, and the Ministry of Health & Welfare of South Korea.

On the Accurate Estimation of Information-Theoretic Quantities from Multi-Dimensional Sample Data

Using information-theoretic quantities in practical applications with continuous data is often hindered by the fact that probability density functions need to be estimated in higher dimensions, which can become unreliable or even computationally unfeasible. To make these useful quantities more accessible, alternative approaches such as binned frequencies using histograms and k-nearest neighbors (k-NN) have been proposed. However, a systematic comparison of the applicability of these methods has been lacking. We wish to fill this gap by comparing kernel-density-based estimation (KDE) with these two alternatives in carefully designed synthetic test cases. Specifically, we wish to estimate the information-theoretic quantities: entropy, Kullback-Leibler divergence, and mutual information, from sample data. As a reference, the results are compared to closed-form solutions or numerical integrals. We generate samples from distributions of various shapes in dimensions ranging from one to ten. We evaluate the estimators' performance as a function of sample size, distribution characteristics, and chosen hyperparameters. We further compare the required computation time and specific implementation challenges. Notably, k-NN estimation tends to outperform other methods, considering algorithmic implementation, computational efficiency, and estimation accuracy, especially with sufficient data. This study provides valuable insights into the strengths and limitations of the different estimation methods for information-theoretic quantities. It also highlights the significance of considering the characteristics of the data, as well as the targeted information-theoretic quantity when selecting an appropriate estimation technique. These findings will assist scientists and practitioners in choosing the most suitable method, considering their specific application and available data. We have collected the compared estimation methods in a ready-to-use open-source Python 3 toolbox and, thereby, hope to promote the use of information-theoretic quantities by researchers and practitioners to evaluate the information in data and models in various disciplines.

Information decomposition and the informational architecture of the brain

To explain how the brain orchestrates information-processing for cognition, we must understand information itself. Importantly, information is not a monolithic entity. Information decomposition techniques provide a way to split information into its constituent elements: unique, redundant, and synergistic information. We review how disentangling synergistic and redundant interactions is redefining our understanding of integrative brain function and its neural organisation. To explain how the brain navigates the trade-offs between redundancy and synergy, we review converging evidence integrating the structural, molecular, and functional underpinnings of synergy and redundancy; their roles in cognition and computation; and how they might arise over evolution and development. Overall, disentangling synergistic and redundant information provides a guiding principle for understanding the informational architecture of the brain and cognition.

Neural and behavioural state switching during hippocampal dentate spikes

Distinct brain and behavioural states are associated with organized neural population dynamics that are thought to serve specific cognitive functions1-3. Memory replay events, for example, occur during synchronous population events called sharp-wave ripples in the hippocampus while mice are in an 'offline' behavioural state, enabling cognitive mechanisms such as memory consolidation and planning4-11. But how does the brain re-engage with the external world during this behavioural state and permit access to current sensory information or promote new memory formation? Here we found that the hippocampal dentate spike, an understudied population event that frequently occurs between sharp-wave ripples12, may underlie such a mechanism. We show that dentate spikes are associated with distinctly elevated brain-wide firing rates, primarily observed in higher order networks, and couple to brief periods of arousal. Hippocampal place coding during dentate spikes aligns to the mouse's current spatial location, unlike the memory replay accompanying sharp-wave ripples. Furthermore, inhibiting neural activity during dentate spikes disrupts associative memory formation. Thus, dentate spikes represent a distinct brain state and support memory during non-locomotor behaviour, extending the repertoire of cognitive processes beyond the classical offline functions.

Speech perception difficulty modulates theta-band encoding of articulatory synergies

The human brain tracks available speech acoustics and extrapolates missing information such as the speaker's articulatory patterns. However, the extent to which articulatory reconstruction supports speech perception remains unclear. This study explores the relationship between articulatory reconstruction and task difficulty. Participants listened to sentences and performed a speech-rhyming task. Real kinematic data of the speaker's vocal tract were recorded via electromagnetic articulography (EMA) and aligned to corresponding acoustic outputs. We extracted articulatory synergies from the EMA data with principal component analysis (PCA) and employed partial information decomposition (PID) to separate the electroencephalographic (EEG) encoding of acoustic and articulatory features into unique, redundant, and synergistic atoms of information. We median-split sentences into easy (ES) and hard (HS) based on participants' performance and found that greater task difficulty involved greater encoding of unique articulatory information in the theta band. We conclude that fine-grained articulatory reconstruction plays a complementary role in the encoding of speech acoustics, lending further support to the claim that motor processes support speech perception.NEW & NOTEWORTHY Top-down processes originating from the motor system contribute to speech perception through the reconstruction of the speaker's articulatory movement. This study investigates the role of such articulatory simulation under variable task difficulty. We show that more challenging listening tasks lead to increased encoding of articulatory kinematics in the theta band and suggest that, in such situations, fine-grained articulatory reconstruction complements acoustic encoding.

Representation of Natural Contours by a Neural Population in Monkey V4

The cortical visual area, V4, has been considered to code contours that contribute to the intermediate-level representation of objects. The neural responses to the complex contour features intrinsic to natural contours are expected to clarify the essence of the representation. To approach the cortical coding of natural contours, we investigated the simultaneous coding of multiple contour features in monkey (Macaca fuscata) V4 neurons and their population-level representation. A substantial number of neurons showed significant tuning for two or more features such as curvature and closure, indicating that a substantial number of V4 neurons simultaneously code multiple contour features. A large portion of the neurons responded vigorously to acutely curved contours that surrounded the center of classical receptive field, suggesting that V4 neurons tend to code prominent features of object contours. The analysis of mutual information (MI) between the neural responses and each contour feature showed that most neurons exhibited similar magnitudes for each type of MI, indicating that many neurons showing the responses depended on multiple contour features. We next examined the population-level representation by using multidimensional scaling analysis. The neural preferences to the multiple contour features and that to natural stimuli compared with silhouette stimuli increased along with the primary and secondary axes, respectively, indicating the contribution of the multiple contour features and surface textures in the population responses. Our analyses suggested that V4 neurons simultaneously code multiple contour features in natural images and represent contour and surface properties in population.

Robust and consistent measures of pattern separation based on information theory and demonstrated in the dentate gyrus

Pattern separation is a valuable computational function performed by neuronal circuits, such as the dentate gyrus, where dissimilarity between inputs is increased, reducing noise and increasing the storage capacity of downstream networks. Pattern separation is studied from both in vivo experimental and computational perspectives and, a number of different measures (such as orthogonalisation, decorrelation, or spike train distance) have been applied to quantify the process of pattern separation. However, these are known to give conclusions that can differ qualitatively depending on the choice of measure and the parameters used to calculate it. We here demonstrate that arbitrarily increasing sparsity, a noticeable feature of dentate granule cell firing and one that is believed to be key to pattern separation, typically leads to improved classical measures for pattern separation even, inappropriately, up to the point where almost all information about the inputs is lost. Standard measures therefore both cannot differentiate between pattern separation and pattern destruction, and give results that may depend on arbitrary parameter choices. We propose that techniques from information theory, in particular mutual information, transfer entropy, and redundancy, should be applied to penalise the potential for lost information (often due to increased sparsity) that is neglected by existing measures. We compare five commonly-used measures of pattern separation with three novel techniques based on information theory, showing that the latter can be applied in a principled way and provide a robust and reliable measure for comparing the pattern separation performance of different neurons and networks. We demonstrate our new measures on detailed compartmental models of individual dentate granule cells and a dentate microcircuit, and show how structural changes associated with epilepsy affect pattern separation performance. We also demonstrate how our measures of pattern separation can predict pattern completion accuracy. Overall, our measures solve a widely acknowledged problem in assessing the pattern separation of neural circuits such as the dentate gyrus, as well as the cerebellum and mushroom body. Finally we provide a publicly available toolbox allowing for easy analysis of pattern separation in spike train ensembles.

Acetylcholine modulates the precision of prediction error in the auditory cortex

A fundamental property of sensory systems is their ability to detect novel stimuli in the ambient environment. The auditory brain contains neurons that decrease their response to repetitive sounds but increase their firing rate to novel or deviant stimuli; the difference between both responses is known as stimulus-specific adaptation or neuronal mismatch (nMM). Here, we tested the effect of microiontophoretic applications of ACh on the neuronal responses in the auditory cortex (AC) of anesthetized rats during an auditory oddball paradigm, including cascade controls. Results indicate that ACh modulates the nMM, affecting prediction error responses but not repetition suppression, and this effect is manifested predominantly in infragranular cortical layers. The differential effect of ACh on responses to standards, relative to deviants (in terms of averages and variances), was consistent with the representational sharpening that accompanies an increase in the precision of prediction errors. These findings suggest that ACh plays an important role in modulating prediction error signaling in the AC and gating the access of these signals to higher cognitive levels.

Selective chronic recording in small nerve fascicles of sciatic nerve with carbon nanotube yarns in rats

Objective. The primary challenge faced in the field of neural rehabilitation engineering is the limited advancement in nerve interface technology, which currently fails to match the mechanical properties of small-diameter nerve fascicles. Novel developments are necessary to enable long-term, chronic recording from a multitude of small fascicles, allowing for the recovery of motor intent and sensory signals.Approach. In this study, we analyze the chronic recording capabilities of carbon nanotube yarn electrodes in the peripheral somatic nervous system. The electrodes were surgically implanted in the sciatic nerve's three individual fascicles in rats, enabling the recording of neural activity during gait. Signal-to-noise ratio (SNR) and information theory were employed to analyze the data, demonstrating the superior recording capabilities of the electrodes. Flat interface nerve electrode and thin-film longitudinal intrafascicular electrode electrodes were used as a references to assess the results from SNR and information theory analysis.Main results. The electrodes exhibited the ability to record chronic signals with SNRs reaching as high as 15 dB, providing 12 bits of information for the sciatic nerve, a significant improvement over previous methods. Furthermore, the study revealed that the SNR and information content of the neural signals remained consistent over a period of 12 weeks across three different fascicles, indicating the stability of the interface. The signals recorded from these electrodes were also analyzed for selectivity using information theory metrics, which showed an information sharing of approximately 1.4 bits across the fascicles.Significance. The ability to safely and reliably record from multiple fascicles of different nerves simultaneously over extended periods of time holds substantial implications for the field of neural and rehabilitation engineering. This advancement addresses the limitation of current nerve interface technologies and opens up new possibilities for enhancing neural rehabilitation and control.

Evidence for increased parallel information transmission in human brain networks compared to macaques and male mice

Brain communication, defined as information transmission through white-matter connections, is at the foundation of the brain's computational capacities that subtend almost all aspects of behavior: from sensory perception shared across mammalian species, to complex cognitive functions in humans. How did communication strategies in macroscale brain networks adapt across evolution to accomplish increasingly complex functions? By applying a graph- and information-theory approach to assess information-related pathways in male mouse, macaque and human brains, we show a brain communication gap between selective information transmission in non-human mammals, where brain regions share information through single polysynaptic pathways, and parallel information transmission in humans, where regions share information through multiple parallel pathways. In humans, parallel transmission acts as a major connector between unimodal and transmodal systems. The layout of information-related pathways is unique to individuals across different mammalian species, pointing at the individual-level specificity of information routing architecture. Our work provides evidence that different communication patterns are tied to the evolution of mammalian brain networks.

Increased noise relates to abnormal excitation-inhibition balance in schizophrenia: a combined empirical and computational study

Electroencephalography studies link sensory processing issues in schizophrenia to increased noise level-noise here is background spontaneous activity-as measured by the signal-to-noise ratio. The mechanism, however, of such increased noise is unknown. We investigate if this relates to changes in cortical excitation-inhibition balance, which has been observed to be atypical in schizophrenia, by combining electroencephalography and computational modeling. Our electroencephalography task results, for which the local field potentials can be used as a proxy, show lower signal-to-noise ratio due to higher noise in schizophrenia. Both electroencephalography rest and task states exhibit higher levels of excitation in the functional excitation-inhibition (as a proxy of excitation-inhibition balance). This suggests a relationship between increased noise and atypical excitation in schizophrenia, which was addressed by using computational modeling. A Leaky Integrate-and-Fire model was used to simulate the effects of varying degrees of noise on excitation-inhibition balance, local field potential, NMDA current, and . Results show a noise-related increase in the local field potential, excitation in excitation-inhibition balance, pyramidal NMDA current, and spike rate. Mutual information and mediation analysis were used to explore a cross-level relationship, showing that the cortical local field potential plays a key role in transferring the effect of noise to the cellular population level of NMDA.

Neural decoding reveals specialized kinematic tuning after an abrupt cortical transition

The primary motor cortex (M1) exhibits a protracted period of development, including the development of a sensory representation long before motor outflow emerges. In rats, this representation is present by postnatal day (P) 8, when M1 activity is "discontinuous." Here, we ask how the representation changes upon the transition to "continuous" activity at P12. We use neural decoding to predict forelimb movements from M1 activity and show that a linear decoder effectively predicts limb movements at P8 but not at P12; instead, a nonlinear decoder better predicts limb movements at P12. The altered decoder performance reflects increased complexity and uniqueness of kinematic information in M1. We next show that M1's representation at P12 is more susceptible to "lesioning" of inputs and "transplanting" of M1's encoding scheme from one pup to another. Thus, the emergence of continuous M1 activity signals the developmental onset of more complex, informationally sparse, and individualized sensory representations.

The QBIT theory of consciousness: Entropy and qualia

The QBIT theory is a recently introduced multi-disciplinary approach to the problem of consciousness. One of the main axioms of the theory is that when information-theoretic certainty of an observer about a stimulus goes beyond a certain threshold, the observer becomes conscious of that stimulus. This axiom could provide an explanation for how the brain generates consciousness.In short, the QBIT theory suggests that the brain generates consciousness by reducing the entropy of its internal representations below a critical threshold. This paper explains how the brain gradually minimizes the entropy of its internal representations and consequently generate minimum-entropy representations (also known as conscious representations or qualia). The paper also explores the consequences of this entropy-minimization process in the context of quantum information theory.

Mutual Information between EDA and EEG in Multiple Cognitive Tasks and Sleep Deprivation Conditions

Sleep deprivation, a widespread phenomenon that affects one-third of normal American adults, induces adverse changes in physical and cognitive performance, which in turn increases the occurrence of accidents. Sleep deprivation is known to increase resting blood pressure and decrease muscle sympathetic nerve activity. Monitoring changes in the interplay between the central and autonomic sympathetic nervous system can be a potential indicator of human's readiness to perform tasks that involve a certain level of cognitive load (e.g., driving). The electroencephalogram (EEG) is the standard to assess the brain's activity. The electrodermal activity (EDA) is a reflection of the general state of arousal regulated by the activation of the sympathetic nervous system through sweat gland stimulation. In this work, we calculated the mutual information between EDA and EEG recordings in order to consider linear and non-linear interactions and provide an insight of the relationship between brain activity and peripheral autonomic sympathetic activity. We analyzed EEG and EDA data from ten participants performing four cognitive tasks every two hours during 24 h (12 trials). We decomposed EEG data into delta, theta, alpha, beta, and gamma spectral components, and EDA into tonic and phasic components. The results demonstrate high values of mutual information between the EDA and delta component of EEG, mainly in working memory tasks. Additionally, we found an increase in the theta component of EEG in the presence of fatigue caused by sleep deprivation, the alpha component in tasks demanding inhibition and attention, and the delta component in working memory tasks. In terms of the location of brain activity, most of the tasks report high mutual information in frontal regions in the initial trials, with a trend to decrease and become uniform for all the nine analyzed EEG channels as a consequence of the sleep deprivation effect. Our results evidence the interplay between central and sympathetic nervous activity and can be used to mitigate the consequences of sleep deprivation.

Accurately predicting hit songs using neurophysiology and machine learning

Identifying hit songs is notoriously difficult. Traditionally, song elements have been measured from large databases to identify the lyrical aspects of hits. We took a different methodological approach, measuring neurophysiologic responses to a set of songs provided by a streaming music service that identified hits and flops. We compared several statistical approaches to examine the predictive accuracy of each technique. A linear statistical model using two neural measures identified hits with 69% accuracy. Then, we created a synthetic set data and applied ensemble machine learning to capture inherent non-linearities in neural data. This model classified hit songs with 97% accuracy. Applying machine learning to the neural response to 1st min of songs accurately classified hits 82% of the time showing that the brain rapidly identifies hit music. Our results demonstrate that applying machine learning to neural data can substantially increase classification accuracy for difficult to predict market outcomes.

Quantifying evoked responses through information-theoretical measures

Information theory is a viable candidate to advance our understanding of how the brain processes information generated in the internal or external environment. With its universal applicability, information theory enables the analysis of complex data sets, is free of requirements about the data structure, and can help infer the underlying brain mechanisms. Information-theoretical metrics such as Entropy or Mutual Information have been highly beneficial for analyzing neurophysiological recordings. However, a direct comparison of the performance of these methods with well-established metrics, such as the t-test, is rare. Here, such a comparison is carried out by evaluating the novel method of Encoded Information with Mutual Information, Gaussian Copula Mutual Information, Neural Frequency Tagging, and t-test. We do so by applying each method to event-related potentials and event-related activity in different frequency bands originating from intracranial electroencephalography recordings of humans and marmoset monkeys. Encoded Information is a novel procedure that assesses the similarity of brain responses across experimental conditions by compressing the respective signals. Such an information-based encoding is attractive whenever one is interested in detecting where in the brain condition effects are present.

Neural activity during monkey vehicular wayfinding

Navigation gets us from place to place, creating a path to arrive at a goal. We trained a monkey to steer a motorized cart in a large room, beginning at its trial-by-trial start location and ending at a trial-by-trial cued goal location. While the monkey steered its autonomously chosen path to its goal, we recorded neural activity simultaneously in both the hippocampus (HPC) and medial superior temporal (MST) cortex. Local field potentials (LFPs) in these sites show similar patterns of activity with the 15-30 Hz band highlighting specific room locations. In contrast, 30-100 Hz LFPs support a unified map of the behaviorally relevant start and goal locations. The single neuron responses (SNRs) do not substantially contribute to room or start-goal maps. Rather, the SNRs form a continuum from neurons that are most active when the monkey is moving on a path toward the goal, versus other neurons that are most active when the monkey deviates from paths toward the goal. Granger analyses suggest that HPC firing precedes MST firing during cueing at the trial start location, mainly mediated by off-path neurons. In contrast, MST precedes HPC firing during steering, mainly mediated by on-path neurons. Interactions between MST and HPC are mediated by the parallel activation of on-path and off-path neurons, selectively activated across stages of this wayfinding task.

Detecting Information Relays in Deep Neural Networks

Deep learning of artificial neural networks (ANNs) is creating highly functional processes that are, unfortunately, nearly as hard to interpret as their biological counterparts. Identification of functional modules in natural brains plays an important role in cognitive and neuroscience alike, and can be carried out using a wide range of technologies such as fMRI, EEG/ERP, MEG, or calcium imaging. However, we do not have such robust methods at our disposal when it comes to understanding functional modules in artificial neural networks. Ideally, understanding which parts of an artificial neural network perform what function might help us to address a number of vexing problems in ANN research, such as catastrophic forgetting and overfitting. Furthermore, revealing a network's modularity could improve our trust in them by making these black boxes more transparent. Here, we introduce a new information-theoretic concept that proves useful in understanding and analyzing a network's functional modularity: the relay information IR. The relay information measures how much information groups of neurons that participate in a particular function (modules) relay from inputs to outputs. Combined with a greedy search algorithm, relay information can be used to identify computational modules in neural networks. We also show that the functionality of modules correlates with the amount of relay information they carry.

Functional duality in group criticality via ambiguous interactions

Critical phenomena are wildly observed in living systems. If the system is at criticality, it can quickly transfer information and achieve optimal response to external stimuli. Especially, animal collective behavior has numerous critical properties, which are related to other research regions, such as the brain system. Although the critical phenomena influencing collective behavior have been extensively studied, two important aspects require clarification. First, these critical phenomena never occur on a single scale but are instead nested from the micro- to macro-levels (e.g., from a Lévy walk to scale-free correlation). Second, the functional role of group criticality is unclear. To elucidate these aspects, the ambiguous interaction model is constructed in this study; this model has a common framework and is a natural extension of previous representative models (such as the Boids and Vicsek models). We demonstrate that our model can explain the nested criticality of collective behavior across several scales (considering scale-free correlation, super diffusion, Lévy walks, and 1/f fluctuation for relative velocities). Our model can also explain the relationship between scale-free correlation and group turns. To examine this relation, we propose a new method, applying partial information decomposition (PID) to two scale-free induced subgroups. Using PID, we construct information flows between two scale-free induced subgroups and find that coupling of the group morphology (i.e., the velocity distributions) and its fluctuation power (i.e., the fluctuation distributions) likely enable rapid group turning. Thus, the flock morphology may help its internal fluctuation convert to dynamic behavior. Our result sheds new light on the role of group morphology, which is relatively unheeded, retaining the importance of fluctuation dynamics in group criticality.

Cortical Representation of Movement Across the Developmental Transition to Continuous Neural Activity

Primary motor cortex (M1) exhibits a protracted period of development that includes the establishment of a somatosensory map long before motor outflow emerges. In rats, the sensory representation is established by postnatal day (P) 8 when cortical activity is still "discontinuous." Here, we ask how the representation survives the sudden transition to noisy "continuous" activity at P12. Using neural decoding to predict forelimb movements based solely on M1 activity, we show that a linear decoder is sufficient to predict limb movements at P8, but not at P12; in contrast, a nonlinear decoder effectively predicts limb movements at P12. The change in decoder performance at P12 reflects an increase in both the complexity and uniqueness of kinematic information available in M1. We next show that the representation at P12 is more susceptible to the deleterious effects of "lesioning" inputs and to "transplanting" M1's encoding scheme from one pup to another. We conclude that the emergence of continuous cortical activity signals the developmental onset in M1 of more complex, informationally sparse, and individualized sensory representations.

Differential processing of decision information in subregions of rodent medial prefrontal cortex

Decision-making involves multiple cognitive processes requiring different aspects of information about the situation at hand. The rodent medial prefrontal cortex (mPFC) has been hypothesized to be central to these abilities. Functional studies have sought to link specific processes to specific anatomical subregions, but past studies of mPFC have yielded controversial results, leaving the precise nature of mPFC function unclear. To settle this debate, we recorded from the full dorso-ventral extent of mPFC in each of 8 rats, as they performed a complex economic decision task. These data revealed four distinct functional domains within mPFC that closely mirrored anatomically identified subregions, including novel evidence to divide prelimbic cortex into dorsal and ventral components. We found that dorsal aspects of mPFC (ACC, dPL) were more involved in processing information about active decisions, while ventral aspects (vPL, IL) were more engaged in motivational factors.

Information-processing dynamics in neural networks of macaque cerebral cortex reflect cognitive state and behavior

One of the essential functions of biological neural networks is the processing of information. This includes everything from processing sensory information to perceive the environment, up to processing motor information to interact with the environment. Due to methodological limitations, it has been historically unclear how information processing changes during different cognitive or behavioral states and to what extent information is processed within or between the network of neurons in different brain areas. In this study, we leverage recent advances in the calculation of information dynamics to explore neural-level processing within and between the frontoparietal areas AIP, F5, and M1 during a delayed grasping task performed by three macaque monkeys. While information processing was high within all areas during all cognitive and behavioral states of the task, interareal processing varied widely: During visuomotor transformation, AIP and F5 formed a reciprocally connected processing unit, while no processing was present between areas during the memory period. Movement execution was processed globally across all areas with predominance of processing in the feedback direction. Furthermore, the fine-scale network structure reconfigured at the neuron level in response to different grasping conditions, despite no differences in the overall amount of information present. These results suggest that areas dynamically form higher-order processing units according to the cognitive or behavioral demand and that the information-processing network is hierarchically organized at the neuron level, with the coarse network structure determining the behavioral state and finer changes reflecting different conditions.

PLD3 affects axonal spheroids and network defects in Alzheimer's disease

The precise mechanisms that lead to cognitive decline in Alzheimer's disease are unknown. Here we identify amyloid-plaque-associated axonal spheroids as prominent contributors to neural network dysfunction. Using intravital calcium and voltage imaging, we show that a mouse model of Alzheimer's disease demonstrates severe disruption in long-range axonal connectivity. This disruption is caused by action-potential conduction blockades due to enlarging spheroids acting as electric current sinks in a size-dependent manner. Spheroid growth was associated with an age-dependent accumulation of large endolysosomal vesicles and was mechanistically linked with Pld3-a potential Alzheimer's-disease-associated risk gene¹ that encodes a lysosomal protein^2,3 that is highly enriched in axonal spheroids. Neuronal overexpression of Pld3 led to endolysosomal vesicle accumulation and spheroid enlargement, which worsened axonal conduction blockades. By contrast, Pld3 deletion reduced endolysosomal vesicle and spheroid size, leading to improved electrical conduction and neural network function. Thus, targeted modulation of endolysosomal biogenesis in neurons could potentially reverse axonal spheroid-induced neural circuit abnormalities in Alzheimer's disease, independent of amyloid removal.

Differences in the spatial fidelity of evoked and spontaneous signals in the degenerating retina

Vision restoration strategies aim to reestablish vision by replacing the function of lost photoreceptors with optoelectronic hardware or through gene therapy. One complication to these approaches is that retinal circuitry undergoes remodeling after photoreceptor loss. Circuit remodeling following perturbation is ubiquitous in the nervous system and understanding these changes is crucial for treating neurodegeneration. Spontaneous oscillations that arise during retinal degeneration have been well-studied, however, other changes in the spatiotemporal processing of evoked and spontaneous activity have received less attention. Here we use subretinal electrical stimulation to measure the spatial and temporal spread of both spontaneous and evoked activity during retinal degeneration. We found that electrical stimulation synchronizes spontaneous oscillatory activity, over space and through time, thus leading to increased correlations in ganglion cell activity. Intriguingly, we found that spatial selectivity was maintained in rd10 retina for evoked responses, with spatial receptive fields comparable to wt retina. These findings indicate that different biophysical mechanisms are involved in mediating feed forward excitation, and the lateral spread of spontaneous activity in the rd10 retina, lending support toward the possibility of high-resolution vision restoration.

Cortical Pyramidal and Parvalbumin Cells Exhibit Distinct Spatiotemporal Extracellular Electric Potentials

Brain circuits are composed of diverse cell types with distinct morphologies, connections, and distributions of ion channels. Modeling suggests that the spatial distribution of the extracellular voltage during a spike depends on cellular morphology, connectivity, and identity. However, experimental evidence from the intact brain is lacking. Here, we combined high-density recordings from hippocampal region CA1 and neocortex of freely moving mice with optogenetic tagging of parvalbumin-immunoreactive (PV) cells. We used ground truth tagging of the recorded pyramidal cells (PYR) and PV cells to construct binary classification models. Features derived from single-channel waveforms or from spike timing alone allowed near-perfect classification of PYR and PV cells. To determine whether there is unique information in the spatial distribution of the extracellular potentials, we removed all single-channel waveform information from the multichannel waveforms using an event-based delta-transformation. We found that spatiotemporal features derived from the transformed waveforms yield accurate classification. The extracellular analog of the spatial distribution of the initial depolarization phase provided the highest contribution to the spatially based prediction. Compared with PV cell spikes, PYR spikes exhibited higher spatial synchrony at the beginning of the extracellular spike and lower synchrony at the trough. The successful classification of PYR and PV cells based on purely spatial features provides direct experimental evidence that spikes of distinct cell types are associated with distinct spatial distributions of extracellular potentials.

Synaptic alterations in visual cortex reshape contrast-dependent gamma oscillations and inhibition-excitation ratio in a genetic mouse model of migraine

Background

Migraine affects a significant fraction of the world population, yet its etiology is not completely understood. In vitro results highlighted thalamocortical and intra-cortical glutamatergic synaptic gain-of-function associated with a monogenic form of migraine (familial-hemiplegic-migraine-type-1: FHM1). However, how these alterations reverberate on cortical activity remains unclear. As altered responsivity to visual stimuli and abnormal processing of visual sensory information are common hallmarks of migraine, herein we investigated the effects of FHM1-driven synaptic alterations in the visual cortex of awake mice.

Methods

We recorded extracellular field potentials from the primary visual cortex (V1) of head-fixed awake FHM1 knock-in (n = 12) and wild type (n = 12) mice in response to square-wave gratings with different visual contrasts. Additionally, we reproduced in silico the obtained experimental results with a novel spiking neurons network model of mouse V1, by implementing in the model both the synaptic alterations characterizing the FHM1 genetic mouse model adopted.

Results

FHM1 mice displayed similar amplitude but slower temporal evolution of visual evoked potentials. Visual contrast stimuli induced a lower increase of multi-unit activity in FHM1 mice, while the amount of information content about contrast level remained, however, similar to WT.

Spectral analysis of the local field potentials revealed an increase in the β/low γ range of WT mice following the abrupt reversal of contrast gratings. Such frequency range transitioned to the high γ range in FHM1 mice. Despite this change in the encoding channel, these oscillations preserved the amount of information conveyed about visual contrast. The computational model showed how these network effects may arise from a combination of changes in thalamocortical and intra-cortical synaptic transmission, with the former inducing a lower cortical activity and the latter inducing the higher frequencies ɣ oscillations.

Conclusions

Contrast-driven ɣ modulation in V1 activity occurs at a much higher frequency in FHM1. This is likely to play a role in the altered processing of visual information. Computational studies suggest that this shift is specifically due to enhanced cortical excitatory transmission. Our network model can help to shed light on the relationship between cellular and network levels of migraine neural alterations.

Graphical Abstract

Supplementary Information

The online version contains supplementary material available at 10.1186/s10194-022-01495-9.

Neural synchronization is strongest to the spectral flux of slow music and depends on familiarity and beat salience

Neural activity in the auditory system synchronizes to sound rhythms, and brain-environment synchronization is thought to be fundamental to successful auditory perception. Sound rhythms are often operationalized in terms of the sound's amplitude envelope. We hypothesized that - especially for music - the envelope might not best capture the complex spectro-temporal fluctuations that give rise to beat perception and synchronized neural activity. This study investigated (1) neural synchronization to different musical features, (2) tempo-dependence of neural synchronization, and (3) dependence of synchronization on familiarity, enjoyment, and ease of beat perception. In this electroencephalography study, 37 human participants listened to tempo-modulated music (1-4 Hz). Independent of whether the analysis approach was based on temporal response functions (TRFs) or reliable components analysis (RCA), the spectral flux of music - as opposed to the amplitude envelope - evoked strongest neural synchronization. Moreover, music with slower beat rates, high familiarity, and easy-to-perceive beats elicited the strongest neural response. Our results demonstrate the importance of spectro-temporal fluctuations in music for driving neural synchronization, and highlight its sensitivity to musical tempo, familiarity, and beat salience.

Neural Information Processing and Computations of Two-Input Synapses

Information processing in artificial neural networks is largely dependent on the nature of neuron models. While commonly used models are designed for linear integration of synaptic inputs, accumulating experimental evidence suggests that biological neurons are capable of nonlinear computations for many converging synaptic inputs via homo- and heterosynaptic mechanisms. This nonlinear neuronal computation may play an important role in complex information processing at the neural circuit level. Here we characterize the dynamics and coding properties of neuron models on synaptic transmissions delivered from two hidden states. The neuronal information processing is influenced by the cooperative and competitive interactions among synapses and the coherence of the hidden states. Furthermore, we demonstrate that neuronal information processing under two-input synaptic transmission can be mapped to linearly nonseparable XOR as well as basic AND/OR operations. In particular, the mixtures of linear and nonlinear neuron models outperform the fashion-MNIST test compared to the neural networks consisting of only one type. This study provides a computational framework for assessing information processing of neuron and synapse models that may be beneficial for the design of brain-inspired artificial intelligence algorithms and neuromorphic systems.

A Comparison of Partial Information Decompositions Using Data from Real and Simulated Layer 5b Pyramidal Cells

Partial information decomposition allows the joint mutual information between an output and a set of inputs to be divided into components that are synergistic or shared or unique to each input. We consider five different decompositions and compare their results using data from layer 5b pyramidal cells in two different studies. The first study was on the amplification of somatic action potential output by apical dendritic input and its regulation by dendritic inhibition. We find that two of the decompositions produce much larger estimates of synergy and shared information than the others, as well as large levels of unique misinformation. When within-neuron differences in the components are examined, the five methods produce more similar results for all but the shared information component, for which two methods produce a different statistical conclusion from the others. There are some differences in the expression of unique information asymmetry among the methods. It is significantly larger, on average, under dendritic inhibition. Three of the methods support a previous conclusion that apical amplification is reduced by dendritic inhibition. The second study used a detailed compartmental model to produce action potentials for many combinations of the numbers of basal and apical synaptic inputs. Decompositions of the entire data set produce similar differences to those in the first study. Two analyses of decompositions are conducted on subsets of the data. In the first, the decompositions reveal a bifurcation in unique information asymmetry. For three of the methods, this suggests that apical drive switches to basal drive as the strength of the basal input increases, while the other two show changing mixtures of information and misinformation. Decompositions produced using the second set of subsets show that all five decompositions provide support for properties of cooperative context-sensitivity—to varying extents.

Multimodal perception links cellular state to decision making in single cells

Individual cells take decisions that are adapted to their internal state and surroundings, but how cells can reliably do this remains unclear. Using multiplexed quantification of signaling responses and markers of the cellular state, we find that signaling nodes in a network display adaptive information processing, which leads to heterogeneous growth factor responses and enables nodes to capture partially non-redundant information about the cellular state. Collectively, as a multimodal percept, this gives individual cells a large information processing capacity to accurately place growth factor concentration within the context of their cellular state and make cellular state-dependent decisions. We propose that heterogeneity and complexity in signaling networks have co-evolved to enable specific and context-aware cellular decision making in a multicellular setting.

Greater than the parts: a review of the information decomposition approach to causal emergence

Emergence is a profound subject that straddles many scientific disciplines, including the formation of galaxies and how consciousness arises from the collective activity of neurons. Despite the broad interest that exists on this concept, the study of emergence has suffered from a lack of formalisms that could be used to guide discussions and advance theories. Here, we summarize, elaborate on, and extend a recent formal theory of causal emergence based on information decomposition, which is quantifiable and amenable to empirical testing. This theory relates emergence with information about a system's temporal evolution that cannot be obtained from the parts of the system separately. This article provides an accessible but rigorous introduction to the framework, discussing the merits of the approach in various scenarios of interest. We also discuss several interpretation issues and potential misunderstandings, while highlighting the distinctive benefits of this formalism. This article is part of the theme issue 'Emergent phenomena in complex physical and socio-technical systems: from cells to societies'.

Compulsive alcohol drinking in rodents is associated with altered representations of behavioral control and seeking in dorsal medial prefrontal cortex

A key feature of compulsive alcohol drinking is continuing to drink despite negative consequences. To examine the changes in neural activity that underlie this behavior, compulsive alcohol drinking was assessed in a validated rodent model of heritable risk for excessive drinking (alcohol preferring (P) rats). Neural activity was measured in dorsal medial prefrontal cortex (dmPFC-a brain region involved in maladaptive decision-making) and assessed via change point analyses and novel principal component analyses. Neural population representations of specific decision-making variables were measured to determine how they were altered in animals that drink alcohol compulsively. Compulsive animals showed weakened representations of behavioral control signals, but strengthened representations of alcohol seeking-related signals. Finally, chemogenetic-based excitation of dmPFC prevented escalation of compulsive alcohol drinking. Collectively, these data indicate that compulsive alcohol drinking in rats is associated with alterations in dmPFC neural activity that underlie diminished behavioral control and enhanced seeking.

Revealing the Dynamics of Neural Information Processing with Multivariate Information Decomposition

The varied cognitive abilities and rich adaptive behaviors enabled by the animal nervous system are often described in terms of information processing. This framing raises the issue of how biological neural circuits actually process information, and some of the most fundamental outstanding questions in neuroscience center on understanding the mechanisms of neural information processing. Classical information theory has long been understood to be a natural framework within which information processing can be understood, and recent advances in the field of multivariate information theory offer new insights into the structure of computation in complex systems. In this review, we provide an introduction to the conceptual and practical issues associated with using multivariate information theory to analyze information processing in neural circuits, as well as discussing recent empirical work in this vein. Specifically, we provide an accessible introduction to the partial information decomposition (PID) framework. PID reveals redundant, unique, and synergistic modes by which neurons integrate information from multiple sources. We focus particularly on the synergistic mode, which quantifies the "higher-order" information carried in the patterns of multiple inputs and is not reducible to input from any single source. Recent work in a variety of model systems has revealed that synergistic dynamics are ubiquitous in neural circuitry and show reliable structure-function relationships, emerging disproportionately in neuronal rich clubs, downstream of recurrent connectivity, and in the convergence of correlated activity. We draw on the existing literature on higher-order information dynamics in neuronal networks to illustrate the insights that have been gained by taking an information decomposition perspective on neural activity. Finally, we briefly discuss future promising directions for information decomposition approaches to neuroscience, such as work on behaving animals, multi-target generalizations of PID, and time-resolved local analyses.

Information content of brain states is explained by structural constraints on state energetics

Signal propagation along the structural connectome of the brain induces changes in the patterns of activity. These activity patterns define global brain states and contain information in accordance with their expected probability of occurrence. Being the physical substrate upon which information propagates, the structural connectome, in conjunction with the dynamics, determines the set of possible brain states and constrains the transition between accessible states. Yet, precisely how these structural constraints on state transitions relate to their information content remains unexplored. To address this gap in knowledge, we defined the information content as a function of the activation distribution, where statistically rare values of activation correspond to high information content. With this numerical definition in hand, we studied the spatiotemporal distribution of information content in functional magnetic resonance imaging (fMRI) data from the Human Connectome Project during different tasks, and report four key findings. First, information content strongly depends on cognitive context; its absolute level and spatial distribution depend on the cognitive task. Second, while information content shows similarities to other measures of brain activity, it is distinct from both Neurosynth maps and task contrast maps generated by a general linear model applied to the fMRI data. Third, the brain's structural wiring constrains the cost to control its state, where the cost to transition into high information content states is larger than that to transition into low information content states. Finally, all state transitions-especially those to high information content states-are less costly than expected from random network null models, thereby indicating the brains marked efficiency. Taken together, our findings establish an explanatory link between the information contained in a brain state and the energetic cost of attaining that state, thereby laying important groundwork for our understanding of large-scale cognitive computations.

Complexity-based Encoded Information Quantification in Neurophysiological Recordings

Brain activity differs vastly between sleep, cognitive tasks, and action. Information theory is an appropriate concept to analytically quantify these brain states. Based on neurophysiological recordings, this concept can handle complex data sets, is free of any requirements about the data structure, and can infer the present underlying brain mechanisms. Specifically, by utilizing algorithmic information theory, it is possible to estimate the absolute information contained in brain responses. While current approaches that apply this theory to neurophysiological recordings can discriminate between different brain states, they are limited in directly quantifying the degree of similarity or encoded information between brain responses. Here, we propose a method grounded in algorithmic information theory that affords direct statements about responses' similarity by estimating the encoded information through a compression-based scheme. We validated this method by applying it to both synthetic and real neurophysiological data and compared its efficiency to the mutual information measure. This proposed procedure is especially suited for task paradigms contrasting different event types because it can precisely quantify the similarity of neuronal responses.

A structural and functional subdivision in central orbitofrontal cortex

Economic choice requires many cognitive subprocesses, including stimulus detection, valuation, motor output, and outcome monitoring; many of these subprocesses are associated with the central orbitofrontal cortex (cOFC). Prior work has largely assumed that the cOFC is a single region with a single function. Here, we challenge that unified view with convergent anatomical and physiological results from rhesus macaques. Anatomically, we show that the cOFC can be subdivided according to its much stronger (medial) or weaker (lateral) bidirectional anatomical connectivity with the posterior cingulate cortex (PCC). We call these subregions cOFCm and cOFCl, respectively. These two subregions have notable functional differences. Specifically, cOFCm shows enhanced functional connectivity with PCC, as indicated by both spike-field coherence and mutual information. The cOFCm-PCC circuit, but not the cOFCl-PCC circuit, shows signatures of relaying choice signals from a non-spatial comparison framework to a spatially framed organization and shows a putative bidirectional mutually excitatory pattern.

An Analysis of Algebraic Codes over Lattice Valued Intuitionistic Fuzzy Type-3 R -Submodules

In the last few decades, the algebraic coding theory found widespread applications in various disciplines due to its rich fascinating mathematical structure. Linear codes, the basic codes in coding theory, are significant in data transmission. In this article, the authors' aim is to enlighten the reader about the role of linear codes in a fuzzy environment. Thus, the reader will be aware of linear codes over lattice valued intuitionistic fuzzy type-3 (LIF-3) R-submodule and α-intuitionistic fuzzy (α-IF) submodule. The proof that the level set of LIF-3 is contained in the level set of α-IF is given, and it is exclusively employed to define linear codes over α-IF submodule. Further, α-IF cyclic codes are presented along with their fundamental properties. Finally, an application based on genetic code is presented, and it is found that the technique of defining codes over α-IF submodule is entirely applicable in this scenario. More specifically, a mapping from the ℤ₆₄ module to a lattice L (comprising 64 codons) is considered, and α-IF codes are defined along with the respective degrees.

Artificial Visual Information Produced by Retinal Prostheses

Numerous retinal prosthetic systems have demonstrated somewhat useful vision can be restored to individuals who had lost their sight due to outer retinal degenerative diseases. Earlier prosthetic studies have mostly focused on the confinement of electrical stimulation for improved spatial resolution and/or the biased stimulation of specific retinal ganglion cell (RGC) types for selective activation of retinal ON/OFF pathway for enhanced visual percepts. To better replicate normal vision, it would be also crucial to consider information transmission by spiking activities arising in the RGC population since an incredible amount of visual information is transferred from the eye to the brain. In previous studies, however, it has not been well explored how much artificial visual information is created in response to electrical stimuli delivered by microelectrodes. In the present work, we discuss the importance of the neural information for high-quality artificial vision. First, we summarize the previous literatures which have computed information transmission rates from spiking activities of RGCs in response to visual stimuli. Second, we exemplify a couple of studies which computed the neural information from electrically evoked responses. Third, we briefly introduce how information rates can be computed in the representative two ways - direct method and reconstruction method. Fourth, we introduce in silico approaches modeling artificial retinal neural networks to explore the relationship between amount of information and the spiking patterns. Lastly, we conclude our review with clinical implications to emphasize the necessity of considering visual information transmission for further improvement of retinal prosthetics.

Group-level inference of information-based measures for the analyses of cognitive brain networks from neurophysiological data

The reproducibility crisis in neuroimaging and in particular in the case of underpowered studies has introduced doubts on our ability to reproduce, replicate and generalize findings. As a response, we have seen the emergence of suggested guidelines and principles for neuroscientists known as Good Scientific Practice for conducting more reliable research. Still, every study remains almost unique in its combination of analytical and statistical approaches. While it is understandable considering the diversity of designs and brain data recording, it also represents a striking point against reproducibility. Here, we propose a non-parametric permutation-based statistical framework, primarily designed for neurophysiological data, in order to perform group-level inferences on non-negative measures of information encompassing metrics from information-theory, machine-learning or measures of distances. The framework supports both fixed- and random-effect models to adapt to inter-individuals and inter-sessions variability. Using numerical simulations, we compared the accuracy in ground-truth retrieving of both group models, such as test- and cluster-wise corrections for multiple comparisons. We then reproduced and extended existing results using both spatially uniform MEG and non-uniform intracranial neurophysiological data. We showed how the framework can be used to extract stereotypical task- and behavior-related effects across the population covering scales from the local level of brain regions, inter-areal functional connectivity to measures summarizing network properties. We also present an open-source Python toolbox called Frites¹ that includes the proposed statistical pipeline using information-theoretic metrics such as single-trial functional connectivity estimations for the extraction of cognitive brain networks. Taken together, we believe that this framework deserves careful attention as its robustness and flexibility could be the starting point toward the uniformization of statistical approaches.

Brain-wide interactions during hippocampal sharp wave ripples

During periods of disengagement from the environment, transient population bursts, known as sharp wave ripples (SPW-Rs), occur sporadically. While numerous experiments have characterized the bidirectional relationship between SPW-Rs and activity in chosen brain areas, the topographic relationship between different segments of the hippocampus and brain-wide target areas has not been studied at high temporal and spatial resolution. Yet, such knowledge is necessary to infer the direction of communication. We analyzed two publicly available datasets with simultaneous high-density silicon probe recordings from across the mouse forebrain. We found that SPW-Rs coincide with a transient brain-wide increase in functional connectivity. In addition, we show that the diversity in SPW-R features, such as their incidence, magnitude, and intrahippocampal topography in the septotemporal axis, are correlated with slower excitability fluctuations in cortical and subcortical areas. Further, variations in SPW-R features correlated with the timing, sign, and magnitude of downstream responses with large-amplitude SPW-Rs followed by transient silence in extrahippocampal structures. Our findings expand on previous results and demonstrate that the activity patterns in extrahippocampal structures depend both on the intrahippocampal topographic origin and magnitude of hippocampal SPW-Rs.

Distinct neural codes in primate hippocampus and lateral prefrontal cortex during associative learning in virtual environments

The hippocampus (HPC) and the lateral prefrontal cortex (LPFC) are two cortical areas of the primate brain deemed essential to cognition. Here, we hypothesized that the codes mediating neuronal communication in the HPC and LPFC microcircuits have distinctively evolved to serve plasticity and memory function at different spatiotemporal scales. We used a virtual reality task in which animals selected one of the two targets in the arms of the maze, according to a learned context-color rule. Our results show that during associative learning, HPC principal cells concentrate spikes in bursts, enabling temporal summation and fast synaptic plasticity in small populations of neurons and ultimately facilitating rapid encoding of associative memories. On the other hand, layer II/III LPFC pyramidal cells fire spikes more sparsely distributed over time. The latter would facilitate broadcasting of signals loaded in short-term memory across neuronal populations without necessarily triggering fast synaptic plasticity.

Computational Modeling of Therapy with the NMDA Antagonist in Neurodegenerative Disease: Information Theory in the Mechanism of Action of Memantine

(1) Background: in patients with neurodegenerative diseases, noncompetitive N-methyl-D-aspartate (NMDA) receptor antagonists provide neuroprotective advantages. We performed memantine therapy and proved mathematical and computer modeling of neurodegenerative disease in this study. (2) Methods: a computer simulation environment of the N-methyl-D-aspartate receptor incorporating biological mechanisms of channel activation by high extracellular glutamic acid concentration. In comparison to controls, pathological models were essentially treated with doses of memantine 3−30 µM. (3) Results: the mean values and 95% CI for Shannon entropy in Alzheimer’s disease (AD) and memantine treatment models were 1.760 (95% CI, 1.704−1.818) vs. 2.385 (95% CI, 2.280−2.490). The Shannon entropy was significantly higher in the memantine treatment model relative to AD model (p = 0.0162). The mean values and 95% CI for the positive Lyapunov exponent in AD and memantine treatment models were 0.125 (95% CI, NE−NE) vs. 0.058 (95% CI, 0.044−0.073). The positive Lyapunov exponent was significantly higher in the AD model relative to the memantine treatment model (p = 0.0091). The mean values and 95% CI for transfer entropy in AD and memantine treatment models were 0.081 (95% CI, 0.048−0.114) vs. 0.040 (95% CI, 0.019−0.062). The transfer entropy was significantly higher in the AD model relative to the memantine treatment model (p = 0.0146). A correlation analysis showed positive and statistically significant correlations of the memantine concentrations and the positive Lyapunov exponent (correlation coefficient R = 0.87, p = 0.0023) and transfer entropy (TE) (correlation coefficient R = 0.99, p < 0.000001). (4) Conclusions: information theory results of simulation studies show that the NMDA antagonist, memantine, causes neuroprotective benefits in patients with AD. Our simulation study opens up remarkable new scenarios in which a medical product, drug, or device, can be developed and tested for efficacy based on parameters of information theory.

The Effects of Electroencephalogram Feature-Based Transcranial Alternating Current Stimulation on Working Memory and Electrophysiology

Transcranial alternating current stimulation (tACS) can influence cognitive functions by modulating brain oscillations. However, results regarding the effectiveness of tACS in regulating cognitive performance have been inconsistent. In the present study, we aimed to find electroencephalogram (EEG) characteristics associated with the improvements in working memory performance, to select tACS stimulus targets and frequency based on this feature, and to explore effects of selected stimulus on verbal working memory. To achieve this goal, we first investigated the EEG characteristics associated with improvements in working memory performance with the aid of EEG analyses and machine learning techniques. These analyses suggested that 8 Hz activity in the prefrontal region was related to accuracy in the verbal working memory task. The tACS stimulus target and pattern were then selected based on the EEG feature. Finally, the selected tACS frequency (8 Hz tACS in the prefrontal region) was applied to modulate working memory. Such modulation resulted significantly greater improvements, compared with 40 Hz and sham modulations (especially for participants with weak verbal working memory). In conclusion, using EEG features related to positive behavioral changes to select brain regions and stimulation patterns for tACS is an effective intervention for improving working memory. Our results contribute to the groundwork for future tACS closed-loop interventions for cognitive deterioration.

Cultural Evolution of Precise and Agreed-Upon Semantic Conventions in a Multiplayer Gaming App

The amount of information conveyed by linguistic conventions depends on their precision, yet the codes that humans and other animals use to communicate are quite ambiguous: they may map several vague meanings to the same symbol. How does semantic precision evolve, and what are the constraints that limit it? We address this question using a multiplayer gaming app, where individuals communicate with one another in a scaled-up referential game. Here, the goal is for a sender to use black and white symbols to communicate colors. We expected that the players' mappings between symbols and colors would grow more specific over time, through a selection process whereby precise mappings are preferentially copied. We found that players become increasingly more precise in their use of symbols over the course of their interactions. This trend did not, however, result from selective copying of precise mappings. We explore the implications of this result for the study of lexical ambiguity, Zipf's Law of Meaning, and disagreements over semantic conventions.

Functional connectivity inference from fMRI data using multivariate information measures

Shannon's entropy or an extension of Shannon's entropy can be used to quantify information transmission between or among variables. Mutual information is the pair-wise information that captures nonlinear relationships between variables. It is more robust than linear correlation methods. Beyond mutual information, two generalizations are defined for multivariate distributions: interaction information or co-information and total correlation or multi-mutual information. In comparison to mutual information, interaction information and total correlation are underutilized and poorly studied in applied neuroscience research. Quantifying information flow between brain regions is not explicitly explained in neuroscience by interaction information and total correlation. This article aims to clarify the distinctions between the neuroscience concepts of mutual information, interaction information, and total correlation. Additionally, we proposed a novel method for determining the interaction information between three variables using total correlation and conditional mutual information. On the other hand, how to apply it properly in practical situations. We supplied both simulation experiments and real neural studies to estimate functional connectivity in the brain with the above three higher-order information-theoretic approaches. In order to capture redundancy information for multivariate variables, we discovered that interaction information and total correlation were both robust, and it could be able to capture both well-known and yet-to-be-discovered functional brain connections.