Neural Encoding of Active Multi-Sensing Enhances Perceptual Decision-Making via a Synergistic Cross-Modal Interaction

A synergistic workspace for human consciousness revealed by Integrated Information Decomposition

How is the information-processing architecture of the human brain organised, and how does its organisation support consciousness? Here, we combine network science and a rigorous information-theoretic notion of synergy to delineate a 'synergistic global workspace', comprising gateway regions that gather synergistic information from specialised modules across the human brain. This information is then integrated within the workspace and widely distributed via broadcaster regions. Through functional MRI analysis, we show that gateway regions of the synergistic workspace correspond to the human brain's default mode network, whereas broadcasters coincide with the executive control network. We find that loss of consciousness due to general anaesthesia or disorders of consciousness corresponds to diminished ability of the synergistic workspace to integrate information, which is restored upon recovery. Thus, loss of consciousness coincides with a breakdown of information integration within the synergistic workspace of the human brain. This work contributes to conceptual and empirical reconciliation between two prominent scientific theories of consciousness, the Global Neuronal Workspace and Integrated Information Theory, while also advancing our understanding of how the human brain supports consciousness through the synergistic integration of information.

Unravelling consciousness and brain function through the lens of time, space, and information

Disentangling how cognitive functions emerge from the interplay of brain dynamics and network architecture is among the major challenges that neuroscientists face. Pharmacological and pathological perturbations of consciousness provide a lens to investigate these complex challenges. Here, we review how recent advances about consciousness and the brain's functional organisation have been driven by a common denominator: decomposing brain function into fundamental constituents of time, space, and information. Whereas unconsciousness increases structure-function coupling across scales, psychedelics may decouple brain function from structure. Convergent effects also emerge: anaesthetics, psychedelics, and disorders of consciousness can exhibit similar reconfigurations of the brain's unimodal-transmodal functional axis. Decomposition approaches reveal the potential to translate discoveries across species, with computational modelling providing a path towards mechanistic integration.

A drift diffusion model analysis of age-related impact on multisensory decision-making processes

Older adults (OAs) are typically slower and/or less accurate in forming perceptual choices relative to younger adults. Despite perceptual deficits, OAs gain from integrating information across senses, yielding multisensory benefits. However, the cognitive processes underlying these seemingly discrepant ageing effects remain unclear. To address this knowledge gap, 212 participants (18-90 years old) performed an online object categorisation paradigm, whereby age-related differences in Reaction Times (RTs) and choice accuracy between audiovisual (AV), visual (V), and auditory (A) conditions could be assessed. Whereas OAs were slower and less accurate across sensory conditions, they exhibited greater RT decreases between AV and V conditions, showing a larger multisensory benefit towards decisional speed. Hierarchical Drift Diffusion Modelling (HDDM) was fitted to participants' behaviour to probe age-related impacts on the latent multisensory decision formation processes. For OAs, HDDM demonstrated slower evidence accumulation rates across sensory conditions coupled with increased response caution for AV trials of higher difficulty. Notably, for trials of lower difficulty we found multisensory benefits in evidence accumulation that increased with age, but not for trials of higher difficulty, in which increased response caution was instead evident. Together, our findings reconcile age-related impacts on multisensory decision-making, indicating greater multisensory evidence accumulation benefits with age underlying enhanced decisional speed.

Information decomposition and the informational architecture of the brain

To explain how the brain orchestrates information-processing for cognition, we must understand information itself. Importantly, information is not a monolithic entity. Information decomposition techniques provide a way to split information into its constituent elements: unique, redundant, and synergistic information. We review how disentangling synergistic and redundant interactions is redefining our understanding of integrative brain function and its neural organisation. To explain how the brain navigates the trade-offs between redundancy and synergy, we review converging evidence integrating the structural, molecular, and functional underpinnings of synergy and redundancy; their roles in cognition and computation; and how they might arise over evolution and development. Overall, disentangling synergistic and redundant information provides a guiding principle for understanding the informational architecture of the brain and cognition.

Adaptive decision-making depends on pupil-linked arousal in rats performing tactile discrimination tasks

Perceptual decision-making is a dynamic cognitive process and is shaped by many factors, including behavioral state, reward contingency, and sensory environment. To understand the extent to which adaptive behavior in decision-making is dependent on pupil-linked arousal, we trained head-fixed rats to perform perceptual decision-making tasks and systematically manipulated the probability of Go and No-go stimuli while simultaneously measuring their pupil size in the tasks. Our data demonstrated that the animals adaptively modified their behavior in response to the changes in the sensory environment. The response probability to both Go and No-go stimuli decreased as the probability of the Go stimulus being presented decreased. Analyses within the signal detection theory framework showed that while the animals' perceptual sensitivity was invariant, their decision criterion increased as the probability of the Go stimulus decreased. Simulation results indicated that the adaptive increase in the decision criterion will increase possible water rewards during the task. Moreover, the adaptive decision-making is dependent on pupil-linked arousal as the increase in the decision criterion was the largest during low pupil-linked arousal periods. Taken together, our results demonstrated that the rats were able to adjust their decision-making to maximize rewards in the tasks, and that adaptive behavior in perceptual decision-making is dependent on pupil-linked arousal.NEW & NOTEWORTHY Perceptual decision-making is a dynamic cognitive process and is shaped by many factors. However, the extent to which changes in sensory environment result in adaptive decision-making remains poorly understood. Our data provided new experimental evidence demonstrating that the rats were able to adaptively modify their decision criterion to maximize water reward in response to changes in the statistics of the sensory environment. Furthermore, the adaptive decision-making is dependent on pupil-linked arousal.

Cognitive Functions in Patients with Moderate-to-Severe Obstructive Sleep Apnea Syndrome with Emphasis on Executive Functions and Decision-Making

BACKGROUND

Patients with obstructive sleep apnea syndrome (OSAS) have cognitive dysfunction in many aspects, however, these patients' decision-making function remains unclear. In this study, the Game of Dice Task (GDT) was used to investigate the function of decision making in patients with OSAS.

METHODS

30 participants with moderate to severe OSAS and 27 participants with no or mild OSAS diagnosed by sleep breathing monitor were selected from June 2021 to March 2022. Risky decision making was tested through the GDT with known risk probability. General demographic information and background cognitive functions, such as the overall cognitive functioning and executive functioning, were tested to establish baseline data.

RESULTS

There were no significant differences in gender, age, and years of education between the two groups. During the GDT, the moderate to severe OSAS group opted for the safety option at a statistically significant lower rate when compared to the no or mild OSAS group (7.53 ± 4.43 vs. 10.26 ± 4.26, p = 0.022). The moderate to severe OSAS group utilized the higher risk option than the group with no or mild OSAS (10.47 ± 4.43 vs. 7.74 ± 4.26, p = 0.022). The utilization rate of negative feedback in the moderate and severe OSAS group was lower than that in the no or mild OSAS group (7.50, 52.50 vs. 28.57, 100.00, p = 0.001). At the end of the GDT, the moderate and severe OSAS group was more likely to have negative total assets than the patients with no or mild OSAS (-1846.67 ± 2587.20 vs. 300.00 ± 1509.97, p < 0.001). Multiple linear regression analysis shows that there is a negative correlation between the selection of risk options and negative feedback utilization in the GDT.

CONCLUSION

Patients with moderate and severe OSAS displayed impaired decision-making throughout the study. Impaired decision-making is related to executive processes and may be caused by diminished prefrontal cortex functioning. However, the functions of memory, attention, language, abstraction, and orientation are relatively retained.

Neuromodulation of Neural Oscillations in Health and Disease

Using EEG and local field potentials (LFPs) as an index of large-scale neural activities, research has been able to associate neural oscillations in different frequency bands with markers of cognitive functions, goal-directed behavior, and various neurological disorders. While this gives us a glimpse into how neurons communicate throughout the brain, the causality of these synchronized network activities remains poorly understood. Moreover, the effect of the major neuromodulatory systems (e.g., noradrenergic, cholinergic, and dopaminergic) on brain oscillations has drawn much attention. More recent studies have suggested that cross-frequency coupling (CFC) is heavily responsible for mediating network-wide communication across subcortical and cortical brain structures, implicating the importance of neurotransmitters in shaping coordinated actions. By bringing to light the role each neuromodulatory system plays in regulating brain-wide neural oscillations, we hope to paint a clearer picture of the pivotal role neural oscillations play in a variety of cognitive functions and neurological disorders, and how neuromodulation techniques can be optimized as a means of controlling neural network dynamics. The aim of this review is to showcase the important role that neuromodulatory systems play in large-scale neural network dynamics, informing future studies to pay close attention to their involvement in specific features of neural oscillations and associated behaviors.

Speech listening entails neural encoding of invisible articulatory features

Speech processing entails a complex interplay between bottom-up and top-down computations. The former is reflected in the neural entrainment to the quasi-rhythmic properties of speech acoustics while the latter is supposed to guide the selection of the most relevant input subspace. Top-down signals are believed to originate mainly from motor regions, yet similar activities have been shown to tune attentional cycles also for simpler, non-speech stimuli. Here we examined whether, during speech listening, the brain reconstructs articulatory patterns associated to speech production. We measured electroencephalographic (EEG) data while participants listened to sentences during the production of which articulatory kinematics of lips, jaws and tongue were also recorded (via Electro-Magnetic Articulography, EMA). We captured the patterns of articulatory coordination through Principal Component Analysis (PCA) and used Partial Information Decomposition (PID) to identify whether the speech envelope and each of the kinematic components provided unique, synergistic and/or redundant information regarding the EEG signals. Interestingly, tongue movements contain both unique as well as synergistic information with the envelope that are encoded in the listener's brain activity. This demonstrates that during speech listening the brain retrieves highly specific and unique motor information that is never accessible through vision, thus leveraging audio-motor maps that arise most likely from the acquisition of speech production during development.

Genuine high-order interactions in brain networks and neurodegeneration

Brain functional networks have been traditionally studied considering only interactions between pairs of regions, neglecting the richer information encoded in higher orders of interactions. In consequence, most of the connectivity studies in neurodegeneration and dementia use standard pairwise metrics. Here, we developed a genuine high-order functional connectivity (HOFC) approach that captures interactions between 3 or more regions across spatiotemporal scales, delivering a more biologically plausible characterization of the pathophysiology of neurodegeneration. We applied HOFC to multimodal (electroencephalography [EEG], and functional magnetic resonance imaging [fMRI]) data from patients diagnosed with behavioral variant of frontotemporal dementia (bvFTD), Alzheimer's disease (AD), and healthy controls. HOFC revealed large effect sizes, which, in comparison to standard pairwise metrics, provided a more accurate and parsimonious characterization of neurodegeneration. The multimodal characterization of neurodegeneration revealed hypo and hyperconnectivity on medium to large-scale brain networks, with a larger contribution of the former. Regions as the amygdala, the insula, and frontal gyrus were associated with both effects, suggesting potential compensatory processes in hub regions. fMRI revealed hypoconnectivity in AD between regions of the default mode, salience, visual, and auditory networks, while in bvFTD between regions of the default mode, salience, and somatomotor networks. EEG revealed hypoconnectivity in the γ band between frontal, limbic, and sensory regions in AD, and in the δ band between frontal, temporal, parietal and posterior areas in bvFTD, suggesting additional pathophysiological processes that fMRI alone can not capture. Classification accuracy was comparable with standard biomarkers and robust against confounders such as sample size, age, education, and motor artifacts (from fMRI and EEG). We conclude that high-order interactions provide a detailed, EEG- and fMRI compatible, biologically plausible, and psychopathological-specific characterization of different neurodegenerative conditions.

Intermodulation from Unisensory to Multisensory Perception: A Review

Previous intermodulation (IM) studies have employed two (or more) temporal modulations of a stimulus, with different local elements of the stimulus being modulated by different frequencies. Brain activities of IM obtained mainly from electroencephalograms (EEG) have been analyzed in the frequency domain. As a powerful tool, IM, which can provide a direct and objective physiological measure of neural interaction, has emerged as a promising method to decipher neural interactions in visual perception, and reveal the underlying different perceptual processing levels. In this review, we summarize the recent applications of IM in visual perception, detail the protocols and types of IM, and extend its utility and potential applications to the multisensory domain. We propose that using IM could prevail in partially revealing the potential hierarchical processing of multisensory information and contribute to a deeper understanding of the underlying brain dynamics.