A dynamical framework to relate perceptual variability with multisensory information processing

Whole-Brain Network Models: From Physics to Bedside

Computational neuroscience has come a long way from its humble origins in the pioneering work of Hodgkin and Huxley. Contemporary computational models of the brain span multiple spatiotemporal scales, from single neuronal compartments to models of social cognition. Each spatial scale comes with its own unique set of promises and challenges. Here, we review models of large-scale neural communication facilitated by white matter tracts, also known as whole-brain models (WBMs). Whole-brain approaches employ inputs from neuroimaging data and insights from graph theory and non-linear systems theory to model brain-wide dynamics. Over the years, WBM models have shown promise in providing predictive insights into various facets of neuropathologies such as Alzheimer's disease, Schizophrenia, Epilepsy, Traumatic brain injury, while also offering mechanistic insights into large-scale cortical communication. First, we briefly trace the history of WBMs, leading up to the state-of-the-art. We discuss various methodological considerations for implementing a whole-brain modeling pipeline, such as choice of node dynamics, model fitting and appropriate parcellations. We then demonstrate the applicability of WBMs toward understanding various neuropathologies. We conclude by discussing ways of augmenting the biological and clinical validity of whole-brain models.

Modeling Frequency Reduction in Human Groups Performing a Joint Oscillatory Task

In human groups performing oscillatory tasks, it has been observed that the frequency of participants' oscillations reduces when compared to that acquired in solo. This experimental observation is not captured by the standard Kuramoto oscillators, often employed to model human synchronization. In this work, we aim at capturing this observed phenomenon by proposing three alternative modifications of the standard Kuramoto model that are based on three different biologically-relevant hypotheses underlying group synchronization. The three models are tuned, validated and compared against experiments on a group synchronization task, which is a multi-agent extension of the so-called mirror game.

Biophysical mechanisms governing large-scale brain network dynamics underlying individual-specific variability of perception

Perception necessitates interaction among neuronal ensembles, the dynamics of which can be conceptualized as the emergent behavior of coupled dynamical systems. Here, we propose a detailed neurobiologically realistic model that captures the neural mechanisms of inter-individual variability observed in cross-modal speech perception. From raw EEG signals recorded from human participants when they were presented with speech vocalizations of McGurk-incongruent and congruent audio-visual (AV) stimuli, we computed the global coherence metric to capture the neural variability of large-scale networks. We identified that participants' McGurk susceptibility was negatively correlated to their alpha band global coherence. The proposed biophysical model conceptualized the global coherence dynamics emerge from coupling between the interacting neural masses-representing the sensory-specific auditory/visual areas and modality nonspecific associative/integrative regions. Subsequently, we could predict that an extremely weak direct AV coupling results in a decrease in alpha band global coherence-mimicking the cortical dynamics of participants with higher McGurk susceptibility. Source connectivity analysis also showed decreased connectivity between sensory-specific regions in participants more susceptible to McGurk effect, thus establishing an empirical validation to the prediction. Overall, our study provides an outline to link variability in structural and functional connectivity metrics to variability of performance that can be useful for several perception and action task paradigms.

Segregation and Integration of Cortical Information Processing Underlying Cross-Modal Perception

Visual cues from the speaker’s face influence the perception of speech. An example of this influence is demonstrated by the McGurk-effect where illusory (cross-modal) sounds are perceived following presentation of incongruent audio–visual (AV) stimuli. Previous studies report the engagement of specific cortical modules that are spatially distributed during cross-modal perception. However, the limits of the underlying representational space and the cortical network mechanisms remain unclear. In this combined psychophysical and electroencephalography (EEG) study, the participants reported their perception while listening to a set of synchronous and asynchronous incongruent AV stimuli. We identified the neural representation of subjective cross-modal perception at different organizational levels — at specific locations in sensor space and at the level of the large-scale brain network estimated from between-sensor interactions. We identified an enhanced positivity in the event-related potential peak around 300 ms following stimulus onset associated with cross-modal perception. At the spectral level, cross-modal perception involved an overall decrease in power at the frontal and temporal regions at multiple frequency bands and at all AV lags, along with an increased power at the occipital scalp region for synchronous AV stimuli. At the level of large-scale neuronal networks, enhanced functional connectivity at the gamma band involving frontal regions serves as a marker of AV integration. Thus, we report in one single study that segregation of information processing at individual brain locations and integration of information over candidate brain networks underlie multisensory speech perception.

Large Scale Functional Brain Networks Underlying Temporal Integration of Audio-Visual Speech Perception: An EEG Study

Observable lip movements of the speaker influence perception of auditory speech. A classical example of this influence is reported by listeners who perceive an illusory (cross-modal) speech sound (McGurk-effect) when presented with incongruent audio-visual (AV) speech stimuli. Recent neuroimaging studies of AV speech perception accentuate the role of frontal, parietal, and the integrative brain sites in the vicinity of the superior temporal sulcus (STS) for multisensory speech perception. However, if and how does the network across the whole brain participates during multisensory perception processing remains an open question. We posit that a large-scale functional connectivity among the neural population situated in distributed brain sites may provide valuable insights involved in processing and fusing of AV speech. Varying the psychophysical parameters in tandem with electroencephalogram (EEG) recordings, we exploited the trial-by-trial perceptual variability of incongruent audio-visual (AV) speech stimuli to identify the characteristics of the large-scale cortical network that facilitates multisensory perception during synchronous and asynchronous AV speech. We evaluated the spectral landscape of EEG signals during multisensory speech perception at varying AV lags. Functional connectivity dynamics for all sensor pairs was computed using the time-frequency global coherence, the vector sum of pairwise coherence changes over time. During synchronous AV speech, we observed enhanced global gamma-band coherence and decreased alpha and beta-band coherence underlying cross-modal (illusory) perception compared to unisensory perception around a temporal window of 300-600 ms following onset of stimuli. During asynchronous speech stimuli, a global broadband coherence was observed during cross-modal perception at earlier times along with pre-stimulus decreases of lower frequency power, e.g., alpha rhythms for positive AV lags and theta rhythms for negative AV lags. Thus, our study indicates that the temporal integration underlying multisensory speech perception requires to be understood in the framework of large-scale functional brain network mechanisms in addition to the established cortical loci of multisensory speech perception.