Increased Connectivity among Sensory and Motor Regions during Visual and Audiovisual Speech Perception

The mesolimbic system and the loss of higher order network features in schizophrenia when learning without reward

Introduction

Schizophrenia is characterized by a loss of network features between cognition and reward sub-circuits (notably involving the mesolimbic system), and this loss may explain deficits in learning and cognition. Learning in schizophrenia has typically been studied with tasks that include reward related contingencies, but recent theoretical models have argued that a loss of network features should be seen even when learning without reward. We tested this model using a learning paradigm that required participants to learn without reward or feedback. We used a novel method for capturing higher order network features, to demonstrate that the mesolimbic system is heavily implicated in the loss of network features in schizophrenia, even when learning without reward.

Methods

fMRI data (Siemens Verio 3T) were acquired in a group of schizophrenia patients and controls (n=78; 46 SCZ, 18 ≤ Age ≤ 50) while participants engaged in associative learning without reward-related contingencies. The task was divided into task-active conditions for encoding (of associations) and cued-retrieval (where the cue was to be used to retrieve the associated memoranda). No feedback was provided during retrieval. From the fMRI time series data, network features were defined as follows: First, for each condition of the task, we estimated 2nd order undirected functional connectivity for each participant (uFC, based on zero lag correlations between all pairs of regions). These conventional 2nd order features represent the task/condition evoked synchronization of activity between pairs of brain regions. Next, in each of the patient and control groups, the statistical relationship between all possible pairs of 2nd order features were computed. These higher order features represent the consistency between all possible pairs of 2nd order features in that group and embed within them the contributions of individual regions to such group structure.

Results

From the identified inter-group differences (SCZ ≠ HC) in higher order features, we quantified the respective contributions of individual brain regions. Two principal effects emerged: 1) SCZ were characterized by a massive loss of higher order features during multiple task conditions (encoding and retrieval of associations). 2) Nodes in the mesolimbic system were over-represented in the loss of higher order features in SCZ, and notably so during retrieval.

Discussion

Our analytical goals were linked to a recent circuit-based integrative model which argued that synergy between learning and reward circuits is lost in schizophrenia. The model's notable prediction was that such a loss would be observed even when patients learned without reward. Our results provide substantial support for these predictions where we observed a loss of network features between the brain's sub-circuits for a) learning (including the hippocampus and prefrontal cortex) and b) reward processing (specifically constituents of the mesolimbic system that included the ventral tegmental area and the nucleus accumbens. Our findings motivate a renewed appraisal of the relationship between reward and cognition in schizophrenia and we discuss their relevance for putative behavioral interventions.

Age-Related Changes to Multisensory Integration and Audiovisual Speech Perception

Multisensory integration is essential for the quick and accurate perception of our environment, particularly in everyday tasks like speech perception. Research has highlighted the importance of investigating bottom-up and top-down contributions to multisensory integration and how these change as a function of ageing. Specifically, perceptual factors like the temporal binding window and cognitive factors like attention and inhibition appear to be fundamental in the integration of visual and auditory information-integration that may become less efficient as we age. These factors have been linked to brain areas like the superior temporal sulcus, with neural oscillations in the alpha-band frequency also being implicated in multisensory processing. Age-related changes in multisensory integration may have significant consequences for the well-being of our increasingly ageing population, affecting their ability to communicate with others and safely move through their environment; it is crucial that the evidence surrounding this subject continues to be carefully investigated. This review will discuss research into age-related changes in the perceptual and cognitive mechanisms of multisensory integration and the impact that these changes have on speech perception and fall risk. The role of oscillatory alpha activity is of particular interest, as it may be key in the modulation of multisensory integration.

Successful aging of musicians: Preservation of sensorimotor regions aids audiovisual speech-in-noise perception

Musicianship can mitigate age-related declines in audiovisual speech-in-noise perception. We tested whether this benefit originates from functional preservation or functional compensation by comparing fMRI responses of older musicians, older nonmusicians, and young nonmusicians identifying noise-masked audiovisual syllables. Older musicians outperformed older nonmusicians and showed comparable performance to young nonmusicians. Notably, older musicians retained similar neural specificity of speech representations in sensorimotor areas to young nonmusicians, while older nonmusicians showed degraded neural representations. In the same region, older musicians showed higher neural alignment to young nonmusicians than older nonmusicians, which was associated with their training intensity. In older nonmusicians, the degree of neural alignment predicted better performance. In addition, older musicians showed greater activation in frontal-parietal, speech motor, and visual motion regions and greater deactivation in the angular gyrus than older nonmusicians, which predicted higher neural alignment in sensorimotor areas. Together, these findings suggest that musicianship-related benefit in audiovisual speech-in-noise processing is rooted in preserving youth-like representations in sensorimotor regions.

Cross-modal functional connectivity supports speech understanding in cochlear implant users

Sensory deprivation can lead to cross-modal cortical changes, whereby sensory brain regions deprived of input may be recruited to perform atypical function. Enhanced cross-modal responses to visual stimuli observed in auditory cortex of postlingually deaf cochlear implant (CI) users are hypothesized to reflect increased activation of cortical language regions, but it is unclear if this cross-modal activity is "adaptive" or "mal-adaptive" for speech understanding. To determine if increased activation of language regions is correlated with better speech understanding in CI users, we assessed task-related activation and functional connectivity of auditory and visual cortices to auditory and visual speech and non-speech stimuli in CI users (n = 14) and normal-hearing listeners (n = 17) and used functional near-infrared spectroscopy to measure hemodynamic responses. We used visually presented speech and non-speech to investigate neural processes related to linguistic content and observed that CI users show beneficial cross-modal effects. Specifically, an increase in connectivity between the left auditory and visual cortices-presumed primary sites of cortical language processing-was positively correlated with CI users' abilities to understand speech in background noise. Cross-modal activity in auditory cortex of postlingually deaf CI users may reflect adaptive activity of a distributed, multimodal speech network, recruited to enhance speech understanding.

Audiovisual speech perception: Moving beyond McGurk

Although it is clear that sighted listeners use both auditory and visual cues during speech perception, the manner in which multisensory information is combined is a matter of debate. One approach to measuring multisensory integration is to use variants of the McGurk illusion, in which discrepant auditory and visual cues produce auditory percepts that differ from those based on unimodal input. Not all listeners show the same degree of susceptibility to the McGurk illusion, and these individual differences are frequently used as a measure of audiovisual integration ability. However, despite their popularity, we join the voices of others in the field to argue that McGurk tasks are ill-suited for studying real-life multisensory speech perception: McGurk stimuli are often based on isolated syllables (which are rare in conversations) and necessarily rely on audiovisual incongruence that does not occur naturally. Furthermore, recent data show that susceptibility to McGurk tasks does not correlate with performance during natural audiovisual speech perception. Although the McGurk effect is a fascinating illusion, truly understanding the combined use of auditory and visual information during speech perception requires tasks that more closely resemble everyday communication: namely, words, sentences, and narratives with congruent auditory and visual speech cues.