Modulation of Brain Activity by Selective Attention to Audiovisual Dialogues

Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network

Selective attention-related top-down modulation plays a significant role in separating relevant speech from irrelevant background speech when vocal attributes separating concurrent speakers are small and continuously evolving. Electrophysiological studies have shown that such top-down modulation enhances neural tracking of attended speech. Yet, the specific cortical regions involved remain unclear due to the limited spatial resolution of most electrophysiological techniques. To overcome such limitations, we collected both electroencephalography (EEG) (high temporal resolution) and functional magnetic resonance imaging (fMRI) (high spatial resolution), while human participants selectively attended to speakers in audiovisual scenes containing overlapping cocktail party speech. To utilise the advantages of the respective techniques, we analysed neural tracking of speech using the EEG data and performed representational dissimilarity-based EEG-fMRI fusion. We observed that attention enhanced neural tracking and modulated EEG correlates throughout the latencies studied. Further, attention-related enhancement of neural tracking fluctuated in predictable temporal profiles. We discuss how such temporal dynamics could arise from a combination of interactions between attention and prediction as well as plastic properties of the auditory cortex. EEG-fMRI fusion revealed attention-related iterative feedforward-feedback loops between hierarchically organised nodes of the ventral auditory object related processing stream. Our findings support models where attention facilitates dynamic neural changes in the auditory cortex, ultimately aiding discrimination of relevant sounds from irrelevant ones while conserving neural resources.

Anterior cingulate glutamate levels associate with functional activation and connectivity during sensory integration in schizophrenia: a multimodal 1H-MRS and fMRI study

BACKGROUND

Glutamatergic dysfunction has been implicated in sensory integration deficits in schizophrenia, yet how glutamatergic function contributes to behavioural impairments and neural activities of sensory integration remains unknown.

METHODS

Fifty schizophrenia patients and 43 healthy controls completed behavioural assessments for sensory integration and underwent magnetic resonance spectroscopy (MRS) for measuring the anterior cingulate cortex (ACC) glutamate levels. The correlation between glutamate levels and behavioural sensory integration deficits was examined in each group. A subsample of 20 pairs of patients and controls further completed an audiovisual sensory integration functional magnetic resonance imaging (fMRI) task. Blood Oxygenation Level Dependent (BOLD) activation and task-dependent functional connectivity (FC) were assessed based on fMRI data. Full factorial analyses were performed to examine the Group-by-Glutamate Level interaction effects on fMRI measurements (group differences in correlation between glutamate levels and fMRI measurements) and the correlation between glutamate levels and fMRI measurements within each group.

RESULTS

We found that schizophrenia patients exhibited impaired sensory integration which was positively correlated with ACC glutamate levels. Multimodal analyses showed significantly Group-by-Glutamate Level interaction effects on BOLD activation as well as task-dependent FC in a 'cortico-subcortical-cortical' network (including medial frontal gyrus, precuneus, ACC, middle cingulate gyrus, thalamus and caudate) with positive correlations in patients and negative in controls.

CONCLUSIONS

Our findings indicate that ACC glutamate influences neural activities in a large-scale network during sensory integration, but the effects have opposite directionality between schizophrenia patients and healthy people. This implicates the crucial role of glutamatergic system in sensory integration processing in schizophrenia.

Brain activity during shadowing of audiovisual cocktail party speech, contributions of auditory-motor integration and selective attention

Selective listening to cocktail-party speech involves a network of auditory and inferior frontal cortical regions. However, cognitive and motor cortical regions are differentially activated depending on whether the task emphasizes semantic or phonological aspects of speech. Here we tested whether processing of cocktail-party speech differs when participants perform a shadowing (immediate speech repetition) task compared to an attentive listening task in the presence of irrelevant speech. Participants viewed audiovisual dialogues with concurrent distracting speech during functional imaging. Participants either attentively listened to the dialogue, overtly repeated (i.e., shadowed) attended speech, or performed visual or speech motor control tasks where they did not attend to speech and responses were not related to the speech input. Dialogues were presented with good or poor auditory and visual quality. As a novel result, we show that attentive processing of speech activated the same network of sensory and frontal regions during listening and shadowing. However, in the superior temporal gyrus (STG), peak activations during shadowing were posterior to those during listening, suggesting that an anterior-posterior distinction is present for motor vs. perceptual processing of speech already at the level of the auditory cortex. We also found that activations along the dorsal auditory processing stream were specifically associated with the shadowing task. These activations are likely to be due to complex interactions between perceptual, attention dependent speech processing and motor speech generation that matches the heard speech. Our results suggest that interactions between perceptual and motor processing of speech relies on a distributed network of temporal and motor regions rather than any specific anatomical landmark as suggested by some previous studies.

Abnormal developmental trends of functional connectivity in young children with infantile esotropia

Previous studies have shown that functional networks are present at birth and change dynamically throughout infancy and early childhood. However, the status of functional connectivity is still poorly understood in patients with infantile esotropia (IE). The aim of this study is to investigate the developmental trends of functional connectivity in patients with IE during a critical period of growth and development. A total of 17 patients with IE (9 males and 8 females; mean age: 3.36 ± 2.03 years, age range: 0.67–6.36 years) and 20 healthy subjects matched for age and gender were recruited and underwent resting-state functional magnetic resonance imaging. The whole-brain functional network connectivity was analyzed for the IE group and healthy control group. A general linear model was applied to assess the group-age interaction in terms of the functional connectivity. The discrepancy between the two groups in functional connectivity trajectories was also quantified across age and exhibited by the quadratic parabolic model. There were significant group-age interactions between the visual network and the default mode network, the visual network and the sensorimotor network, the limbic network and the default mode network, and within the limbic network in the functional connectivity. A U-shaped tendency across age, with an “inflection point” ranging from 3.1 to 4.0 years of age was exhibited in the difference between functional connectivity trajectories of the IE patients and normal controls. Abnormality in functional network connectivity could present in IE patients at birth, exhibiting aberrant developmental patterns over time. An abnormal functional network could reduce the ability of the cortex in visual information processing, further reactivating the subcortical visual information processing system, which is probably the pathogenesis of IE. Three to four years after birth is the critical time window for children with IE to establish normal network connections in the brain. Early surgery during this period may be helpful for affected children to have an opportunity to approach the normal development trajectory as early as possible.

Brain Responses to Peer Feedback in Social Media Are Modulated by Valence in Late Adolescence

Previous studies have examined the neural correlates of receiving negative feedback from peers during virtual social interaction in young people. However, there is a lack of studies applying platforms adolescents use in daily life. In the present study, 92 late-adolescent participants performed a task that involved receiving positive and negative feedback to their opinions from peers in a Facebook-like platform, while brain activity was measured using functional magnetic resonance imaging (fMRI). Peer feedback was shown to activate clusters in the ventrolateral prefrontal cortex (VLPFC), medial prefrontal cortex (MPFC), superior temporal gyrus and sulcus (STG/STS), and occipital cortex (OC). Negative feedback was related to greater activity in the VLPFC, MPFC, and anterior insula than positive feedback, replicating previous findings on peer feedback and social rejection. Real-life habits of social media use did not correlate with brain responses to negative feedback.

The role of eye-specific attention in ocular dominance plasticity

It is well known how selective attention biases information processing in real time, but few work investigates the aftereffects of prolonged attention, let alone the underlying neural mechanisms. To examine perceptual aftereffect after prolonged attention to a monocular pathway, movie images played normally were presented to normal adult's one eye (attended eye), while movie images of the same episode but played backwards were presented to the opposite eye (unattended eye). One hour of watching this dichoptic movie caused a shift of perceptual ocular dominance towards the unattended eye. Interestingly, the aftereffect positively correlated with the advantage of neural activity for the attended-eye over unattended-eye signals at the frontal electrodes measured with steady-state visual evoked potentials. Moreover, the aftereffect disappeared when interocular competition was minimized during adaptation. These results suggest that top-down eye-specific attention can induce ocular dominance plasticity through binocular rivalry mechanisms. The present study opens the route to explain at least part of short-term ocular dominance plasticity with the ocular-opponency-neuron model, which may be an interesting complement to the homeostatic compensation theory.

Application of Mass Multivariate Analysis on Neuroimaging Data Sets for Precision Diagnostics of Depression

We used the Mass Multivariate Method on structural, resting-state, and task-related fMRI data from two groups of patients with schizophrenia and depression in order to define several regions of significant relevance to the differential diagnosis of those conditions. The regions included the left planum polare (PP), the left opercular part of the inferior frontal gyrus (OpIFG), the medial orbital gyrus (MOrG), the posterior insula (PIns), and the parahippocampal gyrus (PHG). This study delivered evidence that a multimodal neuroimaging approach can potentially enhance the validity of psychiatric diagnoses. Structural, resting-state, or task-related functional MRI modalities cannot provide independent biomarkers. Further studies need to consider and implement a model of incremental validity combining clinical measures with different neuroimaging modalities to discriminate depressive disorders from schizophrenia. Biological signatures of disease on the level of neuroimaging are more likely to underpin broader nosological entities in psychiatry.

Task-dependent cortical activations during selective attention to audiovisual speech

Selective listening to speech depends on widespread networks of the brain, but how the involvement of different neural systems in speech processing is affected by factors such as the task performed by a listener and speech intelligibility remains poorly understood. We used functional magnetic resonance imaging to systematically examine the effects that performing different tasks has on neural activations during selective attention to continuous audiovisual speech in the presence of task-irrelevant speech. Participants viewed audiovisual dialogues and attended either to the semantic or the phonological content of speech, or ignored speech altogether and performed a visual control task. The tasks were factorially combined with good and poor auditory and visual speech qualities. Selective attention to speech engaged superior temporal regions and the left inferior frontal gyrus regardless of the task. Frontoparietal regions implicated in selective auditory attention to simple sounds (e.g., tones, syllables) were not engaged by the semantic task, suggesting that this network may not be not as crucial when attending to continuous speech. The medial orbitofrontal cortex, implicated in social cognition, was most activated by the semantic task. Activity levels during the phonological task in the left prefrontal, premotor, and secondary somatosensory regions had a distinct temporal profile as well as the highest overall activity, possibly relating to the role of the dorsal speech processing stream in sub-lexical processing. Our results demonstrate that the task type influences neural activations during selective attention to speech, and emphasize the importance of ecologically valid experimental designs.

Breathlessness in COPD: linking symptom clusters with brain activity

Background

Current models of breathlessness often fail to explain disparities between patients' experiences of breathlessness and objective measures of lung function. While a mechanistic understanding of this discordance has thus far remained elusive, factors such as mood, attention and expectation have all been implicated as important modulators of breathlessness. Therefore, we have developed a model to better understand the relationships between these factors using unsupervised machine learning techniques. Subsequently we examined how expectation-related brain activity differed between these symptom-defined clusters of participants.

Methods

A cohort of 91 participants with mild-to-moderate chronic obstructive pulmonary disease (COPD) underwent functional brain imaging, self-report questionnaires and clinical measures of respiratory function. Unsupervised machine learning techniques of exploratory factor analysis and hierarchical cluster modelling were used to model brain–behaviour–breathlessness links.

Results

We successfully stratified participants across four key factors corresponding to mood, symptom burden and two capability measures. Two key groups resulted from this stratification, corresponding to high and low symptom burden. Compared with the high symptom burden group, the low symptom burden group demonstrated significantly greater brain activity within the anterior insula, a key region thought to be involved in monitoring internal bodily sensations (interoception).

Conclusions

This is the largest functional neuroimaging study of COPD to date, and is the first to provide a clear model linking brain, behaviour and breathlessness expectation. Furthermore, it was possible to stratify participants into groups, which then revealed differences in brain activity patterns. Together, these findings highlight the value of multimodal models of breathlessness in identifying behavioural phenotypes and for advancing understanding of differences in breathlessness burden.

Towards individualised treatments for chronic breathlessness with functional neuroimaging: revealing the factors underlying the breathlessness experience in COPDhttps://bit.ly/3a8fXPt

Breaking down the cocktail party: Attentional modulation of cerebral audiovisual speech processing

Recent studies utilizing electrophysiological speech envelope reconstruction have sparked renewed interest in the cocktail party effect by showing that auditory neurons entrain to selectively attended speech. Yet, the neural networks of attention to speech in naturalistic audiovisual settings with multiple sound sources remain poorly understood. We collected functional brain imaging data while participants viewed audiovisual video clips of lifelike dialogues with concurrent distracting speech in the background. Dialogues were presented in a full-factorial design, comprising task (listen to the dialogues vs. ignore them), audiovisual quality and semantic predictability. We used univariate analyses in combination with multivariate pattern analysis (MVPA) to study modulations of brain activity related to attentive processing of audiovisual speech. We found attentive speech processing to cause distinct spatiotemporal modulation profiles in distributed cortical areas including sensory and frontal-control networks. Semantic coherence modulated attention-related activation patterns in the earliest stages of auditory cortical processing, suggesting that the auditory cortex is involved in high-level speech processing. Our results corroborate views that emphasize the dynamic nature of attention, with task-specificity and context as cornerstones of the underlying neuro-cognitive mechanisms.