Spatio-temporal distribution of brain activity associated with audio-visually congruent and incongruent speech and the McGurk Effect

Comparison of resting-state spontaneous brain activity between treatment-naive schizophrenia and obsessive-compulsive disorder

BACKGROUND

Schizophrenia (SZ) and obsessive-compulsive disorder (OCD) share many demographic characteristics and severity of clinical symptoms, genetic risk factors, pathophysiological underpinnings, and brain structure and function. However, the differences in the spontaneous brain activity patterns between the two diseases remain unclear. Here this study aimed to compare the features of intrinsic brain activity in treatment-naive participants with SZ and OCD and to explore the relationship between spontaneous brain activity and the severity of symptoms.

METHODS

In this study, 22 treatment-naive participants with SZ, 27 treatment-naive participants with OCD, and sixty healthy controls (HC) underwent a resting-state functional magnetic resonance imaging (fMRI) scan. The amplitude of low-frequency fluctuation (ALFF), regional homogeneity (ReHo) and degree of centrality (DC) were performed to examine the intrinsic brain activity of participants. Additionally, the relationships among spontaneous brain activity, the severity of symptoms, and the duration of illness were explored in SZ and OCD groups.

RESULTS

Compared with SZ group and HC group, participants with OCD had significantly higher ALFF in the right angular gyrus and the left middle frontal gyrus/precentral gyrus and significantly lower ALFF in the left superior temporal gyrus/insula/rolandic operculum and the left postcentral gyrus, while there was no significant difference in ALFF between SZ group and HC group. Compared with HC group, lower ALFF in the right supramarginal gyrus/inferior parietal lobule and lower DC in the right lingual gyrus/calcarine fissure and surrounding cortex of the two patient groups, higher ReHo in OCD group and lower ReHo in SZ group in the right angular gyrus/middle occipital gyrus brain region were documented in the present study. DC in SZ group was significantly higher than that in HC group in the right inferior parietal lobule/angular gyrus, while there were no significant DC differences between OCD group and HC group. In addition, ALFF in the left postcentral gyrus were positively correlated with positive subscale score (r = 0.588, P = 0.013) and general psychopathology subscale score (r = 0.488, P = 0.047) respectively on the Positive and Negative Syndrome Scale (PANSS) in SZ group. ALFF in the left superior temporal gyrus/insula/rolandic operculum of participants with OCD were positively correlated with compulsion subscale score (r = 0.463, P = 0.030) on the Yale-Brown Obsessive-Compulsive Scale (Y-BOCS). The longer the illness duration in SZ group, the smaller the ALFF of the left superior temporal gyrus/insula/rolandic operculum (Rho = 0.-492, P = 0.020). The longer the illness duration in OCD group, the higher the ALFF of the right supramarginal gyrus/inferior parietal lobule (Rho = 0.392, P = 0.043) and the left postcentral gyrus (Rho = 0.385, P = 0.048), and the lower the DC of the right inferior parietal lobule/angular gyrus (Rho = - 0.518, P = 0.006).

CONCLUSION

SZ and OCD show some similarities in spontaneous brain activity in parietal and occipital lobes, but exhibit different patterns of spontaneous brain activity in frontal, temporal, parietal, occipital, and insula brain regions, which might imply different underlying neurobiological mechanisms in the two diseases. Compared with OCD, SZ implicates more significant abnormalities in the functional connections among brain regions.

Audiovisual incongruence differentially impacts left and right hemisphere sensorimotor oscillations: Potential applications to production

Speech production gives rise to distinct auditory and somatosensory feedback signals which are dynamically integrated to enable online monitoring and error correction, though it remains unclear how the sensorimotor system supports the integration of these multimodal signals. Capitalizing on the parity of sensorimotor processes supporting perception and production, the current study employed the McGurk paradigm to induce multimodal sensory congruence/incongruence. EEG data from a cohort of 39 typical speakers were decomposed with independent component analysis to identify bilateral mu rhythms; indices of sensorimotor activity. Subsequent time-frequency analyses revealed bilateral patterns of event related desynchronization (ERD) across alpha and beta frequency ranges over the time course of perceptual events. Right mu activity was characterized by reduced ERD during all cases of audiovisual incongruence, while left mu activity was attenuated and protracted in McGurk trials eliciting sensory fusion. Results were interpreted to suggest distinct hemispheric contributions, with right hemisphere mu activity supporting a coarse incongruence detection process and left hemisphere mu activity reflecting a more granular level of analysis including phonological identification and incongruence resolution. Findings are also considered in regard to incongruence detection and resolution processes during production.

Neural Correlates of Modality-Sensitive Deviance Detection in the Audiovisual Oddball Paradigm

The McGurk effect, an incongruent pairing of visual /ga/–acoustic /ba/, creates a fusion illusion /da/ and is the cornerstone of research in audiovisual speech perception. Combination illusions occur given reversal of the input modalities—auditory /ga/-visual /ba/, and percept /bga/. A robust literature shows that fusion illusions in an oddball paradigm evoke a mismatch negativity (MMN) in the auditory cortex, in absence of changes to acoustic stimuli. We compared fusion and combination illusions in a passive oddball paradigm to further examine the influence of visual and auditory aspects of incongruent speech stimuli on the audiovisual MMN. Participants viewed videos under two audiovisual illusion conditions: fusion with visual aspect of the stimulus changing, and combination with auditory aspect of the stimulus changing, as well as two unimodal auditory- and visual-only conditions. Fusion and combination deviants exerted similar influence in generating congruency predictions with significant differences between standards and deviants in the N100 time window. Presence of the MMN in early and late time windows differentiated fusion from combination deviants. When the visual signal changes, a new percept is created, but when the visual is held constant and the auditory changes, the response is suppressed, evoking a later MMN. In alignment with models of predictive processing in audiovisual speech perception, we interpreted our results to indicate that visual information can both predict and suppress auditory speech perception.

Electrophysiological Indexes of Incongruent Audiovisual Phonemic Processing: Unraveling the McGurk Effect

In this study the timing of electromagnetic signals recorded during incongruent and congruent audiovisual (AV) stimulation in 14 Italian healthy volunteers was examined. In a previous study (Proverbio et al., 2016) we investigated the McGurk effect in the Italian language and found out which visual and auditory inputs provided the most compelling illusory effects (e.g., bilabial phonemes presented acoustically and paired with non-labials, especially alveolar-nasal and velar-occlusive phonemes). In this study EEG was recorded from 128 scalp sites while participants observed a female and a male actor uttering 288 syllables selected on the basis of the previous investigation (lasting approximately 600 ms) and responded to rare targets (/re/, /ri/, /ro/, /ru/). In half of the cases the AV information was incongruent, except for targets that were always congruent. A pMMN (phonological Mismatch Negativity) to incongruent AV stimuli was identified 500 ms after voice onset time. This automatic response indexed the detection of an incongruity between the labial and phonetic information. SwLORETA (Low-Resolution Electromagnetic Tomography) analysis applied to the difference voltage incongruent-congruent in the same time window revealed that the strongest sources of this activity were the right superior temporal (STG) and superior frontal gyri, which supports their involvement in AV integration.

Spatio-temporal distribution of brain activity associated with audio-visually congruent and incongruent speech and the McGurk Effect

INTRODUCTION

Spatio-temporal distributions of cortical activity to audio-visual presentations of meaningless vowel-consonant-vowels and the effects of audio-visual congruence/incongruence, with emphasis on the McGurk effect, were studied. The McGurk effect occurs when a clearly audible syllable with one consonant, is presented simultaneously with a visual presentation of a face articulating a syllable with a different consonant and the resulting percept is a syllable with a consonant other than the auditorily presented one.

METHODS

Twenty subjects listened to pairs of audio-visually congruent or incongruent utterances and indicated whether pair members were the same or not. Source current densities of event-related potentials to the first utterance in the pair were estimated and effects of stimulus-response combinations, brain area, hemisphere, and clarity of visual articulation were assessed.

RESULTS

Auditory cortex, superior parietal cortex, and middle temporal cortex were the most consistently involved areas across experimental conditions. Early (<200 msec) processing of the consonant was overall prominent in the left hemisphere, except right hemisphere prominence in superior parietal cortex and secondary visual cortex. Clarity of visual articulation impacted activity in secondary visual cortex and Wernicke's area. McGurk perception was associated with decreased activity in primary and secondary auditory cortices and Wernicke's area before 100 msec, increased activity around 100 msec which decreased again around 180 msec. Activity in Broca's area was unaffected by McGurk perception and was only increased to congruent audio-visual stimuli 30-70 msec following consonant onset.

CONCLUSIONS

The results suggest left hemisphere prominence in the effects of stimulus and response conditions on eight brain areas involved in dynamically distributed parallel processing of audio-visual integration. Initially (30-70 msec) subcortical contributions to auditory cortex, superior parietal cortex, and middle temporal cortex occur. During 100-140 msec, peristriate visual influences and Wernicke's area join in the processing. Resolution of incongruent audio-visual inputs is then attempted, and if successful, McGurk perception occurs and cortical activity in left hemisphere further increases between 170 and 260 msec.