Neural processes for live pro-social dialogue between dyads with socioeconomic disparity

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Neural mechanisms for emotional contagion and spontaneous mimicry of live facial expressions

Viewing a live facial expression typically elicits a similar expression by the observer (facial mimicry) that is associated with a concordant emotional experience (emotional contagion). The model of embodied emotion proposes that emotional contagion and facial mimicry are functionally linked although the neural underpinnings are not known. To address this knowledge gap, we employed a live two-person paradigm (n = 20 dyads) using functional near-infrared spectroscopy during live emotive face-processing while also measuring eye-tracking, facial classifications and ratings of emotion. One dyadic partner, 'Movie Watcher', was instructed to emote natural facial expressions while viewing evocative short movie clips. The other dyadic partner, 'Face Watcher', viewed the Movie Watcher's face. Task and rest blocks were implemented by timed epochs of clear and opaque glass that separated partners. Dyadic roles were alternated during the experiment. Mean cross-partner correlations of facial expressions (r = 0.36 ± 0.11 s.e.m.) and mean cross-partner affect ratings (r = 0.67 ± 0.04) were consistent with facial mimicry and emotional contagion, respectively. Neural correlates of emotional contagion based on covariates of partner affect ratings included angular and supramarginal gyri, whereas neural correlates of the live facial action units included motor cortex and ventral face-processing areas. Findings suggest distinct neural components for facial mimicry and emotional contagion. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Delta-Alpha EEG pattern reflects the interoceptive focus effect on interpersonal motor synchronization

Little is known about how the modulation of the interoceptive focus impacts the neural correlates of high-level social processes, such as synchronization mechanisms. Therefore, the current study aims to explore the intraindividual electrophysiological (EEG) patterns induced by the interoceptive focus on breath when performing cognitive and motor tasks requiring interpersonal synchronization. A sample of 28 healthy caucasian adults was recruited and asked to perform two tasks requiring interpersonal synchronization during two distinct conditions: while focusing on the breath or without the focus on the breath. EEG frequency bands (delta, theta, alpha, and beta band) were recorded from the frontal, temporo-central, and parieto-occipital regions of interest. Significant results were observed for the delta and alpha bands. Notably, higher mean delta values and alpha desynchronization were observed in the temporo-central area during the focus on the breath condition when performing the motor compared to the cognitive synchronization task. Taken together these results could be interpreted considering the functional meaning of delta and alpha band in relation to motor synchronization. Indeed, motor delta oscillations shape the dynamics of motor behaviors and motor neural processes, while alpha band attenuation was previously observed during generation, observation, and imagery of movement and is considered to reflect cortical motor activity and action-perception coupling. Overall, the research shows that an EEG delta-alpha pattern emerges in the temporo-central areas at the intra-individual level, indicating the attention to visceral signals, particularly during interpersonal motor synchrony.

Neural and behavioral alterations of a real-time interpersonal distance (IPD) development process in differing social status interactions

Background

Evidence showed neural changes in interpersonal distance (IPD) interaction, and neural activities are affected by relationships (such as friends or strangers). Behavior studies proved that social status strongly affects IPD between two persons. However, how the differing social status impacts neural alterations in the IPD interactions remains unknown.

Objectives

The teacher-student relationship is a typical representation of the difference in social status. The present study aims to investigate the IPD performance and brain processes underlying real-time differing social status during the development process from teacher-student interactions.

Materials and methods

We designed three within-subject experiments corresponding to the inclusion, control, and affection stages of IPD. Altogether, 38 valid healthy participants participated in three experiments with a teacher (differing social status condition, DS condition) and a peer student (peer social status condition, PS condition) separately. This study employed functional near-infrared spectroscopy (fNIRS) and modified real-time stop-distance paradigms to record IPD performance and neural processes.

Results

For IPD performance, significantly larger IPD gaps were shown in the DS condition than in the PS condition, and IPD feedback affected IPD performance. For neural alterations, activated frontopolar area (FPA, BA10), dorsolateral prefrontal cortex (DLPFC, BA9/BA46), and Broca’s area (BA45) were observed across the IPD stages. Importantly, brain activation shifts with the development of IPD. In addition, results showed that differences in Oxy-Hb changes were located in the FPA (BA10), DLPFC (BA9/BA46), and Broca’s area (BA45) between the DS and PS conditions across IPD stages. Additionally, negative correlations were found between Oxy-Hb changes and IPD performance.

Conclusion

We propose prefrontal cortex (PFC) and Broca’s area involvement in IPD interactions, initially focusing on evaluation and action periods, and later on IPD-evaluation processes after feedback. In addition, a difference in Oxy-Hb activities implies the complexity of relationships and social status in IPD interactions.

EEG brain oscillations are modulated by interoception in response to a synchronized motor vs. cognitive task

So far, little is known about how conscious attention to internal body signals, that is, interoception, affects the synchronization with another person, a necessary or required social process that promotes affiliations and cooperation during daily joint social interactions. The effect of explicit interoceptive attentiveness (IA) modulation, conceived as the focus on the breath for a given time interval, on electrophysiological (EEG) correlates during an interpersonal motor task compared with a cognitive synchronization task was investigated in this study. A total of 28 healthy participants performed a motor and a cognitive synchronization task during the focus and no-focus breath conditions. During the tasks, frequency bands (delta, theta, alpha, and beta bands) from the frontal, temporo-central, and parieto-occipital regions of interest (ROIs) were acquired. According to the results, significantly higher delta and theta power were found in the focus condition in the frontal ROI during the execution of the motor than the cognitive synchronization task. Moreover, in the same experimental condition, delta and beta band power increased in the temporo-central ROI. The current study suggested two main patterns of frequency band modulation during the execution of a motor compared with the cognitive synchronization task while a person is focusing the attention on one's breath. This study can be considered as the first attempt to classify the different effects of interoceptive manipulation on motor and cognitive synchronization tasks using neurophysiological measures.

Regional Brain Volume Changes in Catholic Nuns: A Cross-Sectional Study Using Deep Learning-Based Brain MRI Segmentation

OBJECTIVE

Religious behaviors are considered as complex brain-based phenomena that may be associated with structural brain change. To identify the pattern of regional brain volume change in nuns, we investigated structural alterations in the brains of nuns using a fast processing automated segmentation method based on deep learning algorithms.

METHODS

We retrospectively reviewed the medical records of the catholic sisters between the ages of 31 and 80 who are members of the charity of St. Vincent de Paul of Korea. A total of 193 asymptomatic subjects (86 nuns and 107 control subjects) received comprehensive health screening and underwent brain MRI scans. We compared cortical and sub-cortical volume between groups across multiple locations using our in-house U-Net++ deep learning-based automatic segmentation tool.

RESULTS

Compared to the control group, the nun group displayed increased gray matter volume in the right lingual cortex, left isthmus-cingulate, posterior-cingulate, rostral-middle-frontal, superior-frontal, supramarginal, temporal-pole cortices, and bilateral pars-triangularis cortices after correction for multiple comparisons. On the other hand, the nun group showed reduced gray matter volume in the temporal and parietal regions relative to healthy controls.

CONCLUSION

Our study suggests that spiritual practice may affect brain structure, especially in several frontal regions involved in a higher level of insight function.

Activation in Right Dorsolateral Prefrontal Cortex Underlies Stuttering Anticipation

People who stutter learn to anticipate many of their overt stuttering events. Despite the critical role of anticipation, particularly how responses to anticipation shape stuttering behaviors, the neural bases associated with anticipation are unknown. We used a novel approach to identify anticipated and unanticipated words, which were produced by 22 adult stutterers in a delayed-response task while hemodynamic activity was measured using functional near infrared spectroscopy (fNIRS). Twenty-two control participants were included such that each individualized set of anticipated and unanticipated words was produced by one stutterer and one control participant. We conducted an analysis on the right dorsolateral prefrontal cortex (R-DLPFC) based on converging lines of evidence from the stuttering and cognitive control literatures. We also assessed connectivity between the R-DLPFC and right supramarginal gyrus (R-SMG), two key nodes of the frontoparietal network (FPN), to assess the role of cognitive control, and particularly error-likelihood monitoring, in stuttering anticipation. All analyses focused on the five-second anticipation phase preceding the go signal to produce speech. The results indicate that anticipated words are associated with elevated activation in the R-DLPFC, and that compared to non-stutterers, stutterers exhibit greater activity in the R-DLPFC, irrespective of anticipation. Further, anticipated words are associated with reduced connectivity between the R-DLPFC and R-SMG. These findings highlight the potential roles of the R-DLPFC and the greater FPN as a neural substrate of stuttering anticipation. The results also support previous accounts of error-likelihood monitoring and action-stopping in stuttering anticipation. Overall, this work offers numerous directions for future research with clinical implications for targeted neuromodulation.

Lawrence K, Tachtsidis I, Tong Y, Torricelli A, Urner T, Wabnitz H, Wolf M, Wolf U, Xu S, Yang C, Yodh AG, Yücel MA, Zhou W. Optical imaging and spectroscopy for the study of the human brain: status report

This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.

Interoceptive Attentiveness Induces Significantly More PFC Activation during a Synchronized Linguistic Task Compared to a Motor Task as Revealed by Functional Near-Infrared Spectroscopy

Currently, there is little understanding of how interoceptive attentiveness (IA) affects brain responses during synchronized cognitive or motor tasks. This pilot study explored the effect of explicit IA manipulation on hemodynamic correlates of simple cognitive tasks implying linguistic or motor synchronization. Eighteen healthy participants completed two linguistic and motor synchronization tasks during explicit IA and control conditions while oxygenated (O2Hb) and deoxygenated (HHb) hemoglobin variations were recorded by functional Near-Infrared Spectroscopy (fNIRS). The findings suggested that the brain regions associated with sustained attention, such as the right prefrontal cortex (PFC), were more involved when an explicit focus on the breath was induced during the cognitive linguistic task requiring synchronization with a partner, as indicated by increased O2Hb. Interestingly, this effect was not significant for the motor task. In conclusion, for the first time, this pilot research found increased activity in neuroanatomical regions that promote sustained attention, attention reorientation, and synchronization when a joint task is carried out and the person is focusing on their physiological body reactions. Moreover, the results suggested that the benefits of conscious concentration on physiological interoceptive correlates while executing a task demanding synchronization, particularly verbal alignment, may be related to the right PFC.

Investigating Language and Domain-General Processing in Neurotypicals and Individuals With Aphasia - A Functional Near-Infrared Spectroscopy Pilot Study

Brain reorganization patterns associated with language recovery after stroke have long been debated. Studying mechanisms of spontaneous and treatment-induced language recovery in post-stroke aphasia requires a network-based approach given the potential for recruitment of perilesional left hemisphere language regions, homologous right hemisphere language regions, and/or spared bilateral domain-general regions. Recent hardware, software, and methodological advances in functional near-infrared spectroscopy (fNIRS) make it well-suited to examine this question. fNIRS is cost-effective with minimal contraindications, making it a robust option to monitor treatment-related brain activation changes over time. Establishing clear activation patterns in neurotypical adults during language and domain-general cognitive processes via fNIRS is an important first step. Some fNIRS studies have investigated key language processes in healthy adults, yet findings are challenging to interpret in the context of methodological limitations. This pilot study used fNIRS to capture brain activation during language and domain-general processing in neurotypicals and individuals with aphasia. These findings will serve as a reference when interpreting treatment-related changes in brain activation patterns in post-stroke aphasia in the future. Twenty-four young healthy controls, seventeen older healthy controls, and six individuals with left hemisphere stroke-induced aphasia completed two language tasks (i.e., semantic feature, picture naming) and one domain-general cognitive task (i.e., arithmetic) twice during fNIRS. The probe covered bilateral frontal, parietal, and temporal lobes and included short-separation detectors for scalp signal nuisance regression. Younger and older healthy controls activated core language regions during semantic feature processing (e.g., left inferior frontal gyrus pars opercularis) and lexical retrieval (e.g., left inferior frontal gyrus pars triangularis) and domain-general regions (e.g., bilateral middle frontal gyri) during hard versus easy arithmetic as expected. Consistent with theories of post-stroke language recovery, individuals with aphasia activated areas outside the traditional networks: left superior frontal gyrus and left supramarginal gyrus during semantic feature judgment; left superior frontal gyrus and right precentral gyrus during picture naming; and left inferior frontal gyrus pars opercularis during arithmetic processing. The preliminary findings in the stroke group highlight the utility of using fNIRS to study language and domain-general processing in aphasia.

Bidirectional Connectivity Between Broca's Area and Wernicke's Area During Interactive Verbal Communication

Aim: This investigation aims to advance the understanding of neural dynamics that underlies live and natural interactions during spoken dialogue between two individuals. Introduction: The underlying hypothesis is that functional connectivity between canonical speech areas in the human brain will be modulated by social interaction. Methods: Granger causality was applied to compare directional connectivity across Broca's and Wernicke's areas during verbal conditions consisting of interactive and noninteractive communication. Thirty-three pairs of healthy adult participants alternately talked and listened to each other while performing an object naming and description task that was either interactive or not during hyperscanning with functional near-infrared spectroscopy (fNIRS). In the noninteractive condition, the speaker named and described a picture-object without reference to the partner's description. In the interactive condition, the speaker performed the same task but included an interactive response about the preceding comments of the partner. Causality measures of hemodynamic responses from Broca's and Wernicke's areas were compared between real, surrogate, and shuffled trials within dyads. Results: The interactive communication was characterized by bidirectional connectivity between Wernicke's and Broca's areas of the listener's brain. Whereas this connectivity was unidirectional in the speaker's brain. In the case of the noninteractive condition, both speaker's and listener's brains showed unidirectional top-down (Broca's area to Wernicke's area) connectivity. Conclusion: Together, directional connectivity as determined by Granger analysis reveals bidirectional flow of neuronal information during dynamic two-person verbal interaction for processes that are active during listening (reception) and not during talking (production). Findings are consistent with prior contrast findings (general linear model) showing neural modulation of the receptive language system associated with Wernicke's area during a two-person live interaction. Impact statement The neural dynamics that underlies real-life social interactions is an emergent topic of interest. Dynamically coupled cross-brain neural mechanisms between interacting partners during verbal dialogue have been shown within Wernicke's area. However, it is not known how within-brain long-range neural mechanisms operate during these live social functions. Using Granger causality analysis, we show bidirectional neural activity between Broca's and Wernicke's areas during interactive dialogue compared with a noninteractive control task showing only unidirectional activity. Findings are consistent with an Interactive Brain Model where long-range neural mechanisms process interactive processes associated with rapid and spontaneous spoken social cues.

Interpersonal Agreement and Disagreement During Face-to-Face Dialogue: An fNIRS Investigation

Although the neural systems that underlie spoken language are well-known, how they adapt to evolving social cues during natural conversations remains an unanswered question. In this work we investigate the neural correlates of face-to-face conversations between two individuals using functional near infrared spectroscopy (fNIRS) and acoustical analyses of concurrent audio recordings. Nineteen pairs of healthy adults engaged in live discussions on two controversial topics where their opinions were either in agreement or disagreement. Participants were matched according to their a priori opinions on these topics as assessed by questionnaire. Acoustic measures of the recorded speech including the fundamental frequency range, median fundamental frequency, syllable rate, and acoustic energy were elevated during disagreement relative to agreement. Consistent with both the a priori opinion ratings and the acoustic findings, neural activity associated with long-range functional networks, rather than the canonical language areas, was also differentiated by the two conditions. Specifically, the frontoparietal system including bilateral dorsolateral prefrontal cortex, left supramarginal gyrus, angular gyrus, and superior temporal gyrus showed increased activity while talking during disagreement. In contrast, talking during agreement was characterized by increased activity in a social and attention network including right supramarginal gyrus, bilateral frontal eye-fields, and left frontopolar regions. Further, these social and visual attention networks were more synchronous across brains during agreement than disagreement. Rather than localized modulation of the canonical language system, these findings are most consistent with a model of distributed and adaptive language-related processes including cross-brain neural coupling that serves dynamic verbal exchanges.

Comparison of short-channel separation and spatial domain filtering for removal of non-neural components in functional near-infrared spectroscopy signals

Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. Aim: We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. Approach: We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels. For short-channel temporal regression, we compare non-neural signal removal using first and combined first and second PCs from a broad distribution of short channels to limited distribution on the forehead. Results: Temporal regression of non-neural information from broadly distributed short channels did not differ from forehead-only distribution. Spatial PC filtering provides results similar to short-channel separation using the temporal domain. Utilizing both first and second PCs from short channels removes additional non-neural information. Conclusions: We conclude that short-channel information in the temporal domain and spatial domain regression filtering methods remove similar non-neural components represented in scalp hemodynamics from fNIRS signals and that either technique is sufficient to remove non-neural components.