1
|
Zhang Y, Wu P, Xie S, Hou Y, Wu H, Shi H. The neural mechanism of communication between graduate students and advisers in different adviser-advisee relationships. Sci Rep 2024; 14:11741. [PMID: 38778035 PMCID: PMC11111769 DOI: 10.1038/s41598-024-58308-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Accepted: 03/27/2024] [Indexed: 05/25/2024] Open
Abstract
Communication is crucial in constructing the relationship between students and advisers, ultimately bridging interpersonal interactions. Only a few studies however explore the communication between postgraduate students and advisers. To fill the gaps in the empirical researches, this study uses functional near-infrared spectroscopy (FNIRS) techniques to explore the neurophysiology differences in brain activation of postgraduates with different adviser-advise relationships during simulated communication with their advisers. Results showed significant differences in the activation of the prefrontal cortex between high-quality and the low-quality students during simulating and when communicating with advisers, specifically in the Broca's areas, the frontal pole, and the orbitofrontal and dorsolateral prefrontal cortices. This further elucidated the complex cognitive process of communication between graduate students and advisers.
Collapse
Affiliation(s)
- Yan Zhang
- School of Education, Huazhong University of Science and Technology, Wuhan, 430074, Hubei, China
- Research Center for Innovative Education and Critical Thinking, Huazhong University of Science and Technology, Wuhan, 430074, Hubei, China
| | - Peipei Wu
- School of Education, Huazhong University of Science and Technology, Wuhan, 430074, Hubei, China
| | - Simiao Xie
- School of Education, Huazhong University of Science and Technology, Wuhan, 430074, Hubei, China
- Mental Health Education Center, Jinan University, Guangzhou, 510631, Guangdong, China
| | - Yan Hou
- School of Education, Huazhong University of Science and Technology, Wuhan, 430074, Hubei, China
- Mental Health Education Center, Hubei University for Nationalities, Enshi, 450004, Hubei, China
| | - Huifen Wu
- School of Education, Hubei Engineering University, Xiaogan, 432100, Hubei, China.
| | - Hui Shi
- Department of Clinical Psychology, Beijing Chao-Yang Hospital, Capital Medical University, Beijing, 100020, China.
| |
Collapse
|
2
|
Green GD, Jacewicz E, Santosa H, Arzbecker LJ, Fox RA. Evaluating Speaker-Listener Cognitive Effort in Speech Communication Through Brain-to-Brain Synchrony: A Pilot Functional Near-Infrared Spectroscopy Investigation. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:1339-1359. [PMID: 38535722 DOI: 10.1044/2024_jslhr-23-00476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2024]
Abstract
PURPOSE We explore a new approach to the study of cognitive effort involved in listening to speech by measuring the brain activity in a listener in relation to the brain activity in a speaker. We hypothesize that the strength of this brain-to-brain synchrony (coupling) reflects the magnitude of cognitive effort involved in verbal communication and includes both listening effort and speaking effort. We investigate whether interbrain synchrony is greater in native-to-native versus native-to-nonnative communication using functional near-infrared spectroscopy (fNIRS). METHOD Two speakers participated, a native speaker of American English and a native speaker of Korean who spoke English as a second language. Each speaker was fitted with the fNIRS cap and told short stories. The native English speaker provided the English narratives, and the Korean speaker provided both the nonnative (accented) English and Korean narratives. In separate sessions, fNIRS data were obtained from seven English monolingual participants ages 20-24 years who listened to each speaker's stories. After listening to each story in native and nonnative English, they retold the content, and their transcripts and audio recordings were analyzed for comprehension and discourse fluency, measured in the number of hesitations and articulation rate. No story retellings were obtained for narratives in Korean (an incomprehensible language for English listeners). Utilizing fNIRS technique termed sequential scanning, we quantified the brain-to-brain synchronization in each speaker-listener dyad. RESULTS For native-to-native dyads, multiple brain regions associated with various linguistic and executive functions were activated. There was a weaker coupling for native-to-nonnative dyads, and only the brain regions associated with higher order cognitive processes and functions were synchronized. All listeners understood the content of all stories, but they hesitated significantly more when retelling stories told in accented English. The nonnative speaker hesitated significantly more often than the native speaker and had a significantly slower articulation rate. There was no brain-to-brain coupling during listening to Korean, indicating a break in communication when listeners failed to comprehend the speaker. CONCLUSIONS We found that effortful speech processing decreased interbrain synchrony and delayed comprehension processes. The obtained brain-based and behavioral patterns are consistent with our proposal that cognitive effort in verbal communication pertains to both the listener and the speaker and that brain-to-brain synchrony can be an indicator of differences in their cumulative communicative effort. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.25452142.
Collapse
Affiliation(s)
- Geoff D Green
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | - Ewa Jacewicz
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | | | - Lian J Arzbecker
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | - Robert A Fox
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| |
Collapse
|
3
|
Liu Y, Zhang Y, Zhong Y, Liu J, Zhang C, Meng Y, Pang N, Cheng X, Wang H. Favoritism or bias? Cooperation and competition under different intergroup relationships: evidence from EEG hyperscanning. Cereb Cortex 2024; 34:bhae131. [PMID: 38566514 DOI: 10.1093/cercor/bhae131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Revised: 03/08/2024] [Accepted: 03/09/2024] [Indexed: 04/04/2024] Open
Abstract
Cooperation and competition are the most common forms of social interaction in various social relationships. Intergroup relationships have been posited to influence individuals' interpersonal interactions significantly. Using electroencephalography hyperscanning, this study aimed to establish whether intergroup relationships influence interpersonal cooperation and competition and the underlying neural mechanisms. According to the results, the in-group Coop-index is better than the out-group, whereas the out-group Comp-index is stronger than the in-group. The in-group functional connectivity between the frontal-central region and the right temporoparietal junction in the β band was stronger in competition than cooperation. The out-group functional connectivity between the frontal-central region and the left temporoparietal junction in the α band was stronger in cooperation than competition. In both cooperation and competition, the in-group exhibited higher interbrain synchronization between the prefrontal cortex and parietal region in the θ band, as well as between the frontal-central region and frontal-central region in the α band, compared to the out-group. The intrabrain phase-locking value in both the α and β bands can effectively predict performance in competition tasks. Interbrain phase-locking value in both the α and θ bands can be effectively predicted in a performance cooperation task. This study offers neuroscientific evidence for in-group favoritism and out-group bias at an interpersonal level.
Collapse
Affiliation(s)
- Yingjie Liu
- School of Psychology and Mental Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
- School of Public Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
| | - Ye Zhang
- School of Psychology and Mental Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
| | - Yifei Zhong
- School of Psychology and Mental Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
| | - Jingyue Liu
- School of Psychology and Mental Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
| | - Chenyu Zhang
- School of Psychology and Mental Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
| | - Yujia Meng
- School of Psychology and Mental Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
| | - Nan Pang
- School of Psychology and Mental Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
| | - Xuemei Cheng
- Department of Mechanical and Electrical Engineering, Beijing Polytechnic, 100081
| | - He Wang
- School of Psychology and Mental Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
- School of Public Health, North China University of Science and Technology, 21 Bohai avenue, Caofeidian district, Tangshan, Hebei province 063210, China
| |
Collapse
|
4
|
Schwartz L, Levy J, Hayut O, Netzer O, Endevelt-Shapira Y, Feldman R. Generation WhatsApp: inter-brain synchrony during face-to-face and texting communication. Sci Rep 2024; 14:2672. [PMID: 38302582 PMCID: PMC10834538 DOI: 10.1038/s41598-024-52587-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Accepted: 01/20/2024] [Indexed: 02/03/2024] Open
Abstract
Texting has become one of the most prevalent ways to interact socially, particularly among youth; however, the effects of text messaging on social brain functioning are unknown. Guided by the biobehavioral synchrony frame, this pre-registered study utilized hyperscanning EEG to evaluate interbrain synchrony during face-to-face versus texting interactions. Participants included 65 mother-adolescent dyads observed during face-to-face conversation compared to texting from different rooms. Results indicate that both face-to-face and texting communication elicit significant neural synchrony compared to surrogate data, demonstrating for the first time brain-to-brain synchrony during texting. Direct comparison between the two interactions highlighted 8 fronto-temporal interbrain links that were significantly stronger in the face-to-face interaction compared to texting. Our findings suggest that partners co-create a fronto-temporal network of inter-brain connections during live social exchanges. The degree of improvement in the partners' right-frontal-right-frontal connectivity from texting to the live social interaction correlated with greater behavioral synchrony, suggesting that this well-researched neural connection may be specific to face-to-face communication. Our findings suggest that while technology-based communication allows humans to synchronize from afar, face-to-face interactions remain the superior mode of communication for interpersonal connection. We conclude by discussing the potential benefits and drawbacks of the pervasive use of texting, particularly among youth.
Collapse
Affiliation(s)
- Linoy Schwartz
- Center for Developmental, Social, and Relationship Neuroscience, Reichman University, Herzliya, Israel
| | - Jonathan Levy
- Center for Developmental, Social, and Relationship Neuroscience, Reichman University, Herzliya, Israel
- Department of Criminology and Gonda Brain Research Center, Bar-Ilan University, Ramat-Gan, Israel
| | - Olga Hayut
- Center for Developmental, Social, and Relationship Neuroscience, Reichman University, Herzliya, Israel
| | - Ofir Netzer
- Center for Developmental, Social, and Relationship Neuroscience, Reichman University, Herzliya, Israel
| | - Yaara Endevelt-Shapira
- Center for Developmental, Social, and Relationship Neuroscience, Reichman University, Herzliya, Israel
| | - Ruth Feldman
- Center for Developmental, Social, and Relationship Neuroscience, Reichman University, Herzliya, Israel.
- Child Study Center, Yale University, New Haven, USA.
| |
Collapse
|
5
|
Harris LT. The Neuroscience of Human and Artificial Intelligence Presence. Annu Rev Psychol 2024; 75:433-466. [PMID: 37906951 DOI: 10.1146/annurev-psych-013123-123421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2023]
Abstract
Two decades of social neuroscience and neuroeconomics research illustrate the brain mechanisms that are engaged when people consider human beings, often in comparison to considering artificial intelligence (AI) as a nonhuman control. AI as an experimental control preserves agency and facilitates social interactions but lacks a human presence, providing insight into brain mechanisms that are engaged by human presence and the presence of AI. Here, I review this literature to determine how the brain instantiates human and AI presence across social perception and decision-making paradigms commonly used to realize a social context. People behave toward humans differently than they do toward AI. Moreover, brain regions more engaged by humans compared to AI extend beyond the social cognition brain network to all parts of the brain, and the brain sometimes is engaged more by AI than by humans. Finally, I discuss gaps in the literature, limitations in current neuroscience approaches, and how an understanding of the brain correlates of human and AI presence can inform social science in the wild.
Collapse
Affiliation(s)
- Lasana T Harris
- Department of Experimental Psychology, University College London, London, United Kingdom;
- Alan Turing Institute, London, United Kingdom
| |
Collapse
|
6
|
Hakim U, De Felice S, Pinti P, Zhang X, Noah JA, Ono Y, Burgess PW, Hamilton A, Hirsch J, Tachtsidis I. Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies. Neuroimage 2023; 280:120354. [PMID: 37666393 DOI: 10.1016/j.neuroimage.2023.120354] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2023] [Revised: 08/25/2023] [Accepted: 08/28/2023] [Indexed: 09/06/2023] Open
Abstract
Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.
Collapse
Affiliation(s)
- U Hakim
- Department of Medical Physics and Biomedical Engineering, University College London, Malet Place Engineering Building, Gower Street, London WC1E 6BT, United Kingdom.
| | - S De Felice
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom; Department of Psychology, University of Cambridge, United Kingdom
| | - P Pinti
- Department of Medical Physics and Biomedical Engineering, University College London, Malet Place Engineering Building, Gower Street, London WC1E 6BT, United Kingdom; Centre for Brain and Cognitive Development, Birkbeck, University of London, London, United Kingdom
| | - X Zhang
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - J A Noah
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Y Ono
- Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, Kawasaki, Kanagawa, Japan
| | - P W Burgess
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - A Hamilton
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - J Hirsch
- Department of Medical Physics and Biomedical Engineering, University College London, Malet Place Engineering Building, Gower Street, London WC1E 6BT, United Kingdom; Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States; Departments of Neuroscience and Comparative Medicine, Yale School of Medicine, New Haven, CT, United States; Yale University, Wu Tsai Institute, New Haven, CT, United States
| | - I Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, Malet Place Engineering Building, Gower Street, London WC1E 6BT, United Kingdom
| |
Collapse
|
7
|
Hirsch J, Zhang X, Noah JA, Bhattacharya A. Neural mechanisms for emotional contagion and spontaneous mimicry of live facial expressions. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210472. [PMID: 36871593 PMCID: PMC9985973 DOI: 10.1098/rstb.2021.0472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Accepted: 01/16/2023] [Indexed: 03/07/2023] Open
Abstract
Viewing a live facial expression typically elicits a similar expression by the observer (facial mimicry) that is associated with a concordant emotional experience (emotional contagion). The model of embodied emotion proposes that emotional contagion and facial mimicry are functionally linked although the neural underpinnings are not known. To address this knowledge gap, we employed a live two-person paradigm (n = 20 dyads) using functional near-infrared spectroscopy during live emotive face-processing while also measuring eye-tracking, facial classifications and ratings of emotion. One dyadic partner, 'Movie Watcher', was instructed to emote natural facial expressions while viewing evocative short movie clips. The other dyadic partner, 'Face Watcher', viewed the Movie Watcher's face. Task and rest blocks were implemented by timed epochs of clear and opaque glass that separated partners. Dyadic roles were alternated during the experiment. Mean cross-partner correlations of facial expressions (r = 0.36 ± 0.11 s.e.m.) and mean cross-partner affect ratings (r = 0.67 ± 0.04) were consistent with facial mimicry and emotional contagion, respectively. Neural correlates of emotional contagion based on covariates of partner affect ratings included angular and supramarginal gyri, whereas neural correlates of the live facial action units included motor cortex and ventral face-processing areas. Findings suggest distinct neural components for facial mimicry and emotional contagion. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.
Collapse
Affiliation(s)
- Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
- Department of Neuroscience, Yale School of Medicine, New Haven, CT 06511, USA
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT 06511, USA
- Wu Tsai Institute, Yale University, PO Box 208091, New Haven, CT 06520, USA
- Haskins Laboratories, 300 George Street, New Haven, CT 06511, USA
- Department of Medical Physics and Biomedical Engineering, University College London, London WC1E 6BT, UK
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT 06511, USA
| | | |
Collapse
|
8
|
Zhang Q, Liu Z, Qian H, Hu Y, Gao X. Interpersonal Competition in Elderly Couples: A Functional Near-Infrared Spectroscopy Hyperscanning Study. Brain Sci 2023; 13:brainsci13040600. [PMID: 37190565 DOI: 10.3390/brainsci13040600] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2023] [Revised: 03/14/2023] [Accepted: 03/29/2023] [Indexed: 04/05/2023] Open
Abstract
Elderly people tend not to compete with others, and if they do, the mechanism behind the competition is not clear. In this study, groups of elderly couples and matched cross-sex controls were recruited to perform a competitive button-pressing task, while their brain signals were simultaneously collected using functional near-infrared spectroscopy (fNIRS) hyperscanning. Several fundamental observations were made. First, controls showed attenuated interpersonal competition across task processes, but couples held the competition with each other. Second, couples demonstrated increased inter-brain synchronization (IBS) between the middle temporal cortex and the temporoparietal junction across task processes. Third, Granger causality analysis in couples revealed significant differences between the directions (i.e., from men to women, and from women to men) in the first half of the competitive task, whereas there was no significant difference in the second half. Finally, the groups of couples and controls could be successfully discriminated against based on IBS by using a machine-learning approach. In sum, these findings indicate that elderly couples can maintain interpersonal competition, and such maintenance might be associated with changes in the IBS of the mentalizing system. It suggests the possible positive impact of long-term spouse relationships on interpersonal interactions, both behaviorally and neurally, in terms of competition.
Collapse
Affiliation(s)
- Qian Zhang
- Department of Psychology, Education College, Shanghai Normal University, Shanghai 200234, China
| | - Zhennan Liu
- Department of Psychology, Education College, Shanghai Normal University, Shanghai 200234, China
| | - Haoyue Qian
- Institute of Neuroscience, Key Laboratory of Primate Neurobiology, CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China
- Shanghai Institute of Early Childhood Education, Shanghai Normal University, Shanghai 200234, China
| | - Yinying Hu
- Department of Psychology, Education College, Shanghai Normal University, Shanghai 200234, China
| | - Xiangping Gao
- Department of Psychology, Education College, Shanghai Normal University, Shanghai 200234, China
| |
Collapse
|
9
|
Parker TC, Zhang X, Noah JA, Tiede M, Scassellati B, Kelley M, McPartland JC, Hirsch J. Neural and visual processing of social gaze cueing in typical and ASD adults. MEDRXIV : THE PREPRINT SERVER FOR HEALTH SCIENCES 2023:2023.01.30.23284243. [PMID: 36778502 PMCID: PMC9915835 DOI: 10.1101/2023.01.30.23284243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Atypical eye gaze in joint attention is a clinical characteristic of autism spectrum disorder (ASD). Despite this documented symptom, neural processing of joint attention tasks in real-life social interactions is not understood. To address this knowledge gap, functional-near infrared spectroscopy (fNIRS) and eye-tracking data were acquired simultaneously as ASD and typically developed (TD) individuals engaged in a gaze-directed joint attention task with a live human and robot partner. We test the hypothesis that face processing deficits in ASD are greater for interactive faces than for simulated (robot) faces. Consistent with prior findings, neural responses during human gaze cueing modulated by face visual dwell time resulted in increased activity of ventral frontal regions in ASD and dorsal parietal systems in TD participants. Hypoactivity of the right dorsal parietal area during live human gaze cueing was correlated with autism spectrum symptom severity: Brief Observations of Symptoms of Autism (BOSA) scores (r = âˆ'0.86). Contrarily, neural activity in response to robot gaze cueing modulated by visual acquisition factors activated dorsal parietal systems in ASD, and this neural activity was not related to autism symptom severity (r = 0.06). These results are consistent with the hypothesis that altered encoding of incoming facial information to the dorsal parietal cortex is specific to live human faces in ASD. These findings open new directions for understanding joint attention difficulties in ASD by providing a connection between superior parietal lobule activity and live interaction with human faces. Lay Summary Little is known about why it is so difficult for autistic individuals to make eye contact with other people. We find that in a live face-to-face viewing task with a robot, the brains of autistic participants were similar to typical participants but not when the partner was a live human. Findings suggest that difficulties in real-life social situations for autistic individuals may be specific to difficulties with live social interaction rather than general face gaze.
Collapse
|
10
|
Russo C, Senese VP. Functional near-infrared spectroscopy is a useful tool for multi-perspective psychobiological study of neurophysiological correlates of parenting behaviour. Eur J Neurosci 2023; 57:258-284. [PMID: 36485015 DOI: 10.1111/ejn.15890] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 12/02/2022] [Accepted: 12/08/2022] [Indexed: 12/13/2022]
Abstract
The quality of the relationship between caregiver and child has long-term effects on the cognitive and socio-emotional development of children. A process involved in human parenting is the bio-behavioural synchrony that occurs between the partners in the relationship during interaction. Through interaction, bio-behavioural synchronicity allows the adaptation of the physiological systems of the parent to those of the child and promotes the positive development and modelling of the child's social brain. The role of bio-behavioural synchrony in building social bonds could be investigated using functional near-infrared spectroscopy (fNIRS). In this paper we have (a) highlighted the importance of the quality of the caregiver-child relationship for the child's cognitive and socio-emotional development, as well as the relevance of infantile stimuli in the activation of parenting behaviour; (b) discussed the tools used in the study of the neurophysiological substrates of the parental response; (c) proposed fNIRS as a particularly suitable tool for the study of parental responses; and (d) underlined the need for a multi-systemic psychobiological approach to understand the mechanisms that regulate caregiver-child interactions and their bio-behavioural synchrony. We propose to adopt a multi-system psychobiological approach to the study of parental behaviour and social interaction.
Collapse
Affiliation(s)
- Carmela Russo
- Psychometric Laboratory, Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | - Vincenzo Paolo Senese
- Psychometric Laboratory, Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| |
Collapse
|
11
|
Schwartz L, Levy J, Endevelt-Shapira Y, Djalovski A, Hayut O, Dumas G, Feldman R. Technologically-assisted communication attenuates inter-brain synchrony. Neuroimage 2022; 264:119677. [PMID: 36244598 DOI: 10.1016/j.neuroimage.2022.119677] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Revised: 10/06/2022] [Accepted: 10/07/2022] [Indexed: 11/06/2022] Open
Abstract
The transition to technologically-assisted communication has permeated all facets of human social life; yet, its impact on the social brain is still unknown and the effects may be particularly intense during periods of developmental transitions. Applying a two-brain perspective, the current preregistered study utilized hyperscanning EEG to measure brain-to-brain synchrony in 62 mother-child pairs at the transition to adolescence (child age; M = 12.26, range 10-14) during live face-to-face interaction versus technologically-assisted remote communication. The live interaction elicited 9 significant cross-brain links between densely inter-connected frontal and temporal areas in the beta range [14-30 Hz]. Mother's right frontal region connected with the child's right and left frontal, temporal, and central regions, suggesting its regulatory role in organizing the two-brain dynamics. In contrast, the remote interaction elicited only 1 significant cross-brain-cross-hemisphere link, attenuating the robust right-to-right-brain connectivity during live social moments that communicates socio-affective signals. Furthermore, while the level of social behavior was comparable between the two interactions, brain-behavior associations emerged only during the live exchange. Mother-child right temporal-temporal synchrony linked with moments of shared gaze and the degree of child engagement and empathic behavior correlated with right frontal-frontal synchrony. Our findings indicate that human co-presence is underpinned by specific neurobiological processes that should be studied in depth. Much further research is needed to tease apart whether the "Zoom fatigue" experienced during technological communication may stem, in part, from overload on more limited inter-brain connections and to address the potential cost of social technology for brain maturation, particularly among youth.
Collapse
Affiliation(s)
- Linoy Schwartz
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel
| | - Jonathan Levy
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel; Department of Neuroscience and Biomedical Engineering, Aalto University, Finland
| | | | - Amir Djalovski
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel
| | - Olga Hayut
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel
| | - Guillaume Dumas
- Precision Psychiatry and Social Physiology laboratory, CHU Sainte-Justine Research Center, Department of Psychiatry, Université de Montréal, Montreal, QC, Canada
| | - Ruth Feldman
- Center for Developmental Social Neuroscience, Reichman University, Herzliya, Israel; Child Study Center, Yale University, United States.
| |
Collapse
|
12
|
Li M, Guo F, Wang X, Chen J, Ham J. Effects of robot gaze and voice human-likeness on users’ subjective perception, visual attention, and cerebral activity in voice conversations. COMPUTERS IN HUMAN BEHAVIOR 2022. [DOI: 10.1016/j.chb.2022.107645] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
|
13
|
Hirsch J, Zhang X, Noah JA, Dravida S, Naples A, Tiede M, Wolf JM, McPartland JC. Neural correlates of eye contact and social function in autism spectrum disorder. PLoS One 2022; 17:e0265798. [PMID: 36350848 PMCID: PMC9645655 DOI: 10.1371/journal.pone.0265798] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 10/06/2022] [Indexed: 11/11/2022] Open
Abstract
Reluctance to make eye contact during natural interactions is a central diagnostic criterion for autism spectrum disorder (ASD). However, the underlying neural correlates for eye contacts in ASD are unknown, and diagnostic biomarkers are active areas of investigation. Here, neuroimaging, eye-tracking, and pupillometry data were acquired simultaneously using two-person functional near-infrared spectroscopy (fNIRS) during live "in-person" eye-to-eye contact and eye-gaze at a video face for typically-developed (TD) and participants with ASD to identify the neural correlates of live eye-to-eye contact in both groups. Comparisons between ASD and TD showed decreased right dorsal-parietal activity and increased right ventral temporal-parietal activity for ASD during live eye-to-eye contact (p≤0.05, FDR-corrected) and reduced cross-brain coherence consistent with atypical neural systems for live eye contact. Hypoactivity of right dorsal-parietal regions during eye contact in ASD was further associated with gold standard measures of social performance by the correlation of neural responses and individual measures of: ADOS-2, Autism Diagnostic Observation Schedule, 2nd Edition (r = -0.76, -0.92 and -0.77); and SRS-2, Social Responsiveness Scale, Second Edition (r = -0.58). The findings indicate that as categorized social ability decreases, neural responses to real eye-contact in the right dorsal parietal region also decrease consistent with a neural correlate for social characteristics in ASD.
Collapse
Affiliation(s)
- Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States of America
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, United States of America
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, United States of America
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
- Haskins Laboratories, New Haven, CT, United States of America
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
| | - Swethasri Dravida
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States of America
| | - Adam Naples
- Yale Child Study Center, New Haven, CT, United States of America
| | - Mark Tiede
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States of America
- Haskins Laboratories, New Haven, CT, United States of America
| | - Julie M. Wolf
- Yale Child Study Center, New Haven, CT, United States of America
| | | |
Collapse
|
14
|
Ayaz H, Baker WB, Blaney G, Boas DA, Bortfeld H, Brady K, Brake J, Brigadoi S, Buckley EM, Carp SA, Cooper RJ, Cowdrick KR, Culver JP, Dan I, Dehghani H, Devor A, Durduran T, Eggebrecht AT, Emberson LL, Fang Q, Fantini S, Franceschini MA, Fischer JB, Gervain J, Hirsch J, Hong KS, Horstmeyer R, Kainerstorfer JM, Ko TS, Licht DJ, Liebert A, Luke R, Lynch JM, Mesquida J, Mesquita RC, Naseer N, Novi SL, Orihuela-Espina F, O’Sullivan TD, Peterka DS, Pifferi A, Pollonini L, Sassaroli A, Sato JR, Scholkmann F, Spinelli L, Srinivasan VJ, St. Lawrence K, Tachtsidis I, Tong Y, Torricelli A, Urner T, Wabnitz H, Wolf M, Wolf U, Xu S, Yang C, Yodh AG, Yücel MA, Zhou W. Optical imaging and spectroscopy for the study of the human brain: status report. NEUROPHOTONICS 2022; 9:S24001. [PMID: 36052058 PMCID: PMC9424749 DOI: 10.1117/1.nph.9.s2.s24001] [Citation(s) in RCA: 48] [Impact Index Per Article: 24.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.
Collapse
Affiliation(s)
- Hasan Ayaz
- Drexel University, School of Biomedical Engineering, Science, and Health Systems, Philadelphia, Pennsylvania, United States
- Drexel University, College of Arts and Sciences, Department of Psychological and Brain Sciences, Philadelphia, Pennsylvania, United States
| | - Wesley B. Baker
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
- Perelman School of Medicine at the University of Pennsylvania, Philadelphia, Pennsylvania, United States
| | - Giles Blaney
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - David A. Boas
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Heather Bortfeld
- University of California, Merced, Departments of Psychological Sciences and Cognitive and Information Sciences, Merced, California, United States
| | - Kenneth Brady
- Lurie Children’s Hospital, Northwestern University Feinberg School of Medicine, Department of Anesthesiology, Chicago, Illinois, United States
| | - Joshua Brake
- Harvey Mudd College, Department of Engineering, Claremont, California, United States
| | - Sabrina Brigadoi
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
| | - Erin M. Buckley
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
- Emory University School of Medicine, Department of Pediatrics, Atlanta, Georgia, United States
| | - Stefan A. Carp
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Robert J. Cooper
- University College London, Department of Medical Physics and Bioengineering, DOT-HUB, London, United Kingdom
| | - Kyle R. Cowdrick
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Joseph P. Culver
- Washington University School of Medicine, Department of Radiology, St. Louis, Missouri, United States
| | - Ippeita Dan
- Chuo University, Faculty of Science and Engineering, Tokyo, Japan
| | - Hamid Dehghani
- University of Birmingham, School of Computer Science, Birmingham, United Kingdom
| | - Anna Devor
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Turgut Durduran
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
- Institució Catalana de Recerca I Estudis Avançats (ICREA), Barcelona, Spain
| | - Adam T. Eggebrecht
- Washington University in St. Louis, Mallinckrodt Institute of Radiology, St. Louis, Missouri, United States
| | - Lauren L. Emberson
- University of British Columbia, Department of Psychology, Vancouver, British Columbia, Canada
| | - Qianqian Fang
- Northeastern University, Department of Bioengineering, Boston, Massachusetts, United States
| | - Sergio Fantini
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - Maria Angela Franceschini
- Massachusetts General Hospital, Harvard Medical School, Athinoula A. Martinos Center for Biomedical Imaging, Charlestown, Massachusetts, United States
| | - Jonas B. Fischer
- ICFO – The Institute of Photonic Sciences, The Barcelona Institute of Science and Technology, Castelldefels, Barcelona, Spain
| | - Judit Gervain
- University of Padua, Department of Developmental and Social Psychology, Padua, Italy
- Université Paris Cité, CNRS, Integrative Neuroscience and Cognition Center, Paris, France
| | - Joy Hirsch
- Yale School of Medicine, Department of Psychiatry, Neuroscience, and Comparative Medicine, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Keum-Shik Hong
- Pusan National University, School of Mechanical Engineering, Busan, Republic of Korea
- Qingdao University, School of Automation, Institute for Future, Qingdao, China
| | - Roarke Horstmeyer
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
- Duke University, Department of Electrical and Computer Engineering, Durham, North Carolina, United States
- Duke University, Department of Physics, Durham, North Carolina, United States
| | - Jana M. Kainerstorfer
- Carnegie Mellon University, Department of Biomedical Engineering, Pittsburgh, Pennsylvania, United States
- Carnegie Mellon University, Neuroscience Institute, Pittsburgh, Pennsylvania, United States
| | - Tiffany S. Ko
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Daniel J. Licht
- Children’s Hospital of Philadelphia, Division of Neurology, Philadelphia, Pennsylvania, United States
| | - Adam Liebert
- Polish Academy of Sciences, Nalecz Institute of Biocybernetics and Biomedical Engineering, Warsaw, Poland
| | - Robert Luke
- Macquarie University, Department of Linguistics, Sydney, New South Wales, Australia
- Macquarie University Hearing, Australia Hearing Hub, Sydney, New South Wales, Australia
| | - Jennifer M. Lynch
- Children’s Hospital of Philadelphia, Division of Cardiothoracic Anesthesiology, Philadelphia, Pennsylvania, United States
| | - Jaume Mesquida
- Parc Taulí Hospital Universitari, Critical Care Department, Sabadell, Spain
| | - Rickson C. Mesquita
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology, Campinas, São Paulo, Brazil
| | - Noman Naseer
- Air University, Department of Mechatronics and Biomedical Engineering, Islamabad, Pakistan
| | - Sergio L. Novi
- University of Campinas, Institute of Physics, Campinas, São Paulo, Brazil
- Western University, Department of Physiology and Pharmacology, London, Ontario, Canada
| | | | - Thomas D. O’Sullivan
- University of Notre Dame, Department of Electrical Engineering, Notre Dame, Indiana, United States
| | - Darcy S. Peterka
- Columbia University, Zuckerman Mind Brain Behaviour Institute, New York, United States
| | | | - Luca Pollonini
- University of Houston, Department of Engineering Technology, Houston, Texas, United States
| | - Angelo Sassaroli
- Tufts University, Department of Biomedical Engineering, Medford, Massachusetts, United States
| | - João Ricardo Sato
- Federal University of ABC, Center of Mathematics, Computing and Cognition, São Bernardo do Campo, São Paulo, Brazil
| | - Felix Scholkmann
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Lorenzo Spinelli
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Vivek J. Srinivasan
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- NYU Langone Health, Department of Ophthalmology, New York, New York, United States
- NYU Langone Health, Department of Radiology, New York, New York, United States
| | - Keith St. Lawrence
- Lawson Health Research Institute, Imaging Program, London, Ontario, Canada
- Western University, Department of Medical Biophysics, London, Ontario, Canada
| | - Ilias Tachtsidis
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Yunjie Tong
- Purdue University, Weldon School of Biomedical Engineering, West Lafayette, Indiana, United States
| | - Alessandro Torricelli
- Politecnico di Milano, Dipartimento di Fisica, Milan, Italy
- National Research Council (CNR), IFN – Institute for Photonics and Nanotechnologies, Milan, Italy
| | - Tara Urner
- Georgia Institute of Technology, Wallace H. Coulter Department of Biomedical Engineering, Atlanta, Georgia, United States
| | - Heidrun Wabnitz
- Physikalisch-Technische Bundesanstalt (PTB), Berlin, Germany
| | - Martin Wolf
- University of Zurich, University Hospital Zurich, Department of Neonatology, Biomedical Optics Research Laboratory, Zürich, Switzerland
| | - Ursula Wolf
- University of Bern, Institute of Complementary and Integrative Medicine, Bern, Switzerland
| | - Shiqi Xu
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
| | - Changhuei Yang
- California Institute of Technology, Department of Electrical Engineering, Pasadena, California, United States
| | - Arjun G. Yodh
- University of Pennsylvania, Department of Physics and Astronomy, Philadelphia, Pennsylvania, United States
| | - Meryem A. Yücel
- Boston University Neurophotonics Center, Boston, Massachusetts, United States
- Boston University, College of Engineering, Department of Biomedical Engineering, Boston, Massachusetts, United States
| | - Wenjun Zhou
- University of California Davis, Department of Biomedical Engineering, Davis, California, United States
- China Jiliang University, College of Optical and Electronic Technology, Hangzhou, Zhejiang, China
| |
Collapse
|
15
|
Crum J, Zhang X, Noah A, Hamilton A, Tachtsidis I, Burgess PW, Hirsch J. An Approach to Neuroimaging Interpersonal Interactions in Mental Health Interventions. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2022; 7:669-679. [PMID: 35144035 PMCID: PMC9271588 DOI: 10.1016/j.bpsc.2022.01.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/12/2021] [Revised: 12/31/2021] [Accepted: 01/25/2022] [Indexed: 11/20/2022]
Abstract
BACKGROUND Conventional paradigms in clinical neuroscience tend to be constrained in terms of ecological validity, raising several challenges to studying the mechanisms mediating treatments and outcomes in clinical settings. Addressing these issues requires real-world neuroimaging techniques that are capable of continuously collecting data during free-flowing interpersonal interactions and that allow for experimental designs that are representative of the clinical situations in which they occur. METHODS In this work, we developed a paradigm that fractionates the major components of human-to-human verbal interactions occurring in clinical situations and used functional near-infrared spectroscopy to assess the brain systems underlying clinician-client discourse (N = 30). RESULTS Cross-brain neural coupling between people was significantly greater during clinical interactions compared with everyday life verbal communication, particularly between the prefrontal cortex (e.g., inferior frontal gyrus) and inferior parietal lobule (e.g., supramarginal gyrus). The clinical tasks revealed extensive increases in activity across the prefrontal cortex, especially in the rostral prefrontal cortex (area 10), during periods in which participants were required to silently reason about the dysfunctional cognitions of the other person. CONCLUSIONS This work demonstrates a novel experimental approach to investigating the neural underpinnings of interpersonal interactions that typically occur in clinical settings, and its findings support the idea that particular prefrontal systems might be critical to cultivating mental health.
Collapse
Affiliation(s)
- James Crum
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom.
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut
| | - Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut
| | - Antonia Hamilton
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Ilias Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Paul W Burgess
- Institute of Cognitive Neuroscience, University College London, London, United Kingdom
| | - Joy Hirsch
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom; Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut; Department of Neuroscience, Yale School of Medicine, New Haven, Connecticut; Department of Comparative Medicine, Yale School of Medicine, New Haven, Connecticut
| |
Collapse
|
16
|
Abstract
Clinical neuroimaging has largely been limited to examining the neurophysiological outcomes of treatments for psychiatric conditions rather than the neurocognitive mechanisms by which these outcomes are brought about as a function of clinical strategies, and the cognitive neuroscientific research aiming to investigate these mechanisms in nonclinical and clinical populations has been ecologically challenged by the extent to which tasks represent and generalize to intervention strategies. However, recent technological and methodological advancements to neuroimaging techniques such as functional near-infrared spectroscopy and functional near-infrared spectroscopy-based hyperscanning provide novel opportunities to investigate the mechanisms of change in more naturalistic and interactive settings, representing a unique prospect for improving our understanding of the intra- and interbrain systems supporting the recogitation of dysfunctional cognitive operations.
Collapse
Affiliation(s)
- James E. Crum II
- Institute of Cognitive Neuroscience, University College
London, London, UK
| |
Collapse
|
17
|
Abstract
In order to understand ecologically meaningful social behaviors and their neural substrates in humans and other animals, researchers have been using a variety of social stimuli in the laboratory with a goal of extracting specific processes in real-life scenarios. However, certain stimuli may not be sufficiently effective at evoking typical social behaviors and neural responses. Here, we review empirical research employing different types of social stimuli by classifying them into five levels of naturalism. We describe the advantages and limitations while providing selected example studies for each level. We emphasize the important trade-off between experimental control and ecological validity across the five levels of naturalism. Taking advantage of newly emerging tools, such as real-time videos, virtual avatars, and wireless neural sampling techniques, researchers are now more than ever able to adopt social stimuli at a higher level of naturalism to better capture the dynamics and contingency of real-life social interaction.
Collapse
Affiliation(s)
- Siqi Fan
- Department of Psychology, Yale University, New Haven, CT 06520, USA
| | - Olga Dal Monte
- Department of Psychology, Yale University, New Haven, CT 06520, USA
- Department of Psychology, University of Turin, Torino, Italy
| | - Steve W.C. Chang
- Department of Psychology, Yale University, New Haven, CT 06520, USA
- Department of Neuroscience, Yale University School of Medicine, New Haven, CT 06510, USA
- Kavli Institute for Neuroscience, Yale University School of Medicine, New Haven, CT 06510, USA
- Wu Tsai Institute, Yale University, New Haven, CT 06510, USA
| |
Collapse
|
18
|
Pinti P, Devoto A, Greenhalgh I, Tachtsidis I, Burgess PW, de C Hamilton AF. The role of anterior prefrontal cortex (area 10) in face-to-face deception measured with fNIRS. Soc Cogn Affect Neurosci 2021; 16:129-142. [PMID: 32577765 PMCID: PMC7812627 DOI: 10.1093/scan/nsaa086] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Revised: 05/19/2020] [Accepted: 06/15/2020] [Indexed: 12/12/2022] Open
Abstract
Anterior prefrontal cortex (PFC, Brodmann area 10) activations are often, but not always, found in neuroimaging studies investigating deception, and the precise role of this area remains unclear. To explore the role of the PFC in face-to-face deception, we invited pairs of participants to play a card game involving lying and lie detection while we used functional near infrared spectroscopy (fNIRS) to record brain activity in the PFC. Participants could win points for successfully lying about the value of their cards or for detecting lies. We contrasted patterns of brain activation when the participants either told the truth or lied, when they were either forced into this or did so voluntarily and when they either succeeded or failed to detect a lie. Activation in the anterior PFC was found in both lie production and detection, unrelated to reward. Analysis of cross-brain activation patterns between participants identified areas of the PFC where the lead player’s brain activity synchronized their partner’s later brain activity. These results suggest that during situations that involve close interpersonal interaction, the anterior PFC supports processing widely involved in deception, possibly relating to the demands of monitoring one’s own and other people’s behaviour.
Collapse
Affiliation(s)
- Paola Pinti
- Department of Medical Physics and Biomedical Engineering, University College London, London WC1E 6BT, UK.,Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK
| | - Andrea Devoto
- Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK
| | - Isobel Greenhalgh
- Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK
| | - Ilias Tachtsidis
- Department of Medical Physics and Biomedical Engineering, University College London, London WC1E 6BT, UK
| | - Paul W Burgess
- Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK
| | | |
Collapse
|
19
|
Kelley MS, Noah JA, Zhang X, Scassellati B, Hirsch J. Comparison of Human Social Brain Activity During Eye-Contact With Another Human and a Humanoid Robot. Front Robot AI 2021; 7:599581. [PMID: 33585574 PMCID: PMC7879449 DOI: 10.3389/frobt.2020.599581] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Accepted: 12/07/2020] [Indexed: 01/17/2023] Open
Abstract
Robot design to simulate interpersonal social interaction is an active area of research with applications in therapy and companionship. Neural responses to eye-to-eye contact in humans have recently been employed to determine the neural systems that are active during social interactions. Whether eye-contact with a social robot engages the same neural system remains to be seen. Here, we employ a similar approach to compare human-human and human-robot social interactions. We assume that if human-human and human-robot eye-contact elicit similar neural activity in the human, then the perceptual and cognitive processing is also the same for human and robot. That is, the robot is processed similar to the human. However, if neural effects are different, then perceptual and cognitive processing is assumed to be different. In this study neural activity was compared for human-to-human and human-to-robot conditions using near infrared spectroscopy for neural imaging, and a robot (Maki) with eyes that blink and move right and left. Eye-contact was confirmed by eye-tracking for both conditions. Increased neural activity was observed in human social systems including the right temporal parietal junction and the dorsolateral prefrontal cortex during human-human eye contact but not human-robot eye-contact. This suggests that the type of human-robot eye-contact used here is not sufficient to engage the right temporoparietal junction in the human. This study establishes a foundation for future research into human-robot eye-contact to determine how elements of robot design and behavior impact human social processing within this type of interaction and may offer a method for capturing difficult to quantify components of human-robot interaction, such as social engagement.
Collapse
Affiliation(s)
- Megan S. Kelley
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Brian Scassellati
- Social Robotics Laboratory, Department of Computer Science, Yale University, New Haven, CT, United States
| | - Joy Hirsch
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
- Departments of Neuroscience and Comparative Medicine, Yale School of Medicine, New Haven, CT, United States
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| |
Collapse
|
20
|
Kruppa JA, Reindl V, Gerloff C, Oberwelland Weiss E, Prinz J, Herpertz-Dahlmann B, Konrad K, Schulte-Rüther M. Brain and motor synchrony in children and adolescents with ASD-a fNIRS hyperscanning study. Soc Cogn Affect Neurosci 2021; 16:103-116. [PMID: 32685971 PMCID: PMC7812623 DOI: 10.1093/scan/nsaa092] [Citation(s) in RCA: 38] [Impact Index Per Article: 12.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2020] [Revised: 05/27/2020] [Accepted: 06/24/2020] [Indexed: 01/16/2023] Open
Abstract
Brain-to-brain synchrony has been proposed as an important mechanism underlying social interaction. While first findings indicate that it may be modulated in children with autism spectrum disorder (ASD), no study to date has investigated the influence of different interaction partners and task characteristics. Using functional near-infrared spectroscopy hyperscanning, we assessed brain-to-brain synchrony in 41 male typically developing (TD) children (8-18 years; control sample), as well as 18 children with ASD and age-matched TD children (matched sample), while performing cooperative and competitive tasks with their parents and an adult stranger. Dyads were instructed either to respond jointly in response to a target (cooperation) or to respond faster than the other player (competition). Wavelet coherence was calculated for oxy- and deoxyhemoglobin brain signals. In the control sample, a widespread enhanced coherence was observed for parent-child competition, and a more localized coherence for parent-child cooperation in the frontopolar cortex. While behaviorally, children with ASD showed a lower motor synchrony than children in the TD group, no significant group differences were observed on the neural level. In order to identify biomarkers for typical and atypical social interactions in the long run, more research is needed to investigate the neurobiological underpinnings of reduced synchrony in ASD.
Collapse
Affiliation(s)
- Jana A Kruppa
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
- JARA-Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), RWTH Aachen & Research Centre Jülich, 52428 Jülich, Germany
| | - Vanessa Reindl
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
- JARA-Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), RWTH Aachen & Research Centre Jülich, 52428 Jülich, Germany
| | - Christian Gerloff
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
- JARA-Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), RWTH Aachen & Research Centre Jülich, 52428 Jülich, Germany
- Department of Psychiatry, Psychosomatics, and Psychotherapy, University Hospital RWTH Aachen, 52074 Aachen, Germany
| | - Eileen Oberwelland Weiss
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
- JARA-Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), RWTH Aachen & Research Centre Jülich, 52428 Jülich, Germany
| | - Julia Prinz
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
| | - Beate Herpertz-Dahlmann
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
| | - Kerstin Konrad
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
- JARA-Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), RWTH Aachen & Research Centre Jülich, 52428 Jülich, Germany
| | - Martin Schulte-Rüther
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany
- JARA-Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), RWTH Aachen & Research Centre Jülich, 52428 Jülich, Germany
- Department of Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Göttingen, 37075 Göttingen, Germany
| |
Collapse
|
21
|
Hirsch J, Tiede M, Zhang X, Noah JA, Salama-Manteau A, Biriotti M. Interpersonal Agreement and Disagreement During Face-to-Face Dialogue: An fNIRS Investigation. Front Hum Neurosci 2021; 14:606397. [PMID: 33584223 PMCID: PMC7874076 DOI: 10.3389/fnhum.2020.606397] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2020] [Accepted: 12/15/2020] [Indexed: 01/03/2023] Open
Abstract
Although the neural systems that underlie spoken language are well-known, how they adapt to evolving social cues during natural conversations remains an unanswered question. In this work we investigate the neural correlates of face-to-face conversations between two individuals using functional near infrared spectroscopy (fNIRS) and acoustical analyses of concurrent audio recordings. Nineteen pairs of healthy adults engaged in live discussions on two controversial topics where their opinions were either in agreement or disagreement. Participants were matched according to their a priori opinions on these topics as assessed by questionnaire. Acoustic measures of the recorded speech including the fundamental frequency range, median fundamental frequency, syllable rate, and acoustic energy were elevated during disagreement relative to agreement. Consistent with both the a priori opinion ratings and the acoustic findings, neural activity associated with long-range functional networks, rather than the canonical language areas, was also differentiated by the two conditions. Specifically, the frontoparietal system including bilateral dorsolateral prefrontal cortex, left supramarginal gyrus, angular gyrus, and superior temporal gyrus showed increased activity while talking during disagreement. In contrast, talking during agreement was characterized by increased activity in a social and attention network including right supramarginal gyrus, bilateral frontal eye-fields, and left frontopolar regions. Further, these social and visual attention networks were more synchronous across brains during agreement than disagreement. Rather than localized modulation of the canonical language system, these findings are most consistent with a model of distributed and adaptive language-related processes including cross-brain neural coupling that serves dynamic verbal exchanges.
Collapse
Affiliation(s)
- Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States.,Department of Neuroscience, Yale School of Medicine, New Haven, CT, United States.,Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, United States.,Haskins Laboratories, New Haven, CT, United States.,Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Mark Tiede
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States.,Haskins Laboratories, New Haven, CT, United States
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - J Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Alexandre Salama-Manteau
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Maurice Biriotti
- Faculty of Arts and Humanities, University College London, London, United Kingdom
| |
Collapse
|
22
|
Noah JA, Zhang X, Dravida S, DiCocco C, Suzuki T, Aslin RN, Tachtsidis I, Hirsch J. Comparison of short-channel separation and spatial domain filtering for removal of non-neural components in functional near-infrared spectroscopy signals. NEUROPHOTONICS 2021; 8:015004. [PMID: 33598505 PMCID: PMC7881368 DOI: 10.1117/1.nph.8.1.015004] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Accepted: 01/19/2021] [Indexed: 05/03/2023]
Abstract
Significance: With the increasing popularity of functional near-infrared spectroscopy (fNIRS), the need to determine localization of the source and nature of the signals has grown. Aim: We compare strategies for removal of non-neural signals for a finger-thumb tapping task, which shows responses in contralateral motor cortex and a visual checkerboard viewing task that produces activity within the occipital lobe. Approach: We compare temporal regression strategies using short-channel separation to a spatial principal component (PC) filter that removes global signals present in all channels. For short-channel temporal regression, we compare non-neural signal removal using first and combined first and second PCs from a broad distribution of short channels to limited distribution on the forehead. Results: Temporal regression of non-neural information from broadly distributed short channels did not differ from forehead-only distribution. Spatial PC filtering provides results similar to short-channel separation using the temporal domain. Utilizing both first and second PCs from short channels removes additional non-neural information. Conclusions: We conclude that short-channel information in the temporal domain and spatial domain regression filtering methods remove similar non-neural components represented in scalp hemodynamics from fNIRS signals and that either technique is sufficient to remove non-neural components.
Collapse
Affiliation(s)
- J. Adam Noah
- Yale School of Medicine, Department of Psychiatry, Brain Function Laboratory, New Haven, Connecticut, United States
| | - Xian Zhang
- Yale School of Medicine, Department of Psychiatry, Brain Function Laboratory, New Haven, Connecticut, United States
| | - Swethasri Dravida
- Yale School of Medicine, Interdepartmental Neuroscience Program New Haven, Connecticut, United States
| | - Courtney DiCocco
- Yale School of Medicine, Brain Function Laboratory, New Haven, Connecticut, United States
| | - Tatsuya Suzuki
- Meiji University, Graduate School of Science and Technology, Electrical Engineering Program, Kawasaki, Japan
- Meiji University, School of Science and Technology, Department of Electronics and Bioinformatics, Kawasaki, Japan
| | - Richard N. Aslin
- Haskins Laboratories, New Haven, Connecticut, United States
- Yale University, Department of Psychology, New Haven, Connecticut, United States
| | - Ilias Tachtsidis
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| | - Joy Hirsch
- Yale School of Medicine, Department of Psychiatry, Brain Function Laboratory, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
- Yale School of Medicine, Department of Neuroscience, New Haven, Connecticut, United States
- Yale School of Medicine, Department of Comparative Medicine, New Haven, Connecticut, United States
- Address all correspondence to Joy Hirsch,
| |
Collapse
|
23
|
Wang Z, Wang Y, Zhou X, Yu R. Interpersonal brain synchronization under bluffing in strategic games. Soc Cogn Affect Neurosci 2020; 15:1326-1335. [PMID: 33186465 PMCID: PMC7759204 DOI: 10.1093/scan/nsaa154] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2019] [Revised: 09/02/2020] [Accepted: 11/12/2020] [Indexed: 11/19/2022] Open
Abstract
People commonly use bluffing as a strategy to manipulate other people's beliefs about them for gain. Although bluffing is an important part of successful strategic thinking, the inter-brain mechanisms underlying bluffing remain unclear. Here, we employed a functional near-infrared spectroscopy hyperscanning technique to simultaneously record the brain activity in the right temporal-parietal junction in 32 pairs of participants when they played a bluffing game against each other or with computer opponents separately. We also manipulated the penalty for bluffing (high vs low). Under the condition of high relative to low penalty, results showed a higher bluffing rate and a higher calling rate in human-to-human as compared to human-to-computer pairing. At the neural level, high relative to low penalty condition increased the interpersonal brain synchronization (IBS) in the right angular gyrus (rAG) during human-to-human as compared to human-to-computer interaction. Importantly, bluffing relative to non-bluffing, under the high penalty and human-to-human condition, resulted in an increase in response time and enhanced IBS in the rAG. Participants who bluffed more frequently also elicited stronger IBS. Our findings support the view that regions associated with mentalizing become synchronized during bluffing games, especially under the high penalty and human-to-human condition.
Collapse
Affiliation(s)
- Zhihao Wang
- School of Psychology, Center for Studies of Psychological Application and Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, South China Normal University, Guangzhou, China
| | - Yiwen Wang
- School of Economics and Management, Fuzhou University, Fuzhou 350108, China
- Institute of Psychological and Cognitive Sciences, Fuzhou University, Fuzhou, China
| | - Xiaolin Zhou
- School of Psychology and Cognitive Science, East China Normal University, Shanghai 200062, China
- School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China
- Beijing Laboratory of Behaviour and Mental Health, Peking University, Beijing 100871, China
- Institute of Psychological and Brain Sciences, Zhejiang Normal University, Zhejiang 321004, China
- PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing 100871, China
| | - Rongjun Yu
- Department of Management, Hong Kong Baptist University, Hong Kong, China
- Department of Sport, Physical Education and Health, Hong Kong Baptist University, Hong Kong, China
- Department of Physics, Hong Kong Baptist University, Hong Kong, China
| |
Collapse
|
24
|
Balters S, Baker JM, Hawthorne G, Reiss AL. Capturing Human Interaction in the Virtual Age: A Perspective on the Future of fNIRS Hyperscanning. Front Hum Neurosci 2020; 14:588494. [PMID: 33240067 PMCID: PMC7669622 DOI: 10.3389/fnhum.2020.588494] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Accepted: 10/02/2020] [Indexed: 01/09/2023] Open
Abstract
Advances in video conferencing capabilities combined with dramatic socio-dynamic shifts brought about by COVID-19, have redefined the ways in which humans interact in modern society. From business meetings to medical exams, or from classroom instruction to yoga class, virtual interfacing has permeated nearly every aspect of our daily lives. A seemingly endless stream of technological advances combined with our newfound reliance on virtual interfacing makes it likely that humans will continue to use this modern form of social interaction into the future. However, emergent evidence suggests that virtual interfacing may not be equivalent to face-to-face interactions. Ultimately, too little is currently understood about the mechanisms that underlie human interactions over the virtual divide, including how these mechanisms differ from traditional face-to-face interaction. Here, we propose functional near-infrared spectroscopy (fNIRS) hyperscanning-simultaneous measurement of two or more brains-as an optimal approach to quantify potential neurocognitive differences between virtual and in-person interactions. We argue that increased focus on this understudied domain will help elucidate the reasons why virtual conferencing doesn't always stack up to in-person meetings and will also serve to spur new technologies designed to improve the virtual interaction experience. On the basis of existing fNIRS hyperscanning literature, we highlight the current gaps in research regarding virtual interactions. Furthermore, we provide insight into current hurdles regarding fNIRS hyperscanning hardware and methodology that should be addressed in order to shed light on this newly critical element of everyday life.
Collapse
Affiliation(s)
- Stephanie Balters
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Stanford University, Stanford, CA, United States
| | - Joseph M. Baker
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Stanford University, Stanford, CA, United States
| | - Grace Hawthorne
- Hasso Plattner Institute of Design, Stanford University, Stanford, CA, United States
| | - Allan L. Reiss
- Department of Psychiatry and Behavioral Sciences, School of Medicine, Stanford University, Stanford, CA, United States
- Department of Radiology, School of Medicine, Stanford University, Stanford, CA, United States
- Department of Pediatrics, School of Medicine, Stanford University, Stanford, CA, United States
| |
Collapse
|
25
|
Liang Y, Fu G, Yu R, Bi Y, Ding XP. The Role of Reward System in Dishonest Behavior: A Functional Near-Infrared Spectroscopy Study. Brain Topogr 2020; 34:64-77. [PMID: 33135142 DOI: 10.1007/s10548-020-00804-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Accepted: 10/23/2020] [Indexed: 10/23/2022]
Abstract
Previous studies showed that the cortical reward system plays an important role in deceptive behavior. However, how the reward system activates during the whole course of dishonest behavior and how it affects dishonest decisions remain unclear. The current study investigated these questions. One hundred and two participants were included in the final analysis. They completed two tasks: monetary incentive delay (MID) task and an honesty task. The MID task served as the localizer task and the honesty task was used to measure participants' deceptive behaviors. Participants' spontaneous responses in the honesty task were categorized into three conditions: Correct-Truth condition (tell the truth after guessing correctly), Incorrect-Truth condition (tell the truth after guessing incorrectly), and Incorrect-Lie condition (tell lies after guessing incorrectly). To reduce contamination from neighboring functional regions as well as to increase sensitivity to small effects (Powell et al., Devel Sci 21:e12595, 2018), we adopted the individual functional channel of interest (fCOI) approach to analyze the data. Specially, we identified the channels of interest in the MID task in individual participants and then applied them to the honesty task. The result suggested that the reward system showed different activation patterns during different phases: In the pre-decision phase, the reward system was activated with the winning of the reward. During the decision and feedback phase, the reward system was activated when people made the decisions to be dishonest and when they evaluated the outcome of their decisions. Furthermore, the result showed that neural activity of the reward system toward the outcome of their decision was related to subsequent dishonest behaviors. Thus, the present study confirmed the important role of the reward system in deception. These results can also shed light on how one could use neuroimaging techniques to perform lie-detection.
Collapse
Affiliation(s)
- Yibiao Liang
- Department of Psychology, Hangzhou Normal University, Hangzhou, China.,Psychology Department, University of Massachusetts Boston, Boston, MA, USA
| | - Genyue Fu
- Department of Psychology, Hangzhou Normal University, Hangzhou, China.
| | - Runxin Yu
- Department of Psychology, Zhejiang Normal University, Jinhua, China.,Nuralogix (Hangzhou) Artificial Intelligence Company Limited, Hangzhou, China
| | - Yue Bi
- Department of Psychology, National University of Singapore, Singapore, Singapore
| | - Xiao Pan Ding
- Department of Psychology, National University of Singapore, Singapore, Singapore.
| |
Collapse
|
26
|
Descorbeth O, Zhang X, Noah JA, Hirsch J. Neural processes for live pro-social dialogue between dyads with socioeconomic disparity. Soc Cogn Affect Neurosci 2020; 15:875-887. [PMID: 32879986 PMCID: PMC7543936 DOI: 10.1093/scan/nsaa120] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2019] [Revised: 06/02/2020] [Accepted: 08/28/2020] [Indexed: 01/23/2023] Open
Abstract
An emerging theoretical framework suggests that neural functions associated with stereotyping and prejudice are associated with frontal lobe networks. Using a novel neuroimaging technique, functional near-infrared spectroscopy (fNIRS), during a face-to-face live communication paradigm, we explore an extension of this model to include live dynamic interactions. Neural activations were compared for dyads of similar and dissimilar socioeconomic backgrounds. The socioeconomic status of each participant was based on education and income levels. Both groups of dyads engaged in pro-social dialectic discourse during acquisition of hemodynamic signals. Post-scan questionnaires confirmed increased anxiety and effort for high-disparity dyads. Consistent with the frontal lobe hypothesis, left dorsolateral pre-frontal cortex (DLPFC), frontopolar area and pars triangularis were more active during speech dialogue in high than in low-disparity groups. Further, frontal lobe signals were more synchronous across brains for high- than low-disparity dyads. Convergence of these behavioral, neuroimaging and neural coupling findings associate left frontal lobe processes with natural pro-social dialogue under 'out-group' conditions and advance both theoretical and technical approaches for further investigation.
Collapse
Affiliation(s)
- Olivia Descorbeth
- Undergraduates of Yale College (Descorbeth), New Haven, CT, 06511, USA
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, 06511, USA
| | - J Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, 06511, USA
| | - Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, 06511, USA
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, 06511, USA
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, 06511, USA
- Haskins Laboratories, New Haven, CT, 06511, USA
- Department of Medical Physics and Biomedical Engineering, University College London, WC1E 6BT, UK
| |
Collapse
|
27
|
Li Q, Yan J, Liao J, Zhang X, Liu L, Fu X, Tan HY, Zhang D, Yan H. Distinct Effects of Social Stress on Working Memory in Obsessive-Compulsive Disorder. Neurosci Bull 2020; 37:81-93. [PMID: 33000423 PMCID: PMC7811969 DOI: 10.1007/s12264-020-00579-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2019] [Accepted: 05/13/2020] [Indexed: 10/30/2022] Open
Abstract
Stress might exaggerate the compulsion and impair the working memory of patients with obsessive-compulsive disorder (OCD). This study evaluated the effect of stress on the cognitive neural processing of working memory in OCD and its clinical significance using a "number calculation working memory" task. Thirty-eight patients and 55 gender- and education-matched healthy controls were examined. Stress impaired the performance of the manipulation task in patients. Healthy controls showed less engagement of the medial prefrontal cortex and striatum during the task under stress versus less stress, which was absent in the patients with OCD. The diagnosis × stress interaction effect was significant in the right fusiform, supplementary motor area, precentral cortex and caudate. The failure of suppression of the medial prefrontal cortex and striatum and stress-related hyperactivation in the right fusiform, supplementary motor area, precentral cortex, and caudate might be an OCD-related psychopathological and neural response to stress.
Collapse
Affiliation(s)
- Qianqian Li
- Peking University Sixth Hospital, Beijing, 100191, China.,Peking University Institute of Mental Health, National Health Commission Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, 100191, China
| | - Jun Yan
- Peking University Sixth Hospital, Beijing, 100191, China.,Peking University Institute of Mental Health, National Health Commission Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, 100191, China
| | - Jinmin Liao
- Peking University Sixth Hospital, Beijing, 100191, China.,Peking University Institute of Mental Health, National Health Commission Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, 100191, China
| | - Xiao Zhang
- Peking University Sixth Hospital, Beijing, 100191, China.,Peking University Institute of Mental Health, National Health Commission Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, 100191, China
| | - Lijun Liu
- Peking University Sixth Hospital, Beijing, 100191, China.,Peking University Institute of Mental Health, National Health Commission Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, 100191, China
| | - Xiaoyu Fu
- Peking University Sixth Hospital, Beijing, 100191, China.,Peking University Institute of Mental Health, National Health Commission Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, 100191, China
| | - Hao Yang Tan
- Lieber Institute for Brain Development, Baltimore, MD, 21205, USA.,Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, 21205, USA
| | - Dai Zhang
- Peking University Sixth Hospital, Beijing, 100191, China. .,Peking University Institute of Mental Health, National Health Commission Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, 100191, China. .,Tsinghua University-Peking University Joint Center for Life Sciences, Beijing, 100871, China. .,PKU-IDG/McGovern Institute for Brain Research, Peking University, Beijing, 100871, China.
| | - Hao Yan
- Peking University Sixth Hospital, Beijing, 100191, China. .,Peking University Institute of Mental Health, National Health Commission Key Laboratory of Mental Health (Peking University), National Clinical Research Center for Mental Disorders (Peking University Sixth Hospital), Beijing, 100191, China.
| |
Collapse
|
28
|
Dravida S, Noah JA, Zhang X, Hirsch J. Joint Attention During Live Person-to-Person Contact Activates rTPJ, Including a Sub-Component Associated With Spontaneous Eye-to-Eye Contact. Front Hum Neurosci 2020; 14:201. [PMID: 32581746 PMCID: PMC7283505 DOI: 10.3389/fnhum.2020.00201] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Accepted: 05/05/2020] [Indexed: 12/19/2022] Open
Abstract
Eye-to-eye contact is a spontaneous behavior between interacting partners that occurs naturally during social interactions. However, individuals differ with respect to eye gaze behaviors such as frequency of eye-to-eye contacts, and these variations may reflect underlying differences in social behavior in the population. While the use of eye signaling to indicate a shared object of attention in joint attention tasks has been well-studied, the effects of the natural variation in establishing eye contact during joint attention have not been isolated. Here, we investigate this question using a novel two-person joint attention task. Participants were not instructed regarding the use of eye contacts; thus all mutual eye contact events between interacting partners that occurred during the joint attention task were spontaneous and varied with respect to frequency. We predicted that joint attention systems would be modulated by differences in the social behavior across participant pairs, which could be measured by the frequency of eye contact behavior. We used functional near-infrared spectroscopy (fNIRS) hyperscanning and eye-tracking to measure the neural signals associated with joint attention in interacting dyads and to record the number of eye contact events between them. Participants engaged in a social joint attention task in which real partners used eye gaze to direct each other's attention to specific targets. Findings were compared to a non-social joint attention task in which an LED cue directed both partners' attention to the same target. The social joint attention condition showed greater activity in right temporoparietal junction than the non-social condition, replicating prior joint attention results. Eye-contact frequency modulated the joint attention activity, revealing bilateral activity in social and high level visual areas associated with partners who made more eye contact. Additionally, when the number of mutual eye contact events was used to classify each pair as either "high eye contact" or "low eye contact" dyads, cross-brain coherence analysis revealed greater coherence between high eye contact dyads than low eye contact dyads in these same areas. Together, findings suggest that variation in social behavior as measured by eye contact modulates activity in a subunit of the network associated with joint attention.
Collapse
Affiliation(s)
- Swethasri Dravida
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States
| | - J. Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, United States
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, United States
- Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| |
Collapse
|
29
|
Yang J, Zhang H, Ni J, De Dreu CKW, Ma Y. Within-group synchronization in the prefrontal cortex associates with intergroup conflict. Nat Neurosci 2020; 23:754-760. [PMID: 32341541 DOI: 10.1038/s41593-020-0630-x] [Citation(s) in RCA: 55] [Impact Index Per Article: 13.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Accepted: 03/23/2020] [Indexed: 12/12/2022]
Abstract
Individuals immersed in groups sometimes lose their individuality, take risks they would normally avoid and approach outsiders with unprovoked hostility. In this study, we identified within-group neural synchronization in the right dorsolateral prefrontal cortex (rDLPFC) and the right temporoparietal junction (rTPJ) as a candidate mechanism underlying intergroup hostility. We organized 546 individuals into 91 three-versus-three-person intergroup competitions, induced in-group bonding or no-bonding control manipulation and measured neural activity and within-group synchronization using functional near-infrared spectroscopy. After in-group bonding (versus control), individuals gave more money to in-group members than to out-group members and contributed more money to outcompete their rivals. In-group bonding decreased rDLPFC activity and increased functional connectivity between the rDLPFC and the rTPJ. Especially during the out-group attack, in-group bonding also increased within-group synchronization in both the rDLPFC and the rTPJ, and within-group rDLPFC synchronization positively correlated with intergroup hostility. Within-group synchronized reduction in prefrontal activity might explain how in-group bonding leads to impulsive and collective hostility toward outsiders.
Collapse
Affiliation(s)
- Jiaxin Yang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China
| | - Hejing Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China
| | - Jun Ni
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China
| | - Carsten K W De Dreu
- Institute of Psychology, Leiden University, Leiden, The Netherlands.,Center for Research in Experimental Economics and Political Decision Making, University of Amsterdam, Amsterdam, The Netherlands
| | - Yina Ma
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, China.
| |
Collapse
|
30
|
Pinti P, Tachtsidis I, Hamilton A, Hirsch J, Aichelburg C, Gilbert S, Burgess PW. The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience. Ann N Y Acad Sci 2020; 1464:5-29. [PMID: 30085354 PMCID: PMC6367070 DOI: 10.1111/nyas.13948] [Citation(s) in RCA: 411] [Impact Index Per Article: 102.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2018] [Revised: 07/10/2018] [Accepted: 07/13/2018] [Indexed: 01/11/2023]
Abstract
The past few decades have seen a rapid increase in the use of functional near-infrared spectroscopy (fNIRS) in cognitive neuroscience. This fast growth is due to the several advances that fNIRS offers over the other neuroimaging modalities such as functional magnetic resonance imaging and electroencephalography/magnetoencephalography. In particular, fNIRS is harmless, tolerant to bodily movements, and highly portable, being suitable for all possible participant populations, from newborns to the elderly and experimental settings, both inside and outside the laboratory. In this review we aim to provide a comprehensive and state-of-the-art review of fNIRS basics, technical developments, and applications. In particular, we discuss some of the open challenges and the potential of fNIRS for cognitive neuroscience research, with a particular focus on neuroimaging in naturalistic environments and social cognitive neuroscience.
Collapse
Affiliation(s)
- Paola Pinti
- Department of Medical Physics and Biomedical EngineeringUniversity College LondonLondonUK
- Institute of Cognitive NeuroscienceUniversity College LondonLondonUK
| | - Ilias Tachtsidis
- Department of Medical Physics and Biomedical EngineeringUniversity College LondonLondonUK
| | - Antonia Hamilton
- Institute of Cognitive NeuroscienceUniversity College LondonLondonUK
| | - Joy Hirsch
- Department of Medical Physics and Biomedical EngineeringUniversity College LondonLondonUK
- Department of PsychiatryYale School of MedicineNew HavenConnecticut
- Department of NeuroscienceYale School of MedicineNew HavenConnecticut
- Comparative MedicineYale School of MedicineNew HavenConnecticut
| | | | - Sam Gilbert
- Institute of Cognitive NeuroscienceUniversity College LondonLondonUK
| | - Paul W. Burgess
- Institute of Cognitive NeuroscienceUniversity College LondonLondonUK
| |
Collapse
|
31
|
Noah JA, Zhang X, Dravida S, Ono Y, Naples A, McPartland JC, Hirsch J. Real-Time Eye-to-Eye Contact Is Associated With Cross-Brain Neural Coupling in Angular Gyrus. Front Hum Neurosci 2020; 14:19. [PMID: 32116606 PMCID: PMC7016046 DOI: 10.3389/fnhum.2020.00019] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2019] [Accepted: 01/17/2020] [Indexed: 11/25/2022] Open
Abstract
Direct eye contact between two individuals is a salient social behavior known to initiate and promote interpersonal interaction. However, the neural processes that underlie these live interactive behaviors and eye-to-eye contact are not well understood. The Dynamic Neural Coupling Hypothesis presents a general theoretical framework proposing that shared interactive behaviors are represented by cross-brain signal coherence. Using functional near-infrared spectroscopy (fNIRS) adapted for hyper scanning, we tested this hypothesis specifically for neural mechanisms associated with eye-to-eye gaze between human participants compared to similar direct eye-gaze at a dynamic video of a face and predicted that the coherence of neural signals between the two participants during reciprocal eye-to-eye contact would be greater than coherence observed during direct eye-gaze at a dynamic video for those signals originating in social and face processing systems. Consistent with this prediction cross-brain coherence was increased for signals within the angular gyrus (AG) during eye-to-eye contact relative to direct eye-gaze at a dynamic face video (p < 0.01). Further, activity in the right temporal-parietal junction (TPJ) was increased in the real eye-to-eye condition (p < 0.05, FDR corrected). Together, these findings advance a functional and mechanistic understanding of the AG and cross-brain neural coupling associated with real-time eye-to-eye contact.
Collapse
Affiliation(s)
- J Adam Noah
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Xian Zhang
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States
| | - Swethasri Dravida
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, United States
| | - Yumie Ono
- Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, Kawasaki, Japan
| | - Adam Naples
- Yale Child Study Center, Yale School of Medicine, New Haven, CT, United States
| | - James C McPartland
- Yale Child Study Center, Yale School of Medicine, New Haven, CT, United States
| | - Joy Hirsch
- Brain Function Laboratory, Department of Psychiatry, Yale School of Medicine, New Haven, CT, United States.,Department of Neuroscience, Yale School of Medicine, New Haven, CT, United States.,Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, United States.,Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| |
Collapse
|
32
|
Zhang X, Noah JA, Dravida S, Hirsch J. Optimization of wavelet coherence analysis as a measure of neural synchrony during hyperscanning using functional near-infrared spectroscopy. NEUROPHOTONICS 2020; 7:015010. [PMID: 32206677 PMCID: PMC7047008 DOI: 10.1117/1.nph.7.1.015010] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/30/2019] [Accepted: 02/05/2020] [Indexed: 05/27/2023]
Abstract
Significance: The expanding field of human social interaction is enabled by functional near-infrared spectroscopy (fNIRS) that acquires hemodynamic signals during live two-person interactions. These advances call for development of methods to quantify interactive processes. Aim: Wavelet coherence analysis has been applied to cross-brain neural coupling. However, fNIRS-specific computations have not been explored. This investigation determines the effects of global mean removal, wavelet equation, and choice of oxyhemoglobin versus deoxyhemoglobin signals. Approach: We compare signals with a known coherence with acquired signals to determine optimal computational approaches. The known coherence was calculated using three visual stimulation sequences of a contrast-reversing checkerboard convolved with the canonical hemodynamic response function. This standard was compared with acquired human fNIRS responses within visual cortex using the same sequences. Results: Observed coherence was consistent with known coherence with highest correlations within the wavelength range between 10 and 20 s. Removal of the global mean improved the correlation irrespective of the specific equation for wavelet coherence, and the oxyhemoglobin signal was associated with a marginal correlation advantage. Conclusions: These findings provide both methodological and computational guidance that enhances the validity and interpretability of wavelet coherence analysis for fNIRS signals acquired during live social interactions.
Collapse
Affiliation(s)
- Xian Zhang
- Yale School of Medicine, Brain Function Laboratory, Department of Psychiatry, New Haven, Connecticut, United States
| | - J. Adam Noah
- Yale School of Medicine, Interdepartmental Neuroscience Program, New Haven, Connecticut, United States
| | - Swethasri Dravida
- Yale School of Medicine, Medical Scientist Training Program, New Haven, Connecticut, United States
- Yale School of Medicine, Department of Neuroscience, New Haven, Connecticut, United States
| | - Joy Hirsch
- Yale School of Medicine, Brain Function Laboratory, Department of Psychiatry, New Haven, Connecticut, United States
- Yale School of Medicine, Department of Neuroscience, New Haven, Connecticut, United States
- Yale School of Medicine, Department of Comparative Medicine, New Haven, Connecticut, United States
- University College London, Department of Medical Physics and Biomedical Engineering, London, United Kingdom
| |
Collapse
|
33
|
Rojiani R, Zhang X, Noah A, Hirsch J. Communication of emotion via drumming: dual-brain imaging with functional near-infrared spectroscopy. Soc Cogn Affect Neurosci 2019; 13:1047-1057. [PMID: 30215809 PMCID: PMC6204489 DOI: 10.1093/scan/nsy076] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2017] [Accepted: 09/04/2018] [Indexed: 11/13/2022] Open
Abstract
Nonverbal communication of emotion is essential to human interaction and relevant to many clinical applications, yet it is an understudied topic in social neuroscience. Drumming is an ancient nonverbal communication modality for expression of emotion that has not been previously investigated in this context. We investigate the neural response to live, natural communication of emotion via drumming using a novel dual-brain neuroimaging paradigm. Hemodynamic signals were acquired using whole-head functional near-infrared spectroscopy (fNIRS). Dyads of 36 subjects participated in two conditions, drumming and talking, alternating between 'sending' (drumming or talking to partner) and 'receiving' (listening to partner) in response to emotionally salient images from the International Affective Picture System. Increased frequency and amplitude of drum strikes was behaviorally correlated with higher arousal and lower valence measures and neurally correlated with temporoparietal junction (TPJ) activation in the listener. Contrast comparisons of drumming greater than talking also revealed neural activity in right TPJ. Together, findings suggest that emotional content communicated by drumming engages right TPJ mechanisms in an emotionally and behaviorally sensitive fashion. Drumming may provide novel, effective clinical approaches for treating social-emotional psychopathology.
Collapse
Affiliation(s)
| | | | | | - Joy Hirsch
- Department of Psychiatry.,Department of Neuroscience.,Department of Comparative Medicine, Yale School of Medicine, New Haven, CT.,Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| |
Collapse
|
34
|
Zhang Y, Meng T, Hou Y, Pan Y, Hu Y. Interpersonal brain synchronization associated with working alliance during psychological counseling. Psychiatry Res Neuroimaging 2018; 282:103-109. [PMID: 30292535 DOI: 10.1016/j.pscychresns.2018.09.007] [Citation(s) in RCA: 38] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/15/2018] [Revised: 09/22/2018] [Accepted: 09/27/2018] [Indexed: 11/16/2022]
Abstract
The mechanisms underlying behavioral synchrony during psychological counseling are not clear. Recent research has provided evidence that pervasive synchrony is associated with interpersonal brain synchronization (IBS) and possibly contributes to the positive working alliance-the degree to which the counseling dyads engage in collaborative and purposive work. Our study explored the IBS between the clients and the counselors using functional near-infrared spectroscopy (fNIRS)-based hyperscanning. Thirty-four participants (as clients) were randomly assigned either to the psychological counseling group or to the chatting group; three female professional counselors provided them with 40 minutes of psychological counseling or chatting. We found better working alliances and increased IBS in the right temporo-parietal junction (rTPJ) between clients and counselors during psychological counseling (versus chatting). Such IBS also correlated with the bond of working alliance. To our knowledge, our work represents the first demonstration of fNIRS-hyperscanning measurements for synchronous brain activity between the clients and counselors. This study refines the neural explanation of behavioral synchrony during psychological counseling.
Collapse
Affiliation(s)
- Ya Zhang
- Shanghai Key Laboratory of Brain Functional Genomics, Shanghai Changning-ECNU Mental Health Center, Key Laboratory of Brain Functional Genomics, Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Tian Meng
- Shanghai Key Laboratory of Brain Functional Genomics, Shanghai Changning-ECNU Mental Health Center, Key Laboratory of Brain Functional Genomics, Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Yingying Hou
- Shanghai Key Laboratory of Brain Functional Genomics, Shanghai Changning-ECNU Mental Health Center, Key Laboratory of Brain Functional Genomics, Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Yafeng Pan
- Shanghai Key Laboratory of Brain Functional Genomics, Shanghai Changning-ECNU Mental Health Center, Key Laboratory of Brain Functional Genomics, Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China; Neuropsychology and Functional Neuroimaging Research Unit (UR2NF), ULB Neuroscience Institute (UNI), Université Libre de Bruxelles, Bruxelles, Belgium.
| | - Yi Hu
- Shanghai Key Laboratory of Brain Functional Genomics, Shanghai Changning-ECNU Mental Health Center, Key Laboratory of Brain Functional Genomics, Ministry of Education, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China.
| |
Collapse
|
35
|
Hirsch J, Adam Noah J, Zhang X, Dravida S, Ono Y. A cross-brain neural mechanism for human-to-human verbal communication. Soc Cogn Affect Neurosci 2018; 13:907-920. [PMID: 30137601 PMCID: PMC6137318 DOI: 10.1093/scan/nsy070] [Citation(s) in RCA: 53] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2018] [Revised: 07/26/2018] [Accepted: 08/08/2018] [Indexed: 02/05/2023] Open
Abstract
Neural mechanisms that mediate dynamic social interactions remain understudied despite their evolutionary significance. The interactive brain hypothesis proposes that interactive social cues are processed by dedicated brain substrates and provides a general theoretical framework for investigating the underlying neural mechanisms of social interaction. We test the specific case of this hypothesis proposing that canonical language areas are upregulated and dynamically coupled across brains during social interactions based on talking and listening. Functional near-infrared spectroscopy (fNIRS) was employed to acquire simultaneous deoxyhemoglobin (deOxyHb) signals of the brain on partners who alternated between speaking and listening while doing an Object Naming & Description task with and without interaction in a natural setting. Comparison of interactive and non-interactive conditions confirmed an increase in neural activity associated with Wernicke's area including the superior temporal gyrus (STG) during interaction (P = 0.04). However, the hypothesis was not supported for Broca's area. Cross-brain coherence determined by wavelet analyses of signals originating from the STG and the subcentral area was greater during interaction than non-interaction (P < 0.01). In support of the interactive brain hypothesis these findings suggest a dynamically coupled cross-brain neural mechanism dedicated to pathways that share interpersonal information.
Collapse
Affiliation(s)
- Joy Hirsch
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Department of Neuroscience, Yale School of Medicine, New Haven, CT, USA
- Department of Comparative Medicine, Yale School of Medicine, New Haven, CT, USA
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA
- Department of Medical Physics and Biomedical Engineering, University College London, London, UK
| | - J Adam Noah
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Xian Zhang
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
| | - Swethasri Dravida
- Interdepartmental Neuroscience Program, Yale School of Medicine, New Haven, CT, USA
- Medical Student Training Program, Yale School of Medicine, New Haven, CT, USA
| | - Yumie Ono
- Department of Psychiatry, Yale School of Medicine, New Haven, CT, USA
- Department of Electronics and Bioinformatics, School of Science and Technology, Meiji University, Kawasaki, Kanagawa, Japan
| |
Collapse
|
36
|
Bulgarelli C, Blasi A, Arridge S, Powell S, de Klerk CCJM, Southgate V, Brigadoi S, Penny W, Tak S, Hamilton A. Dynamic causal modelling on infant fNIRS data: A validation study on a simultaneously recorded fNIRS-fMRI dataset. Neuroimage 2018; 175:413-424. [PMID: 29655936 PMCID: PMC5971219 DOI: 10.1016/j.neuroimage.2018.04.022] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2018] [Revised: 03/19/2018] [Accepted: 04/09/2018] [Indexed: 01/25/2023] Open
Abstract
Tracking the connectivity of the developing brain from infancy through childhood is an area of increasing research interest, and fNIRS provides an ideal method for studying the infant brain as it is compact, safe and robust to motion. However, data analysis methods for fNIRS are still underdeveloped compared to those available for fMRI. Dynamic causal modelling (DCM) is an advanced connectivity technique developed for fMRI data, that aims to estimate the coupling between brain regions and how this might be modulated by changes in experimental conditions. DCM has recently been applied to adult fNIRS, but not to infants. The present paper provides a proof-of-principle for the application of this method to infant fNIRS data and a demonstration of the robustness of this method using a simultaneously recorded fMRI-fNIRS single case study, thereby allowing the use of this technique in future infant studies. fMRI and fNIRS were simultaneously recorded from a 6-month-old sleeping infant, who was presented with auditory stimuli in a block design. Both fMRI and fNIRS data were preprocessed using SPM, and analysed using a general linear model approach. The main challenges that adapting DCM for fNIRS infant data posed included: (i) the import of the structural image of the participant for spatial pre-processing, (ii) the spatial registration of the optodes on the structural image of the infant, (iii) calculation of an accurate 3-layer segmentation of the structural image, (iv) creation of a high-density mesh as well as (v) the estimation of the NIRS optical sensitivity functions. To assess our results, we compared the values obtained for variational Free Energy (F), Bayesian Model Selection (BMS) and Bayesian Model Average (BMA) with the same set of possible models applied to both the fMRI and fNIRS datasets. We found high correspondence in F, BMS, and BMA between fMRI and fNIRS data, therefore showing for the first time high reliability of DCM applied to infant fNIRS data. This work opens new avenues for future research on effective connectivity in infancy by contributing a data analysis pipeline and guidance for applying DCM to infant fNIRS data. Connectivity studies give important insights into infant brain development. fNIRS is a valuable method for infancy studies, but can we analyse connectivity? On fMRI-fNIRS acquired simultaneously, we estimate effective connectivity with DCM. We showed high correspondence of DCM values between fMRI and fNIRS data. We validated DCM on fNIRS infant data, providing guidance for future projects.
Collapse
Affiliation(s)
- Chiara Bulgarelli
- Centre for Brain and Cognitive Development, Birkbeck College, University of London, United Kingdom.
| | - Anna Blasi
- Centre for Brain and Cognitive Development, Birkbeck College, University of London, United Kingdom
| | - Simon Arridge
- Centre for Medical Image Computing, University College London, United Kingdom
| | - Samuel Powell
- Department of Medical Physics and Biomedical Engineering, University College London, United Kingdom
| | - Carina C J M de Klerk
- Centre for Brain and Cognitive Development, Birkbeck College, University of London, United Kingdom
| | | | - Sabrina Brigadoi
- Department of Developmental Psychology, University of Padova, Italy
| | - William Penny
- School of Psychology, University of East Anglia, Norwich, United Kingdom
| | - Sungho Tak
- Bioimaging Research Team, Korea Basic Science Institute, South Korea
| | - Antonia Hamilton
- Institute of Cognitive Neuroscience, University College London, United Kingdom
| |
Collapse
|
37
|
Sun PP, Tan FL, Zhang Z, Jiang YH, Zhao Y, Zhu CZ. Feasibility of Functional Near-Infrared Spectroscopy (fNIRS) to Investigate the Mirror Neuron System: An Experimental Study in a Real-Life Situation. Front Hum Neurosci 2018; 12:86. [PMID: 29556185 PMCID: PMC5845015 DOI: 10.3389/fnhum.2018.00086] [Citation(s) in RCA: 53] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2017] [Accepted: 02/19/2018] [Indexed: 01/01/2023] Open
Abstract
The mirror neuron system (MNS), mainly including the premotor cortex (PMC), inferior frontal gyrus (IFG), superior parietal lobule (SPL), and rostral inferior parietal lobule (IPL), has attracted extensive attention as a possible neural mechanism of social interaction. Owing to high ecological validity, functional near-infrared spectroscopy (fNIRS) has become an ideal approach for exploring the MNS. Unfortunately, for the feasibility of fNIRS to detect the MNS, none of the four dominant regions were found in previous studies, implying a very limited capacity of fNIRS to investigate the MNS. Here, we adopted an experimental paradigm in a real-life situation to evaluate whether the MNS activity, including four dominant regions, can be detected by using fNIRS. Specifically, 30 right-handed subjects were asked to complete a table-setting task that included action execution and action observation. A double density probe configuration covered the four regions of the MNS in the left hemisphere. We used a traditional channel-based group analysis and also a ROI-based group analysis to find which regions are activated during both action execution and action observation. The results showed that the IFG, adjacent PMC, SPL, and IPL were involved in both conditions, indicating the feasibility of fNIRS to detect the MNS. Our findings provide a foundation for future research to explore the functional role of the MNS in social interaction and various disorders using fNIRS.
Collapse
Affiliation(s)
- Pei-Pei Sun
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Fu-Lun Tan
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Zong Zhang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Yi-Han Jiang
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Yang Zhao
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China
| | - Chao-Zhe Zhu
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing, China.,IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China.,Center for Collaboration and Innovation in Brain and Learning Sciences, Beijing Normal University, Beijing, China
| |
Collapse
|