1
|
Tamburro G, Bruña R, Fiedler P, De Fano A, Raeisi K, Khazaei M, Zappasodi F, Comani S. An Analytical Approach for Naturalistic Cooperative and Competitive EEG-Hyperscanning Data: A Proof-of-Concept Study. SENSORS (BASEL, SWITZERLAND) 2024; 24:2995. [PMID: 38793851 PMCID: PMC11125252 DOI: 10.3390/s24102995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 04/03/2024] [Accepted: 05/02/2024] [Indexed: 05/26/2024]
Abstract
Investigating the neural mechanisms underlying both cooperative and competitive joint actions may have a wide impact in many social contexts of human daily life. An effective pipeline of analysis for hyperscanning data recorded in a naturalistic context with a cooperative and competitive motor task has been missing. We propose an analytical pipeline for this type of joint action data, which was validated on electroencephalographic (EEG) signals recorded in a proof-of-concept study on two dyads playing cooperative and competitive table tennis. Functional connectivity maps were reconstructed using the corrected imaginary part of the phase locking value (ciPLV), an algorithm suitable in case of EEG signals recorded during turn-based competitive joint actions. Hyperbrain, within-, and between-brain functional connectivity maps were calculated in three frequency bands (i.e., theta, alpha, and beta) relevant during complex motor task execution and were characterized with graph theoretical measures and a clustering approach. The results of the proof-of-concept study are in line with recent findings on the main features of the functional networks sustaining cooperation and competition, hence demonstrating that the proposed pipeline is promising tool for the analysis of joint action EEG data recorded during cooperation and competition using a turn-based motor task.
Collapse
Affiliation(s)
- Gabriella Tamburro
- Behavioral Imaging and Neural Dynamics Center, G. d’Annunzio University of Chieti-Pescara, 66100 Chieti, Italy; (A.D.F.); (F.Z.); (S.C.)
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| | - Ricardo Bruña
- Center for Cognitive and Computational Neuroscience (C3N), Universidad Complutense de Madrid, 28040 Madrid, Spain;
- Department of Radiology, Rehabilitation and Physiotherapy, School of Medicine, Universidad Complutense de Madrid, IdISSC, 28040 Madrid, Spain
| | - Patrique Fiedler
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, 98693 Ilmenau, Germany
| | - Antonio De Fano
- Behavioral Imaging and Neural Dynamics Center, G. d’Annunzio University of Chieti-Pescara, 66100 Chieti, Italy; (A.D.F.); (F.Z.); (S.C.)
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| | - Khadijeh Raeisi
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| | - Mohammad Khazaei
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| | - Filippo Zappasodi
- Behavioral Imaging and Neural Dynamics Center, G. d’Annunzio University of Chieti-Pescara, 66100 Chieti, Italy; (A.D.F.); (F.Z.); (S.C.)
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
- Institute for Advanced Biomedical Technologies, University “Gabriele d’Annunzio” of Chieti–Pescara, 66100 Chieti, Italy
| | - Silvia Comani
- Behavioral Imaging and Neural Dynamics Center, G. d’Annunzio University of Chieti-Pescara, 66100 Chieti, Italy; (A.D.F.); (F.Z.); (S.C.)
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| |
Collapse
|
2
|
Boukarras S, Ferri D, Borgogni L, Aglioti SM. Neurophysiological markers of asymmetric emotional contagion: implications for organizational contexts. Front Integr Neurosci 2024; 18:1321130. [PMID: 38357225 PMCID: PMC10861795 DOI: 10.3389/fnint.2024.1321130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 01/02/2024] [Indexed: 02/16/2024] Open
Abstract
Emotions play a vital role within organizations, impacting various crucial aspects of work such as job satisfaction, performance, and employee well-being. Understanding how emotional states spread in organizational settings is therefore essential. Recent studies have highlighted that a leader's emotional state can influence their followers, with significant consequences on job performance. Leaders thus possess the ability to influence their employees' psychological state and, consequently, their well-being. However, the biological underpinnings of emotional contagion from leaders to followers remain unexplored. The field of interpersonal (neuro)physiology, which involves recording brain and peripheral activity of multiple individuals during interactions, holds great potential for investigating this phenomenon. Analyzing the time-lagged synchronization of neurophysiological activity during interactions may serve as a measure of the leader's influence on their followers in organizational contexts. In this "mini review," we examine empirical studies that have employed interpersonal (neuro)physiology to quantify the asymmetrical contagion of emotions in different contexts. Asymmetrical contagion was operationalized as the unidirectional influence exerted by one individual (i.e., the "sender") to another one (i.e., the "receiver"), whereby the receiver's state can be predicted by the sender's one. The reviewed literature reveals that delayed synchronization of physiological states is a widespread phenomenon that may underpin the transmission of emotions. These findings have significant implications for various aspects of organizational life, including leader-to-employee communication, and could drive the development of effective leadership training programs. We propose that Organizational Neuroscience may benefit from including interpersonal neurophysiology in its methodological toolkit for laboratory and field studies of leader-follower dynamics.
Collapse
Affiliation(s)
- Sarah Boukarras
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Santa Lucia Foundation, IRCCS, Rome, Italy
| | - Donato Ferri
- Department of Psychology, Sapienza University of Rome, Rome, Italy
- Ernst and Young (EY), Rome, Italy
| | - Laura Borgogni
- Department of Psychology, Sapienza University of Rome, Rome, Italy
| | - Salvatore Maria Aglioti
- Santa Lucia Foundation, IRCCS, Rome, Italy
- Sapienza University of Rome and CLN2S@Sapienza, Italian Institute of Technology, Rome, Italy
| |
Collapse
|
3
|
Atilla F, Alimardani M, Kawamoto T, Hiraki K. Mother-child inter-brain synchrony during a mutual visual search task: A study of feedback valence and role. Soc Neurosci 2023; 18:232-244. [PMID: 37395457 DOI: 10.1080/17470919.2023.2228545] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/28/2022] [Indexed: 07/04/2023]
Abstract
Parent and child have been shown to synchronize their behaviors and physiology during social interactions. This synchrony is an important marker of their relationship quality and subsequently the child's social and emotional development. Therefore, understanding the factors that influence parent-child synchrony is an important undertaking. Using EEG hyperscanning, this study investigated brain-to-brain synchrony in mother-child dyads when they took turns performing a visual search task and received positive or negative feedback. In addition to the effect of feedback valence, we studied how their assigned role, i.e., observing or performing the task, influenced synchrony. Results revealed that mother-child synchrony was higher during positive feedback relative to negative feedback in delta and gamma frequency bands. Furthermore, a main effect was found for role in the alpha band with higher synchrony when a child observed their mother performing the task compared to when the mother observed their child. These findings reveal that a positive social context could lead a mother and child to synchronize more on a neural level, which could subsequently improve the quality of their relationship. This study provides insight into mechanisms that underlie mother-child brain-to-brain synchrony, and establishes a framework by which the impact of emotion and task demand on a dyad's synchrony can be investigated.
Collapse
Affiliation(s)
- Fred Atilla
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, Netherlands
| | - Maryam Alimardani
- Department of Cognitive Science and Artificial Intelligence, Tilburg University, Tilburg, Netherlands
| | | | - Kazuo Hiraki
- Department of General Systems Studies, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
4
|
Mohanavelu K, Poonguzhali S, Janani A, Vinutha S. Machine learning-based approach for identifying mental workload of pilots. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103623] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
5
|
Saul MA, He X, Black S, Charles F. A Two-Person Neuroscience Approach for Social Anxiety: A Paradigm With Interbrain Synchrony and Neurofeedback. Front Psychol 2022; 12:568921. [PMID: 35095625 PMCID: PMC8796854 DOI: 10.3389/fpsyg.2021.568921] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Accepted: 12/06/2021] [Indexed: 12/11/2022] Open
Abstract
Social anxiety disorder has been widely recognised as one of the most commonly diagnosed mental disorders. Individuals with social anxiety disorder experience difficulties during social interactions that are essential in the regular functioning of daily routines; perpetually motivating research into the aetiology, maintenance and treatment methods. Traditionally, social and clinical neuroscience studies incorporated protocols testing one participant at a time. However, it has been recently suggested that such protocols are unable to directly assess social interaction performance, which can be revealed by testing multiple individuals simultaneously. The principle of two-person neuroscience highlights the interpersonal aspect of social interactions that observes behaviour and brain activity from both (or all) constituents of the interaction, rather than analysing on an individual level or an individual observation of a social situation. Therefore, two-person neuroscience could be a promising direction for assessment and intervention of the social anxiety disorder. In this paper, we propose a novel paradigm which integrates two-person neuroscience in a neurofeedback protocol. Neurofeedback and interbrain synchrony, a branch of two-person neuroscience, are discussed in their own capacities for their relationship with social anxiety disorder and relevance to the paradigm. The newly proposed paradigm sets out to assess the social interaction performance using interbrain synchrony between interacting individuals, and to employ a multi-user neurofeedback protocol for intervention of the social anxiety.
Collapse
Affiliation(s)
- Marcia A. Saul
- Faculty of Media and Communication, Centre for Digital Entertainment, Bournemouth University, Poole, United Kingdom
| | - Xun He
- Department of Psychology, Faculty of Science and Technology, Bournemouth University, Poole, United Kingdom
- *Correspondence: Xun He
| | - Stuart Black
- Applied Neuroscience Solutions Ltd., Frimley Green, United Kingdom
| | - Fred Charles
- Department of Creative Technology, Faculty of Science and Technology, Bournemouth University, Poole, United Kingdom
- Fred Charles
| |
Collapse
|
6
|
Zamm A, Palmer C, Bauer AKR, Bleichner MG, Demos AP, Debener S. Behavioral and Neural Dynamics of Interpersonal Synchrony Between Performing Musicians: A Wireless EEG Hyperscanning Study. Front Hum Neurosci 2021; 15:717810. [PMID: 34588966 PMCID: PMC8473838 DOI: 10.3389/fnhum.2021.717810] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Accepted: 07/27/2021] [Indexed: 11/13/2022] Open
Abstract
Interpersonal synchrony refers to the temporal coordination of actions between individuals and is a common feature of social behaviors, from team sport to ensemble music performance. Interpersonal synchrony of many rhythmic (periodic) behaviors displays dynamics of coupled biological oscillators. The current study addresses oscillatory dynamics on the levels of brain and behavior between music duet partners performing at spontaneous (uncued) rates. Wireless EEG was measured from N = 20 pairs of pianists as they performed a melody first in Solo performance (at their spontaneous rate of performance), and then in Duet performances at each partner's spontaneous rate. Influences of partners' spontaneous rates on interpersonal synchrony were assessed by correlating differences in partners' spontaneous rates of Solo performance with Duet tone onset asynchronies. Coupling between partners' neural oscillations was assessed by correlating amplitude envelope fluctuations of cortical oscillations at the Duet performance frequency between observed partners and between surrogate (re-paired) partners, who performed the same melody but at different times. Duet synchronization was influenced by partners' spontaneous rates in Solo performance. The size and direction of the difference in partners' spontaneous rates were mirrored in the size and direction of the Duet asynchronies. Moreover, observed Duet partners showed greater inter-brain correlations of oscillatory amplitude fluctuations than did surrogate partners, suggesting that performing in synchrony with a musical partner is reflected in coupled cortical dynamics at the performance frequency. The current study provides evidence that dynamics of oscillator coupling are reflected in both behavioral and neural measures of temporal coordination during musical joint action.
Collapse
Affiliation(s)
- Anna Zamm
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Caroline Palmer
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Anna-Katharina R. Bauer
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
| | - Martin G. Bleichner
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
| | - Alexander P. Demos
- Sequence Production Laboratory, Department of Psychology, McGill University, Montreal, QC, Canada
| | - Stefan Debener
- Neuropsychology Laboratory, Institute for Psychology, European Medical School, University of Oldenburg, Oldenburg, Germany
- Cluster of Excellence Hearing4All Oldenburg, University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
7
|
Cho PS, Escoffier N, Mao Y, Green C, Davis RC. Beyond physical entrainment: competitive and cooperative mental stances during identical joint-action tasks differently affect inter-subjective neural synchrony and judgments of agency. Soc Neurosci 2021; 15:368-379. [PMID: 32031918 DOI: 10.1080/17470919.2020.1727949] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
Little work has examined how mental stance alone, apart from physical entrainment, affects between-participant neural synchrony during joint social interaction. We report the first findings on how cooperative and competitive mental stances, even during identical visuomotor joint-action tasks, result in distinct neural oscillatory signatures in low beta and theta band between-participant phase synchrony. Two participants jointly controlled a cursor and were instructed to either compete or cooperate to move it to one of three targets. The visuomotor output was identical for both the compete and cooperate conditions because participants were privately given the same target for experimental trials. Cooperation enhanced theta band between-participant phase-locking value (PLV) midtrial at 1-2 seconds, reflecting activation of systems for social coordination to move the cursor in a shared direction. Competition enhanced low beta between-participant PLV, shifting from temporal to frontal regions, indicating that participants focused only on their target and later evaluated self-agency as winner or loser. This interpretation of the neural signature was corroborated by participants' greater post-trial ratings of the degree of control over the cursor during competition. Top-down cooperative and competitive mental stances shape perceptions of social context and affect interpersonal neural synchrony important for representation of self and others' actions.
Collapse
Affiliation(s)
- Philip S Cho
- Center for Science and Engineering Applications in Social Science, Yonsei University , Seoul, Korea.,Underwood International College, Yonsei University , Seoul, Korea
| | - Nicolas Escoffier
- Department of Psychology, National University of Singapore , Singapore.,Life Sciences Institute Programme in Neurobiology and Ageing, National University of Singapore , Singapore
| | - Yinan Mao
- Department of Statistics, National University of Singapore , Singapore
| | - Christopher Green
- Diagnostic Radiology and Psychiatry, Wayne State School of Medicine , Detroit, MI, USA
| | - Richard C Davis
- School of Information Systems, Singapore Management University , Singapore, Singapore
| |
Collapse
|
8
|
Liu H, Zhao C, Wang F, Zhang D. Inter-brain amplitude correlation differentiates cooperation from competition in a motion-sensing sports game. Soc Cogn Affect Neurosci 2021; 16:552-564. [PMID: 33693825 PMCID: PMC8138086 DOI: 10.1093/scan/nsab031] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2020] [Revised: 02/07/2021] [Accepted: 03/08/2021] [Indexed: 11/23/2022] Open
Abstract
Cooperation and competition are two basic modes of human interaction. Their underlying neural mechanisms, especially from an interpersonal perspective, have not been fully explored. Using the electroencephalograph-based hyperscanning technique, the present study investigated the neural correlates of both cooperation and competition within the same ecological paradigm using a classic motion-sensing tennis game. Both the inter-brain coupling (the inter-brain amplitude correlation and inter-brain phase-locking) and the intra-brain spectral power were analyzed. Only the inter-brain amplitude correlation showed a significant difference between cooperation and competition, with different spatial patterns at theta, alpha and beta frequency bands. Further inspection revealed distinct inter-brain coupling patterns for cooperation and competition; cooperation elicited positive inter-brain amplitude correlation at the delta and theta bands in extensive brain regions, while competition was associated with negative occipital inter-brain amplitude correlation at the alpha and beta bands. These findings add to our knowledge of the neural mechanisms of cooperation and competition and suggest the significance of adopting an inter-brain perspective in exploring the neural underpinnings of social interaction in ecological contexts.
Collapse
Affiliation(s)
- Huashuo Liu
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, China
| | - Chenying Zhao
- Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing 100084, China
| | - Fei Wang
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, China.,Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing 100084, China
| | - Dan Zhang
- Department of Psychology, School of Social Sciences, Tsinghua University, Beijing 100084, China.,Tsinghua Laboratory of Brain and Intelligence, Tsinghua University, Beijing 100084, China
| |
Collapse
|
9
|
Richard C, Karić MS, McConnell M, Poole J, Rupp G, Fink A, Meghdadi A, Berka C. Elevated Inter-Brain Coherence Between Subjects With Concordant Stances During Discussion of Social Issues. Front Hum Neurosci 2021; 15:611886. [PMID: 34054446 PMCID: PMC8160431 DOI: 10.3389/fnhum.2021.611886] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Accepted: 04/20/2021] [Indexed: 02/03/2023] Open
Abstract
Social media platforms offer convenient, instantaneous social sharing on a mass scale with tremendous impact on public perceptions, opinions, and behavior. There is a need to understand why information spreads including the human motivations, cognitive processes, and neural dynamics of large-scale sharing. This study introduces a novel approach for investigating the effect social media messaging and in-person discussion has on the inter-brain dynamics within small groups of participants. The psychophysiological impact of information campaigns and narrative messaging within a closed social media environment was assessed using 24-channel wireless EEG. Data were acquired from three- or four-person groups while subjects debated contemporary social issues framed by four scenarios of varying controversy: (a) investing in ethical vs. unethical corporations, (b) selecting travel destination based on social awareness, (c) determining verdict in a murder trial and the punishment of life in prison or death penalty, and (d) decision to vaccinate. Pre-/post-scenario questionnaires assess the effects of the social media information. Inter-brain coherence between subject pairs on each social issue discussed by subjects was analyzed by concordance, agreement vs. disagreement, and by group unanimity, unanimous vs. not unanimous. Subject pairs that agreed on the social issues raised in the scenarios had significantly greater inter-brain coherence in gamma frequency range than disagreeing pairs over cortical regions known to be involved in social interactions. These effects were magnified when comparing groups where subject pairs were unanimous in their stance on the social issues for some but not all scenarios. While there was considerable overlap between scenarios in what EEG channels were significant, there was enough variability to indicate the possibility of scenario-specific effects on inter-brain coherence.
Collapse
|
10
|
Brain-to-Brain Neural Synchrony During Social Interactions: A Systematic Review on Hyperscanning Studies. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10196669] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
The aim of this study was to conduct a comprehensive review on hyperscanning research (measuring brain activity simultaneously from more than two people interacting) using an explicit systematic method, the preferred reporting items for systematic reviews and meta-analyses (PRISMA). Data were searched from IEEE Xplore, PubMed, Engineering Village, Web of Science and Scopus databases. Inclusion criteria were journal articles written in English from 2000 to 19 June 2019. A total of 126 empirical studies were screened out to address three specific questions regarding the neuroimaging method, the application domain, and the experiment paradigm. Results showed that the most used neuroimaging method with hyperscanning was magnetoencephalography/electroencephalography (MEG/EEG; 47%), and the least used neuroimaging method was hyper-transcranial Alternating Current Stimulation (tACS) (1%). Applications in cognition accounted for almost half the studies (48%), while educational applications accounted for less than 5% of the studies. Applications in decision-making tasks were the second most common (26%), shortly followed by applications in motor synchronization (23%). The findings from this systematic review that were based on documented, transparent and reproducible searches should help build cumulative knowledge and guide future research regarding inter-brain neural synchrony during social interactions, that is, hyperscanning research.
Collapse
|
11
|
Trendafilov D, Schmitz G, Hwang TH, Effenberg AO, Polani D. Tilting Together: An Information-Theoretic Characterization of Behavioral Roles in Rhythmic Dyadic Interaction. Front Hum Neurosci 2020; 14:185. [PMID: 32523522 PMCID: PMC7261889 DOI: 10.3389/fnhum.2020.00185] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Accepted: 04/27/2020] [Indexed: 11/19/2022] Open
Abstract
Every joint collaborative physical activity performed by a group of people, e.g., carrying a table, typically leads to the emergence of spatiotemporal coordination of individual motor behavior. Such interpersonal coordination can arise solely based on the observation of the partners' and/or the object's movements, without the presence of verbal communication. In this paper, we investigate how the social coupling between two individuals in a collaborative task translates into measured objective and subjective performance indicators recorded in two different studies. We analyse the trends in the dyadic interrelationship based on the information-theoretic measure of transfer entropy and identify emerging leader-follower roles. In our experimental paradigm, the actions of the pair of subjects are continuously and seamlessly fused, resulting in a joint control of an object simulated on a tablet computer. Subjects need to synchronize their movements with a 90° phase difference in order to keep the object (a ball) rotating precisely on a predefined circular or elliptic trajectory on a tablet device. Results demonstrate how the identification of causal dependencies in this social interaction task could reveal specific trends in human behavior and provide insights into the emergence of social sensorimotor contingencies.
Collapse
Affiliation(s)
- Dari Trendafilov
- Institute of Pervasive Computing, Johannes Kepler University, Linz, Austria
| | - Gerd Schmitz
- Department of Humanities, Institute of Sports Science, Leibniz University Hannover, Hanover, Germany
| | - Tong-Hun Hwang
- Department of Humanities, Institute of Sports Science, Leibniz University Hannover, Hanover, Germany
| | - Alfred O Effenberg
- Department of Humanities, Institute of Sports Science, Leibniz University Hannover, Hanover, Germany
| | - Daniel Polani
- Adaptive Systems, University of Hertfordshire, Hatfield, United Kingdom
| |
Collapse
|
12
|
Czeszumski A, Eustergerling S, Lang A, Menrath D, Gerstenberger M, Schuberth S, Schreiber F, Rendon ZZ, König P. Hyperscanning: A Valid Method to Study Neural Inter-brain Underpinnings of Social Interaction. Front Hum Neurosci 2020; 14:39. [PMID: 32180710 PMCID: PMC7059252 DOI: 10.3389/fnhum.2020.00039] [Citation(s) in RCA: 183] [Impact Index Per Article: 45.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2019] [Accepted: 01/27/2020] [Indexed: 01/11/2023] Open
Abstract
Social interactions are a crucial part of human life. Understanding the neural underpinnings of social interactions is a challenging task that the hyperscanning method has been trying to tackle over the last two decades. Here, we review the existing literature and evaluate the current state of the hyperscanning method. We review the type of methods (fMRI, M/EEG, and fNIRS) that are used to measure brain activity from more than one participant simultaneously and weigh their pros and cons for hyperscanning. Further, we discuss different types of analyses that are used to estimate brain networks and synchronization. Lastly, we present results of hyperscanning studies in the context of different cognitive functions and their relations to social interactions. All in all, we aim to comprehensively present methods, analyses, and results from the last 20 years of hyperscanning research.
Collapse
Affiliation(s)
- Artur Czeszumski
- Institute of Cognitive Science, Universität Osnabrück, Osnabrück, Germany
| | - Sara Eustergerling
- Institute of Cognitive Science, Universität Osnabrück, Osnabrück, Germany
| | - Anne Lang
- Institute of Cognitive Science, Universität Osnabrück, Osnabrück, Germany
| | - David Menrath
- Institute of Cognitive Science, Universität Osnabrück, Osnabrück, Germany
| | | | - Susanne Schuberth
- Institute of Cognitive Science, Universität Osnabrück, Osnabrück, Germany
| | - Felix Schreiber
- Institute of Cognitive Science, Universität Osnabrück, Osnabrück, Germany
| | | | - Peter König
- Institute of Cognitive Science, Universität Osnabrück, Osnabrück, Germany.,Institut für Neurophysiologie und Pathophysiologie, Universitätsklinikum Hamburg-Eppendorf, Hamburg, Germany
| |
Collapse
|
13
|
Lee S, Cho H, Kim K, Jun SC. Simultaneous EEG Acquisition System for Multiple Users: Development and Related Issues. SENSORS (BASEL, SWITZERLAND) 2019; 19:E4592. [PMID: 31652579 PMCID: PMC6832946 DOI: 10.3390/s19204592] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/21/2019] [Revised: 10/17/2019] [Accepted: 10/20/2019] [Indexed: 11/25/2022]
Abstract
Social interaction is one of humans' most important activities and many efforts have been made to understand the phenomenon. Recently, some investigators have attempted to apply advanced brain signal acquisition systems that allow dynamic brain activities to be measured simultaneously during social interactions. Most studies to date have investigated dyadic interactions, although multilateral interactions are more common in reality. However, it is believed that most studies have focused on such interactions because of methodological limitations, in that it is very difficult to design a well-controlled experiment for multiple users at a reasonable cost. Accordingly, there are few simultaneous acquisition systems for multiple users. In this study, we propose a design framework for an acquisition system that measures EEG data simultaneously in an environment with 10 or more people. Our proposed framework allowed us to acquire EEG data at up to 1 kHz frequency from up to 20 people simultaneously. Details of our acquisition system are described from hardware and software perspectives. In addition, various related issues that arose in the system's development-such as synchronization techniques, system loads, electrodes, and applications-are discussed. In addition, simultaneous visual ERP experiments were conducted with a group of nine people to validate the EEG acquisition framework proposed. We found that our framework worked reasonably well with respect to less than 4 ms delay and average loss rates of 1%. It is expected that this system can be used in various hyperscanning studies, such as those on crowd psychology, large-scale human interactions, and collaborative brain-computer interface, among others.
Collapse
Affiliation(s)
- Sunghan Lee
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Korea.
| | - Hohyun Cho
- Wadsworth Center, New York State Department of Health, Albany, NY 12201, USA.
| | - Kiseong Kim
- Department of Bio and Brain Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Korea.
- R&D Center, BioBrain Inc., Daejeon, 35203, Korea.
| | - Sung Chan Jun
- School of Electrical Engineering and Computer Science, Gwangju Institute of Science and Technology, Gwangju 61005, Korea.
| |
Collapse
|
14
|
Greco A, Spada D, Rossi S, Perani D, Valenza G, Scilingo EP. EEG Hyperconnectivity Study on Saxophone Quartet Playing in Ensemble. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2018:1015-1018. [PMID: 30440563 DOI: 10.1109/embc.2018.8512409] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
A professional quartet of saxophonists playing in ensemble provides a perfect scenario to study the eventual occurrence of synchronous oscillatory brain activity across subjects. Here, we applied hyperscanning methodologies for simultaneously recordings of electroencephalographic (EEG) signals from four professional saxophonists while they observ an audiovideo recording of their own previous musical performance. An ad-hoc musical composition was written for the study. At debriefing, the subjects were asked to answer two questionnaires to assess their empathy trait and the musical leadership. In order to estimate the hyperconnectivity of each musician we proposed a measure which combines phase synchronization index of brain oscillations and graph theory framework. The inter-connectivity level of each musician was statistically compared. Statistical results revealed a significant lower hyperconnectivity in the left Brodmann area 44 for the Soprano with respect to the other three members. Recent theories attributed this brain region (Broca's area) to music generation, empathy processes and communication. We hypothesize a relationship between brain-to-brain connectivity level and the musical role within the quartet.
Collapse
|
15
|
Mu Y, Cerritos C, Khan F. Neural mechanisms underlying interpersonal coordination: A review of hyperscanning research. SOCIAL AND PERSONALITY PSYCHOLOGY COMPASS 2018. [DOI: 10.1111/spc3.12421] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
16
|
Brain-to-brain coupling during handholding is associated with pain reduction. Proc Natl Acad Sci U S A 2018; 115:E2528-E2537. [PMID: 29483250 DOI: 10.1073/pnas.1703643115] [Citation(s) in RCA: 157] [Impact Index Per Article: 26.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023] Open
Abstract
The mechanisms underlying analgesia related to social touch are not clear. While recent research highlights the role of the empathy of the observer to pain relief in the target, the contribution of social interaction to analgesia is unknown. The current study examines brain-to-brain coupling during pain with interpersonal touch and tests the involvement of interbrain synchrony in pain alleviation. Romantic partners were assigned the roles of target (pain receiver) and observer (pain observer) under pain-no-pain and touch-no-touch conditions concurrent with EEG recording. Brain-to-brain coupling in alpha-mu band (8-12 Hz) was estimated by a three-step multilevel analysis procedure based on running window circular correlation coefficient and post hoc power of the findings was calculated using simulations. Our findings indicate that hand-holding during pain administration increases brain-to-brain coupling in a network that mainly involves the central regions of the pain target and the right hemisphere of the pain observer. Moreover, brain-to-brain coupling in this network was found to correlate with analgesia magnitude and observer's empathic accuracy. These findings indicate that brain-to-brain coupling may be involved in touch-related analgesia.
Collapse
|
17
|
Balconi M, Vanutelli ME. Cooperation and Competition with Hyperscanning Methods: Review and Future Application to Emotion Domain. Front Comput Neurosci 2017; 11:86. [PMID: 29033810 PMCID: PMC5627061 DOI: 10.3389/fncom.2017.00086] [Citation(s) in RCA: 46] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2017] [Accepted: 09/06/2017] [Indexed: 11/24/2022] Open
Abstract
Cooperation and competition, as two common and opposite examples of interpersonal dynamics, are thought to be reflected by different cognitive, neural, and behavioral patterns. According to the conventional approach, they have been explored by measuring subjects' reactions during individual performance or turn-based interactions in artificial settings, that don't allow on-line, ecological enactment of real-life social exchange. Considering the importance of these factors, and accounting for the complexity of such phenomena, the hyperscanning approach emerged as a multi-subject paradigm since it allows the simultaneous recording of the brain activity from multiple participants interacting. In this view, the present paper aimed at reviewing the most significant work about cooperation and competition by EEG hyperscanning technique, which proved to be a promising tool in capturing the sudden course of social interactions. In detail, the review will consider and group different experimental tasks that have been developed so far: (1) paradigms that used rhythm, music and motor synchronization; (2) card tasks taken from the Game Theory; (3) computerized tasks; and (4) possible real-life applications. Finally, although highlighting the potential contribution of such approach, some important limitations about these paradigms will be elucidated, with a specific focus on the emotional domain.
Collapse
Affiliation(s)
- Michela Balconi
- Research Unit in Affective and Social Neuroscience, Catholic University of Milan, Milan, Italy.,Department of Psychology, Catholic University of Milan, Milan, Italy
| | - Maria E Vanutelli
- Research Unit in Affective and Social Neuroscience, Catholic University of Milan, Milan, Italy.,Department of Psychology, Catholic University of Milan, Milan, Italy.,Department of Philosophy, Università degli Studi di Milano, Milan, Italy
| |
Collapse
|
18
|
Acquadro MAS, Congedo M, De Riddeer D. Music Performance As an Experimental Approach to Hyperscanning Studies. Front Hum Neurosci 2016; 10:242. [PMID: 27252641 PMCID: PMC4879135 DOI: 10.3389/fnhum.2016.00242] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2015] [Accepted: 05/09/2016] [Indexed: 01/10/2023] Open
Abstract
Humans are fundamentally social and tend to create emergent organizations when interacting with each other; from dyads to families, small groups, large groups, societies, and civilizations. The study of the neuronal substrate of human social behavior is currently gaining momentum in the young field of social neuroscience. Hyperscanning is a neuroimaging technique by which we can study two or more brains simultaneously while participants interact with each other. The aim of this article is to discuss several factors that we deem important in designing hyperscanning experiments. We first review hyperscanning studies performed by means of electroencephalography (EEG) that have been relying on a continuous interaction paradigm. Then, we provide arguments for favoring ecological paradigms, for studying the emotional component of social interactions and for performing longitudinal studies, the last two aspects being largely neglected so far in the hyperscanning literature despite their paramount importance in social sciences. Based on these premises, we argue that music performance is a suitable experimental setting for hyperscanning and that for such studies EEG is an appropriate choice as neuroimaging modality.
Collapse
Affiliation(s)
- Michaël A. S. Acquadro
- Centre National de la Recherche Scientifique, Gipsa-Lab-DIS, University of Grenoble-AlpesGrenoble, France
| | - Marco Congedo
- Centre National de la Recherche Scientifique, Gipsa-Lab-DIS, University of Grenoble-AlpesGrenoble, France
| | - Dirk De Riddeer
- Dunedin School of Medicine, Otago UniversityDunedin, New Zealand
| |
Collapse
|
19
|
Toppi J, Borghini G, Petti M, He EJ, De Giusti V, He B, Astolfi L, Babiloni F. Investigating Cooperative Behavior in Ecological Settings: An EEG Hyperscanning Study. PLoS One 2016; 11:e0154236. [PMID: 27124558 PMCID: PMC4849782 DOI: 10.1371/journal.pone.0154236] [Citation(s) in RCA: 105] [Impact Index Per Article: 13.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2016] [Accepted: 04/11/2016] [Indexed: 11/28/2022] Open
Abstract
The coordinated interactions between individuals are fundamental for the success of the activities in some professional categories. We reported on brain-to-brain cooperative interactions between civil pilots during a simulated flight. We demonstrated for the first time how the combination of neuroelectrical hyperscanning and intersubject connectivity could provide indicators sensitive to the humans’ degree of synchronization under a highly demanding task performed in an ecological environment. Our results showed how intersubject connectivity was able to i) characterize the degree of cooperation between pilots in different phases of the flight, and ii) to highlight the role of specific brain macro areas in cooperative behavior. During the most cooperative flight phases pilots showed, in fact, dense patterns of interbrain connectivity, mainly linking frontal and parietal brain areas. On the contrary, the amount of interbrain connections went close to zero in the non-cooperative phase. The reliability of the interbrain connectivity patterns was verified by means of a baseline condition represented by formal couples, i.e. pilots paired offline for the connectivity analysis but not simultaneously recorded during the flight. Interbrain density was, in fact, significantly higher in real couples with respect to formal couples in the cooperative flight phases. All the achieved results demonstrated how the description of brain networks at the basis of cooperation could effectively benefit from a hyperscanning approach. Interbrain connectivity was, in fact, more informative in the investigation of cooperative behavior with respect to established EEG signal processing methodologies applied at a single subject level.
Collapse
Affiliation(s)
- Jlenia Toppi
- Dept. of Computer, Control, and Management Engineering, "Sapienza" University of Rome, Via Ariosto 25, I – 00185, Rome, Italy
- IRCCS Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, Via Ardeatina 306, I– 00179, Rome, Italy
- * E-mail:
| | - Gianluca Borghini
- IRCCS Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, Via Ardeatina 306, I– 00179, Rome, Italy
- Dept. of Molecular Medicine, "Sapienza" University of Rome, viale Regina Elena 291, Rome, Italy
| | - Manuela Petti
- Dept. of Computer, Control, and Management Engineering, "Sapienza" University of Rome, Via Ariosto 25, I – 00185, Rome, Italy
- IRCCS Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, Via Ardeatina 306, I– 00179, Rome, Italy
| | - Eric J. He
- Carnegie Mellon University, Pittsburgh, PA 15213, Stati Uniti, United States of America
| | - Vittorio De Giusti
- Dept. of Molecular Medicine, "Sapienza" University of Rome, viale Regina Elena 291, Rome, Italy
| | - Bin He
- Dept. of Biomedical Engineering, University of Minnesota, 7–105 Hasselmo Hall 312 Church St. SE, Minneapolis, Minnesota, United States of America
| | - Laura Astolfi
- Dept. of Computer, Control, and Management Engineering, "Sapienza" University of Rome, Via Ariosto 25, I – 00185, Rome, Italy
- IRCCS Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, Via Ardeatina 306, I– 00179, Rome, Italy
| | - Fabio Babiloni
- IRCCS Fondazione Santa Lucia, Neuroelectrical Imaging and BCI Lab, Via Ardeatina 306, I– 00179, Rome, Italy
- Dept. of Molecular Medicine, "Sapienza" University of Rome, viale Regina Elena 291, Rome, Italy
| |
Collapse
|
20
|
Hachmeister N, Finke A, Ritter H. Does machine-mediated interaction induce inter-brain synchrony?--A hyperscanning study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2014:1018-21. [PMID: 25570134 DOI: 10.1109/embc.2014.6943766] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
We present a study in which participants were trained in several sessions to control a (comparatively simple) robot via an EEG-/motor imagery-based Brain-Computer Interface (BCI). In the final (experiment) session pairs of participants were formed and each participant controlled one of two robots in a shared space. EEG data was recorded synchronously from both participants. We performed a joint data analysis on the datasets and found increases of phase-locking in μ- and θ-band. One such phase-locking effect appears to be time-locked to the start of the robotic action.
Collapse
|
21
|
Burgess AP. On the interpretation of synchronization in EEG hyperscanning studies: a cautionary note. Front Hum Neurosci 2013; 7:881. [PMID: 24399948 PMCID: PMC3870947 DOI: 10.3389/fnhum.2013.00881] [Citation(s) in RCA: 123] [Impact Index Per Article: 11.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2013] [Accepted: 12/03/2013] [Indexed: 11/13/2022] Open
Abstract
EEG Hyperscanning is a method for studying two or more individuals simultaneously with the objective of elucidating how co-variations in their neural activity (i.e., hyperconnectivity) are influenced by their behavioral and social interactions. The aim of this study was to compare the performance of different hyper-connectivity measures using (i) simulated data, where the degree of coupling could be systematically manipulated, and (ii) individually recorded human EEG combined into pseudo-pairs of participants where no hyper-connections could exist. With simulated data we found that each of the most widely used measures of hyperconnectivity were biased and detected hyper-connections where none existed. With pseudo-pairs of human data we found spurious hyper-connections that arose because there were genuine similarities between the EEG recorded from different people independently but under the same experimental conditions. Specifically, there were systematic differences between experimental conditions in terms of the rhythmicity of the EEG that were common across participants. As any imbalance between experimental conditions in terms of stimulus presentation or movement may affect the rhythmicity of the EEG, this problem could apply in many hyperscanning contexts. Furthermore, as these spurious hyper-connections reflected real similarities between the EEGs, they were not Type-1 errors that could be overcome by some appropriate statistical control. However, some measures that have not previously been used in hyperconnectivity studies, notably the circular correlation co-efficient (CCorr), were less susceptible to detecting spurious hyper-connections of this type. The reason for this advantage in performance is discussed and the use of the CCorr as an alternative measure of hyperconnectivity is advocated.
Collapse
Affiliation(s)
- Adrian P Burgess
- Aston Brain Centre, School of Life and Health Sciences, Aston University Birmingham, UK
| |
Collapse
|