1
|
Tamburro G, Bruña R, Fiedler P, De Fano A, Raeisi K, Khazaei M, Zappasodi F, Comani S. An Analytical Approach for Naturalistic Cooperative and Competitive EEG-Hyperscanning Data: A Proof-of-Concept Study. SENSORS (BASEL, SWITZERLAND) 2024; 24:2995. [PMID: 38793851 PMCID: PMC11125252 DOI: 10.3390/s24102995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 04/03/2024] [Accepted: 05/02/2024] [Indexed: 05/26/2024]
Abstract
Investigating the neural mechanisms underlying both cooperative and competitive joint actions may have a wide impact in many social contexts of human daily life. An effective pipeline of analysis for hyperscanning data recorded in a naturalistic context with a cooperative and competitive motor task has been missing. We propose an analytical pipeline for this type of joint action data, which was validated on electroencephalographic (EEG) signals recorded in a proof-of-concept study on two dyads playing cooperative and competitive table tennis. Functional connectivity maps were reconstructed using the corrected imaginary part of the phase locking value (ciPLV), an algorithm suitable in case of EEG signals recorded during turn-based competitive joint actions. Hyperbrain, within-, and between-brain functional connectivity maps were calculated in three frequency bands (i.e., theta, alpha, and beta) relevant during complex motor task execution and were characterized with graph theoretical measures and a clustering approach. The results of the proof-of-concept study are in line with recent findings on the main features of the functional networks sustaining cooperation and competition, hence demonstrating that the proposed pipeline is promising tool for the analysis of joint action EEG data recorded during cooperation and competition using a turn-based motor task.
Collapse
Affiliation(s)
- Gabriella Tamburro
- Behavioral Imaging and Neural Dynamics Center, G. d’Annunzio University of Chieti-Pescara, 66100 Chieti, Italy; (A.D.F.); (F.Z.); (S.C.)
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| | - Ricardo Bruña
- Center for Cognitive and Computational Neuroscience (C3N), Universidad Complutense de Madrid, 28040 Madrid, Spain;
- Department of Radiology, Rehabilitation and Physiotherapy, School of Medicine, Universidad Complutense de Madrid, IdISSC, 28040 Madrid, Spain
| | - Patrique Fiedler
- Institute of Biomedical Engineering and Informatics, Technische Universität Ilmenau, 98693 Ilmenau, Germany
| | - Antonio De Fano
- Behavioral Imaging and Neural Dynamics Center, G. d’Annunzio University of Chieti-Pescara, 66100 Chieti, Italy; (A.D.F.); (F.Z.); (S.C.)
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| | - Khadijeh Raeisi
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| | - Mohammad Khazaei
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| | - Filippo Zappasodi
- Behavioral Imaging and Neural Dynamics Center, G. d’Annunzio University of Chieti-Pescara, 66100 Chieti, Italy; (A.D.F.); (F.Z.); (S.C.)
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
- Institute for Advanced Biomedical Technologies, University “Gabriele d’Annunzio” of Chieti–Pescara, 66100 Chieti, Italy
| | - Silvia Comani
- Behavioral Imaging and Neural Dynamics Center, G. d’Annunzio University of Chieti-Pescara, 66100 Chieti, Italy; (A.D.F.); (F.Z.); (S.C.)
- Department of Neuroscience, Imaging and Clinical Sciences, G. d’Annunzio University of Chieti–Pescara, 66100 Chieti, Italy; (K.R.); (M.K.)
| |
Collapse
|
2
|
Jia T, Sun J, McGeady C, Ji L, Li C. Enhancing Brain-Computer Interface Performance by Incorporating Brain-to-Brain Coupling. CYBORG AND BIONIC SYSTEMS 2024; 5:0116. [PMID: 38680535 PMCID: PMC11052607 DOI: 10.34133/cbsystems.0116] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Accepted: 03/24/2024] [Indexed: 05/01/2024] Open
Abstract
Human cooperation relies on key features of social interaction in order to reach desirable outcomes. Similarly, human-robot interaction may benefit from integration with human-human interaction factors. In this paper, we aim to investigate brain-to-brain coupling during motor imagery (MI)-based brain-computer interface (BCI) training using eye-contact and hand-touch interaction. Twelve pairs of friends (experimental group) and 10 pairs of strangers (control group) were recruited for MI-based BCI tests concurrent with electroencephalography (EEG) hyperscanning. Event-related desynchronization (ERD) was estimated to measure cortical activation, and interbrain functional connectivity was assessed using multilevel statistical analysis. Furthermore, we compared BCI classification performance under different social interaction conditions. In the experimental group, greater ERD was found around the contralateral sensorimotor cortex under social interaction conditions compared with MI without any social interaction. Notably, EEG channels with decreased power were mainly distributed around the frontal, central, and occipital regions. A significant increase in interbrain coupling was also found under social interaction conditions. BCI decoding accuracies were significantly improved in the eye contact condition and eye and hand contact condition compared with the no-interaction condition. However, for the strangers' group, no positive effects were observed in comparisons of cortical activations between interaction and no-interaction conditions. These findings indicate that social interaction can improve the neural synchronization between familiar partners with enhanced brain activations and brain-to-brain coupling. This study may provide a novel method for enhancing MI-based BCI performance in conjunction with neural synchronization between users.
Collapse
Affiliation(s)
- Tianyu Jia
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
- Department of Bioengineering,
Imperial College London, London, UK
| | - Jingyao Sun
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
| | - Ciarán McGeady
- Department of Bioengineering,
Imperial College London, London, UK
| | - Linhong Ji
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
| | - Chong Li
- Lab of Intelligent and Biomimetic Machinery, Department of Mechanical Engineering,
Tsinghua University, Beijing, China
- School of Clinical Medicine,
Tsinghua University, Beijing, China
- Beijing Tsinghua Changgung Hospital,
Tsinghua University, Beijing, China
| |
Collapse
|
3
|
Konrad K, Gerloff C, Kohl SH, Mehler DMA, Mehlem L, Volbert EL, Komorek M, Henn AT, Boecker M, Weiss E, Reindl V. Interpersonal neural synchrony and mental disorders: unlocking potential pathways for clinical interventions. Front Neurosci 2024; 18:1286130. [PMID: 38529267 PMCID: PMC10962391 DOI: 10.3389/fnins.2024.1286130] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Accepted: 01/30/2024] [Indexed: 03/27/2024] Open
Abstract
Introduction Interpersonal synchronization involves the alignment of behavioral, affective, physiological, and brain states during social interactions. It facilitates empathy, emotion regulation, and prosocial commitment. Mental disorders characterized by social interaction dysfunction, such as Autism Spectrum Disorder (ASD), Reactive Attachment Disorder (RAD), and Social Anxiety Disorder (SAD), often exhibit atypical synchronization with others across multiple levels. With the introduction of the "second-person" neuroscience perspective, our understanding of interpersonal neural synchronization (INS) has improved, however, so far, it has hardly impacted the development of novel therapeutic interventions. Methods To evaluate the potential of INS-based treatments for mental disorders, we performed two systematic literature searches identifying studies that directly target INS through neurofeedback (12 publications; 9 independent studies) or brain stimulation techniques (7 studies), following PRISMA guidelines. In addition, we narratively review indirect INS manipulations through behavioral, biofeedback, or hormonal interventions. We discuss the potential of such treatments for ASD, RAD, and SAD and using a systematic database search assess the acceptability of neurofeedback (4 studies) and neurostimulation (4 studies) in patients with social dysfunction. Results Although behavioral approaches, such as engaging in eye contact or cooperative actions, have been shown to be associated with increased INS, little is known about potential long-term consequences of such interventions. Few proof-of-concept studies have utilized brain stimulation techniques, like transcranial direct current stimulation or INS-based neurofeedback, showing feasibility and preliminary evidence that such interventions can boost behavioral synchrony and social connectedness. Yet, optimal brain stimulation protocols and neurofeedback parameters are still undefined. For ASD, RAD, or SAD, so far no randomized controlled trial has proven the efficacy of direct INS-based intervention techniques, although in general brain stimulation and neurofeedback methods seem to be well accepted in these patient groups. Discussion Significant work remains to translate INS-based manipulations into effective treatments for social interaction disorders. Future research should focus on mechanistic insights into INS, technological advancements, and rigorous design standards. Furthermore, it will be key to compare interventions directly targeting INS to those targeting other modalities of synchrony as well as to define optimal target dyads and target synchrony states in clinical interventions.
Collapse
Affiliation(s)
- Kerstin Konrad
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- JARA Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), Jülich Research Centre, Jülich, Germany
| | - Christian Gerloff
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- JARA Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), Jülich Research Centre, Jülich, Germany
- Department of Applied Mathematics and Theoretical Physics, Cambridge Centre for Data-Driven Discovery, University of Cambridge, Cambridge, United Kingdom
| | - Simon H. Kohl
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- JARA Brain Institute II, Molecular Neuroscience and Neuroimaging (INM-11), Jülich Research Centre, Jülich, Germany
| | - David M. A. Mehler
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical School, RWTH Aachen University, Aachen, Germany
- Institute for Translational Psychiatry, University of Münster, Münster, Germany
- School of Psychology, Cardiff University Brain Research Imaging Center (CUBRIC), Cardiff University, Cardiff, United Kingdom
| | - Lena Mehlem
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
| | - Emily L. Volbert
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
| | - Maike Komorek
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
| | - Alina T. Henn
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
| | - Maren Boecker
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- Institute of Medical Psychology and Medical Sociology, University Hospital RWTH, Aachen, Germany
| | - Eileen Weiss
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- Institute of Medical Psychology and Medical Sociology, University Hospital RWTH, Aachen, Germany
| | - Vanessa Reindl
- Child Neuropsychology Section, Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, University Hospital RWTH, Aachen, Germany
- Department of Psychology, School of Social Sciences, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
4
|
Moreno-Calderón S, Martínez-Cagigal V, Santamaría-Vázquez E, Pérez-Velasco S, Marcos-Martínez D, Hornero R. Combining brain-computer interfaces and multiplayer video games: an application based on c-VEPs. Front Hum Neurosci 2023; 17:1227727. [PMID: 37600556 PMCID: PMC10435322 DOI: 10.3389/fnhum.2023.1227727] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 07/21/2023] [Indexed: 08/22/2023] Open
Abstract
Introduction and objective Video games are crucial to the entertainment industry, nonetheless they can be challenging to access for those with severe motor disabilities. Brain-computer interfaces (BCI) systems have the potential to help these individuals by allowing them to control video games using their brain signals. Furthermore, multiplayer BCI-based video games may provide valuable insights into how competitiveness or motivation affects the control of these interfaces. Despite the recent advancement in the development of code-modulated visual evoked potentials (c-VEPs) as control signals for high-performance BCIs, to the best of our knowledge, no studies have been conducted to develop a BCI-driven video game utilizing c-VEPs. However, c-VEPs could enhance user experience as an alternative method. Thus, the main goal of this work was to design, develop, and evaluate a version of the well-known 'Connect 4' video game using a c-VEP-based BCI, allowing 2 users to compete by aligning 4 same-colored coins vertically, horizontally or diagonally. Methods The proposed application consists of a multiplayer video game controlled by a real-time BCI system processing 2 electroencephalograms (EEGs) sequentially. To detect user intention, columns in which the coin can be placed was encoded with shifted versions of a pseudorandom binary code, following a traditional circular shifting c-VEP paradigm. To analyze the usability of our application, the experimental protocol comprised an evaluation session by 22 healthy users. Firstly, each user had to perform individual tasks. Afterward, users were matched and the application was used in competitive mode. This was done to assess the accuracy and speed of selection. On the other hand, qualitative data on satisfaction and usability were collected through questionnaires. Results The average accuracy achieved was 93.74% ± 1.71%, using 5.25 seconds per selection. The questionnaires showed that users felt a minimal workload. Likewise, high satisfaction values were obtained, highlighting that the application was intuitive and responds quickly and smoothly. Conclusions This c-VEP based multiplayer video game has reached suitable performance on 22 users, supported by high motivation and minimal workload. Consequently, compared to other versions of "Connect 4" that utilized different control signals, this version has exhibited superior performance.
Collapse
Affiliation(s)
- Selene Moreno-Calderón
- Biomedical Engineering Group (GIB), E.T.S Ingenieros de Telecomunicación, University of Valladolid, Valladolid, Spain
| | - Víctor Martínez-Cagigal
- Biomedical Engineering Group (GIB), E.T.S Ingenieros de Telecomunicación, University of Valladolid, Valladolid, Spain
- Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Madrid, Spain
| | - Eduardo Santamaría-Vázquez
- Biomedical Engineering Group (GIB), E.T.S Ingenieros de Telecomunicación, University of Valladolid, Valladolid, Spain
- Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Madrid, Spain
| | - Sergio Pérez-Velasco
- Biomedical Engineering Group (GIB), E.T.S Ingenieros de Telecomunicación, University of Valladolid, Valladolid, Spain
- Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Madrid, Spain
| | - Diego Marcos-Martínez
- Biomedical Engineering Group (GIB), E.T.S Ingenieros de Telecomunicación, University of Valladolid, Valladolid, Spain
- Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Madrid, Spain
| | - Roberto Hornero
- Biomedical Engineering Group (GIB), E.T.S Ingenieros de Telecomunicación, University of Valladolid, Valladolid, Spain
- Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Madrid, Spain
| |
Collapse
|
5
|
Moreno-Calderon S, Martinez-Cagigal V, Santamaria-Vazquez E, Perez-Velasco S, Marcos-Martinez D, Hornero R. Assessing the Potential of Brain-Computer Interface Multiplayer Video Games using c-VEPs: A Pilot Study. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083424 DOI: 10.1109/embc40787.2023.10340542] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Video games have become a common and widespread form of entertainment, while non-invasive brain-computer interfaces (BCI) are emerging as potential alternative communication technologies. Combining BCIs and video games can enhance the gaming experience and make it accessible to motor-disabled individuals. Recently, code-modulated visual evoked potentials (c-VEP) have been proposed as a novel control signal able to achieve high performance with short calibration times. However, there are still no video games that use c-VEPs as a control signal. The aim of this pilot study is to develop an implementation of the 'Connect 4' multiplayer video game using a c-VEP-based BCI and test it with 10 healthy users. Participants were paired to compete in matches and carried out individual tasks. The results showed that the participants were able to control the game with an average accuracy of 94.10% and a selection time of 5.25 seconds per command, outperforming previous approaches. This suggests that the proposed video game is feasible and c-VEPs can provide smooth BCI control.
Collapse
|
6
|
Sened H, Zilcha-Mano S, Shamay-Tsoory S. Inter-brain plasticity as a biological mechanism of change in psychotherapy: A review and integrative model. Front Hum Neurosci 2022; 16:955238. [PMID: 36092652 PMCID: PMC9458846 DOI: 10.3389/fnhum.2022.955238] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2022] [Accepted: 08/04/2022] [Indexed: 11/26/2022] Open
Abstract
Recent models of psychopathology and psychotherapy highlight the importance of interpersonal factors. The current review offers a biological perspective on these interpersonal processes by examining inter-brain synchrony—the coupling of brain activity between people interacting with one another. High inter-brain synchrony is associated with better relationships in therapy and in daily life, while deficits in the ability to achieve inter-brain synchrony are associated with a variety of psychological and developmental disorders. The review suggests that therapy improves patients’ ability to achieve such synchrony through inter-brain plasticity—a process by which recurring exposure to high inter-brain synchrony leads to lasting change in a person’s overall ability to synchronize. Therapeutic sessions provide repeated situations with high inter-brain synchrony. This can lead to a long-term increase in the ability to synchronize, first with the therapist, then generalized to other interpersonal relationships, ultimately leading to symptom reduction. The proposed inter-brain plasticity model offers a novel biological framework for understanding relational change in psychotherapy and its links to various forms of psychopathology and provides testable hypotheses for future research. Understanding this mechanism may help improve existing psychotherapy methods and develop new ones.
Collapse
|
7
|
Putri F, Susnoschi Luca I, Garcia Pedro JA, Ding H, Vuckovic A. Winners and losers in brain computer interface competitive gaming: Directional connectivity analysis. J Neural Eng 2022; 19. [PMID: 35882224 DOI: 10.1088/1741-2552/ac8451] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Accepted: 07/26/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE to characterize the direction within and between brain connectivity in winning and losing players in a competitive brain-computer interface game. APPROACH ten dyads (26.9 ± 4.7 years old, eight females and 12 males) participated in the study. In a competitive game based on neurofeedback, they used their relative alpha (RA) band power from the electrode location Pz, to control a virtual seesaw. The players in each pair were separated into winners (W) and losers (L) based on their scores. Intrabrain connectivity was analyzed using multivariate Granger Causality (GC) and Directed Transfer Function, while interbrain connectivity was analyzed using bivariate GC. RESULTS linear regression analysis revealed a significant relationship (p<0.05) between RA and individual scores. During the game, W players maintained a higher RA than L players, although it was not higher than their baseline RA. The analysis of intrabrain GC indicated that both groups engaged in general social interactions, but only the W group succeeded in controlling their brain activity at Pz. Group L applied an inappropriate metal strategy, characterized by strong activity in the left frontal cortex, indicative of collaborative gaming. Interbrain GC showed a larger flow of information from the L to the W group, suggesting a higher capability of the W group to monitor the activity of their opponent. SIGNIFICANCE both innate neurological indices and gaming mental strategies contribute to game outcomes. Future studies should investigate whether there is a causal relationship between these two factors.
Collapse
Affiliation(s)
- Finda Putri
- Centre for Rehabilitation Engineering, University of Glasgow, James Watt Building (South), G12 8QQ, Glasgow, Glasgow, G12 8QQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Ioana Susnoschi Luca
- Centre for Rehabilitation Engineering, University of Glasgow, James Watt Building (South), G12 8QQ, Glasgow, Glasgow, G12 8QQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Jorge Abdullah Garcia Pedro
- Centre for Rehabilitation Engineering, University of Glasgow, James Watt Building (South), G12 8QQ, Glasgow, Glasgow, G12 8QQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Hao Ding
- Centre for Rehabilitation Engineering, University of Glasgow, James Watt Building (South), G12 8QQ, Glasgow, Glasgow, G12 8QQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| | - Aleksandra Vuckovic
- School of Engineering, Biomedical Engineering, University of Glasgow, James Watt building (south), G12 8QQ, Glasgow, Glasgow, G12 8QQ, UNITED KINGDOM OF GREAT BRITAIN AND NORTHERN IRELAND
| |
Collapse
|