Hyperbrain features of team mental models within a juggling paradigm: a proof of concept

An Analytical Approach for Naturalistic Cooperative and Competitive EEG-Hyperscanning Data: A Proof-of-Concept Study

Investigating the neural mechanisms underlying both cooperative and competitive joint actions may have a wide impact in many social contexts of human daily life. An effective pipeline of analysis for hyperscanning data recorded in a naturalistic context with a cooperative and competitive motor task has been missing. We propose an analytical pipeline for this type of joint action data, which was validated on electroencephalographic (EEG) signals recorded in a proof-of-concept study on two dyads playing cooperative and competitive table tennis. Functional connectivity maps were reconstructed using the corrected imaginary part of the phase locking value (ciPLV), an algorithm suitable in case of EEG signals recorded during turn-based competitive joint actions. Hyperbrain, within-, and between-brain functional connectivity maps were calculated in three frequency bands (i.e., theta, alpha, and beta) relevant during complex motor task execution and were characterized with graph theoretical measures and a clustering approach. The results of the proof-of-concept study are in line with recent findings on the main features of the functional networks sustaining cooperation and competition, hence demonstrating that the proposed pipeline is promising tool for the analysis of joint action EEG data recorded during cooperation and competition using a turn-based motor task.

An ecological study protocol for the multimodal investigation of the neurophysiological underpinnings of dyadic joint action

A novel multimodal experimental setup and dyadic study protocol were designed to investigate the neurophysiological underpinnings of joint action through the synchronous acquisition of EEG, ECG, EMG, respiration and kinematic data from two individuals engaged in ecologic and naturalistic cooperative and competitive joint actions involving face-to-face real-time and real-space coordinated full body movements. Such studies are still missing because of difficulties encountered in recording reliable neurophysiological signals during gross body movements, in synchronizing multiple devices, and in defining suitable study protocols. The multimodal experimental setup includes the synchronous recording of EEG, ECG, EMG, respiration and kinematic signals of both individuals via two EEG amplifiers and a motion capture system that are synchronized via a single-board microcomputer and custom Python scripts. EEG is recorded using new dry sports electrode caps. The novel study protocol is designed to best exploit the multimodal data acquisitions. Table tennis is the dyadic motor task: it allows naturalistic and face-to-face interpersonal interactions, free in-time and in-space full body movement coordination, cooperative and competitive joint actions, and two task difficulty levels to mimic changing external conditions. Recording conditions-including minimum table tennis rally duration, sampling rate of kinematic data, total duration of neurophysiological recordings-were defined according to the requirements of a multilevel analytical approach including a neural level (hyperbrain functional connectivity, Graph Theoretical measures and Microstate analysis), a cognitive-behavioral level (integrated analysis of neural and kinematic data), and a social level (extending Network Physiology to neurophysiological data recorded from two interacting individuals). Four practical tests for table tennis skills were defined to select the study population, permitting to skill-match the dyad members and to form two groups of higher and lower skilled dyads to explore the influence of skill level on joint action performance. Psychometric instruments are included to assess personality traits and support interpretation of results. Studying joint action with our proposed protocol can advance the understanding of the neurophysiological mechanisms sustaining daily life joint actions and could help defining systems to predict cooperative or competitive behaviors before being overtly expressed, particularly useful in real-life contexts where social behavior is a main feature.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Interpersonal synchrony when singing in a choir

Singing in a choir has long been known to enhance well-being and protect mental health. Clearly, the experience of a uniquely harmonious social activity is very satisfying for the singers. How might this come about? One of the important factors positively associated with well-being is interpersonal action coordination allowing the choir to function as a whole. This review focuses on temporal coordination dynamics of physiological systems and/or subsystems forming part or the core of the functional substrate of choir singing. These coordination dynamics will be evaluated with respect to the concept of a superordinate system, or superorganism, based on the principles of self-organization and circular causality. We conclude that choral singing is a dynamic process requiring tight interpersonal action coordination that is characterized by coupled physiological systems and specific network topology dynamics, representing a potent biomarker for social interaction.

Exploring how healthcare teams balance the neurodynamics of autonomous and collaborative behaviors: a proof of concept

Team members co-regulate their activities and move together at the collective level of behavior while coordinating their actions toward shared goals. In parallel with team processes, team members need to resolve uncertainties arising from the changing task and environment. In this exploratory study we have measured the differential neurodynamics of seven two-person healthcare teams across time and brain regions during autonomous (taskwork) and collaborative (teamwork) segments of simulation training. The questions posed were: (1) whether these abstract and mostly integrated constructs could be separated neurodynamically; and, (2) what could be learned about taskwork and teamwork by trying to do so? The taskwork and teamwork frameworks used were Neurodynamic Information (NI), an electroencephalography (EEG) derived measure shown to be a neurodynamic proxy for the pauses and hesitations associated with individual uncertainty, and inter-brain EEG coherence (IBC) which is a required component of social interactions. No interdependency was observed between NI and IBC, and second-by-second dynamic comparisons suggested mutual exclusivity. These studies show that proxies for fundamental properties of teamwork and taskwork can be separated neurodynamically during team performances of ecologically valid tasks. The persistent expression of NI and IBC were not simultaneous suggesting that it may be difficult for team members to maintain inter-brain coherence while simultaneously reducing their individual uncertainties. Lastly, these separate dynamics occur over time frames of 15-30 s providing time for real-time detection and mitigation of individual and collaborative complications during training or live patient encounters.

Neural Synchrony and Network Dynamics in Social Interaction: A Hyper-Brain Cell Assembly Hypothesis

Mounting neurophysiological evidence suggests that interpersonal interaction relies on continual communication between cell assemblies within interacting brains and continual adjustments of these neuronal dynamic states between the brains. In this Hypothesis and Theory article, a Hyper-Brain Cell Assembly Hypothesis is suggested on the basis of a conceptual review of neural synchrony and network dynamics and their roles in emerging cell assemblies within the interacting brains. The proposed hypothesis states that such cell assemblies can emerge not only within, but also between the interacting brains. More precisely, the hyper-brain cell assembly encompasses and integrates oscillatory activity within and between brains, and represents a common hyper-brain unit, which has a certain relation to social behavior and interaction. Hyper-brain modules or communities, comprising nodes across two or several brains, are considered as one of the possible representations of the hypothesized hyper-brain cell assemblies, which can also have a multidimensional or multilayer structure. It is concluded that the neuronal dynamics during interpersonal interaction is brain-wide, i.e., it is based on common neuronal activity of several brains or, more generally, of the coupled physiological systems including brains.

Is Brain Dynamics Preserved in the EEG After Automated Artifact Removal? A Validation of the Fingerprint Method and the Automatic Removal of Cardiac Interference Approach Based on Microstate Analysis

The assessment of a method for removing artifacts from electroencephalography (EEG) datasets often disregard verifying that global brain dynamics is preserved. In this study, we verified that the recently introduced optimized fingerprint method and the automatic removal of cardiac interference (ARCI) approach not only remove physiological artifacts from EEG recordings but also preserve global brain dynamics, as assessed with a new approach based on microstate analysis. We recorded EEG activity with a high-resolution EEG system during two resting-state conditions (eyes open, 25 volunteers, and eyes closed, 26 volunteers) known to exhibit different brain dynamics. After signal decomposition by independent component analysis (ICA), the independent components (ICs) related to eyeblinks, eye movements, myogenic interference, and cardiac electromechanical activity were identified with the optimized fingerprint method and ARCI approach and statistically compared with the outcome of the expert classification of the ICs by visual inspection. Brain dynamics in two different groups of denoised EEG signals, reconstructed after having removed the artifactual ICs identified by either visual inspection or the automated methods, was assessed by calculating microstate topographies, microstate metrics (duration, occurrence, and coverage), and directional predominance (based on transition probabilities). No statistically significant differences between the expert and the automated classification of the artifactual ICs were found (p > 0.05). Cronbach’s α values assessed the high test–retest reliability of microstate parameters for EEG datasets denoised by the automated procedure. The total EEG signal variance explained by the sets of global microstate templates was about 80% for all denoised EEG datasets, with no significant differences between groups. For the differently denoised EEG datasets in the two recording conditions, we found that the global microstate templates and the sequences of global microstates were very similar (p < 0.01). Descriptive statistics and Cronbach’s α of microstate metrics highlighted no significant differences and excellent consistency between groups (p > 0.5). These results confirm the ability of the optimized fingerprint method and the ARCI approach to effectively remove physiological artifacts from EEG recordings while preserving global brain dynamics. They also suggest that microstate analysis could represent a novel approach for assessing the ability of an EEG denoising method to remove artifacts without altering brain dynamics.

Coordination Cost and Super-Efficiency in Teamwork: The Role of Communication, Psychological States, Cardiovascular Responses, and Brain Rhythms

To advance knowledge on the psychophysiological markers of "coordination cost" in team settings, we explored differences in meta-communication patterns (i.e., silence, speaking, listening, and overlap), perceived psychological states (i.e., core affect, attention, efficacy beliefs), heart rate variability (i.e., RMSSD), and brain rhythms (i.e., alpha, beta and theta absolute power) across three studies involving 48 male dyads (Mage = 21.30; SD = 2.03). Skilled participants cooperatively played three consecutive FIFA-17 (Xbox) games in a dyad against the computer, or competed against the computer in a solo condition and a dyad condition. We observed that playing in a team, in contrast to playing alone, was associated with higher alpha peak and global efficiency in the brain and, at the same time, led to an increase in focused attention as evidenced by participants' higher theta activity in the frontal lobe. Moreover, we observed that overtime participants' brain dynamics moved towards a state of "neural-efficiency", characterized by increased theta and beta activity in the frontal lobe, and high alpha activity across the whole brain. Our findings advance the literature by demonstrating that (1) the notion of coordination cost can be captured at the neural level in the initial stages of team development; (2) by decreasing the costs of switching between tasks, teamwork increases both individuals' attentional focus and global neural efficiency; and (3) communication dynamics become more proficient and individuals' brain patterns change towards neural efficiency over time, likely due to team learning and decreases in intra-team conflict.

Shared Zones of Optimal Functioning: A Framework to Capture Peak Performance, Momentum, Psycho–Bio–Social Synchrony, and Leader–Follower Dynamics in Teams

By bridging the literature on shared mental models and the individual zones of optimal functioning, the author advances a new framework called the shared zones of optimal functioning. The shared zones of optimal functioning is a probabilistic methodology designed to (a) capture optimal and suboptimal performance experiences in teams, (b) track team momentum through the analysis of within-team performance fluctuations, and (c) estimate within-team psycho–bio–social synchrony and leader–follower dynamics (i.e., leader–follower dichotomy, shared leadership). To test the shared zones of optimal functioning framework, three dyadic juggling teams were asked to juggle for 60 trials, while having their performance, arousal, pleasantness, and attentional levels recorded. Ordinal logistic regression, frequency counts, and cross-correlation analyses revealed that each team showed idiosyncratic affective and attentional levels linked to optimal performance, team momentum patterns, and leader–follower dynamics. The implications of these findings for the development of high-performing teams and specific avenues of future research are discussed throughout.

Brain-to-Brain Neural Synchrony During Social Interactions: A Systematic Review on Hyperscanning Studies

The aim of this study was to conduct a comprehensive review on hyperscanning research (measuring brain activity simultaneously from more than two people interacting) using an explicit systematic method, the preferred reporting items for systematic reviews and meta-analyses (PRISMA). Data were searched from IEEE Xplore, PubMed, Engineering Village, Web of Science and Scopus databases. Inclusion criteria were journal articles written in English from 2000 to 19 June 2019. A total of 126 empirical studies were screened out to address three specific questions regarding the neuroimaging method, the application domain, and the experiment paradigm. Results showed that the most used neuroimaging method with hyperscanning was magnetoencephalography/electroencephalography (MEG/EEG; 47%), and the least used neuroimaging method was hyper-transcranial Alternating Current Stimulation (tACS) (1%). Applications in cognition accounted for almost half the studies (48%), while educational applications accounted for less than 5% of the studies. Applications in decision-making tasks were the second most common (26%), shortly followed by applications in motor synchronization (23%). The findings from this systematic review that were based on documented, transparent and reproducible searches should help build cumulative knowledge and guide future research regarding inter-brain neural synchrony during social interactions, that is, hyperscanning research.

Dry EEG in Sports Sciences: A Fast and Reliable Tool to Assess Individual Alpha Peak Frequency Changes Induced by Physical Effort

Novel state-of-the-art amplifier and cap systems enable Electroencephalography (EEG) recording outside of stationary lab systems during physical exercise and body motion. However, extensive preparation time, cleaning, and limited long-term stability of conventional gel-based electrode systems pose significant limitations in out-of-the-lab conditions. Dry electrode systems may contribute to rapid and repetitive mobile EEG acquisition with significantly reduced preparation time, reduced cleaning requirements, and possible self-application by the volunteer but are known for higher channel failure probability and increased sensitivity to movement artifacts. We performed a counterbalanced repeated measure endurance cycling study to objectively validate the performance and applicability of a novel commercially available 64-channel dry electrode cap for sport science. A total of 17 healthy volunteers participated in the study, performing an endurance cycling paradigm comprising five phases: (I) baseline EEG, (II) pre-cycling EEG, (III) endurance cycling, (IV) active recovery, and (V) passive recovery. We compared the performance of the 64-channel dry electrode cap with a commercial gel-based cap system in terms of usability metrics, reliability, and signal characteristics. Furthermore, we validated the performance of the dry cap during a realistic sport science investigation, verifying the hypothesis of a systematic, reproducible shift of the individual alpha peak frequency (iAPF) induced by physical effort. The average preparation time of the dry cap was one-third of the gel-based electrode caps. The average channel reliability of the dry cap varied between 80 ± 15% (Phase I), 66 ± 19% (Phase III), and 91 ± 10% (Phase V). In comparison, the channel reliability of the gel-based cap varied between 95 ± 3, 85 ± 9, and 82 ± 9%, respectively. No considerable differences were evident for the comfort evaluations nor the signal characteristics of both caps. A within-volunteers repeated measure analysis of variance (RM-ANOVA) did not show significant effects of the electrode type on the iAPF [F(1,12) = 1.670, p = 0.221, ηp2 = 0.122, Power = 0.222]. However, a significant increase of the iAPF exists from Phase II to Phases IV and V due to exhaustive physical task. In conclusion, we demonstrated that dry electrode cap is equivalent to the gel-based electrode cap based on signal characteristics, comfort, and signal information content, thereby confirming the usefulness of dry electrodes in sports science and other mobile applications involving ample movement.

Hyperscanning of Interactive Juggling: Expertise Influence on Source Level Functional Connectivity

Hyperscanning studies, wherein brain activity is recorded from multiple participants simultaneously, offer an opportunity to investigate interpersonal dynamics during interactive tasks at the neurophysiological level. In this study, we employed a dyadic juggling paradigm and electroencephalography (EEG) hyperscanning to evaluate functional connectivity between EEG sources within and between jugglers’ brains during individual and interactive juggling. We applied graph theoretical measures to identify significant differences in functional connectivity between the individual and interactive juggling conditions. Connectivity was measured in multiple juggler pairs with various skill levels where dyads were either skill-level matched or skill-level unmatched. We observed that global efficiency was reduced during paired juggling for less skilled jugglers and increased for more skilled jugglers. When jugglers were skill-level matched, additional reductions were found in the mean clustering coefficient and small-world topology during interactive juggling. A significant difference in hemispheric brain lateralization was detected between skill-level matched and skill-level unmatched jugglers during interactive juggling: matched jugglers had an increased right hemisphere lateralization while unmatched jugglers had an increased left hemisphere lateralization. These results reveal multiple differences in functional brain networks during individual and interactive juggling and suggest that similarities and disparities in individual skills can impact inter-brain dynamics in the performance and learning of motor tasks.

A new ICA-based fingerprint method for the automatic removal of physiological artifacts from EEG recordings

Background

EEG may be affected by artefacts hindering the analysis of brain signals. Data-driven methods like independent component analysis (ICA) are successful approaches to remove artefacts from the EEG. However, the ICA-based methods developed so far are often affected by limitations, such as: the need for visual inspection of the separated independent components (subjectivity problem) and, in some cases, for the independent and simultaneous recording of the inspected artefacts to identify the artefactual independent components; a potentially heavy manipulation of the EEG signals; the use of linear classification methods; the use of simulated artefacts to validate the methods; no testing in dry electrode or high-density EEG datasets; applications limited to specific conditions and electrode layouts.

Methods

Our fingerprint method automatically identifies EEG ICs containing eyeblinks, eye movements, myogenic artefacts and cardiac interference by evaluating 14 temporal, spatial, spectral, and statistical features composing the IC fingerprint. Sixty-two real EEG datasets containing cued artefacts are recorded with wet and dry electrodes (128 wet and 97 dry channels). For each artefact, 10 nonlinear SVM classifiers are trained on fingerprints of expert-classified ICs. Training groups include randomly chosen wet and dry datasets decomposed in 80 ICs. The classifiers are tested on the IC-fingerprints of different datasets decomposed into 20, 50, or 80 ICs. The SVM performance is assessed in terms of accuracy, False Omission Rate (FOR), Hit Rate (HR), False Alarm Rate (FAR), and sensitivity (p). For each artefact, the quality of the artefact-free EEG reconstructed using the classification of the best SVM is assessed by visual inspection and SNR.

Results

The best SVM classifier for each artefact type achieved average accuracy of 1 (eyeblink), 0.98 (cardiac interference), and 0.97 (eye movement and myogenic artefact). Average classification sensitivity (p) was 1 (eyeblink), 0.997 (myogenic artefact), 0.98 (eye movement), and 0.48 (cardiac interference). Average artefact reduction ranged from a maximum of 82% for eyeblinks to a minimum of 33% for cardiac interference, depending on the effectiveness of the proposed method and the amplitude of the removed artefact. The performance of the SVM classifiers did not depend on the electrode type, whereas it was better for lower decomposition levels (50 and 20 ICs).

Discussion

Apart from cardiac interference, SVM performance and average artefact reduction indicate that the fingerprint method has an excellent overall performance in the automatic detection of eyeblinks, eye movements and myogenic artefacts, which is comparable to that of existing methods. Being also independent from simultaneous artefact recording, electrode number, type and layout, and decomposition level, the proposed fingerprint method can have useful applications in clinical and experimental EEG settings.