Investigating Cooperative Behavior in Ecological Settings: An EEG Hyperscanning Study

Reducing flight upset risk and startle response: A study of the wake vortex alert with licensed commercial pilots

The study aimed at investigating the impact of an innovative Wake Vortex Alert (WVA) avionics on pilots' operation and mental states, intending to improve aviation safety by mitigating the risks associated with wake vortex encounters (WVEs). Wake vortices, generated by jet aircraft, pose a significant hazard to trailing or crossing aircrafts. Despite existing separation rules, incidents involving WVEs continue to occur, especially affecting smaller aircrafts like business jets, resulting in aircraft upsets and occasional cabin injuries. To address these challenges, the study focused on developing and validating an alert system that can be presented to air traffic controllers, enabling them to warn flight crews. This empowers the flight crews to either avoid the wake vortex or secure the cabin to prevent injuries. The research employed a multidimensional approach including an analysis of human performance and human factors (HF) issues to determine the potential impact of the alert on pilots' roles, tasks, and mental states. It also utilizes Human Assurance Levels (HALs) to evaluate the necessary human factors support based on the safety criticality of the new system. Realistic flight simulations were conducted to collect data of pilots' behavioural, subjective and neurophysiological responses during WVEs. The data allowed for an objective evaluation of the WVA impact on pilots' operation, behaviour and mental states (mental workload, stress levels and arousal). In particular, the results highlighted the effectiveness of the alert system in facilitating pilots' preparation, awareness and crew resource management (CRM). The results also highlighted the importance of avionics able to enhance aviation safety and reducing risks associated with wake vortex encounters. In particular, we demonstrated how providing timely information and improving situational awareness, the WVA will minimize the occurrence of WVEs and contribute to safer aviation operations.

Hyperscanning literature after two decades of neuroscientific research: A scientometric review

Hyperscanning, a neuroimaging approach introduced in 2002 for simultaneously recording the brain activity of multiple participants, has significantly contributed to our understanding of social interactions. Nevertheless, the existing literature requires systematic organization to advance our knowledge. This study, after two decades of hyperscanning research, aims to identify the primary thematic domains and the most influential documents in the field. We conducted a scientometric analysis to examine co-citation patterns quantitatively, using a sample of 548 documents retrieved from Scopus and their 32,022 cited references. Our analysis revealed ten major thematic domains in hyperscanning research, with the most impactful document authored by Czeszumski and colleagues in 2020. Notably, while hyperscanning was initially developed for functional magnetic resonance imaging (fMRI), our findings indicate a substantial influence of research conducted using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). The introduction of fNIRS and advancements in EEG methods have enabled the implementation of more ecologically valid experiments for investigating social interactions. The study also highlights the need for more research that combines multi-brain neural stimulation with neuroimaging techniques to understand the causal role played by interpersonal neural synchrony in social interactions.

Decoding influences of indoor temperature and light on neural activity: entropy analysis of electroencephalographic signals

Understanding the neural responses to indoor characteristics like temperature and light is crucial for comprehending how the physical environment influences the human brain. Our study introduces an innovative approach using entropy analysis, specifically, approximate entropy (ApEn), applied to electroencephalographic (EEG) signals to investigate neural responses to temperature and light variations in indoor environments. By strategically placing electrodes over specific brain regions linked to temperature and light processing, we show how ApEn can be influenced by indoor factors. We also integrate heart indices from a multi-sensor bracelet to create a machine learning classifier for temperature conditions. Results showed that in anterior frontal and temporoparietal areas, neutral temperature conditions yield higher ApEn values. The anterior frontal area showed a trend of gradually decreasing ApEn values from neutral to warm conditions, with cold being in an intermediate position. There was a significant interaction between light and site factors, only evident in the temporoparietal region. Here, the neutral light condition had higher ApEn values compared to blue and red light conditions. Positive correlations between anterior frontal ApEn and thermal comfort scores suggest a link between entropy and perceived thermal comfort. Our quadratic SVM classifier, incorporating entropy and heart features, demonstrates strong performance (until 90% in terms of AUC, accuracy, sensitivity, and specificity) in classifying temperature sensations. This study offers insights into neural responses to indoor factors and presents a novel approach for temperature classification using EEG entropy and heart features.

Effects of age and flight experience on prefrontal cortex activity in airline pilots: An fNIRS study

It is essential for airlines to have a deep understanding of the cognitive impact of aging among pilots. The current literature on executive function indicates that compensatory mechanisms in the brain may counteract age-related cognitive decline, at least up to certain task load levels. However, few studies have been administered to evaluate changes in aircrew competence as they age. The present study focuses on dorsolateral prefrontal cortex (DLPFC) activity as it is implicated in cognitive performance and working memory, which are associated with skill proficiency. We measured the DLPFC activity for airline pilots, including trainees, during maneuvering using a flight simulator. Our preliminary results indicated that only expert (aged) pilots demonstrated higher activity of the left DLPFC than the right one. However, for youth trainees, not only was the error rate high while using the flight simulator, but the activity of the DLFPC was also lower than that of the expert pilots, and there was no statistically significant difference between the left and right DLPFC. Although these findings partially differ from those reported in previous studies on age-related changes, it is evident that training as an airline pilot for over 20 years may affect such results. We believe that this noninvasive approach to objective quantification of skill will facilitate the development of effective assessment competence in aging.

An Analytical Approach for Naturalistic Cooperative and Competitive EEG-Hyperscanning Data: A Proof-of-Concept Study

Investigating the neural mechanisms underlying both cooperative and competitive joint actions may have a wide impact in many social contexts of human daily life. An effective pipeline of analysis for hyperscanning data recorded in a naturalistic context with a cooperative and competitive motor task has been missing. We propose an analytical pipeline for this type of joint action data, which was validated on electroencephalographic (EEG) signals recorded in a proof-of-concept study on two dyads playing cooperative and competitive table tennis. Functional connectivity maps were reconstructed using the corrected imaginary part of the phase locking value (ciPLV), an algorithm suitable in case of EEG signals recorded during turn-based competitive joint actions. Hyperbrain, within-, and between-brain functional connectivity maps were calculated in three frequency bands (i.e., theta, alpha, and beta) relevant during complex motor task execution and were characterized with graph theoretical measures and a clustering approach. The results of the proof-of-concept study are in line with recent findings on the main features of the functional networks sustaining cooperation and competition, hence demonstrating that the proposed pipeline is promising tool for the analysis of joint action EEG data recorded during cooperation and competition using a turn-based motor task.

Using interbrain synchrony to study teamwork: A systematic review and meta-analysis

It has been proposed that interbrain synchrony (IBS) may help to elucidate the neural mechanisms underpinning teamwork. As hyperscanning studies have provided abundant findings on IBS in team environments, the current review aims to synthesize the findings of hyperscanning studies in a way that is relevant to the teamwork research. A systematic review was conducted. Included studies were classified according to the IPO (i.e. input, process, output) model of teamwork. Three multi-level meta-analyses were performed to quantify the associations between IBS and the three IPO variables. The methodology followed PRISMA guidelines and the protocol was pre-registered (https://osf.io/7h8sa/). Of the 229 studies, 41 were included, representing 1326 teams. The three meta-analyses found statistically significant positive effects, indicating a positive association between IBS and the three IPO teamwork variables. This study provides evidence that IBS is a relevant measure of the teamwork process and argues for the continued use of IBS to study teamwork.

A dual-brain therapeutic approach using noninvasive brain stimulation based on two-person neuroscience: A perspective review

Our actions and decisions in everyday life are heavily influenced by social interactions, which are dynamic feedback loops involving actions, reactions, and internal cognitive processes between individual agents. Social interactions induce interpersonal synchrony, which occurs at different biobehavioral levels and comprises behavioral, physiological, and neurological activities. Hyperscanning-a neuroimaging technique that simultaneously measures the activity of multiple brain regions-has provided a powerful second-person neuroscience tool for investigating the phase alignment of neural processes during interactive social behavior. Neural synchronization, revealed by hyperscanning, is a phenomenon called inter-brain synchrony- a process that purportedly facilitates social interactions by prompting appropriate anticipation of and responses to each other's social behaviors during ongoing shared interactions. In this review, I explored the therapeutic dual-brain approach using noninvasive brain stimulation to target inter-brain synchrony based on second-person neuroscience to modulate social interaction. Artificially inducing synchrony between the brains is a potential adjunct technique to physiotherapy, psychotherapy, and pain treatment- which are strongly influenced by the social interaction between the therapist and patient. Dual-brain approaches to personalize stimulation parameters must consider temporal, spatial, and oscillatory factors. Multiple data fusion analysis, the assessment of inter-brain plasticity, a closed-loop system, and a brain-to-brain interface can support personalized stimulation.

The topology of interpersonal neural network in weak social ties

The strategies for social interaction between strangers differ from those between acquaintances, whereas the differences in neural basis of social interaction have not been fully elucidated. In this study, we examined the geometrical properties of interpersonal neural networks in pairs of strangers and acquaintances during antiphase joint tapping. Dual electroencephalogram (EEG) of 29 channels per participant was measured from 14 strangers and 13 acquaintance pairs.Intra-brain synchronizations were calculated using the weighted phase lag index (wPLI) for intra-brain electrode combinations, and inter-brain synchronizations were calculated using the phase locking value (PLV) for inter-brain electrode combinations in the theta, alpha, and beta frequency bands. For each participant pair, electrode combinations with larger wPLI/PLV than their surrogates were defined as the edges of the neural networks. We calculated global efficiency, local efficiency, and modularity derived from graph theory for the combined intra- and inter-brain networks of each pair. In the theta band networks, stranger pairs showed larger local efficiency than acquaintance pairs, indicating that the two brains of stranger pairs were more densely connected. Hence, weak social ties require extensive social interactions and result in high efficiency of information transfer between neighbors in neural network.

It takes a village: A multi-brain approach to studying multigenerational family communication

Grandparents play a critical role in child rearing across the globe. Yet, there is a shortage of neurobiological research examining the relationship between grandparents and their grandchildren. We employ multi-brain neurocomputational models to simulate how changes in neurophysiological processes in both development and healthy aging affect multigenerational inter-brain coupling - a neural marker that has been linked to a range of socio-emotional and cognitive outcomes. The simulations suggest that grandparent-child interactions may be paired with higher inter-brain coupling than parent-child interactions, raising the possibility that the former may be more advantageous under certain conditions. Critically, this enhancement of inter-brain coupling for grandparent-child interactions is more pronounced in tri-generational interactions that also include a parent, which may speak to findings that grandparent involvement in childrearing is most beneficial if the parent is also an active household member. Together, these findings underscore that a better understanding of the neurobiological basis of cross-generational interactions is vital, and that such knowledge can be helpful in guiding interventions that consider the whole family. We advocate for a community neuroscience approach in developmental social neuroscience to capture the diversity of child-caregiver relationships in real-world settings.

Effects of Targeted Memory Reactivation on Cortical Networks

Sleep is a complex physiological process with an important role in memory consolidation characterised by a series of spatiotemporal changes in brain activity and connectivity. Here, we investigate how task-related responses differ between pre-sleep wake, sleep, and post-sleep wake. To this end, we trained participants on a serial reaction time task using both right and left hands using Targeted Memory Reactivation (TMR), in which auditory cues are associated with learned material and then re-presented in subsequent wake or sleep periods in order to elicit memory reactivation. The neural responses just after each cue showed increased theta band connectivity between frontal and other cortical regions, as well as between hemispheres, in slow wave sleep compared to pre- or post-sleep wake. This pattern was consistent across the cues associated with both right- and left-handed movements. We also searched for hand-specific connectivity and found that this could be identified in within-hemisphere connectivity after TMR cues during sleep and post-sleep sessions. The fact that we could identify which hand had been cued during sleep suggests that these connectivity measures could potentially be used to determine how successfully memory is reactivated by our manipulation. Collectively, these findings indicate that TMR modulates the brain cortical networks showing clear differences between wake and sleep connectivity patterns.

Exploring Inter-Brain Electroencephalogram Patterns for Social Cognitive Assessment During Jigsaw Puzzle Solving

Social interaction enables the smooth progression of our daily lives. Mounting evidence from recent hyperscanning neuroimaging studies indicates that key components of social behavior can be evaluated using inter-brain oscillations and connectivity. However, mapping out inter-brain networks and developing neurocognitive theories that explain how humans co-create and share information during social interaction remains challenging. In this study, we developed a jigsaw puzzle-solving game with hyperscanning electroencephalography (EEG) signals recorded to investigate inter-brain activities during social interactions involving cooperation and competition. Participants were recruited and paired into dyads to participate in the multiplayer jigsaw puzzle game with 32-channel EEG signals recorded. The corresponding event-related potentials (ERPs), brain oscillations, and inter-brain functional connectivity were analyzed. The results showed different ERP morphologies of P3 patterns in competitive and cooperative contexts, and brain oscillations in the low-frequency band may be an indicator of social cognitive activities. Furthermore, increased inter-brain functional connectivity in the delta, theta, alpha, and beta frequency bands was observed in the competition mode compared to the cooperation mode. By presenting comparable and valid hyperscanning EEG results alongside those of previous studies using traditional paradigms, this study demonstrates the potential of utilizing hyperscanning techniques in real-life game-playing scenarios to quantitatively assess social cognitive interactions involving cooperation and competition. Our approach offers a promising platform with potential applications in the flexible assessment of psychiatric disorders related to social functioning.

Inter-brain synchrony during mother-infant interactive parenting in 3-4-month-old infants with and without an elevated likelihood of autism spectrum disorder

Maternal bonding for mammalian infants is critical for their survival. Additionally, it is important for human infants' development into social creatures. However, despite the ample neurobiological evidence of attachment for the mother's brain, the interplay of this system in infants is poorly understood. We aimed to identify the neural substrates of synchrony in mothers and infants under three interactive conditions and compare the differences between groups with (n = 16) and without (n = 71) an elevated likelihood of autism spectrum disorder by examining the inter-brain synchrony between mothers and their 3-4-month-old infants. Mother-infant hyperscanning with functional near-infrared spectroscopy was performed during breastfeeding and while each of the mother and experimenter was holding the infants. The results showed almost no group differences, with both groups demonstrating the strongest inter-brain coupling for breastfeeding. The cerebral foci underlying these couplings differed between mothers and infants: the ventral prefrontal cortex, focusing on the right orbitofrontal cortex, in the mother and the left temporoparietal junction in the infant were chiefly involved in connecting the two brains. Furthermore, these synchronizations revealed many significant correlations with behavioral measures, including subsequent language development. The maternal reward-motivational system and the infant's elementary mentalization system seem to underlie mother-infant coupling during breastfeeding.

An ecological study protocol for the multimodal investigation of the neurophysiological underpinnings of dyadic joint action

A novel multimodal experimental setup and dyadic study protocol were designed to investigate the neurophysiological underpinnings of joint action through the synchronous acquisition of EEG, ECG, EMG, respiration and kinematic data from two individuals engaged in ecologic and naturalistic cooperative and competitive joint actions involving face-to-face real-time and real-space coordinated full body movements. Such studies are still missing because of difficulties encountered in recording reliable neurophysiological signals during gross body movements, in synchronizing multiple devices, and in defining suitable study protocols. The multimodal experimental setup includes the synchronous recording of EEG, ECG, EMG, respiration and kinematic signals of both individuals via two EEG amplifiers and a motion capture system that are synchronized via a single-board microcomputer and custom Python scripts. EEG is recorded using new dry sports electrode caps. The novel study protocol is designed to best exploit the multimodal data acquisitions. Table tennis is the dyadic motor task: it allows naturalistic and face-to-face interpersonal interactions, free in-time and in-space full body movement coordination, cooperative and competitive joint actions, and two task difficulty levels to mimic changing external conditions. Recording conditions-including minimum table tennis rally duration, sampling rate of kinematic data, total duration of neurophysiological recordings-were defined according to the requirements of a multilevel analytical approach including a neural level (hyperbrain functional connectivity, Graph Theoretical measures and Microstate analysis), a cognitive-behavioral level (integrated analysis of neural and kinematic data), and a social level (extending Network Physiology to neurophysiological data recorded from two interacting individuals). Four practical tests for table tennis skills were defined to select the study population, permitting to skill-match the dyad members and to form two groups of higher and lower skilled dyads to explore the influence of skill level on joint action performance. Psychometric instruments are included to assess personality traits and support interpretation of results. Studying joint action with our proposed protocol can advance the understanding of the neurophysiological mechanisms sustaining daily life joint actions and could help defining systems to predict cooperative or competitive behaviors before being overtly expressed, particularly useful in real-life contexts where social behavior is a main feature.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Age differences in interbrain synchronization during peer cooperation: an EEG hyperscanning study

Healthy peer relationships could provide emotional and social support for adolescents experiencing dramatic physical and environmental changes. Examining age differences in cognitive neural processing during peer interaction provides insight into adolescent interpersonal contact and "social brain" development. The present study compared the age differences between adolescents and adults by examining the behavior and interbrain synchronization of pairs in a cooperative computer game task. 32 pairs of adolescents and 31 pairs of adults were recruited as participants. The reaction times and interbrain synchronization of the participants were measured. The results revealed that interbrain synchronization activation following the onset of the "ready signal" was primarily detected in low-frequency bands such as delta and theta. Adolescent pairs' interbrain synchronization activations were significantly higher than those of adult pairs in the anterior and central brain regions, such as the frontal, frontal-central, and parietal lobes. Correlation analysis indicated a positive correlation between occipital region interbrain synchronization and behavioral performance. The findings provide behavioral and neurophysiological evidence for the characteristics of adolescent interpersonal cognitive processing and point to the significance of low-frequency interbrain synchronization in interpersonal coordination.

Inter-Brain Synchrony Pattern Investigation on Triadic Board Game Play-Based Social Interaction: An fNIRS Study

Recent advances in functional neuroimaging techniques, including methodologies such as fNIRS, have enabled the evaluation of inter-brain synchrony (IBS) induced by interpersonal interactions. However, the social interactions assumed in existing dyadic hyperscanning studies do not sufficiently emulate polyadic social interactions in the real world. Therefore, we devised an experimental paradigm that incorporates the Korean folk board game "Yut-nori" to reproduce social interactions that emulate social activities in the real world. We recruited 72 participants aged 25.2 ± 3.9 years (mean ± standard deviation) and divided them into 24 triads to play Yut-nori, following the standard or modified rules. The participants either competed against an opponent (standard rule) or cooperated with an opponent (modified rule) to achieve a goal efficiently. Three different fNIRS devices were employed to record cortical hemodynamic activations in the prefrontal cortex both individually and simultaneously. Wavelet transform coherence (WTC) analyses were performed to assess prefrontal IBS within a frequency range of 0.05-0.2 Hz. Consequently, we observed that cooperative interactions increased prefrontal IBS across overall frequency bands of interest. In addition, we also found that different purposes for cooperation generated different spectral characteristics of IBS depending on the frequency bands. Moreover, IBS in the frontopolar cortex (FPC) reflected the influence of verbal interactions. The findings of our study suggest that future hyperscanning studies should consider polyadic social interactions to reveal the properties of IBS in real-world interactions.

Spontaneous dyadic behaviour predicts the emergence of interpersonal neural synchrony

Synchronization of neural activity across brains - interpersonal neural synchrony (INS) - is emerging as a powerful marker of social interaction that predicts success of multi-person coordination, communication, and cooperation. As the origins of INS are poorly understood, we tested whether and how INS might emerge from spontaneous dyadic behavior. We recorded neural activity (EEG) and human behavior (full-body kinematics, eye movements and facial expressions) while dyads of participants were instructed to look at each other without speaking or making co-verbal gestures. We made four fundamental observations. First, despite the absence of a structured social task, INS emerged spontaneously only when participants were able to see each other. Second, we show that such spontaneous INS, comprising specific spectral and topographic profiles, did not merely reflect intra-personal modulations of neural activity, but it rather reflected real-time and dyad-specific coupling of neural activities. Third, using state-of-art video-image processing and deep learning, we extracted the temporal unfolding of three notable social behavioral cues - body movement, eye contact, and smiling - and demonstrated that these behaviors also spontaneously synchronized within dyads. Fourth, we probed the correlates of INS in such synchronized social behaviors. Using cross-correlation and Granger causality analyses, we show that synchronized social behaviors anticipate and in fact Granger cause INS. These results provide proof-of-concept evidence for studying interpersonal neural and behavioral synchrony under natural and unconstrained conditions. Most importantly, the results suggest that INS could be conceptualized as an emergent property of two coupled neural systems: an entrainment phenomenon, promoted by real-time dyadic behavior.

Research on brain functions related to visual information processing and body coordination function of pilots based on the low-frequency amplitude method

Objective

Research on the differences in physiological and psychological mechanisms of practitioners in different occupations is a current hot spot, such as pilots. This study explores the frequency-dependent changes of pilots’ low-frequency amplitudes in the classical frequency band and sub-frequency band between pilots and general occupations. The goal of the current work is to provide objective brain images for the selection and evaluation of outstanding pilots.

Methods

Twenty-six pilots and 23 age-, sex-, and education-matched healthy controls were included in this study. Then the mean low-frequency amplitude (mALFF) of the classical frequency band and sub-frequency band was calculated. The two-sample t-test was performed on SPM12 to analyze the differences between the flight group and control group in the classic frequency band. To explore the main effects and the inter-band effects of the mean low-frequency amplitude (mALFF), the mixed design analysis of variance was applied in the sub-frequency bands.

Results

Compared with the control group, left cuneiform lobe and the right cerebellum six area of pilots show significant difference in the classic frequency band. And the main effect results in the sub-frequency bands show that the area with higher mALFF in the flight group is located on the left middle occipital gyrus, the left cuneiform lobe, the right superior occipital gyrus, the right superior gyrus, and the left lateral central lobule. However, the area where the value of mALFF decreased is mainly located on the left rectangular cleft with surrounding cortex and the right dorsolateral superior frontal gyrus. Besides, compared with the slow-4 frequency band, the mALFF of the left middle orbital middle frontal gyrus of the slow-5 frequency band was increased, while the mALFF value of the left putamen, left fusiform gyrus, and right thalamus was decreased. The sensitivity of the slow-5 frequency band and the slow-4 frequency band to the pilots’ different brain areas was also different. Also, the different brain areas in the classic frequency band and the sub-frequency band were significantly correlated with pilots’ flight hours.

Conclusion

Our findings showed that the left cuneiform brain area and the right cerebellum of pilots changed significantly during resting state. And there was a positive correlation between the mALFF value of those brain area and flight hours. The comparative analysis of sub-frequency bands found that the slow-5 band could elucidate a wider range of different brain regions, providing new ideas for exploring the brain mechanisms of pilots.

Speaking and listening to inter-brain relationships

Studies of inter-brain relationships thrive, and yet many reservations regarding their scope and interpretation of these phenomena have been raised by the scientific community. It is thus essential to establish common ground on methodological and conceptual definitions related to this topic and to open debate about any remaining points of uncertainty. We here offer insights to improve the conceptual clarity and empirical standards offered by social neuroscience studies of inter-personal interaction using hyperscanning with a particular focus on verbal communication.

Functional near-infrared spectroscopy is a useful tool for multi-perspective psychobiological study of neurophysiological correlates of parenting behaviour

The quality of the relationship between caregiver and child has long-term effects on the cognitive and socio-emotional development of children. A process involved in human parenting is the bio-behavioural synchrony that occurs between the partners in the relationship during interaction. Through interaction, bio-behavioural synchronicity allows the adaptation of the physiological systems of the parent to those of the child and promotes the positive development and modelling of the child's social brain. The role of bio-behavioural synchrony in building social bonds could be investigated using functional near-infrared spectroscopy (fNIRS). In this paper we have (a) highlighted the importance of the quality of the caregiver-child relationship for the child's cognitive and socio-emotional development, as well as the relevance of infantile stimuli in the activation of parenting behaviour; (b) discussed the tools used in the study of the neurophysiological substrates of the parental response; (c) proposed fNIRS as a particularly suitable tool for the study of parental responses; and (d) underlined the need for a multi-systemic psychobiological approach to understand the mechanisms that regulate caregiver-child interactions and their bio-behavioural synchrony. We propose to adopt a multi-system psychobiological approach to the study of parental behaviour and social interaction.

Envisioning translational hyperscanning: how applied neuroscience might improve family-centered care

From the very beginning of their life, human beings are immersed in a social and interactive environment that contributes to shaping their social and cognitive development under typical and at-risk conditions. In order to understand human development in its bidirectional relationship with the social environment, we need to develop a 'complexity-sensitive' approach in neuroscience. Recent advances have started to do so with the application of hyperscanning techniques which involve recording adult and child neural activity simultaneously and highlighting the presence of similar patterns of brain activity in the dyad. Numerous studies focused on typically developing children have been published in recent years with the application of this technique to different fields of developmental research. However, hyperscanning techniques could also be extremely beneficial and effective in studying development in atypical and clinical populations. Such application, namely translational hyperscanning, should foster the transition toward a two-brain translational neuroscience. In this paper, we envision how the application of hyperscanning to atypical and clinical child populations can inform family-centered care for children and their parents.

Aviation and neurophysiology: A systematic review

This paper systematically reviews 20 years of publications (N = 54) on aviation and neurophysiology. The main goal is to provide an account of neurophysiological changes associated with flight training with the aim of identifying neurometrics indicative of pilot's flight training level and task relevant mental states, as well as to capture the current state-of-art of (neuro)ergonomic design and practice in flight training. We identified multiple candidate neurometrics of training progress and workload, such as frontal theta power, the EEG Engagement Index and the Cognitive Stability Index. Furthermore, we discovered that several types of classifiers could be used to accurately detect mental states, such as the detection of drowsiness and mental fatigue. The paper advances practical guidelines on terminology usage, simulator fidelity, and multimodality, as well as future research ideas including the potential of Virtual Reality flight simulations for training, and a brain-computer interface for flight training.

Transcranial Electrical Stimulation Offers the Possibility of Improving Teamwork Among Military Pilots: A Review

Effective teamwork among military pilots is key to successful mission completion. The underlying neural mechanism of teamwork is thought to be inter-brain synchronization (IBS). IBS could also be explained as an incidental phenomenon of cooperative behavior, but the causality between IBS and cooperative behavior could be clarified by directly producing IBS through extra external stimuli applied to functional brain regions. As a non-invasive technology for altering brain function, transcranial electrical stimulation might have the potential to explore whether top-down enhancement of the synchronization of multiple brains can change cooperative behavioral performance among members of a team. This review focuses on the characteristic features of teamwork among military pilots and variations in neuroimaging obtained by hyper-scanning. Furthermore, we discuss the possibility that transcranial electrical stimulation could be used to improve teamwork among military pilots, try to provide a feasible design for doing so, and emphasize crucial aspects to be addressed by future research.

Inter-brain synchronization occurs without physical co-presence during cooperative online gaming

Inter-brain synchronization during social interaction has been linked with several positive phenomena, including closeness, cooperation, prosociality, and team performance. However, the temporal dynamics of inter-brain synchronization during collaboration are not yet fully understood. Furthermore, with collaboration increasingly happening online, the dependence of inter-brain phase synchronization of oscillatory activity on physical presence is an important but understudied question. In this study, physically isolated participants performed a collaborative coordination task in the form of a cooperative multiplayer game. We measured EEG from 42 subjects working together as pairs in the task. During the measurement, the only interaction between the participants happened through on-screen movement of a racing car, controlled by button presses of both participants working with distinct roles, either controlling the speed or the direction of the car. Pairs working together in the task were found to have elevated neural coupling in the alpha, beta, and gamma frequency bands, compared to performance matched false pairs. Higher gamma synchrony was associated with better momentary performance within dyads and higher alpha synchrony was associated with better mean performance across dyads. These results are in line with previous findings of increased inter-brain synchrony during interaction, and show that phase synchronization of oscillatory activity occurs during online real-time joint coordination without any physical co-presence or video and audio connection. Synchrony decreased during a playing session, but was found to be higher during the second session compared to the first. The novel paradigm, developed for the measurement of real-time collaborative performance, demonstrates that changes in inter-brain EEG phase synchrony can be observed continuously during interaction.

Reproducible Inter-Personal Brain Coupling Measurements in Hyperscanning Settings With functional Near Infra-Red Spectroscopy

Despite a huge advancement in neuroimaging techniques and growing importance of inter-personal brain research, few studies assess the most appropriate computational methods to measure brain-brain coupling. Here, we focus on the signal processing methods to detect brain-coupling in dyads. From a public dataset of functional Near Infra-Red Spectroscopy signals (N=24 dyads), we derived a synthetic control condition by randomization, we investigated the effectiveness of four most used signal similarity metrics: Cross Correlation, Mutual Information, Wavelet Coherence and Dynamic Time Warping. We also accounted for temporal variations between signals by allowing for misalignments up to a maximum lag. Starting from the observed effect sizes, computed in terms of Cohen's d, the power analysis indicated that a high sample size ([Formula: see text]) would be required to detect significant brain-coupling. We therefore discuss the need for specialized statistical approaches and propose bootstrap as an alternative method to avoid over-penalizing the results. In our settings, and based on bootstrap analyses, Cross Correlation and Dynamic Time Warping outperform Mutual Information and Wavelet Coherence for all considered maximum lags, with reproducible results. These results highlight the need to set specific guidelines as the high degree of customization of the signal processing procedures prevents the comparability between studies, their reproducibility and, ultimately, undermines the possibility of extracting new knowledge.

Real-time Pilot Crew's Mental Workload and Arousal Assessment During Simulated Flights for Training Evaluation: a Case Study

Training assessment is usually done by evaluating information derived from instructor's supervision related to the pilot's operational performance and behavior. However, this approach lacks objective measures, especially regarding the pilots' mental states while accomplishing the flight training tasks. The study therefore aimed at developing and testing a method for gathering and analyzing in real-time pilots' brain activity and skin conductance to improve the training evaluation. In this regard, Novice pilots' neurophysiological signals were acquired throughout multi-crew training sessions. The results demonstrated how the methodology proposed was able to endow real-time pilots' mental workload and arousal assessment for i) better evaluating training progress and operational behavior during the training session, and ii) for objectively comparing different training sessions.

“We Will Let You Know”: An Assessment of Digital vs. Face-to-Face Job Interviews via EEG Connectivity Analysis

We focused on job interviews as critical examples of complex social interaction in organizational contexts. We aimed at investigating the effect of face-to-face vs. computer-mediated interaction, of role (candidate, recruiter), and of the interview phase (introductory, attitudinal, technical, conclusive) on intra-brain and inter-brain connectivity measures and autonomic synchronization. Twenty expert recruiters and potential candidates took part in a hyperscanning investigation. Namely, electroencephalography (delta, theta, alpha, beta bands) and autonomic (skin-conductance, heart-rate) data were collected in candidate-recruiter dyads during a simulated job interview and then concurrently analyzed. Analyses highlighted a link between face-to-face condition and greater intra-/inter-brain connectivity indices in delta and theta bands. Furthermore, intra-brain and inter-brain connectivity measures were higher for delta and theta bands in the final interview phases compared to the first ones. Consistently, autonomic synchronization was higher during the final interview phases, specifically in the face-to-face condition. Finally, recruiters showed higher intra-brain connectivity in the delta range over frontal and temporoparietal areas, while candidates showed higher intra-brain connectivity in the theta range over frontal areas. Findings highlight the value of hyperscanning investigations in exploring social attunement in professional contexts and hint at their potential to foster neuroscience-informed practices in human resource management processes.

Interbrain synchrony: on wavy ground

In recent years the study of dynamic, between-brain coupling mechanisms has taken social neuroscience by storm. In particular, interbrain synchrony (IBS) is a putative neural mechanism said to promote social interactions by enabling the functional integration of multiple brains. In this article, I argue that this research is beset with three pervasive and interrelated problems. First, the field lacks a widely accepted definition of IBS. Second, IBS wants for theories that can guide the design and interpretation of experiments. Third, a potpourri of tasks and empirical methods permits undue flexibility when testing the hypothesis. These factors synergistically undermine IBS as a theoretical construct. I finish by recommending measures that can address these issues.

Neural Synchrony and Network Dynamics in Social Interaction: A Hyper-Brain Cell Assembly Hypothesis

Mounting neurophysiological evidence suggests that interpersonal interaction relies on continual communication between cell assemblies within interacting brains and continual adjustments of these neuronal dynamic states between the brains. In this Hypothesis and Theory article, a Hyper-Brain Cell Assembly Hypothesis is suggested on the basis of a conceptual review of neural synchrony and network dynamics and their roles in emerging cell assemblies within the interacting brains. The proposed hypothesis states that such cell assemblies can emerge not only within, but also between the interacting brains. More precisely, the hyper-brain cell assembly encompasses and integrates oscillatory activity within and between brains, and represents a common hyper-brain unit, which has a certain relation to social behavior and interaction. Hyper-brain modules or communities, comprising nodes across two or several brains, are considered as one of the possible representations of the hypothesized hyper-brain cell assemblies, which can also have a multidimensional or multilayer structure. It is concluded that the neuronal dynamics during interpersonal interaction is brain-wide, i.e., it is based on common neuronal activity of several brains or, more generally, of the coupled physiological systems including brains.

It Takes Two: Interpersonal Neural Synchrony Is Increased after Musical Interaction

Music’s deeply interpersonal nature suggests that music-derived neuroplasticity relates to interpersonal temporal dynamics, or synchrony. Interpersonal neural synchrony (INS) has been found to correlate with increased behavioral synchrony during social interactions and may represent mechanisms that support them. As social interactions often do not have clearly delineated boundaries, and many start and stop intermittently, we hypothesize that a neural signature of INS may be detectable following an interaction. The present study aimed to investigate this hypothesis using a pre-post paradigm, measuring interbrain phase coherence before and after a cooperative dyadic musical interaction. Ten dyads underwent synchronous electroencephalographic (EEG) recording during silent, non-interactive periods before and after a musical interaction in the form of a cooperative tapping game. Significant post-interaction increases in delta band INS were found in the post-condition and were positively correlated with the duration of the preceding interaction. These findings suggest a mechanism by which social interaction may be efficiently continued after interruption and hold the potential for measuring neuroplastic adaption in longitudinal studies. These findings also support the idea that INS during social interaction represents active mechanisms for maintaining synchrony rather than mere parallel processing of stimuli and motor activity.

Inter-Brain Synchrony Levels According to Task Execution Modes and Difficulty Levels: an fNIRS/GSR Study

Hyperscanning is a brain imaging technique that measures brain synchrony caused by social interactions. Recent research on hyperscanning has revealed substantial inter-brain synchrony (IBS), but little is known about the link between IBS and mental workload. To study this link, we conducted an experiment consisting of button-pressing tasks of three different difficulty levels for the cooperation and competition modes with 56 participants aged 23.7±3.8 years (mean±standard deviation). We attempted to observe IBS using functional near-infrared spectroscopy (fNIRS) and galvanic skin response (GSR) to assess the activities of the human autonomic nervous system. We found that the IBS levels increased in a frequency band of 0.075-0.15 Hz, which was unrelated to the task repetition frequency in the cooperation mode according to the task difficulty level. Significant relative inter-brain synchrony (RIBS) increases were observed in three and 10 channels out of 15 for the hard tasks compared to the normal and easy tasks, respectively. We observed that the average GSR values increased with increasing task difficulty levels for the competition mode only. Thus, our results suggest that the IBS revealed by fNIRS and GSR is not related to the hemodynamic changes induced by mental workload, simple behavioral synchrony such as button-pressing timing, or autonomic nervous system activity. IBS is thus explicitly caused by social interactions such as cooperation.

A Two-Person Neuroscience Approach for Social Anxiety: A Paradigm With Interbrain Synchrony and Neurofeedback

Social anxiety disorder has been widely recognised as one of the most commonly diagnosed mental disorders. Individuals with social anxiety disorder experience difficulties during social interactions that are essential in the regular functioning of daily routines; perpetually motivating research into the aetiology, maintenance and treatment methods. Traditionally, social and clinical neuroscience studies incorporated protocols testing one participant at a time. However, it has been recently suggested that such protocols are unable to directly assess social interaction performance, which can be revealed by testing multiple individuals simultaneously. The principle of two-person neuroscience highlights the interpersonal aspect of social interactions that observes behaviour and brain activity from both (or all) constituents of the interaction, rather than analysing on an individual level or an individual observation of a social situation. Therefore, two-person neuroscience could be a promising direction for assessment and intervention of the social anxiety disorder. In this paper, we propose a novel paradigm which integrates two-person neuroscience in a neurofeedback protocol. Neurofeedback and interbrain synchrony, a branch of two-person neuroscience, are discussed in their own capacities for their relationship with social anxiety disorder and relevance to the paradigm. The newly proposed paradigm sets out to assess the social interaction performance using interbrain synchrony between interacting individuals, and to employ a multi-user neurofeedback protocol for intervention of the social anxiety.

Interbrain emotional connection during music performances is driven by physical proximity and individual traits

How musical emotions and the pleasure derived from music, regardless of the musical valence, can be shared between individuals is a fascinating question, and investigating it can shed light on the function of musical reward. We carried out our investigations in a natural setting during an international competition for orchestra conductors. Participants (n = 15) used a dedicated smartphone app to report their subjective emotional experiences in real time while we recorded their cerebral activity using electroencephalography and their electrodermal activity. The overall behavioral real-time behavioral ratings suggest a possible social influence on the reported and felt pleasure. The physically closer the participants, the more similar their reported pleasure. By calculating the interindividual cerebral coherence (n = 21 pairs), we showed that when people simultaneously reported either high or low pleasure, their cerebral activities were closer than for simultaneous neutral pleasure reports. Participants' skin conductance levels were also more coupled when reporting higher emotional degrees simultaneously. More importantly, the participants who were physically closer had higher cerebral coherence, but only when they simultaneously reported a high level of pleasure. We propose that emotional contagion and/or emotional resonance mechanisms could explain why a form of "emotional connecting force" arises between people during shared appraisal situations.

Is there collaboration specific neurophysiological activation during collaborative task activity? An analysis of brain responses using electroencephalography and hyperscanning

Collaboration between two individuals is thought to be associated with the synchrony of two different brain activities. Indeed, prefrontal cortical activation and alpha frequency band modulation has been widely reported, but little is known about interbrain synchrony (IBS) changes occurring during social interaction such as collaboration or competition. In this study, we assess the dynamic of IBS variation in order to provide novel insights into the frequency band modulation underlying collaboration. To address this question, we used electroencephalography (EEG) to simultaneously record the brain activity of two individuals playing a computer-based game facing four different conditions: collaboration, competition, single participation, and passive observation. The computer-based game consisted of a fast button response task. Using data recorded in sensor space, we calculated an IBS value for each frequency band using both wavelet coherence transform and phase-locking value and performed single-subject analysis to compare each condition. We found significant IBS in frontal electrodes only present during collaboration associated with alpha frequency band modulation. In addition, we observed significant IBS in the theta frequency band for both collaboration and competition conditions, along with a significant single-subject cortical activity. Competition is distinguishable through single-subject activity in several regions and frequency bands of the brain. Performance is correlated with single-subject frontal activation during collaboration in the alpha and beta frequency band.

Brain Synchrony in Competition and Collaboration During Multiuser Neurofeedback-Based Gaming

EEG hyperscanning during multiuser gaming offers opportunities to study brain characteristics of social interaction under various paradigms. In this study, we aimed to characterize neural signatures and phase-based functional connectivity patterns of gaming strategies during collaborative and competitive alpha neurofeedback games. Twenty pairs of participants with no close relationship took part in three sessions of collaborative or competitive multiuser neurofeedback (NF), with identical graphical user interface, using Relative Alpha (RA) power as a control signal. Collaborating dyads had to keep their RA within 5% of each other for the team to be awarded a point, while members of competitive dyads scored points if their RA was 10% above their opponent's. Interbrain synchrony existed only during gaming but not during baseline in either collaborative or competitive gaming. Spectral analysis and interbrain connectivity showed that in collaborative gaming, players with higher resting state alpha content were more active in regulating their RA to match those of their partner. Moreover, interconnectivity was the strongest between homologous brain structures of the dyad in theta and alpha bands, indicating a similar degree of planning and social exchange. Competitive gaming emphasized the difference between participants who were able to relax and, in this way, maintain RA, and those who had an unsuccessful approach. Analysis of interbrain connections shows engagement of frontal areas in losers, but not in winners, indicating the formers' attempt to mentalise and apply strategies that might be suitable for conventional gaming, but inappropriate for the alpha neurofeedback-based game. We show that in gaming based on multiplayer non-verbalized NF, the winning strategy is dependent on the rules of the game and on the behavior of the opponent. Mental strategies that characterize successful gaming in the physical world might not be adequate for NF-based gaming.

Socializing Sensorimotor Contingencies

The aim of this review is to highlight the idea of grounding social cognition in sensorimotor interactions shared across agents. We discuss an action-oriented account that emerges from a broader interpretation of the concept of sensorimotor contingencies. We suggest that dynamic informational and sensorimotor coupling across agents can mediate the deployment of action-effect contingencies in social contexts. We propose this concept of socializing sensorimotor contingencies (socSMCs) as a shared framework of analysis for processes within and across brains and bodies, and their physical and social environments. In doing so, we integrate insights from different fields, including neuroscience, psychology, and research on human-robot interaction. We review studies on dynamic embodied interaction and highlight empirical findings that suggest an important role of sensorimotor and informational entrainment in social contexts. Furthermore, we discuss links to closely related concepts, such as enactivism, models of coordination dynamics and others, and clarify differences to approaches that focus on mentalizing and high-level cognitive representations. Moreover, we consider conceptual implications of rethinking cognition as social sensorimotor coupling. The insight that social cognitive phenomena like joint attention, mutual trust or empathy rely heavily on the informational and sensorimotor coupling between agents may provide novel remedies for people with disturbed social cognition and for situations of disturbed social interaction. Furthermore, our proposal has potential applications in the field of human-robot interaction where socSMCs principles might lead to more natural and intuitive interfaces for human users.

Exploring Neurocognitive Performance Differences in Military Aviation Personnel

INTRODUCTION: Military aeromedical evaluations are common, but specialized neuropsychological norms for aviation personnel are sparse, resulting in a need to rely on norms from the general population. Little has been published regarding aviation subpopulations and how their neuropsychological profiles may differ from general population normative data. This study investigated neuropsychological test results of aeromedical service members to evaluate consistency with general population norms, and to delineate differences between aviation subpopulations.METHODS: Analyses were conducted on demographic variables and test scores of military aviators (N 26) and nonaviator crewmembers (N 36) referred for evaluation due to a clinical problem requiring a waiver for flight status. Performance differences between subsamples were investigated with general linear modeling. Base rates for low scores were described.RESULTS: Mean test scores in both subsamples were 0 to 1 standard deviation (SD) above the general populations means, with the largest discrepancies being found on measures of visuospatial ability (crewmembers) and verbal learning (aviators). Modeling revealed a significant difference between aviators and crewmembers on Trail Making Test Part B, after accounting for education. Aviators produced fewer low scores than crewmembers, even when using education adjusted normative data.DISCUSSION: Results suggest the cognitive profile of aviators is uniquely strong in specific domains, with fewer low scores. The development of aviator-specific norms may enhance sensitivity to cognitive decrements in this population. Future studies might separately assess crewmember roles to further assess cognitive performance standards across specialties.Maltez-Laurienti A, Minniear A, Moore R, McGovern T, Newman P, Brearly T. Exploring neurocognitive performance differences in military aviation personnel. Aerosp Med Hum Perform. 2021; 92(9):702709.

Beyond physical entrainment: competitive and cooperative mental stances during identical joint-action tasks differently affect inter-subjective neural synchrony and judgments of agency

Little work has examined how mental stance alone, apart from physical entrainment, affects between-participant neural synchrony during joint social interaction. We report the first findings on how cooperative and competitive mental stances, even during identical visuomotor joint-action tasks, result in distinct neural oscillatory signatures in low beta and theta band between-participant phase synchrony. Two participants jointly controlled a cursor and were instructed to either compete or cooperate to move it to one of three targets. The visuomotor output was identical for both the compete and cooperate conditions because participants were privately given the same target for experimental trials. Cooperation enhanced theta band between-participant phase-locking value (PLV) midtrial at 1-2 seconds, reflecting activation of systems for social coordination to move the cursor in a shared direction. Competition enhanced low beta between-participant PLV, shifting from temporal to frontal regions, indicating that participants focused only on their target and later evaluated self-agency as winner or loser. This interpretation of the neural signature was corroborated by participants' greater post-trial ratings of the degree of control over the cursor during competition. Top-down cooperative and competitive mental stances shape perceptions of social context and affect interpersonal neural synchrony important for representation of self and others' actions.

Inter-brain amplitude correlation differentiates cooperation from competition in a motion-sensing sports game

Cooperation and competition are two basic modes of human interaction. Their underlying neural mechanisms, especially from an interpersonal perspective, have not been fully explored. Using the electroencephalograph-based hyperscanning technique, the present study investigated the neural correlates of both cooperation and competition within the same ecological paradigm using a classic motion-sensing tennis game. Both the inter-brain coupling (the inter-brain amplitude correlation and inter-brain phase-locking) and the intra-brain spectral power were analyzed. Only the inter-brain amplitude correlation showed a significant difference between cooperation and competition, with different spatial patterns at theta, alpha and beta frequency bands. Further inspection revealed distinct inter-brain coupling patterns for cooperation and competition; cooperation elicited positive inter-brain amplitude correlation at the delta and theta bands in extensive brain regions, while competition was associated with negative occipital inter-brain amplitude correlation at the alpha and beta bands. These findings add to our knowledge of the neural mechanisms of cooperation and competition and suggest the significance of adopting an inter-brain perspective in exploring the neural underpinnings of social interaction in ecological contexts.

Wireless multilateral devices for optogenetic studies of individual and social behaviors

Advanced technologies for controlled delivery of light to targeted locations in biological tissues are essential to neuroscience research that applies optogenetics in animal models. Fully implantable, miniaturized devices with wireless control and power-harvesting strategies offer an appealing set of attributes in this context, particularly for studies that are incompatible with conventional fiber-optic approaches or battery-powered head stages. Limited programmable control and narrow options in illumination profiles constrain the use of existing devices. The results reported here overcome these drawbacks via two platforms, both with real-time user programmability over multiple independent light sources, in head-mounted and back-mounted designs. Engineering studies of the optoelectronic and thermal properties of these systems define their capabilities and key design considerations. Neuroscience applications demonstrate that induction of interbrain neuronal synchrony in the medial prefrontal cortex shapes social interaction within groups of mice, highlighting the power of real-time subject-specific programmability of the wireless optogenetic platforms introduced here.

Elevated Inter-Brain Coherence Between Subjects With Concordant Stances During Discussion of Social Issues

Social media platforms offer convenient, instantaneous social sharing on a mass scale with tremendous impact on public perceptions, opinions, and behavior. There is a need to understand why information spreads including the human motivations, cognitive processes, and neural dynamics of large-scale sharing. This study introduces a novel approach for investigating the effect social media messaging and in-person discussion has on the inter-brain dynamics within small groups of participants. The psychophysiological impact of information campaigns and narrative messaging within a closed social media environment was assessed using 24-channel wireless EEG. Data were acquired from three- or four-person groups while subjects debated contemporary social issues framed by four scenarios of varying controversy: (a) investing in ethical vs. unethical corporations, (b) selecting travel destination based on social awareness, (c) determining verdict in a murder trial and the punishment of life in prison or death penalty, and (d) decision to vaccinate. Pre-/post-scenario questionnaires assess the effects of the social media information. Inter-brain coherence between subject pairs on each social issue discussed by subjects was analyzed by concordance, agreement vs. disagreement, and by group unanimity, unanimous vs. not unanimous. Subject pairs that agreed on the social issues raised in the scenarios had significantly greater inter-brain coherence in gamma frequency range than disagreeing pairs over cortical regions known to be involved in social interactions. These effects were magnified when comparing groups where subject pairs were unanimous in their stance on the social issues for some but not all scenarios. While there was considerable overlap between scenarios in what EEG channels were significant, there was enough variability to indicate the possibility of scenario-specific effects on inter-brain coherence.

Towards a multi-brain framework for hypnosis: a review of quantitative methods

Most real-world applications of hypnosis involve a pair of actors: a hypnotist and a subject. Accordingly, most current models of hypnosis acknowledge the relevance of social factors in the development of the hypnotic response. Yet, psychophysiological research on hypnosis has been mostly restricted to techniques that are studying one individual, neglecting the complexity of hypnosis as a social phenomenon. In this paper, we review evidence suggesting that a multi-brain approach to studying the psychophysiology of hypnosis could lead to a breakthrough in our understanding of the neural correlates of hypnosis. In particular, we aim to highlight how this approach which relies on the information conveyed by complex verbal stimuli can be utilized to deal with the multifaceted nature of hypnosis. Furthermore, we present analytical approaches to assessing brain-to-brain coupling developed in the field of social cognitive neuroscience in the past decade, to aid the design of similar multi-brain studies in hypnosis research.

Forefront Users' Experience Evaluation by Employing Together Virtual Reality and Electroencephalography: A Case Study on Cognitive Effects of Scents

Scents have the ability to affect peoples' mental states and task performance with to different extents. It has been widely demonstrated that the lemon scent, included in most all-purpose cleaners, elicits stimulation and activation, while the lavender scent elicits relaxation and sedative effects. The present study aimed at investigating and fostering a novel approach to evaluate users' experience with respect to scents' effects through the joint employment of Virtual Reality and users' neurophysiological monitoring, in particular Electroencephalography. In particular, this study, involving 42 participants, aimed to compare the effects of lemon and lavender scents on the deployment of cognitive resources during a daily life experience consisting in a train journey carried out in virtual reality. Our findings showed a significant higher request of cognitive resources during the processing of an informative message for subjects exposed to the lavender scent with respect to the lemon exposure. No differences were found between lemon and lavender conditions on the self-reported items of pleasantness and involvement; as this study demonstrated, the employment of the lavender scent preserves the quality of the customer experience to the same extent as the more widely used lemon scent.

Team Physiological Dynamics: A Critical Review

OBJECTIVE

Review the use of physiological measurement in team settings and propose recommendations to improve the state of the science.

BACKGROUND

New sensor and analytical capabilities enable exploration of relationships between team members' physiological dynamics. We conducted a review of physiological measures used in research on teams to understand (1) how these measures are theoretically and operationally related to team constructs and (2) what types of validity evidence exist for physiological measurement in team settings.

METHOD

We identified 32 articles that investigated task-performing teams using physiological data. Articles were coded on several dimensions, including team characteristics. Study findings were categorized by relationships tested between team physiological dynamics (TPD) and team inputs, mediators/processes, outputs, or psychometric properties.

RESULTS

TPD researchers overwhelmingly measure single physiological systems. Although there is research linking TPD to inputs and outputs, the research on processes is underdeveloped.

CONCLUSION

We recommend several theoretical, methodological, and statistical themes to expand the growth of the TPD field.

APPLICATION

Physiological measures, once established as reliable indicators of team functioning, might be used to diagnose suboptimal team states and cue interventions to ameliorate these states.

HyPyP: a Hyperscanning Python Pipeline for inter-brain connectivity analysis

The bulk of social neuroscience takes a 'stimulus-brain' approach, typically comparing brain responses to different types of social stimuli, but most of the time in the absence of direct social interaction. Over the last two decades, a growing number of researchers have adopted a 'brain-to-brain' approach, exploring similarities between brain patterns across participants as a novel way to gain insight into the social brain. This methodological shift has facilitated the introduction of naturalistic social stimuli into the study design (e.g. movies) and, crucially, has spurred the development of new tools to directly study social interaction, both in controlled experimental settings and in more ecologically valid environments. Specifically, 'hyperscanning' setups, which allow the simultaneous recording of brain activity from two or more individuals during social tasks, has gained popularity in recent years. However, currently, there is no agreed-upon approach to carry out such 'inter-brain connectivity analysis', resulting in a scattered landscape of analysis techniques. To accommodate a growing demand to standardize analysis approaches in this fast-growing research field, we have developed Hyperscanning Python Pipeline, a comprehensive and easy open-source software package that allows (social) neuroscientists to carry-out and to interpret inter-brain connectivity analyses.

Perceived Mental Workload Classification Using Intermediate Fusion Multimodal Deep Learning

A lot of research has been done on the detection of mental workload (MWL) using various bio-signals. Recently, deep learning has allowed for novel methods and results. A plethora of measurement modalities have proven to be valuable in this task, yet studies currently often only use a single modality to classify MWL. The goal of this research was to classify perceived mental workload (PMWL) using a deep neural network (DNN) that flexibly makes use of multiple modalities, in order to allow for feature sharing between modalities. To achieve this goal, an experiment was conducted in which MWL was simulated with the help of verbal logic puzzles. The puzzles came in five levels of difficulty and were presented in a random order. Participants had 1 h to solve as many puzzles as they could. Between puzzles, they gave a difficulty rating between 1 and 7, seven being the highest difficulty. Galvanic skin response, photoplethysmograms, functional near-infrared spectrograms and eye movements were collected simultaneously using LabStreamingLayer (LSL). Marker information from the puzzles was also streamed on LSL. We designed and evaluated a novel intermediate fusion multimodal DNN for the classification of PMWL using the aforementioned four modalities. Two main criteria that guided the design and implementation of our DNN are modularity and generalisability. We were able to classify PMWL within-level accurate (0.985 levels) on a seven-level workload scale using the aforementioned modalities. The model architecture allows for easy addition and removal of modalities without major structural implications because of the modular nature of the design. Furthermore, we showed that our neural network performed better when using multiple modalities, as opposed to a single modality. The dataset and code used in this paper are openly available.

Adaptive Human-Robot Interactions for Multiple Unmanned Aerial Vehicles

Advances in unmanned aircraft systems (UAS) have paved the way for progressively higher levels of intelligence and autonomy, supporting new modes of operation, such as the one-to-many (OTM) concept, where a single human operator is responsible for monitoring and coordinating the tasks of multiple unmanned aerial vehicles (UAVs). This paper presents the development and evaluation of cognitive human-machine interfaces and interactions (CHMI2) supporting adaptive automation in OTM applications. A CHMI2 system comprises a network of neurophysiological sensors and machine-learning based models for inferring user cognitive states, as well as the adaptation engine containing a set of transition logics for control/display functions and discrete autonomy levels. Models of the user’s cognitive states are trained on past performance and neurophysiological data during an offline calibration phase, and subsequently used in the online adaptation phase for real-time inference of these cognitive states. To investigate adaptive automation in OTM applications, a scenario involving bushfire detection was developed where a single human operator is responsible for tasking multiple UAV platforms to search for and localize bushfires over a wide area. We present the architecture and design of the UAS simulation environment that was developed, together with various human-machine interface (HMI) formats and functions, to evaluate the CHMI2 system’s feasibility through human-in-the-loop (HITL) experiments. The CHMI2 module was subsequently integrated into the simulation environment, providing the sensing, inference, and adaptation capabilities needed to realise adaptive automation. HITL experiments were performed to verify the CHMI2 module’s functionalities in the offline calibration and online adaptation phases. In particular, results from the online adaptation phase showed that the system was able to support real-time inference and human-machine interface and interaction (HMI2) adaptation. However, the accuracy of the inferred workload was variable across the different participants (with a root mean squared error (RMSE) ranging from 0.2 to 0.6), partly due to the reduced number of neurophysiological features available as real-time inputs and also due to limited training stages in the offline calibration phase. To improve the performance of the system, future work will investigate the use of alternative machine learning techniques, additional neurophysiological input features, and a more extensive training stage.

The Role of the Prefrontal Cortex and Functional Connectivity during Maritime Operations: An fNIRS study

INTRODUCTION

Watchkeeping is a significant activity during maritime operations, and failures of sustained attention and decision-making can increase the likelihood of a collision.

METHODS

A study was conducted in a ship bridge simulator where 40 participants (20 experienced/20 inexperienced) performed: (1) a 20-min period of sustained attention to locate a target vessel and (2) a 10-min period of decision-making/action selection to perform an evasive maneuver. Half of the participants also performed an additional task of verbally reporting the position of their vessel. Activation of the prefrontal cortex (PFC) was captured via a 15-channel functional near-infrared spectroscopy (fNIRS) montage, and measures of functional connectivity were calculated frontal using graph-theoretic measures.

RESULTS

Neurovascular activation of right lateral area of the PFC decreased during sustained attention and increased during decision-making. The graph-theoretic analysis revealed that density declined during decision-making in comparison with the previous period of sustained attention, while local clustering declined during sustained attention and increased when participants prepared their evasive maneuver. A regression analysis revealed an association between network measures and behavioral outcomes, with respect to spotting the target vessel and making an evasive maneuver.

CONCLUSIONS

The right lateral area of the PFC is sensitive to watchkeeping and decision-making during operational performance. Graph-theoretic measures allow us to quantify patterns of functional connectivity and were predictive of safety-critical performance.