The role of anterior prefrontal cortex (area 10) in face-to-face deception measured with fNIRS

From physical to digital: A theoretical-methodological primer on designing hyperscanning investigations to explore remote exchanges

As individuals increasingly engage in social interactions through digital mediums, understanding the neuroscientific underpinnings of such exchanges becomes a critical challenge and a valuable opportunity. In line with a second-person neuroscience approach, understanding the forms of interpersonal syntonisation that occur during digital interactions is pivotal for grasping the mechanisms underlying successful collaboration in virtual spaces. The hyperscanning paradigm, involving the simultaneous monitoring of the brains and bodies of multiple interacting individuals, seems to be a powerful tool for unravelling the neural correlates of interpersonal syntonisation in social exchanges. We posit that such approach can now open new windows on interacting brains' responses even to digitally-conveyed social cues, offering insights into how social information is processed in the absence of traditional face-to-face settings. Yet, such paradigm shift raises challenging methodological questions, which should be answered properly to conduct significant and informative hyperscanning investigations. Here, we provide an introduction to core methodological issues dedicated to novices approaching the design of hyperscanning investigations of remote exchanges in natural settings, focusing on the selection of neuroscientific devices, synchronization of data streams, and data analysis approaches. Finally, a methodological checklist for devising robust hyperscanning studies on digital interactions is presented.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

A calculus of probability or belief? Neural underpinnings of social decision-making in a card game

For decades, the prefrontal cortex (PFC) has been the focus of social neuroscience research, specifically regarding its role in competitive social decision-making. However, the distinct contributions of PFC subregions when making strategic decisions involving multiple types of information (social, non-social, and mixed information) remain unclear. This study investigates decision-making strategies (pure probability calculation vs. mentalizing) and their neural representations using functional near-infrared spectroscopy (fNIRS) data collected during a two-person card game. We observed individual differences in information processing strategy, indicating that some participants relied more on probability than others. Overall, the use of pure probability decreased over time in favor of other types of information (e.g., mixed information), with this effect being more pronounced within-round trials than across rounds. In the brain, (1) the lateral PFC activates when decisions are driven by probability calculations; (2) the right lateral PFC responds to trial difficulty; and (3) the anterior medial PFC is engaged when decision-making involves mentalizing. Furthermore, neural synchrony, which reflects the real-time interplay between individuals' cognitive processes, did not consistently contribute to correct decisions and fluctuated throughout the experiment, suggesting a hierarchical mentalizing mechanism at work.

Spontaneous dyadic behaviour predicts the emergence of interpersonal neural synchrony

Synchronization of neural activity across brains - interpersonal neural synchrony (INS) - is emerging as a powerful marker of social interaction that predicts success of multi-person coordination, communication, and cooperation. As the origins of INS are poorly understood, we tested whether and how INS might emerge from spontaneous dyadic behavior. We recorded neural activity (EEG) and human behavior (full-body kinematics, eye movements and facial expressions) while dyads of participants were instructed to look at each other without speaking or making co-verbal gestures. We made four fundamental observations. First, despite the absence of a structured social task, INS emerged spontaneously only when participants were able to see each other. Second, we show that such spontaneous INS, comprising specific spectral and topographic profiles, did not merely reflect intra-personal modulations of neural activity, but it rather reflected real-time and dyad-specific coupling of neural activities. Third, using state-of-art video-image processing and deep learning, we extracted the temporal unfolding of three notable social behavioral cues - body movement, eye contact, and smiling - and demonstrated that these behaviors also spontaneously synchronized within dyads. Fourth, we probed the correlates of INS in such synchronized social behaviors. Using cross-correlation and Granger causality analyses, we show that synchronized social behaviors anticipate and in fact Granger cause INS. These results provide proof-of-concept evidence for studying interpersonal neural and behavioral synchrony under natural and unconstrained conditions. Most importantly, the results suggest that INS could be conceptualized as an emergent property of two coupled neural systems: an entrainment phenomenon, promoted by real-time dyadic behavior.

Increased Interpersonal Brain Synchronization in Romantic Couples Is Associated with Higher Honesty: An fNIRS Hyperscanning Study

Previous studies on the brain-brain interaction of deception have shown different patterns of interpersonal brain synchronization (IBS) between different genders. However, the brain-brain mechanisms in the cross-sex composition need to be better understood. Furthermore, there needs to be more discussion about how relationships (e.g., romantic couples vs. strangers) affect the brain-brain mechanism under interactive deception. To elaborate on these issues, we used the functional near-infrared spectroscopy (fNIRS)-based hyperscanning approach to simultaneously measure interpersonal brain synchronization (IBS) in romantic couples (heterosexual) and cross-sex stranger dyads during the sender-receiver game. The behavioral results found that the deception rate of males was lower than that of females, and romantic couples were deceived less than strangers. Significantly increased IBS was observed in the frontopolar cortex (FPC) and right temporoparietal junction (rTPJ) of the romantic couple group. Moreover, the IBS is negatively correlated with the deception rate. No significantly increased IBS was observed in cross-sex stranger dyads. The result corroborated the lower deception of males and romantic couples in cross-sex interactions. Furthermore, IBS in the PFC and rTPJ was the underlying dual-brain neural basis for supporting honesty in romantic couples.

Prefrontal cortical activation associated with prospective memory while walking around a real-world street environment

Rostral PFC (area 10) activation is common during prospective memory (PM) tasks. But it is not clear what mental processes these activations index. Three candidate explanations from cognitive neuroscience theory are: (i) monitoring of the environment; (ii) spontaneous intention retrieval; (iii) a combination of the two. These explanations make different predictions about the temporal and spatial patterns of activation that would be seen in rostral PFC in naturalistic settings. Accordingly, we plotted functional events in PFC using portable fNIRS while people were carrying out a PM task outside the lab and responding to cues when they were encountered, to decide between these explanations. Nineteen people were asked to walk around a street in London, U.K. and perform various tasks while also remembering to respond to prospective memory (PM) cues when they detected them. The prospective memory cues could be either social (involving greeting a person) or non-social (interacting with a parking meter) in nature. There were also a number of contrast conditions which allowed us to determine activation specifically related to the prospective memory components of the tasks. We found that maintaining both social and non-social intentions was associated with widespread activation within medial and right hemisphere rostral prefrontal cortex (BA 10), in agreement with numerous previous lab-based fMRI studies of prospective memory. In addition, increased activation was found within lateral prefrontal cortex (BA 45 and 46) when people were maintaining a social intention compared to a non-social one. The data were then subjected to a GLM-based method for automatic identification of functional events (AIDE), and the position of the participants at the time of the activation events were located on a map of the physical space. The results showed that the spatial and temporal distribution of these events was not random, but aggregated around areas in which the participants appeared to retrieve their future intentions (i.e., where they saw intentional cues), as well as where they executed them. Functional events were detected most frequently in BA 10 during the PM conditions compared to other regions and tasks. Mobile fNIRS can be used to measure higher cognitive functions of the prefrontal cortex in "real world" situations outside the laboratory in freely ambulant individuals. The addition of a "brain-first" approach to the data permits the experimenter to determine not only when haemodynamic changes occur, but also where the participant was when it happened. This can be extremely valuable when trying to link brain and cognition.

Systemic physiology augmented functional near-infrared spectroscopy hyperscanning: a first evaluation investigating entrainment of spontaneous activity of brain and body physiology between subjects

Significance: Functional near-infrared spectroscopy (fNIRS) enables measuring the brain activity of two subjects while they interact, i.e., the hyperscanning approach. Aim: In our exploratory study, we extended classical fNIRS hyperscanning by adding systemic physiological measures to obtain systemic physiology augmented fNIRS (SPA-fNIRS) hyperscanning while blocking and not blocking the visual communication between the subjects. This approach enables access brain-to-brain, brain-to-body, and body-to-body coupling between the subjects simultaneously. Approach: Twenty-four pairs of subjects participated in the experiment. The paradigm consisted of two subjects that sat in front of each other and had their eyes closed for 10 min, followed by a phase of 10 min where they made eye contact. Brain and body activity was measured continuously by SPA-fNIRS. Results: Our study shows that making eye contact for a prolonged time causes significant changes in brain-to-brain, brain-to-body, and body-to-body coupling, indicating that eye contact is followed by entrainment of the physiology between subjects. Subjects that knew each other generally showed a larger trend to change between the two conditions. Conclusions: The main point of this study is to introduce a new framework to investigate brain-to-brain, body-to-body, and brain-to-body coupling through a simple social experimental paradigm. The study revealed that eye contact leads to significant synchronization of spontaneous activity of the brain and body physiology. Our study is the first that employed the SPA-fNIRS approach and showed its usefulness to investigate complex interpersonal physiological changes.

Novel Approaches and Cognitive Neuroscience Perspectives on False Memory and Deception

The DRM (Deese-Roediger-McDermott) paradigm produces robust false memories of non-presented critical words. After studying a thematic word list (e.g., bed, rest, and pillow) participants falsely remember the critical item "sleep." We report two false memory experiments. Study One introduces a novel use of the lexical decision task (LDT) to prime critical words. Participants see two letter-strings and make timed responses indicating whether they are both words. The word pairs Night-Bed and Dream-Thweeb both prime "sleep" but only one pair contains two words. Our primary purpose is to introduce this new methodology via two pilot experiments. The results, considered preliminary, are promising as they indicate that participants were as likely to recognize critical words (false memories) and presented words (true memories) just as when studying thematic lists. Study Two actually employs the standard DRM lists so that semantic priming is in play there as well. The second study, however, uses functional near-infrared spectroscopy (fNIRS) to measure activity in the prefrontal cortex during a DRM task which includes a deception phase where participants intentionally lie about critical lures. False and true memories occurred at high levels and activated many of the same brain regions but, compared to true memories, cortical activity was higher for false memories and lies. Accuracy findings are accompanied by confidence and reaction time results. Both investigations suggest that it is difficult to distinguish accurate from inaccurate memories. We explain results in terms of activation-monitoring theory and Fuzzy Trace Theory. We provide real world implications and suggest extending the present research to varying age groups and special populations. A nagging question has not been satisfactorily answered: Could neural pathways exist that signal the presence of false memories and lies? Answering this question will require imaging experiments that focus on regions of distinction such as the anterior prefrontal cortex.

Being 'in sync'-is interactional synchrony the key to understanding the social brain?

The past couple of decades produced a surge of interest in interaction synchrony. Moving from the study of behavioral coordination to investigating the coordination of psychophysiological and brain activity, relevant research has tackled a broad range of interactional settings with a multitude of measurement and analysis tools. This method diversity produced a host of interesting results converging on the fact that individuals engaged in social exchange tend to temporally align external as well as internal processes. Moreover, there appears to be a reciprocal relationship between the individuals' affective bond and the extent of synchronization, which together benefit interaction outcomes. Notably, however, the current breadth of study approaches creates challenges for the field, including how to compare findings and how to develop a theoretical framework that unites and directs ongoing research efforts. More concerted efforts are called for to achieve the conceptual and methodological clarity needed to answer core questions and enabling a balanced pursuit of both synchronous and asynchronous processes.

Working Memory Decline in Alzheimer's Disease Is Detected by Complexity Analysis of Multimodal EEG-fNIRS

Alzheimer's disease (AD) is characterized by working memory (WM) failures that can be assessed at early stages through administering clinical tests. Ecological neuroimaging, such as Electroencephalography (EEG) and functional Near Infrared Spectroscopy (fNIRS), may be employed during these tests to support AD early diagnosis within clinical settings. Multimodal EEG-fNIRS could measure brain activity along with neurovascular coupling (NC) and detect their modifications associated with AD. Data analysis procedures based on signal complexity are suitable to estimate electrical and hemodynamic brain activity or their mutual information (NC) during non-structured experimental paradigms. In this study, sample entropy of whole-head EEG and frontal/prefrontal cortex fNIRS was evaluated to assess brain activity in early AD and healthy controls (HC) during WM tasks (i.e., Rey-Osterrieth complex figure and Raven's progressive matrices). Moreover, conditional entropy between EEG and fNIRS was evaluated as indicative of NC. The findings demonstrated the capability of complexity analysis of multimodal EEG-fNIRS to detect WM decline in AD. Furthermore, a multivariate data-driven analysis, performed on these entropy metrics and based on the General Linear Model, allowed classifying AD and HC with an AUC up to 0.88. EEG-fNIRS may represent a powerful tool for the clinical evaluation of WM decline in early AD.

The Role of Reward System in Dishonest Behavior: A Functional Near-Infrared Spectroscopy Study

Previous studies showed that the cortical reward system plays an important role in deceptive behavior. However, how the reward system activates during the whole course of dishonest behavior and how it affects dishonest decisions remain unclear. The current study investigated these questions. One hundred and two participants were included in the final analysis. They completed two tasks: monetary incentive delay (MID) task and an honesty task. The MID task served as the localizer task and the honesty task was used to measure participants' deceptive behaviors. Participants' spontaneous responses in the honesty task were categorized into three conditions: Correct-Truth condition (tell the truth after guessing correctly), Incorrect-Truth condition (tell the truth after guessing incorrectly), and Incorrect-Lie condition (tell lies after guessing incorrectly). To reduce contamination from neighboring functional regions as well as to increase sensitivity to small effects (Powell et al., Devel Sci 21:e12595, 2018), we adopted the individual functional channel of interest (fCOI) approach to analyze the data. Specially, we identified the channels of interest in the MID task in individual participants and then applied them to the honesty task. The result suggested that the reward system showed different activation patterns during different phases: In the pre-decision phase, the reward system was activated with the winning of the reward. During the decision and feedback phase, the reward system was activated when people made the decisions to be dishonest and when they evaluated the outcome of their decisions. Furthermore, the result showed that neural activity of the reward system toward the outcome of their decision was related to subsequent dishonest behaviors. Thus, the present study confirmed the important role of the reward system in deception. These results can also shed light on how one could use neuroimaging techniques to perform lie-detection.