Mental action simulation synchronizes action-observation circuits across individuals

Sisterhood predicts similar neural processing of a film

Relationships between humans are essential for how we see the world. Using fMRI, we explored the neural basis of homophily, a sociological concept that describes the tendency to bond with similar others. Our comparison of brain activity between sisters, friends and acquaintances while they watched a movie, indicate that sisters' brain activity is more similar than that of friends and friends' activity is more similar than that of acquaintances. The increased similarity in brain activity measured as inter-subject correlation (ISC) was found both in higher-order brain areas including the default-mode network (DMN) and sensory areas. Increased ISC could not be explained by genetic relation between sisters neither by similarities in eye-movements, emotional experiences, and physiological activity. Our findings shed light on the neural basis of homophily by revealing that similarity in brain activity in the DMN and sensory areas is the stronger the closer is the relationship between the people.

A Brain-To-Brain Mechanism for Social Transmission of Threat Learning

Survival and adaptation in environments require swift and efficacious learning about what is dangerous. Across species, much of such threat learning is acquired socially, e.g., through the observation of others' ("demonstrators'") defensive behaviors. However, the specific neural mechanisms responsible for the integration of information shared between demonstrators and observers remain largely unknown. This dearth of knowledge is addressed by performing magnetoencephalography (MEG) neuroimaging in demonstrator-observer dyads. A set of stimuli are first shown to a demonstrator whose defensive responses are filmed and later presented to an observer, while neuronal activity is recorded sequentially from both individuals who never interacted directly. These results show that brain-to-brain coupling (BtBC) in the fronto-limbic circuit (including insula, ventromedial, and dorsolateral prefrontal cortex) within demonstrator-observer dyads predict subsequent expressions of learning in the observer. Importantly, the predictive power of BtBC magnifies when a threat is imminent to the demonstrator. Furthermore, BtBC depends on how observers perceive their social status relative to the demonstrator, likely driven by shared attention and emotion, as bolstered by dyadic pupillary coupling. Taken together, this study describes a brain-to-brain mechanism for social threat learning, involving BtBC, which reflects social relationships and predicts adaptive, learned behaviors.

Narrative simulation of social experiences in naturalistic context - A neurocinematic approach

Narratives may be regarded as simulations of everyday social situations. They are key to studying the human mind in socio-culturally determined contexts as they allow anchoring to the common ground of embodied and environmentally-engaged cognition. Here we review recent findings from naturalistic neuroscience on neural functions in conditions that mimic lifelike situations. We will focus particularly on neurocinematics, a research field that applies mediated narratives as stimuli for neuroimaging experiments. During the last two decades, this paradigm has contributed to an accumulation of insights about the neural underpinnings of behavior and sense-making in various narratively contextualized situations particularly pertaining to socio-emotional encounters. One of the key questions in neurocinematics is, how do intersubjectively synchronized brain activations relate to subjective experiences? Another question we address is how to bring natural contexts into experimental studies. Seeking to respond to both questions, we suggest neurocinematic studies to examine three manifestations of the same phenomenon side-by-side: subjective experiences of narrative situations, unfolding of narrative stimulus structure, and neural processes that co-constitute the experience. This approach facilitates identifying experientially meaningful activity patterns in the brain and points out what they may mean in relation to shared and communicable contents. Via rich-featured and temporally contextualized narrative stimuli, neurocinematics attempts to contribute to emerging holistic theories of neural dynamics and connectomics explaining typical and atypical interindividual variability.

Ongoing first-hand pain facilitates somatosensory resonance but inhibits affective sharing in empathy for pain

Alterations of empathy for others' pain among patients with chronic pain remained inconsistent. Here, applying a capsaicin-based ongoing pain model on healthy participants, this study investigated how ongoing first-hand pain influences empathic reactions to vicarious pain stimuli. Healthy participants were randomly treated with topical capsaicin cream (capsaicin group) or hand cream (control group) on the left forearm. Video clips showing limbs in painful and non-painful situations were used to induce empathic responses. The capsaicin group showed greater empathic neural responses in the right primary somatosensory cortex (S1) than the control group but smaller responses in the left anterior insula (AI) accompanied with smaller empathic pain-intensity ratings. Notably, the intensity of ongoing pain negatively correlated with empathy-related neural responses in the left AI. Inter-subject phase synchronization analysis was used to assess stimulus-dependent dynamic functional connectivity within or between brain regions engaged in pain empathy. The capsaicin group showed greater empathy-related neural synchronization within S1 and between S1 and AI, but less synchronization within AI and between AI and MCC. Behaviorally, the differential inter-subject pain-intensity rating alignment between painful and non-painful videos was more positive for the capsaicin group than for the control group, and this effect was partially mediated by the inter-subject neural synchronization between S1 and AI. These results suggest that ongoing first-hand pain facilitates neural activation and synchronization within brain regions associated with empathy-related somatosensory resonance at the cost of inhibiting activation and synchronization within brain regions engaged in empathy-related affective sharing.

Synchrony with distress in affective empathy and compassion

Sensitivity to suffering of others is a core factor in social cohesion and evolutionary success. The emergence of such sensitivity may occur via two neuro-functional mechanisms. One is sharing the pain and distress of others, which relies on affective empathy. The other involves a caring concern for others' wellbeing, termed compassion. Both affective empathy and compassion are triggered by cues of pain and distress, exhibited by suffering targets. Yet, the mechanisms underlying distress processing in empathy and compassion are not clear. In the current research, we investigated synchrony with a target's distress, as a putative mechanism for continuous processing of distress cues. Participants viewed a video of a target in distress when given two different instructions: they were asked to continuously rate their distress in the affective empathy condition, or their feelings of care in the compassion condition. We used these dynamic ratings as well as participants' autonomic and facial responses to assess multi-channel synchrony with the target's self-rated distress fluctuations. Dynamic ratings and facial corrugator responses were significantly positively synchronized with the target's distress. For the corrugator responses, synchrony with the target was more pronounced than synchrony with participants' own ratings. Autonomic responses exhibited negative synchrony with the target's distress. Synchrony was higher in the affective empathy than in the compassion condition, across channels. These results point to the key role of subjective and physiological synchrony with the target's distress in empathic sharing of negative experiences. They also highlight the attenuation of embodied resonance with distress in compassionate experiences.

Naturalistic Stimuli in Affective Neuroimaging: A Review

Naturalistic stimuli such as movies, music, and spoken and written stories elicit strong emotions and allow brain imaging of emotions in close-to-real-life conditions. Emotions are multi-component phenomena: relevant stimuli lead to automatic changes in multiple functional components including perception, physiology, behavior, and conscious experiences. Brain activity during naturalistic stimuli reflects all these changes, suggesting that parsing emotion-related processing during such complex stimulation is not a straightforward task. Here, I review affective neuroimaging studies that have employed naturalistic stimuli to study emotional processing, focusing especially on experienced emotions. I argue that to investigate emotions with naturalistic stimuli, we need to define and extract emotion features from both the stimulus and the observer.

Escitalopram enhances synchrony of brain responses during emotional narratives in patients with major depressive disorder

One-week treatment with escitalopram decreases amygdala responses to fearful facial expressions in depressed patients, but it remains unknown whether it also modulates processing of complex and freely processed emotional stimuli resembling daily life emotional situations. Inter-subject correlation (ISC) offers a means to track brain activity during complex, dynamic stimuli in a model-free manner. Twenty-nine treatment-seeking patients with major depressive disorder were randomized in a double-blind study design to receive either escitalopram or placebo for one week, after which functional magnetic resonance imaging (fMRI) was performed. During fMRI the participants listened to spoken emotional narratives. Level of ISC between the escitalopram and the placebo group was compared across all the narratives and separately for the episodes with positive and negative valence. Across all the narratives, the escitalopram group had higher ISC in the default mode network of the brain as well as in the fronto-temporal narrative processing regions, whereas lower ISC was seen in the middle temporal cortex, hippocampus and occipital cortex. Escitalopram increased ISC during positive parts of the narratives in the precuneus, medial prefrontal cortex, anterior cingulate and fronto-insular cortex, whereas there was no significant synchronization in brain responses to positive vs negative events in the placebo group. Increased ISC may imply improved emotional synchronization with others, particularly during observation of positive events. Further studies are needed to test whether this contributes to the later therapeutic effect of escitalopram.

Gamma frequencies as a predictor for the accomplishment of a motor task guided through the action observation network

BACKGROUND

Action observation describes a concept where the subsequent motor behavior of an individual can be modulated though observing an action. This occurs through the activation of neurons in the action observation network, acting on a variety of motor learning processes. This network has been proven highly useful in the rehabilitation of patients with acquired brain injury, placing "action observation" as one of the most effective techniques for motor recovery in physical neurorehabilitation.

OBJECTIVE

The aim of this paper is to define an EEG marker for motor learning, guided through observation.

METHODS

Healthy subjects (n = 41) participated voluntarily for this research. They were asked to repeat an unknown motor behavior, immediately after observing a video. During the observation, EEG raw signals where collected with a portable EEG and the results were later compared with success and fail on repeating the motor procedure. The comparison was then analyzed with the Mann-Whitney U test for non-parametrical data, with a confidence interval of 95%.

RESULTS

A significant relation between motor performance and neural activity was found for Alpha (p = 0,0149) and Gamma (0,0005) oscillatory patterns.

CONCLUSION

Gamma oscillations with frequencies between 41 and 49,75 Hz, seem to be an adequate EEG marker for motor performance guided through the action observation network. The technology used for this paper is easy to use, low-cost and presents valid measurements for the recommended oscillatory frequencies, implying a possible use on rehabilitation, by collecting data in real-time during therapeutic interventions and assessments.

Movies and narratives as naturalistic stimuli in neuroimaging

Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity.

Finding the neural correlates of collaboration using a three-person fMRI hyperscanning paradigm

Humans have an extraordinary ability to interact and cooperate with others. Despite the social and evolutionary significance of collaboration, research on finding its neural correlates has been limited partly due to restrictions on the simultaneous neuroimaging of more than one participant (also known as hyperscanning). Several studies have used dyadic fMRI hyperscanning to examine the interaction between two participants. However, to our knowledge, no study to date has aimed at revealing the neural correlates of social interactions using a three-person (or triadic) fMRI hyperscanning paradigm. Here, we simultaneously measured the blood-oxygenation level-dependent signal from 12 triads (n = 36 participants), while they engaged in a collaborative drawing task based on the social game of Pictionary General linear model analysis revealed increased activation in the brain regions previously linked with the theory of mind during the collaborative phase compared to the independent phase of the task. Furthermore, using intersubject correlation analysis, we revealed increased synchronization of the right temporo-parietal junction (R TPJ) during the collaborative phase. The increased synchrony in the R TPJ was observed to be positively associated with the overall team performance on the task. In sum, our paradigm revealed a vital role of the R TPJ among other theory-of-mind regions during a triadic collaborative drawing task.

Neural Processing of Narratives: From Individual Processing to Viral Propagation

Narratives, in the form of, e.g., written stories, mouth-to-mouth accounts, audiobooks, fiction movies, and media-feeds, powerfully shape the perception of reality and widely influence human decision-making. In this review, we describe findings from recent neuroimaging studies unraveling how narratives influence the human brain, thus shaping perception, cognition, emotions, and decision-making. It appears that narrative sense-making relies on default-mode network (DMN) structures of the brain, especially precuneus. Activity in precuneus further seems to differ for fictitious vs. real narratives. Notably, high inter-subject correlation (ISC) of brain activity during narrative processing seems to predict the efficacy of a narrative. Factors that enhance the ISC of brain activity during narratives include higher levels of attention, emotional arousal, and negative emotional valence. Higher levels of attentional suspense seem to co-vary with activity in the temporoparietal junction, emotional arousal with activity in dorsal attention network, and negative emotional valence with activity in DMN. Lingering after-effects of emotional narratives have been further described in DMN, amygdala, and sensory cortical areas. Finally, inter-individual differences in personality, and cultural-background related analytical and holistic thinking styles, shape ISC of brain activity during narrative perception. Together, these findings offer promising leads for future studies elucidating the effects of narratives on the human brain, and how such effects might predict the efficacy of narratives in modulating decision-making.

Social perspective-taking shapes brain hemodynamic activity and eye movements during movie viewing

Putting oneself into the shoes of others is an important aspect of social cognition. We measured brain hemodynamic activity and eye-gaze patterns while participants were viewing a shortened version of the movie 'My Sister's Keeper' from two perspectives: that of a potential organ donor, who violates moral norms by refusing to donate her kidney, and that of a potential organ recipient, who suffers in pain. Inter-subject correlation (ISC) of brain activity was significantly higher during the potential organ donor's perspective in dorsolateral and inferior prefrontal, lateral and inferior occipital, and inferior-anterior temporal areas. In the reverse contrast, stronger ISC was observed in superior temporal, posterior frontal and anterior parietal areas. Eye-gaze analysis showed higher proportion of fixations on the potential organ recipient during both perspectives. Taken together, these results suggest that during social perspective-taking different brain areas can be flexibly recruited depending on the nature of the perspective that is taken.

Secondary somatosensory cortex of primates: beyond body maps, toward conscious self-in-the-world maps

Recent human imaging studies have revealed the involvement of the secondary somatosensory cortex (SII) in processes that require high-level information integration, such as self-consciousness, social relations, whole body representation, and metaphorical extrapolations. These functions are far beyond its known role in the formation of body maps (even in their most complex forms), requiring the integration of different information modalities in addition to somatosensory information. However, no evidence of such complex processing seems to have been detected at the neuronal level in animal experiments, which would constitute a major discrepancy between human and non-human animals. This article scrutinizes this gap, introducing experimental evidence of human and non-human primates’ SII functions set in context with their evolutionary significance and mechanisms, functionally situating the human SII as a primate brain. Based on the presented data, a new concept of a somatocentric holistic self is proposed, represented as a more comprehensive body-in-the-world map in the primate SII, taking into account evolutionary aspects that characterize the human SII and its implication in the emergence of self-consciousness. Finally, the idea of projection is introduced from the viewpoint of cognitive science, providing a logical explanation to bridge this gap between observed behavior and neurophysiological data.

Emotions amplify speaker-listener neural alignment

Individuals often align their emotional states during conversation. Here, we reveal how such emotional alignment is reflected in synchronization of brain activity across speakers and listeners. Two "speaker" subjects told emotional and neutral autobiographical stories while their hemodynamic brain activity was measured with functional magnetic resonance imaging (fMRI). The stories were recorded and played back to 16 "listener" subjects during fMRI. After scanning, both speakers and listeners rated the moment-to-moment valence and arousal of the stories. Time-varying similarity of the blood-oxygenation-level-dependent (BOLD) time series was quantified by intersubject phase synchronization (ISPS) between speaker-listener pairs. Telling and listening to the stories elicited similar emotions across speaker-listener pairs. Arousal was associated with increased speaker-listener neural synchronization in brain regions supporting attentional, auditory, somatosensory, and motor processing. Valence was associated with increased speaker-listener neural synchronization in brain regions involved in emotional processing, including amygdala, hippocampus, and temporal pole. Speaker-listener synchronization of subjective feelings of arousal was associated with increased neural synchronization in somatosensory and subcortical brain regions; synchronization of valence was associated with neural synchronization in parietal cortices and midline structures. We propose that emotion-dependent speaker-listener neural synchronization is associated with emotional contagion, thereby implying that listeners reproduce some aspects of the speaker's emotional state at the neural level.

Measuring shared responses across subjects using intersubject correlation

Our capacity to jointly represent information about the world underpins our social experience. By leveraging one individual's brain activity to model another's, we can measure shared information across brains-even in dynamic, naturalistic scenarios where an explicit response model may be unobtainable. Introducing experimental manipulations allows us to measure, for example, shared responses between speakers and listeners or between perception and recall. In this tutorial, we develop the logic of intersubject correlation (ISC) analysis and discuss the family of neuroscientific questions that stem from this approach. We also extend this logic to spatially distributed response patterns and functional network estimation. We provide a thorough and accessible treatment of methodological considerations specific to ISC analysis and outline best practices.

A drama movie activates brains of holistic and analytical thinkers differentially

People socialized in different cultures differ in their thinking styles. Eastern-culture people view objects more holistically by taking context into account, whereas Western-culture people view objects more analytically by focusing on them at the expense of context. Here we studied whether participants, who have different thinking styles but live within the same culture, exhibit differential brain activity when viewing a drama movie. A total of 26 Finnish participants, who were divided into holistic and analytical thinkers based on self-report questionnaire scores, watched a shortened drama movie during functional magnetic resonance imaging. We compared intersubject correlation (ISC) of brain hemodynamic activity of holistic vs analytical participants across the movie viewings. Holistic thinkers showed significant ISC in more extensive cortical areas than analytical thinkers, suggesting that they perceived the movie in a more similar fashion. Significantly higher ISC was observed in holistic thinkers in occipital, prefrontal and temporal cortices. In analytical thinkers, significant ISC was observed in right-hemisphere fusiform gyrus, temporoparietal junction and frontal cortex. Since these results were obtained in participants with similar cultural background, they are less prone to confounds by other possible cultural differences. Overall, our results show how brain activity in holistic vs analytical participants differs when viewing the same drama movie.

Neural dynamics underlying emotional transmissions between individuals

Emotional experiences are frequently shaped by the emotional responses of co-present others. Research has shown that people constantly monitor and adapt to the incoming social–emotional signals, even without face-to-face interaction. And yet, the neural processes underlying such emotional transmissions have not been directly studied. Here, we investigated how the human brain processes emotional cues which arrive from another, co-attending individual. We presented continuous emotional feedback to participants who viewed a movie in the scanner. Participants in the social group (but not in the control group) believed that the feedback was coming from another person who was co-viewing the same movie. We found that social–emotional feedback significantly affected the neural dynamics both in the core affect and in the medial pre-frontal regions. Specifically, the response time-courses in those regions exhibited increased similarity across recipients and increased neural alignment with the timeline of the feedback in the social compared with control group. Taken in conjunction with previous research, this study suggests that emotional cues from others shape the neural dynamics across the whole neural continuum of emotional processing in the brain. Moreover, it demonstrates that interpersonal neural alignment can serve as a neural mechanism through which affective information is conveyed between individuals.

MEG adaptation reveals action representations in posterior occipitotemporal regions

When we observe other people's actions, a number of parietal and precentral regions known to be involved in the planning and execution of actions are recruited for example seen as power decreases in alpha and beta frequencies indicative of increased activation. It has been argued that this recruitment reflects the process of simulating the observed action, thereby providing access to the meaning of the action. Alternatively, it has been suggested that rather than providing access to the meaning of an action, parietal and precentral regions might be recruited as a consequence of action understanding. A way to distinguish between these alternatives is to examine where in the brain and at which time point it is possible to discriminate between different types of actions (e.g., pointing or grasping) irrespective of the way these are performed. To this aim, we presented participants with videos of simple hand actions performed with the left or right hand towards a target on the left or the right side while recording magnetoencephalography (MEG) data. In each trial, participants were presented with two subsequent videos (S1, S2) depicting either the same (repeat trials) or different (non-repeat trials) actions. We predicted that areas that are sensitive to the type of action should show stronger adaptation (i.e., a smaller decrease in alpha and beta power) in repeat in comparison to non-repeat trials. Indeed, we observed less alpha and beta power decreases during the presentation of S2 when the action was repeated compared to when two different actions were presented indicating adaptation of neuronal populations that are selective for the type of action. Sources were obtained exclusively in posterior occipitotemporal regions, supporting the notion that an early differentiation of actions occurs outside the motor system.

Sharing the social world via intersubject neural synchronisation

Sociability and capability of shared mental states are hallmarks of the human species, and pursuing shared goals oftentimes requires coordinating both behaviour and mental states. Here we review recent work using indices of intersubject neural synchronisation for measuring similarity of mental states across individuals. We discuss the methodological advances and limitations in the analyses based on intersubject synchrony, and discuss how these kinds of model-free analysis techniques enable the investigation of the brain basis of complex social processes. We argue that similarity of brain activity across individuals can be used, under certain conditions, to index the similarity of their subjective states of consciousness, and thus be used for investigating brain basis of mutual understanding and cooperation.

Haptic contents of a movie dynamically engage the spectator's sensorimotor cortex

Observation of another person's actions and feelings activates brain areas that support similar functions in the observer, thereby facilitating inferences about the other's mental and bodily states. In real life, events eliciting this kind of vicarious brain activations are intermingled with other complex, ever-changing stimuli in the environment. One practical approach to study the neural underpinnings of real-life vicarious perception is to image brain activity during movie viewing. Here the goal was to find out how observed haptic events in a silent movie would affect the spectator's sensorimotor cortex. The functional state of the sensorimotor cortex was monitored by analyzing, in 16 healthy subjects, magnetoencephalographic (MEG) responses to tactile finger stimuli that were presented once per second throughout the session. Using canonical correlation analysis and spatial filtering, consistent single-trial responses across subjects were uncovered, and their waveform changes throughout the movie were quantified. The long-latency (85-175 ms) parts of the responses were modulated in concordance with the participants' average moment-by-moment ratings of own engagement in the haptic content of the movie (correlation r = 0.49; ratings collected after the MEG session). The results, obtained by using novel signal-analysis approaches, demonstrate that the functional state of the human sensorimotor cortex fluctuates in a fine-grained manner even during passive observation of temporally varying haptic events. Hum Brain Mapp 37:4061-4068, 2016. © 2016 The Authors Human Brain Mapping Published by Wiley Periodicals, Inc.

Differential inter-subject correlation of brain activity when kinship is a variable in moral dilemma

Previous behavioural studies have shown that humans act more altruistically towards kin. Whether and how knowledge of genetic relatedness translates into differential neurocognitive evaluation of observed social interactions has remained an open question. Here, we investigated how the human brain is engaged when viewing a moral dilemma between genetic vs. non-genetic sisters. During functional magnetic resonance imaging, a movie was shown, depicting refusal of organ donation between two sisters, with subjects guided to believe the sisters were related either genetically or by adoption. Although 90% of the subjects self-reported that genetic relationship was not relevant, their brain activity told a different story. Comparing correlations of brain activity across all subject pairs between the two viewing conditions, we found significantly stronger inter-subject correlations in insula, cingulate, medial and lateral prefrontal, superior temporal, and superior parietal cortices, when the subjects believed that the sisters were genetically related. Cognitive functions previously associated with these areas include moral and emotional conflict regulation, decision making, and mentalizing, suggesting more similar engagement of such functions when observing refusal of altruism from a genetic sister. Our results show that mere knowledge of a genetic relationship between interacting persons robustly modulates social cognition of the perceiver.

Interpersonal synchrony enhanced through 20 Hz phase-coupled dual brain stimulation

Synchronous movement is a key component of social behaviour in several species including humans. Recent theories have suggested a link between interpersonal synchrony of brain oscillations and interpersonal movement synchrony. The present study investigated this link. Using transcranial alternating current stimulation (tACS) applied over the left motor cortex, we induced beta band (20 Hz) oscillations in pairs of individuals who both performed a finger-tapping task with the right hand. In-phase or anti-phase oscillations were delivered during a preparatory period prior to movement and while the tapping task was performed. In-phase 20 Hz stimulation enhanced interpersonal movement synchrony, compared to anti-phase or sham stimulation, particularly for the initial taps following the preparatory period. This was confirmed in an analysis comparing real vs. pseudo pair surrogate data. No enhancement was observed for stimulation frequencies of 2 Hz (matching the target movement frequency) or 10 Hz (alpha band). Thus, phase-coupling of beta band neural oscillations across two individuals' (resting) motor cortices supports the interpersonal alignment of sensorimotor processes that regulate rhythmic action initiation, thereby facilitating the establishment of synchronous movement. Phase-locked dual brain stimulation provides a promising method to study causal effects of interpersonal brain synchrony on social, sensorimotor and cognitive processes.

Inter-Individual Differences in Vicarious Tactile Perception: a View Across the Lifespan in Typical and Atypical Populations

Touch is our most interpersonal sense, and so it stands to reason that we represent not only our own bodily experiences, but also those felt by others. This review will summarise brain and behavioural research on vicarious tactile perception (mirror touch). Specifically, we will focus on vicarious touch across the lifespan in typical and atypical groups, and will identify the knowledge gaps that are in urgent need of filling by examining what is known about how individuals differ within and between typical and atypical groups.

Data-driven approaches in the investigation of social perception

The complexity of social perception poses a challenge to traditional approaches to understand its psychological and neurobiological underpinnings. Data-driven methods are particularly well suited to tackling the often high-dimensional nature of stimulus spaces and of neural representations that characterize social perception. Such methods are more exploratory, capitalize on rich and large datasets, and attempt to discover patterns often without strict hypothesis testing. We present four case studies here: behavioural studies on face judgements, two neuroimaging studies of movies, and eyetracking studies in autism. We conclude with suggestions for particular topics that seem ripe for data-driven approaches, as well as caveats and limitations.

The brain timewise: how timing shapes and supports brain function

We discuss the importance of timing in brain function: how temporal dynamics of the world has left its traces in the brain during evolution and how we can monitor the dynamics of the human brain with non-invasive measurements. Accurate timing is important for the interplay of neurons, neuronal circuitries, brain areas and human individuals. In the human brain, multiple temporal integration windows are hierarchically organized, with temporal scales ranging from microseconds to tens and hundreds of milliseconds for perceptual, motor and cognitive functions, and up to minutes, hours and even months for hormonal and mood changes. Accurate timing is impaired in several brain diseases. From the current repertoire of non-invasive brain imaging methods, only magnetoencephalography (MEG) and scalp electroencephalography (EEG) provide millisecond time-resolution; our focus in this paper is on MEG. Since the introduction of high-density whole-scalp MEG/EEG coverage in the 1990s, the instrumentation has not changed drastically; yet, novel data analyses are advancing the field rapidly by shifting the focus from the mere pinpointing of activity hotspots to seeking stimulus- or task-specific information and to characterizing functional networks. During the next decades, we can expect increased spatial resolution and accuracy of the time-resolved brain imaging and better understanding of brain function, especially its temporal constraints, with the development of novel instrumentation and finer-grained, physiologically inspired generative models of local and network activity. Merging both spatial and temporal information with increasing accuracy and carrying out recordings in naturalistic conditions, including social interaction, will bring much new information about human brain function.

A Duet for one

This paper considers communication in terms of inference about the behaviour of others (and our own behaviour). It is based on the premise that our sensations are largely generated by other agents like ourselves. This means, we are trying to infer how our sensations are caused by others, while they are trying to infer our behaviour: for example, in the dialogue between two speakers. We suggest that the infinite regress induced by modelling another agent - who is modelling you - can be finessed if you both possess the same model. In other words, the sensations caused by others and oneself are generated by the same process. This leads to a view of communication based upon a narrative that is shared by agents who are exchanging sensory signals. Crucially, this narrative transcends agency - and simply involves intermittently attending to and attenuating sensory input. Attending to sensations enables the shared narrative to predict the sensations generated by another (i.e. to listen), while attenuating sensory input enables one to articulate the narrative (i.e. to speak). This produces a reciprocal exchange of sensory signals that, formally, induces a generalised synchrony between internal (neuronal) brain states generating predictions in both agents. We develop the arguments behind this perspective, using an active (Bayesian) inference framework and offer some simulations (of birdsong) as proof of principle.

Hesitant avoidance while walking: an error of social behavior generated by mutual interaction

Altering physical actions when responding to changing environmental demands is important but not always effectively performed. This ineffectiveness, which is an error of social behavior generated by mutual interactions, is not well understood. This study investigated mechanisms of a hesitant behavior that occurs in people walking toward each other, causing people to move in the same direction when attempting to avoid a collision. Using a motion capture device affixed to 17 pairs, we first confirmed the hesitant behavior by a difference between the experimental task, which involved an indeterminate situation to assess the actions of another individual, and the control task, which involved a predetermined avoiding direction, in a real-time situation involving two people. We next investigated the effect of three external factors: long distance until an event, synchronized walking cycle, and different foot relations in dyads on the hesitant behavior. A dramatic increase in freezing and near-collision behavior occurred in dyads for which the avoiding direction was not predetermined. The behavior related with the combination of long distance until an event, synchronized walking cycle, and different foot relations in dyads. We found that the hesitant behavior is influenced by an interpersonal relationship under enough distance to predict other movement. The hesitant behavior has possibly emerged as an undesired by-product of joint action. These results contribute to our understanding of the mechanisms of adaptive control of perception-action coupling in mutual interaction.

Differences in fMRI intersubject correlation while viewing unedited and edited videos of dance performance

Intersubject correlation (ISC) analysis of functional magnetic resonance imaging (fMRI) data provides insight into how continuous streams of sensory stimulation are processed by groups of observers. Although edited movies are frequently used as stimuli in ISC studies, there has been little direct examination of the effect of edits on the resulting ISC maps. In this study we showed 16 observers two audiovisual movie versions of the same dance. In one experimental condition there was a continuous view from a single camera (Unedited condition) and in the other condition there were views from different cameras (Edited condition) that provided close up views of the feet or face and upper body. We computed ISC maps for each condition, as well as created a map that showed the difference between the conditions. The results from the Unedited and Edited maps largely overlapped in the occipital and temporal cortices, although more voxels were found for the Edited map. The difference map revealed greater ISC for the Edited condition in the Postcentral Gyrus, Lingual Gyrus, Precentral Gyrus and Medial Frontal Gyrus, while the Unedited condition showed greater ISC in only the Superior Temporal Gyrus. These findings suggest that the visual changes associated with editing provide a source of correlation in maps obtained from edited film, and highlight the utility of using maps to evaluate the difference in ISC between conditions.

Visual Responsiveness of Neurons in the Secondary Somatosensory Area and its Surrounding Parietal Operculum Regions in Awake Macaque Monkeys

Previous neurophysiological studies performed in macaque monkeys have shown that the secondary somatosensory cortex (SII) is essentially engaged in the processing of somatosensory information and no other sensory input has been reported. In contrast, recent human brain-imaging studies have revealed the effects of visual and auditory stimuli on SII activity, which suggest multisensory integration in the human SII. To determine whether multisensory responses of the SII also exist in nonhuman primates, we recorded single-unit activity in response to visual and auditory stimuli from the SII and surrounding regions in 8 hemispheres from 6 awake monkeys. Among 1157 recorded neurons, 306 neurons responded to visual stimuli. These visual neurons usually responded to rather complex stimuli, such as stimulation of the peripersonal space (40.5%), observation of human action (29.1%), and moving-object stimulation outside the monkey's reach (23.9%). We occasionally applied auditory stimuli to visual neurons and found 10 auditory-responsive neurons that exhibited somatosensory responses. The visual neurons were distributed continuously along the lateral sulcus covering the entire SII, along with other somatosensory neurons. These results highlight the need to investigate novel functional roles-other than somesthetic sensory processing-of the SII.

"Some like it hot": spectators who score high on the personality trait openness enjoy the excitement of hearing dancers breathing without music

Music is an integral part of dance. Over the last 10 years, however, dance stimuli (without music) have been repeatedly used to study action observation processes, increasing our understanding of the influence of observer’s physical abilities on action perception. Moreover, beyond trained skills and empathy traits, very little has been investigated on how other observer or spectators’ properties modulate action observation and action preference. Since strong correlations have been shown between music and personality traits, here we aim to investigate how personality traits shape the appreciation of dance when this is presented with three different music/sounds. Therefore, we investigated the relationship between personality traits and the subjective esthetic experience of 52 spectators watching a 24 min lasting contemporary dance performance projected on a big screen containing three movement phrases performed to three different sound scores: classical music (i.e., Bach), an electronic sound-score, and a section without music but where the breathing of the performers was audible. We found that first, spectators rated the experience of watching dance without music significantly different from with music. Second, we found that the higher spectators scored on the Big Five personality factor openness, the more they liked the no-music section. Third, spectators’ physical experience with dance was not linked to their appreciation but was significantly related to high average extravert scores. For the first time, we showed that spectators’ reported entrainment to watching dance movements without music is strongly related to their personality and thus may need to be considered when using dance as a means to investigate action observation processes and esthetic preferences.

Emotional speech synchronizes brains across listeners and engages large-scale dynamic brain networks

Speech provides a powerful means for sharing emotions. Here we implement novel intersubject phase synchronization and whole-brain dynamic connectivity measures to show that networks of brain areas become synchronized across participants who are listening to emotional episodes in spoken narratives. Twenty participants' hemodynamic brain activity was measured with functional magnetic resonance imaging (fMRI) while they listened to 45-s narratives describing unpleasant, neutral, and pleasant events spoken in neutral voice. After scanning, participants listened to the narratives again and rated continuously their feelings of pleasantness–unpleasantness (valence) and of arousal–calmness. Instantaneous intersubject phase synchronization (ISPS) measures were computed to derive both multi-subject voxel-wise similarity measures of hemodynamic activity and inter-area functional dynamic connectivity (seed-based phase synchronization, SBPS). Valence and arousal time series were subsequently used to predict the ISPS and SBPS time series. High arousal was associated with increased ISPS in the auditory cortices and in Broca's area, and negative valence was associated with enhanced ISPS in the thalamus, anterior cingulate, lateral prefrontal, and orbitofrontal cortices. Negative valence affected functional connectivity of fronto-parietal, limbic (insula, cingulum) and fronto-opercular circuitries, and positive arousal affected the connectivity of the striatum, amygdala, thalamus, cerebellum, and dorsal frontal cortex. Positive valence and negative arousal had markedly smaller effects. We propose that high arousal synchronizes the listeners' sound-processing and speech-comprehension networks, whereas negative valence synchronizes circuitries supporting emotional and self-referential processing.

•

We model how emotional speech synchronizes brains across listeners.

•

Participants listened to emotional and neutral narratives during fMRI scan.

•

Arousal synchronized auditory cortices and Broca's area.

•

Valence synchronized limbic system, prefrontal, and orbitofrontal cortices.

•

Valence and arousal triggered distinct patterns of dynamic functional connectivity.

Synchronous brain activity across individuals underlies shared psychological perspectives

For successful communication, we need to understand the external world consistently with others. This task requires sufficiently similar cognitive schemas or psychological perspectives that act as filters to guide the selection, interpretation and storage of sensory information, perceptual objects and events. Here we show that when individuals adopt a similar psychological perspective during natural viewing, their brain activity becomes synchronized in specific brain regions. We measured brain activity with functional magnetic resonance imaging (fMRI) from 33 healthy participants who viewed a 10-min movie twice, assuming once a ‘social’ (detective) and once a ‘non-social’ (interior decorator) perspective to the movie events. Pearson's correlation coefficient was used to derive multisubject voxelwise similarity measures (inter-subject correlations; ISCs) of functional MRI data. We used k-nearest-neighbor and support vector machine classifiers as well as a Mantel test on the ISC matrices to reveal brain areas wherein ISC predicted the participants' current perspective. ISC was stronger in several brain regions—most robustly in the parahippocampal gyrus, posterior parietal cortex and lateral occipital cortex—when the participants viewed the movie with similar rather than different perspectives. Synchronization was not explained by differences in visual sampling of the movies, as estimated by eye gaze. We propose that synchronous brain activity across individuals adopting similar psychological perspectives could be an important neural mechanism supporting shared understanding of the environment.