Intersubject representational similarity analysis reveals individual variations in affective experience when watching erotic movies

Deciphering the neural responses to a naturalistic persuasive message

Effective health promotion may benefit from understanding how persuasion emerges. While earlier research has identified brain regions implicated in persuasion, these studies often relied on event-related analyses and frequently simplified persuasive communications. The present study investigates the neural basis of valuation change induced by a persuasive healthy eating call, employing naturalistic stimuli. Fifty healthy participants performed two blocks of a bidding task, in which they had to bid on sugar-containing, sugar-free, and nonedible products during functional MRI. In between the two blocks, they listened to a persuasive healthy eating call that influenced their bidding behavior. Intriguingly, participants who resisted persuasion exhibited increased synchronization of brain activity during listening in several regions, including default mode network structures. Additionally, intersubject functional connectivity among these brain regions was found to be weaker in persuaded individuals. These results emphasize the individualized nature of processing persuasive messages, challenging conventional interpretations of synchronized neural activity. Our findings support the emerging practice of tailoring persuasive messages in health promotion campaigns.

Microstructural and functional substrates underlying dispositional greed and its link with trait but not state impulsivity

The interplay between personality traits and impulsivity has long been a central theme in psychology and psychiatry. However, the potential association between Greed Personality Traits (GPT) and impulsivity, encompassing both trait and state impulsivity and future time perspective, remains largely unexplored. To address these issues, we employed questionnaires and an inter-temporal choice task to estimate corresponding trait/state impulsivity and collected multi-modal neuroimaging data (resting-state functional imaging: n = 430; diffusion-weighted imaging: n = 426; task-related functional imaging: n = 53) to investigate the underlying microstructural and functional substrates. Behavioral analyses revealed that GPT mediated the association between time perspective (e.g., present fatalism) and trait impulsivity (e.g., motor impulsivity). Functional imaging analyses further identified that brain activation strengths and patterns related to delay length, particularly in the dorsomedial prefrontal cortex, superior parietal lobule, and cerebellum, were associated with GPT. Moreover, individuals with similar levels of greed exhibited analogous spontaneous brain activity patterns, predominantly in the Default Mode Network (DMN), Fronto-Parietal Network (FPN), and Visual Network (VIS). Diffusion imaging analysis observed specific microstructural characteristics in the spinocerebellar/pontocerebellar fasciculus, internal/external capsule, and corona radiata that support the formation of GPT. Furthermore, the corresponding neural activation pattern, spontaneous neural activity pattern, and analogous functional couplings among the aforementioned brain regions mediated the relationships between time perspective and GPT and between GPT and motor impulsivity. These findings provide novel insights into the possible pathway such as time perspective → dispositional greed → impulsivity and uncover their underlying microstructural and functional substrates.

The association between social rewards and anxiety: Links from neurophysiological analysis in virtual reality and social interaction game

Individuals' affective experience can be intricate, influenced by various factors including monetary rewards and social factors during social interaction. However, within this array of factors, divergent evidence has been considered as potential contributors to social anxiety. To gain a better understanding of the specific factors associated with anxiety during social interaction, we combined a social interaction task with neurophysiological recordings obtained through an anxiety-elicitation task conducted in a Virtual Reality (VR) environment. Employing inter-subject representational similarity analysis (ISRSA), we explored the potential linkage between individuals' anxiety neural patterns and their affective experiences during social interaction. Our findings suggest that, after controlling for other factors, the influence of the partner's emotional cues on individuals' affective experiences is specifically linked to their neural pattern of anxiety. This indicates that the emergence of anxiety during social interaction may be particularly associated with the emotional cues provided by the social partner, rather than individuals' own reward or prediction errors during social interaction. These results provide further support for the cognitive theory of social anxiety and extend the application of VR in future cognitive and affective studies.

High-level cognition is supported by information-rich but compressible brain activity patterns

To efficiently yet reliably represent and process information, our brains need to produce information-rich signals that differentiate between moments or cognitive states, while also being robust to noise or corruption. For many, though not all, natural systems, these two properties are often inversely related: More information-rich signals are less robust, and vice versa. Here, we examined how these properties change with ongoing cognitive demands. To this end, we applied dimensionality reduction algorithms and pattern classifiers to functional neuroimaging data collected as participants listened to a story, temporally scrambled versions of the story, or underwent a resting state scanning session. We considered two primary aspects of the neural data recorded in these different experimental conditions. First, we treated the maximum achievable decoding accuracy across participants as an indicator of the "informativeness" of the recorded patterns. Second, we treated the number of features (components) required to achieve a threshold decoding accuracy as a proxy for the "compressibility" of the neural patterns (where fewer components indicate greater compression). Overall, we found that the peak decoding accuracy (achievable without restricting the numbers of features) was highest in the intact (unscrambled) story listening condition. However, the number of features required to achieve comparable classification accuracy was also lowest in the intact story listening condition. Taken together, our work suggests that our brain networks flexibly reconfigure according to ongoing task demands and that the activity patterns associated with higher-order cognition and high engagement are both more informative and more compressible than the activity patterns associated with lower-order tasks and lower engagement.

The computational and neural substrates of individual differences in impulsivity under loss framework

Numerous neuroimaging studies have identified significant individual variability in intertemporal choice, often attributed to three neural mechanisms: (1) increased reward circuit activity, (2) decreased cognitive control, and (3) prospection ability. These mechanisms that explain impulsivity, however, have been primarily studied in the gain domain. This study extends this investigation to the loss domain. We employed a hierarchical Bayesian drift-diffusion model (DDM) and the inter-subject representational similarity approach (IS-RSA) to investigate the potential computational neural substrates underlying impulsivity in loss domain across two experiments (n = 155). These experiments utilized a revised intertemporal task that independently manipulated the amounts of immediate and delayed-loss options. Behavioral results demonstrated positive correlations between the drift rate, measured by the DDM, and the impulsivity index K in Exp. 1 (n = 97) and were replicated in Exp. 2 (n = 58). Imaging analyses further revealed that the drift rate significantly mediated the relations between brain properties (e.g., prefrontal cortex activations and gray matter volume in the orbitofrontal cortex and precuneus) and K in Exp. 1. IS-RSA analyses indicated that variability in the drift rate also mediated the associations between inter-subject variations in activation patterns and individual differences in K. These findings suggest that individuals with similar impulsivity levels are likely to exhibit similar value processing patterns, providing a potential explanation for individual differences in impulsivity within a loss framework.

Neural substrates of affective temperaments: An intersubject representational similarity analysis to resting-state functional magnetic resonance imaging in nonclinical subjects

Previous research has suggested that certain types of the affective temperament, including depressive, cyclothymic, hyperthymic, irritable, and anxious, are subclinical manifestations and precursors of mental disorders. However, the neural mechanisms that underlie these temperaments are not fully understood. The aim of this study was to identify the brain regions associated with different affective temperaments. We collected the resting-state functional magnetic resonance imaging (fMRI) data from 211 healthy adults and evaluated their affective temperaments using the Temperament Evaluation of Memphis, Pisa, Paris and San Diego Autoquestionnaire. We used intersubject representational similarity analysis to identify brain regions associated with each affective temperament. Brain regions associated with each affective temperament were detected. These regions included the prefrontal cortex, anterior cingulate cortex (ACC), precuneus, amygdala, thalami, hippocampus, and visual areas. The ACC, lingual gyri, and precuneus showed similar activity across several affective temperaments. The similarity in related brain regions was high among the cyclothymic, irritable, and anxious temperaments, and low between hyperthymic and the other affective temperaments. These findings may advance our understanding of the neural mechanisms underlying affective temperaments and their potential relationship to mental disorders and may have potential implications for personalized treatment strategies for mood disorders.

Comparing the multivariate relationships of conceptual adversity models and structural brain development in adolescent girls: A registered report

Adverse experiences throughout development confer risk for a multitude of negative long-term outcomes, but the processes via which these experiences are neurobiologically embedded are still unclear. Adolescence provides an opportunity to understand how these experiences impact the brain's rapidly changing structure. Two models are central to current adversity conceptualizations: a cumulative risk model, where all types of experiences are combined to represent accumulating stress, and a dimensional model, where certain features of experience (e.g., threat or deprivation) exert unique neurophysiological influence. In this registered report, we extended upon previous research by using a form of representational similarity analysis to examine whether the dimensional and cumulative risk models of adversity predict cortical thinning in frontoparietal and frontotemporal networks and volumetric changes in subcortical regions throughout adolescence. Drawing from a longitudinal sample of 179 adolescent girls (ages 10-13 years at the first wave) from Lane County, Oregon, United States, and up to four waves of follow-up data, we found that operationalizing adversity by similarity in threat and deprivation provided better prediction of brain development than similarity in overall adversity. However, these dimensions do not exhibit unique associations with developmental changes in the hypothesized brain changes. These results underscore the significance of carefully defining adversity and considering its impact on the entire brain. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Vicarious punishment of moral violations in naturalistic drama narratives predicts cortical synchronization

Punishment of moral norm violators is instrumental for human cooperation. Yet, social and affective neuroscience research has primarily focused on second- and third-party norm enforcement, neglecting the neural architecture underlying observed (vicarious) punishment of moral wrongdoers. We used naturalistic television drama as a sampling space for observing outcomes of morally-relevant behaviors to assess how individuals cognitively process dynamically evolving moral actions and their consequences. Drawing on Affective Disposition Theory, we derived hypotheses linking character morality with viewers' neural processing of characters' rewards and punishments. We used functional magnetic resonance imaging (fMRI) to examine neural responses of 28 female participants while free-viewing 15 short story summary video clips of episodes from a popular US television soap opera. Each summary included a complete narrative structure, fully crossing main character behaviors (moral/immoral) and the consequences (reward/punishment) characters faced for their actions. Narrative engagement was examined via intersubject correlation and representational similarity analysis. Highest cortical synchronization in 9 specifically selected regions previously implicated in processing moral information was observed when characters who act immorally are punished for their actions with participants' empathy as an important moderator. The results advance our understanding of the moral brain and the role of normative considerations and character outcomes in viewers' engagement with popular narratives.

Intersubject representational similarity analysis uncovers the impact of state anxiety on brain activation patterns in the human extrastriate cortex

The current study used functional magnetic resonance imaging (fMRI) and showed that state anxiety modulated extrastriate cortex activity in response to emotionally-charged visual images. State anxiety and neuroimaging data from 53 individuals were subjected to an intersubject representational similarity analysis (ISRSA), wherein the geometries between neural and behavioral data were compared. This analysis identified the extrastriate cortex (fusiform gyrus and area MT) to be the sole regions whose activity patterns covaried with state anxiety. Importantly, we show that this brain-behavior association is revealed when treating state anxiety data as a multidimensional response pattern, rather than a single composite score. This suggests that ISRSA using multivariate distances may be more sensitive in identifying the shared geometries between self-report questionnaires and brain imaging data. Overall, our findings demonstrate that a transient state of anxiety may influence how visual information - especially those relevant to the valence dimension - is processed in the extrastriate cortex.

Onscreen presence of instructors in video lectures affects learners' neural synchrony and visual attention during multimedia learning

COVID-19 forced students to rely on online learning using multimedia tools, and multimedia learning continues to impact education beyond the pandemic. In this study, we combined behavioral, eye-tracking, and neuroimaging paradigms to identify multimedia learning processes and outcomes. College students viewed four video lectures including slides with either an onscreen human instructor, an animated instructor, or no onscreen instructor. Brain activity was recorded via fMRI, visual attention was recorded via eye-tracking, and learning outcome was assessed via post-tests. Onscreen presence of instructor, compared with no instructor presence, resulted in superior post-test performance, less visual attention on the slide, more synchronized eye movements during learning, and higher neural synchronization in cortical networks associated with socio-emotional processing and working memory. Individual variation in cognitive and socio-emotional abilities and intersubject neural synchronization revealed different levels of cognitive and socio-emotional processing in different learning conditions. The instructor-present condition evoked increased synchronization, likely reflecting extra processing demands in attentional control, working memory engagement, and socio-emotional processing. Although human instructors and animated instructors led to comparable learning outcomes, the effects were due to the dynamic interplay of information processing vs. attentional distraction. These findings reflect a benefit-cost trade-off where multimedia learning outcome is enhanced only when the cognitive benefits motivated by the social presence of onscreen instructor outweigh the cognitive costs brought about by concurrent attentional distraction unrelated to learning.

Neural signatures of shared subjective affective engagement and disengagement during movie viewing

When watching a negative emotional movie, we differ from person to person in the ease with which we engage and the difficulty with which we disengage throughout a temporally evolving narrative. We investigated neural responses of emotional processing, by considering inter-individual synchronization in subjective emotional engagement and disengagement. The neural underpinnings of these shared responses are ideally studied in naturalistic scenarios like movie viewing, wherein individuals emotionally engage and disengage at their own time and pace throughout the course of a narrative. Despite the rich data that naturalistic designs can bring to the study, there is a challenge in determining time-resolved behavioral markers of subjective engagement and disengagement and their underlying neural responses. We used a within-subject cross-over design instructing 22 subjects to watch clips of either neutral or sad content while undergoing functional magnetic resonance imaging (fMRI). Participants watched the same movies a second time while continuously annotating the perceived emotional intensity, thus enabling the mapping of brain activity and emotional experience. Our analyses revealed that between-participant similarity in waxing (engagement) and waning (disengagement) of emotional intensity was directly related to the between-participant similarity in spatiotemporal patterns of brain activation during the movie(s). Similar patterns of engagement reflected common activation in the bilateral ventromedial prefrontal cortex, regions often involved in self-referenced evaluation and generation of negative emotions. Similar patterns of disengagement reflected common activation in central executive and default mode network regions often involved in top-down emotion regulation. Together this work helps to better understand cognitive and neural mechanisms underpinning engagement and disengagement from emotionally evocative narratives.

Hostile Attribution Bias Shapes Neural Synchrony in the Left Ventromedial Prefrontal Cortex during Ambiguous Social Narratives

Hostile attribution bias refers to the tendency to interpret social situations as intentionally hostile. While previous research has focused on its developmental origins and behavioral consequences, the underlying neural mechanisms remain underexplored. Here, we employed functional near-infrared spectroscopy (fNIRS) to investigate the neural correlates of hostile attribution bias. While undergoing fNIRS, male and female participants listened to and provided attribution ratings for 21 hypothetical scenarios where a character's actions resulted in a negative outcome for the listener. Ratings of hostile intentions were averaged to measure hostile attribution bias. Using intersubject representational similarity analysis, we found that participants with similar levels of hostile attribution bias exhibited higher levels of neural synchrony during narrative listening, suggesting shared interpretations of the scenarios. This effect was localized to the left ventromedial prefrontal cortex (VMPFC) and was particularly prominent in scenarios where the character's intentions were highly ambiguous. We then grouped participants into high and low bias groups based on a median split of their hostile attribution bias scores. A similarity-based classifier trained on the neural data classified participants as having high or low bias with 75% accuracy, indicating that the neural time courses during narrative listening was systematically different between the two groups. Furthermore, hostile attribution bias correlated negatively with attributional complexity, a measure of one's tendency to consider multifaceted causes when explaining behavior. Our study sheds light on the neural mechanisms underlying hostile attribution bias and highlights the potential of using fNIRS to develop nonintrusive and cost-effective neural markers of this sociocognitive bias.

Explorations of using a convolutional neural network to understand brain activations during movie watching

Neuroimaging studies increasingly use naturalistic stimuli like video clips to trigger complex brain activations, but the complexity of such stimuli makes it difficult to assign specific functions to the resulting brain activations, particularly for higher-level content like social interactions. To address this challenge, researchers have turned to deep neural networks, e.g., convolutional neural networks (CNNs). CNNs have shown success in image recognition due to their different levels of features enabling high performance. In this study, we used pre-trained VGG-16, a popular CNN model, to analyze video data and extract hierarchical features from low-level shallow layers to high-level deeper layers, linking these activations to different levels of activation of the human brain. We hypothesized that activations in different layers of VGG-16 would be associated with different levels of brain activation and visual processing hierarchy in the brain. We were also curious about which brain regions would be associated with deeper convolutional layers in VGG-16. The study analyzed a functional MRI (fMRI) dataset where participants watched the cartoon movie Partly Cloudy. Frames of the videos were fed into VGG-16, and activation maps from different kernels and layers were extracted. Time series of the average activation patterns for each kernel were created and fed into a voxel-wise model to study brain activations. Results showed that lower convolutional layers (1st convolutional layer) were mostly associated with lower visual regions, but some kernels (6, 19, 24, 42, 55, and 58) surprisingly showed associations with activations in the posterior cingulate cortex, part of the default mode network. Deeper convolutional layers were associated with more anterior and lateral portions of the visual cortex (e.g., the lateral occipital complex) and the supramarginal gyrus. Analyzing activation features associated with different brain regions showed the promise and limitations of using CNNs to link video content to brain functions.

Exploring the role of mutual prediction in inter-brain synchronization during competitive interactions: an fNIRS hyperscanning investigation

Mutual prediction is crucial for understanding the mediation of bodily actions in social interactions. Despite this importance, limited studies have investigated neurobehavioral patterns under the mutual prediction hypothesis in natural competitive scenarios. To address this gap, our study employed functional near-infrared spectroscopy hyperscanning to examine the dynamics of real-time rock-paper-scissors games using a computerized paradigm with 54 participants. Firstly, our results revealed activations in the right inferior frontal gyrus, bilateral dorsolateral prefrontal cortex, and bilateral frontopolar cortex, each displaying distinct temporal profiles indicative of diverse cognitive processes during the task. Subsequently, a task-related increase in inter-brain synchrony was explicitly identified in the right dorsolateral prefrontal cortex, which supported the mutual prediction hypothesis across the two brains. Moreover, our investigation uncovered a close association between the coherence value in the right dorsolateral prefrontal cortex and the dynamic predictive performances of dyads using inter-subject representational similarity analysis. Finally, heightened inter-brain synchrony values were observed in the right dorsolateral prefrontal cortex before a draw compared to a no-draw scenario in the second block, suggesting that cross-brain signal patterns could be reflected in behavioral responses during competition. In summary, these findings provided initial support for expanding the understanding of cognitive processes underpinning natural competitive engagements.

Uncovering individual variations in bystander intervention of injustice through intrinsic brain connectivity patterns

When confronted with injustice, individuals often intervene as third parties to restore justice by either punishing the perpetrator or helping the victim, even at their own expense. However, little is known about how individual differences in third-party intervention propensity are related to inter-individual variability in intrinsic brain connectivity patterns and how these associations vary between help and punishment intervention. To address these questions, we employed a novel behavioral paradigm in combination with resting-state fMRI and inter-subject representational similarity analysis (IS-RSA). Participants acted as third-party bystanders and needed to decide whether to maintain the status quo or intervene by either helping the disadvantaged recipient (Help condition) or punishing the proposer (Punish condition) at a specific cost. Our analyses focused on three brain networks proposed in the third-party punishment (TPP) model: the salience (e.g., dorsal anterior cingulate cortex, dACC), central executive (e.g., dorsolateral prefrontal cortex, dlPFC), and default mode (e.g., dorsomedial prefrontal cortex, dmPFC; temporoparietal junction, TPJ) networks. IS-RSA showed that individual differences in resting-state functional connectivity (rs-FC) patterns within these networks were associated with the general third-party intervention propensity. Moreover, rs-FC patterns of the right dlPFC and right TPJ were more strongly associated with individual differences in the helping propensity rather than the punishment propensity, whereas the opposite pattern was observed for the dmPFC. Post-hoc predictive modeling confirmed the predictive power of rs-FC in these regions for intervention propensity across individuals. Collectively, these findings shed light on the shared and distinct roles of key regions in TPP brain networks at rest in accounting for individual variations in justice-restoring intervention behaviors.

Neural patterns differentiate traumatic from sad autobiographical memories in PTSD

For people with post-traumatic stress disorder (PTSD), recall of traumatic memories often displays as intrusions that differ profoundly from processing of 'regular' negative memories. These mnemonic features fueled theories speculating a unique cognitive state linked with traumatic memories. Yet, to date, little empirical evidence supports this view. Here we examined neural activity of patients with PTSD who were listening to narratives depicting their own memories. An intersubject representational similarity analysis of cross-subject semantic content and neural patterns revealed a differentiation in hippocampal representation by narrative type: semantically similar, sad autobiographical memories elicited similar neural representations across participants. By contrast, within the same individuals, semantically similar trauma memories were not represented similarly. Furthermore, we were able to decode memory type from hippocampal multivoxel patterns. Finally, individual symptom severity modulated semantic representation of the traumatic narratives in the posterior cingulate cortex. Taken together, these findings suggest that traumatic memories are an alternative cognitive entity that deviates from memory per se.

Synchronized affect in shared experiences strengthens social connection

People structure their days to experience events with others. We gather to eat meals, watch TV, and attend concerts together. What constitutes a shared experience and how does it manifest in dyadic behavior? The present study investigates how shared experiences-measured through emotional, motoric, physiological, and cognitive alignment-promote social bonding. We recorded the facial expressions and electrodermal activity (EDA) of participants as they watched four episodes of a TV show for a total of 4 h with another participant. Participants displayed temporally synchronized and spatially aligned emotional facial expressions and the degree of synchronization predicted the self-reported social connection ratings between viewing partners. We observed a similar pattern of results for dyadic physiological synchrony measured via EDA and their cognitive impressions of the characters. All four of these factors, temporal synchrony of positive facial expressions, spatial alignment of expressions, EDA synchrony, and character impression similarity, contributed to a latent factor of a shared experience that predicted social connection. Our findings suggest that the development of interpersonal affiliations in shared experiences emerges from shared affective experiences comprising synchronous processes and demonstrate that these complex interpersonal processes can be studied in a holistic and multi-modal framework leveraging naturalistic experimental designs.

Dimensional emotions are represented by distinct topographical brain networks

The ability to recognize others' facial emotions has become increasingly important after the COVID-19 pandemic, which causes stressful situations in emotion regulation. Considering the importance of emotion in maintaining a social life, emotion knowledge to perceive and label emotions of oneself and others requires an understanding of affective dimensions, such as emotional valence and emotional arousal. However, limited information is available about whether the behavioral representation of affective dimensions is similar to their neural representation. To explore the relationship between the brain and behavior in the representational geometries of affective dimensions, we constructed a behavioral paradigm in which emotional faces were categorized into geometric spaces along the valence, arousal, and valence and arousal dimensions. Moreover, we compared such representations to neural representations of the faces acquired by functional magnetic resonance imaging. We found that affective dimensions were similarly represented in the behavior and brain. Specifically, behavioral and neural representations of valence were less similar to those of arousal. We also found that valence was represented in the dorsolateral prefrontal cortex, frontal eye fields, precuneus, and early visual cortex, whereas arousal was represented in the cingulate gyrus, middle frontal gyrus, orbitofrontal cortex, fusiform gyrus, and early visual cortex. In conclusion, the current study suggests that dimensional emotions are similarly represented in the behavior and brain and are presented with differential topographical organizations in the brain.

Enhanced neural synchrony associated with long-term ballroom dance training

Long-term dance training offers numerous benefits, including improvements in physical health, posture, body coordination, and mental health and well-being. Since dance is an art form of body-to-body communication, professional dancers may share feelings and thoughts on dance with their partners, owing to their shared training experiences. Considering this perspective, one may expect that professional dancers would demonstrate pronounced neural similarities when viewing dancing videos, which could be associated with their training duration. To test these hypotheses, we collected functional magnetic resonance imaging (fMRI) data while presenting ballroom dancing and neutral video clips with long durations (∼100 s each) to 41 professional ballroom dancers (19 pairs of dance partners) and 39 age- and sex-matched nondancers. Our findings revealed that dancers exhibited broader and stronger neural similarities across the whole brain when watching dancing video clips, as compared to the control group. These increased neural similarities could be interpreted in at least two distinct ways. First, neural similarities in certain brain regions within the motor control circuit (i.e., frontal cortical-basal ganglia-thalamic circuit) were significantly correlated with dance-related information (e.g., dance partners' cooperation duration), which reinforced the impact of long-term dance training on neural synchronization. Second, neural similarities in other brain regions (e.g., memory-related brain regions) were significantly correlated with subjects' impression of the viewed videos (i.e., whether they have watched before, familiarity, and liking), which may not necessarily be directly linked to long-term dance training. Altogether, our study provided solid evidence for synchronized neural mechanisms in professional dancers due to long-term dance training.

Anxiety Shapes Amygdala-Prefrontal Dynamics During Movie Watching

Background

A well-characterized amygdala-dorsomedial prefrontal circuit is thought to be crucial for threat vigilance during anxiety. However, engagement of this circuitry within relatively naturalistic paradigms remains unresolved.

Methods

Using an open functional magnetic resonance imaging dataset (Cambridge Centre for Ageing Neuroscience; n = 630), we sought to investigate whether anxiety correlates with dynamic connectivity between the amygdala and dorsomedial prefrontal cortex during movie watching.

Results

Using an intersubject representational similarity approach, we saw no effect of anxiety when comparing pairwise similarities of dynamic connectivity across the entire movie. However, preregistered analyses demonstrated a relationship between anxiety, amygdala-prefrontal dynamics, and anxiogenic features of the movie (canonical suspense ratings). Our results indicated that amygdala-prefrontal circuitry was modulated by suspense in low-anxiety individuals but was less sensitive to suspense in high-anxiety individuals. We suggest that this could also be related to slowed habituation or amplified anticipation. Moreover, a measure of threat-relevant attentional bias (accuracy/reaction time to fearful faces) demonstrated an association with connectivity and suspense.

Conclusions

Overall, this study demonstrated the presence of anxiety-relevant differences in connectivity during movie watching, varying with anxiogenic features of the movie. Mechanistically, exactly how and when these differences arise remains an opportunity for future research.

Integrating media content analysis, reception analysis, and media effects studies

Every day, the world of media is at our fingertips, whether it is watching movies, listening to the radio, or browsing online media. On average, people spend over 8 h per day consuming messages from the mass media, amounting to a total lifetime dose of more than 20 years in which conceptual content stimulates our brains. Effects from this flood of information range from short-term attention bursts (e.g., by breaking news features or viral 'memes') to life-long memories (e.g., of one's favorite childhood movie), and from micro-level impacts on an individual's memory, attitudes, and behaviors to macro-level effects on nations or generations. The modern study of media's influence on society dates back to the 1940s. This body of mass communication scholarship has largely asked, "what is media's effect on the individual?" Around the time of the cognitive revolution, media psychologists began to ask, "what cognitive processes are involved in media processing?" More recently, neuroimaging researchers started using real-life media as stimuli to examine perception and cognition under more natural conditions. Such research asks: "what can media tell us about brain function?" With some exceptions, these bodies of scholarship often talk past each other. An integration offers new insights into the neurocognitive mechanisms through which media affect single individuals and entire audiences. However, this endeavor faces the same challenges as all interdisciplinary approaches: Researchers with different backgrounds have different levels of expertise, goals, and foci. For instance, neuroimaging researchers label media stimuli as "naturalistic" although they are in many ways rather artificial. Similarly, media experts are typically unfamiliar with the brain. Neither media creators nor neuroscientifically oriented researchers approach media effects from a social scientific perspective, which is the domain of yet another species. In this article, we provide an overview of approaches and traditions to studying media, and we review the emerging literature that aims to connect these streams. We introduce an organizing scheme that connects the causal paths from media content → brain responses → media effects and discuss network control theory as a promising framework to integrate media content, reception, and effects analyses.

Every individual makes a difference: A trinity derived from linking individual brain morphometry, connectivity and mentalising ability

Mentalising ability, indexed as the ability to understand others' beliefs, feelings, intentions, thoughts and traits, is a pivotal and fundamental component of human social cognition. However, considering the multifaceted nature of mentalising ability, little research has focused on characterising individual differences in different mentalising components. And even less research has been devoted to investigating how the variance in the structural and functional patterns of the amygdala and hippocampus, two vital subcortical regions of the "social brain", are related to inter-individual variability in mentalising ability. Here, as a first step toward filling these gaps, we exploited inter-subject representational similarity analysis (IS-RSA) to assess relationships between amygdala and hippocampal morphometry (surface-based multivariate morphometry statistics, MMS), connectivity (resting-state functional connectivity, rs-FC) and mentalising ability (interactive mentalisation questionnaire [IMQ] scores) across the participants ( N = 24 $$ N=24 $$ ). In IS-RSA, we proposed a novel pipeline, that is, computing patching and pooling operations-based surface distance (CPP-SD), to obtain a decent representation for high-dimensional MMS data. On this basis, we found significant correlations (i.e., second-order isomorphisms) between these three distinct modalities, indicating that a trinity existed in idiosyncratic patterns of brain morphometry, connectivity and mentalising ability. Notably, a region-related mentalising specificity emerged from these associations: self-self and self-other mentalisation are more related to the hippocampus, while other-self mentalisation shows a closer link with the amygdala. Furthermore, by utilising the dyadic regression analysis, we observed significant interactions such that subject pairs with similar morphometry had even greater mentalising similarity if they were also similar in rs-FC. Altogether, we demonstrated the feasibility and illustrated the promise of using IS-RSA to study individual differences, deepening our understanding of how individual brains give rise to their mentalising abilities.

Social navigation modulates the anterior and posterior hippocampal circuits in the resting brain

Social navigation is a dynamic and complex process that requires the collaboration of multiple brain regions. However, the neural networks for navigation in a social space remain largely unknown. This study aimed to investigate the role of hippocampal circuit in social navigation from a resting-state fMRI data. Here, resting-state fMRI data were acquired before and after participants performed a social navigation task. By taking the anterior and posterior hippocampus (HPC) as the seeds, we calculated their connectivity with the whole brain using the seed-based static functional connectivity (sFC) and dynamic FC (dFC) approaches. We found that the sFC and dFC between the anterior HPC and supramarginal gyrus, sFC or dFC between posterior HPC and middle cingulate cortex, inferior parietal gyrus, angular gyrus, posterior cerebellum, medial superior frontal gyrus were increased after the social navigation task. These alterations were related to social cognition of tracking location in the social navigation. Moreover, participants who had more social support or less neuroticism showed a greater increase in hippocampal connectivity. These findings may highlight a more important role of the posterior hippocampal circuit in the social navigation, which is crucial for social cognition.

Biasing the neurocognitive processing of videos with the presence of a real cultural other

In the digital age, while short videos present vital events with powerful information, the presence of cultural cues may bias our processing of videos of foreign cultures. However, the underlying neurocognitive processes remain unclear. In this study, we hypothesized that cultural cues might bias video processing by either enhancing cultural perspective-taking or shifting cultural self-schema. To test these hypotheses, we used a novel paradigm in which the cultural cue was a real cultural other (the priming participants) who watched American/Chinese videos together with the primed participants. The results showed that when the cue was present, the right temporoparietal junction (rTPJ) response to videos with other cultural content was shifted, showing a priming effect. Moreover, the activity pattern in the rTPJ was more congruent with the primed culture than with the original culture, reflecting a neural biasing effect. Finally, intersubject representational similarity analysis indicated that the neural biasing effect in the rTPJ was more closely associated with cultural perspective-taking than with cultural self-schema. In summary, these findings support the perspective-taking hypothesis, suggesting that cultural cues can significantly bias our cultural mindset by altering cultural perspective-taking when we are exposed to culture-relevant naturalistic stimuli.

The optimal balance of controlled and spontaneous processing in insight problem solving: fMRI evidence from Chinese idiom guessing

Cognitive control is a key factor in insight generation. However, the neurocognitive mechanisms underlying the generation of insight for different cognitive control remain poorly understood. This study developed a parametric fMRI design, wherein hints for solving Chinese idiom riddles were gradually provided in a stepwise manner (from the first hint, H1, to the final hint, H4). By classifying the step-specific items solved in different hint-uncovering steps/conditions, we could identify insightful responses for different levels of spontaneous or controlled processing. At the behavioral level, the number of insightful problem solving trials reached the maximum at a intermediate level of the cognitively controlled processing and the spontaneously idea generating in H3, while the bilateral insular cortex and thalamus showed the robust engagement, implying the function of these regions in making the optimal balance between external hint processing and internal generated ideas. In addition, we identified brain areas, including the dorsolateral prefrontal cortex (dlPFC), angular gyrus (AG), dorsal anterior cingulate cortex (dACC), and precuneus (PreC), whose activities were parametrically increased with the levels of controlled (from H1 to H4) insightful processing which were increasingly produced by the sequentially revealed hints. Further representational similarity analysis (RSA) found that spontaneous processing in insight featured greater within-condition representational variabilities in widely distributed regions in the executive, salience, and default networks. Altogether, the present study provided new evidence for the relationship between the process of cognitive control and that of spontaneous idea generation in insight problem solving and demystified the function of the insula and thalamus as an interactive interface for the optimal balance of these two processes.

The role of the parahippocampal cortex in landmark-based distance estimation based on the contextual hypothesis

Parahippocampal cortex (PHC) is a vital neural bases in spatial navigation. However, its functional role is still unclear. "Contextual hypothesis," which assumes that the PHC participates in processing the spatial association between the landmark and destination, provides a potential answer to the question. Nevertheless, the hypothesis was previously tested using the picture categorization task, which is indirectly related to spatial navigation. By now, study is still needed for testing the hypothesis with a navigation-related paradigm. In the current study, we tested the hypothesis by an fMRI experiment in which participants performed a distance estimation task in a virtual environment under three different conditions: landmark free (LF), stable landmark (SL), and ambiguous landmark (AL). By analyzing the behavioral data, we found that the presence of an SL improved the participants' performance in distance estimation. Comparing the brain activity in SL-versus-LF contrast as well as AL-versus-LF contrast, we found that the PHC was activated by the SL rather than by AL when encoding the distance. This indicates that the PHC is elicited by strongly associated context and encodes the landmark reference for distance perception. Furthermore, accessing the representational similarity with the activity of the PHC across conditions, we observed a high similarity within the same condition but low similarity between conditions. This result indicated that the PHC sustains the contextual information for discriminating between scenes. Our findings provided insights into the neural correlates of the landmark information processing from the perspective of contextual hypothesis.

Individual uniqueness in trust profiles and well‐being: Understanding the role of cultural tightness–looseness from a representation similarity perspective

This paper provides a unique perspective for understanding cultural differences: representation similarity-a computational technique that uses pairwise comparisons of units to reveal their representation in higher-order space. By combining individual-level measures of trust across domains and well-being from 13,823 participants across 15 nations with a measure of society-level tightness-looseness, we found that any two countries with more similar tightness-looseness tendencies exhibit higher degrees of representation similarity in national interpersonal trust profiles. Although each individual's trust profile is generally similar to their nation's trust profile, the greater similarity between an individual's and their society's trust profile predicted a higher level of individual life satisfaction only in loose cultures but not in tight cultures. Using the framework of representation similarity to explore cross-cultural differences from a multidimensional, multi-national perspective provide a comprehensive picture of how culture is related to the human activities.

Morphological similarity of amygdala-ventral prefrontal pathways represents trait anxiety in younger and older adults

Stronger amygdala-ventral prefrontal white matter connectivity has been associated with lower trait anxiety, possibly reflecting an increased capacity for efficient communication between the two regions. However, there are also reports arguing against this brain-anxiety association. To address these inconsistencies in the literature, we tested the possibility that idiosyncratic tract morphology may account for meaningful individual differences in trait anxiety, even among those with comparable microstructural integrity. Here, we adopted intersubject representational similarity analysis, an analytic framework that captures multivariate patterns of similarity, to analyze the morphological similarity of amygdala-ventral prefrontal pathways. Data drawn from the Leipzig Study for Mind-Body-Emotion Interactions dataset showed that younger adults (20 to 35 y of age) with low trait anxiety, in contrast to trait-anxious individuals, had consistently similar morphological configurations in their left amygdala-ventral prefrontal pathways. Additional tests on an independent sample of older adults (60 to 75 y of age) validated this finding. Our study reveals a generalizable pattern of brain-anxiety association that is embedded within the shared geometries between fiber tract morphology and trait anxiety data.

Functional connectivity of cortical resting-state networks is differentially affected by rest conditions

Optimal conditions for resting-state functional magnetic resonance imaging (rs-fMRI) are still highly debated. Here, we comprehensively assessed the effects of various rest conditions on all cortical resting-state networks (RSNs) defined by an established atlas. Twenty-two healthy college students (22 ± 4 years old, 12 females) were scanned on a GE 3T MRI scanner. Rs-fMRI datasets were collected under four different conditions for each subject: (1) eyes open in dim light (Eyes-Open), (2) eyes closed and awake (Eyes-Closed), (3) eyes closed while remembering four numbers through the scan session (Eyes-Closed-Number) and (4) asked to watch a movie (Movie). We completed a thorough examination of the 17 functional RSNs defined by Yeo and colleagues. Importantly, the movie led to changes in global connectivity and should be avoided as a rest condition. Conversely, there were no significant connectivity differences between conditions within the frontoparietal control and limbic networks and the following subnetworks as defined by Yeo et al.: default-B, dorsal-attention-B and salience/ventral-attention-B. These were not even significant when compared to the highly stimulative Movie condition. A significant difference was not found between Eyes-Closed and Eyes-Closed-Number conditions in whole-brain, within-network and between-network comparisons. When considering other rest conditions, however, we observed connectivity changes in some subnetworks, including those of the default-mode network. Overall, we found conditions with more external stimulation led to more changes in functional connectivity during rs-fMRI. In conclusion, the comprehensive results of our study can aid in choosing rest conditions for the study of overall and specific functional networks.

Individual variation in the neurophysiological representation of negative emotions in virtual reality is shaped by sociability

Negative emotions play a dominant role in daily human life, and mentalizing and empathy are also basic sociability in social life. However, little is known regards the neurophysiological pattern of negative experiences in immersive environments and how people with different sociabilities respond to the negative emotional stimuli at behavioral and neural levels. The present study investigated the neurophysiological representation of negative affective experiences and whether such variations are associated with one's sociability. To address this question, we examined four types of negative emotions that frequently occurred in real life: angry, anxious, fearful, and helpless. We combined naturalistic neuroimaging under virtual reality, multimodal neurophysiological recording, and behavioral measures. Inter-subject representational similarity analysis was conducted to capture the individual differences in the neurophysiological representations of negative emotional experiences. The behavioral and neurophysiological indices revealed that although the emotion ratings were uniquely different, a similar electroencephalography response pattern across these negative emotions was found over the parieto-occipital electrodes. Furthermore, the neurophysiological representations indeed reflected interpersonal variations regarding mentalizing and empathic abilities. Our findings yielded a common pattern of neurophysiological responses toward different negative affective experiences in VR. Moreover, the current results indicate the potential of taking a sociability perspective for understanding the interpersonal variations in the neurophysiological representation of emotion.

Inferring Brain State Dynamics Underlying Naturalistic Stimuli Evoked Emotion Changes With dHA-HMM

The brain functional mechanisms underlying emotional changes have been primarily studied based on the traditional task design with discrete and simple stimuli. However, the brain state transitions when exposed to continuous and naturalistic stimuli with rich affection variations remain poorly understood. This study proposes a dynamic hyperalignment algorithm (dHA) to functionally align the inter-subject neural activity. The hidden Markov model (HMM) was used to study how the brain dynamics responds to emotion during long-time movie-viewing activity. The results showed that dHA significantly improved inter-subject consistency and allowed more consistent temporal HMM states across participants. Afterward, grouping the emotions in a clustering dendrogram revealed a hierarchical grouping of the HMM states. Further emotional sensitivity and specificity analyses of ordered states revealed the most significant differences in happiness and sadness. We then compared the activation map in HMM states during happiness and sadness and found significant differences in the whole brain, but strong activation was observed during both in the superior temporal gyrus, which is related to the early process of emotional prosody processing. A comparison of the inter-network functional connections indicates unique functional connections of the memory retrieval and cognitive network with the cerebellum network during happiness. Moreover, the persistent bilateral connections among salience, cognitive, and sensorimotor networks during sadness may reflect the interaction between high-level cognitive networks and low-level sensory networks. The main results were verified by the second session of the dataset. All these findings enrich our understanding of the brain states related to emotional variation during naturalistic stimuli.

Behavioral Studies Using Large-Scale Brain Networks – Methods and Validations

Mapping human behaviors to brain activity has become a key focus in modern cognitive neuroscience. As methods such as functional MRI (fMRI) advance cognitive scientists show an increasing interest in investigating neural activity in terms of functional connectivity and brain networks, rather than activation in a single brain region. Due to the noisy nature of neural activity, determining how behaviors are associated with specific neural signals is not well-established. Previous research has suggested graph theory techniques as a solution. Graph theory provides an opportunity to interpret human behaviors in terms of the topological organization of brain network architecture. Graph theory-based approaches, however, only scratch the surface of what neural connections relate to human behavior. Recently, the development of data-driven methods, e.g., machine learning and deep learning approaches, provide a new perspective to study the relationship between brain networks and human behaviors across the whole brain, expanding upon past literatures. In this review, we sought to revisit these data-driven approaches to facilitate our understanding of neural mechanisms and build models of human behaviors. We start with the popular graph theory approach and then discuss other data-driven approaches such as connectome-based predictive modeling, multivariate pattern analysis, network dynamic modeling, and deep learning techniques that quantify meaningful networks and connectivity related to cognition and behaviors. Importantly, for each topic, we discuss the pros and cons of the methods in addition to providing examples using our own data for each technique to describe how these methods can be applied to real-world neuroimaging data.

Neural signatures associated with temporal compression in the verbal retelling of past events

When we retell our past experiences, we aim to reproduce some version of the original events; this reproduced version is often temporally compressed relative to the original. However, it is currently unclear how this compression manifests in brain activity. One possibility is that a compressed retrieved memory manifests as a neural pattern which is more dissimilar to the original, relative to a more detailed or vivid memory. However, we argue that measuring raw dissimilarity alone is insufficient, as it confuses a variety of interesting and uninteresting changes. To address this problem, we examine brain pattern changes that are consistent across people. We show that temporal compression in individuals’ retelling of past events predicts systematic encoding-to-recall transformations in several higher associative regions. These findings elucidate how neural representations are not simply reactivated, but can also be transformed due to temporal compression during a universal form of human memory expression: verbal retelling.

Brain patterns measured while participants first watched a movie in the fMRI scanner, then recalled the movie’s key narrative features, demonstrate that temporal compression in individuals’ retelling of past events predicts encoding-to-recall transformations.

The polarized mind in context: Interdisciplinary approaches to the psychology of political polarization

Existing research into the psychological roots of political polarization centers around two main approaches: one studying cognitive traits that predict susceptibility to holding polarized beliefs and one studying contextual influences that spread and reinforce polarized attitudes. Although both accounts have made valuable progress, political polarization is neither a purely cognitive trait nor a contextual issue. We argue that a new approach aiming to uncover interactions between cognition and context will be fruitful for understanding how polarization arises. Furthermore, recent developments in neuroimaging methods can overcome long-standing issues of measurement and ecological validity to critically help identify in which psychological processing steps-e.g., attention, semantic understanding, emotion-polarization takes hold. This interdisciplinary research agenda can thereby provide new avenues for interventions against the political polarization that plagues democracies around the world. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Anxiety and amygdala connectivity during movie-watching

Rodent and human studies have implicated an amygdala-prefrontal circuit during threat processing. One possibility is that while amygdala activity underlies core features of anxiety (e.g. detection of salient information), prefrontal cortices (i.e. dorsomedial prefrontal/anterior cingulate cortex) entrain its responsiveness. To date, this has been established in tightly controlled paradigms (predominantly using static face perception tasks) but has not been extended to more naturalistic settings. Consequently, using ‘movie fMRI’—in which participants watch ecologically-rich movie stimuli rather than constrained cognitive tasks—we sought to test whether individual differences in anxiety correlate with the degree of face-dependent amygdala-prefrontal coupling in two independent samples. Analyses suggested increased face-dependent superior parietal activation and decreased speech-dependent auditory cortex activation as a function of anxiety. However, we failed to find evidence for anxiety-dependent connectivity, neither in our stimulus-dependent or -independent analyses. Our findings suggest that work using experimentally constrained tasks may not replicate in more ecologically valid settings and, moreover, highlight the importance of testing the generalizability of neuroimaging findings outside of the original context.

•

Using ‘movie fMRI’, we tested whether trait anxiety correlates with face-dependent amygdala-prefrontal coupling.

•

We observed altered superior parietal activation to faces and auditory cortex activation to speech as a function of anxiety.

•

We failed to find evidence for anxiety-dependent amygdala-dmPFC connectivity in stimulus-dependent or -independent analyses.

•

Our findings highlight the importance of testing the generalizability of neuroimaging findings outside of the original context.

Functional selectivity for social interaction perception in the human superior temporal sulcus during natural viewing

Recognizing others' social interactions is a crucial human ability. Using simple stimuli, previous studies have shown that social interactions are selectively processed in the superior temporal sulcus (STS), but prior work with movies has suggested that social interactions are processed in the medial prefrontal cortex (mPFC), part of the theory of mind network. It remains unknown to what extent social interaction selectivity is observed in real world stimuli when controlling for other covarying perceptual and social information, such as faces, voices, and theory of mind. The current study utilizes a functional magnetic resonance imaging (fMRI) movie paradigm and advanced machine learning methods to uncover the brain mechanisms uniquely underlying naturalistic social interaction perception. We analyzed two publicly available fMRI datasets, collected while both male and female human participants (n = 17 and 18) watched two different commercial movies in the MRI scanner. By performing voxel-wise encoding and variance partitioning analyses, we found that broad social-affective features predict neural responses in social brain regions, including the STS and mPFC. However, only the STS showed robust and unique selectivity specifically to social interactions, independent from other covarying features. This selectivity was observed across two separate fMRI datasets. These findings suggest that naturalistic social interaction perception recruits dedicated neural circuity in the STS, separate from the theory of mind network, and is a critical dimension of human social understanding.

Personality network neuroscience: Promises and challenges on the way toward a unifying framework of individual variability

We propose that the application of network theory to established psychological personality conceptions has great potential to advance a biologically plausible model of human personality. Stable behavioral tendencies are conceived as personality “traits.” Such traits demonstrate considerable variability between individuals, and extreme expressions represent risk factors for psychological disorders. Although the psychometric assessment of personality has more than hundred years tradition, it is not yet clear whether traits indeed represent “biophysical entities” with specific and dissociable neural substrates. For instance, it is an open question whether there exists a correspondence between the multilayer structure of psychometrically derived personality factors and the organizational properties of traitlike brain systems. After a short introduction into fundamental personality conceptions, this article will point out how network neuroscience can enhance our understanding about human personality. We will examine the importance of intrinsic (task-independent) brain connectivity networks and show means to link brain features to stable behavioral tendencies. Questions and challenges arising from each discipline itself and their combination are discussed and potential solutions are developed. We close by outlining future trends and by discussing how further developments of network neuroscience can be applied to personality research.

Taking a Computational Cultural Neuroscience Approach to Study Parent-Child Similarities in Diverse Cultural Contexts

Parent-child similarities and discrepancies at multiple levels provide a window to understand the cultural transmission process. Although prior research has examined parent-child similarities at the belief, behavioral, and physiological levels across cultures, little is known about parent-child similarities at the neural level. The current review introduces an interdisciplinary computational cultural neuroscience approach, which utilizes computational methods to understand neural and psychological processes being involved during parent-child interactions at intra- and inter-personal level. This review provides three examples, including the application of intersubject representational similarity analysis to analyze naturalistic neuroimaging data, the usage of computer vision to capture non-verbal social signals during parent-child interactions, and unraveling the psychological complexities involved during real-time parent-child interactions based on their simultaneous recorded brain response patterns. We hope that this computational cultural neuroscience approach can provide researchers an alternative way to examine parent-child similarities and discrepancies across different cultural contexts and gain a better understanding of cultural transmission processes.

Common functional localizers to enhance NHP & cross-species neuroscience imaging research

Functional localizers are invaluable as they can help define regions of interest, provide cross-study comparisons, and most importantly, allow for the aggregation and meta-analyses of data across studies and laboratories. To achieve these goals within the non-human primate (NHP) imaging community, there is a pressing need for the use of standardized and validated localizers that can be readily implemented across different groups. The goal of this paper is to provide an overview of the value of localizer protocols to imaging research and we describe a number of commonly used or novel localizers within NHPs, and keys to implement them across studies. As has been shown with the aggregation of resting-state imaging data in the original PRIME-DE submissions, we believe that the field is ready to apply the same initiative for task-based functional localizers in NHP imaging. By coming together to collect large datasets across research group, implementing the same functional localizers, and sharing the localizers and data via PRIME-DE, it is now possible to fully test their robustness, selectivity and specificity. To do this, we reviewed a number of common localizers and we created a repository of well-established localizer that are easily accessible and implemented through the PRIME-RE platform.

Naturalistic Stimuli in Affective Neuroimaging: A Review

Naturalistic stimuli such as movies, music, and spoken and written stories elicit strong emotions and allow brain imaging of emotions in close-to-real-life conditions. Emotions are multi-component phenomena: relevant stimuli lead to automatic changes in multiple functional components including perception, physiology, behavior, and conscious experiences. Brain activity during naturalistic stimuli reflects all these changes, suggesting that parsing emotion-related processing during such complex stimulation is not a straightforward task. Here, I review affective neuroimaging studies that have employed naturalistic stimuli to study emotional processing, focusing especially on experienced emotions. I argue that to investigate emotions with naturalistic stimuli, we need to define and extract emotion features from both the stimulus and the observer.

Movie-watching outperforms rest for functional connectivity-based prediction of behavior

A major goal of human neuroscience is to relate differences in brain function to differences in behavior across people. Recent work has established that whole-brain functional connectivity patterns are relatively stable within individuals and unique across individuals, and that features of these patterns predict various traits. However, while functional connectivity is most often measured at rest, certain tasks may enhance individual signals and improve sensitivity to behavior differences. Here, we show that compared to the resting state, functional connectivity measured during naturalistic viewing—i.e., movie watching—yields more accurate predictions of trait-like phenotypes in the domains of both cognition and emotion. Traits could be predicted using less than three minutes of data from single video clips, and clips with highly social content gave the most accurate predictions. Results suggest that naturalistic stimuli amplify individual differences in behaviorally relevant brain networks.

Endogenous variation in ventromedial prefrontal cortex state dynamics during naturalistic viewing reflects affective experience

How we process ongoing experiences is shaped by our personal history, current needs, and future goals. Consequently, ventromedial prefrontal cortex (vmPFC) activity involved in processing these subjective appraisals appears to be highly idiosyncratic across individuals. To elucidate the role of the vmPFC in processing our ongoing experiences, we developed a computational framework and analysis pipeline to characterize the spatiotemporal dynamics of individual vmPFC responses as participants viewed a 45-minute television drama. Through a combination of functional magnetic resonance imaging, facial expression tracking, and self-reported emotional experiences across four studies, our data suggest that the vmPFC slowly transitions through a series of discretized states that broadly map onto affective experiences. Although these transitions typically occur at idiosyncratic times across people, participants exhibited a marked increase in state alignment during high affectively valenced events in the show. Our work suggests that the vmPFC ascribes affective meaning to our ongoing experiences.

The default mode network: where the idiosyncratic self meets the shared social world

The default mode network (DMN) is classically considered an 'intrinsic' system, specializing in internally oriented cognitive processes such as daydreaming, reminiscing and future planning. In this Perspective, we suggest that the DMN is an active and dynamic 'sense-making' network that integrates incoming extrinsic information with prior intrinsic information to form rich, context-dependent models of situations as they unfold over time. We review studies that relied on naturalistic stimuli, such as stories and movies, to demonstrate how an individual's DMN neural responses are influenced both by external information accumulated as events unfold over time and by the individual's idiosyncratic past memories and knowledge. The integration of extrinsic and intrinsic information over long timescales provides a space for negotiating a shared neural code, which is necessary for establishing shared meaning, shared communication tools, shared narratives and, above all, shared communities and social networks.

Multivariate Identification of Functional Neural Networks Underpinning Humorous Movie Viewing

While univariate functional magnetic resonance imaging (fMRI) data analysis methods have been utilized successfully to map brain areas associated with cognitive and emotional functions during viewing of naturalistic stimuli such as movies, multivariate methods might provide the means to study how brain structures act in concert as networks during free viewing of movie clips. Here, to achieve this, we generalized the partial least squares (PLS) analysis, based on correlations between voxels, experimental conditions, and behavioral measures, to identify large-scale neuronal networks activated during the first time and repeated watching of three ∼5-min comedy clips. We identified networks that were similarly activated across subjects during free viewing of the movies, including the ones associated with self-rated experienced humorousness that were composed of the frontal, parietal, and temporal areas acting in concert. In conclusion, the PLS method seems to be well suited for the joint analysis of multi-subject neuroimaging and behavioral data to quantify a functionally relevant brain network activity without the need for explicit temporal models.

Multivariate spatial feature selection in fMRI

Multivariate neuroimaging analyses constitute a powerful class of techniques to identify psychological representations. However, not all psychological processes are represented at the same spatial scale throughout the brain. This heterogeneity is apparent when comparing hierarchically organized local representations of perceptual processes to flexible transmodal representations of more abstract cognitive processes such as social and affective operations. An open question is how the spatial scale of analytic approaches interacts with the spatial scale of the representations under investigation. In this article, we describe how multivariate analyses can be viewed as existing on a spatial spectrum, anchored by searchlights used to identify locally distributed patterns of information on one end, whole brain approach used to identify diffuse neural representations at the other and region-based approaches in between. We describe how these distinctions are an important and often overlooked analytic consideration and provide heuristics to compare these different techniques to choose based on the analyst’s inferential goals.

Neural reference groups: a synchrony-based classification approach for predicting attitudes using fNIRS

Social neuroscience research has demonstrated that those who are like-minded are also 'like-brained.' Studies have shown that people who share similar viewpoints have greater neural synchrony with one another, and less synchrony with people who 'see things differently.' Although these effects have been demonstrated at the 'group level,' little work has been done to predict the viewpoints of specific 'individuals' using neural synchrony measures. Furthermore, the studies that have made predictions using synchrony-based classification at the individual level used expensive and immobile neuroimaging equipment (e.g. functional magnetic resonance imaging) in highly controlled laboratory settings, which may not generalize to real-world contexts. Thus, this study uses a simple synchrony-based classification method, which we refer to as the 'neural reference groups' approach, to predict individuals' dispositional attitudes from data collected in a mobile 'pop-up neuroscience' lab. Using functional near-infrared spectroscopy data, we predicted individuals' partisan stances on a sociopolitical issue by comparing their neural timecourses to data from two partisan neural reference groups. We found that partisan stance could be identified at above-chance levels using data from dorsomedial prefrontal cortex. These results indicate that the neural reference groups approach can be used to investigate naturally occurring, dispositional differences anywhere in the world.

Individual Differences in Brain Responses: New Opportunities for Tailoring Health Communication Campaigns

Prevention neuroscience investigates the brain basis of attitude and behavior change. Over the years, an increasingly structurally and functionally resolved "persuasion network" has emerged. However, current studies have only identified a small handful of neural structures that are commonly recruited during persuasive message processing, and the extent to which these (and other) structures are sensitive to numerous individual difference factors remains largely unknown. In this project we apply a multi-dimensional similarity-based individual differences analysis to explore which individual factors-including characteristics of messages and target audiences-drive patterns of brain activity to be more or less similar across individuals encountering the same anti-drug public service announcements (PSAs). We demonstrate that several ensembles of brain regions show response patterns that are driven by a variety of unique factors. These results are discussed in terms of their implications for neural models of persuasion, prevention neuroscience and message tailoring, and methodological implications for future research.

Mapping neural activity patterns to contextualized fearful facial expressions onto callous-unemotional (CU) traits: intersubject representational similarity analysis reveals less variation among high-CU adolescents

Callous-unemotional (CU) traits are early-emerging personality features characterized by deficits in empathy, concern for others, and remorse following social transgressions. One of the interpersonal deficits most consistently associated with CU traits is impaired behavioral and neurophysiological responsiveness to fearful facial expressions. However, the facial expression paradigms traditionally employed in neuroimaging are often ambiguous with respect to the nature of threat (i.e., is the perceiver the threat, or is something else in the environment?). In the present study, 30 adolescents with varying CU traits viewed fearful facial expressions cued to three different contexts ("afraid for you," "afraid of you," "afraid for self") while undergoing functional magnetic resonance imaging (fMRI). Univariate analyses found that mean right amygdala activity during the "afraid for self" context was negatively associated with CU traits. With the goal of disentangling idiosyncratic stimulus-driven neural responses, we employed intersubject representational similarity analysis to link intersubject similarities in multivoxel neural response patterns to contextualized fearful expressions with differential intersubject models of CU traits. Among low-CU adolescents, neural response patterns while viewing fearful faces were most consistently similar early in the visual processing stream and among regions implicated in affective responding, but were more idiosyncratic as emotional face information moved up the cortical processing hierarchy. By contrast, high-CU adolescents' neural response patterns consistently aligned along the entire cortical hierarchy (but diverged among low-CU youths). Observed patterns varied across contexts, suggesting that interpretations of fearful expressions depend to an extent on neural response patterns and are further shaped by levels of CU traits.

Intersubject Spatial Pattern Correlations During Movie Viewing Are Stimulus-Driven and Nonuniform Across the Cortex

A fundamental step to predicting brain activity in healthy and diseased populations is characterizing the common spatio-temporal response to a shared experience. Multivoxel pattern analysis allows us to investigate information encoding through these patterns; however, we have yet to explore local, stimulus-driven, patterns of cortical activity during naturalistic stimulation. We sought to examine these patterns with minimum interpolation—excluding functional alignment—to characterize the most basic degree of shared response between subjects. We used an unbiased analytic approach, combined with rich, naturalistic, and nonsemantic stimulation to estimate shared spatial patterns in functional magnetic resonance imaging responses across a large group. We found that meso-scale spatial patterns were shared nonuniformly across the visual cortex and represent information distinct from the shared temporal response. Shared spatial patterns were stimulus-driven, modulated by pattern size, and more sensitive to the contrast of 3D versus 2D stimulus differences than the temporal signals. Although the grand functional structure of the brain is understood to be common, these results suggest that even at a meso-scale, we share common spatial structures with anatomical alignment alone. The strength of this similarity varies across the cortex, suggesting some spatial structures are innately organized, whereas others are shaped by factors such as learning and plasticity.