Functional connectivity dynamics during film viewing reveal common networks for different emotional experiences

Original language versus dubbed movies: Effects on our brain and emotions

Converging evidence suggests that emotions are often dulled in one's foreign language. Here, we paired fMRI with a naturalistic viewing paradigm (i.e., original vs. dubbed versions of sad, fun and neutral movie clips) to investigate the neural correlates of emotion perception as a function of native (L1) and foreign (L2) language context. Watching emotional clips in L1 (vs. L2) reflected in activations of anterior temporal cortices involved in semantic cognition, arguably indicating a closer association of emotion concepts with the native language. The processing of fun clips in L1 (vs. L2) reflected in enhanced response of the right amygdala, suggesting a deeper emotional experience of positively valenced stimuli in the L1. Of interest, the amygdala response to fun clips positively correlated with participants' proficiency in the L2, indicating that a higher L2 competence may reduce emotional processing differences across a bilingual's two languages. Our findings are compatible with the view that language provides a context for the construction of emotions.

Decoding the dynamic perception of risk and speed using naturalistic stimuli: A multivariate, whole-brain analysis

Time-resolved decoding of speed and risk perception in car driving is important for understanding the perceptual processes related to driving safety. In this study, we used an fMRI-compatible trackball with naturalistic stimuli to record dynamic ratings of perceived risk and speed and investigated the degree to which different brain regions were able to decode these. We presented participants with first-person perspective videos of cars racing on the same course. These videos varied in terms of subjectively perceived speed and risk profiles, as determined during a behavioral pilot. During the fMRI experiment, participants used the trackball to dynamically rate subjective risk in a first and speed in a second session and assessed overall risk and speed after watching each video. A standard multivariate correlation analysis based on these ratings revealed sparse decodability in visual areas only for the risk ratings. In contrast, the dynamic rating-based correlation analysis uncovered frontal, visual, and temporal region activation for subjective risk and dorsal visual stream and temporal region activation for subjectively perceived speed. Interestingly, further analyses showed that the brain regions for decoding risk changed over time, whereas those for decoding speed remained constant. Overall, our results demonstrate the advantages of time-resolved decoding to help our understanding of the dynamic networks associated with decoding risk and speed perception in realistic driving scenarios.

Probing neurodynamics of experienced emotions-a Hitchhiker's guide to film fMRI

Film functional magnetic resonance imaging (fMRI) has gained tremendous popularity in many areas of neuroscience. However, affective neuroscience remains somewhat behind in embracing this approach, even though films lend themselves to study how brain function gives rise to complex, dynamic and multivariate emotions. Here, we discuss the unique capabilities of film fMRI for emotion research, while providing a general guide of conducting such research. We first give a brief overview of emotion theories as these inform important design choices. Next, we discuss films as experimental paradigms for emotion elicitation and address the process of annotating them. We then situate film fMRI in the context of other fMRI approaches, and present an overview of results from extant studies so far with regard to advantages of film fMRI. We also give an overview of state-of-the-art analysis techniques including methods that probe neurodynamics. Finally, we convey limitations of using film fMRI to study emotion. In sum, this review offers a practitioners' guide to the emerging field of film fMRI and underscores how it can advance affective neuroscience.

Arousal modulates the amygdala-insula reciprocal connectivity during naturalistic emotional movie watching

Emotional arousal is a complex state recruiting distributed cortical and subcortical structures, in which the amygdala and insula play an important role. Although previous neuroimaging studies have showed that the amygdala and insula manifest reciprocal connectivity, the effective connectivities and modulatory patterns on the amygdala-insula interactions underpinning arousal are still largely unknown. One of the reasons may be attributed to static and discrete laboratory brain imaging paradigms used in most existing studies. In this study, by integrating naturalistic-paradigm (i.e., movie watching) functional magnetic resonance imaging (fMRI) with a computational affective model that predicts dynamic arousal for the movie stimuli, we investigated the effective amygdala-insula interactions and the modulatory effect of the input arousal on the effective connections. Specifically, the predicted dynamic arousal of the movie served as regressors in general linear model (GLM) analysis and brain activations were identified accordingly. The regions of interest (i.e., the bilateral amygdala and insula) were localized according to the GLM activation map. The effective connectivity and modulatory effect were then inferred by using dynamic causal modeling (DCM). Our experimental results demonstrated that amygdala was the site of driving arousal input and arousal had a modulatory effect on the reciprocal connections between amygdala and insula. Our study provides novel evidence to the underlying neural mechanisms of arousal in a dynamical naturalistic setting.

Topographic representation of visually evoked emotional experiences in the human cerebral cortex

Affective neuroscience seeks to uncover the neural underpinnings of emotions that humans experience. However, it remains unclear whether an affective space underlies the discrete emotion categories in the human brain, and how it relates to the hypothesized affective dimensions. To address this question, we developed a voxel-wise encoding model to investigate the cortical organization of human emotions. Results revealed that the distributed emotion representations are constructed through a fundamental affective space. We further compared each dimension of this space to 14 hypothesized affective dimensions, and found that many affective dimensions are captured by the fundamental affective space. Our results suggest that emotional experiences are represented by broadly spatial overlapping cortical patterns and form smooth gradients across large areas of the cortex. This finding reveals the specific structure of the affective space and its relationship to hypothesized affective dimensions, while highlighting the distributed nature of emotional representations in the cortex.

Improving the study of brain-behavior relationships by revisiting basic assumptions

Neuroimaging research has been at the forefront of concerns regarding the failure of experimental findings to replicate. In the study of brain-behavior relationships, past failures to find replicable and robust effects have been attributed to methodological shortcomings. Methodological rigor is important, but there are other overlooked possibilities: most published studies share three foundational assumptions, often implicitly, that may be faulty. In this paper, we consider the empirical evidence from human brain imaging and the study of non-human animals that calls each foundational assumption into question. We then consider the opportunities for a robust science of brain-behavior relationships that await if scientists ground their research efforts in revised assumptions supported by current empirical evidence.

Integrating media content analysis, reception analysis, and media effects studies

Every day, the world of media is at our fingertips, whether it is watching movies, listening to the radio, or browsing online media. On average, people spend over 8 h per day consuming messages from the mass media, amounting to a total lifetime dose of more than 20 years in which conceptual content stimulates our brains. Effects from this flood of information range from short-term attention bursts (e.g., by breaking news features or viral 'memes') to life-long memories (e.g., of one's favorite childhood movie), and from micro-level impacts on an individual's memory, attitudes, and behaviors to macro-level effects on nations or generations. The modern study of media's influence on society dates back to the 1940s. This body of mass communication scholarship has largely asked, "what is media's effect on the individual?" Around the time of the cognitive revolution, media psychologists began to ask, "what cognitive processes are involved in media processing?" More recently, neuroimaging researchers started using real-life media as stimuli to examine perception and cognition under more natural conditions. Such research asks: "what can media tell us about brain function?" With some exceptions, these bodies of scholarship often talk past each other. An integration offers new insights into the neurocognitive mechanisms through which media affect single individuals and entire audiences. However, this endeavor faces the same challenges as all interdisciplinary approaches: Researchers with different backgrounds have different levels of expertise, goals, and foci. For instance, neuroimaging researchers label media stimuli as "naturalistic" although they are in many ways rather artificial. Similarly, media experts are typically unfamiliar with the brain. Neither media creators nor neuroscientifically oriented researchers approach media effects from a social scientific perspective, which is the domain of yet another species. In this article, we provide an overview of approaches and traditions to studying media, and we review the emerging literature that aims to connect these streams. We introduce an organizing scheme that connects the causal paths from media content → brain responses → media effects and discuss network control theory as a promising framework to integrate media content, reception, and effects analyses.

Retrospective behavioral sampling (RBS): A method to effectively track the cognitive fluctuations driven by naturalistic stimulation

Everyday experiences are dynamic, driving fluctuations across simultaneous cognitive processes. A key challenge in the study of naturalistic cognition is to disentangle the complexity of these dynamic processes, without altering the natural experience itself. Retrospective behavioral sampling (RBS) is a novel approach to model the cognitive fluctuations corresponding to the time-course of naturalistic stimulation, across a variety of cognitive dimensions. We tested the effectiveness and reliability of RBS in a web-based experiment, in which 53 participants viewed short movies and listened to a story, followed by retrospective reporting. Participants recalled their experience of 55 discrete events from the stimuli, rating their quality of memory, magnitude of surprise, intensity of negative and positive emotions, perceived importance, reflectivity state, and mental time travel. In addition, a subset of the original cohort re-rated their memory of events in a follow-up questionnaire. Results show highly replicable fluctuation patterns across distinct cognitive dimensions, thereby revealing a stimulus-driven experience that is substantially shared among individuals. Remarkably, memory ratings more than a week after stimulation resulted in an almost identical time-course of memorability as measured immediately following stimulation. In addition, idiosyncratic response patterns were preserved across different stimuli, indicating that RBS characterizes individual differences that are stimulus invariant. The current findings highlight the potential of RBS as a powerful tool for measuring dynamic processes of naturalistic cognition. We discuss the promising approach of matching RBS fluctuations with dynamic processes measured via other testing modalities, such as neuroimaging, to study the neural manifestations of naturalistic cognitive processing.

Eliciting empathetic drives to prosocial behavior during stressful events

In the current pandemic situation, psychological science is increasingly considered by public health policy. Empathy is mainly recognized as a crucial drive for prosocial behavior. However, this rich body of evidence still lacks visibility and implementation. Effective social programs are needed, and little is known about how to elicit empathetic drives. The paper gives first a clear foundation to the role of empathy during stressful events. It provides then a comprehensive overview of innovative interventions triggering empathic response in the public such as fiction, film, and theater. Moreover, it integrates interactive ways of sharing personal views that could elicit empathetic feelings in different people. Advances deriving from this perspective could be of significant public interest in the current and future health crises and help authorities develop innovative social programs, which should be the focus of further scientific inquiry.

Dynamic Functional Connectivity of Emotion Processing in Beta Band with Naturalistic Emotion Stimuli

While naturalistic stimuli, such as movies, better represent the complexity of the real world and are perhaps crucial to understanding the dynamics of emotion processing, there is limited research on emotions with naturalistic stimuli. There is a need to understand the temporal dynamics of emotion processing and their relationship to different dimensions of emotion experience. In addition, there is a need to understand the dynamics of functional connectivity underlying different emotional experiences that occur during or prior to such experiences. To address these questions, we recorded the EEG of participants and asked them to mark the temporal location of their emotional experience as they watched a video. We also obtained self-assessment ratings for emotional multimedia stimuli. We calculated dynamic functional the connectivity (DFC) patterns in all the frequency bands, including information about hubs in the network. The change in functional networks was quantified in terms of temporal variability, which was then used in regression analysis to evaluate whether temporal variability in DFC (tvDFC) could predict different dimensions of emotional experience. We observed that the connectivity patterns in the upper beta band could differentiate emotion categories better during or prior to the reported emotional experience. The temporal variability in functional connectivity dynamics is primarily related to emotional arousal followed by dominance. The hubs in the functional networks were found across the right frontal and bilateral parietal lobes, which have been reported to facilitate affect, interoception, action, and memory-related processing. Since our study was performed with naturalistic real-life resembling emotional videos, the study contributes significantly to understanding the dynamics of emotion processing. The results support constructivist theories of emotional experience and show that changes in dynamic functional connectivity can predict aspects of our emotional experience.

Inferring Brain State Dynamics Underlying Naturalistic Stimuli Evoked Emotion Changes With dHA-HMM

The brain functional mechanisms underlying emotional changes have been primarily studied based on the traditional task design with discrete and simple stimuli. However, the brain state transitions when exposed to continuous and naturalistic stimuli with rich affection variations remain poorly understood. This study proposes a dynamic hyperalignment algorithm (dHA) to functionally align the inter-subject neural activity. The hidden Markov model (HMM) was used to study how the brain dynamics responds to emotion during long-time movie-viewing activity. The results showed that dHA significantly improved inter-subject consistency and allowed more consistent temporal HMM states across participants. Afterward, grouping the emotions in a clustering dendrogram revealed a hierarchical grouping of the HMM states. Further emotional sensitivity and specificity analyses of ordered states revealed the most significant differences in happiness and sadness. We then compared the activation map in HMM states during happiness and sadness and found significant differences in the whole brain, but strong activation was observed during both in the superior temporal gyrus, which is related to the early process of emotional prosody processing. A comparison of the inter-network functional connections indicates unique functional connections of the memory retrieval and cognitive network with the cerebellum network during happiness. Moreover, the persistent bilateral connections among salience, cognitive, and sensorimotor networks during sadness may reflect the interaction between high-level cognitive networks and low-level sensory networks. The main results were verified by the second session of the dataset. All these findings enrich our understanding of the brain states related to emotional variation during naturalistic stimuli.

Compounding Vulnerability in the Neurocircuitry of Addiction: Longitudinal Functional Connectivity Changes in Alcohol Use Disorder

AIMS

The addiction neurocircuitry model describes the role of several brain circuits (drug reward, negative emotionality and craving/executive control) in alcohol use and subsequent development of alcohol use disorder (AUD). Human studies examining longitudinal change using resting-state functional magnetic resonance imaging (rs-fMRI) are needed to understand how functional changes to these circuits are caused by or contribute to continued AUD.

METHODS

In order to characterize how intrinsic functional connectivity changes with sustained AUD, we analyzed rs-fMRI data from individuals with (n = 18; treatment seeking and non-treatment seeking) and without (n = 21) AUD collected on multiple visits as part of various research studies at the NIAAA intramural program from 2012 to 2020.

RESULTS

Results of the seed correlation analysis showed that individuals with AUD had an increase in functional connectivity over time between emotionality and craving neurocircuits, and a decrease between executive control and reward networks. Post hoc investigations of AUD severity and alcohol consumption between scans revealed an additive effect of these AUD features in many of the circuits, such that more alcohol consumption or more severe AUD was associated with more pronounced changes to synchronicity.

CONCLUSIONS

These findings suggest an increased concordance of networks underlying emotionality and compulsions toward drinking while also a reduction in control network connectivity, consistent with the addiction neurocircuitry model. Further, they suggest a compounding effect of continued heavy drinking on these vulnerabilities in neurocircuitry. More longitudinal research is necessary to understand the trajectories of individuals with AUD not adequately represented in this study, as well as whether this can inform effective harm reduction strategies.

A new science of emotion: implications for functional neurological disorder

Functional neurological disorder reflects impairments in brain networks leading to distressing motor, sensory and/or cognitive symptoms that demonstrate positive clinical signs on examination incongruent with other conditions. A central issue in historical and contemporary formulations of functional neurological disorder has been the mechanistic and aetiological role of emotions. However, the debate has mostly omitted fundamental questions about the nature of emotions in the first place. In this perspective article, we first outline a set of relevant working principles of the brain (e.g. allostasis, predictive processing, interoception and affect), followed by a focused review of the theory of constructed emotion to introduce a new understanding of what emotions are. Building on this theoretical framework, we formulate how altered emotion category construction can be an integral component of the pathophysiology of functional neurological disorder and related functional somatic symptoms. In doing so, we address several themes for the functional neurological disorder field including: (i) how energy regulation and the process of emotion category construction relate to symptom generation, including revisiting alexithymia, 'panic attack without panic', dissociation, insecure attachment and the influential role of life experiences; (ii) re-interpret select neurobiological research findings in functional neurological disorder cohorts through the lens of the theory of constructed emotion to illustrate its potential mechanistic relevance; and (iii) discuss therapeutic implications. While we continue to support that functional neurological disorder is mechanistically and aetiologically heterogenous, consideration of how the theory of constructed emotion relates to the generation and maintenance of functional neurological and functional somatic symptoms offers an integrated viewpoint that cuts across neurology, psychiatry, psychology and cognitive-affective neuroscience.

Functional connectivity dynamics as a function of the fluctuation of tension during film watching

To advance the understanding of the dynamic relationship between brain activities and emotional experiences, we examined the neural patterns of tension, a unique emotion that highly depends on how an event unfolds. Specifically, the present study explored the temporal relationship between functional connectivity patterns within and between different brain functional modules and the fluctuation in tension during film watching. Due to the highly contextualized and time-varying nature of tension, we expected that multiple neural networks would be involved in the dynamic tension experience. Using the neuroimaging data of 546 participants, we conducted a dynamic brain analysis to identify the intra- and inter-module functional connectivity patterns that are significantly correlated with the fluctuation of tension over time. The results showed that the inter-module connectivity of cingulo-opercular network, fronto-parietal network, and default mode network is involved in the dynamic experience of tension. These findings demonstrate a close relationship between brain functional connectivity patterns and emotional dynamics, which supports the importance of functional connectivity dynamics in understanding our cognitive and emotional processes.

Inter-Brain Synchronization During Sandplay Therapy: Individual Analyses

Interactions between the client (Cl) and therapist (Th) evolve therapeutic relationships in psychotherapy. An interpersonal link or therapeutic space is implicitly developed, wherein certain important elements are expressed and shared. However, neural basis of psychotherapy, especially of non-verbal modalities, have scarcely been explored. Therefore, we examined the neural backgrounds of such therapeutic alliances during sandplay, a powerful art/play therapy technique. Real-time and simultaneous measurement of hemodynamics was conducted in the prefrontal cortex (PFC) of Cl-Th pairs participating in sandplay and subsequent interview sessions through multichannel near-infrared spectroscopy. As sandplay is highly individualized, and no two sessions and products (sandtrays) are the same, we expected variation in interactive patterns in the Cl–Th pairs. Nevertheless, we observed a statistically significant correlation between the spatio-temporal patterns in signals produced by the homologous regions of the brains. During the sandplay condition, significant correlations were obtained in the lateral PFC and frontopolar (FP) regions in the real Cl-Th pairs. Furthermore, a significant correlation was observed in the FP region for the interview condition. The correlations found in our study were explained as a “remote” synchronization (i.e., unconnected peripheral oscillators synchronizing through a hub maintaining free desynchronized dynamics) between two subjects in a pair, possibly representing the neural foundation of empathy, which arises commonly in sandplay therapy (ST).

Classification of emotion categories based on functional connectivity patterns of the human brain

Neurophysiological and psychological models posit that emotions depend on connections across wide-spread corticolimbic circuits. While previous studies using pattern recognition on neuroimaging data have shown differences between various discrete emotions in brain activity patterns, less is known about the differences in functional connectivity. Thus, we employed multivariate pattern analysis on functional magnetic resonance imaging data (i) to develop a pipeline for applying pattern recognition in functional connectivity data, and (ii) to test whether connectivity patterns differ across emotion categories. Six emotions (anger, fear, disgust, happiness, sadness, and surprise) and a neutral state were induced in 16 participants using one-minute-long emotional narratives with natural prosody while brain activity was measured with functional magnetic resonance imaging (fMRI). We computed emotion-wise connectivity matrices both for whole-brain connections and for 10 previously defined functionally connected brain subnetworks and trained an across-participant classifier to categorize the emotional states based on whole-brain data and for each subnetwork separately. The whole-brain classifier performed above chance level with all emotions except sadness, suggesting that different emotions are characterized by differences in large-scale connectivity patterns. When focusing on the connectivity within the 10 subnetworks, classification was successful within the default mode system and for all emotions. We thus show preliminary evidence for consistently different sustained functional connectivity patterns for instances of emotion categories particularly within the default mode system.

Default and Control Networks Connectivity Dynamics Track the Stream of Affect at Multiple Timescales

In everyday life the stream of affect results from the interaction between past experiences, expectations, and the unfolding of events. How the brain represents the relationship between time and affect has been hardly explored, as it requires modeling the complexity of everyday life in the laboratory setting. Movies condense into hours a multitude of emotional responses, synchronized across subjects and characterized by temporal dynamics alike real-world experiences. Here, we use time-varying intersubject brain synchronization and real-time behavioral reports to test whether connectivity dynamics track changes in affect during movie watching. Results show that polarity and intensity of experiences relate to connectivity of the default mode and control networks and converge in the right temporo-parietal cortex. We validate these results in two experiments including four independent samples, two movies, and alternative analysis workflows. Lastly, we reveal chronotopic connectivity maps within temporo-parietal and prefrontal cortex, where adjacent areas preferentially encode affect at specific timescales.

Networks underpinning emotion: A systematic review and synthesis of functional and effective connectivity

•

We reviewed 33 studies of functional connectivity of emotion in healthy participants.

•

Our results challenge a hierarchical model of emotion processing.

•

Causal connectivity analyze identify dynamic modulatory relationships between regions.

•

We derive a quality tool to make recommendations addressing variability in study design.

Existing models of emotion processing are based almost exclusively on brain activation data, yet make assumptions about network connectivity. There is a need to integrate connectivity findings into these models.

We systematically reviewed all studies of functional and effective connectivity employing tasks to investigate negative emotion processing and regulation in healthy participants. Thirty-three studies met inclusion criteria. A quality assessment tool was derived from prominent neuroimaging papers. The evidence supports existing models, with primarily limbic regions for salience and identification, and frontal areas important for emotion regulation. There was mixed support for the assumption that regulatory influences on limbic and sensory areas come predominantly from prefrontal areas. Rather, studies quantifying effective connectivity reveal context-dependent dynamic modulatory relationships between occipital, subcortical, and frontal regions, arguing against purely top-down regulatory theoretical models. Our quality assessment tool found considerable variability in study design and tasks employed.

The findings support and extend those of previous syntheses focused on activation studies, and provide evidence for a more nuanced view of connectivity in networks of human emotion processing and regulation.

To Regulate or Not to Regulate: Emotion Regulation in Participants With Low and High Impulsivity

Successful emotion regulation plays a key role in psychological health and well-being. This study examines (1) whether cognitive control and corresponding neural connectivity are associated with emotion regulation and (2) to what extent external instructions can improve emotion regulation in individuals with low vs. high cognitive control capacity. For this, emotion regulation capabilities and the impact of emotion regulation on a subsequent emotional Stroop task was tested in participants with low (N = 25) vs. high impulsivity (N = 32). The classification according to impulsivity is based upon the stable correlation between high impulsivity and reduced cognitive control capacity. A negative emotion inducing movie scene was presented with the instruction to either suppress or allow all emotions that arose. This was followed by an emotional Stroop task. Electromyography (EMG) over the corrugator supercilii was used to assess the effects of emotion regulation. Neurophysiological mechanisms were measured using functional near-infrared spectroscopy over frontal brain areas. While EMG activation was low in the low-impulsive group independent of instruction, high-impulsive participants showed increased EMG activity when they were not explicitly instructed to suppress arising emotions. Given the same extent of functional connectivity within frontal lobe networks, the low-impulsive participants controlled their emotions better (less EMG activation) than the high-impulsive participants. In the Stroop task, the low-impulsive subjects performed significantly better. The emotion regulation condition had no significant effect on the results. We conclude that the cognitive control network is closely associated with emotion regulation capabilities. Individuals with high cognitive control show implicit capabilities for emotion regulation. Individuals with low cognitive control require external instructions (= explicit emotion regulation) to achieve similarly low expressions of emotionality. Implications for clinical applications aiming to improve emotion regulation are discussed.

Dynamic functional network connectivity associated with musical emotions evoked by different tempi

Background：Music tempo has strong clinical maneuverability and positive emotional effect in music therapy, which can directly evoke multiple emotions and dynamic neural changes in the whole-brain. However, the precise relationship between music tempo and its emotional effects remains unclear. The present study aimed to investigate the dynamic functional network connectivity (dFNC) associated with emotions elicited by music at different tempi.

METHODS

We obtained emotion ratings of fast- (155-170 bpm), middle- (90 bpm), and slow-tempo (50-60 bpm) piano music from 40 participants both during and after functional magnetic resonance imaging (fMRI). Group independent component analysis (ICA), sliding time window correlations, and k-means clustering were used to assess dFNC of fMRI data. Paired t-tests were conducted to compare the difference of neural networks.

RESULTS

(1) Fast music was associated with higher ratings of emotional valence and arousal, which were accompanied with increasing dFNC between somatomotor (SM) and cingulo-opercular (CO) networks and decreasing dFNC between fronto-parietal and SM networks. (2) Even with stronger activation in auditory (AUD) networks, slow music was associated with weaker emotion than fast music, with decreasing FNC across the brain and the participation of default mode (DM). (3) Middle-tempo music elicited moderate emotional activation with the most stable dFNC in the whole brain.

CONCLUSION

Faster music increases neural activity in the SM and CO regions, increasing the intensity of the emotional experience. In contrast, slower music was associated with decreasing engagement of AUD and stable engagement of DM, resulting in a weak emotional experience. These findings suggested that the time-varying aspects of functional connectivity can help to uncover the dynamic neural substrates of tempo-evoked emotion while listening to music.

Naturalistic Stimuli in Affective Neuroimaging: A Review

Naturalistic stimuli such as movies, music, and spoken and written stories elicit strong emotions and allow brain imaging of emotions in close-to-real-life conditions. Emotions are multi-component phenomena: relevant stimuli lead to automatic changes in multiple functional components including perception, physiology, behavior, and conscious experiences. Brain activity during naturalistic stimuli reflects all these changes, suggesting that parsing emotion-related processing during such complex stimulation is not a straightforward task. Here, I review affective neuroimaging studies that have employed naturalistic stimuli to study emotional processing, focusing especially on experienced emotions. I argue that to investigate emotions with naturalistic stimuli, we need to define and extract emotion features from both the stimulus and the observer.

At the Neural Intersection Between Language and Emotion

What role does language play in emotion? Behavioral research shows that emotion words such as "anger" and "fear" alter emotion experience, but questions still remain about mechanism. Here, we review the neuroscience literature to examine whether neural processes associated with semantics are also involved in emotion. Our review suggests that brain regions involved in the semantic processing of words: (i) are engaged during experiences of emotion, (ii) coordinate with brain regions involved in affect to create emotions, (iii) hold representational content for emotion, and (iv) may be necessary for constructing emotional experience. We relate these findings with respect to four theoretical relationships between language and emotion, which we refer to as "non-interactive," "interactive," "constitutive," and "deterministic." We conclude that findings are most consistent with the interactive and constitutive views with initial evidence suggestive of a constitutive view, in particular. We close with several future directions that may help test hypotheses of the constitutive view.

Brain functional connectivity dynamics at rest in the aftermath of affective and cognitive challenges

Carry-over effects on brain states have been reported following emotional and cognitive events, persisting even during subsequent rest. Here, we investigated such effects by identifying recurring co-activation patterns (CAPs) in neural networks at rest with functional magnetic resonance imaging (fMRI). We compared carry-over effects on brain-wide CAPs at rest and their modulation after both affective and cognitive challenges. Healthy participants underwent fMRI scanning during emotional induction with negative valence and performed cognitive control tasks, each followed by resting periods. Several CAPs, overlapping with the default-mode (DMN), salience, dorsal attention, and social cognition networks were impacted by both the preceding events (movie or task) and the emotional valence of the experimental contexts (neutral or negative), with differential dynamic fluctuations over time. Temporal metrics of DMN-related CAPs were altered after exposure to negative emotional content (compared to neutral) and predicted changes in subjective affect on self-reported scores. In parallel, duration rates of another attention-related CAP increased with greater task difficulty during the preceding cognitive control condition, specifically in the negative context. These findings provide new insights on the anatomical organization and temporal inertia of functional brain networks, whose expression is differentially shaped by emotional states, presumably mediating adaptive homeostatic processes subsequent to behaviorally challenging events.

Comparing supervised and unsupervised approaches to emotion categorization in the human brain, body, and subjective experience

Machine learning methods provide powerful tools to map physical measurements to scientific categories. But are such methods suitable for discovering the ground truth about psychological categories? We use the science of emotion as a test case to explore this question. In studies of emotion, researchers use supervised classifiers, guided by emotion labels, to attempt to discover biomarkers in the brain or body for the corresponding emotion categories. This practice relies on the assumption that the labels refer to objective categories that can be discovered. Here, we critically examine this approach across three distinct datasets collected during emotional episodes—measuring the human brain, body, and subjective experience—and compare supervised classification solutions with those from unsupervised clustering in which no labels are assigned to the data. We conclude with a set of recommendations to guide researchers towards meaningful, data-driven discoveries in the science of emotion and beyond.

Context-aware experience sampling reveals the scale of variation in affective experience

Emotion research typically searches for consistency and specificity in physiological activity across instances of an emotion category, such as anger or fear, yet studies to date have observed more variation than expected. In the present study, we adopt an alternative approach, searching inductively for structure within variation, both within and across participants. Following a novel, physiologically-triggered experience sampling procedure, participants' self-reports and peripheral physiological activity were recorded when substantial changes in cardiac activity occurred in the absence of movement. Unsupervised clustering analyses revealed variability in the number and nature of patterns of physiological activity that recurred within individuals, as well as in the affect ratings and emotion labels associated with each pattern. There were also broad patterns that recurred across individuals. These findings support a constructionist account of emotion which, drawing on Darwin, proposes that emotion categories are populations of variable instances tied to situation-specific needs.

The neuroscience of sadness: A multidisciplinary synthesis and collaborative review

Sadness is typically characterized by raised inner eyebrows, lowered corners of the mouth, reduced walking speed, and slumped posture. Ancient subcortical circuitry provides a neuroanatomical foundation, extending from dorsal periaqueductal grey to subgenual anterior cingulate, the latter of which is now a treatment target in disorders of sadness. Electrophysiological studies further emphasize a role for reduced left relative to right frontal asymmetry in sadness, underpinning interest in the transcranial stimulation of left dorsolateral prefrontal cortex as an antidepressant target. Neuroimaging studies - including meta-analyses - indicate that sadness is associated with reduced cortical activation, which may contribute to reduced parasympathetic inhibitory control over medullary cardioacceleratory circuits. Reduced cardiac control may - in part - contribute to epidemiological reports of reduced life expectancy in affective disorders, effects equivalent to heavy smoking. We suggest that the field may be moving toward a theoretical consensus, in which different models relating to basic emotion theory and psychological constructionism may be considered as complementary, working at different levels of the phylogenetic hierarchy.

Decoding dynamic affective responses to naturalistic videos with shared neural patterns

This study explored the feasibility of using shared neural patterns from brief affective episodes (viewing affective pictures) to decode extended, dynamic affective sequences in a naturalistic experience (watching movie-trailers). Twenty-eight participants viewed pictures from the International Affective Picture System (IAPS) and, in a separate session, watched various movie-trailers. We first located voxels at bilateral occipital cortex (LOC) responsive to affective picture categories by GLM analysis, then performed between-subject hyperalignment on the LOC voxels based on their responses during movie-trailer watching. After hyperalignment, we trained between-subject machine learning classifiers on the affective pictures, and used the classifiers to decode affective states of an out-of-sample participant both during picture viewing and during movie-trailer watching. Within participants, neural classifiers identified valence and arousal categories of pictures, and tracked self-reported valence and arousal during video watching. In aggregate, neural classifiers produced valence and arousal time series that tracked the dynamic ratings of the movie-trailers obtained from a separate sample. Our findings provide further support for the possibility of using pre-trained neural representations to decode dynamic affective responses during a naturalistic experience.

Changes in brain activity following the voluntary control of empathy

In neuroscience, empathy is often conceived as relatively automatic. The voluntary control that people can exert on brain mechanisms that map the emotions of others onto our own emotions has received comparatively less attention. Here, we therefore measured brain activity while participants watched emotional Hollywood movies under two different instructions: to rate the main characters' emotions by empathizing with them, or to do so while keeping a detached perspective. We found that participants yielded highly consistent and similar ratings of emotions under both conditions. Using intersubject correlation-based analyses we found that, when encouraged to empathize, participants' brain activity in limbic (including cingulate and putamen) and somatomotor regions (including premotor, SI and SII) synchronized more during the movie than when encouraged to detach. Using intersubject functional connectivity we found that comparing the empathic and detached perspectives revealed widespread increases in functional connectivity between large scale networks. Our findings contribute to the increasing awareness that we have voluntary control over the neural mechanisms through which we process the emotions of others.

Dynamic intersubject neural synchronization reflects affective responses to sad music

Psychological theories of emotion often highlight the dynamic quality of the affective experience, yet neuroimaging studies of affect have traditionally relied on static stimuli that lack ecological validity. Consequently, the brain regions that represent emotions and feelings as they unfold remain unclear. Recently, dynamic, model-free analytical techniques have been employed with naturalistic stimuli to better capture time-varying patterns of activity in the brain; yet, few studies have focused on relating these patterns to changes in subjective feelings. Here, we address this gap, using intersubject correlation and phase synchronization to assess how stimulus-driven changes in brain activity and connectivity are related to two aspects of emotional experience: emotional intensity and enjoyment. During fMRI scanning, healthy volunteers listened to a full-length piece of music selected to induce sadness. After scanning, participants listened to the piece twice while simultaneously rating the intensity of felt sadness or felt enjoyment. Activity in the auditory cortex, insula, and inferior frontal gyrus was significantly synchronized across participants. Synchronization in auditory, visual, and prefrontal regions was significantly greater in participants with higher measures of a subscale of trait empathy related to feeling emotions in response to music. When assessed dynamically, continuous enjoyment ratings positively predicted a moment-to-moment measure of intersubject synchronization in auditory, default mode, and striatal networks, as well as the orbitofrontal cortex, whereas sadness predicted intersubject synchronization in limbic and striatal networks. The results suggest that stimulus-driven patterns of neural communication in emotional processing and high-level cortical regions carry meaningful information with regards to our feeling in response to a naturalistic stimulus.

Intrinsic Functional Connectivity is Organized as Three Interdependent Gradients

The intrinsic functional architecture of the brain supports moment-to-moment maintenance of an internal model of the world. We hypothesized and found three interdependent architectural gradients underlying the organization of intrinsic functional connectivity within the human cerebral cortex. We used resting state fMRI data from two samples of healthy young adults (N's = 280 and 270) to generate functional connectivity maps of 109 seeds culled from published research, estimated their pairwise similarities, and multidimensionally scaled the resulting similarity matrix. We discovered an optimal three-dimensional solution, accounting for 98% of the variance within the similarity matrix. The three dimensions corresponded to three gradients, which spatially correlate with two functional features (external vs. internal sources of information; content representation vs. attentional modulation) and one structural feature (anatomically central vs. peripheral) of the brain. Remapping the three dimensions into coordinate space revealed that the connectivity maps were organized in a circumplex structure, indicating that the organization of intrinsic connectivity is jointly guided by graded changes along all three dimensions. Our findings emphasize coordination between multiple, continuous functional and anatomical gradients, and are consistent with the emerging predictive coding perspective.

Reduced brain processing of affective pictures in children with cerebral palsy

Sensory and cognitive deficits are common comorbidities in children with cerebral palsy. This observational study examines if brain processing of affective information is also altered in children with cerebral palsy (CP) in comparison with typically developing peers (TDP).

METHODS

Evoked-related potentials were recorded in 15 children with CP (age = 11.27 ± 4.53 yr, 6 girls) and 14 TDP (age = 10.14 ± 4.29 yr, 5 girls) when viewing pleasant, unpleasant and neutral pictures. The subjective perception of valence and arousal of each one of the pictures was examined.

RESULTS

Children with CP showed a significant amplitude reduction of evoked potentials in the occipital region to the affective stimuli in early brain processing latencies (P100 and N200; all F > 2.9, all p < .05). Children with CP rated pictures with affective content (pleasant and unpleasant) as less arousing (F(2.25) = 46.71, p < .001), and neutral pictures as more pleasant, than their TDP (F(2.25) = 75.56, p < .001).

CONCLUSION

The pictures with emotional content produce less activation, both at the behavioral and brain processing levels in children with CP. These differences were found in early latencies of brain processing which could be related to alterations in the detection of emotionally relevant stimuli.

The tenacious brain: How the anterior mid-cingulate contributes to achieving goals

Tenacity-persistence in the face of challenge-has received increasing attention, particularly because it contributes to better academic achievement, career opportunities and health outcomes. We review evidence from non-human primate neuroanatomy and structural and functional neuroimaging in humans suggesting that the anterior mid cingulate cortex (aMCC) is an important network hub in the brain that performs the cost/benefit computations necessary for tenacity. Specifically, we propose that its position as a structural and functional hub allows the aMCC to integrate signals from diverse brain systems to predict energy requirements that are needed for attention allocation, encoding of new information, and physical movement, all in the service of goal attainment. We review and integrate research findings from studies of attention, reward, memory, affect, multimodal sensory integration, and motor control to support this hypothesis. We close by discussing the implications of our framework for educational achievement, exercise and eating disorders, successful aging, and neuropsychiatric disorders such as depression and dementia.

The Default Mode Network's Role in Discrete Emotion

Emotions are often assumed to manifest in subcortical limbic and brainstem structures. While these areas are clearly important for representing affect (e.g., valence and arousal), we propose that the default mode network (DMN) is additionally important for constructing discrete emotional experiences (of anger, fear, disgust, etc.). Findings from neuroimaging studies, invasive electrical stimulation studies, and lesion studies support this proposal. Importantly, our framework builds on a constructionist theory of emotion to explain how instances involving diverse physiological and behavioral patterns can be conceptualized as belonging to the same emotion category. We argue that this ability requires abstraction (from concrete features to broad mental categories), which the DMN is well positioned to support, and we make novel predictions from our proposed framework.

Mood congruency effects are mediated by shifts in salience and central executive network efficiency

Emotions are not confined to short momentary states but carry on over time, facilitating the perception and interpretation of the environment in mood-congruent ways. Yet, the (neural) mechanism linking affective stimulation at a certain time-point to such altered, mood-congruent processing of stimuli presented at a subsequent time-point remains unknown. Recent research suggests that such a link could be explained by transient effects of affective stimulation on the organization of intrinsic macro-scale neural networks. It remains, however, unclear whether these changes in network organization are influencing subsequent perception in a mood-congruent way. Addressing this gap the current study investigated whether changes in network organization, measured in terms of network efficiency, mediate the relation between mood induction and mood-congruent processing as measured by reaction times during an emotional Stroop task. The results demonstrated that negative mood induction increased the efficiency of the salience network and decreased the efficiency of the central executive network. This modulation of network efficiency fully mediated the effects of mood induction on reaction times to negative words. These findings indicate that transient shifts in the organization of macro-scale neural networks are an essential part of the emotional response and can help to explain how affect shapes our interaction with the environment.

Emotion words, emotion concepts, and emotional development in children: A constructionist hypothesis

In this article, we integrate two constructionist approaches-the theory of constructed emotion and rational constructivism-to introduce several novel hypotheses for understanding emotional development. We first discuss the hypothesis that emotion categories are abstract and conceptual, whose instances share a goal-based function in a particular context but are highly variable in their affective, physical, and perceptual features. Next, we discuss the possibility that emotional development is the process of developing emotion concepts, and that emotion words may be a critical part of this process. We hypothesize that infants and children learn emotion categories the way they learn other abstract conceptual categories-by observing others use the same emotion word to label highly variable events. Finally, we hypothesize that emotional development can be understood as a concept construction problem: a child becomes capable of experiencing and perceiving emotion only when her brain develops the capacity to assemble ad hoc, situated emotion concepts for the purposes of guiding behavior and giving meaning to sensory inputs. Specifically, we offer a predictive processing account of emotional development. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Emotional Reactivity, Emotion Regulation Capacity, and Posttraumatic Stress Disorder in Traumatized Refugees: An Experimental Investigation

Refugees who suffer from posttraumatic stress disorder (PTSD) often react with strong emotions when confronted with trauma reminders. In this study, we aimed to investigate the associations between low emotion regulation capacity (as indexed by low heart rate variability [HRV]), probable PTSD diagnosis, and fear and anger reaction and recovery to trauma-related stimuli. Participants were 81 trauma-exposed refugees (probable PTSD, n = 23; trauma-exposed controls, n = 58). The experiment comprised three 5-min phases: a resting phase (baseline); an exposition phase, during which participants were exposed to trauma-related images (stimulus); and another resting phase (recovery). We assessed HRV at baseline, and fear and anger were rated at the end of each phase. Linear mixed model analyses were used to investigate the associations between baseline HRV and probable DSM-5 PTSD diagnosis in influencing anger and fear responses both immediately after viewing trauma-related stimuli and at the end of the recovery phase. Compared to controls, participants with probable PTSD showed a greater increase in fear from baseline to stimulus presentation, d = 0.606. Compared to participants with low emotion regulation capacity, participants with high emotion regulation capacity showed a smaller reduction in anger from stimulus presentation to recovery, d = 0.548. Our findings indicated that following exposure to trauma-related stimuli, probable PTSD diagnosis predicted increased fear reactivity, and low emotion regulation capacity predicted decreased anger recovery. Impaired anger recovery following trauma reminders in the context of low emotion regulation capacity might contribute to the increased levels of anger found in postconflict samples.

Words are a context for mental inference

Accumulating evidence indicates that context has an important impact on inferring emotion in facial configurations. In this paper, we report on three studies examining whether words referring to mental states contribute to mental inference in images from the Reading the Mind in the Eyes Test (Study 1), Baron-Cohen et al. (2001) in static emoji (Study 2), and in animated emoji (Study 3). Across all three studies, we predicted and found that perceivers were more likely to infer mental states when relevant words were embedded in the experimental context (i.e., in a forced-choice task) versus when those words were absent (i.e., in a free-labeling task). We discuss the implications of these findings for the widespread conclusion that faces or parts of faces "display" emotions or other mental states, as well as for psychology's continued reliance on forced-choice methods. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Cingulate-centered large-scale networks: Normal functions, aging, and neurodegenerative disease

In this chapter, we review evidence from structural and functional neuroimaging in humans to consider the role of the cingulate cortex subregions (i.e., subgenual anterior cingulate cortex, pregenual anterior cingulate cortex, anterior midcingulate cortex, and dorsal posterior cingulate cortex) as major hubs anchoring multiple large-scale brain networks. We begin with a review of evidence from intrinsic functional connectivity and diffusion tensor imaging studies to show how connections within and between cingulate-centered networks contribute to processing and integrating signals related to autonomic, affective, executive, and memory functions. We then consider how variability in cingulate-centered networks could contribute to a range of aging outcomes, including typical aging and unusually successful aging (dubbed "superaging"), as well as early neurodegenerative dementias, including frontotemporal dementia and Alzheimer's disease.

Chaotic and Fast Audiovisuals Increase Attentional Scope but Decrease Conscious Processing

Audiovisual cuts involve spatial, temporal, and action narrative leaps. They can even change the meaning of the narrative through film editing. Many cuts are not consciously perceived, others are, just as we perceive or not the changes in real events. In this paper, we analyze the effects of cuts and different editing styles on 36 subjects, using electroencephalographic (EEG) techniques and the projection of stimuli with different audiovisual style of edition but the same narrative. Eyeblinks, event-related potentials (ERPs), EEG spectral power and disturbances, and the functional and effective connectivity before and after the cuts were analyzed. Cuts decreased blink frequency in the first second following them. Cuts also caused an increase of the alpha rhythm, with a cortical evolution from visual toward rostral areas. There were marked differences between a video-clip editing style, with greater activities evoked in visual areas, and the classic continuous style of editing, which presented greater activities in the frontal zones. This was reflected by differences in the theta rhythm between 200 and 400 ms, in visual and frontal zones, and can be connected to the different demands that each style of edition makes on working memory and conscious processing after cutting. Also, at the time of cuts, the causality between visual, somatosensory, and frontal networks is altered in any editing style. Our findings suggest that cuts affect media perception and chaotic and fast audiovisuals increase attentional scope but decrease conscious processing.

Hormonal Cycles, Brain Network Connectivity, and Windows of Vulnerability to Affective Disorder

The rate of affective disorder is substantially higher in women than in men, and considerable evidence points to the actions of ovarian hormones in mediating this disparity. In this Opinion, we discuss the hypothesis that cyclic changes in ovarian hormone levels produce cyclic alterations in connectivity between the intrinsic networks of the brain. These alterations produce specific temporal windows within the menstrual cycle when internetwork connectivity is increased, associated with increased stress reactivity and better memory for unpleasant, arousing events, leading to increased negative mood and susceptibility to affective disorder. Our windows of vulnerability model offers insights for both treatment of affective disorder and research on sex differences in the brain.

Neural dynamics underlying emotional transmissions between individuals

Emotional experiences are frequently shaped by the emotional responses of co-present others. Research has shown that people constantly monitor and adapt to the incoming social–emotional signals, even without face-to-face interaction. And yet, the neural processes underlying such emotional transmissions have not been directly studied. Here, we investigated how the human brain processes emotional cues which arrive from another, co-attending individual. We presented continuous emotional feedback to participants who viewed a movie in the scanner. Participants in the social group (but not in the control group) believed that the feedback was coming from another person who was co-viewing the same movie. We found that social–emotional feedback significantly affected the neural dynamics both in the core affect and in the medial pre-frontal regions. Specifically, the response time-courses in those regions exhibited increased similarity across recipients and increased neural alignment with the timeline of the feedback in the social compared with control group. Taken in conjunction with previous research, this study suggests that emotional cues from others shape the neural dynamics across the whole neural continuum of emotional processing in the brain. Moreover, it demonstrates that interpersonal neural alignment can serve as a neural mechanism through which affective information is conveyed between individuals.

Anger Modulates Influence Hierarchies Within and Between Emotional Reactivity and Regulation Networks

Emotion regulation is hypothesized to be mediated by the interactions between emotional reactivity and regulation networks during the dynamic unfolding of the emotional episode. Yet, it remains unclear how to delineate the effective relationships between these networks. In this study, we examined the aforementioned networks’ information flow hierarchy during viewing of an anger provoking movie excerpt. Anger regulation is particularly essential for averting individuals from aggression and violence, thus improving prosocial behavior. Using subjective ratings of anger intensity we differentiated between low and high anger periods of the film. We then applied the Dependency Network Analysis (D_EPNA), a newly developed graph theory method to quantify networks’ node importance during the two anger periods. The D_EPNA analysis revealed that the impact of the ventromedial prefrontal cortex (vmPFC) was higher in the high anger condition, particularly within the regulation network and on the connections between the reactivity and regulation networks. We further showed that higher levels of vmPFC impact on the regulation network were associated with lower subjective anger intensity during the high-anger cinematic period, and lower trait anger levels. Supporting and replicating previous findings, these results emphasize the previously acknowledged central role of vmPFC in modulating negative affect. We further show that the impact of the vmPFC relies on its correlational influence on the connectivity between reactivity and regulation networks. More importantly, the hierarchy network analysis revealed a link between connectivity patterns of the vmPFC and individual differences in anger reactivity and trait, suggesting its potential therapeutic role.

Emotion fingerprints or emotion populations? A meta-analytic investigation of autonomic features of emotion categories

The classical view of emotion hypothesizes that certain emotion categories have a specific autonomic nervous system (ANS) "fingerprint" that is distinct from other categories. Substantial ANS variation within a category is presumed to be epiphenomenal. The theory of constructed emotion hypothesizes that an emotion category is a population of context-specific, highly variable instances that need not share an ANS fingerprint. Instead, ANS variation within a category is a meaningful part of the nature of emotion. We present a meta-analysis of 202 studies measuring ANS reactivity during lab-based inductions of emotion in nonclinical samples of adults, using a random effects, multilevel meta-analysis and multivariate pattern classification analysis to test our hypotheses. We found increases in mean effect size for 59.4% of ANS variables across emotion categories, but the pattern of effect sizes did not clearly distinguish 1 emotion category from another. We also observed significant variation within emotion categories; heterogeneity accounted for a moderate to substantial percentage (i.e., I2 ≥ 30%) of variability in 54% of these effect sizes. Experimental moderators epiphenomenal to emotion, such as induction type (e.g., films vs. imagery), did not explain a large portion of the variability. Correction for publication bias reduced estimated effect sizes even further, increasing heterogeneity of effect sizes for certain emotion categories. These findings, when considered in the broader empirical literature, are more consistent with population thinking and other principles from evolutionary biology found within the theory of constructed emotion, and offer insights for developing new hypotheses to understand the nature of emotion. (PsycINFO Database Record