Emotional speech synchronizes brains across listeners and engages large-scale dynamic brain networks

Approaches to studying emotion using physiological responses to spoken narratives: A scoping review

Narratives are effective tools for evoking emotions, and physiological measurements provide a means of objectively assessing emotional reactions - making them a potentially powerful pair of tools for studying emotional processes. However, extent research combining emotional narratives and physiological measurement varies widely in design and application, making it challenging to identify previous work, consolidate findings, and design effective experiments. Our scoping review explores the use of auditory emotional narratives and physiological measures in research, examining paradigms, study populations, and represented emotions. Following the PRISMA-ScR Checklist, we searched five databases for peer-reviewed experimental studies that used spoken narratives to induce emotion and reported autonomic physiological measures. Among 3466 titles screened and 653 articles reviewed, 110 studies were included. Our exploration revealed a variety of applications and experimental paradigms; emotional narratives paired with physiological measures have been used to study diverse topics and populations, including neurotypical and clinical groups. Although incomparable designs and sometimes contradictory results precluded general recommendations as regards which physiological measures to use when designing new studies, as a whole, the body of work suggests that these tools can be valuable to study emotions. Our review offers an overview of research employing narratives and physiological measures for emotion study, and highlights weaknesses in reporting practices and gaps in our knowledge concerning the robustness and specificity of physiological measures as indices of emotion. We discuss study design considerations and transparent reporting, to facilitate future using emotional narratives and physiological measures in studying emotions.

Vicarious punishment of moral violations in naturalistic drama narratives predicts cortical synchronization

Punishment of moral norm violators is instrumental for human cooperation. Yet, social and affective neuroscience research has primarily focused on second- and third-party norm enforcement, neglecting the neural architecture underlying observed (vicarious) punishment of moral wrongdoers. We used naturalistic television drama as a sampling space for observing outcomes of morally-relevant behaviors to assess how individuals cognitively process dynamically evolving moral actions and their consequences. Drawing on Affective Disposition Theory, we derived hypotheses linking character morality with viewers' neural processing of characters' rewards and punishments. We used functional magnetic resonance imaging (fMRI) to examine neural responses of 28 female participants while free-viewing 15 short story summary video clips of episodes from a popular US television soap opera. Each summary included a complete narrative structure, fully crossing main character behaviors (moral/immoral) and the consequences (reward/punishment) characters faced for their actions. Narrative engagement was examined via intersubject correlation and representational similarity analysis. Highest cortical synchronization in 9 specifically selected regions previously implicated in processing moral information was observed when characters who act immorally are punished for their actions with participants' empathy as an important moderator. The results advance our understanding of the moral brain and the role of normative considerations and character outcomes in viewers' engagement with popular narratives.

The Cerebellum as an Embodying Machine

Whereas emotion theorists often keep their distance from the embodied approach, theorists of embodiment tend to treat emotion as a mainly physiologic process. However, intimate links between emotions and the body suggest that emotions are privileged phenomena to attempt to reintegrate mind and body and that the body helps the mind in shaping emotional responses. To date, research has favored the cerebrum over other parts of the brain as a substrate of embodied emotions. However, given the widely demonstrated contribution of the cerebellum to emotional processing, research in affective neuroscience should consider embodiment theory as a useful approach for evaluating the cerebellar role in emotion and affect. The aim of this review is to insert the cerebellum among the structures needed to embody emotions, providing illustrative examples of cerebellar involvement in embodied emotions (as occurring in empathic abilities) and in impaired identification and expression of embodied emotions (as occurring in alexithymia).

How a speaker herds the audience: Multi-brain neural convergence over time during naturalistic storytelling

Storytelling-an ancient way for humans to share individual experiences with others-has been found to induce neural synchronization among listeners. In our exploration of the dynamic fluctuations in listener-listener (LL) coupling throughout stories, we uncover a significant correlation between LL and lag-speaker-listener (lag-SL) couplings over time. Using the analogy of neural pattern (dis)similarity as distances between participants, we term this phenomenon the "herding effect": like a shepherd guiding a group of sheep, the more closely listeners follow the speaker's prior brain activity patterns (higher lag-SL similarity), the more tightly they cluster together (higher LL similarity). This herding effect is particularly pronounced in brain regions where neural synchronization among listeners tracks with behavioral ratings of narrative engagement, highlighting the mediating role of narrative content in the observed multi-brain neural coupling dynamics. By integrating LL and SL neural couplings, this study illustrates how unfolding stories shape a dynamic multi-brain functional network and how the configuration of this network may be associated with moment-by-moment efficacy of communication.

Neural patterns differentiate traumatic from sad autobiographical memories in PTSD

For people with post-traumatic stress disorder (PTSD), recall of traumatic memories often displays as intrusions that differ profoundly from processing of 'regular' negative memories. These mnemonic features fueled theories speculating a unique cognitive state linked with traumatic memories. Yet, to date, little empirical evidence supports this view. Here we examined neural activity of patients with PTSD who were listening to narratives depicting their own memories. An intersubject representational similarity analysis of cross-subject semantic content and neural patterns revealed a differentiation in hippocampal representation by narrative type: semantically similar, sad autobiographical memories elicited similar neural representations across participants. By contrast, within the same individuals, semantically similar trauma memories were not represented similarly. Furthermore, we were able to decode memory type from hippocampal multivoxel patterns. Finally, individual symptom severity modulated semantic representation of the traumatic narratives in the posterior cingulate cortex. Taken together, these findings suggest that traumatic memories are an alternative cognitive entity that deviates from memory per se.

Probing neurodynamics of experienced emotions-a Hitchhiker's guide to film fMRI

Film functional magnetic resonance imaging (fMRI) has gained tremendous popularity in many areas of neuroscience. However, affective neuroscience remains somewhat behind in embracing this approach, even though films lend themselves to study how brain function gives rise to complex, dynamic and multivariate emotions. Here, we discuss the unique capabilities of film fMRI for emotion research, while providing a general guide of conducting such research. We first give a brief overview of emotion theories as these inform important design choices. Next, we discuss films as experimental paradigms for emotion elicitation and address the process of annotating them. We then situate film fMRI in the context of other fMRI approaches, and present an overview of results from extant studies so far with regard to advantages of film fMRI. We also give an overview of state-of-the-art analysis techniques including methods that probe neurodynamics. Finally, we convey limitations of using film fMRI to study emotion. In sum, this review offers a practitioners' guide to the emerging field of film fMRI and underscores how it can advance affective neuroscience.

A normative model of brain responses to social scenarios reflects the maturity of children and adolescents' social-emotional abilities

The rapid brain maturation in childhood and adolescence accompanies the development of socio-emotional functioning. However, it is unclear how the maturation of the neural activity drives the development of socio-emotional functioning and individual differences. This study aimed to reflect the age dependence of inter-individual differences in brain responses to socio-emotional scenarios and to develop naturalistic imaging indicators to assess the maturity of socio-emotional ability at the individual level. Using three independent naturalistic imaging datasets containing healthy participants (n = 111, 21 and 122), we found and validated that age-modulated inter-individual concordance of brain responses to socio-emotional movies in specific brain regions. The similarity of an individual's brain response to the average response of older participants was defined as response typicality, which predicted an individual's emotion regulation strategies in adolescence and theory of mind (ToM) in childhood. Its predictive power was not superseded by age, sex, cognitive performance or executive function. We further showed that the movie's valence and arousal ratings grounded the response typicality. The findings highlight that forming typical brain response patterns may be a neural phenotype underlying the maturation of socio-emotional ability. The proposed response typicality represents a neuroimaging approach to measure individuals' maturity of cognitive reappraisal and ToM.

Examining the consistency of continuous affect annotations and psychophysiological measures in response to emotional videos

Despite the growing necessity of understanding the dynamics of emotion by naturalistic stimuli, averaging time-locked responses seems insufficient to capture emotional experiences that change over time. Intersubject correlation (ISC) has been implemented to examine dynamic emotional experiences by quantifying the consistency of responses across individuals. While previous research has shown that enhanced psychophysiological ISC can capture dynamic emotional experiences in response to long-lasting videos that evoke dimensional emotions, it is not yet fully understood how psychophysiological consistency varies during videos that elicit distinct emotions, such as fear. In this study, we re-analyzed publicly available data consisting of continuous affect annotations and psychophysiological signals, namely heart rate (HR), electrodermal activity (EDA), electromyographic signals from zygomaticus major (EMG-z), and corrugator supercilii (EMG-c), in response to categorical emotional videos, namely amusing, boring, relaxing, and fearful. Results showed an overall increase in ISC in multiple measures during fearful videos, indicating that emotional experiences during fearful videos were reliably consistent across participants. The effect of amusing and boring videos on ISC revealed varying results depending on the measurements. In particular, larger ISC in valence rating, EDA, and EMG-z was found for amusing than boring videos, whereas larger ISC in HR and EMG-c was observed for boring than amusing movies. Lastly, decreased ISC for relaxing videos was observed across multiple measurements, showing inconsistent emotional experiences during relaxing videos. This study builds on previous research on physiological consistency during emotional experiences by examining how the consistency of continuous affect annotations and psychophysiological measures differs in response to videos that elicit distinct emotions.

Synchronized affect in shared experiences strengthens social connection

People structure their days to experience events with others. We gather to eat meals, watch TV, and attend concerts together. What constitutes a shared experience and how does it manifest in dyadic behavior? The present study investigates how shared experiences-measured through emotional, motoric, physiological, and cognitive alignment-promote social bonding. We recorded the facial expressions and electrodermal activity (EDA) of participants as they watched four episodes of a TV show for a total of 4 h with another participant. Participants displayed temporally synchronized and spatially aligned emotional facial expressions and the degree of synchronization predicted the self-reported social connection ratings between viewing partners. We observed a similar pattern of results for dyadic physiological synchrony measured via EDA and their cognitive impressions of the characters. All four of these factors, temporal synchrony of positive facial expressions, spatial alignment of expressions, EDA synchrony, and character impression similarity, contributed to a latent factor of a shared experience that predicted social connection. Our findings suggest that the development of interpersonal affiliations in shared experiences emerges from shared affective experiences comprising synchronous processes and demonstrate that these complex interpersonal processes can be studied in a holistic and multi-modal framework leveraging naturalistic experimental designs.

Toward personalized circuit-based closed-loop brain-interventions in psychiatry: using symptom provocation to extract EEG-markers of brain circuit activity

Symptom provocation is a well-established component of psychiatric research and therapy. It is hypothesized that specific activation of those brain circuits involved in the symptomatic expression of a brain pathology makes the relevant neural substrate accessible as a target for therapeutic interventions. For example, in the treatment of obsessive-compulsive disorder (OCD), symptom provocation is an important part of psychotherapy and is also performed prior to therapeutic brain stimulation with transcranial magnetic stimulation (TMS). Here, we discuss the potential of symptom provocation to isolate neurophysiological biomarkers reflecting the fluctuating activity of relevant brain networks with the goal of subsequently using these markers as targets to guide therapy. We put forward a general experimental framework based on the rapid switching between psychiatric symptom states. This enable neurophysiological measures to be derived from EEG and/or TMS-evoked EEG measures of brain activity during both states. By subtracting the data recorded during the baseline state from that recorded during the provoked state, the resulting contrast would ideally isolate the specific neural circuits differentially activated during the expression of symptoms. A similar approach enables the design of effective classifiers of brain activity from EEG data in Brain-Computer Interfaces (BCI). To obtain reliable contrast data, psychiatric state switching needs to be achieved multiple times during a continuous recording so that slow changes of brain activity affect both conditions equally. This is achieved easily for conditions that can be controlled intentionally, such as motor imagery, attention, or memory retention. With regard to psychiatric symptoms, an increase can often be provoked effectively relatively easily, however, it can be difficult to reliably and rapidly return to a baseline state. Here, we review different approaches to return from a provoked state to a baseline state and how these may be applied to different symptoms occurring in different psychiatric disorders.

Neural synchronization as a function of engagement with the narrative

We can all agree that a good story engages us, however, agreeing which story is good is far more debatable. In this study, we explored whether engagement with a narrative synchronizes listeners' brain responses, by examining individual differences in engagement to the same story. To do so, we pre-registered and re-analyzed a previously collected dataset by Chang et al. (2021) of functional Magnetic Resonance Imaging (fMRI) scans of 25 participants who listened to a one-hour story and answered questionnaires. We assessed the degree of their overall engagement with the story and their engagement with the main characters. The questionnaires revealed individual differences in engagement with the story, as well as different valence towards specific characters. Neuroimaging data showed that the auditory cortex, the default mode network (DMN) and language regions were involved in processing the story. Increased engagement with the story was correlated with increased neural synchronization within regions in the DMN (especially the medial prefrontal cortex), as well as regions outside the DMN such as the dorso-lateral prefrontal cortex and the reward system. Interestingly, positively and negatively engaging characters elicited different patterns of neural synchronization. Finally, engagement increased functional connectivity within and between the DMN, the ventral attention network and the control network. Taken together, these findings suggest that engagement with a narrative synchronizes listeners' responses in regions involved in mentalizing, reward, working memory and attention. By examining individual differences in engagement, we revealed that these synchronization patterns are due to engagement, and not due to differences in the narrative's content.

Information load dynamically modulates functional brain connectivity during narrative listening

Narratives are paradigmatic examples of natural language, where nouns represent a proxy of information. Functional magnetic resonance imaging (fMRI) studies revealed the recruitment of temporal cortices during noun processing and the existence of a noun-specific network at rest. Yet, it is unclear whether, in narratives, changes in noun density influence the brain functional connectivity, so that the coupling between regions correlates with information load. We acquired fMRI activity in healthy individuals listening to a narrative with noun density changing over time and measured whole-network and node-specific degree and betweenness centrality. Network measures were correlated with information magnitude with a time-varying approach. Noun density correlated positively with the across-regions average number of connections and negatively with the average betweenness centrality, suggesting the pruning of peripheral connections as information decreased. Locally, the degree of the bilateral anterior superior temporal sulcus (aSTS) was positively associated with nouns. Importantly, aSTS connectivity cannot be explained by changes in other parts of speech (e.g., verbs) or syllable density. Our results indicate that the brain recalibrates its global connectivity as a function of the information conveyed by nouns in natural language. Also, using naturalistic stimulation and network metrics, we corroborate the role of aSTS in noun processing.

Naturalistic viewing increases individual identifiability based on connectivity within functional brain networks

Naturalistic viewing (NV) is currently considered a promising paradigm for studying individual differences in functional brain organization. While whole brain functional connectivity (FC) under NV has been relatively well characterized, so far little work has been done on a network level. Here, we extend current knowledge by characterizing the influence of NV on FC in fourteen meta-analytically derived brain networks considering three different movie stimuli in comparison to resting-state (RS). We show that NV increases identifiability of individuals over RS based on functional connectivity in certain, but not all networks. Furthermore, movie stimuli including a narrative appear more distinct from RS. In addition, we assess individual variability in network FC by comparing within- and between-subject similarity during NV and RS. We show that NV can evoke individually distinct NFC patterns by increasing inter-subject variability while retaining within-subject similarity. Crucially, our results highlight that this effect is not observable across all networks, but rather dependent on the network-stimulus combination. Our results confirm that NV can improve the detection of individual differences over RS and underline the importance of selecting the appropriate combination of movie and cognitive network for the research question at hand.

Decoding brain basis of laughter and crying in natural scenes

Laughter and crying are universal signals of prosociality and distress, respectively. Here we investigated the functional brain basis of perceiving laughter and crying using naturalistic functional magnetic resonance imaging (fMRI) approach. We measured haemodynamic brain activity evoked by laughter and crying in three experiments with 100 subjects in each. The subjects i) viewed a 20-minute medley of short video clips, and ii) 30 minutes of a full-length feature film, and iii) listened to 15 minutes of a radio play that all contained bursts of laughter and crying. Intensity of laughing and crying in the videos and radio play was annotated by independent observes, and the resulting time series were used to predict hemodynamic activity to laughter and crying episodes. Multivariate pattern analysis (MVPA) was used to test for regional selectivity in laughter and crying evoked activations. Laughter induced widespread activity in ventral visual cortex and superior and middle temporal and motor cortices. Crying activated thalamus, cingulate cortex along the anterior-posterior axis, insula and orbitofrontal cortex. Both laughter and crying could be decoded accurately (66-77% depending on the experiment) from the BOLD signal, and the voxels contributing most significantly to classification were in superior temporal cortex. These results suggest that perceiving laughter and crying engage distinct neural networks, whose activity suppresses each other to manage appropriate behavioral responses to others' bonding and distress signals.

Functional connectivity profiles of the default mode and visual networks reflect temporal accumulative effects of sustained naturalistic emotional experience

Determining and decoding emotional brain processes under ecologically valid conditions remains a key challenge in affective neuroscience. The current functional Magnetic Resonance Imaging (fMRI) based emotion decoding studies are mainly based on brief and isolated episodes of emotion induction, while sustained emotional experience in naturalistic environments that mirror daily life experiences are scarce. Here we used 12 different 10-minute movie clips as ecologically valid emotion-evoking procedures in n = 52 individuals to explore emotion-specific fMRI functional connectivity (FC) profiles on the whole-brain level at high spatial resolution (432 parcellations including cortical and subcortical structures). Employing machine-learning based decoding and cross validation procedures allowed to investigate FC profiles contributing to classification that can accurately distinguish sustained happiness and sadness and that generalize across subjects, movie clips, and parcellations. Both functional brain network-based and subnetwork-based emotion classification results suggested that emotion manifests as distributed representation of multiple networks, rather than a single functional network or subnetwork. Further, the results showed that the Visual Network (VN) and Default Mode Network (DMN) associated functional networks, especially VN-DMN, exhibited a strong contribution to emotion classification. To further estimate the temporal accumulative effect of naturalistic long-term movie-based video-evoking emotions, we divided the 10-min episode into three stages: early stimulation (1∼200 s), middle stimulation (201∼400 s), and late stimulation (401∼600 s) and examined the emotion classification performance at different stimulation stages. We found that the late stimulation contributes most to the classification (accuracy=85.32%, F1-score=85.62%) compared to early and middle stimulation stages, implying that continuous exposure to emotional stimulation can lead to more intense emotions and further enhance emotion-specific distinguishable representations. The present work demonstrated that sustained happiness and sadness under naturalistic conditions are presented in emotion-specific network profiles and these expressions may play different roles in the generation and modulation of emotions. These findings elucidated the importance of network level adaptations for sustained emotional experiences during naturalistic contexts and open new venues for imaging network level contributions under naturalistic conditions.

Functional organization of social perception in the human brain

Humans rapidly extract diverse and complex information from ongoing social interactions, but the perceptual and neural organization of the different aspects of social perception remains unresolved. We showed short movie clips with rich social content to 97 healthy participants while their haemodynamic brain activity was measured with fMRI. The clips were annotated moment-to-moment for a large set of social features and 45 of the features were evaluated reliably between annotators. Cluster analysis of the social features revealed that 13 dimensions were sufficient for describing the social perceptual space. Three different analysis methods were used to map the social perceptual processes in the human brain. Regression analysis mapped regional neural response profiles for different social dimensions. Multivariate pattern analysis then established the spatial specificity of the responses and intersubject correlation analysis connected social perceptual processing with neural synchronization. The results revealed a gradient in the processing of social information in the brain. Posterior temporal and occipital regions were broadly tuned to most social dimensions and the classifier revealed that these responses showed spatial specificity for social dimensions; in contrast Heschl gyri and parietal areas were also broadly associated with different social signals, yet the spatial patterns of responses did not differentiate social dimensions. Frontal and subcortical regions responded only to a limited number of social dimensions and the spatial response patterns did not differentiate social dimension. Altogether these results highlight the distributed nature of social processing in the brain.

Depression core network-based individualized targeting for transcranial magnetic stimulation

BACKGROUND

Transcranial magnetic stimulation (TMS) of the dorsolateral prefrontal cortex (DLPFC) is an established treatment for major depressive disorder (MDD). Recent attempts to improve TMS efficacy by individually targeting DLPFC subregions that are functionally connected to the subgenual anterior cingulate cortex (sgACC) appear promising. However, sgACC covers only a small subset of core MDD-related areas. Further, fMRI connectivity of sgACC is poorly repeatable within subjects.

METHODS

Based on an fMRI database analysis, we first constructed a novel core network model (CNM), capturing voxelwise emotion regulation- and MDD-related DLPFC connectivity. Then, in a sample of 15 healthy subjects and 29 MDD patients, we assessed (i) within-subject repeatability of the DLPFC connectivity patterns computed from time segments of varying lengths of individual-level fMRI data and (ii) association of MDD severity with the individual DLPFC connectivity strengths. We extracted group-level connectivity strengths in CNM from individual DLPFC coordinates stimulated with neuronavigated TMS in a separate sample of 25 MDD patients. These connectivity strengths were then correlated with individual TMS efficacy.

RESULTS

Compared with sgACC connectivity, CNM increased intraindividual repeatability 5-fold. DLPFC connectivity strength from CNM was associated with MDD severity and TMS efficacy. While the locations of CNM-based individual TMS targets remained constant within individuals, they varied considerably between individuals.

CONCLUSIONS

CNM increased repeatability of functional targeting to a clinically feasible level. The observed association of MDD severity and TMS efficacy with DLPFC connectivity supports the validity of the CNM. The interindividual differences in target locations motivate future individualized clinical trials leveraging the CNM.

How processing emotion affects language control in bilinguals

Research has shown that several variables affect language control among bilingual speakers but the effect of affective processing remains unexplored. Chinese-English bilinguals participated in a novel prime-target language switching experiment in which they first judged the affective valence (i.e., positive or negative) of auditorily presented words and then named pictures with neutral emotional valence in either the same (non-switch trial) or different language (switch trial). Brain activity was monitored using functional magnetic resonance imaging (fMRI). The behavioral performance showed that the typical switch cost (i.e., the calculated difference between switch and non-switch trials) emerged after processing positive words but not after negative words. Brain imaging demonstrated that processing negative words immediately before non-switch picturing naming trials (but not for switch trials) increased activation in brain areas associated with domain-general cognitive control. The opposite patterns were found after processing positive words. These findings suggest that an (emotional) negative priming effect is induced by spontaneous exposure to negative words and that these priming effects may be triggered by reactive emotional processing and that they may interact with higher level cognitive functions.

Narrative theory v: Narratives about penalties resulting from illegal tobacco purchases increase psychological distress

Previous research with individuals with substance use disorder indicated that different narratives have different effects on one's behaviors and decision-making. One question that remains unanswered is whether simulating real-world consequences of illegal purchases using narratives would induce psychological distress levels as expected in real-world situations. The present experiment used a between-group design to study how different narratives regarding penalties impact smokers' affective state and more specifically, psychological distress. Participants (N = 93) were randomized into one of the three groups: (a) legal tobacco purchases (LTP), (b) illegal tobacco purchases with fines (ITP_F), and (c) illegal tobacco purchases with fines, criminal record, and negative public exposure (ITP_F + CR + NPE) to complete an online survey. The survey contained one narrative randomly assigned to each participant, demographic questions, the heaviness of smoking index, the Positive and Negative Affect Schedule (PANAS), and a single-item psychological distress question. The results showed that (a) narratives about making illegal tobacco purchases significantly increased psychological distress when compared to narratives about making LTP, (b) no differences were observed on psychological distress and negative affective state between a narrative describing a fine and a narrative describing a fine, a criminal record, and negative public exposure, and (c) a narrative about a criminal record had the greatest effect on psychological distress among the different narratives about penalty types. Narratives involving illegal purchases increase psychological distress, which varies according to the hypothetical penalties described. More research regarding the use of narratives on decision-making and purchasing of hypothetical substances is warranted. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Lipreading a naturalistic narrative in a female population: Neural characteristics shared with listening and reading

INTRODUCTION

Few of us are skilled lipreaders while most struggle with the task. Neural substrates that enable comprehension of connected natural speech via lipreading are not yet well understood.

METHODS

We used a data-driven approach to identify brain areas underlying the lipreading of an 8-min narrative with participants whose lipreading skills varied extensively (range 6-100%, mean = 50.7%). The participants also listened to and read the same narrative. The similarity between individual participants' brain activity during the whole narrative, within and between conditions, was estimated by a voxel-wise comparison of the Blood Oxygenation Level Dependent (BOLD) signal time courses.

RESULTS

Inter-subject correlation (ISC) of the time courses revealed that lipreading, listening to, and reading the narrative were largely supported by the same brain areas in the temporal, parietal and frontal cortices, precuneus, and cerebellum. Additionally, listening to and reading connected naturalistic speech particularly activated higher-level linguistic processing in the parietal and frontal cortices more consistently than lipreading, probably paralleling the limited understanding obtained via lip-reading. Importantly, higher lipreading test score and subjective estimate of comprehension of the lipread narrative was associated with activity in the superior and middle temporal cortex.

CONCLUSIONS

Our new data illustrates that findings from prior studies using well-controlled repetitive speech stimuli and stimulus-driven data analyses are also valid for naturalistic connected speech. Our results might suggest an efficient use of brain areas dealing with phonological processing in skilled lipreaders.

Information flow across the cortical timescale hierarchy during narrative construction

When listening to spoken narratives, we must integrate information over multiple, concurrent timescales, building up from words to sentences to paragraphs to a coherent narrative. Recent evidence suggests that the brain relies on a chain of hierarchically organized areas with increasing temporal receptive windows to process naturalistic narratives. We hypothesized that the structure of this cortical processing hierarchy should result in an observable sequence of response lags between networks comprising the hierarchy during narrative comprehension. This study uses functional MRI to estimate the response lags between functional networks during narrative comprehension. We use intersubject cross-correlation analysis to capture network connectivity driven by the shared stimulus. We found a fixed temporal sequence of response lags-on the scale of several seconds-starting in early auditory areas, followed by language areas, the attention network, and lastly the default mode network. This gradient is consistent across eight distinct stories but absent in data acquired during rest or using a scrambled story stimulus, supporting our hypothesis that narrative construction gives rise to internetwork lags. Finally, we build a simple computational model for the neural dynamics underlying the construction of nested narrative features. Our simulations illustrate how the gradual accumulation of information within the boundaries of nested linguistic events, accompanied by increased activity at each level of the processing hierarchy, can give rise to the observed lag gradient.

IDEST: International Database of Emotional Short Texts

We introduce a database (IDEST) of 250 short stories rated for valence, arousal, and comprehensibility in two languages. The texts, with a narrative structure telling a story in the first person and controlled for length, were originally written in six different languages (Finnish, French, German, Portuguese, Spanish, and Turkish), and rated for arousal, valence, and comprehensibility in the original language. The stories were translated into English, and the same ratings for the English translations were collected via an internet survey tool (N = 573). In addition to the rating data, we also report readability indexes for the original and English texts. The texts have been categorized into different story types based on their emotional arc. The texts score high on comprehensibility and represent a wide range of emotional valence and arousal levels. The comparative analysis of the ratings of the original texts and English translations showed that valence ratings were very similar across languages, whereas correlations between the two pairs of language versions for arousal and comprehensibility were modest. Comprehensibility ratings correlated with only some of the readability indexes. The database is published in osf.io/9tga3, and it is freely available for academic research.

Ongoing first-hand pain facilitates somatosensory resonance but inhibits affective sharing in empathy for pain

Alterations of empathy for others' pain among patients with chronic pain remained inconsistent. Here, applying a capsaicin-based ongoing pain model on healthy participants, this study investigated how ongoing first-hand pain influences empathic reactions to vicarious pain stimuli. Healthy participants were randomly treated with topical capsaicin cream (capsaicin group) or hand cream (control group) on the left forearm. Video clips showing limbs in painful and non-painful situations were used to induce empathic responses. The capsaicin group showed greater empathic neural responses in the right primary somatosensory cortex (S1) than the control group but smaller responses in the left anterior insula (AI) accompanied with smaller empathic pain-intensity ratings. Notably, the intensity of ongoing pain negatively correlated with empathy-related neural responses in the left AI. Inter-subject phase synchronization analysis was used to assess stimulus-dependent dynamic functional connectivity within or between brain regions engaged in pain empathy. The capsaicin group showed greater empathy-related neural synchronization within S1 and between S1 and AI, but less synchronization within AI and between AI and MCC. Behaviorally, the differential inter-subject pain-intensity rating alignment between painful and non-painful videos was more positive for the capsaicin group than for the control group, and this effect was partially mediated by the inter-subject neural synchronization between S1 and AI. These results suggest that ongoing first-hand pain facilitates neural activation and synchronization within brain regions associated with empathy-related somatosensory resonance at the cost of inhibiting activation and synchronization within brain regions engaged in empathy-related affective sharing.

Recent Trends in Non-invasive Neural Recording Based Brain-to-Brain Synchrony Analysis on Multidisciplinary Human Interactions for Understanding Brain Dynamics: A Systematic Review

The study of brain-to-brain synchrony has a burgeoning application in the brain-computer interface (BCI) research, offering valuable insights into the neural underpinnings of interacting human brains using numerous neural recording technologies. The area allows exploring the commonality of brain dynamics by evaluating the neural synchronization among a group of people performing a specified task. The growing number of publications on brain-to-brain synchrony inspired the authors to conduct a systematic review using the PRISMA protocol so that future researchers can get a comprehensive understanding of the paradigms, methodologies, translational algorithms, and challenges in the area of brain-to-brain synchrony research. This review has gone through a systematic search with a specified search string and selected some articles based on pre-specified eligibility criteria. The findings from the review revealed that most of the articles have followed the social psychology paradigm, while 36% of the selected studies have an application in cognitive neuroscience. The most applied approach to determine neural connectivity is a coherence measure utilizing phase-locking value (PLV) in the EEG studies, followed by wavelet transform coherence (WTC) in all of the fNIRS studies. While most of the experiments have control experiments as a part of their setup, a small number implemented algorithmic control, and only one study had interventional or a stimulus-induced control experiment to limit spurious synchronization. Hence, to the best of the authors' knowledge, this systematic review solely contributes to critically evaluating the scopes and technological advances of brain-to-brain synchrony to allow this discipline to produce more effective research outcomes in the remote future.

Phase-based causality analysis with partial mutual information from mixed embedding

Instantaneous phases extracted from multivariate time series can retain information about the relationships between the underlying mechanisms that generate the series. Although phases have been widely used in the study of nondirectional coupling and connectivity, they have not found similar appeal in the study of causality. Herein, we present a new method for phase-based causality analysis, which combines ideas from the mixed embedding technique and the information-theoretic approach to causality in coupled oscillatory systems. We then use the introduced method to investigate causality in simulated datasets of bivariate, unidirectionally paired systems from combinations of Rössler, Lorenz, van der Pol, and Mackey-Glass equations. We observe that causality analysis using the phases can capture the true causal relation for coupling strength smaller than the analysis based on the amplitudes can capture. On the other hand, the causality estimation based on the phases tends to have larger variability, which is attributed more to the phase extraction process than the actual phase-based causality method. In addition, an application on real electroencephalographic data from an experiment on elicited human emotional states reinforces the usefulness of phases in causality identification.

Behavioral Experience-Sampling Methods in Neuroimaging Studies With Movie and Narrative Stimuli

Movies and narratives are increasingly utilized as stimuli in functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and electroencephalography (EEG) studies. Emotional reactions of subjects, what they pay attention to, what they memorize, and their cognitive interpretations are all examples of inner experiences that can differ between subjects during watching of movies and listening to narratives inside the scanner. Here, we review literature indicating that behavioral measures of inner experiences play an integral role in this new research paradigm via guiding neuroimaging analysis. We review behavioral methods that have been developed to sample inner experiences during watching of movies and listening to narratives. We also review approaches that allow for joint analyses of the behaviorally sampled inner experiences and neuroimaging data. We suggest that building neurophenomenological frameworks holds potential for solving the interrelationships between inner experiences and their neural underpinnings. Finally, we tentatively suggest that recent developments in machine learning approaches may pave way for inferring different classes of inner experiences directly from the neuroimaging data, thus potentially complementing the behavioral self-reports.

Intersubject correlation analysis reveals the plasticity of cerebral functional connectivity in the long‐term use of social media

Owing to the limitations of cross‐sectional studies, it is unclear whether social media induce brain changes, or if individuals with certain biological traits are more likely to use social media. Functional connectivity (FC) can reflect cerebral functional plasticity, and if social media can influence cerebral FC, then the FC of light social media users should be more similar to that of heavy users after they “heavily” used social media for a long period. We combined longitudinal study design and intersubject correlation (ISC) analysis to investigate this similarity. Thirty‐five heavy and 21 light social media users underwent cognitive tests and functional MRIs. The 21 light social media users underwent another functional MRI scan after completing an additional four‐week social media task. We conducted the ISC at the group, individual, and brain‐region levels to investigate the similarity of FC and locate the brain regions most affected by social media. The FC of light social media users was more similar to that of heavy social media users after they completed the four‐week social media task. Then, social media had an impact on half of the brain, involving almost all brain networks. Finally, cerebral FC that mostly affected by social media was associated with selective attention. We concluded that the impact of social media use on cerebral functional connectivity changes is revealed by ISC method and longitudinal design, which may provide guidance for clinical practice. The methods used in the current research could also be applied to similar domains.

Classification of emotion categories based on functional connectivity patterns of the human brain

Neurophysiological and psychological models posit that emotions depend on connections across wide-spread corticolimbic circuits. While previous studies using pattern recognition on neuroimaging data have shown differences between various discrete emotions in brain activity patterns, less is known about the differences in functional connectivity. Thus, we employed multivariate pattern analysis on functional magnetic resonance imaging data (i) to develop a pipeline for applying pattern recognition in functional connectivity data, and (ii) to test whether connectivity patterns differ across emotion categories. Six emotions (anger, fear, disgust, happiness, sadness, and surprise) and a neutral state were induced in 16 participants using one-minute-long emotional narratives with natural prosody while brain activity was measured with functional magnetic resonance imaging (fMRI). We computed emotion-wise connectivity matrices both for whole-brain connections and for 10 previously defined functionally connected brain subnetworks and trained an across-participant classifier to categorize the emotional states based on whole-brain data and for each subnetwork separately. The whole-brain classifier performed above chance level with all emotions except sadness, suggesting that different emotions are characterized by differences in large-scale connectivity patterns. When focusing on the connectivity within the 10 subnetworks, classification was successful within the default mode system and for all emotions. We thus show preliminary evidence for consistently different sustained functional connectivity patterns for instances of emotion categories particularly within the default mode system.

Decreased intersubject synchrony in dynamic valence ratings of sad movie contents in dysphoric individuals

Emotional reactions to movies are typically similar between people. However, depressive symptoms decrease synchrony in brain responses. Less is known about the effect of depressive symptoms on intersubject synchrony in conscious stimulus-related processing. In this study, we presented amusing, sad and fearful movie clips to dysphoric individuals (those with elevated depressive symptoms) and control participants to dynamically rate the clips' valences (positive vs. negative). We analysed both the valence ratings' mean values and intersubject correlation (ISC). We used electrodermal activity (EDA) to complement the measurement in a separate session. There were no group differences in either the EDA or mean valence rating values for each movie type. As expected, the valence ratings' ISC was lower in the dysphoric than the control group, specifically for the sad movie clips. In addition, there was a negative relationship between the valence ratings' ISC and depressive symptoms for sad movie clips in the full sample. The results are discussed in the context of the negative attentional bias in depression. The findings extend previous brain activity results of ISC by showing that depressive symptoms also increase variance in conscious ratings of valence of stimuli in a mood-congruent manner.

Brain and motor synchrony in children and adolescents with ASD-a fNIRS hyperscanning study

Brain-to-brain synchrony has been proposed as an important mechanism underlying social interaction. While first findings indicate that it may be modulated in children with autism spectrum disorder (ASD), no study to date has investigated the influence of different interaction partners and task characteristics. Using functional near-infrared spectroscopy hyperscanning, we assessed brain-to-brain synchrony in 41 male typically developing (TD) children (8–18 years; control sample), as well as 18 children with ASD and age-matched TD children (matched sample), while performing cooperative and competitive tasks with their parents and an adult stranger. Dyads were instructed either to respond jointly in response to a target (cooperation) or to respond faster than the other player (competition). Wavelet coherence was calculated for oxy- and deoxyhemoglobin brain signals. In the control sample, a widespread enhanced coherence was observed for parent–child competition, and a more localized coherence for parent–child cooperation in the frontopolar cortex. While behaviorally, children with ASD showed a lower motor synchrony than children in the TD group, no significant group differences were observed on the neural level. In order to identify biomarkers for typical and atypical social interactions in the long run, more research is needed to investigate the neurobiological underpinnings of reduced synchrony in ASD.

Statistical pattern recognition reveals shared neural signatures for displaying and recognizing specific facial expressions

Human neuroimaging and behavioural studies suggest that somatomotor ‘mirroring’ of seen facial expressions may support their recognition. Here we show that viewing specific facial expressions triggers the representation corresponding to that expression in the observer’s brain. Twelve healthy female volunteers underwent two separate fMRI sessions: one where they observed and another where they displayed three types of facial expressions (joy, anger and disgust). Pattern classifier based on Bayesian logistic regression was trained to classify facial expressions (i) within modality (trained and tested with data recorded while observing or displaying expressions) and (ii) between modalities (trained with data recorded while displaying expressions and tested with data recorded while observing the expressions). Cross-modal classification was performed in two ways: with and without functional realignment of the data across observing/displaying conditions. All expressions could be accurately classified within and also across modalities. Brain regions contributing most to cross-modal classification accuracy included primary motor and somatosensory cortices. Functional realignment led to only minor increases in cross-modal classification accuracy for most of the examined ROIs. Substantial improvement was observed in the occipito-ventral components of the core system for facial expression recognition. Altogether these results support the embodied emotion recognition model and show that expression-specific somatomotor neural signatures could support facial expression recognition.

Naturalistic Stimuli in Affective Neuroimaging: A Review

Naturalistic stimuli such as movies, music, and spoken and written stories elicit strong emotions and allow brain imaging of emotions in close-to-real-life conditions. Emotions are multi-component phenomena: relevant stimuli lead to automatic changes in multiple functional components including perception, physiology, behavior, and conscious experiences. Brain activity during naturalistic stimuli reflects all these changes, suggesting that parsing emotion-related processing during such complex stimulation is not a straightforward task. Here, I review affective neuroimaging studies that have employed naturalistic stimuli to study emotional processing, focusing especially on experienced emotions. I argue that to investigate emotions with naturalistic stimuli, we need to define and extract emotion features from both the stimulus and the observer.

Inter-subject phase synchronization differentiates neural networks underlying physical pain empathy

Recent approaches for understanding the neural basis of pain empathy emphasize the dynamic construction of networks underlying this multifaceted social cognitive process. Inter-subject phase synchronization (ISPS) is an approach for exploratory analysis of task-fMRI data that reveals brain networks dynamically synchronized to task-features across participants. We applied ISPS to task-fMRI data assessing vicarious pain empathy in healthy participants (n = 238). The task employed physical (limb) and affective (face) painful and corresponding non-painful visual stimuli. ISPS revealed two distinct networks synchronized during physical pain observation, one encompassing anterior insula and midcingulate regions strongly engaged in (vicarious) pain and another encompassing parietal and inferior frontal regions associated with social cognitive processes which may modulate and support the physical pain empathic response. No robust network synchronization was observed for affective pain, possibly reflecting high inter-individual variation in response to socially transmitted pain experiences. ISPS also revealed networks related to task onset or general processing of physical (limb) or affective (face) stimuli which encompassed networks engaged in object manipulation or face processing, respectively. Together, the ISPS approach permits segregation of networks engaged in different psychological processes, providing additional insight into shared neural mechanisms of empathy for physical pain, but not affective pain, across individuals.

Escitalopram enhances synchrony of brain responses during emotional narratives in patients with major depressive disorder

One-week treatment with escitalopram decreases amygdala responses to fearful facial expressions in depressed patients, but it remains unknown whether it also modulates processing of complex and freely processed emotional stimuli resembling daily life emotional situations. Inter-subject correlation (ISC) offers a means to track brain activity during complex, dynamic stimuli in a model-free manner. Twenty-nine treatment-seeking patients with major depressive disorder were randomized in a double-blind study design to receive either escitalopram or placebo for one week, after which functional magnetic resonance imaging (fMRI) was performed. During fMRI the participants listened to spoken emotional narratives. Level of ISC between the escitalopram and the placebo group was compared across all the narratives and separately for the episodes with positive and negative valence. Across all the narratives, the escitalopram group had higher ISC in the default mode network of the brain as well as in the fronto-temporal narrative processing regions, whereas lower ISC was seen in the middle temporal cortex, hippocampus and occipital cortex. Escitalopram increased ISC during positive parts of the narratives in the precuneus, medial prefrontal cortex, anterior cingulate and fronto-insular cortex, whereas there was no significant synchronization in brain responses to positive vs negative events in the placebo group. Increased ISC may imply improved emotional synchronization with others, particularly during observation of positive events. Further studies are needed to test whether this contributes to the later therapeutic effect of escitalopram.

The Embodied-Enactive-Interactive Brain: Bridging Neuroscience and Creative Arts Therapies

The recognition and incorporation of evidence-based neuroscientific concepts into creative arts therapeutic knowledge and practice seem valuable and advantageous for the purpose of integration and professional development. Moreover, exhilarating insights from the field of neuroscience coincide with the nature, conceptualization, goals, and methods of Creative Arts Therapies (CATs), enabling comprehensive understandings of the clinical landscape, from a translational perspective. This paper contextualizes and discusses dynamic brain functions that have been suggested to lie at the heart of intra- and inter-personal processes. Touching upon fundamental aspects of the self and self-other interaction, the state-of-the-art neuroscientific-informed views will shed light on mechanisms of the embodied, predictive and relational brain. The conceptual analysis introduces and interweaves the following contemporary perspectives of brain function: firstly, the grounding of mental activity in the lived, bodily experience will be delineated; secondly, the enactive account of internal models, or generative predictive representations, shaped by experience, will be defined and extensively deliberated; and thirdly, the interpersonal simulation and synchronization mechanisms that support empathy and mentalization will be thoroughly considered. Throughout the paper, the cross-talks between the brain and the body, within the brain through functionally connected neural networks and in the context of agent-environment dynamics, will be addressed. These communicative patterns will be elaborated on to unfold psychophysiological linkage, as well as psychopathological shifts, concluding with the neuroplastic change associated with the formulation of CATs. The manuscript suggests an integrative view of the brain-body-mind in contexts relevant to the therapeutic potential of the expressive creative arts and the main avenues by which neuroscience may ground, enlighten and enrich the clinical psychotherapeutic practice.

Decoding Music-Evoked Emotions in the Auditory and Motor Cortex

Music can induce strong subjective experience of emotions, but it is debated whether these responses engage the same neural circuits as emotions elicited by biologically significant events. We examined the functional neural basis of music-induced emotions in a large sample (n = 102) of subjects who listened to emotionally engaging (happy, sad, fearful, and tender) pieces of instrumental music while their hemodynamic brain activity was measured with functional magnetic resonance imaging (fMRI). Ratings of the four categorical emotions and liking were used to predict hemodynamic responses in general linear model (GLM) analysis of the fMRI data. Multivariate pattern analysis (MVPA) was used to reveal discrete neural signatures of the four categories of music-induced emotions. To map neural circuits governing non-musical emotions, the subjects were scanned while viewing short emotionally evocative film clips. The GLM revealed that most emotions were associated with activity in the auditory, somatosensory, and motor cortices, cingulate gyrus, insula, and precuneus. Fear and liking also engaged the amygdala. In contrast, the film clips strongly activated limbic and cortical regions implicated in emotional processing. MVPA revealed that activity in the auditory cortex and primary motor cortices reliably discriminated the emotion categories. Our results indicate that different music-induced basic emotions have distinct representations in regions supporting auditory processing, motor control, and interoception but do not strongly rely on limbic and medial prefrontal regions critical for emotions with survival value.

Movies and narratives as naturalistic stimuli in neuroimaging

Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity.

Idiosynchrony: From shared responses to individual differences during naturalistic neuroimaging

Two ongoing movements in human cognitive neuroscience have researchers shifting focus from group-level inferences to characterizing single subjects, and complementing tightly controlled tasks with rich, dynamic paradigms such as movies and stories. Yet relatively little work combines these two, perhaps because traditional analysis approaches for naturalistic imaging data are geared toward detecting shared responses rather than between-subject variability. Here, we review recent work using naturalistic stimuli to study individual differences, and advance a framework for detecting structure in idiosyncratic patterns of brain activity, or "idiosynchrony". Specifically, we outline the emerging technique of inter-subject representational similarity analysis (IS-RSA), including its theoretical motivation and an empirical demonstration of how it recovers brain-behavior relationships during movie watching using data from the Human Connectome Project. We also consider how stimulus choice may affect the individual signal and discuss areas for future research. We argue that naturalistic neuroimaging paradigms have the potential to reveal meaningful individual differences above and beyond those observed during traditional tasks or at rest.

Neural Processing of Narratives: From Individual Processing to Viral Propagation

Narratives, in the form of, e.g., written stories, mouth-to-mouth accounts, audiobooks, fiction movies, and media-feeds, powerfully shape the perception of reality and widely influence human decision-making. In this review, we describe findings from recent neuroimaging studies unraveling how narratives influence the human brain, thus shaping perception, cognition, emotions, and decision-making. It appears that narrative sense-making relies on default-mode network (DMN) structures of the brain, especially precuneus. Activity in precuneus further seems to differ for fictitious vs. real narratives. Notably, high inter-subject correlation (ISC) of brain activity during narrative processing seems to predict the efficacy of a narrative. Factors that enhance the ISC of brain activity during narratives include higher levels of attention, emotional arousal, and negative emotional valence. Higher levels of attentional suspense seem to co-vary with activity in the temporoparietal junction, emotional arousal with activity in dorsal attention network, and negative emotional valence with activity in DMN. Lingering after-effects of emotional narratives have been further described in DMN, amygdala, and sensory cortical areas. Finally, inter-individual differences in personality, and cultural-background related analytical and holistic thinking styles, shape ISC of brain activity during narrative perception. Together, these findings offer promising leads for future studies elucidating the effects of narratives on the human brain, and how such effects might predict the efficacy of narratives in modulating decision-making.

Narrative theory III: Evolutionary narratives addressing mating motives change discounting and tobacco valuation

Relationships between discounting and addictive behaviors have both state- and trait-based components. Evolutionarily driven motives may trigger risk-taking behaviors, and narratives might be used to alter the temporal window of reward valuation. The current investigation-in 2 separate studies-sought to understand the basic effects of narratives on smoking behavior by examining the effect of mating narratives on the discounting rates of cigarette smokers. Using data collected online, Study 1 (N = 132) assessed the within-individual effect of a mating narrative describing a long-term romantic relationship on rates of discounting after being randomly assigned to 1 of 2 narratives (romance or control) and Study 2 (N = 273) assessed the between-individual effect of 2 mating narratives (1 describing a long-term romantic relationship and 1 describing a short-term sexual encounter) on rates of discounting, craving, and cigarette valuation after being randomly assigned to 1 of 3 motivational narratives (romance, sex, or control). Reading the romance narrative decreased rates of discounting (i.e., increased preference for larger delayed rewards), compared to a control narrative (Studies 1 and 2). In contrast, reading the sexual narrative increased discounting (i.e., decreased preference for larger delayed rewards). Moreover, the romance narrative significantly decreased craving of cigarettes while the sexual narrative increased cigarette valuation (Study 2). These findings suggest that mating narratives may be useful in manipulating the temporal window of reward valuation, relevant for altering demand and craving, and may show potential as a component of future behavioral addiction interventions. Given the small effect sizes, replicating the study in future research will be beneficial. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Fluctuation in Pupil Size and Spontaneous Blinks Reflect Story Transportation

Thirty-nine participants listened to 28 neutral and horror excerpts of Stephen King short stories while constantly tracking their emotional arousal. Pupil size was measured with an Eyelink 1000+, and participants rated valence and transportation after each story. In addition to computing mean pupil size across 1-sec intervals, we extracted blink count and used detrended fluctuation analysis (DFA) to obtain the scaling exponents of long-range temporal correlations (LRTCs) in pupil size time-series. Pupil size was expected to be sensitive also to emotional arousal, whereas blink count and LRTC's were expected to reflect cognitive engagement. The results showed that self-reported arousal increased, pupil size was overall greater, and the decreasing slope of pupil size was flatter for horror than for neutral stories. Horror stories induced higher transportation than neutral stories. High transportation was associated with a steeper increase in self-reported arousal across time, stronger LRTCs in pupil size fluctuations, and lower blink count. These results indicate that pupil size reflects emotional arousal induced by the text content, while LRTCs and blink count are sensitive to cognitive engagement associated with transportation, irrespective of the text type. The study demonstrates the utility of pupillometric measures and blink count to study literature reception.

Memory of Others' Disclosures Is Consolidated during Rest and Associated with Providing Support: Neural and Linguistic Evidence

Social scientists have documented the power of being heard: Disclosing emotional experiences to others promotes mental and physical health. Yet, far less is known about how listeners digest the sensitive information people share with them. We combined brain imaging and text analysis methods with a naturalistic emotional disclosure paradigm to assess how listeners form memories of others' disclosures. Neural and linguistic evidence support the hypothesis that listeners consolidate memories for others' disclosures during rest after listening and that their ability to do so facilitates subsequently providing the speakers with support. In Study 1, brain imaging methods showed that functional connectivity between the dorsomedial subsystem of the default network and frontoparietal control network increased during rest after listening to others' disclosures and predicted subsequent memory for their experiences. Moreover, graph analytic methods demonstrated that the left anterior temporal lobe may function as a connector hub between these two networks when consolidating memory for disclosures. In Study 2, linguistic analyses revealed other-focused thought increased during rest after listening to others' disclosures and predicted not only memory for the information disclosed but also whether listeners supported the speakers the next day. Collectively, these findings point to the important role of memory consolidation during rest in helping listeners respond supportively to others' disclosures. In our increasingly busy lives, pausing to briefly rest may not only help us care for ourselves but also help us care for others.

Investigation of functional brain network reconfiguration during vocal emotional processing using graph-theoretical analysis

Vocal expression is essential for conveying the emotion during social interaction. Although vocal emotion has been explored in previous studies, little is known about how perception of different vocal emotional expressions modulates the functional brain network topology. In this study, we aimed to investigate the functional brain networks under different attributes of vocal emotion by graph-theoretical network analysis. Functional magnetic resonance imaging (fMRI) experiments were performed on 36 healthy participants. We utilized the Power-264 functional brain atlas to calculate the interregional functional connectivity (FC) from fMRI data under resting state and vocal stimuli at different arousal and valence levels. The orthogonal minimal spanning trees method was used for topological filtering. The paired-sample t-test with Bonferroni correction across all regions and arousal-valence levels were used for statistical comparisons. Our results show that brain network exhibits significantly altered network attributes at FC, nodal and global levels, especially under high-arousal or negative-valence vocal emotional stimuli. The alterations within/between well-known large-scale functional networks were also investigated. Through the present study, we have gained more insights into how comprehending emotional speech modulates brain networks. These findings may shed light on how the human brain processes emotional speech and how it distinguishes different emotional conditions.

Dissociable neural systems for unconditioned acute and sustained fear

Fear protects organisms by increasing vigilance and preparedness, and by coordinating survival responses during life-threatening encounters. The fear circuit must thus operate on multiple timescales ranging from preparatory sustained alertness to acute fight-or-flight responses. Here we studied the brain basis of sustained and acute fear using naturalistic functional magnetic resonance imaging (fMRI) enabling analysis of different time-scales of fear responses. Subjects (N ​= ​37) watched feature-length horror movies while their hemodynamic brain activity was measured with fMRI. Time-variable intersubject correlation (ISC) was used to quantify the reliability of brain activity across participants, and seed-based phase synchronization was used for characterizing dynamic connectivity. Subjective ratings of fear were used to assess how synchronization and functional connectivity varied with emotional intensity. These data suggest that acute and sustained fear are supported by distinct neural pathways, with sustained fear amplifying mainly sensory responses, and acute fear increasing activity in brainstem, thalamus, amygdala and cingulate cortices. Sustained fear increased ISC in regions associated with acute fear, and also amplified functional connectivity within this network. The results were replicated in an independent experiment with a different subject sample and stimulus movie. The functional interplay between cortical networks involved in sustained anticipation of, and acute response to, threat involves a complex and dynamic interaction that depends on the proximity of threat, and the need to employ threat appraisals and vigilance for decision making and response selection.

Reinforcer Pathology: Implications for Substance Abuse Intervention

The rate at which individuals discount future rewards (i.e., discounting rate) is strongly associated with their propensity for substance abuse as well as myriad other negative health behaviors. An excessive preference for immediately available rewards suggests a shortened time horizon in which immediate rewards are overvalued and future, potentially negative consequences are undervalued. This review outlines Reinforcer Pathology Theory (i.e., the interaction between excessive preference for immediately available rewards and the overvaluation of a particular commodity that offers brief, intense reinforcement), its neurobiological/behavioral underpinnings, and its implications for treating substance use disorders. In doing so, the current review provides an overview of a variety of ways in which interventions have been used to manipulate aspects of reinforcer pathology in an individual, including narrative theory, framing manipulations, and neuromodulation (e.g., working memory training, TMS) which may serve as promising avenues for the modulation of the temporal window and/or valuation of reinforcers.