The Temporal Dynamics of Spontaneous Emotional Brain States and Their Implications for Mental Health

Network state dynamics underpin basal craving in a transdiagnostic population

Emerging fMRI methods quantifying brain dynamics present an opportunity to capture how fluctuations in brain responses give rise to individual variations in affective and motivation states. Although the experience and regulation of affective states affect psychopathology, their underlying time-varying brain responses remain unclear. Here, we present a novel framework to identify network states matched to an affective experience and examine how the dynamic engagement of these network states contributes to this experience. We apply this framework to investigate network state dynamics underlying basal craving, an affective experience with important clinical implications. In a transdiagnostic sample of healthy controls and individuals diagnosed with or at risk for craving-related disorders (total N = 252), we utilized connectome-based predictive modeling (CPM) to identify brain networks predictive of basal craving. An edge-centric timeseries approach was leveraged to quantify the moment-to-moment engagement of the craving-positive and craving-negative subnetworks during independent scan runs. We found that dynamic markers of network engagement, namely more persistence in a craving-positive network state and less dwelling in a craving-negative network state, characterized individuals with higher craving. We replicated the latter results in a separate dataset, incorporating distinct participants (N = 173) and experimental stimuli. The associations between basal craving and network state dynamics were consistently observed even when craving-predictive networks were defined in the replication dataset. These robust findings suggest that network state dynamics underpin individual differences in basal craving. Our framework additionally presents a new avenue to explore how the moment-to-moment engagement of behaviorally meaningful network states supports our affective experiences.

EEG-based emotion recognition using a temporal-difference minimizing neural network

Electroencephalogram (EEG) emotion recognition plays an important role in human-computer interaction. An increasing number of algorithms for emotion recognition have been proposed recently. However, it is still challenging to make efficient use of emotional activity knowledge. In this paper, based on prior knowledge that emotion varies slowly across time, we propose a temporal-difference minimizing neural network (TDMNN) for EEG emotion recognition. We use maximum mean discrepancy (MMD) technology to evaluate the difference in EEG features across time and minimize the difference by a multibranch convolutional recurrent network. State-of-the-art performances are achieved using the proposed method on the SEED, SEED-IV, DEAP and DREAMER datasets, demonstrating the effectiveness of including prior knowledge in EEG emotion recognition.

Identifying the Neural Correlates of Resting State Affect Processing Dynamics

There exists growing interest in understanding the dynamics of resting state functional magnetic resonance imaging (rs-fMRI) to establish mechanistic links between individual patterns of spontaneous neural activation and corresponding behavioral measures in both normative and clinical populations. Here we propose and validate a novel approach in which whole-brain rs-fMRI data are mapped to a specific low-dimensional representation-affective valence and arousal processing-prior to dynamic analysis. This mapping process constrains the state space such that both independent validation and visualization of the system's dynamics become tractable. To test this approach, we constructed neural decoding models of affective valence and arousal processing from brain states induced by International Affective Picture Set image stimuli during task-related fMRI in (n = 97) healthy control subjects. We applied these models to decode moment-to-moment affect processing in out-of-sample subjects' rs-fMRI data and computed first and second temporal derivatives of the resultant valence and arousal time-series. Finally, we fit a second set of neural decoding models to these derivatives, which function as neurally constrained ordinary differential equations (ODE) underlying affect processing dynamics. To validate these decodings, we simulated affect processing by numerical integration of the true temporal sequence of neurally decoded derivatives for each subject and demonstrated that these decodings generate significantly less (p < 0.05) group-level simulation error than integration based upon decoded derivatives sampled uniformly randomly from the true temporal sequence. Indeed, simulations of valence and arousal processing were significant for up to four steps of closed-loop simulation (Δt = 2.0 s) for both valence and arousal, respectively. Moreover, neural encoding representations of the ODE decodings include significant clusters of activation within brain regions associated with affective reactivity and regulation. Our work has methodological implications for efforts to identify unique and actionable biomarkers of possible future or current psychopathology, particularly those related to mood and emotional instability.

Behavioral Experience-Sampling Methods in Neuroimaging Studies With Movie and Narrative Stimuli

Movies and narratives are increasingly utilized as stimuli in functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and electroencephalography (EEG) studies. Emotional reactions of subjects, what they pay attention to, what they memorize, and their cognitive interpretations are all examples of inner experiences that can differ between subjects during watching of movies and listening to narratives inside the scanner. Here, we review literature indicating that behavioral measures of inner experiences play an integral role in this new research paradigm via guiding neuroimaging analysis. We review behavioral methods that have been developed to sample inner experiences during watching of movies and listening to narratives. We also review approaches that allow for joint analyses of the behaviorally sampled inner experiences and neuroimaging data. We suggest that building neurophenomenological frameworks holds potential for solving the interrelationships between inner experiences and their neural underpinnings. Finally, we tentatively suggest that recent developments in machine learning approaches may pave way for inferring different classes of inner experiences directly from the neuroimaging data, thus potentially complementing the behavioral self-reports.