Movies in the magnet: Naturalistic paradigms in developmental functional neuroimaging

Inter- and intra-subject similarity in network functional connectivity across a full narrative movie

Naturalistic paradigms, such as watching movies during functional magnetic resonance imaging, are thought to prompt the emotional and cognitive processes typically elicited in real life situations. Therefore, naturalistic viewing (NV) holds great potential for studying individual differences. Previous studies have primarily focused on using shorter movie clips, geared toward eliciting specific and often isolated emotions, while the potential behind using full narratives depicted in commercial movies as a proxy for real-life experiences has barely been explored. Here, we offer preliminary evidence that a full narrative movie (FNM), that is, a movie covering a complete narrative arc, can capture complex socio-affective dynamics and their links to individual differences. Using the studyforrest dataset, we investigated inter- and intra-subject similarity in network functional connectivity (NFC) of 14 meta-analytically defined networks across a full narrative, audio-visual movie split into eight consecutive movie segments. We characterized the movie segments by valence and arousal portrayed within the sequences, before utilizing a linear mixed model to analyze which factors explain inter- and intra-subject similarity. Our results show that the model best explaining inter-subject similarity comprised network, movie segment, valence and a movie segment by valence interaction. Intra-subject similarity was influenced significantly by the same factors and an additional three-way interaction between movie segment, valence and arousal. Overall, inter- and intra-subject similarity in NFC were sensitive to the ongoing narrative and emotions in the movie. We conclude that FNMs offer complex content and dynamics that might be particularly valuable for studying individual differences. Further characterization of movie features, such as the overarching narratives, that enhance individual differences is needed for advancing the potential of NV research.

Increasing the representation of minoritized youth for inclusive and reproducible brain-behavior associations

Population neuroscience datasets allow researchers to estimate reliable effect sizes for brain-behavior associations because of their large sample sizes. However, these datasets undergo strict quality control to mitigate sources of noise, such as head motion. This practice often excludes a disproportionate number of minoritized individuals. We employ motion-ordering and motion-ordering+resampling (bagging) to test if these methods preserve functional MRI (fMRI) data in the Adolescent Brain Cognitive Development Study ( N = 5,733 ). Black and Hispanic youth exhibited excess head motion relative to data collected from White youth, and were discarded disproportionately when using conventional approaches. Both methods retained more than 99% of Black and Hispanic youth. They produced reproducible brain-behavior associations across low-/high-motion racial/ethnic groups based on motion-limited fMRI data. The motion-ordering and bagging methods are two feasible approaches that can enhance sample representation for testing brain-behavior associations and fulfill the promise of consortia datasets to produce generalizable effect sizes across diverse populations.

The Thermodynamics of Mind

To not only survive, but also thrive, the brain must efficiently orchestrate distributed computation across space and time. This requires hierarchical organisation facilitating fast information transfer and processing at the lowest possible metabolic cost. Quantifying brain hierarchy is difficult but can be estimated from the asymmetry of information flow. Thermodynamics has successfully characterised hierarchy in many other complex systems. Here, we propose the 'Thermodynamics of Mind' framework as a natural way to quantify hierarchical brain orchestration and its underlying mechanisms. This has already provided novel insights into the orchestration of hierarchy in brain states including movie watching, where the hierarchy of the brain is flatter than during rest. Overall, this framework holds great promise for revealing the orchestration of cognition.

Resting state functional brain connectivity in child and adolescent psychiatry: where are we now?

Approaching the 30th anniversary of the discovery of resting state functional magnetic resonance imaging (rsfMRI) functional connectivity, we reflect on the impact of this neuroimaging breakthrough on the field of child and adolescent psychiatry. The study of intrinsic functional brain architecture that rsfMRI affords across a wide range of ages and abilities has yielded numerous key insights. For example, we now know that many neurodevelopmental conditions are associated with more widespread circuit alterations across multiple large-scale brain networks than previously suspected. The emergence of population neuroscience and effective data-sharing initiatives have made large rsfMRI datasets publicly available, providing sufficient power to begin to identify brain-based subtypes within heterogeneous clinical conditions. Nevertheless, several methodological and theoretical challenges must still be addressed to fulfill the promises of personalized child and adolescent psychiatry. In particular, incomplete understanding of the physiological mechanisms driving developmental changes in intrinsic functional connectivity remains an obstacle to further progress. Future directions include cross-species and multimodal neuroimaging investigations to illuminate such mechanisms. Data collection and harmonization efforts that span multiple countries and diverse cohorts are urgently needed. Finally, incorporating naturalistic fMRI paradigms such as movie watching should be a priority for future research efforts.

Inter- and intra-subject similarity in network functional connectivity across a full narrative movie

Naturalistic paradigms, such as watching movies during functional magnetic resonance imaging (fMRI), are thought to prompt the emotional and cognitive processes typically elicited in real life situations. Therefore, naturalistic viewing (NV) holds great potential for studying individual differences. However, in how far NV elicits similarity within and between subjects on a network level, particularly depending on emotions portrayed in movies, is currently unknown. We used the studyforrest dataset to investigate the inter- and intra-subject similarity in network functional connectivity (NFC) of 14 meta-analytically defined networks across a full narrative, audio-visual movie split into 8 consecutive movie segments. We characterized the movie segments by valence and arousal portrayed within the sequences, before utilizing a linear mixed model to analyze which factors explain inter- and intra-subject similarity. Our results showed that the model best explaining inter-subject similarity comprised network, movie segment, valence and a movie segment by valence interaction. Intra-subject similarity was influenced significantly by the same factors and an additional three-way interaction between movie segment, valence and arousal. Overall, inter- and intra-subject similarity in NFC were sensitive to the ongoing narrative and emotions in the movie. Lowest similarity both within and between subjects was seen in the emotional regulation network and networks associated with long-term memory processing, which might be explained by specific features and content of the movie. We conclude that detailed characterization of movie features is crucial for NV research.

Mapping brain function in adults and young children during naturalistic viewing with high-density diffuse optical tomography

Human studies of early brain development have been limited by extant neuroimaging methods. MRI scanners present logistical challenges for imaging young children, while alternative modalities like functional near-infrared spectroscopy have traditionally been limited by image quality due to sparse sampling. In addition, conventional tasks for brain mapping elicit low task engagement, high head motion, and considerable participant attrition in pediatric populations. As a result, typical and atypical developmental trajectories of processes such as language acquisition remain understudied during sensitive periods over the first years of life. We evaluate high-density diffuse optical tomography (HD-DOT) imaging combined with movie stimuli for high resolution optical neuroimaging in awake children ranging from 1 to 7 years of age. We built an HD-DOT system with design features geared towards enhancing both image quality and child comfort. Furthermore, we characterized a library of animated movie clips as a stimulus set for brain mapping and we optimized associated data analysis pipelines. Together, these tools could map cortical responses to movies and contained features such as speech in both adults and awake young children. This study lays the groundwork for future research to investigate response variability in larger pediatric samples and atypical trajectories of early brain development in clinical populations.

Infant neuroscience: how to measure brain activity in the youngest minds

The functional properties of the infant brain are poorly understood. Recent advances in cognitive neuroscience are opening new avenues for measuring brain activity in human infants. These include novel uses of existing technologies such as electroencephalography (EEG) and magnetoencephalography (MEG), the availability of newer technologies including functional near-infrared spectroscopy (fNIRS) and optically pumped magnetometry (OPM), and innovative applications of functional magnetic resonance imaging (fMRI) in awake infants during cognitive tasks. In this review article we catalog these available non-invasive methods, discuss the challenges and opportunities encountered when applying them to human infants, and highlight the potential they may ultimately hold for advancing our understanding of the youngest minds.

Network-wise analysis of movie-specific information in dynamic functional connectivity using COBE

Movie watching during functional magnetic resonance imaging has emerged as a promising tool to measure the complex behavior of the brain in response to a stimulus similar to real-life situations. It has been observed that presenting a movie (sequence of events) as a stimulus will lead to a unique time course of dynamic functional connectivity related to movie stimuli that can be compared across the participants. We assume that the observed dynamic functional connectivity across subjects can be divided into following 2 components: (i) specific to a movie stimulus (depicting group-level behavior in functional connectivity) and (ii) individual-specific behavior (not necessarily common across the subjects). In this work, using the dynamic time warping distance measure, we have shown the extent of similarity between the temporal sequences of functional connectivity while the underlying movie stimuli were same and different. Further, the temporal sequence of functional connectivity patterns related to a movie is enhanced by suppressing the subject-specific components of dynamic functional connectivity using common and orthogonal basis extraction. Quantitative analysis using the F-ratio measure reveals significant differences in dynamic functional connectivity within the somatomotor network and default mode network, as well as between the occipital network and somatomotor networks.

Dynamic threat-reward neural processing under semi-naturalistic ecologically relevant scenarios

Studies of affective neuroscience have typically employed highly controlled, static experimental paradigms to investigate the neural underpinnings of threat and reward processing in the brain. Yet our knowledge of affective processing in more naturalistic settings remains limited. Specifically, affective studies generally examine threat and reward features separately and under brief time periods, despite the fact that in nature organisms are often exposed to the simultaneous presence of threat and reward features for extended periods. To study the neural mechanisms of threat and reward processing under distinct temporal profiles, we created a modified version of the PACMAN game that included these environmental features. We also conducted two automated meta-analyses to compare the findings from our semi-naturalistic paradigm to those from more constrained experiments. Overall, our results revealed a distributed system of regions sensitive to threat imminence and a less distributed system related to reward imminence, both of which exhibited overlap yet neither of which involved the amygdala. Additionally, these systems broadly overlapped with corresponding meta-analyses, with the notable absence of the amygdala in our findings. Together, these findings suggest a shared system for salience processing that reveals a heightened sensitivity toward environmental threats compared to rewards when both are simultaneously present in an environment. The broad correspondence of our findings to meta-analyses, consisting of more tightly controlled paradigms, illustrates how semi-naturalistic studies can corroborate previous findings in the literature while also potentially uncovering novel mechanisms resulting from the nuances and contexts that manifest in such dynamic environments.

Impact of exposure to natural versus urban soundscapes on brain functional connectivity, BOLD entropy and behavior

BACKGROUND

Humans have been moving from rural to urban environments for decades. This process may have important consequences for our health and well-being. Most previous studies have focused on visual input, and the auditory domain has been understudied so far. Therefore, we set out to investigate the influence of exposure to natural vs urban soundscapes on brain activity and behavior.

METHODS

Resting-state fMRI data was acquired while participants (N = 35) listened to natural and urban soundscapes. Two affective questionnaires (the Positive and Negative Affect Schedule (PANAS) and the Perceived Stress Scale) and two cognitive tasks (dual n-back (DNB) and the backward digit-span (BDS)) were assessed before and after each soundscape condition. To quantify brain function we used complexity and network measures, namely brain entropy (BEN) and whole brain functional connectivity (FC). To study the link between brain and behavior, changes in BEN and whole brain FC were correlated to changes in cognitive performance and self-reported affect.

RESULTS

We found higher BEN when listening to urban sounds in posterior cingulate gyrus, cuneus and precuneus, occipital lobe/calcarine as compared to nature sounds, which was negatively correlated to (post-pre) differences in positive affect (PANAS) in the urban soundscape condition. In addition, we found higher FC between areas in the auditory, cinguloopercular, somatomotor hand and mouth networks when listening to nature as compared to urban sounds which was positively correlated to (post-pre) differences of the of the composite score of Digit span and N-back for nature soundscape.

CONCLUSIONS

This study provides a framework for the neural underpinnings of how natural versus urban soundscapes affect both whole brain FC and BEN and bear implications for the understanding of how the physical auditory environment affects brain function and subsequently observed behavior. Moreover, correlations with cognition and affect reveal the meaning that exposure to soundscapes may have on the human brain. To the best of our knowledge this is the first study to analyze BEN and whole brain FC at rest during exposure to nature and urban soundscapes and to explore their relationship to behavior.

Functional magnetic resonance imaging in schizophrenia: current evidence, methodological advances, limitations and future directions

Functional neuroimaging emerged with great promise and has provided fundamental insights into the neurobiology of schizophrenia. However, it has faced challenges and criticisms, most notably a lack of clinical translation. This paper provides a comprehensive review and critical summary of the literature on functional neuroimaging, in particular functional magnetic resonance imaging (fMRI), in schizophrenia. We begin by reviewing research on fMRI biomarkers in schizophrenia and the clinical high risk phase through a historical lens, moving from case-control regional brain activation to global connectivity and advanced analytical approaches, and more recent machine learning algorithms to identify predictive neuroimaging features. Findings from fMRI studies of negative symptoms as well as of neurocognitive and social cognitive deficits are then reviewed. Functional neural markers of these symptoms and deficits may represent promising treatment targets in schizophrenia. Next, we summarize fMRI research related to antipsychotic medication, psychotherapy and psychosocial interventions, and neurostimulation, including treatment response and resistance, therapeutic mechanisms, and treatment targeting. We also review the utility of fMRI and data-driven approaches to dissect the heterogeneity of schizophrenia, moving beyond case-control comparisons, as well as methodological considerations and advances, including consortia and precision fMRI. Lastly, limitations and future directions of research in the field are discussed. Our comprehensive review suggests that, in order for fMRI to be clinically useful in the care of patients with schizophrenia, research should address potentially actionable clinical decisions that are routine in schizophrenia treatment, such as which antipsychotic should be prescribed or whether a given patient is likely to have persistent functional impairment. The potential clinical utility of fMRI is influenced by and must be weighed against cost and accessibility factors. Future evaluations of the utility of fMRI in prognostic and treatment response studies may consider including a health economics analysis.

Combining wearable fNIRS and immersive virtual reality to study preschoolers' social development: a proof-of-principle study on preschoolers' social preference

A child's social world is complex and rich, but has traditionally been assessed with conventional experiments where children are presented with repeated stimuli on a screen. These assessments are impoverished relative to the dynamics of social interactions in real life, and can be challenging to implement with preschoolers, who struggle to comply with strict lab rules. The current work meets the need to develop new platforms to assess preschoolers' social development, by presenting a unique virtual-reality set-up combined with wearable functional near-infrared spectroscopy (fNIRS). As a proof-of-principle, we validated this platform by measuring brain activity during self-guided social interaction in 3-to-5-year-olds, which is under-investigated, yet crucial to understand the basis of social interactions in preschoolers. 37 preschoolers chose an interaction partner from one of 4 human-like avatars of different gender and age. We recorded spontaneous brain fluctuations from the frontal and temporoparietal regions (notably engaged in social-categorization and preference) while children played a bubble-popping game with a preferred and an assigned avatar. 60% of the participants chose to play with the same-gender and same-age avatar. However, this result was driven by females (>80% vs. 50% in males). Different fronto-temporoparietal connectivity patterns when playing with the two avatars were observed, especially in females. We showed the feasibility of using a novel set-up to naturalistically assess social preference in preschoolers, which was assessed at the behavioural and functional connectivity level. This work provides a first proof-of-principle for using cutting-edge technologies and naturalistic experiments to study social development, opening new avenues of research.

Left-Hemisphere Cortical Language Regions Respond Equally to Observed Dialogue and Monologue

Much of the language we encounter in our everyday lives comes in the form of conversation, yet the majority of research on the neural basis of language comprehension has used input from only one speaker at a time. Twenty adults were scanned while passively observing audiovisual conversations using functional magnetic resonance imaging. In a block-design task, participants watched 20 s videos of puppets speaking either to another puppet (the dialogue condition) or directly to the viewer (the monologue condition), while the audio was either comprehensible (played forward) or incomprehensible (played backward). Individually functionally localized left-hemisphere language regions responded more to comprehensible than incomprehensible speech but did not respond differently to dialogue than monologue. In a second task, participants watched videos (1-3 min each) of two puppets conversing with each other, in which one puppet was comprehensible while the other's speech was reversed. All participants saw the same visual input but were randomly assigned which character's speech was comprehensible. In left-hemisphere cortical language regions, the time course of activity was correlated only among participants who heard the same character speaking comprehensibly, despite identical visual input across all participants. For comparison, some individually localized theory of mind regions and right-hemisphere homologues of language regions responded more to dialogue than monologue in the first task, and in the second task, activity in some regions was correlated across all participants regardless of which character was speaking comprehensibly. Together, these results suggest that canonical left-hemisphere cortical language regions are not sensitive to differences between observed dialogue and monologue.

The naturalistic paradigm: An approach to studying individual variability in neural underpinnings of music perception

Music listening is a dynamic process that entails complex interactions between sensory, cognitive, and emotional processes. The naturalistic paradigm provides a means to investigate these processes in an ecologically valid manner by allowing experimental settings that mimic real-life musical experiences. In this paper, we highlight the importance of the naturalistic paradigm in studying dynamic music processing and discuss how it allows for investigating both the segregation and integration of brain processes using model-based and model-free methods. We further suggest that studying individual difference-modulated music processing in this paradigm can provide insights into the mechanisms of brain plasticity, which can have implications for the development of interventions and therapies in a personalized way. Finally, despite the challenges that the naturalistic paradigm poses, we end with a discussion on future prospects of music and neuroscience research, especially with the continued development and refinement of naturalistic paradigms and the adoption of open science practices.

Cross-movie prediction of individualized functional topography

Participant-specific, functionally defined brain areas are usually mapped with functional localizers and estimated by making contrasts between responses to single categories of input. Naturalistic stimuli engage multiple brain systems in parallel, provide more ecologically plausible estimates of real-world statistics, and are friendly to special populations. The current study shows that cortical functional topographies in individual participants can be estimated with high fidelity from naturalistic stimuli. Importantly, we demonstrate that robust, individualized estimates can be obtained even when participants watched different movies, were scanned with different parameters/scanners, and were sampled from different institutes across the world. Our results create a foundation for future studies that allow researchers to estimate a broad range of functional topographies based on naturalistic movies and a normative database, making it possible to integrate high-level cognitive functions across datasets from laboratories worldwide.

Probing neurodynamics of experienced emotions-a Hitchhiker's guide to film fMRI

Film functional magnetic resonance imaging (fMRI) has gained tremendous popularity in many areas of neuroscience. However, affective neuroscience remains somewhat behind in embracing this approach, even though films lend themselves to study how brain function gives rise to complex, dynamic and multivariate emotions. Here, we discuss the unique capabilities of film fMRI for emotion research, while providing a general guide of conducting such research. We first give a brief overview of emotion theories as these inform important design choices. Next, we discuss films as experimental paradigms for emotion elicitation and address the process of annotating them. We then situate film fMRI in the context of other fMRI approaches, and present an overview of results from extant studies so far with regard to advantages of film fMRI. We also give an overview of state-of-the-art analysis techniques including methods that probe neurodynamics. Finally, we convey limitations of using film fMRI to study emotion. In sum, this review offers a practitioners' guide to the emerging field of film fMRI and underscores how it can advance affective neuroscience.

A normative model of brain responses to social scenarios reflects the maturity of children and adolescents' social-emotional abilities

The rapid brain maturation in childhood and adolescence accompanies the development of socio-emotional functioning. However, it is unclear how the maturation of the neural activity drives the development of socio-emotional functioning and individual differences. This study aimed to reflect the age dependence of inter-individual differences in brain responses to socio-emotional scenarios and to develop naturalistic imaging indicators to assess the maturity of socio-emotional ability at the individual level. Using three independent naturalistic imaging datasets containing healthy participants (n = 111, 21 and 122), we found and validated that age-modulated inter-individual concordance of brain responses to socio-emotional movies in specific brain regions. The similarity of an individual's brain response to the average response of older participants was defined as response typicality, which predicted an individual's emotion regulation strategies in adolescence and theory of mind (ToM) in childhood. Its predictive power was not superseded by age, sex, cognitive performance or executive function. We further showed that the movie's valence and arousal ratings grounded the response typicality. The findings highlight that forming typical brain response patterns may be a neural phenotype underlying the maturation of socio-emotional ability. The proposed response typicality represents a neuroimaging approach to measure individuals' maturity of cognitive reappraisal and ToM.

Characterizing the spatiotemporal features of functional connectivity across the white matter and gray matter during the naturalistic condition

Introduction

The naturalistic stimuli due to its ease of operability has attracted many researchers in recent years. However, the influence of the naturalistic stimuli for whole-brain functions compared with the resting state is still unclear.

Methods

In this study, we clustered gray matter (GM) and white matter (WM) masks both at the ROI- and network-levels. Functional connectivity (FC) and inter-subject functional connectivity (ISFC) were calculated in GM, WM, and between GM and WM under the movie-watching and the resting-state conditions. Furthermore, intra-class correlation coefficients (ICC) of FC and ISFC were estimated on different runs of fMRI data to denote the reliability of them during the two conditions. In addition, static and dynamic connectivity indices were calculated with Pearson correlation coefficient to demonstrate the associations between the movie-watching and the resting-state.

Results

As the results, we found that the movie-watching significantly affected FC in whole-brain compared with the resting-state, but ISFC did not show significant connectivity induced by the naturalistic condition. ICC of FC and ISFC was generally higher during movie-watching compared with the resting-state, demonstrating that naturalistic stimuli could promote the reliability of connectivity. The associations between static and dynamic ISFC were weakly negative correlations in the naturalistic stimuli while there is no correlation between them under resting-state condition.

Discussion

Our findings confirmed that compared to resting-state condition, the connectivity indices under the naturalistic stimuli were more reliable and stable to investigate the normal functional activities of the human brain, and might promote the applications of FC in the cerebral dysfunction in various mental disorders.

Functional networks in the infant brain during sleep and wake states

Functional brain networks are assessed differently earlier versus later in development: infants are almost universally scanned asleep, whereas adults are typically scanned awake. Observed differences between infant and adult functional networks may thus reflect differing states of consciousness rather than or in addition to developmental changes. We explore this question by comparing functional networks in functional magnetic resonance imaging (fMRI) scans of infants during natural sleep and awake movie-watching. As a reference, we also scanned adults during awake rest and movie-watching. Whole-brain functional connectivity was more similar within the same state (sleep and movie in infants; rest and movie in adults) compared with across states. Indeed, a classifier trained on patterns of functional connectivity robustly decoded infant state and even generalized to adults; interestingly, a classifier trained on adult state did not generalize as well to infants. Moreover, overall similarity between infant and adult functional connectivity was modulated by adult state (stronger for movie than rest) but not infant state (same for sleep and movie). Nevertheless, the connections that drove this similarity, particularly in the frontoparietal control network, were modulated by infant state. In sum, infant functional connectivity differs between sleep and movie states, highlighting the value of awake fMRI for studying functional networks over development.

Similarity in functional connectome architecture predicts teenage grit

Grit is a personality trait that encapsulates the tendency to persevere and maintain consistent interest for long-term goals. While prior studies found that grit predicts positive behavioral outcomes, there is a paucity of work providing explanatory evidence from a neurodevelopmental perspective. Based on previous research suggesting the utility of the functional connectome (FC) as a developmental measure, we tested the idea that individual differences in grit might be, in part, rooted in brain development in adolescence and emerging adulthood (N = 64, 11-19 years of age). Our analysis showed that grit was associated with connectome stability across conditions and connectome similarity across individuals. Notably, inter-subject representational similarity analysis revealed that teenagers who were grittier shared similar FC architecture with each other, more so than those with lower grit. Our findings suggest that individuals with high levels of grit are more likely to exhibit a converging pattern of whole-brain functional connectivity, which may underpin subsequent beneficial behavioral outcomes.

Individual differences in time-varying and stationary brain connectivity during movie watching from childhood to early adulthood: Age, sex, and behavioral associations

Spatially remote brain regions exhibit dynamic functional interactions across various task conditions. While time-varying functional connectivity during movie watching shows sensitivity to movie content, stationary functional connectivity remains relatively stable across videos. These findings suggest that dynamic and stationary functional interactions may represent different aspects of brain function. However, the relationship between individual differences in time-varying and stationary connectivity and behavioral phenotypes remains elusive. To address this gap, we analyzed an open-access functional MRI dataset comprising participants aged 5-22 years, who watched two cartoon movie clips. We calculated regional brain activity, time-varying connectivity, and stationary connectivity, examining associations with age, sex, and behavioral assessments. Model comparison revealed that time-varying connectivity was more sensitive to age and sex effects compared with stationary connectivity. The preferred age models exhibited quadratic log age or quadratic age effects, indicative of inverted-U shaped developmental patterns. In addition, females showed higher consistency in regional brain activity and time-varying connectivity than males. However, in terms of behavioral predictions, only stationary connectivity demonstrated the ability to predict full-scale intelligence quotient. These findings suggest that individual differences in time-varying and stationary connectivity may capture distinct aspects of behavioral phenotypes.

Narrative simulation of social experiences in naturalistic context - A neurocinematic approach

Narratives may be regarded as simulations of everyday social situations. They are key to studying the human mind in socio-culturally determined contexts as they allow anchoring to the common ground of embodied and environmentally-engaged cognition. Here we review recent findings from naturalistic neuroscience on neural functions in conditions that mimic lifelike situations. We will focus particularly on neurocinematics, a research field that applies mediated narratives as stimuli for neuroimaging experiments. During the last two decades, this paradigm has contributed to an accumulation of insights about the neural underpinnings of behavior and sense-making in various narratively contextualized situations particularly pertaining to socio-emotional encounters. One of the key questions in neurocinematics is, how do intersubjectively synchronized brain activations relate to subjective experiences? Another question we address is how to bring natural contexts into experimental studies. Seeking to respond to both questions, we suggest neurocinematic studies to examine three manifestations of the same phenomenon side-by-side: subjective experiences of narrative situations, unfolding of narrative stimulus structure, and neural processes that co-constitute the experience. This approach facilitates identifying experientially meaningful activity patterns in the brain and points out what they may mean in relation to shared and communicable contents. Via rich-featured and temporally contextualized narrative stimuli, neurocinematics attempts to contribute to emerging holistic theories of neural dynamics and connectomics explaining typical and atypical interindividual variability.

A longitudinal resource for population neuroscience of school-age children and adolescents in China

During the past decade, cognitive neuroscience has been calling for population diversity to address the challenge of validity and generalizability, ushering in a new era of population neuroscience. The developing Chinese Color Nest Project (devCCNP, 2013-2022), the first ten-year stage of the lifespan CCNP (2013-2032), is a two-stages project focusing on brain-mind development. The project aims to create and share a large-scale, longitudinal and multimodal dataset of typically developing children and adolescents (ages 6.0-17.9 at enrolment) in the Chinese population. The devCCNP houses not only phenotypes measured by demographic, biophysical, psychological and behavioural, cognitive, affective, and ocular-tracking assessments but also neurotypes measured with magnetic resonance imaging (MRI) of brain morphometry, resting-state function, naturalistic viewing function and diffusion structure. This Data Descriptor introduces the first data release of devCCNP including a total of 864 visits from 479 participants. Herein, we provided details of the experimental design, sampling strategies, and technical validation of the devCCNP resource. We demonstrate and discuss the potential of a multicohort longitudinal design to depict normative brain growth curves from the perspective of developmental population neuroscience. The devCCNP resource is shared as part of the "Chinese Data-sharing Warehouse for In-vivo Imaging Brain" in the Chinese Color Nest Project (CCNP) - Lifespan Brain-Mind Development Data Community ( https://ccnp.scidb.cn ) at the Science Data Bank.

Large-scale encoding of emotion concepts becomes increasingly similar between individuals from childhood to adolescence

Humans require a shared conceptualization of others' emotions for adaptive social functioning. A concept is a mental blueprint that gives our brains parameters for predicting what will happen next. Emotion concepts undergo refinement with development, but it is not known whether their neural representations change in parallel. Here, in a sample of 5-15-year-old children (n = 823), we show that the brain represents different emotion concepts distinctly throughout the cortex, cerebellum and caudate. Patterns of activation to each emotion changed little across development. Using a model-free approach, we show that activation patterns were more similar between older children than between younger children. Moreover, scenes that required inferring negative emotional states elicited higher default mode network activation similarity in older children than younger children. These results suggest that representations of emotion concepts are relatively stable by mid to late childhood and synchronize between individuals during adolescence.

Individual differences in time-varying and stationary brain connectivity during movie watching from childhood to early adulthood: age, sex, and behavioral associations

Spatially remote brain regions exhibit dynamic functional interactions across various task conditions. While time-varying functional connectivity during movie watching shows sensitivity to movie content, stationary functional connectivity remains relatively stable across videos. These findings suggest that dynamic and stationary functional interactions may represent different aspects of brain function. However, the relationship between individual differences in time-varying and stationary connectivity and behavioral phenotypes remains elusive. To address this gap, we analyzed an open-access functional MRI dataset comprising participants aged 5 to 22 years, who watched two cartoon movie clips. We calculated regional brain activity, time-varying connectivity, and stationary connectivity, examining associations with age, sex, and behavioral assessments. Model comparison revealed that time-varying connectivity was more sensitive to age and sex effects compared with stationary connectivity. The preferred age models exhibited quadratic log age or quadratic age effects, indicative of inverted-U shaped developmental patterns. In addition, females showed higher consistency in regional brain activity and time-varying connectivity than males. However, in terms of behavioral predictions, only stationary connectivity demonstrated the ability to predict full-scale intelligence quotient. These findings suggest that individual differences in time-varying and stationary connectivity may capture distinct aspects of behavioral phenotypes.

A Novel Exploratory Graph-Based Analytical Tool for Functional Near-Infrared Spectroscopy in Naturalistic Experiments: An Illustrative Application in Typically Developing Children

Naturalistic paradigms are being increasingly applied to investigate human brain function. Compared with resting-state and task-based paradigms in neuroimaging, naturalistic stimuli and situations can be potentially more readily translated to daily-life applications. Among neuroimaging modalities, functional near-infrared spectroscopy (fNIRS) is particularly suitable for naturalistic investigations and applications. However, specific and tailored statistical analysis to interrogate brain function using naturalistic fNIRS is warranted. Here, we describe an exploratory graph-centrality-based approach to investigating participants' spatiotemporal similarities from the fNIRS signal. We illustrate the usefulness of our approach in a sample of typically developing children (10 males and 9 females; mean age of 5.2 years old; sd = 0.78) while they watch the Inscapes movie designed for neuroimaging acquisition. A node in the left dorsal prefrontal cortex presented similar responses across children, and those fNIRS responses were in line with scene transitions in the movie stimulus. Our results suggest the feasibility of applying centrality graph-based measures to investigate brain function in naturalistic fNIRS during development.

Cortical gradients during naturalistic processing are hierarchical and modality-specific

Understanding cortical topographic organization and how it supports complex perceptual and cognitive processes is a fundamental question in neuroscience. Previous work has characterized functional gradients that demonstrate large-scale principles of cortical organization. How these gradients are modulated by rich ecological stimuli remains unknown. Here, we utilize naturalistic stimuli via movie-fMRI to assess macroscale functional organization. We identify principal movie gradients that delineate separate hierarchies anchored in sensorimotor, visual, and auditory/language areas. At the opposite/heteromodal end of these perception-to-cognition axes, we find a more central role for the frontoparietal network along with the default network. Even across different movie stimuli, movie gradients demonstrated good reliability, suggesting that these hierarchies reflect a brain state common across different naturalistic conditions. The relative position of brain areas within movie gradients showed stronger and more numerous correlations with cognitive behavioral scores compared to resting state gradients. Together, these findings provide an ecologically valid representation of the principles underlying cortical organization while the brain is active and engaged in multimodal, dynamic perceptual and cognitive processing.

Naturalistic viewing increases individual identifiability based on connectivity within functional brain networks

Naturalistic viewing (NV) is currently considered a promising paradigm for studying individual differences in functional brain organization. While whole brain functional connectivity (FC) under NV has been relatively well characterized, so far little work has been done on a network level. Here, we extend current knowledge by characterizing the influence of NV on FC in fourteen meta-analytically derived brain networks considering three different movie stimuli in comparison to resting-state (RS). We show that NV increases identifiability of individuals over RS based on functional connectivity in certain, but not all networks. Furthermore, movie stimuli including a narrative appear more distinct from RS. In addition, we assess individual variability in network FC by comparing within- and between-subject similarity during NV and RS. We show that NV can evoke individually distinct NFC patterns by increasing inter-subject variability while retaining within-subject similarity. Crucially, our results highlight that this effect is not observable across all networks, but rather dependent on the network-stimulus combination. Our results confirm that NV can improve the detection of individual differences over RS and underline the importance of selecting the appropriate combination of movie and cognitive network for the research question at hand.

Annual Research Review: Perspectives on progress in ADHD science - from characterization to cause

The science of attention-deficit/hyperactivity disorder (ADHD) is motivated by a translational goal - the discovery and exploitation of knowledge about the nature of ADHD to the benefit of those individuals whose lives it affects. Over the past fifty years, scientific research has made enormous strides in characterizing the ADHD condition and in understanding its correlates and causes. However, the translation of these scientific insights into clinical benefits has been limited. In this review, we provide a selective and focused survey of the scientific field of ADHD, providing our personal perspectives on what constitutes the scientific consensus, important new leads to be highlighted, and the key outstanding questions to be addressed going forward. We cover two broad domains - clinical characterization and, risk factors, causal processes and neuro-biological pathways. Part one focuses on the developmental course of ADHD, co-occurring characteristics and conditions, and the functional impact of living with ADHD - including impairment, quality of life, and stigma. In part two, we explore genetic and environmental influences and putative mediating brain processes. In the final section, we reflect on the future of the ADHD construct in the light of cross-cutting scientific themes and recent conceptual reformulations that cast ADHD traits as part of a broader spectrum of neurodivergence.

Temporal continuity shapes visual responses of macaque face patch neurons

Macaque inferior temporal cortex neurons respond selectively to complex visual images, with recent work showing that they are also entrained reliably by the evolving content of natural movies. To what extent does temporal continuity itself shape the responses of high-level visual neurons? We addressed this question by measuring how cells in face-selective regions of the macaque visual cortex were affected by the manipulation of a movie's temporal structure. Sampling a 5-min movie at 1 s intervals, we measured neural responses to randomized, brief stimuli of different lengths, ranging from 800 ms dynamic movie snippets to 100 ms static frames. We found that the disruption of temporal continuity strongly altered neural response profiles, particularly in the early response period after stimulus onset. The results suggest that models of visual system function based on discrete and randomized visual presentations may not translate well to the brain's natural modes of operation.

Functional connectivity based machine learning approach for autism detection in young children using MEG signals

Objective.Autism spectrum disorder (ASD) is a complex neurodevelopmental disorder, and identifying early autism biomarkers plays a vital role in improving detection and subsequent life outcomes. This study aims to reveal hidden biomarkers in the patterns of functional brain connectivity as recorded by the neuro-magnetic brain responses in children with ASD.Approach.We recorded resting-state magnetoencephalogram signals from thirty children with ASD (4-7 years) and thirty age and gender-matched typically developing (TD) children. We used a complex coherency-based functional connectivity analysis to understand the interactions between different brain regions of the neural system. The work characterizes the large-scale neural activity at different brain oscillations using functional connectivity analysis and assesses the classification performance of coherence-based (COH) measures for autism detection in young children. A comparative study has also been carried out on COH-based connectivity networks both region-wise and sensor-wise to understand frequency-band-specific connectivity patterns and their connections with autism symptomatology. We used artificial neural network (ANN) and support vector machine (SVM) classifiers in the machine learning framework with a five-fold CV technique.Main results.To classify ASD from TD children, the COH connectivity feature yields the highest classification accuracy of 91.66% in the high gamma (50-100 Hz) frequency band. In region-wise connectivity analysis, the second highest performance is in the delta band (1-4 Hz) after the gamma band. Combining the delta and gamma band features, we achieved a classification accuracy of 95.03% and 93.33% in the ANN and SVM classifiers, respectively. Using classification performance metrics and further statistical analysis, we show that ASD children demonstrate significant hyperconnectivity.Significance.Our findings support the weak central coherency theory in autism detection. Further, despite its lower complexity, we show that region-wise COH analysis outperforms the sensor-wise connectivity analysis. Altogether, these results demonstrate the functional brain connectivity patterns as an appropriate biomarker of autism in young children.

Entropy, complexity, and maturity in children’s neural responses to naturalistic video lessons

Temporal characteristics of neural signals are often overlooked in traditional fMRI developmental studies but are critical to studying brain functions in ecologically valid settings. In the present study, we explore the temporal properties of children's neural responses during naturalistic mathematics and grammar tasks. To do so, we introduce a novel measure in developmental fMRI: neural entropy, which indicates temporal complexity of BOLD signals. We show that temporal patterns of neural activity have lower complexity and greater variability in children than in adults in the association cortex but not in the sensory-motor cortex. We also show that neural entropy is associated with both child-adult similarity in functional connectivity and neural synchrony, and that neural entropy increases with the size of functionally connected networks in the association cortex. In addition, neural entropy increases with functional maturity (i.e., child-adult neural synchrony) in content-specific regions. These exploratory findings suggest the hypothesis that neural entropy indexes the increasing breadth and diversity of neural processes available to children for analyzing mathematical information over development.

Are inter-subject functional correlations consistent across different movies?

Movie fMRI has been increasingly used in investigations of human brain function. Inter-subject functional correlation (ISFC), which evaluates stimulus-dependent inter-regional synchrony between brains exposed to the same stimulus, is emerging as an influencing measure for movie fMRI data analyses. Before the wide application of ISFC analyses, it will be useful to investigate the degree to which they are similar and different across different movies. Based on the four movie fMRI runs of 178 subjects included in the "human connectome project (HCP) S1200 Release", we evaluated ISFCs throughout the brain and analyzed their consistency across different movies using intra-class correlation (ICC). We also investigated the generalizability of ISFC-based predictive models, which is closely related to their consistency, with sex classification and grip strength prediction used as test cases. The results showed that the intensity of ISFCs was generally weak (0.047). Except a few within-network ones (e.g., ICC of ISFC in the PON was 0.402), ISFCs throughout the brain exhibited low consistency, as indicated by a mean ICC of 0.130. The accuracies for inter-run predictions (60.7-72.8% for sex classification, and R = 0.122-0.275 for grip strength prediction) were much lower than those for intra-run predictions (73.2-83.0% for sex classification, and R = 0.325-0.403 for grip strength prediction), and this indicates poor generalizability of predictive models based on ISFCs. According to these findings, ISFC analyses capture aspects of brain function that are specific to each individual movie, and this specificity should be taken into account (in some cases might be especially useful) in future naturalistic studies.

Toward naturalistic neuroscience: Mechanisms underlying the flattening of brain hierarchy in movie-watching compared to rest and task

Identifying the functional specialization of the brain has moved from using cognitive tasks and resting state to using ecological relevant, naturalistic movies. We leveraged a large-scale neuroimaging dataset to directly investigate the hierarchical reorganization of functional brain activity when watching naturalistic films compared to performing seven cognitive tasks and resting. A thermodynamics-inspired whole-brain model paradigm revealed the generative underlying mechanisms for changing the balance in causal interactions between brain regions in different conditions. Paradoxically, the hierarchy is flatter for movie-watching, and the level of nonreversibility is significantly smaller in comparison to both rest and tasks, where the latter in turn have the highest levels of hierarchy and nonreversibility. The underlying mechanisms were revealed by the model-based generative effective connectivity (GEC). Naturalistic films could therefore provide a fast and convenient way to measure important changes in GEC (integrating functional and anatomical connectivity) found in, for example, neuropsychiatric disorders. Overall, this study demonstrates the benefits of moving toward a more naturalistic neuroscience.

Integrating media content analysis, reception analysis, and media effects studies

Every day, the world of media is at our fingertips, whether it is watching movies, listening to the radio, or browsing online media. On average, people spend over 8 h per day consuming messages from the mass media, amounting to a total lifetime dose of more than 20 years in which conceptual content stimulates our brains. Effects from this flood of information range from short-term attention bursts (e.g., by breaking news features or viral 'memes') to life-long memories (e.g., of one's favorite childhood movie), and from micro-level impacts on an individual's memory, attitudes, and behaviors to macro-level effects on nations or generations. The modern study of media's influence on society dates back to the 1940s. This body of mass communication scholarship has largely asked, "what is media's effect on the individual?" Around the time of the cognitive revolution, media psychologists began to ask, "what cognitive processes are involved in media processing?" More recently, neuroimaging researchers started using real-life media as stimuli to examine perception and cognition under more natural conditions. Such research asks: "what can media tell us about brain function?" With some exceptions, these bodies of scholarship often talk past each other. An integration offers new insights into the neurocognitive mechanisms through which media affect single individuals and entire audiences. However, this endeavor faces the same challenges as all interdisciplinary approaches: Researchers with different backgrounds have different levels of expertise, goals, and foci. For instance, neuroimaging researchers label media stimuli as "naturalistic" although they are in many ways rather artificial. Similarly, media experts are typically unfamiliar with the brain. Neither media creators nor neuroscientifically oriented researchers approach media effects from a social scientific perspective, which is the domain of yet another species. In this article, we provide an overview of approaches and traditions to studying media, and we review the emerging literature that aims to connect these streams. We introduce an organizing scheme that connects the causal paths from media content → brain responses → media effects and discuss network control theory as a promising framework to integrate media content, reception, and effects analyses.

Emotional states as distinct configurations of functional brain networks

The conceptualization of emotional states as patterns of interactions between large-scale brain networks has recently gained support. Yet, few studies have directly examined the brain’s network structure during emotional experiences. Here, we investigated the brain’s functional network organization during experiences of sadness, amusement, and neutral states elicited by movies, in addition to a resting-state. We tested the effects of the experienced emotion on individual variability in the brain’s functional connectome. Next, for each state, we defined a community structure of the brain and quantified its segregation and integration. We found that sadness, relative to amusement, was associated with higher modular integration and increased connectivity of cognitive control networks: the salience and fronto-parietal networks. Moreover, in both the functional connectome and the emotional report, the similarity between individuals was dependent on the sex. Our results suggest that the experience of emotion is linked to a reconfiguration of whole-brain distributed, not emotion-specific, functional networks and that the brain’s topological structure carries information about the subjective emotional experience.

Longitudinal investigation of executive function development employing task-based, teacher reports, and fNIRS multimethodology in 4- to 5-year-old children

Increased focus on resting-state functional connectivity (rsFC) and the use and accessibility of functional near-infrared spectroscopy (fNIRS) have advanced knowledge on the interconnected nature of neural substrates underlying executive function (EF) development in adults and clinical populations. Less is known about the relationship between rsFC and developmental changes in EF during preschool years in typically developing children, a gap the present study addresses employing task-based assessment, teacher reports, and fNIRS multimethodology. This preregistered study contributes to our understanding of the neural basis of EF development longitudinally with 41 children ages 4-5. Changes in prefrontal cortex (PFC) rsFC utilizing fNIRS, EF measured with a common task-based assessment (Day-Night task), and teacher reports of behavior (BRIEF-P) were monitored over multiple timepoints: Initial Assessment, 72 h follow-up, 1 Month Follow-up, and 4 Month Follow-up. Measures of rsFC were strongly correlated 72 h apart, providing evidence of high rsFC measurement reliability using fNIRS with preschool-aged children. PFC rsFC was positively correlated with performance on task-based and report-based EF assessments. Children's PFC functional connectivity at rest uniquely predicted later EF, controlling for verbal IQ, age, and sex. Functional connectivity at rest using fNIRS may potentially show the rapid changes in EF development in young children, not only neurophysiologically, but also as a correlate of task-based EF performance and ecologically-relevant teacher reports of EF in a classroom context.

Functional Connectome-Based Predictive Modeling in Autism

Autism is a heterogeneous neurodevelopmental condition, and functional magnetic resonance imaging-based studies have helped advance our understanding of its effects on brain network activity. We review how predictive modeling, using measures of functional connectivity and symptoms, has helped reveal key insights into this condition. We discuss how different prediction frameworks can further our understanding of the brain-based features that underlie complex autism symptomatology and consider how predictive models may be used in clinical settings. Throughout, we highlight aspects of study interpretation, such as data decay and sampling biases, that require consideration within the context of this condition. We close by suggesting exciting future directions for predictive modeling in autism.

Early stressful experiences are associated with reduced neural responses to naturalistic emotional and social content in children

How do children's experiences relate to their naturalistic emotional and social processing? Because children can struggle with tasks in the scanner, we collected fMRI data while 4-to-11-year-olds watched a short film with positive and negative emotional events, and rich parent-child interactions (n = 70). We captured broad, normative stressful experiences by examining socioeconomic status (SES) and stressful life events, as well as children's more proximal experiences with their parents. For a sub-sample (n = 30), parenting behaviors were measured during a parent-child interaction, consisting of a picture book, a challenging puzzle, and free play with novel toys. We characterized positive parenting behaviors (e.g., warmth, praise) and negative parenting behaviors (e.g., harsh tone, physical control). We found that higher SES was related to greater activity in medial orbitofrontal cortex during parent-child interaction movie events. Negative parenting behaviors were associated with less activation of the ventral tegmental area and cerebellum during positive emotional events. In a region-of-interest analysis, we found that stressful life events and negative parenting behaviors were associated with less activation of the amygdala during positive emotional events. These exploratory results demonstrate the promise of using movie fMRI to study how early experiences may shape emotional, social, and motivational processes.

A hybrid learning framework for fine-grained interpretation of brain spatiotemporal patterns during naturalistic functional magnetic resonance imaging

Naturalistic stimuli, including movie, music, and speech, have been increasingly applied in the research of neuroimaging. Relative to a resting-state or single-task state, naturalistic stimuli can evoke more intense brain activities and have been proved to possess higher test–retest reliability, suggesting greater potential to study adaptive human brain function. In the current research, naturalistic functional magnetic resonance imaging (N-fMRI) has been a powerful tool to record brain states under naturalistic stimuli, and many efforts have been devoted to study the high-level semantic features from spatial or temporal representations via N-fMRI. However, integrating both spatial and temporal characteristics of brain activities for better interpreting the patterns under naturalistic stimuli is still underexplored. In this work, a novel hybrid learning framework that comprehensively investigates both the spatial (via Predictive Model) and the temporal [via convolutional neural network (CNN) model] characteristics of the brain is proposed. Specifically, to focus on certain relevant regions from the whole brain, regions of significance (ROS), which contain common spatial activation characteristics across individuals, are selected via the Predictive Model. Further, voxels of significance (VOS), whose signals contain significant temporal characteristics under naturalistic stimuli, are interpreted via one-dimensional CNN (1D-CNN) model. In this article, our proposed framework is applied onto the N-fMRI data during naturalistic classical/pop/speech audios stimuli. The promising performance is achieved via the Predictive Model to differentiate the different audio categories. Especially for distinguishing the classic and speech audios, the accuracy of classification is up to 92%. Moreover, spatial ROS and VOS are effectively obtained. Besides, temporal characteristics of the high-level semantic features are investigated on the frequency domain via convolution kernels of 1D-CNN model, and we effectively bridge the “semantic gap” between high-level semantic features of N-fMRI and low-level acoustic features of naturalistic audios in the frequency domain. Our results provide novel insights on characterizing spatiotemporal patterns of brain activities via N-fMRI and effectively explore the high-level semantic features under naturalistic stimuli, which will further benefit the understanding of the brain working mechanism and the advance of naturalistic stimuli clinical application.

An evaluation of how connectopic mapping reveals visual field maps in V1

Abstract

Functional gradients, in which response properties change gradually across the cortical surface, have been proposed as a key organising principle of the brain. However, the presence of these gradients remains undetermined in many brain regions. Resting-state neuroimaging studies have suggested these gradients can be reconstructed from patterns of functional connectivity. Here we investigate the accuracy of these reconstructions and establish whether it is connectivity or the functional properties within a region that determine these “connectopic maps”. Different manifold learning techniques were used to recover visual field maps while participants were at rest or engaged in natural viewing. We benchmarked these reconstructions against maps measured by traditional visual field mapping. We report an initial exploratory experiment of a publicly available naturalistic imaging dataset, followed by a preregistered replication using larger resting-state and naturalistic imaging datasets from the Human Connectome Project. Connectopic mapping accurately predicted visual field maps in primary visual cortex, with better predictions for eccentricity than polar angle maps. Non-linear manifold learning methods outperformed simpler linear embeddings. We also found more accurate predictions during natural viewing compared to resting-state. Varying the source of the connectivity estimates had minimal impact on the connectopic maps, suggesting the key factor is the functional topography within a brain region. The application of these standardised methods for connectopic mapping will allow the discovery of functional gradients across the brain.

Protocol registration

The stage 1 protocol for this Registered Report was accepted in principle on 19 April 2022. The protocol, as accepted by the journal, can be found at 10.6084/m9.figshare.19771717.

Maternal sensitivity at the age of 8 months associates with local connectivity of the medial prefrontal cortex in children at 5 years of age

The quality of mother–child interaction, especially maternal sensitivity in caregiving behavior, plays an important role in a child’s later socioemotional development. Numerous studies have indicated associations between poor mother–child interaction and offspring brain structure and function, but more knowledge on how variation in the characteristics of early caregiving is associated with children’s brain structure and function is needed. We investigated whether maternal sensitivity at 8 or 30 months is associated with functional connectivity in a child’s brain at 5 years of age based on the FinnBrain Birth Cohort Study (17 and 39 mother–child dyads at 8 and 30 months, respectively, with an overlap of 13 dyads). Maternal sensitivity was assessed during a free play interaction using the Emotional Availability Scales at 8 and 30 months of the children’s age. Task-free functional magnetic resonance imaging (fMRI) was acquired at the age of 5 years in 7-min scans while watching the Inscapes movie. Regional homogeneity (ReHo) maps were created from the fMRI data, and multiple regression analysis was performed to assess the relation between maternal sensitivity and ReHo. Maternal sensitivity at the age of 8 months was positively associated with children’s ReHo values within the medial prefrontal cortex. Distal connectivity of this region showed no significant association with maternal sensitivity in a seed-based connectivity analysis. No associations were found between maternal sensitivity during toddlerhood and brain functional connectivity. Together, these results suggest that maternal sensitivity, especially in infancy, may influence offspring brain functional connectivity. However, studies with larger sample sizes are warranted.

Dynamic and stationary brain connectivity during movie watching as revealed by functional MRI

Spatially remote brain regions show synchronized activity as typically revealed by correlated functional MRI (fMRI) signals. An emerging line of research has focused on the temporal fluctuations of connectivity; however, its relationships with stationary connectivity have not been clearly illustrated. We examined dynamic and stationary connectivity when the participants watched four different movie clips. We calculated point-by-point multiplication between two regional time series to estimate the time-resolved dynamic connectivity, and estimated the inter-individual consistency of the dynamic connectivity time series. Widespread consistent dynamic connectivity was observed for each movie clip, which also showed differences between the clips. For example, a cartoon movie clip, Wall-E, showed more consistent of dynamic connectivity with the posterior cingulate cortex and supramarginal gyrus, while a court drama clip, A Few Good Men, showed more consistent of dynamic connectivity with the auditory cortex and temporoparietal junction, which might suggest the involvement of specific brain processing for different movie contents. In contrast, the stationary connectivity as measured by the correlations between regional time series was highly similar among the movie clips, and showed fewer statistically significant differences. The patterns of consistent dynamic connectivity could be used to classify different movie clips with higher accuracy than the stationary connectivity and regional activity. These results support the functional significance of dynamic connectivity in reflecting functional brain changes, which could provide more functionally relevant information than stationary connectivity.

Neural synchronization predicts marital satisfaction

Marital attachment plays an important role in maintaining intimate personal relationships and sustaining psychological well-being. Mate-selection theories suggest that people are more likely to marry someone with a similar personality and social status, yet evidence for the association between personality-based couple similarity measures and marital satisfaction has been inconsistent. A more direct and useful approach for understanding fundamental processes underlying marital satisfaction is to probe similarity of dynamic brain responses to maritally and socially relevant communicative cues, which may better reflect how married couples process information in real time and make sense of their mates and themselves. Here, we investigate shared neural representations based on intersubject synchronization (ISS) of brain responses during free viewing of marital life-related, and nonmarital, object-related movies. Compared to randomly selected pairs of couples, married couples showed significantly higher levels of ISS during viewing of marital movies and ISS between married couples predicted higher levels of marital satisfaction. ISS in the default mode network emerged as a strong predictor of marital satisfaction and canonical correlation analysis revealed a specific relation between ISS in this network and shared communication and egalitarian components of martial satisfaction. Our findings demonstrate that brain similarities that reflect real-time mental responses to subjective perceptions, thoughts, and feelings about interpersonal and social interactions are strong predictors of marital satisfaction, reflecting shared values and beliefs. Our study advances foundational knowledge of the neurobiological basis of human pair bonding.

Personality similarity predicts synchronous neural responses in fMRI and EEG data

Successful communication and cooperation among different members of society depends, in part, on a consistent understanding of the physical and social world. What drives this alignment in perspectives? We present evidence from two neuroimaging studies using functional magnetic resonance imaging (fMRI; N = 66 with 2145 dyadic comparisons) and electroencephalography (EEG; N = 225 with 25,200 dyadic comparisons) to show that: (1) the extent to which people’s neural responses are synchronized when viewing naturalistic stimuli is related to their personality profiles, and (2) that this effect is stronger than that of similarity in gender, ethnicity and political affiliation. The localization of the fMRI results in combination with the additional eye tracking analyses suggest that the relationship between personality similarity and neural synchrony likely reflects alignment in the interpretation of stimuli and not alignment in overt visual attention. Together, the findings suggest that similarity in psychological dispositions aligns people’s reality via shared interpretations of the external world.

Accounting for motion in resting-state fMRI: What part of the spectrum are we characterizing in autism spectrum disorder?

The exclusion of high-motion participants can reduce the impact of motion in functional Magnetic Resonance Imaging (fMRI) data. However, the exclusion of high-motion participants may change the distribution of clinically relevant variables in the study sample, and the resulting sample may not be representative of the population. Our goals are two-fold: 1) to document the biases introduced by common motion exclusion practices in functional connectivity research and 2) to introduce a framework to address these biases by treating excluded scans as a missing data problem. We use a study of autism spectrum disorder in children without an intellectual disability to illustrate the problem and the potential solution. We aggregated data from 545 children (8-13 years old) who participated in resting-state fMRI studies at Kennedy Krieger Institute (173 autistic and 372 typically developing) between 2007 and 2020. We found that autistic children were more likely to be excluded than typically developing children, with 28.5% and 16.1% of autistic and typically developing children excluded, respectively, using a lenient criterion and 81.0% and 60.1% with a stricter criterion. The resulting sample of autistic children with usable data tended to be older, have milder social deficits, better motor control, and higher intellectual ability than the original sample. These measures were also related to functional connectivity strength among children with usable data. This suggests that the generalizability of previous studies reporting naïve analyses (i.e., based only on participants with usable data) may be limited by the selection of older children with less severe clinical profiles because these children are better able to remain still during an rs-fMRI scan. We adapt doubly robust targeted minimum loss based estimation with an ensemble of machine learning algorithms to address these data losses and the resulting biases. The proposed approach selects more edges that differ in functional connectivity between autistic and typically developing children than the naïve approach, supporting this as a promising solution to improve the study of heterogeneous populations in which motion is common.

Developmental changes in story-evoked responses in the neocortex and hippocampus

How does the representation of naturalistic life events change with age? Here, we analyzed fMRI data from 414 children and adolescents (5–19 years) as they watched a narrative movie. In addition to changes in the degree of inter-subject correlation (ISC) with age in sensory and medial parietal regions, we used a novel measure (between-group ISC) to reveal age-related shifts in the responses across the majority of the neocortex. Over the course of development, brain responses became more discretized into stable and coherent events and shifted earlier in time to anticipate upcoming perceived event transitions, measured behaviorally in an age-matched sample. However, hippocampal responses to event boundaries actually decreased with age, suggesting a shifting division of labor between episodic encoding processes and schematic event representations between the ages of 5 and 19.

Comparing the Effectiveness of Brain Structural Imaging, Resting-state fMRI, and Naturalistic fMRI in Recognizing Social Anxiety Disorder in Children and Adolescents

Social anxiety disorder (SAD) is a common anxiety disorder in childhood and adolescence. Studies on SAD in adults have reported both structural and functional aberrancies of the brain at the group level. However, evidence has shown differences in anxiety-related brain abnormalities between adolescents and adults. Since children and adolescents can afford limited scan time, optimizing the scan tasks is essential for SAD research in children and adolescents. Thus, we need to address whether brain structure, resting-state fMRI, and naturalistic imaging enable individualized identification of SAD in children and adolescents, which measurement is more effective, and whether pooling multi-modal features can improve the identification of SAD. We comprehensively addressed these questions by building machine learning models based on parcel-wise brain features. We found that naturalistic fMRI yielded higher classification accuracy (69.17%) than the other modalities and the classification performance showed dependence on the contents of the movie. The classification models also identified contributing brain regions, some of which exhibited correlations with the symptoms scores of SAD. However, pooling brain features from the three modalities did not help enhance the classification accuracy. These results support the application of carefully designed naturalistic imaging in recognizing children and adolescents at risk of SAD.

Inferring Brain State Dynamics Underlying Naturalistic Stimuli Evoked Emotion Changes With dHA-HMM

The brain functional mechanisms underlying emotional changes have been primarily studied based on the traditional task design with discrete and simple stimuli. However, the brain state transitions when exposed to continuous and naturalistic stimuli with rich affection variations remain poorly understood. This study proposes a dynamic hyperalignment algorithm (dHA) to functionally align the inter-subject neural activity. The hidden Markov model (HMM) was used to study how the brain dynamics responds to emotion during long-time movie-viewing activity. The results showed that dHA significantly improved inter-subject consistency and allowed more consistent temporal HMM states across participants. Afterward, grouping the emotions in a clustering dendrogram revealed a hierarchical grouping of the HMM states. Further emotional sensitivity and specificity analyses of ordered states revealed the most significant differences in happiness and sadness. We then compared the activation map in HMM states during happiness and sadness and found significant differences in the whole brain, but strong activation was observed during both in the superior temporal gyrus, which is related to the early process of emotional prosody processing. A comparison of the inter-network functional connections indicates unique functional connections of the memory retrieval and cognitive network with the cerebellum network during happiness. Moreover, the persistent bilateral connections among salience, cognitive, and sensorimotor networks during sadness may reflect the interaction between high-level cognitive networks and low-level sensory networks. The main results were verified by the second session of the dataset. All these findings enrich our understanding of the brain states related to emotional variation during naturalistic stimuli.

Functional connectomes become more longitudinally self-stable, but not more distinct from others, across early childhood

Functional connectomes, as measured with functional magnetic resonance imaging (fMRI), are highly individualized, and evidence suggests this individualization may increase across childhood. A connectome can become more individualized either by increasing self-stability or decreasing between-subject-similarity. Here we used a longitudinal early childhood dataset to investigate age associations with connectome self-stability, between-subject-similarity, and developmental individualization, defined as an individual's self-stability across a 12-month interval relative to their between-subject-similarity. fMRI data were collected during an 18-minute passive viewing scan from 73 typically developing children aged 4-7 years, at baseline and 12-month follow-up. We found that young children had highly individualized connectomes, with sufficient self-stability across 12-months for 98% identification accuracy. Linear models showed a significant relationship between age and developmental individualization across the whole brain and in most networks. This association appeared to be largely driven by an increase in self-stability with age, with only weak evidence for relationships between age and similarity across participants. Together our findings suggest that children's connectomes become more individualized across early childhood, and that this effect is driven by increasing self-stability rather than decreasing between-subject-similarity.