Language beyond the language system: Dorsal visuospatial pathways support processing of demonstratives and spatial language during naturalistic fast fMRI

Distinct functional connectivity patterns during naturalistic learning by adolescent first versus second language speakers

Spoken lessons (lectures) are commonly used in schools as a medium for conveying educational content. In adolescence, experience-expectant maturation of language and cognitive systems supports learning; however, little is known about whether or how learners' language experiences interact with this integration process during learning. We examined functional connectivity using fMRI in 38 Spanish-English bilingual (L1-Spanish) and English monolingual (L1-English) adolescents during a naturalistic science video lesson in English. Seed analyses including the left inferior frontal gyrus (pars opercularis) and posterior middle temporal gyrus showed that L1-Spanish adolescents, when learning in their second language (L2), displayed widespread bilateral functional connectivity throughout the cortex while L1-English adolescents displayed mostly left-lateralized connectivity with core language regions over the course of the science lesson. Furthermore, we identified functional seed connectivity associated with better learning outcomes for adolescents with diverse language backgrounds. Importantly, functional connectivity patterns in L1-Spanish adolescents while learning in English also correlate with their Spanish cloze reading. Findings suggest that functional networks associated with higher-order language processing and cognitive control are differentially engaged for L1 vs. L2 speakers while learning new information through spoken language.

Graph methods to infer spatial disturbances: Application to Huntington's Disease's speech

OBJECTIVE

Huntington's Disease (HD) is an inherited neurodegenerative disease caused by the mutation of the Htt gene, impacting all aspects of living and functioning. Among cognitive disabilities, spatial capacities are impaired, but their monitoring remains scarce as limited by lengthy experts' assessments. Language offers an alternative medium to evaluate patients' performance in HD. Yet, its capacities to assess HD's spatial abilities are unknown. Here, we aimed to bring proof-of-concept that HD's spatial deficits can be assessed through speech.

METHODS

We developed the Spatial Description Model to graphically represent spatial relations described during the Cookie Theft Picture (CTP) task. We increased the sensitivity of our model by using only sentences with spatial terms, unlike previous studies in Alzheimer's disease. 78 carriers of the mutant Htt, including 56 manifest and 22 premanifest individuals, as well as 25 healthy controls were included from the BIOHD & (NCT01412125) & Repair-HD (NCT03119246) cohorts. The convergence and divergence of the model were validated using the SelfCog battery.

RESULTS

Our Spatial Description Model was the only one among the four assessed approaches, revealing that individuals with manifest HD expressed fewer spatial relations and engaged in less spatial exploration compared to healthy controls. Their graphs correlated with both visuospatial and language SelfCog performances, but not with motor, executive nor memory functions.

CONCLUSIONS

We provide the proof-of-concept using our Spatial Description Model that language can grasp HD patient's spatial disturbances. By adding spatial capabilities to the panel of functions tested by the language, it paves the way for eventual remote clinical application.

Imagery and Verbal Strategies in Spatial Memory for Route and Survey Descriptions

Being able to represent and remember verbally-encoded information about spatial environments from different perspectives is important for numerous daily activities. The present study examined how frequently individuals spontaneously engage in visual mental imagery and verbal rehearsal strategies in memory recall of spatial descriptions, and whether using certain strategies is associated with better recall performance. Memory recall for route (person-centred) and survey (object-centred) spatial descriptions was examined in a sample of 105 neurotypical individuals, who also reported to what extent they used route- and survey-based mental imagery and verbal rehearsal strategies in each description. Results showed that participants favoured a path visualisation strategy to recall the route description and a map visualisation strategy to recall the survey description. Regression models further showed that employing both imagery and verbal strategies was associated with better recall for both route and survey descriptions, although imagery strategies held a higher predictive power. The present findings highlight the fact that the spontaneous use of internal strategies in the form of visual imagery and verbal rehearsal is ubiquitous when recalling spatial descriptions and a core part of efficient spatial memory functioning.

Functional neuroimaging as a catalyst for integrated neuroscience

Functional magnetic resonance imaging (fMRI) enables non-invasive access to the awake, behaving human brain. By tracking whole-brain signals across a diverse range of cognitive and behavioural states or mapping differences associated with specific traits or clinical conditions, fMRI has advanced our understanding of brain function and its links to both normal and atypical behaviour. Despite this headway, progress in human cognitive neuroscience that uses fMRI has been relatively isolated from rapid advances in other subdomains of neuroscience, which themselves are also somewhat siloed from one another. In this Perspective, we argue that fMRI is well-placed to integrate the diverse subfields of systems, cognitive, computational and clinical neuroscience. We first summarize the strengths and weaknesses of fMRI as an imaging tool, then highlight examples of studies that have successfully used fMRI in each subdomain of neuroscience. We then provide a roadmap for the future advances that will be needed to realize this integrative vision. In this way, we hope to demonstrate how fMRI can help usher in a new era of interdisciplinary coherence in neuroscience.

Use of the Spanish English Neuropsychological Assessment Scale in older adult Latines and those at risk for autosomal dominant Alzheimer's disease

OBJECTIVE

The Spanish English Neuropsychological Assessment Scale (SENAS) is a cognitive battery with English and Spanish versions for use with persons for whom either language is predominant. Few studies have examined its utility outside the normative sample. The current study examined SENAS performance in samples of older adult Latines and Latines with or at risk for autosomal dominant Alzheimer's disease (ADAD) mutations.

METHOD

The SENAS was administered to 202 older adults from the Los Angeles Latino Eye Study (LALES) and 29 adults with (carriers) or without (non-carriers) mutations causing ADAD. We examined associations between SENAS, age, education, and language (LALES) and between SENAS, estimated years from familial age of dementia diagnosis, education, language, and acculturation (ADAD). Partial correlations were used to examine differences in correlational strength between estimated years from familial age of dementia diagnosis and SENAS scores among ADAD carriers compared to chronological age and SENAS in the LALES sample. Exploratory t-tests were performed to examine SENAS performance differences between ADAD carriers and non-carriers.

RESULTS

In an older adult sample (LALES), increased age correlated with worse verbal delayed recall; English fluency and higher education correlated with better naming and visuospatial subtest performance. Among ADAD carriers, verbal and nonverbal delayed recall and object naming subtest performance worsened as they approached their familial age of dementia diagnosis. English fluency and higher U.S.-acculturation were related to better SENAS performance among carriers and non-carriers. Tests of verbal delayed recall and object naming best distinguished ADAD carriers from their familial non-carrier counterparts.

CONCLUSIONS

Verbal delayed recall and object naming measures appear to be most sensitive to age-related changes in older adult samples and mutation-related changes in distinguishing ADAD carriers from non-carriers. Future research should examine the sensitivity of SENAS in other samples, such as larger samples of symptomatic ADAD carriers and other AD subtypes.

Editorial concepts in interaction: social engagement and inner experiences

This theme issue aims to view the literature on concepts through a novel lens, that of social interaction and its influence on inner experiences. It discusses unsolved problems in literature on concepts, emphasizing the distinction between concrete versus abstract concepts and external versus internal grounding. This introductory article reflects the two research streams that the theme aims to bridge-in this area, the dimension of embodied interaction with others and how this influences the interaction with ourselves is still underexplored. In the first part, we discuss recent trends in social cognition, showing how interacting with others influences our concepts. In the second part, we address how social interactions become part of our inner world in a Vygotskian fashion. First, we illustrate how interoception, emotion and metacognition are connected with concepts and knowledge. Second, we deal with how language, in both its outer and inner form, can empower cognition and concepts. We also briefly describe how novel experimental and computational methods contribute to investigating the online use of concepts. Overall, this introductory article outlines the potentialities of an integrated and interactive approach that can give new, fresh life to a topic, that of concepts, which lies at the root of human cognition. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.

Neuroscout, a unified platform for generalizable and reproducible fMRI research

Functional magnetic resonance imaging (fMRI) has revolutionized cognitive neuroscience, but methodological barriers limit the generalizability of findings from the lab to the real world. Here, we present Neuroscout, an end-to-end platform for analysis of naturalistic fMRI data designed to facilitate the adoption of robust and generalizable research practices. Neuroscout leverages state-of-the-art machine learning models to automatically annotate stimuli from dozens of fMRI studies using naturalistic stimuli-such as movies and narratives-allowing researchers to easily test neuroscientific hypotheses across multiple ecologically-valid datasets. In addition, Neuroscout builds on a robust ecosystem of open tools and standards to provide an easy-to-use analysis builder and a fully automated execution engine that reduce the burden of reproducible research. Through a series of meta-analytic case studies, we validate the automatic feature extraction approach and demonstrate its potential to support more robust fMRI research. Owing to its ease of use and a high degree of automation, Neuroscout makes it possible to overcome modeling challenges commonly arising in naturalistic analysis and to easily scale analyses within and across datasets, democratizing generalizable fMRI research.

Inferring Brain State Dynamics Underlying Naturalistic Stimuli Evoked Emotion Changes With dHA-HMM

The brain functional mechanisms underlying emotional changes have been primarily studied based on the traditional task design with discrete and simple stimuli. However, the brain state transitions when exposed to continuous and naturalistic stimuli with rich affection variations remain poorly understood. This study proposes a dynamic hyperalignment algorithm (dHA) to functionally align the inter-subject neural activity. The hidden Markov model (HMM) was used to study how the brain dynamics responds to emotion during long-time movie-viewing activity. The results showed that dHA significantly improved inter-subject consistency and allowed more consistent temporal HMM states across participants. Afterward, grouping the emotions in a clustering dendrogram revealed a hierarchical grouping of the HMM states. Further emotional sensitivity and specificity analyses of ordered states revealed the most significant differences in happiness and sadness. We then compared the activation map in HMM states during happiness and sadness and found significant differences in the whole brain, but strong activation was observed during both in the superior temporal gyrus, which is related to the early process of emotional prosody processing. A comparison of the inter-network functional connections indicates unique functional connections of the memory retrieval and cognitive network with the cerebellum network during happiness. Moreover, the persistent bilateral connections among salience, cognitive, and sensorimotor networks during sadness may reflect the interaction between high-level cognitive networks and low-level sensory networks. The main results were verified by the second session of the dataset. All these findings enrich our understanding of the brain states related to emotional variation during naturalistic stimuli.

Disruption of Cerebellar–Cerebral Functional Connectivity in Temporal Lobe Epilepsy and the Connection to Language and Cognitive Functions

Objective

To investigate the changes in the cerebellar-cerebral language network in temporal lobe epilepsy (TLE) patients from the cerebellar perspective, the research analyzes the changes of language and cognitive network in terms of functional connectivity (FC), as well as their efficiency of the reorganization were evaluated basing on relationship between the network metrics and neuropsychological scale scores.

Methods

30 TLE patients and 30 healthy controls were recruited. Brain activity was evaluated by voxel-mirrored homotopic connectivity analysis (VMHC). Two groups were analyzed and compared in terms of language FC using the following methods: Seed-to-Voxel analysis, pairwise correlations [region of interest(ROI)-to-ROI] and graph theory. Correlation analysis was performed between network properties and neuropsychological score.

Results

Compared with healthy participants, VMHC values in the Cerebellum Anterior Lobe, Frontal Lobe, Frontal_Sup_R/L, Cingulum_Ant_R/L, and Cingulum_Mid_R/L were decreased in TLE patients. Decreased FC was observed from the Cerebelum_10_R to the left inferior frontal gyrus, from the Cerebelum_6_R to the left Lingual Gyrus, from the Cerebelum_4_5_R to left Lingual Gyrus, left Cuneal Cortex and Precuneous Cortex, from the Cerebelum_3_R to Brain-Stem, and from the Cerebelum_Crus1_L to Cerebelum_6_R in TLE patients. The FC was enhanced between bilateral Cingulum_Mid and angular gyrus and frontoparietal insular cranium, between Frontal_Sup_Med L and left/right superior temporal gyrus (pSTG l/r), while it was decreased between left middle temporal gyrus and pSTG l/r. Compared with controls, the Betweenness Centrality (BC) of the right superior marginal gyrus (SMG), Temporal_Pole_Mid_R and Temporal_Mid_L as well as the Degree Centrality (DC) and Nodal Efficiency (NE) of the right SMG were lower in TLE patients. Further analysis showed that decreased VMHC in bilateral Cerebellum Anterior Lobe was positively correlated with the Boston Naming Test score in TLE patients, but it was negatively correlated with the Verbal Fluency Test score. The NE and DC of SMG_R were both negatively correlated with visual perception score in Montreal Cognitive Assessment.

Conclusion

Our results suggest that presence of abnormalities in the static functional connectivity and the language and cognitive network of TLE patients. Cerebellum potentially represents an intervention target for delaying or improving language and cognitive deficits in patients with TLE.

The extended development of mapping spatial demonstratives onto space

Spatial demonstratives (this and that in English) convey distance relative to speaker (within reach vs. out of reach) and object characteristics such as ownership. Previous studies indicate that object characteristics affect adult demonstrative choice, for example, greater use of this for owned objects. Here, production of spatial demonstratives was studied developmentally to identify when demonstrative production is sensitive to both distance and ownership. In two experiments, 7-year-olds, 11-year-olds, and adults completed an object location memory task, and a language task eliciting this or that to indicate an object. Results indicate that adult-like demonstrative production starts around 7 years of age and continues to develop beyond 11 years. Nonlinguistic spatial memory did not vary significantly across age groups. Spatial demonstratives encode both semantic and spatial object characteristics throughout development, revealing the fundamental importance of semantic factors for demonstrative production.

Imaging faster neural dynamics with fast fMRI: A need for updated models of the hemodynamic response

Fast fMRI enables the detection of neural dynamics over timescales of hundreds of milliseconds, suggesting it may provide a new avenue for studying subsecond neural processes in the human brain. The magnitudes of these fast fMRI dynamics are far greater than predicted by canonical models of the hemodynamic response. Several studies have established nonlinear properties of the hemodynamic response that have significant implications for fast fMRI. We first review nonlinear properties of the hemodynamic response function that may underlie fast fMRI signals. We then illustrate the breakdown of canonical hemodynamic response models in the context of fast neural dynamics. We will then argue that the canonical hemodynamic response function is not likely to reflect the BOLD response to neuronal activity driven by sparse or naturalistic stimuli or perhaps to spontaneous neuronal fluctuations in the resting state. These properties suggest that fast fMRI is capable of tracking surprisingly fast neuronal dynamics, and we discuss the neuroscientific questions that could be addressed using this approach.

Imaging the temporal dynamics of brain states with highly sampled fMRI

The spontaneous dynamics of the brain modulate its function from moment to moment, shaping neural computation and cognition. Functional MRI (fMRI), while classically used as a tool for spatial localization, is increasingly being used to identify the temporal dynamics of brain activity. fMRI analyses focused on the temporal domain have revealed important new information about the dynamics underlying states such as arousal, attention, and sleep. Dense temporal sampling – either by using fast fMRI acquisition, or multiple repeated scan sessions within individuals – can further enrich the information present in these studies. This review focuses on recent developments in using fMRI to identify dynamics across brain states, particularly vigilance and sleep states, and the potential for highly temporally sampled fMRI to answer these questions.

A conceptual framework for the study of demonstrative reference

Language allows us to efficiently communicate about the things in the world around us. Seemingly simple words like this and that are a cornerstone of our capability to refer, as they contribute to guiding the attention of our addressee to the specific entity we are talking about. Such demonstratives are acquired early in life, ubiquitous in everyday talk, often closely tied to our gestural communicative abilities, and present in all spoken languages of the world. Based on a review of recent experimental work, here we introduce a new conceptual framework of demonstrative reference. In the context of this framework, we argue that several physical, psychological, and referent-intrinsic factors dynamically interact to influence whether a speaker will use one demonstrative form (e.g., this) or another (e.g., that) in a given setting. However, the relative influence of these factors themselves is argued to be a function of the cultural language setting at hand, the theory-of-mind capacities of the speaker, and the affordances of the specific context in which the speech event takes place. It is demonstrated that the framework has the potential to reconcile findings in the literature that previously seemed irreconcilable. We show that the framework may to a large extent generalize to instances of endophoric reference (e.g., anaphora) and speculate that it may also describe the specific form and kinematics a speaker's pointing gesture takes. Testable predictions and novel research questions derived from the framework are presented and discussed.

A studyforrest extension, an annotation of spoken language in the German dubbed movie "Forrest Gump" and its audio-description

Here we present an annotation of speech in the audio-visual movie "Forrest Gump" and its audio-description for a visually impaired audience, as an addition to a large public functional brain imaging dataset ( studyforrest.org). The annotation provides information about the exact timing of each of the more than 2500 spoken sentences, 16,000 words (including 202 non-speech vocalizations), 66,000 phonemes, and their corresponding speaker. Additionally, for every word, we provide lemmatization, a simple part-of-speech-tagging (15 grammatical categories), a detailed part-of-speech tagging (43 grammatical categories), syntactic dependencies, and a semantic analysis based on word embedding which represents each word in a 300-dimensional semantic space. To validate the dataset's quality, we build a model of hemodynamic brain activity based on information drawn from the annotation. Results suggest that the annotation's content and quality enable independent researchers to create models of brain activity correlating with a variety of linguistic aspects under conditions of near-real-life complexity.

Interpreting Estonian Demonstratives: The Effects of Referent's Distance and Visual Salience

Most of the research done with spatial demonstratives (words such as this, here and that, there) have focused on the production, not the interpretation, of these words. In addition, emphasis has been largely on demonstrative pronouns, leaving demonstrative adverbs with relatively little research attention. The present study explores the interpretation of both demonstrative pronouns and demonstrative adverbs in Estonian—a Finno-Ugric language with two dialectal-specific demonstrative pronoun systems. In the South-Estonian (SE) dialectal region, two demonstrative pronouns, see—“this” and too—“that”, are used. In the North-Estonian (NE) region, only one, see—“this/that”, is used. The aim of this study is twofold. First, we test if the distance and the visual salience of a referent have an effect on the interpretation of demonstratives. Second, we explore if there is a difference in the interpretation of demonstratives between native speakers from SE and NE. We used an interpretation experiment with 30 participants per group (total n = 60) and compared the SE and NE group responses. The results clearly show that the distance of the referent has an effect on how demonstratives are interpreted across the two groups, while the effect of visual salience is inconclusive. There is also a difference in the interpretation of demonstratives between the two dialectal groups. When using the Estonian with an influence of the SE dialect, the NE speakers rely on demonstrative adverbs in interpreting the referential utterance that includes demonstrative pronoun and adverb combinations, whereas the SE speakers also take into account the semantics of demonstrative pronouns. We show that, in addition to an already known difference in the production, there is also a difference in the interpretation of demonstratives between the two groups. In addition, our findings support the recognition that languages that have distance neutral demonstrative pronouns enforce the spatial meaning of a referring utterance by adding demonstrative adverbs. Not only is the interpretation of demonstrative pronouns affected, but the interpretation of demonstrative adverbs as well. The latter shows the importance of studying adverbs also, not just pronouns, and contributes to further knowledge of how demonstratives function.

Demonstratives in Spatial Language and Social Interaction: An Interdisciplinary Review

This paper offers a review of research on demonstratives from an interdisciplinary perspective. In particular, we consider the role of demonstratives in current research on language universals, language evolution, language acquisition, multimodal communication, signed language, language and perception, language in interaction, spatial imagery, and discourse processing. Traditionally, demonstratives are analyzed as a particular class of spatial deictics. Yet, a number of recent studies have argued that space is largely irrelevant to deixis and that demonstratives are primarily used for social and interactive purposes. Synthesizing findings in the literature, we conclude that demonstratives are a very special class of linguistic items that are foundational to both spatial and social aspects of language and cognition.

[Changes of brain structural network properties in patients with rapid eye movement sleep behavior disorder]

OBJECTIVE

To investigate the changes in behaviors and brain structural network in patients with idiopathic rapid eye movement sleep behavior disorder (iRBD).

METHODS

Twenty patients with iRBD (iRBD group) and 22 healthy control subjects were evaluated using the Unified Parkinson's Disease Rating Scale (UPDRS) and Hoehn-Yahr staging. Diffusion tensor imaging and graph- theoretical analysis were performed for analyzing the topological characteristics of brain structural networks of the patients, and the correlation between the behavioral changes and the changes in the topological characteristics of the brain networks was analyzed.

RESULTS

The UPDRS score was significantly higher in iRBD group than in the healthy control group (P < 0.05). No significant difference was found in small-world attributes between the patients with iRBD and the control subjects (P>0.05). The patients with iRBD exhibited significantly shortened characteristic shortest path length Lp (P < 0.05) and significantly increased global efficiency, local efficiency and assortativity (P < 0.05). Examination of regional topological properties of the brain network revealed abnormal node properties in the frontal, temporal, parietal, occipital, and striatal and limbic lobes in patients with iRBD. The patients also had significantly increased degree centrality of the left pallidum and enhanced nodal efficiency in the left thalamus, superior temporal gyrus, temporal pole and bilateral superior occipital gyrus, bilateral putamens as well as the right gyrus rectus, amygdala, supramarginal gyrus, and middle temporal gyrus. The nodal local efficiency was significantly increased in the left superior frontal gyrus, middle cingulate gyrus, superior parietal gyrus, bilateral fusiform gyrus, right superior motor area, postcentral gyrus and angular gyrus of the patients with iRBD. The nodal shortest path was significantly shortened in the left superior motor area, pallidum, thalamus, superior temporal gyrus, temporal pole, bilateral putamens, bilateral superior occipital gyrus, right rectus gyrus, amygdala, supramarginal gyrus and middle temporal gyrus, and the nodal clustering coefficient was significantly lowered in the left superior occipital gyrus of the patients. In patients with iRBD, the UPDRS I score was positively correlated with the nodal efficiency in the right supramarginal gyrus (r=0.50, P < 0.05) and local nodal efficiency in the right fusiform gyrus (r=0.53, P < 0.05), and negatively correlated with the nodal clustering coefficient in the left superior occipital gyrus (r=-0.552, P < 0.05).

CONCLUSIONS

Patients with iRBD present with abnormal changes in mental condition, behaviors, emotions, activities of daily living and motor functions. The brain structural network of patient with iRBD still has a small-world property with abnormal global topological property and abnormal distribution of local topological property in the cortex, striatum and limbic system.

Demonstrative Reference and Semantic Space: A Large-Scale Demonstrative Choice Task Study

Spatial demonstratives (words like this and that) have been thought to primarily be used for carving up space into a peripersonal and extrapersonal domain. However, when given a noun out of context and asked to couple it with a demonstrative, speakers tend to choose this for words denoting manipulable objects (small, harmless, and inanimate), while non-manipulable objects (large, harmful, and animate) are more likely to be coupled with that. Here, we extend these findings using the Demonstrative Choice Task (DCT) procedure and map demonstrative use along a wide spectrum of semantic features. We conducted a large-scale (N = 2197) DCT experiment eliciting demonstratives for 506 words, rated across 65 + 11 perceptually and cognitively relevant semantic dimensions. We replicated the finding that demonstrative choice is influenced by object manipulability. Demonstrative choice was furthermore found to be related to a set of additional semantic factors, including valence, arousal, loudness, motion, time and more generally, the self. Importantly, demonstrative choices were highly structured across participants, as shown by a strong correlation detected in a split-sample comparison of by-word demonstrative choices. We argue that the DCT may be used to map a generalized semantic space anchored in the self of the speaker, the self being an extension of the body beyond physical space into a multidimensional semantic space.