Frontal eye fields involved in shifting frame of reference within working memory for scenes

Neural correlates of pronoun processing: An activation likelihood estimation meta-analysis

Pronouns are unique linguistic devices that allow for the expression of referential relationships. Despite their communicative utility, the neural correlates of the operations involved in reference assignment and/or resolution, are not well-understood. The present study synthesized the neuroimaging literature on pronoun processing to test extant theories of pronoun comprehension. Following the PRISMA guidelines and thebest-practice recommendations for neuroimaging meta-analyses, a systematic literature search and record assessment were performed. As a result, 16 fMRI studies were included in the meta-analysis, and were coded in Scribe 3.6 for inclusion in the BrainMap database. The activation coordinates for the contrasts of interest were transformed into Talairach space and submitted to an Activation Likelihood Estimation (ALE) meta-analysis in GingerALE 3.0.1. The results indicated that pronoun processing had functional convergence in the left posterior middle and superior temporal gyri, potentially reflecting the retrieval, prediction and integration roles of these areas for pronoun processing.

Improved Spatial Knowledge Acquisition through Sensory Augmentation

Sensory augmentation provides novel opportunities to broaden our knowledge of human perception through external sensors that record and transmit information beyond natural perception. To assess whether such augmented senses affect the acquisition of spatial knowledge during navigation, we trained a group of 27 participants for six weeks with an augmented sense for cardinal directions called the feelSpace belt. Then, we recruited a control group that did not receive the augmented sense and the corresponding training. All 53 participants first explored the Westbrook virtual reality environment for two and a half hours spread over five sessions before assessing their spatial knowledge in four immersive virtual reality tasks measuring cardinal, route, and survey knowledge. We found that the belt group acquired significantly more accurate cardinal and survey knowledge, which was measured in pointing accuracy, distance, and rotation estimates. Interestingly, the augmented sense also positively affected route knowledge, although to a lesser degree. Finally, the belt group reported a significant increase in the use of spatial strategies after training, while the groups' ratings were comparable at baseline. The results suggest that six weeks of training with the feelSpace belt led to improved survey and route knowledge acquisition. Moreover, the findings of our study could inform the development of assistive technologies for individuals with visual or navigational impairments, which may lead to enhanced navigation skills and quality of life.

Cortical Hemodynamic Response Associated with Spatial Coding: A Near-Infrared Spectroscopy Study

Allocentric and egocentric are two types of spatial coding. Previous studies reported the dorsal attention network's involvement in both types. To eliminate possible paradigm-specific confounds in the results, this study employed fine-grained cue-to-target paradigm to dissociate allocentric (aSC) and egocentric (eSC) spatial coding. Twenty-two participants completed a custom visuospatial task, and changes in the concentration of oxygenated hemoglobin (O₂-Hb) were recorded using functional near-infrared spectroscopy (fNIRS). The least absolute shrinkage and selection operator-regularized principal component (LASSO-RPC) algorithm was used to identify cortical sites that predicted the aSC and eSC conditions' reaction times. Significant changes in O₂-Hb concentration in the right inferior parietal lobule (IPL) and post-central gyrus regions were common in both aSC and eSC. Results of inter-channel correlations further substantiate cortical activities in both conditions were predominantly over the right parieto-frontal areas. Together with right superior frontal gyrus areas be the reaction time neural correlates, the results suggest top-down attention and response-mapping processes are common to both spatial coding types. Changes unique to aSC were in clusters over the right intraparietal sulcus, right temporo-parietal junction, and left IPL. With the left pre-central gyrus region, be the reaction time neural correlate, aSC is likely to involve more orienting attention, updating of spatial information, and object-based response selection and inhibition than eSC. Future studies will use other visuospatial task designs for testing the robustness of the findings on spatial coding processes.

Language beyond the language system: Dorsal visuospatial pathways support processing of demonstratives and spatial language during naturalistic fast fMRI

Spatial demonstratives are powerful linguistic tools used to establish joint attention. Identifying the meaning of semantically underspecified expressions like "this one" hinges on the integration of linguistic and visual cues, attentional orienting and pragmatic inference. This synergy between language and extralinguistic cognition is pivotal to language comprehension in general, but especially prominent in demonstratives. In this study, we aimed to elucidate which neural architectures enable this intertwining between language and extralinguistic cognition using a naturalistic fMRI paradigm. In our experiment, 28 participants listened to a specially crafted dialogical narrative with a controlled number of spatial demonstratives. A fast multiband-EPI acquisition sequence (TR = 388 m s) combined with finite impulse response (FIR) modelling of the hemodynamic response was used to capture signal changes at word-level resolution. We found that spatial demonstratives bilaterally engage a network of parietal areas, including the supramarginal gyrus, the angular gyrus, and precuneus, implicated in information integration and visuospatial processing. Moreover, demonstratives recruit frontal regions, including the right FEF, implicated in attentional orienting and reference frames shifts. Finally, using multivariate similarity analyses, we provide evidence for a general involvement of the dorsal ("where") stream in the processing of spatial expressions, as opposed to ventral pathways encoding object semantics. Overall, our results suggest that language processing relies on a distributed architecture, recruiting neural resources for perception, attention, and extra-linguistic aspects of cognition in a dynamic and context-dependent fashion.

Role of the human retrosplenial cortex/parieto-occipital sulcus in perspective priming

The ability to imagine the world from a different viewpoint is a fundamental competence for spatial reorientation and for imagining what another individual sees in the environment. Here, we investigated the neural bases of such an ability using functional magnetic resonance imaging. Healthy participants detected target displacements across consecutive views of a familiar virtual room, either from the perspective of an avatar (primed condition) or in the absence of such a prime (unprimed condition). In the primed condition, the perspective at test always corresponded to the avatar's perspective, while in the unprimed condition it was randomly chosen as 0, 45 or 135deg of viewpoint rotation. We observed a behavioral advantage in performing a perspective transformation during the primed condition as compared to an equivalent amount of unprimed perspective change. Although many cortical regions (dorsal parietal, parieto-temporo-occipital junction, precuneus and retrosplenial cortex/parieto-occipital sulcus or RSC/POS) were involved in encoding and retrieving target location from different perspectives and were modulated by the amount of viewpoint rotation, the RSC/POS was the only area showing decreased activity in the primed as compared to the unprimed condition, suggesting that this region anticipates the upcoming perspective change. The retrosplenial cortex/parieto-occipital sulcus appears to play a special role in the allocentric coding of heading directions.

A functional MRI study of a picture-sentence verification task: evidence of attention shift to the grammatical subject

Mapping the meaning of a sentence onto visual entities is a fundamental process of daily language use, but it is unclear how attention in the visual context influences sentence comprehension. Aiming to examine this problem, we conducted a picture-sentence matching experiment with scanning using functional MRI. In the experiment, a moving picture describing an event with two colored objects was presented on a screen. A visual cue was flashed at the position of an object's appearance just before the event presentation, and participants were instructed to pay attention to the visually cued object in the picture. They were then required to read a simple Japanese sentence and to verify whether it correctly described the previous event. To examine the effects of visual cueing, we defined two conditions on the basis of the relationship between the visually cued object in an event and the grammatical subject of the subsequent sentence. When comparing the conditions in which the visually cued object was incongruent with the grammatical subject to the congruent conditions, participants showed a lower hit rate, and the right frontal eye field, which is known to be the region related to attention shift, was more activated. These findings suggest that the attention was initially allocated to an object encoded as the grammatical subject in the process of linking the content of a sentence with a visual event. Therefore, the attention was shifted from the cued object to the other object under the conditions discussed above.

TEST: a tropic, embodied, and situated theory of cognition

TEST is a novel taxonomy of knowledge representations based on three distinct hierarchically organized representational features: Tropism, Embodiment, and Situatedness. Tropic representational features reflect constraints of the physical world on the agent's ability to form, reactivate, and enrich embodied (i.e., resulting from the agent's bodily constraints) conceptual representations embedded in situated contexts. The proposed hierarchy entails that representations can, in principle, have tropic features without necessarily having situated and/or embodied features. On the other hand, representations that are situated and/or embodied are likely to be simultaneously tropic. Hence, although we propose tropism as the most general term, the hierarchical relationship between embodiment and situatedness is more on a par, such that the dominance of one component over the other relies on the distinction between offline storage versus online generation as well as on representation-specific properties.

Tracking down abstract linguistic meaning: neural correlates of spatial frame of reference ambiguities in language

This functional magnetic resonance imaging (fMRI) study investigates a crucial parameter in spatial description, namely variants in the frame of reference chosen. Two frames of reference are available in European languages for the description of small-scale assemblages, namely the intrinsic (or object-oriented) frame and the relative (or egocentric) frame. We showed participants a sentence such as “the ball is in front of the man”, ambiguous between the two frames, and then a picture of a scene with a ball and a man – participants had to respond by indicating whether the picture did or did not match the sentence. There were two blocks, in which we induced each frame of reference by feedback. Thus for the crucial test items, participants saw exactly the same sentence and the same picture but now from one perspective, now the other. Using this method, we were able to precisely pinpoint the pattern of neural activation associated with each linguistic interpretation of the ambiguity, while holding the perceptual stimuli constant. Increased brain activity in bilateral parahippocampal gyrus was associated with the intrinsic frame of reference whereas increased activity in the right superior frontal gyrus and in the parietal lobe was observed for the relative frame of reference. The study is among the few to show a distinctive pattern of neural activation for an abstract yet specific semantic parameter in language. It shows with special clarity the nature of the neural substrate supporting each frame of spatial reference.

Visual selection and the human frontal eye fields: effects of frontal transcranial magnetic stimulation on partial report analyzed by Bundesen's theory of visual attention

While the frontal eye fields (FEF) are traditionally associated with eye movements, recent work indicates possible roles in controlling selective visual processing. We applied 10 Hz bursts of transcranial magnetic stimulation (TMS) over left or right human FEF while subjects performed a partial-report task that allowed quantitative estimates of top-down control and other parameters affecting visual performance. Participants selectively reported digits in a relevant color (targets) but not those in an irrelevant color (nontargets) from a brief masked display. A target could appear alone or together with an accompanying item (nontarget or target) in the same or opposite hemifield. Targets were normally identified better when presented with a nontarget than with another target, indicating prioritization of task-relevant targets and thus top-down control. We found this usual pattern of results without TMS, and also with TMS over left FEF. However, during right FEF TMS, the detrimental impact of accompanying distractors increased. Formal analysis in terms of Bundesen's (1990) theory of visual attention confirmed that right FEF TMS diminished the top-down control parameter for both hemifields, indicating an FEF role in top-down selection even for targets defined by the nonspatial property of color. Direct comparison with our previous findings for parietal TMS (Hung et al., 2005) confirmed the distinct role of FEF in top-down control, plus right-hemisphere predominance for this in humans.

Real world referencing and schizophrenia: are we experiencing the same reality?

Psychotic symptoms in schizophrenia patients encompass the difficulty to distinguish between the respective points of view of self and others. The capacity to adopt and switch between different perspectives is, however, fundamental for ego- and allocentric spatial referencing. We tested whether schizophrenia patients are able to adopt and maintain a non-egocentric point of view in a complex visual environment. Twenty-four chronic schizophrenic outpatients (11 females) and 25 controls matched for age, gender, years of education and handedness were recruited from a population-based sample. In a virtual environment, participants had to make a decision as to which of two trash cans was closest to themselves (viewer-centered, egocentric), to a ball (object-centered, unstable allocentric), or to a palace (landmark-centered, stable allocentric). Main outcome measures were reaction time, error rate, learning rate and local task switch cost. While egocentric reaction time was preserved, patients showed an increased reaction time in both allocentric referencing conditions (stable and unstable) and an overall increased error rate. Switch cost was diminished in patients when changing from the egocentric to the landmark-centered condition and elevated when changing from the landmark-centered to the egocentric condition. The results imply that schizophrenia patients' adoption of an egocentric perspective is preserved. However, adopting an allocentric point of view and switching between egocentric and landmark-centered perspectives are impaired. Perturbations in non-egocentric referencing and transferring efficiently between different referential systems might contribute to altered personal and social world comprehension in schizophrenia.

Intrusive images in psychological disorders: characteristics, neural mechanisms, and treatment implications

Involuntary images and visual memories are prominent in many types of psychopathology. Patients with posttraumatic stress disorder, other anxiety disorders, depression, eating disorders, and psychosis frequently report repeated visual intrusions corresponding to a small number of real or imaginary events, usually extremely vivid, detailed, and with highly distressing content. Both memory and imagery appear to rely on common networks involving medial prefrontal regions, posterior regions in the medial and lateral parietal cortices, the lateral temporal cortex, and the medial temporal lobe. Evidence from cognitive psychology and neuroscience implies distinct neural bases to abstract, flexible, contextualized representations (C-reps) and to inflexible, sensory-bound representations (S-reps). We revise our previous dual representation theory of posttraumatic stress disorder to place it within a neural systems model of healthy memory and imagery. The revised model is used to explain how the different types of distressing visual intrusions associated with clinical disorders arise, in terms of the need for correct interaction between the neural systems supporting S-reps and C-reps via visuospatial working memory. Finally, we discuss the treatment implications of the new model and relate it to existing forms of psychological therapy.

Cortical midline involvement in autobiographical memory

Recollecting autobiographical memories of personal past experiences is an integral part of our everyday lives and relies on a distributed set of brain regions. Their occurrence externally in the real world (‘realness’) and their self-relevance (‘selfness’) are two defining features of these autobiographical events. Distinguishing between personally experienced events and those that happened to other individuals, and between events that really occurred and those that were mere figments of the imagination, is clearly advantageous, yet the respective neural correlates remain unclear. Here we experimentally manipulated and dissociated realness and selfness during fMRI using a novel paradigm where participants recalled self (autobiographical) and non-self (from a movie or television news clips) events that were either real or previously imagined. Distinct sub-regions within dorsal and ventral medial prefrontal cortex, retrosplenial cortex and along the parieto-occipital sulcus preferentially coded for events (real or imagined) involving the self. By contrast, recollection of autobiographical events that really happened in the external world activated different areas within ventromedial prefrontal cortex and posterior cingulate cortex. In addition, recall of externally experienced real events (self or non-self) was associated with increased activity in areas of dorsomedial prefrontal cortex and posterior cingulate cortex. Taken together our results permitted a functional deconstruction of anterior (medial prefrontal) and posterior (retrosplenial cortex, posterior cingulate cortex, precuneus) cortical midline regions widely associated with autobiographical memory but whose roles have hitherto been poorly understood.

Language is shaped for social interactions, as well as by the brain

Language learning is not primarily driven by a motivation to describe invariant features of the world, but rather by a strong force to be a part of the social group, which by definition is not invariant. It is not sufficient for language to be fit for the speaker's perceptual motor system. It must also be fit for social interactions.