Context-Dependent Coding of Temporal Distance Between Cinematic Events in the Human Precuneus

Scene construction processes in the anterior hippocampus during temporal episodic memory retrieval

Although the hippocampus has been implicated in both the temporal organization of memories and association of scene elements, some theoretical accounts posit that the role of the hippocampus in episodic memory is largely atemporal. In this study, we set out to explore this discrepancy by identifying hippocampal activity patterns related to scene construction while participants performed a temporal order memory task. Participants in the fMRI scanner were shown a sequence of photographs, each consisting of a central object and a contextual background scene. On each retrieval trial, participants were shown a pair of the original photographs (FULL), objects from the scenes without the background (OBJ), or background contexts without the main foreground object (BACK). In the temporal order judgment (TOJ) task, participants judged the temporal order of the pair of scenes; in the Viewing trials, two identical scenes were shown without any task. First, we found that the anterior hippocampus-particularly the CA1 and subiculum-showed similar patterns of activation between the BACK and OBJ conditions, suggesting that scene construction occurred spontaneously during both TOJ and Viewing. Furthermore, neural markers of scene construction in the anterior hippocampus did not apply to incorrect trials, showing that successful temporal memory retrieval was functionally linked to scene construction. In the cortex, time-processing areas, such as the supplementary motor area and the precuneus, and scene-processing areas, such as the parahippocampal cortex, were activated and functionally connected with the hippocampus. Together, these results support the view that the hippocampus is concurrently involved in scene construction and temporal organization of memory and propose a model of hippocampal episodic memory that takes both processes into account.

The influence of the precuneus on the medial temporal cortex determines the subjective quality of memory during the retrieval of naturalistic episodes

Memory retrieval entails dynamic interactions between the medial temporal lobe and areas in the parietal and frontal cortices. Here, we tested the hypothesis that effective connectivity between the precuneus, in the medial parietal cortex, and the medial temporal cortex contributes to the subjective quality of remembering objects together with information about their rich spatio-temporal encoding context. During a 45 min encoding session, the participants were presented with pictures of objects while they actively explored a virtual town. The following day, under fMRI, participants were presented with images of objects and had to report whether: they recognized the object and could remember the place/time of encoding, the object was familiar only, or the object was new. The hippocampus/parahippocampus, the precuneus and the ventro-medial prefrontal cortex activated when the participants successfully recognized objects they had seen in the virtual town and reported that they could remember the place/time of these events. Analyses of effective connectivity showed that the influence exerted by the precuneus on the medial temporal cortex mediates this effect of episodic recollection. Our findings demonstrate the role of the inter-regional connectivity in mediating the subjective experience of remembering and underline the relevance of studying memory in contextually-rich conditions.

Minor Changes Change Memories: Functional Magnetic Resonance Imaging and Behavioral Reflections of Episodic Prediction Errors

Episodic memories can be modified, a process that is potentially driven by mnemonic prediction errors. In the present study, we used modified cues to induce prediction errors of different episodic relevance. Participants encoded episodes in the form of short toy stories and then returned for an fMRI session on the subsequent day. Here, participants were presented either original episodes or slightly modified versions thereof. Modifications consisted of replacing a single object within the episode and either challenged the gist of an episode (gist modifications) or left it intact (surface modifications). On the next day, participants completed a post-fMRI memory test that probed memories for originally encoded episodes. Both types of modifications triggered brain activation in regions we previously found to be involved in the processing of content-based mnemonic prediction errors (i.e., the exchange of an object). Specifically, these were ventrolateral pFC, intraparietal cortex, and lateral occipitotemporal cortex. In addition, gist modifications triggered pronounced brain responses, whereas those for surface modification were only significant in the right inferior frontal sulcus. Processing of gist modifications also involved the posterior temporal cortex and the precuneus. Interestingly, our findings confirmed the posterior hippocampal role of detail processing in episodic memory, as evidenced by increased posterior hippocampal activity for surface modifications compared with gist modifications. In the post-fMRI memory test, previous experience with surface modified, but not gist-modified episodes, increased erroneous acceptance of the same modified versions as originally encoded. Whereas surface-level prediction errors might increase uncertainty and facilitate confusion of alternative episode representations, gist-level prediction errors seem to trigger the clear distinction of independent episodes.

Localization of a Medial Temporal Lobe-Precuneus Network for Time Orientation

OBJECTIVE

Time orientation is a fundamental cognitive process in which one's personal sense of time is matched with a universal reference. Time orientation is commonly assessed through mental status examination, yet its neural correlates remain unclear. Large lesions have been associated with deficits in time orientation, but the regional anatomy implicated in time disorientation is not well established. The current study investigates the anatomy of time disorientation and its network correlates in patients with focal brain lesions.

METHODS

Time orientation was assessed 3 months or more after lesion onset using the Benton Temporal Orientation Test (BTOT) in 550 patients with acquired, focal brain lesions, 39 of whom were impaired. Multivariate lesion-symptom mapping and lesion network mapping were used to evaluate the anatomy and networks associated with time disorientation. Performance on a variety of neuropsychological tests was compared between the time oriented and time disoriented group.

RESULTS

Lesion-symptom mapping showed that lesions of the precuneus, medial temporal lobes (MTL), and occipito-temporal cortex were associated with time disorientation (r = 0.264, p < 0.001). Lesion network mapping using normative connectome data demonstrated that these regional findings occurred along a network that includes white and gray matter connecting the precuneus and MTL. There was a strong behavioral and anatomical association of time disorientation with memory impairment, such that the 2 processes could not be fully disentangled.

INTERPRETATION

We interpret these findings as novel evidence for a network involving the precuneus and the medial temporal lobe in supporting time orientation. ANN NEUROL 2023;94:421-433.

Hippocampal orchestration of associative and sequential memory networks for episodic retrieval

Episodic memory involves the recollection of contextual details replayed mentally across time. Here, we propose the association-sequence network (ASN) model, characterizing complementary cortico-hippocampal networks underlying the retrieval of simultaneously associated and sequentially ordered events. Participants viewed objects, presented singly or in pairs, and later reported whether two objects were shown simultaneously, consecutively, or farther apart in time. Behavioral results and hippocampal activation reveal a correlation between the two sequential conditions but not the simultaneous condition, despite the temporal proximity of consecutive pairs. We also find that anterior hippocampal activity is modulated by temporal distance. Distinct cortical networks are engaged during simultaneous and sequential memory (prefrontal cortex and angular gyrus for association; supplementary motor cortex and precuneus for sequence); notably, these regions show differential connectivity with the hippocampus. The ASN model provides a comprehensive framework for how we reconstruct memories that are both rich in associative detail and temporally dynamic in nature.

Neural unscrambling of temporal information during a nonlinear narrative

Although we must experience our lives chronologically, storytellers often manipulate the order in which they relay events. How the brain processes temporal information while encoding a nonlinear narrative remains unclear. Here, we use functional magnetic resonance imaging during movie watching to investigate which brain regions are sensitive to information about time in a narrative and test whether the representation of temporal context across a narrative is more influenced by the order in which events are presented or their underlying chronological sequence. Results indicate that medial parietal regions are sensitive to cued jumps through time over and above other changes in context (i.e., location). Moreover, when processing non-chronological narrative information, the precuneus and posterior cingulate engage in on-the-fly temporal unscrambling to represent information chronologically. Specifically, days that are closer together in chronological time are represented more similarly regardless of when they are presented in the movie, and this representation is consistent across participants. Additional analyses reveal a strong spatial signature associated with higher magnitude jumps through time. These findings are consistent with prior theorizing on medial parietal regions as central to maintaining and updating narrative situation models, and suggest the priority of chronological information when encoding narrative events.

Reactivating ordinal position information from auditory sequence memory in human brains

Retaining a sequence of events in their order is a core ability of many cognitive functions, such as speech recognition, movement control, and episodic memory. Although content representations have been widely studied in working memory (WM), little is known about how ordinal position information of an auditory sequence is retained in the human brain as well as its coding characteristics. In fact, there is still a lack of an efficient approach to directly accessing the stored ordinal position code during WM retention. Here, 31 participants performed an auditory sequence WM task with their brain activities recorded using electroencephalography (EEG). We developed new triggering events that could successfully reactivate neural representations of ordinal position during the delay period. Importantly, the ordinal position reactivation is further related to recognition behavior, confirming its indexing of WM storage. Furthermore, the ordinal position code displays an intriguing “stable-dynamic” format, i.e. undergoing the same dynamic neutral trajectory in the multivariate neural space during both encoding and retention (whenever reactivated). Overall, our results provide an effective approach to accessing the behaviorally-relevant ordinal position information in auditory sequence WM and reveal its new temporal characteristics.

The neural bases for timing of durations

Durations are defined by a beginning and an end, and a major distinction is drawn between durations that start in the present and end in the future ('prospective timing') and durations that start in the past and end either in the past or the present ('retrospective timing'). Different psychological processes are thought to be engaged in each of these cases. The former is thought to engage a clock-like mechanism that accurately tracks the continuing passage of time, whereas the latter is thought to engage a reconstructive process that utilizes both temporal and non-temporal information from the memory of past events. We propose that, from a biological perspective, these two forms of duration 'estimation' are supported by computational processes that are both reliant on population state dynamics but are nevertheless distinct. Prospective timing is effectively carried out in a single step where the ongoing dynamics of population activity directly serve as the computation of duration, whereas retrospective timing is carried out in two steps: the initial generation of population state dynamics through the process of event segmentation and the subsequent computation of duration utilizing the memory of those dynamics.

What Happened When? Cerebral Processing of Modified Structure and Content in Episodic Cueing

Episodic memories are not static but can change on the basis of new experiences, potentially allowing us to make valid predictions in the face of an ever-changing environment. Recent research has identified prediction errors during memory retrieval as a possible trigger for such changes. In this study, we used modified episodic cues to investigate whether different types of mnemonic prediction errors modulate brain activity and subsequent memory performance. Participants encoded episodes that consisted of short toy stories. During a subsequent fMRI session, participants were presented videos showing the original episodes, or slightly modified versions thereof. In modified videos, either the order of two subsequent action steps was changed or an object was exchanged for another. Content modifications recruited parietal, temporo-occipital, and parahippocampal areas reflecting the processing of the new object information. In contrast, structure modifications elicited activation in right dorsal premotor, posterior temporal, and parietal areas, reflecting the processing of new sequence information. In a post-fMRI memory test, the participants' tendency to accept modified episodes as originally encoded increased significantly when they had been presented modified versions already during the fMRI session. After experiencing modifications, especially those of the episodes' structure, the recognition of originally encoded episodes was impaired as well. Our study sheds light onto the neural processing of different types of episodic prediction errors and their influence on subsequent memory recall.

Decoding the silence: Neural bases of zero pronoun resolution in Chinese

Chinese is one of many languages that can drop subjects. We report an fMRI study of language comprehension processes in these "zero pronoun" cases. The fMRI data come from Chinese speakers who listened to an audiobook. We conducted both univariate GLM and multivariate pattern analysis (MVPA) on these data. We found increased left Temporal Lobe activity for zero pronouns compared to overt subjects, suggesting additional effort searching for an antecedent during zero pronoun resolution. MVPA further revealed that the intended referent of a zero pronoun can be decoded in the Parahippocampal Gyrus and the Precuneus shortly after its presentation. This highlights the role of memory and discourse-level processing in resolving referential expressions, including unspoken ones, in naturalistic language comprehension.

Hippocampal Representations of Event Structure and Temporal Context during Episodic Temporal Order Memory

The hippocampus plays an important role in representing spatial locations and sequences and in transforming representations. How these representational structures and operations support memory for the temporal order of random items is still poorly understood. We addressed this question by leveraging the method of loci, a powerful mnemonic strategy for temporal order memory that particularly recruits hippocampus-dependent computations of spatial locations and associations. Applying representational similarity analysis to functional magnetic resonance imaging activation patterns revealed that hippocampal subfields contained representations of multiple features of sequence structure, including spatial locations, location distance, and sequence boundaries, as well as episodic-like temporal context. Critically, the hippocampal CA1 exhibited spatial transformation of representational patterns, showing lower pattern similarity for items in same locations than closely matched different locations during retrieval, whereas the CA23DG exhibited sequential transformation of representational patterns, showing lower pattern similarity for items in near locations than in far locations during encoding. These transformations enabled the encoding of multiple items in the same location and disambiguation of adjacent items. Our results suggest that the hippocampus can flexibly reconfigure multiplexed event structure representations to support accurate temporal order memory.

Mental travel in the person domain

"Mental travel" is a cognitive concept embodying the human capacity to intentionally disengage from the here and now, and mentally experience the world from different perspectives. We explored how individuals mentally "travel" to the point of view (POV) of other people in varying levels of personal closeness and from these perspectives process these people's social network. Under fMRI, participants were asked to "project" themselves to the POVs of four different people: a close other, a nonclose other, a famous-person, and their own-self, and rate the level of affiliation (closeness) to different individuals in the respective social network. Participants were always faster making judgments from their own POV compared with other POVs (self-projection effect) and for people who were personally closer to their adopted POV (social-distance effect). Brain activity at the medial prefrontal and anterior cingulate cortex in the self-POV was higher, compared with all other conditions. Activity at the right temporoparietal junction and medial parietal cortex was found to distinguish between the personally related (self, close, and nonclose others) and unrelated (famous-person) people. No difference was found between mental travel to the POVs of close and nonclose others. Regardless of POV, the precuneus, anterior cingulate cortex, prefrontal cortex, and temporoparietal junction distinguished between close and distant individuals within the different social networks. Representational similarity analysis implicated the left retrosplenial cortex as crucial for social distance processing across all POVs. These distinctions suggest several constraints regarding our ability to adopt others' POV and process not only ours but also other people's social networks and stress the importance of proximity in social cognition.NEW & NOTEWORTHY Mental-travel, the ability to mentally imagine oneself in a different place and time, is a fundamental cognitive concept. Investigation of mental-travel in the social domain under fMRI revealed that a network of brain regions, largely overlapping the default-mode-network, is responsible for "traveling" to points of view of different others; moreover, this network distinguishes between closer and less-close others, suggesting that mental-travel is a rich dynamical process, encompassing individuals in different proximities and these individuals' social network.

Brain Coding of Social Network Structure

Humans have large social networks, with hundreds of interacting individuals. How does the brain represent the complex connectivity structure of these networks? Here we used social media (Facebook) data to objectively map participants' real-life social networks. We then used representational similarity analysis (RSA) of functional magnetic resonance imaging (fMRI) activity patterns to investigate the neural coding of these social networks as participants reflected on each individual. We found coding of social network distances in the default-mode network (medial prefrontal, medial parietal, and lateral parietal cortices). When using partial correlation RSA to control for other factors that can be correlated to social distance (personal affiliation, personality traits. and visual appearance, as subjectively rated by the participants), we found that social network distance information was uniquely coded in the retrosplenial complex, a region involved in spatial processing. In contrast, information on individuals' personal affiliation to the participants and personality traits was found in the medial parietal and prefrontal cortices, respectively. These findings demonstrate a cortical division between representations of non-self-referenced (allocentric) social network structure, self-referenced (egocentric) social distance, and trait-based social knowledge.SIGNIFICANCE STATEMENT Each of us has a social network composed of hundreds of individuals, with different characteristics and different relations among them. How does our brain represent this complexity? To find out, we mapped participants' social connections using Facebook data and then asked them to think about individuals from their network while undergoing functional MRI scanning. We found that the position of individuals within the social network, as well as their affiliation to the participant, are mapped in the retrosplenial complex, a region involved in spatial processing. Individuals' personality traits were coded in another region, the medial prefrontal cortex. Our findings demonstrate a neural dissociation among different aspects of social knowledge and suggest a link between spatial and social cognitive mapping.

Diffusion property and functional connectivity of superior longitudinal fasciculus underpin human metacognition

Metacognition as the capacity of monitoring one's own cognition operates across domains. Here, we addressed whether metacognition in different cognitive domains rely on common or distinct neural substrates with combined diffusion tensor imaging (DTI) and functional magnetic resonance imaging (fMRI) techniques. After acquiring DTI and resting-state fMRI data, we asked participants to perform a temporal-order memory task and a perceptual discrimination task, followed by trial-specific confidence judgments. DTI analysis revealed that the structural integrity (indexed by fractional anisotropy) in the anterior portion of right superior longitudinal fasciculus (SLF) was associated with both perceptual and mnemonic metacognitive abilities. Using perturbed mnemonic metacognitive scores produced by inhibiting the precuneus using TMS, the mnemonic metacognition scores did not correlate with individuals' SLF structural integrity anymore, revealing the relevance of this tract in memory metacognition. To further verify the involvement of several cortical regions connected by SLF, we took the TMS-targeted precuneus region as a seed in a functional connectivity analysis and found the functional connectivity between precuneus and two SLF-connected regions (inferior parietal cortex and precentral gyrus) mediated mnemonic metacognition performance. These results illustrate the importance of SLF and a putative white-matter grey-matter circuitry that supports human metacognition.

Psychotherapy in pain management: New viewpoints and treatment targets based on a brain theory

The current paper provides an explanation of neurophysiological pain processing based the Dimensional Systems Model (DSM), a theory of higher cortical functions in which the cortical column is considered the binary digit for all cortical functions. Within the discussion, novel views on the roles of the basal ganglia, cerebellum, and cingulate cortex are presented. Additionally, an applied Clinical Biopsychological Model (CBM) based on the DSM will be discussed as related to psychological treatment with chronic pain patients. Three specific areas that have not been adequately addressed in the psychological treatment of chronic pain patients will be discussed based on the CBM. The treatment approaches have been effectively used in a clinical setting. Conclusions focus on a call for researchers and clinicians to fully evaluate the value of both the DSM and CBM.