Late onset of anterior prefrontal activity during true and false recognition: an event-related fMRI study

False memories in forensic psychology: do cognition and brain activity tell the same story?

One of the most important problems in forensic psychology is the impossibility of reliably discriminating between true and false memories when the only prosecution evidence comes from the memory of a witness or a victim. Unfortunately, both children and adults can be persuaded that they have been victims of past criminal acts, usually of a sexual nature. In adults, suggestion often occurs in the context of suggestive therapies based on the belief that traumatic events are repressed, while children come to believe and report events that never occurred as a result of repeated suggestive questioning. Cognitive Researchers have designed false memory paradigms (i.e., misinformation effect, Deese-Roediger-McDermott paradigm, event implantation paradigm) to first form false memories and then determine whether it is possible to reliably differentiate between false and true memories. In the present study, we review the contribution of cognitive research to the formation of false memories and the neuropsychological approaches aimed to discriminate between true and false memories. Based on these results, we analyze the applicability of the cognitive and neuropsychological evidence to the forensic setting.

"I heard it before … or not": time-course of ERP response and behavioural correlates associated with false recognition memory

Electrophysiological and behavioural correlates of true and false memories were examined in the Deese/Roediger-McDermont (DRM) paradigm. A mass univariate approach for analysing event-related potentials (ERP) in the temporal domain was used to examine the electrophysiological effects associated with this paradigm precisely (point-by-point) and without bias (data-driven). Behaviourally, true and false recognition did not differ, and the predicted DRM effect was observed, as false recognition of critical lures (i.e., new words semantically related to studied words) was higher than false alarms of new (unrelated) words. Neurally, an expected old/new effect was observed during the time-range of the late positive component (LPC) over left centro-parietal scalp electrodes. Furthermore, true recognition also evoked larger LPC amplitudes than false recognition over both left centro-parietal and fronto-central scalp electrodes. However, we did not observe LPC-related differences between critical lures and new words, nor between correct rejections of critical lures and new words. In contrast, correct rejections of critical lures were accompanied by higher activation of a sustained positive slow wave (SPSW) in right fronto-central electrodes beyond 1200 ms. This result reveals a key role of post-retrieval processes in recognition. Results are discussed in light of theoretical approaches to false memory in the DRM paradigm.

Understanding associative false memories in aging using multivariate analyses

Age-related declines in associative memory are ubiquitous, with decreases in behavioral discriminability largely arising from increases in false memories for recombined lures. Using representational similarity analyses to examine the neural basis of associative false memories in aging, the current study found that neural pattern similarity between Hits and FAs and Hits and CRs differed as a function of age in occipital ROIs, such that older adults exhibited a smaller difference between the two similarity metrics than did younger adults. Additionally, greater Hit-FA representational similarity correlated with increases in associative FAs across several ROIs. Results suggest that while neural representations underlying targets may not differ across ages, greater pattern similarity between the neural representation of targets and lures may reflect reduced distinctiveness of the information encoded in memory, such that old and new items are more difficult to discriminate, leading to more false alarms.

An empirical investigation of the benefit of increasing the temporal resolution of task-evoked fMRI data with multi-band imaging

Objective

There is a tendency for reducing TR in MRI experiments with multi-band imaging. We empirically investigate its benefit for the group-level statistical outcome in task-evoked fMRI.

Methods

Three visual fMRI data sets were collected from 17 healthy adult participants. Multi-band acquisition helped vary the TR (2000/1000/410 ms, respectively). Because these data sets capture different temporal aspects of the haemodynamic response (HRF), we tested several HRF models. We computed a composite descriptive statistic, H, from β’s of each first-level model fit and carried it to the group-level analysis. The number of activated voxels and the t value of the group-level analysis as well as a goodness-of-fit measure were used as surrogate markers of data quality for comparison.

Results

Increasing the temporal sampling rate did not provide a universal improvement in the group-level statistical outcome. Rather, both the voxel-wise and ROI-averaged group-level results varied widely with anatomical location, choice of HRF and the setting of the TR. Correspondingly, the goodness-of-fit of HRFs became worse with increasing the sampling frequency.

Conclusion

Rather than universally increasing the temporal sampling rate in cognitive fMRI experiments, these results advocate the performance of a pilot study for the specific ROIs of interest to identify the appropriate temporal sampling rate for the acquisition and the correspondingly suitable HRF for the analysis of the data.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10334-021-00918-z.

Resting state heart rate variability and false memories

Recent studies have shown higher resting-state vagally-mediated heart rate variability (vmHRV) to be related to greater memory retrieval. Research has not yet linked resting vmHRV with memory encoding and retrieval, as both are thought to play an important role in correctly distinguishing between true and false memories. The current study investigated this possible link in n = 71 undergraduate students. VmHRV was assessed during a 5-minute resting baseline period. Participants then completed the Deese-Roediger-McDermott (DRM) task, where they first viewed 6 word lists (12 words per list), and were later asked to identify previously shown words (true memories) and reject non-presented words. Results showed that participants with lower resting vmHRV were less able to discriminate true from false items. These data extend previous work on resting vmHRV and memory suggesting that resting vmHRV represents a psychophysiological pathway involved in both the proper encoding and retrieval of memories.

Microstructural Alterations in Hippocampal Subfields Mediate Age-Related Memory Decline in Humans

Aging, even in the absence of clear pathology of dementia, is associated with cognitive decline. Neuroimaging, especially diffusion-weighted imaging, has been highly valuable in understanding some of these changes in live humans, non-invasively. Traditional tensor techniques have revealed that the integrity of the fornix and other white matter tracts significantly deteriorates with age, and that this deterioration is highly correlated with worsening cognitive performance. However, traditional tensor techniques are still not specific enough to indict explicit microstructural features that may be responsible for age-related cognitive decline and cannot be used to effectively study gray matter properties. Here, we sought to determine whether recent advances in diffusion-weighted imaging, including Neurite Orientation Dispersion and Density Imaging (NODDI) and Constrained Spherical Deconvolution, would provide more sensitive measures of age-related changes in the microstructure of the medial temporal lobe. We evaluated these measures in a group of young (ages 20-38 years old) and older (ages 59-84 years old) adults and assessed their relationships with performance on tests of cognition. We found that the fiber density (FD) of the fornix and the neurite density index (NDI) of the fornix, hippocampal subfields (DG/CA3, CA1, and subiculum), and parahippocampal cortex, varied as a function of age in a cross-sectional cohort. Moreover, in the fornix, DG/CA3, and CA1, these changes correlated with memory performance on the Rey Auditory Verbal Learning Test (RAVLT), even after regressing out the effect of age, suggesting that they were capturing neurobiological properties directly related to performance in this task. These measures provide more details regarding age-related neurobiological properties. For example, a change in fiber density could mean a reduction in axonal packing density or myelination, and the increase in NDI observed might be explained by changes in dendritic complexity or even sprouting. These results provide a far more comprehensive view than previously determined on the possible system-wide processes that may be occurring because of healthy aging and demonstrate that advanced diffusion-weighted imaging is evolving into a powerful tool to study more than just white matter properties.

Who is susceptible in three false memory tasks?

Decades of research show that people are susceptible to developing false memories. But if they do so in one task, are they likely to do so in a different one? The answer: "No". In the current research, a large number of participants took part in three well-established false memory paradigms (a misinformation task, the Deese-Roediger-McDermott [DRM] list learning paradigm, and an imagination inflation exercise) as well as completed several individual difference measures. Results indicate that many correlations between false memory variables in all three inter-paradigm comparisons are null, though some small, positive, significant correlations emerged. Moreover, very few individual difference variables significantly correlated with false memories, and any significant correlations were rather small. It seems likely, therefore, that there is no false memory "trait". In other words, no one type of person seems especially prone, or especially resilient, to the ubiquity of memory distortion.

Meaningfulness of landmark pictograms reduces visual salience and recognition performance

Landmarks, objects in the environment used for orientation, navigation and the formation of cognitive maps are often represented in maps as pictograms. In order to support these tasks effectively and efficiently, landmark pictograms also need to be salient, as the map user needs to identify and process them quickly and easily. Two additional relevant characteristics for the usability of landmark pictograms are their meaningfulness and recognition performance. Meaningfulness is required to understand which categories of objects are represented by the pictograms. Ease of recognition prevents the necessity to consult a map repetitively and may support the formation of a cognitive map of the environment. In the present study, we investigated the relation between salience, meaningfulness and recognition performance of OpenStreetMap (OSM) pictograms and the potential effects of the visual complexity of pictograms on these usability characteristics. Salience was measured via eye fixations on specific pictograms, meaningfulness with an explicit continuous scale and recognition performance with a yes/no recognition memory paradigm. Statistical analyses showed that pictograms drew more visual attention if they were visually complex or if their meaning was inapprehensible or ambiguous. Less apprehensible pictograms were also recognized more often. Interestingly, the data indicated that longer fixations could lead to worse recognition performance. Long fixations on a pictogram may increase the likelihood of false recognition in subsequent situations where the pictogram is no longer valid or relevant. Based on the findings, we suggest balancing the meaningfulness and visual complexity of contiguous pictograms to enhance their recognition and to provide an optimal level of salience of single objects.

Eyewitness Memory in Face-to-Face and Immersive Avatar-to-Avatar Contexts

Technological advances offer possibilities for innovation in the way eyewitness testimony is elicited. Typically, this occurs face-to-face. We investigated whether a virtual environment, where interviewer and eyewitness communicate as avatars, might confer advantages by attenuating the social and situational demands of a face-to-face interview, releasing more cognitive resources for invoking episodic retrieval mode. In conditions of intentional encoding, eyewitnesses were interviewed 48 h later, either face-to-face or in a virtual environment (N = 38). Participants in the virtual environment significantly outperformed those interviewed face-to-face on all episodic performance measures - improved correct reporting reduced errors, and increased accuracy. Participants reported finding it easier to admit not remembering event information to the avatar, and finding the avatar easier to talk to. These novel findings, and our pattern of retrieval results indicates the potential of avatar-to-avatar communication in virtual environments, and provide impetus for further research investigating eyewitness cognition in contemporary retrieval contexts.

Recognition memory and featural similarity between concepts: The pupil's point of view

Differences in pupil dilation are observed for studied compared to new items in recognition memory. According to cognitive load theory, this effect reflects the greater cognitive demands of retrieving contextual information from study phase. Pupil dilation can also occur when new items conceptually related to old ones are erroneously recognized as old, but the aspects of similarity that modulate false memory and related pupil responses remain unclear. We investigated this issue by manipulating the degree of featural similarity between new (unstudied) and old (studied) concepts in an old/new recognition task. We found that new concepts with high similarity were mistakenly identified as old and had greater pupil dilation than those with low similarity, suggesting that pupil dilation reflects the strength of evidence on which recognition judgments are based and, importantly, greater locus coeruleus and prefrontal activity determined by the higher degree of retrieval monitoring involved in recognizing these items.

Neuroanatomical substrates involved in unrelated false facial recognition

Identifying faces is a process central for social interaction and a relevant factor in eyewitness theory. False recognition is a critical mistake during an eyewitness's identification scenario because it can lead to a wrongful conviction. Previous studies have described neural areas related to false facial recognition using the standard Deese/Roediger-McDermott (DRM) paradigm, triggering related false recognition. Nonetheless, misidentification of faces without trying to elicit false memories (unrelated false recognition) in a police lineup could involve different cognitive processes, and distinct neural areas. To delve into the neural circuitry of unrelated false recognition, we evaluated the memory and response confidence of participants while watching faces photographs in an fMRI task. Functional activations of unrelated false recognition were identified by contrasting the activation on this condition vs. the activations related to recognition (hits) and correct rejections. The results identified the right precentral and cingulate gyri as areas with distinctive activations during false recognition events suggesting a conflict resulting in a dysfunction during memory retrieval. High confidence suggested that about 50% of misidentifications may be related to an unconscious process. These findings add to our understanding of the construction of facial memories and its biological basis, and the fallibility of the eyewitness testimony.

The influence of perceptual similarity and individual differences on false memories in aging

Previous false memory research has suggested that older adults' false memories are based on an overreliance on gist processing in the absence of item-specific details. Yet, false memory studies have rarely taken into consideration the precise role of item-item similarity on the cognitive and neural mechanisms underlying perceptual false memories in older adults. In addition, work in our laboratory has suggested that when investigating the neural basis of false memories in older adults, it is equally as critical to take into account interindividual variability in behavior. With both factors in mind, the present study was the first to examine how both controlled, systematic differences in perceptual relatedness between targets and lures and individual differences in true and false recognition contribute to the neural basis of both true and false memories in older adults. Results suggest that between-subject variability in memory performance modulates neural activity in key regions associated with false memories in aging, whereas systematic differences in perceptual similarity did not modulate neural activity associated with false memories.

Brain Networks Related to Beta Oscillatory Activity during Episodic Memory Retrieval

Evidence from fMRI has consistently located a widespread network of frontal, parietal, and temporal lobe regions during episodic retrieval. However, the temporal limitations of the fMRI methodology have made it difficult to assess the transient network dynamics by which these distributed regions coordinate activity. Recent evidence suggests that beta oscillations (17-20 Hz) are important for top-down control for memory suppression. However, the spatial limitations of the EEG methodology make it difficult to assess the relationship between these oscillatory signals and the distributed networks identified with fMRI. This study used simultaneous EEG/fMRI to identify networks related to beta oscillations during episodic retrieval. Participants studied adjectives and either imagined a scene (Place Task) or judged its pleasantness (Pleasant Task). During the recognition test, participants decided which task was performed with each word ("Old Place Task" or "Old Pleasant Task") or "New." EEG results revealed that posterior beta power was greater for new than old words. fMRI results revealed activity in a frontal, parietal network that was greater for old than new words, consistent with prior studies. Although overall beta power increases correlated with decreased activity within a predominantly parietal network, within the right dorsolateral and ventrolateral pFC, beta power correlated with BOLD activity more under conditions requiring more cognitive control and EEG/fMRI effects in the right frontal cortex correlated with BOLD activity in a frontoparietal network. Therefore, using simultaneous EEG and fMRI, the present results suggest that beta oscillations are related to postretrieval control operations in the right frontal cortex and act within a broader postretrieval control network.

Assessing dynamic functional connectivity in heterogeneous samples

Several methods have been developed to measure dynamic functional connectivity (dFC) in fMRI data. These methods are often based on a sliding-window analysis, which aims to capture how the brain's functional organization varies over the course of a scan. The aim of many studies is to compare dFC across groups, such as younger versus older people. However, spurious group differences in measured dFC may be caused by other sources of heterogeneity between people. For example, the shape of the haemodynamic response function (HRF) and levels of measurement noise have been found to vary with age. We use a generic simulation framework for fMRI data to investigate the effect of such heterogeneity on estimates of dFC. Our findings show that, despite no differences in true dFC, individual differences in measured dFC can result from other (non-dynamic) features of the data, such as differences in neural autocorrelation, HRF shape, connectivity strength and measurement noise. We also find that common dFC methods such as k-means and multilayer modularity approaches can detect spurious group differences in dynamic connectivity due to inappropriate setting of their hyperparameters. fMRI studies therefore need to consider alternative sources of heterogeneity across individuals before concluding differences in dFC.

•

Estimates of dFC may be affected by various sources of between-people heterogeneity.

•

We simulated fMRI data to investigate the effect of such heterogeneity on dFC.

•

Differences in estimated dFC resulted from non-dynamic features of the data.

•

Choice of parameters in common methods produced spurious group differences in dFC.

Mismaking Memories

Memory illusions—vivid experiences of events that never occurred—could result from inaccuracies either in retrieving memories or in initially storing them. In two experiments, people studied lists of associated words that either did or did not induce later illusory (false) memories of associated but nonpresented lure words. The amplitude of the electrical brain activity during study of words (~500-1,300 ms) that were themselves later correctly remembered reliably distinguished list words that led to such illusory memories from those that did not. This encoding difference associated with subsequent illusory memory (referred to as a DIM)—presumably reflecting item-specific encoding differences—is a neural precursor of memory illusions.

Are eyewitness accounts biased? Evaluating false memories for crimes involving in-group or out-group conflict

Eyewitness testimony has been shown to be unreliable and susceptible to false memories. Whether eyewitness memory errors are influenced by the victim's group membership (relative to both the eyewitness and perpetrator) is underexplored. The current study used complementary behavioral and neuroimaging approaches to test the hypothesis that intragroup conflict heightens participants' susceptibility to subsequent false memories. Healthy young adults witnessed and later answered questions about events in which the perpetrator and victim were either 1) identified as in-group members relative to each other and the eyewitness, 2) out-group members relative to the eyewitness, but not each other, or 3) out-group members relative to each other (Experiments 1a and 1b). When perpetrators and victims were in-group members (intragroup conflict), participants showed heightened false memory rates. Moreover, false memories increased upon crime realization. Neuroimaging data analysis revealed that salient (as compared to ambiguous) intragroup conflict elicited heightened activation in neural regions associated with resolving cognitive conflict (anterior cingulate cortex; ACC). Increased functional connectivity between the ACC and dorsomedial prefrontal cortex was associated with subsequent false memories (Experiment 2). Results suggest that the social salience of the intragroup conflict may have been associated with participants' increased susceptibility to false memories.

Memory Distortion and Its Avoidance: An Event-Related Potentials Study on False Recognition and Correct Rejection

Memory researchers have long been captivated by the nature of memory distortions and have made efforts to identify the neural correlates of true and false memories. However, the underlying mechanisms of avoiding false memories by correctly rejecting related lures remains underexplored. In this study, we employed a variant of the Deese/Roediger-McDermott paradigm to explore neural signatures of committing and avoiding false memories. ERP were obtained for True recognition, False recognition, Correct rejection of new items, and, more importantly, Correct rejection of related lures. With these ERP data, early-frontal, left-parietal, and late right-frontal old/new effects (associated with familiarity, recollection, and monitoring processes, respectively) were analysed. Results indicated that there were similar patterns for True and False recognition in all three old/new effects analysed in our study. Also, False recognition and Correct rejection of related lures activities seemed to share common underlying familiarity-based processes. The ERP similarities between False recognition and Correct rejection of related lures disappeared when recollection processes were examined because only False recognition presented a parietal old/new effect. This finding supported the view that actual false recollections underlie false memories, providing evidence consistent with previous behavioural research and with most ERP and neuroimaging studies. Later, with the onset of monitoring processes, False recognition and Correct rejection of related lures waveforms presented, again, clearly dissociated patterns. Specifically, False recognition and True recognition showed more positive going patterns than Correct rejection of related lures signal and Correct rejection of new items signature. Since False recognition and Correct rejection of related lures triggered familiarity-recognition processes, our results suggest that deciding which items are studied is based more on recollection processes, which are later supported by monitoring processes. Results are discussed in terms of Activation-Monitoring Framework and Fuzzy Trace-Theory, the most prominent explanatory theories of false memory raised with the Deese/Roediger-McDermott paradigm.

What's the gist? The influence of schemas on the neural correlates underlying true and false memories

The current study used a novel scene paradigm to investigate the role of encoding schemas on memory. Specifically, the study examined the influence of a strong encoding schema on retrieval of both schematic and non-schematic information, as well as false memories for information associated with the schema. Additionally, the separate roles of recollection and familiarity in both veridical and false memory retrieval were examined. The study identified several novel results. First, while many common neural regions mediated both schematic and non-schematic retrieval success, schematic recollection exhibited greater activation in visual cortex and hippocampus, regions commonly shown to mediate detailed retrieval. More effortful cognitive control regions in the prefrontal and parietal cortices, on the other hand, supported non-schematic recollection, while lateral temporal cortices supported familiarity-based retrieval of non-schematic items. Second, both true and false recollection, as well as familiarity, were mediated by activity in left middle temporal gyrus, a region associated with semantic processing and retrieval of schematic gist. Moreover, activity in this region was greater for both false recollection and false familiarity, suggesting a greater reliance on lateral temporal cortices for retrieval of illusory memories, irrespective of memory strength. Consistent with previous false memory studies, visual cortex showed increased activity for true compared to false recollection, suggesting that visual cortices are critical for distinguishing between previously viewed targets and related lures at retrieval. Additionally, the absence of common visual activity between true and false retrieval suggests that, unlike previous studies utilizing visual stimuli, when false memories are predicated on schematic gist and not perceptual overlap, there is little reliance on visual processes during false memory retrieval. Finally, the medial temporal lobe exhibited an interesting dissociation, showing greater activity for true compared to false recollection, as well as for false compared to true familiarity. These results provided an indication as to how different types of items are retrieved when studied within a highly schematic context. Results both replicate and extend previous true and false memory findings, supporting the Fuzzy Trace Theory.

The Neural System of Postdecision Evaluation in Rostral Frontal Cortex during Problem-solving Tasks

Little attention has been paid to the postdecision processing in fMRI studies with task paradigms in which there was no explicit feedback. Although late-onset BOLD responses were previously observed in the lateral frontopolar cortex after the familiar-novel decision on visually presented words, the nature of neural activations that caused the late-onset BOLD responses remained elusive. We here found, in human experts conducting complicated problem-solving tasks in their expertise domain, that the rostral frontal cortex, including the lateral frontopolar cortex, along with the anterior inferior parietal lobule, was activated only during the postdecision period, although there was no feedback. That is, these areas showed late-onset BOLD responses, and fitting of the BOLD responses with different models indicates that they were caused by neural activations that occurred after the decision. However, there was no response after performing a sensory-motor control task, and the magnitude of postdecision activations was correlated with the degree of uncertainty about the preceding decision, which suggests that the postdecision neural activations were associated with the preceding decision procedure. Furthermore, the same set of areas was more strongly activated when the subject explicitly rethought the preceding problem. These results suggest that the rostral frontal cortex, together with anterior inferior parietal lobule, comprises a network for uncertainty monitoring and exploration of alternative resolutions in postdecision evaluation. The present results thus introduce a new aspect of the functional gradient along the rostrocaudal axis in the frontal cortex.

The interaction between frontal functioning and encoding processes in reducing false memories

Studies suggest that age differences in false memories may be related to deficits in frontal lobe functioning (FLF; Butler, McDaniel, Dornburg, Price, & Roediger, 2004, Psychonomic Bulletin & Review, 11, 921). In addition, research has demonstrated that item-specific encoding can reduce false memories in younger adults ( Arndt & Reder, 2003, Journal of Experimental Psychology: Learning, Memory, and Cognition, 28, 830). In the present study we examined whether younger and older adults who perform poorly on tests designed to assess frontal function would be less likely to benefit from item-specific encoding in a false memory paradigm. In three experiments, participants studied categorized word or picture lists. Encoding manipulations were designed to emphasize either item-specific or relational processing. Younger adults and high FLF older adults showed a reduction in false memories when item-specific processing was implemented. However, low FLF older adults showed a reduction in false memories only when relational processing was impoverished. Results suggest that frontal function directly influences the engagement in distinctive encoding processes.

True and false memories, parietal cortex, and confidence judgments

Recent studies have asked whether activity in the medial temporal lobe (MTL) and the neocortex can distinguish true memory from false memory. A frequent complication has been that the confidence associated with correct memory judgments (true memory) is typically higher than the confidence associated with incorrect memory judgments (false memory). Accordingly, it has often been difficult to know whether a finding is related to memory confidence or memory accuracy. In the current study, participants made recognition memory judgments with confidence ratings in response to previously studied scenes and novel scenes. The left hippocampus and 16 other brain regions distinguished true and false memories when confidence ratings were different for the two conditions. Only three regions (all in the parietal cortex) distinguished true and false memories when confidence ratings were equated. These findings illustrate the utility of taking confidence ratings into account when identifying brain regions associated with true and false memories. Neural correlates of true and false memories are most easily interpreted when confidence ratings are similar for the two kinds of memories.

The dissociable effects of stereotype threat on older adults' memory encoding and retrieval

The present study asks how subliminal exposure to negative stereotypes about age-related memory deficits affects older adults' memory performance. Whereas prior research has focused on the effect of "stereotype threat" on older adults' memory for neutral material, the present study additionally examines the effect on memory for positive and negative words, as well as whether the subliminal "threat" has a larger impact on memory performance when it occurs prior to encoding or prior to retrieval (as compared to a control condition). Results revealed that older adults' memory impairments were most pronounced when the threat was placed prior to retrieval as compared to when the threat was placed prior to encoding or no threat occurred. Moreover, the threat specifically increased false memory rates, particularly for neutral items compared to positive and negative ones. These results emphasize that stereotype threat effects vary depending upon the phase of memory it impacts.

Methods and utility of EEG-fMRI in epilepsy

Brain activity data in general and more specifically in epilepsy can be represented as a matrix that includes measures of electrophysiology, anatomy and behaviour. Each of these sub-matrices has a complex interaction depending upon the brain state i.e., rest, cognition, seizures and interictal periods. This interaction presents significant challenges for interpretation but also potential for developing further insights into individual event types. Successful treatments in epilepsy hinge on unravelling these complexities, and also on the sensitivity and specificity of methods that characterize the nature and localization of underlying physiological and pathological networks. Limitations of pharmacological and surgical treatments call for refinement and elaboration of methods to improve our capability to localise the generators of seizure activity and our understanding of the neurobiology of epilepsy. Simultaneous electroencephalography and functional magnetic resonance imaging (EEG-fMRI), by potentially circumventing some of the limitations of EEG in terms of sensitivity, can allow the mapping of haemodynamic networks over the entire brain related to specific spontaneous and triggered epileptic events in humans, and thereby provide new localising information. In this work we review the published literature, and discuss the methods and utility of EEG-fMRI in localising the generators of epileptic activity. We draw on our experience and that of other groups, to summarise the spectrum of information provided by an increasing number of EEG-fMRI case-series, case studies and group studies in patients with epilepsy, for its potential role to elucidate epileptic generators and networks. We conclude that EEG-fMRI provides a multidimensional view that contributes valuable clinical information to localize the epileptic focus with potential important implications for the surgical treatment of some patients with drug-resistant epilepsy, and insights into the resting state and cognitive network dynamics.

Inferring common cognitive mechanisms from brain blood-flow lateralization data: a new methodology for fTCD analysis

Current neuroimaging techniques with high spatial resolution constrain participant motion so that many natural tasks cannot be carried out. The aim of this paper is to show how a time-locked correlation-analysis of cerebral blood flow velocity (CBFV) lateralization data, obtained with functional TransCranial Doppler (fTCD) ultrasound, can be used to infer cerebral activation patterns across tasks. In a first experiment we demonstrate that the proposed analysis method results in data that are comparable with the standard Lateralization Index (LI) for within-task comparisons of CBFV patterns, recorded during cued word generation (CWG) at two difficulty levels. In the main experiment we demonstrate that the proposed analysis method shows correlated blood-flow patterns for two different cognitive tasks that are known to draw on common brain areas, CWG, and Music Synthesis. We show that CBFV patterns for Music and CWG are correlated only for participants with prior musical training. CBFV patterns for tasks that draw on distinct brain areas, the Tower of London and CWG, are not correlated. The proposed methodology extends conventional fTCD analysis by including temporal information in the analysis of cerebral blood-flow patterns to provide a robust, non-invasive method to infer whether common brain areas are used in different cognitive tasks. It complements conventional high resolution imaging techniques.

A hierarchical model for simultaneous detection and estimation in multi-subject fMRI studies

In this paper we introduce a new hierarchical model for the simultaneous detection of brain activation and estimation of the shape of the hemodynamic response in multi-subject fMRI studies. The proposed approach circumvents a major stumbling block in standard multi-subject fMRI data analysis, in that it both allows the shape of the hemodynamic response function to vary across region and subjects, while still providing a straightforward way to estimate population-level activation. An efficient estimation algorithm is presented, as is an inferential framework that allows for not only tests of activation, but also tests for deviations from some canonical shape. The model is validated through simulations and application to a multi-subject fMRI study of thermal pain.

Lag structure in resting-state fMRI

The discovery that spontaneous fluctuations in blood oxygen level-dependent (BOLD) signals contain information about the functional organization of the brain has caused a paradigm shift in neuroimaging. It is now well established that intrinsic brain activity is organized into spatially segregated resting-state networks (RSNs). Less is known regarding how spatially segregated networks are integrated by the propagation of intrinsic activity over time. To explore this question, we examined the latency structure of spontaneous fluctuations in the fMRI BOLD signal. Our data reveal that intrinsic activity propagates through and across networks on a timescale of ∼1 s. Variations in the latency structure of this activity resulting from sensory state manipulation (eyes open vs. closed), antecedent motor task (button press) performance, and time of day (morning vs. evening) suggest that BOLD signal lags reflect neuronal processes rather than hemodynamic delay. Our results emphasize the importance of the temporal structure of the brain's spontaneous activity.

Disowned recollections: denying true experiences undermines belief in occurrence but not judgments of remembering

Recent research findings have illustrated that false memories induced in the laboratory can be dissociated from the beliefs that the events had in fact occurred. In this study we assessed whether this dissociability is a quality peculiar to false memory, or whether it represents a general characteristic of autobiographical memory. To this end we examined whether people can be induced to stop believing in memories for true experiences. Participants observed and performed simple actions, and were later falsely informed that they had not performed some of them--that false memories for these actions had been implanted through the use of fabricated evidence. Before and after receiving this misinformation, participants rated their belief in and memory of performing those actions, other actions that they had also performed, and actions that they had not performed. Whereas the misinformation substantially undermined participants' beliefs in the specific performed actions about which they had been misinformed, it had little effect on their endorsement of remembering those actions. The misinformation thus boosted the proportion of occasions in which participants rated their memories as stronger than their beliefs, and it weakened the correlation between belief and memory ratings. Thus, this study provides the first experimental demonstration of non-believed memories of true experiences. We discuss our findings with reference to the small literature concerning the use of socially-communicated misinformation to undermine event memories, and with reference to the structure of autobiographical memory.

Differential effects of Parkinson's disease and dopamine replacement on memory encoding and retrieval

Increasingly memory deficits are recognized in Parkinson's disease (PD). In PD, the dopamine-producing cells of the substantia nigra (SN) are significantly degenerated whereas those in the ventral tegmental area (VTA) are relatively spared. Dopamine-replacement medication improves cognitive processes that implicate the SN-innervated dorsal striatum but is thought to impair those that depend upon the VTA-supplied ventral striatum, limbic and prefrontal cortices. Our aim was to examine memory encoding and retrieval in PD and how they are affected by dopamine replacement. Twenty-nine PD patients performed the Rey Auditory Verbal Learning Test (RAVLT) and a non-verbal analogue, the Aggie Figures Learning Test (AFLT), both on and off dopaminergic medications. Twenty-seven, age-matched controls also performed these memory tests twice and their data were analyzed to correspond to the ON-OFF order of the PD patients to whom they were matched. We contrasted measures that emphasized with those that accentuated retrieval and investigated the effect of PD and dopamine-replacement on these processes separately. For PD patients relative to controls, encoding performance was normal in the off state and was impaired on dopaminergic medication. Retrieval was impaired off medication and improved by dopamine repletion. This pattern of findings suggests that VTA-innervated brain regions such as ventral striatum, limbic and prefrontal cortices are implicated in encoding, whereas the SN-supplied dorsal striatum mediates retrieval. Understanding this pattern of spared functions and deficits in PD, and the effect of dopamine replacement on these distinct memory processes, should prompt closer scrutiny of patients' cognitive complaints to inform titration of dopamine replacement dosages along with motor symptoms.

Functional parcellation of the inferior frontal and midcingulate cortices in a flanker-stop-change paradigm

Conflict monitoring and motor inhibition are engaged in the performance of complex tasks. The midcingulate cortex (MCC) has been suggested to detect conflicts, whereas the right inferior frontal cortex (IFC) seems to be of relevance for the inhibition process. The current experiment investigates the neural underpinnings of their interplay via a modified flanker paradigm. Conflict was manipulated by the congruency of flanking stimuli relative to a target (congruent vs. incongruent) and motor inhibition by a within-trial response change of the initiated response (keep response vs. stop-change). We used event-related functional magnetic resonance imaging, decomposition with high model order ICA, and single trial analysis to derive a functional parcellation of the whole-brain data. Results demonstrate the segmentation of the MCC into anterior and posterior subregions, and of the IFC into the pars opercularis, pars triangularis, and pars orbitalis. The pars opercularis and pars triangularis of the right IFC constituted the foundation of inhibition-related networks. With high conflict on incongruent trials, activity in the posterior MCC network, as well as in one right IFC network was observed. Stop-change trials modulated both the MCC as well as networks covering extended parts of the IFC. Whereas conflict processing and inhibition most often are studied separately, this study provides a synopsis of functionally coupled brain regions acting in concert to enable an optimal performance in situations involving interference and inhibition.

Massive modulation of brain areas after mechanical pain stimulation: a time-resolved FMRI study

To date, relatively little is known about the spatiotemporal aspects of whole-brain blood oxygenation level-dependent (BOLD) responses to brief nociceptive stimuli. It is known that the majority of brain areas show a stimulus-locked response, whereas only some are characterized by a canonical hemodynamic response function. Here, we investigated the time course of brain activations in response to mechanical pain stimulation applied to participants' hands while they were undergoing functional magnetic resonance imaging (fMRI) scanning. To avoid any assumption about the shape of BOLD response, we used an unsupervised data-driven method to group voxels sharing a time course similar to the BOLD response to the stimulus and found that whole-brain BOLD responses to painful mechanical stimuli elicit massive activation of stimulus-locked brain areas. This pattern of activations can be segregated into 5 clusters, each with a typical temporal profile. In conclusion, we show that an extensive activity of multiple networks is engaged at different time latencies after presentation of a noxious stimulus. These findings aim to motivate research on a controversial topic, such as the temporal profile of BOLD responses, the variability of these response profiles, and the interaction between the stimulus-related BOLD response and ongoing fluctuations in large-scale brain networks.

False memory ≠ false memory: DRM errors are unrelated to the misinformation effect

The DRM method has proved to be a popular and powerful, if controversial, way to study 'false memories'. One reason for the controversy is that the extent to which the DRM effect generalises to other kinds of memory error has been neither satisfactorily established nor subject to much empirical attention. In the present paper we contribute data to this ongoing debate. One hundred and twenty participants took part in a standard misinformation effect experiment, in which they watched some CCTV footage, were exposed to misleading post-event information about events depicted in the footage, and then completed free recall and recognition tests. Participants also completed a DRM test as an ostensibly unrelated filler task. Despite obtaining robust misinformation and DRM effects, there were no correlations between a broad range of misinformation and DRM effect measures (mean r  = -.01). This was not due to reliability issues with our measures or a lack of power. Thus DRM 'false memories' and misinformation effect 'false memories' do not appear to be equivalent.

Constructive memory: past and future

Human memory is not a literal reproduction of the past, but instead relies on constructive processes that are sometimes prone to error and distortion. Understanding of constructive memory has accelerated during recent years as a result of research that has linked together its cognitive and neural bases. This article focuses on three aspects of constructive memory that have been the target of recent research: (i) the idea that certain kinds of memory distortions reflect the operation of adaptive cognitive processes that contribute to the efficient functioning of memory; (ii) the role of a constructive memory system in imagining or simulating possible future events; and (iii) differences between true and false memories that have been revealed by functional neuroimaging techniques. The article delineates the theoretical implications of relevant research, and also considers some clinical and applied implications.

The encoding/retrieval flip: interactions between memory performance and memory stage and relationship to intrinsic cortical networks

fMRI studies have linked the posteromedial cortex to episodic learning (encoding) and remembering (retrieval) processes. The posteromedial cortex is considered part of the default network and tends to deactivate during encoding but activate during retrieval, a pattern known as the encoding/retrieval flip. Yet, the exact relationship between the neural correlates of memory performance (hit/miss) and memory stage (encoding/retrieval) and the extent of overlap with intrinsic cortical networks remains to be elucidated. Using task-based fMRI, we isolated the pattern of activity associated with memory performance, memory stage, and the interaction between both. Using resting-state fMRI, we identified which intrinsic large-scale functional networks overlapped with regions showing task-induced effects. Our results demonstrated an effect of successful memory performance in regions associated with the control network and an effect of unsuccessful memory performance in the ventral attention network. We found an effect of memory retrieval in brain regions that span the default and control networks. Finally, we found an interaction between memory performance and memory stage in brain regions associated with the default network, including the posteromedial cortex, posterior parietal cortex, and parahippocampal cortex. We discuss these findings in relation to the encoding/retrieval flip. In general, the findings demonstrate that task-induced effects cut across intrinsic cortical networks. Furthermore, regions within the default network display functional dissociations, and this may have implications for the neural underpinnings of age-related memory disorders.

Item familiarity and controlled associative retrieval in Alzheimer's disease: an fMRI study

Typical Alzheimer's disease (AD) is characterized by an impaired form of associative memory, recollection, that includes the controlled retrieval of associations. In contrast, familiarity-based memory for individual items may sometimes be preserved in the early stages of the disease. This is the first study that directly examines whole-brain regional activity during one core aspect of the recollection function: associative controlled episodic retrieval (CER), contrasted to item familiarity in AD patients. Cerebral activity related to associative CER and item familiarity in AD patients and healthy controls (HCs) was measured with functional magnetic resonance imaging during a word-pair recognition task to which the process dissociation procedure was applied. Some patients had null CER estimates (AD-), whereas others did show some CER abilities (AD+), although significantly less than HC. In contrast, familiarity estimates were equivalent in the three groups. In AD+, as in controls, associative CER activated the inferior precuneus/posterior cingulate cortex (PCC). When performing group comparisons, no region was found to be significantly more activated during CER in HC than AD+ and vice versa. However, during associative CER, functional connectivity between this region and the hippocampus, the inferior parietal and dorsolateral prefrontal cortex (DLPFC) was significantly higher in HC than in AD+. In all three groups, item familiarity was related to activation along the intraparietal sulcus (IPS). In conclusion, whereas the preserved automatic detection of an old item (without retrieval of accurate word association) is related to parietal activation centred on the IPS, the inferior precuneus/PCC supports associative CER ability in AD patients, as in HC. However, AD patients have deficient functional connectivity during associative CER, suggesting that the residual recollection function in these patients might be impoverished by the lack of some recollection-related aspects such as autonoetic quality, episodic details and verification.

Retrieval orientation and the control of recollection: an fMRI study

This study used event-related fMRI to examine the impact of the adoption of different retrieval orientations on the neural correlates of recollection. In each of two study-test blocks, participants encoded a mixed list of words and pictures and then performed a recognition memory task with words as the test items. In one block, the requirement was to respond positively to test items corresponding to studied words and to reject both new items and items corresponding to the studied pictures. In the other block, positive responses were made to test items corresponding to pictures, and items corresponding to words were classified along with the new items. On the basis of previous ERP findings, we predicted that in the word task, recollection-related effects would be found for target information only. This prediction was fulfilled. In both tasks, targets elicited the characteristic pattern of recollection-related activity. By contrast, nontargets elicited this pattern in the picture task, but not in the word task. Importantly, the left angular gyrus was among the regions demonstrating this dissociation of nontarget recollection effects according to retrieval orientation. The findings for the angular gyrus parallel prior findings for the "left-parietal" ERP old/new effect and add to the evidence that the effect reflects recollection-related neural activity originating in left ventral parietal cortex. Thus, the results converge with the previous ERP findings to suggest that the processing of retrieval cues can be constrained to prevent the retrieval of goal-irrelevant information.

Neural correlates of true and false memory in mild cognitive impairment

The goal of this research was to investigate the changes in neural processing in mild cognitive impairment. We measured phase synchrony, amplitudes, and event-related potentials in veridical and false memory to determine whether these differed in participants with mild cognitive impairment compared with typical, age-matched controls. Empirical mode decomposition phase locking analysis was used to assess synchrony, which is the first time this analysis technique has been applied in a complex cognitive task such as memory processing. The technique allowed assessment of changes in frontal and parietal cortex connectivity over time during a memory task, without a priori selection of frequency ranges, which has been shown previously to influence synchrony detection. Phase synchrony differed significantly in its timing and degree between participant groups in the theta and alpha frequency ranges. Timing differences suggested greater dependence on gist memory in the presence of mild cognitive impairment. The group with mild cognitive impairment had significantly more frontal theta phase locking than the controls in the absence of a significant behavioural difference in the task, providing new evidence for compensatory processing in the former group. Both groups showed greater frontal phase locking during false than true memory, suggesting increased searching when no actual memory trace was found. Significant inter-group differences in frontal alpha phase locking provided support for a role for lower and upper alpha oscillations in memory processing. Finally, fronto-parietal interaction was significantly reduced in the group with mild cognitive impairment, supporting the notion that mild cognitive impairment could represent an early stage in Alzheimer's disease, which has been described as a 'disconnection syndrome'.

True and False DRM Memories: Differences Detected with an Implicit Task

Memory is prone to illusions. When people are presented with lists of words associated with a non-presented critical lure, they produce a high level of false recognitions (false memories) for non-presented related stimuli indistinguishable, at the explicit level, from presented words (DRM paradigm). We assessed whether true and false DRM memories can be distinguished at the implicit level by using the autobiographical IAT (aIAT), a novel method based on indirect measures that permits to detect true autobiographical events encoded in the respondent's mind/brain. In our experiment, after a DRM task participants performed two aIATs: the first aimed at testing implicit memory for presented words (true-memories aIAT) and the second aimed at evaluating implicit memory for critical lures (false-memories aIAT). Specifically, the two aIATs assessed the association of presented words and critical lures with the logical dimension "true." Results showed that the aIAT detected a greater association of presented words than critical lures with the logical dimension "true." This result indicates that although true and false DRM memories are indistinguishable at the explicit level a different association of the true and false DRM memories with the logical dimension "true" can be detected at the implicit level, and suggests that the aIAT may be a sensitive instrument to detect differences between true and false DRM memories.

An overview of the neuro-cognitive processes involved in the encoding, consolidation, and retrieval of true and false memories

Perception and memory are imperfect reconstructions of reality. These reconstructions are prone to be influenced by several factors, which may result in false memories. A false memory is the recollection of an event, or details of an episode, that did not actually occur. Memory formation comprises at least three different sub-processes: encoding, consolidation and the retrieval of the learned material. All of these sub-processes are vulnerable for specific errors and consequently may result in false memories. Whereas, processes like imagery, self-referential encoding or spreading activation can lead to the formation of false memories at encoding, semantic generalization during sleep and updating processes due to misleading post event information, in particular, are relevant at the consolidation stage. Finally at the retrieval stage, monitoring processes, which are assumed to be essential to reject false memories, are of specific importance. Different neuro-cognitive processes have been linked to the formation of true and false memories. Most consistently the medial temporal lobe and the medial and lateral prefrontal cortex have been reported with regard to the formation of true and false memories. Despite the fact that all phases entailing memory formation, consolidation of stored information and retrieval processes, are relevant for the forming of false memories, most studies focused on either memory encoding or retrieval. Thus, future studies should try to integrate data from all phases to give a more comprehensive view on systematic memory distortions. An initial outline is developed within this review to connect the different memory stages and research strategies.

Neuronal Correlates of Perception, Imagery, and Memory for Familiar Tunes

We used fMRI to investigate the neuronal correlates of encoding and recognizing heard and imagined melodies. Ten participants were shown lyrics of familiar verbal tunes; they either heard the tune along with the lyrics, or they had to imagine it. In a subsequent surprise recognition test, they had to identify the titles of tunes that they had heard or imagined earlier. The functional data showed substantial overlap during melody perception and imagery, including secondary auditory areas. During imagery compared with perception, an extended network including pFC, SMA, intraparietal sulcus, and cerebellum showed increased activity, in line with the increased processing demands of imagery. Functional connectivity of anterior right temporal cortex with frontal areas was increased during imagery compared with perception, indicating that these areas form an imagery-related network. Activity in right superior temporal gyrus and pFC was correlated with the subjective rating of imagery vividness. Similar to the encoding phase, the recognition task recruited overlapping areas, including inferior frontal cortex associated with memory retrieval, as well as left middle temporal gyrus. The results present new evidence for the cortical network underlying goal-directed auditory imagery, with a prominent role of the right pFC both for the subjective impression of imagery vividness and for on-line mental monitoring of imagery-related activity in auditory areas.

Spatial and temporal dynamics of cortical networks engaged in memory encoding and retrieval

Memory operations such as encoding and retrieval require the coordinated interplay of cortical regions with distinct functional contributions. The mechanistic nature of these interactions, however, remains unspecified. During the performance of a face memory task during fMRI scanning, we measured the magnitude (a measure of the strength of coupling between areas) and phase (a measure of the relative timing across areas) of coherence between regions of interest and the rest of the brain. The fusiform face area (FFA) showed robust coherence with a distributed network of subregions in the prefrontal cortex (PFC), posterior parietal cortex (PPC), precuneus, and hippocampus across both memory operations. While these findings reveal significant overlap in the cortical networks underlying mnemonic encoding and retrieval, coherence phase analyses revealed context-dependent differences in cortical dynamics. During both encoding and retrieval, PFC and PPC exhibited earlier activity than in the FFA and hippocampus. Also, during retrieval, PFC activity preceded PPC activity. These findings are consistent with prior physiology studies suggesting an early contribution of PFC and PPC in mnemonic control. Together, these findings contribute to the growing literature exploring the spatio-temporal dynamics of basic memory operations.

Psychophysiology of false memories in a Deese-Roediger-McDermott paradigm with visual scenes

Remembering something that has not in fact been experienced is commonly referred to as false memory. The Deese-Roediger-McDermott (DRM) paradigm is a well-elaborated approach to this phenomenon. This study attempts to investigate the peripheral physiology of false memories induced in a visual DRM paradigm. The main research question is whether false recognition is different from true recognition in terms of accompanying physiological responses.Sixty subjects participated in the experiment, which included a study phase with visual scenes each showing a group of interrelated items in social contexts. Subjects were divided into an experimental group undergoing a classical DRM design and a control group without DRM manipulation. The control group was implemented in order to statistically control for possible biases produced by memorability differences between stimulus types. After a short retention interval, a pictorial recognition phase was conducted in the manner of a Concealed Information Test. Simultaneous recordings of electrodermal activity, respiration line length, phasic heart rate, and finger pulse waveform length were used. Results yielded a significant Group by Item Type interaction, showing that true recognition is accompanied by greater electrodermal activity than false recognition.Results are discussed in the light of Sokolov's Orienting Reflex, the Preliminary Process Theory and the Concealed Information Test. Implications and restrictions of the introduced design features are critically discussed. This study demonstrates the applicability of measures of peripheral physiology to the field of false memory research.