Interactions of memory and perception in amnesia: the figure-ground perspective

Backward masking implicates cortico-cortical recurrent processes in convex figure context effects and cortico-thalamic recurrent processes in resolving figure-ground ambiguity

Introduction

Previous experiments purportedly showed that image-based factors like convexity were sufficient for figure assignment. Recently, however, we found that the probability of perceiving a figure on the convex side of a central border was only slightly higher than chance for two-region displays and increased with the number of display regions; this increase was observed only when the concave regions were homogeneously colored. These convex figure context effects (CEs) revealed that figure assignment in these classic displays entails more than a response to local convexity. A Bayesian observer replicated the convex figure CEs using both a convexity object prior and a new, homogeneous background prior and made the novel prediction that the classic displays in which both the convex and concave regions were homogeneous were ambiguous during perceptual organization.

Methods

Here, we report three experiments investigating the proposed ambiguity and examining how the convex figure CEs unfold over time with an emphasis on whether they entail recurrent processing. Displays were shown for 100 ms followed by pattern masks after ISIs of 0, 50, or 100 ms. The masking conditions were designed to add noise to recurrent processing and therefore to delay the outcome of processes in which they play a role. In Exp. 1, participants viewed two- and eight-region displays with homogeneous convex regions (homo-convex displays; the putatively ambiguous displays). In Exp. 2, participants viewed putatively unambiguous hetero-convex displays. In Exp. 3, displays and masks were presented to different eyes, thereby delaying mask interference in the thalamus for up to 100 ms.

Results and discussion

The results of Exps. 1 and 2 are consistent with the interpretation that recurrent processing is involved in generating the convex figure CEs and resolving the ambiguity of homo-convex displays. The results of Exp. 3 suggested that corticofugal recurrent processing is involved in resolving the ambiguity of homo-convex displays and that cortico-cortical recurrent processes play a role in generating convex figure CEs and these two types of recurrent processes operate in parallel. Our results add to evidence that perceptual organization evolves dynamically and reveal that stimuli that seem unambiguous can be ambiguous during perceptual organization.

Episodic Memory formation: A review of complex Hippocampus input pathways

Memories of everyday experiences involve the encoding of a rich and dynamic representation of present objects and their contextual features. Traditionally, the resulting mnemonic trace is referred to as Episodic Memory, i.e. the "what", "where" and "when" of a lived episode. The journey for such memory trace encoding begins with the perceptual data of an experienced episode handled in sensory brain regions. The information is then streamed to cortical areas located in the ventral Medio Temporal Lobe, which produces multi-modal representations concerning either the objects (in the Perirhinal cortex) or the spatial and contextual features (in the parahippocampal region) of the episode. Then, this high-level data is gated through the Entorhinal Cortex and forwarded to the Hippocampal Formation, where all the pieces get bound together. Eventually, the resulting encoded neural pattern is relayed back to the Neocortex for a stable consolidation. This review will detail these different stages and provide a systematic overview of the major cortical streams toward the Hippocampus relevant for Episodic Memory encoding.

Semantic Expectation Effects on Object Detection: Using Figure Assignment to Elucidate Mechanisms

Recent evidence suggesting that object detection is improved following valid rather than invalid labels implies that semantics influence object detection. It is not clear, however, whether the results index object detection or feature detection. Further, because control conditions were absent and labels and objects were repeated multiple times, the mechanisms are unknown. We assessed object detection via figure assignment, whereby objects are segmented from backgrounds. Masked bipartite displays depicting a portion of a mono-oriented object (a familiar configuration) on one side of a central border were shown once only for 90 or 100 ms. Familiar configuration is a figural prior. Accurate detection was indexed by reports of an object on the familiar configuration side of the border. Compared to control experiments without labels, valid labels improved accuracy and reduced response times (RTs) more for upright than inverted objects (Studies 1 and 2). Invalid labels denoting different superordinate-level objects (DSC; Study 1) or same superordinate-level objects (SSC; Study 2) reduced accuracy for upright displays only. Orientation dependency indicates that effects are mediated by activated object representations rather than features which are invariant over orientation. Following invalid SSC labels (Study 2), accurate detection RTs were longer than control for both orientations, implicating conflict between semantic representations that had to be resolved before object detection. These results demonstrate that object detection is not just affected by semantics, it entails semantics.

Verbal and Nonverbal Memory in Neurodegenerative and Stroke Aphasia: Evidence From the Turkish Version of the Three Words Three Shapes Test

BACKGROUND

Although language impairment is the most salient feature of cognitive impairment in both primary progressive aphasia (PPA) and stroke aphasia (SA), memory can also be impaired in both patient populations.

OBJECTIVE

To identify distinctive features of verbal and nonverbal memory processing in individuals with PPA and those with SA.

METHOD

We gave individuals with PPA (n = 14), those with SA (n = 8), and healthy controls (HC; n = 13) a comprehensive neuropsychological test battery and the Turkish version of the Three Words Three Shapes Test (3W3S-Turkish). The 3W3S-Turkish Test includes five subtests: Copy, Incidental Recall, Acquisition, Delayed Recall, and Recognition. High-resolution brain scans were performed in a subset of individuals with PPA and those with SA. Lesion distribution was limited to the dorsal language areas in the SA group, whereas peak atrophy areas in the PPA group extended beyond the language network, including the medial temporal lobe, precuneus, and posterior/medial portions of the cingulate cortex.

RESULTS

Both the PPA and SA groups showed impairment in incidental recall, and the PPA group showed additional impairment in delayed recall. Greater impairment for verbal stimuli suggestive of material-specific memory impairment was evident in the PPA group's scores on the Incidental Recall and Delayed Recall subtests. Both aphasia groups retained the acquired information regardless of material type.

CONCLUSION

Although both aphasia groups shared similarities in the involvement of the dorsal prefrontal working memory/attention network, the PPA group showed greater impairment in delayed recall compared with the SA group.

Task set and instructions influence the weight of figural priors: A psychophysical study with extremal edges and familiar configuration

In figure-ground organization, the figure is defined as a region that is both "shaped" and "nearer." Here we test whether changes in task set and instructions can alter the outcome of the cross-border competition between figural priors that underlies figure assignment. Extremal edge (EE), a relative distance prior, has been established as a strong figural prior when the task is to report "which side is nearer?" In three experiments using bipartite stimuli, EEs competed and cooperated with familiar configuration, a shape prior for figure assignment in a "which side is shaped?" task." Experiment 1 showed small but significant effects of familiar configuration for displays sketching upright familiar objects, although "shaped-side" responses were predominantly determined by EEs. In Experiment 2, instructions regarding the possibility of perceiving familiar shapes were added. Now, although EE remained the dominant prior, the figure was perceived on the familiar-configuration side of the border on a significantly larger percentage of trials across all display types. In Experiment 3, both task set (nearer/shaped) and the presence versus absence of instructions emphasizing that familiar objects might be present were manipulated within subjects. With familiarity thus "primed," effects of task set emerged when EE and familiar configuration favored opposite sides as figure. Thus, changing instructions can modulate the weighing of figural priors for shape versus distance in figure assignment in a manner that interacts with task set. Moreover, we show that the influence of familiar parts emerges in participants without medial temporal lobe/ perirhinal cortex brain damage when instructions emphasize that familiar objects might be present.

High-definition transcranial direct current stimulation of the lateral occipital cortex influences figure-ground perception

Prior work has shown that the lateral occipital cortex (LO) is involved in recognition of objects and their parts, as well as segregation of that object (or "figure") from its background. No studies, though, have examined how LO's functioning is influenced by non-invasive brain stimulation, particularly during a figure-ground perception task. The present study tested whether high-definition transcranial direct current stimulation (HD-tDCS) to right LO influences the effects of familiarity on figure-ground perception. Following 20 min of offline anodal stimulation (or sham), participants viewed masked stimuli consisting of two regions separated by a vertical border and were asked to report which region they perceived as figure. One region was the "critical" region, which either depicted a portion of a familiar object ("Familiar" stimuli), or a familiar object with its parts rearranged into a novel configuration ("Part-rearranged" stimuli). Previous research using these stimuli has found higher reports of the critical region as figure for Familiar vs. Part-rearranged displays, demonstrating the effect of familiarity on figure assignment. The results of the current study showed that HD-tDCS to right LO significantly influenced this typical behavioral pattern. Specifically, stimulation (vs. sham) increased reports of the critical region as figure for Part-rearranged stimuli, bringing perception of these displays up to the level of the Familiar stimuli. We interpret this finding as evidence that stimulation of right LO increased participants' reliance on the familiarity of the parts in their figure-ground judgements-a finding consistent with and extending previous research showing that LO is indeed sensitive to object parts. This is the first study showing that HD-tDCS to LO can influence the effects of familiarity on figure-ground perception.

How Can Hearing Loss Cause Dementia?

Epidemiological studies identify midlife hearing loss as an independent risk factor for dementia, estimated to account for 9% of cases. We evaluate candidate brain bases for this relationship. These bases include a common pathology affecting the ascending auditory pathway and multimodal cortex, depletion of cognitive reserve due to an impoverished listening environment, and the occupation of cognitive resources when listening in difficult conditions. We also put forward an alternate mechanism, drawing on new insights into the role of the medial temporal lobe in auditory cognition. In particular, we consider how aberrant activity in the service of auditory pattern analysis, working memory, and object processing may interact with dementia pathology in people with hearing loss. We highlight how the effect of hearing interventions on dementia depends on the specific mechanism and suggest avenues for work at the molecular, neuronal, and systems levels to pin this down.

Object recognition is enabled by an experience-dependent appraisal of visual features in the brain's value system

This paper addresses perceptual synthesis by comparing responses evoked by visual stimuli before and after they are recognized, depending on prior exposure. Using magnetoencephalography, we analyzed distributed patterns of neuronal activity - evoked by Mooney figures - before and after they were recognized as meaningful objects. Recognition induced changes were first seen at 100-120 ​ms, for both faces and tools. These early effects - in right inferior and middle occipital regions - were characterized by an increase in power in the absence of any changes in spatial patterns of activity. Within a later 210-230 ​ms window, a quite different type of recognition effect appeared. Regions of the brain's value system (insula, entorhinal cortex and cingulate of the right hemisphere for faces and right orbitofrontal cortex for tools) evinced a reorganization of their neuronal activity without an overall power increase in the region. Finally, we found that during the perception of disambiguated face stimuli, a face-specific response in the right fusiform gyrus emerged at 240-290 ​ms, with a much greater latency than the well-known N170m component, and, crucially, followed the recognition effect in the value system regions. These results can clarify one of the most intriguing issues of perceptual synthesis, namely, how a limited set of high-level predictions, which is required to reduce the uncertainty when resolving the ill-posed inverse problem of perception, can be available before category-specific processing in visual cortex. We suggest that a subset of local spatial features serves as partial cues for a fast re-activation of object-specific appraisal by the value system. The ensuing top-down feedback from value system to visual cortex, in particular, the fusiform gyrus enables high levels of processing to form category-specific predictions. This descending influence of the value system was more prominent for faces than for tools, the fact that reflects different dependence of these categories on value-related information.

Normative data for an expanded set of stimuli for testing high-level influences on object perception: OMEFA-II

We present normative data for an expanded set of stimuli designed to investigate past experience effects on object detection. The stimuli are vertically-elongated “bipartite” displays comprising two equal-area regions meeting at an articulated central border. When the central border is assigned to one side, a shaped figure (i.e., an object) is detected on that side. Participants viewing brief masked exposures typically detect figures more often on the critical side of Intact displays where a common (“familiar”) object is depicted than on a matched critical side of Part-Rearranged (PR) displays comprising the same parts arranged in novel configurations. This pattern of results showed that past experience in the form of familiar configuration rather than familiar parts is a prior for figure assignment. Spurred by research implicating a network involving the perirhinal cortex of the medial temporal lobe in these familiar configuration effects, we enlarged the stimulus set from 24 to 48 base stimuli to increase its usefulness for behavioral, neuropsychological, and neuroimaging experiments. We measured the percentage of participants who agreed on a single interpretation for each side of Intact, Upright PR, and Inverted PR displays (144 displays; 288 sides) under long exposure conditions. High inter-subject agreement is taken to operationally define a familiar configuration. This new stimulus set is well-suited to investigate questions concerning how parts and wholes are integrated and how high- and low-level brain areas interact in object detection. This set also allows tests of predictions regarding cross-border competition in figure assignment and assessments of individual differences. The displays, their image statistics, and normative data are available online (https://osf.io/j9kz2/).

Prior Experience Alters the Appearance of Blurry Object Borders

Object memories activated by borders serve as priors for figure assignment: figures are more likely to be perceived on the side of a border where a well-known object is sketched. Do object memories also affect the appearance of object borders? Memories represent past experience with objects; memories of well-known objects include many with sharp borders because they are often fixated. We investigated whether object memories affect appearance by testing whether blurry borders appear sharper when they are contours of well-known objects versus matched novel objects. Participants viewed blurry versions of one familiar and one novel stimulus simultaneously for 180 ms; then made comparative (Exp. 1) or equality judgments regarding perceived blur (Exps. 2–4). For equivalent levels of blur, the borders of well-known objects appeared sharper than those of novel objects. These results extend evidence for the influence of past experience to object appearance, consistent with dynamic interactive models of perception.

Experience Transforms Conjunctive Object Representations: Neural Evidence for Unitization After Visual Expertise

Certain transformations must occur within the brain to allow rapid processing of familiar experiences. Complex objects are thought to become unitized, whereby multifeature conjunctions are retrieved as rapidly as a single feature. Behavioral studies strongly support unitization theory, but a compelling neural mechanism is lacking. Here, we examined how unitization transforms conjunctive representations to become more “feature-like” by recruiting posterior regions of the ventral visual stream (VVS) whose architecture is specialized for processing single features. We used functional magnetic resonance imaging to scan humans before and after visual training with novel objects. We implemented a novel multivoxel pattern analysis to measure a conjunctive code, which represented a conjunction of object features above and beyond the sum of the parts. Importantly, a multivoxel searchlight showed that the strength of conjunctive coding in posterior VVS increased posttraining. Furthermore, multidimensional scaling revealed representational separation at the level of individual features in parallel to the changes at the level of feature conjunctions. Finally, functional connectivity between anterior and posterior VVS was higher for novel objects than for trained objects, consistent with early involvement of anterior VVS in unitizing feature conjunctions in response to novelty. These data demonstrate that the brain implements unitization as a mechanism to refine complex object representations over the course of multiple learning experiences.

BRAIN AND EYE AS POTENTIAL TARGETS FOR IONIZING RADIATION IMPACT. Part І. THE CONSEQUENCES OF IRRADIATION OF THE PARTICIPANTS OF THE LIQUIDATION OF THE CHORNOBYL ACCIDENT

BACKGROUND

Exposure to ionizing radiation could affect the brain and eyes leading to cognitive and vision impairment, behavior disorders and performance decrement during professional irradiation at medical radiology, includinginterventional radiological procedures, long-term space flights, and radiation accidents.

OBJECTIVE

The objective was to analyze the current experimental, epidemiological, and clinical data on the radiation cerebro-ophthalmic effects.

MATERIALS AND METHODS

In our analytical review peer-reviewed publications via the bibliographic and scientometric bases PubMed / MEDLINE, Scopus, Web of Science, and selected papers from the library catalog of NRCRM - theleading institution in the field of studying the medical effects of ionizing radiation - were used.

RESULTS

The probable radiation-induced cerebro-ophthalmic effects in human adults comprise radiation cataracts,radiation glaucoma, radiation-induced optic neuropathy, retinopathies, angiopathies as well as specific neurocognitive deficit in the various neuropsychiatric pathology including cerebrovascular pathology and neurodegenerativediseases. Specific attention is paid to the likely stochastic nature of many of those effects. Those prenatally and inchildhood exposed are a particular target group with a higher risk for possible radiation effects and neurodegenerative diseases.

CONCLUSIONS

The experimental, clinical, epidemiological, anatomical and pathophysiological rationale for visualsystem and central nervous system (CNS) radiosensitivity is given. The necessity for further international studieswith adequate dosimetric support and the follow-up medical and biophysical monitoring of high radiation riskcohorts is justified. The first part of the study currently being published presents the results of the study of theeffects of irradiation in the participants of emergency works at the Chornobyl Nuclear Power Plant (ChNPP).

Hippocampal Engagement during Recall Depends on Memory Content

The hippocampus is considered pivotal to recall, allowing retrieval of information not available in the immediate environment. In contrast, neocortex is thought to signal familiarity, contributing to recall only when called upon by the hippocampus. However, this view is not compatible with representational accounts of memory, which reject the mapping of cognitive processes onto brain regions. According to representational accounts, the hippocampus is not engaged by recall per se, rather it is engaged whenever hippocampal representations are required. To test whether hippocampus is engaged by recall when hippocampal representations are not required, we used functional imaging and a non-associative recall task, with images (objects, scenes) studied in isolation, and image patches as cues. As predicted by a representational account, hippocampal activation was modulated by the content of the recalled memory, increasing during recall of scenes-which are known to be processed by hippocampus-but not during recall of objects. Object recall instead engaged neocortical regions known to be involved in object-processing. Further supporting the representational account, effective connectivity analyses revealed that changes in functional activation during recall were driven by increased information flow from neocortical sites, rather than by the spreading of recall-related activation from hippocampus back to neocortex.

Visual Object Discrimination Impairment as an Early Predictor of Mild Cognitive Impairment and Alzheimer's Disease

OBJECTIVE

Detection of cognitive impairment suggestive of risk for Alzheimer's disease (AD) progression is crucial to the prevention of incipient dementia. This study was performed to determine if performance on a novel object discrimination task improved identification of earlier deficits in older adults at risk for AD.

METHOD

In total, 135 participants from the 1Florida Alzheimer's Disease Research Center [cognitively normal (CN), Pre-mild cognitive impairment (PreMCI), amnestic mild cognitive impairment (aMCI), and dementia] completed a test of object discrimination and traditional memory measures in the context of a larger neuropsychological and clinical evaluation.

RESULTS

The Object Recognition and Discrimination Task (ORDT) revealed significant differences between the PreMCI, aMCI, and dementia groups versus CN individuals. Moreover, relative risk of being classified as PreMCI rather than CN increased as an inverse function of ORDT score.

DISCUSSION

Overall, the obtained results suggest that a novel object discrimination task improves the detection of very early AD-related cognitive impairment, increasing the window for therapeutic intervention. (JINS, 2019, 25, 688-698).

Extended categorization of conjunction object stimuli decreases the latency of attentional feature selection and recruits orthography-linked ERPs

The role of attention in driving perceptual expertise effects is controversial. The current study addressed the effect of training on ERP components related to and independent of attentional feature selection. Participants learned to categorize cartoon animals over six training sessions (8,800 trials) after which ERPs were recorded during a target detection task performed on trained and untrained stimulus sets. The onset of the selection negativity, an ERP component indexing attentional modulation, was about 60 msec earlier for trained than untrained stimuli. Trained stimuli also elicited centro-parietal N200 and N320 components that were insensitive to attentional feature selection. The scalp distribution and timecourse of these components were better matched by studies of orthography than object expertise. Source localization using eLORETA suggested that the strongest neural sources of the selection negativity were in right ventral temporal cortex whereas the strongest sources of the N200/N320 components were in left ventral temporal cortex, again consistent with the hypothesis that training recruited orthography related areas. Overall, training altered neural processes related to attentional selection, but also affected neural processes that were independent of feature selection.

Recognition memory shielded from semantic but not perceptual interference in normal aging

Normal aging impairs long-term declarative memory, and evidence suggests that this impairment may be driven partly by structural or functional changes in the medial temporal lobe (MTL). Theories of MTL memory function therefore make predictions for age-related memory loss. One theory - the Representational-Hierarchical account - makes two specific predictions. First, recognition memory performance in older participants should be impaired by feature-level interference, in which studied items contain many shared, and thus repeatedly appearing, perceptual features. Second, if the interference in a recognition memory task - i.e., the information that repeats across items - resides at a higher level of complexity than simple perceptual features, such as semantic gist, older adults should be less impacted by such interference than young adults. We tested these predictions using the Deese-Roediger-McDermott paradigm, by creating feature-level (i.e., perceptual) interference with phonemically/orthographically related word categories, and higher-level associative interference with semantically related word categories. We manipulated category size in order to compare the effect of less versus more interference (i.e., small versus large category size), which served to (1) avoid potential item confounds arising from systematic differences between words belonging to perceptually- versus semantically-related categories, and (2) ensure that any effect of interference was due to information encoded at study, rather than pre-experimentally. Further, we used signal detection theory (SDT) to interpret our data, rather than examining false alarm (FA) rates in isolation. The d' measure derived from SDT avoids contamination of the memory measure by response bias, and lies on an interval scale, allowing memory performance in different conditions to be compared without violating assumptions of the statistical tests. Older participants were relatively more impaired by perceptual interference and less impaired by semantic interference than young adults. This pattern is at odds with many current theories of age-related memory loss, but is in line with the Representational-Hierarchical account.

In sight, in mind

A region of the brain called the perirhinal cortex represents both what things look like and what they mean.

Intact perceptual ability, but impaired familiarity judgment, after neonatal perirhinal lesions in rhesus macaques

The perirhinal cortex is known to support high-level perceptual abilities as well as familiarity judgments that may affect recognition memory. We tested whether poor perceptual abilities or a loss of familiarity judgment contributed to the recognition memory impairments reported earlier in monkeys with PRh lesions received in infancy (Neo-PRh) (Weiss and Bachevalier, 2016; Zeamer et al., 2015). Perceptual abilities were assessed using a version of the Visual Paired Comparison task with black&white (B&W) stimuli, and familiarity judgments were assessed using the Constant Negative task requiring repeated familiarization exposures. Adult monkeys with Neo-PRh lesions were able to recognize B&W stimuli after short delays, suggesting that their perceptual abilities were within the range of control animals. However, the same Neo-PRh monkeys were slower to acquire the Constant Negative task, requiring more exposures to objects before judging them as familiar compared to control animals. Taken together, the data help to account for the differential patterns of functional compensation on previously reported recognition tasks following neonatal versus adult-onset PRh lesions, and provide further support to the view that the PRh is involved in familiarity processes.

Neuropsychological Investigations of Human Amnesia: Insights Into the Role of the Medial Temporal Lobes in Cognition

The past 30 years of research on human amnesia has yielded important changes in our understanding of the role of the medial temporal lobes (MTL) in memory. On the one hand, this body of evidence has highlighted that not all types of memory are impaired in patients with MTL lesions. On the other hand, this research has made apparent that the role of the MTL extends beyond the domain of long-term memory, to include working memory, perception, and future thinking. In this article, we review the discoveries and controversies that have characterized this literature and that set the stage for a new conceptualization of the role of the MTL in cognition. This shift toward a more nuanced understanding of MTL function has direct relevance for a range of clinical disorders in which the MTL is implicated, potentially shaping not only theoretical understanding but also clinical practice. (JINS, 2017, 23, 732-740).

Age-Related Changes in Perirhinal Cortex Sensitivity to Configuration and Part Familiarity and Connectivity to Visual Cortex

The perirhinal cortex (PRC) is a medial temporal lobe (MTL) structure known to be involved in assessing whether an object is familiar (i.e., meaningful) or novel. Recent evidence shows that the PRC is sensitive to the familiarity of both whole object configurations and their parts, and suggests the PRC may modulate part familiarity responses in V2. Here, using functional magnetic resonance imaging (fMRI), we investigated age-related decline in the PRC's sensitivity to part/configuration familiarity and assessed its functional connectivity to visual cortex in young and older adults. Participants categorized peripherally presented silhouettes as familiar ("real-world") or novel. Part/configuration familiarity was manipulated via three silhouette configurations: Familiar (parts/configurations familiar), Control Novel (parts/configurations novel), and Part-Rearranged Novel (parts familiar, configurations novel). "Real-world" judgments were less accurate than "novel" judgments, although accuracy did not differ between age groups. The fMRI data revealed differential neural activity, however: In young adults, a linear pattern of activation was observed in left hemisphere (LH) PRC, with Familiar > Control Novel > Part-Rearranged Novel. Older adults did not show this pattern, indicating age-related decline in the PRC's sensitivity to part/configuration familiarity. A functional connectivity analysis revealed a significant coupling between the PRC and V2 in the LH in young adults only. Older adults showed a linear pattern of activation in the temporopolar cortex (TPC), but no evidence of TPC-V2 connectivity. This is the first study to demonstrate age-related decline in the PRC's representations of part/configuration familiarity and its covariance with visual cortex.

Memory-guided drawing training increases Granger causal influences from the perirhinal cortex to V1 in the blind

The perirhinal cortex (PRC) is a medial temporal lobe structure that has been implicated in not only visual memory in the sighted, but also tactile memory in the blind (Cacciamani & Likova, 2016). It has been proposed that, in the blind, the PRC may contribute to modulation of tactile memory responses that emerge in low-level "visual" area V1 as a result of training-induced cortical reorganization (Likova, 2012, 2015). While some studies in the sighted have indicated that the PRC is indeed structurally and functionally connected to the visual cortex (Clavagnier, Falchier, & Kennedy, 2004; Peterson, Cacciamani, Barense, & Scalf, 2012), the PRC's direct modulation of V1 is unknown-particularly in those who lack the visual input that typically stimulates this region. In the present study, we tested Likova's PRC modulation hypothesis; specifically, we used fMRI to assess the PRC's Granger causal influence on V1 activation in the blind during a tactile memory task. To do so, we trained congenital and acquired blind participants on a unique memory-guided drawing technique previously shown to result in V1 reorganization towards tactile memory representations (Likova, 2012). The tasks (20s each) included: tactile exploration of raised line drawings of faces and objects, tactile memory retrieval via drawing, and a scribble motor/memory control. FMRI before and after a week of the Cognitive-Kinesthetic training on these tasks revealed a significant increase in PRC-to-V1 Granger causality from pre- to post-training during the memory drawing task, but not during the motor/memory control. This increase in causal connectivity indicates that the training strengthened the top-down modulation of visual cortex from the PRC. This is the first study to demonstrate enhanced directed functional connectivity from the PRC to the visual cortex in the blind, implicating the PRC as a potential source of the reorganization towards tactile representations that occurs in V1 in the blind brain (Likova, 2012).

Medial prefrontal-perirhinal cortical communication is necessary for flexible response selection

The ability to use information from the physical world to update behavioral strategies is critical for survival across species. The prefrontal cortex (PFC) supports behavioral flexibility; however, exactly how this brain structure interacts with sensory association cortical areas to facilitate the adaptation of response selection remains unknown. Given the role of the perirhinal cortex (PER) in higher-order perception and associative memory, the current study evaluated whether PFC-PER circuits are critical for the ability to perform biconditional object discriminations when the rule for selecting the rewarded object shifted depending on the animal's spatial location in a 2-arm maze. Following acquisition to criterion performance on an object-place paired association task, pharmacological blockade of communication between the PFC and PER significantly disrupted performance. Specifically, the PFC-PER disconnection caused rats to regress to a response bias of selecting an object on a particular side regardless of its identity. Importantly, the PFC-PER disconnection did not interfere with the capacity to perform object-only or location-only discriminations, which do not require the animal to update a response rule across trials. These findings are consistent with a critical role for PFC-PER circuits in rule shifting and the effective updating of a response rule across spatial locations.

A retroactive spatial cue improved VSTM capacity in mild cognitive impairment and medial temporal lobe amnesia but not in healthy older adults

Visual short-term memory (VSTM) is a vital cognitive ability, connecting visual input with conscious awareness. VSTM performance declines with mild cognitive impairment (MCI) and medial temporal lobe (MTL) amnesia. Many studies have shown that providing a spatial retrospective cue ("retrocue") improves VSTM capacity estimates for healthy young adults. However, one study has demonstrated that older adults are unable to use a retrocue to inhibit irrelevant items from memory. It is unknown whether patients with MCI and MTL amnesia will be able to use a retrocue to benefit their memory. We administered a retrocue and a baseline (simultaneous cue, "simucue") task to young adults, older adults, MCI patients, and MTL cases. Consistent with previous findings, young adults showed a retrocue benefit, whereas healthy older adults did not. In contrast, both MCI patients and MTL cases showed a retrocue benefit--the use of a retrocue brought patient performance up to the level of age-matched controls. We speculate that the patients were able to use the spatial information from the retrocue to reduce interference and facilitate binding items to their locations.

Conjunctive Coding of Complex Object Features

Critical to perceiving an object is the ability to bind its constituent features into a cohesive representation, yet the manner by which the visual system integrates object features to yield a unified percept remains unknown. Here, we present a novel application of multivoxel pattern analysis of neuroimaging data that allows a direct investigation of whether neural representations integrate object features into a whole that is different from the sum of its parts. We found that patterns of activity throughout the ventral visual stream (VVS), extending anteriorly into the perirhinal cortex (PRC), discriminated between the same features combined into different objects. Despite this sensitivity to the unique conjunctions of features comprising objects, activity in regions of the VVS, again extending into the PRC, was invariant to the viewpoints from which the conjunctions were presented. These results suggest that the manner in which our visual system processes complex objects depends on the explicit coding of the conjunctions of features comprising them.

Hippocampus, perirhinal cortex, and complex visual discriminations in rats and humans

Structures in the medial temporal lobe, including the hippocampus and perirhinal cortex, are known to be essential for the formation of long-term memory. Recent animal and human studies have investigated whether perirhinal cortex might also be important for visual perception. In our study, using a simultaneous oddity discrimination task, rats with perirhinal lesions were impaired and did not exhibit the normal preference for exploring the odd object. Notably, rats with hippocampal lesions exhibited the same impairment. Thus, the deficit is unlikely to illuminate functions attributed specifically to perirhinal cortex. Both lesion groups were able to acquire visual discriminations involving the same objects used in the oddity task. Patients with hippocampal damage or larger medial temporal lobe lesions were intact in a similar oddity task that allowed participants to explore objects quickly using eye movements. We suggest that humans were able to rely on an intact working memory capacity to perform this task, whereas rats (who moved slowly among the objects) needed to rely on long-term memory.

Mapping brain activity during loss of situation awareness: an EEG investigation of a basis for top-down influence on perception

OBJECTIVE

The objective was to map brain activity during early intervals in loss of situation awareness (SA) to examine any co-activity in visual and high-order regions, reflecting grounds for top-down influences on Level I SA.

BACKGROUND

Behavioral and neuroscience evidence indicates that high-order brain areas can engage before perception is complete. Inappropriate top-down messages may distort perception during loss of SA. Evidence of co-activity of perceptual and high-order regions would not confirm such influence but may reflect a basis for it.

METHOD

SA and bias were measured using Quantitative Analysis of Situation Awareness and brain activity recorded with 128-channel EEG (electroencephalography) during loss of SA. One task (15 participants) required identification of a target pattern, and another task (10 participants) identification of "threat" in urban scenes. In both, the target was changed without warning, enforcing loss of SA. Key regions of brain activity were identified using source localization with standardized low-resolution electrical tomography (sLORETA) 150 to 160 ms post-stimulus onset in both tasks and also 100 to 110 ms in the second task.

RESULTS

In both tasks, there was significant loss of SA and bias shift (p < .02), associated at both 150- and 100-ms intervals with co-activity of visual regions and prefrontal, anterior cingulate and parietal regions linked to cognition under uncertainty.

CONCLUSION

There was early co-activity in high- order and visual perception regions that may provide a basis for top-down influence on perception.

APPLICATION

Co-activity in high- and low-order brain regions may explain either beneficial or disruptive top-down influence on perception affecting Level I SA in real-world operations.

Novelty enhances visual salience independently of reward in the parietal lobe

Novelty modulates sensory and reward processes, but it remains unknown how these effects interact, i.e., how the visual effects of novelty are related to its motivational effects. A widespread hypothesis, based on findings that novelty activates reward-related structures, is that all the effects of novelty are explained in terms of reward. According to this idea, a novel stimulus is by default assigned high reward value and hence high salience, but this salience rapidly decreases if the stimulus signals a negative outcome. Here we show that, contrary to this idea, novelty affects visual salience in the monkey lateral intraparietal area (LIP) in ways that are independent of expected reward. Monkeys viewed peripheral visual cues that were novel or familiar (received few or many exposures) and predicted whether the trial will have a positive or a negative outcome--i.e., end in a reward or a lack of reward. We used a saccade-based assay to detect whether the cues automatically attracted or repelled attention from their visual field location. We show that salience--measured in saccades and LIP responses--was enhanced by both novelty and positive reward associations, but these factors were dissociable and habituated on different timescales. The monkeys rapidly recognized that a novel stimulus signaled a negative outcome (and withheld anticipatory licking within the first few presentations), but the salience of that stimulus remained high for multiple subsequent presentations. Therefore, novelty can provide an intrinsic bonus for attention that extends beyond the first presentation and is independent of physical rewards.

Spatially rearranged object parts can facilitate perception of intact whole objects

The familiarity of an object depends on the spatial arrangement of its parts; when the parts are spatially rearranged, they form a novel, unrecognizable configuration. Yet the same collection of parts comprises both the familiar and novel configuration. Is it possible that the collection of familiar parts activates a representation of the intact familiar configuration even when they are spatially rearranged? We presented novel configurations as primes before test displays that assayed effects on figure-ground perception from memories of intact familiar objects. In our test displays, two equal-area regions shared a central border; one region depicted a portion of a familiar object. Previous research with such displays has shown that participants are more likely to perceive the region depicting a familiar object as the figure and the abutting region as its ground when the familiar object is depicted in its upright orientation rather than upside down. The novel primes comprised either the same or a different collection of parts as the familiar object in the test display (part-rearranged and control primes, respectively). We found that participants were more likely to perceive the familiar region as figure in upright vs. inverted displays following part-rearranged primes but not control primes. Thus, priming with a novel configuration comprising the same familiar parts as the upcoming figure-ground display facilitated orientation-dependent effects of object memories on figure assignment. Similar results were obtained when the spatially rearranged collection of parts was suggested on the groundside of the prime's border, suggesting that familiar parts in novel configurations access the representation of their corresponding intact whole object before figure assignment. These data demonstrate that familiar parts access memories of familiar objects even when they are arranged in a novel configuration.

Individuals with episodic amnesia are not stuck in time

The metaphor that individuals with episodic amnesia due to hippocampal damage are "stuck in time" persists in science, philosophy, and everyday life despite mounting evidence that episodic amnesia can spare many central aspects of temporal consciousness. Here we describe some of this evidence, focusing specifically on KC, one of the most thoroughly documented and severe cases of episodic amnesia on record. KC understands the concept of time, knows that it passes, and can orient himself with respect to his personal past and future. He expresses typical attitudes toward his past and future, and he is able to make future-regarding decisions. Theories claiming that the hippocampus plays an essential role in temporal consciousness need to be revised in light of these findings.

Stimulus familiarity modulates functional connectivity of the perirhinal cortex and anterior hippocampus during visual discrimination of faces and objects

Recent research suggests that the medial temporal lobe (MTL) is involved in perception as well as in declarative memory. Amnesic patients with focal MTL lesions and semantic dementia patients showed perceptual deficits when discriminating faces and objects. Interestingly, these two patient groups showed different profiles of impairment for familiar and unfamiliar stimuli. For MTL amnesics, the use of familiar relative to unfamiliar stimuli improved discrimination performance. By contrast, patients with semantic dementia—a neurodegenerative condition associated with anterolateral temporal lobe damage—showed no such facilitation from familiar stimuli. Given that the two patient groups had highly overlapping patterns of damage to the perirhinal cortex, hippocampus, and temporal pole, the neuroanatomical substrates underlying their performance discrepancy were unclear. Here, we addressed this question with a multivariate reanalysis of the data presented by Barense et al. (2011), using functional connectivity to examine how stimulus familiarity affected the broader networks with which the perirhinal cortex, hippocampus, and temporal poles interact. In this study, healthy participants were scanned while they performed an odd-one-out perceptual task involving familiar and novel faces or objects. Seed-based analyses revealed that functional connectivity of the right perirhinal cortex and right anterior hippocampus was modulated by the degree of stimulus familiarity. For familiar relative to unfamiliar faces and objects, both right perirhinal cortex and right anterior hippocampus showed enhanced functional correlations with anterior/lateral temporal cortex, temporal pole, and medial/lateral parietal cortex. These findings suggest that in order to benefit from stimulus familiarity, it is necessary to engage not only the perirhinal cortex and hippocampus, but also a network of regions known to represent semantic information.

Resources required for processing ambiguous complex features in vision and audition are modality specific

Processing multiple complex features to create cohesive representations of objects is an essential aspect of both the visual and auditory systems. It is currently unclear whether these processes are entirely modality specific or whether there are amodal processes that contribute to complex object processing in both vision and audition. We investigated this using a dual-stream target detection task in which two concurrent streams of novel visual or auditory stimuli were presented. We manipulated the degree to which each stream taxed processing conjunctions of complex features. In two experiments, we found that concurrent visual tasks that both taxed conjunctive processing strongly interfered with each other but that concurrent auditory and visual tasks that both taxed conjunctive processing did not. These results suggest that resources for processing conjunctions of complex features within vision and audition are modality specific.

A pencil rescues impaired performance on a visual discrimination task in patients with medial temporal lobe lesions

We tested proposals that medial temporal lobe (MTL) structures support not just memory but certain kinds of visual perception as well. Patients with hippocampal lesions or larger MTL lesions attempted to identify the unique object among twin pairs of objects that had a high degree of feature overlap. Patients were markedly impaired under the more difficult task conditions. However, the deficit was fully rescued when patients used a pencil to draw lines between the twin pairs, thereby eliminating the need to hold material in memory as they worked at each display. The perceptual demands of the task were presumably the same with or without this memory aid. Accordingly, the results suggest that the deficit on this and similar tasks, which involve comparisons across stimuli, are better understood in terms of impaired memory rather than impaired perception.

The hippocampus supports high-resolution binding in the service of perception, working memory and long-term memory

It is well established that the hippocampus plays a critical role in our ability to recollect past events. A number of recent studies have indicated that the hippocampus may also play a critical role in working memory and perception, but these results have been highly controversial because other similar studies have failed to find evidence for hippocampal involvement. Thus, the precise role that the hippocampus plays in cognition is still debated. In the current paper, I propose that the hippocampus supports the generation and utilization of complex high-resolution bindings that link together the qualitative aspects that make up an event; these bindings are essential for recollection, and they can also contribute to performance across a variety of tasks including perception and working memory. An examination of the existing patient literature provides support for this proposal by showing that hippocampal damage leads to impairments on perception and working memory tasks that require complex high-resolution bindings. Conversely, hippocampal damage is much less likely to lead to impairments on tasks that require only low-resolution or simple associations/relations. The current proposal can be distinguished from earlier accounts of hippocampal function, and it generates a number of novel predictions that can be tested in future studies.

It does not look odd to me: perceptual impairments and eye movements in amnesic patients with medial temporal lobe damage

Studies of people with memory impairments have shown that a specific set of brain structures in the medial temporal lobe (MTL) is vital for memory function. However, whether these structures have a role outside of memory remains contentious. Recent studies of amnesic patients with damage to two structures within the MTL, the hippocampus and the perirhinal cortex, indicated that these patients also performed poorly on perceptual tasks. More specifically, they performed worse than controls when discriminating between objects, faces and scenes with overlapping features. In order to investigate whether these perceptual deficits are reflected in their viewing strategies, we tested a group of amnesic patients with MTL damage that included the hippocampus and perirhinal cortex on a series of oddity discrimination tasks in which they had to select an odd item from a visual array. Participants' eye movements were monitored throughout the experiment. Results revealed that patients were impaired on tasks that required them to discriminate between items that shared many features, and tasks that required processing items from different viewpoints. An analysis of their eye movements revealed that they exhibited a similar viewing pattern as controls: they fixated more on the target item on trials answered correctly, but not on trials answered incorrectly. In addition, their impaired performance was not explained by an abnormal viewing-strategy that assessed their use of working memory. These results suggest that the perceptual deficits in the MTL patients are not a consequence of abnormal viewing patterns of the objects and scenes, but instead, could involve an inability to bind information gathered from several fixations into a cohesive percept. These data also support the view that MTL structures are important not only for long-term memory, but are also involved in perceptual tasks.

Competition-strength-dependent ground suppression in figure-ground perception

Figure-ground segregation is modeled as inhibitory competition between objects that might be perceived on opposite sides of borders. The winner is the figure; the loser is suppressed, and its location is perceived as shapeless ground. Evidence of ground suppression would support inhibitory competition models and would contribute to explaining why grounds are shapeless near borders shared with figures, yet such evidence is scarce. We manipulated whether competition from potential objects on the ground side of figures was high (i.e., portions of familiar objects were potentially present there) or low (novel objects were potentially present). We predicted that greater competition would produce more ground suppression. The results of two experiments in which suppression was assessed via judgments of the orientation of target bars confirmed this prediction; a third experiment showed that ground suppression is short-lived. Our findings support inhibitory competition models of figure assignment, in particular, and models of visual perception entailing feedback, in general.

Age-related impairment in a complex object discrimination task that engages perirhinal cortex

Previous lesion studies have shown compromised complex object discrimination in rats, monkeys, and human patients with damage to the perirhinal cortical region (PRC) of the medial temporal lobe. These findings support the notion that the PRC is involved in object discrimination when pairs of objects have a high degree of overlapping features but not when object discrimination can be resolved on the basis of a single feature (e.g., size or color). Recent studies have demonstrated age-related functional changes to the PRC in animals (rats and monkeys) resulting in impaired complex object discrimination and object recognition. To date, no studies have compared younger and older humans using paradigms previously shown to engage the PRC. To investigate the influence of age on complex object discrimination in humans, the present study used an object matching paradigm for blob-like objects that have previously been shown to recruit the PRC. Difficulty was manipulated by varying the number of overlapping features between objects. Functional MRI data was acquired to determine the involvement of the PRC in the two groups during complex object discrimination. Results indicated that while young and older adults performed similarly on the easy version of the task, most older adults were impaired relative to young participants when the number of overlapping features increased. fMRI results suggest that older adults do not engage bilateral anterior PRC to the same extent as young adults. Specifically, complex object matching performance in older adults was predicted by the degree to which they engage left anterior PRC. These results provide evidence for human age-related changes in PRC function that impact complex object discrimination.

Intact memory for irrelevant information impairs perception in amnesia

Memory and perception have long been considered separate cognitive processes, and amnesia resulting from medial temporal lobe (MTL) damage is thought to reflect damage to a dedicated memory system. Recent work has questioned these views, suggesting that amnesia can result from impoverished perceptual representations in the MTL, causing an increased susceptibility to interference. Using a perceptual matching task for which fMRI implicated a specific MTL structure, the perirhinal cortex, we show that amnesics with MTL damage including the perirhinal cortex, but not those with damage limited to the hippocampus, were vulnerable to object-based perceptual interference. Importantly, when we controlled such interference, their performance recovered to normal levels. These findings challenge prevailing conceptions of amnesia, suggesting that effects of damage to specific MTL regions are better understood not in terms of damage to a dedicated declarative memory system, but in terms of impoverished representations of the stimuli those regions maintain.

Can complex visual discrimination deficits in amnesia be attributed to the medial temporal lobe? An investigation into the effects of medial temporal lobe damage on brain connectivity

It has been suggested that complex visual discrimination deficits in patients with medial temporal lobe (MTL) damage may be explained by damage or dysfunction beyond the MTL. We examined the resting functional networks and white matter connectivity of two amnesic patients who have consistently demonstrated discrimination impairments for complex object and/or spatial stimuli across a number of studies. Although exploratory analyses revealed some significant differences in comparison with neurologically healthy controls (more specifically in the patient with a larger MTL lesion), there were no obvious findings involving posterior occipital or posterior temporal regions, which can account entirely for their discrimination deficits. These findings converge with previous work to support the suggestion that the MTL does not subserve long-term declarative memory exclusively.

Visual discrimination performance, memory, and medial temporal lobe function

We evaluated recent proposals that structures in the medial temporal lobe (MTL)--in particular, perirhinal cortex--support not just memory but certain kinds of perceptual abilities as well. Specifically, it has been suggested that the perirhinal cortex supports the perceptual abilities needed to accomplish visual discrimination performance when the stimuli have complex features and overlapping elements. However, the tasks that have been studied are quite challenging. Stimulus features must be held in working memory while attention shifts among the several parts of the display. When working memory capacity is exceeded, performance must depend on retrieval from long-term memory. Five patients with limited hippocampal lesions and one patient with large MTL lesions were asked to identify the unique object among twin pairs of objects that had a high degree of feature overlap and perceptual similarity. The patient groups performed similarly to controls when there were few objects and features in the displays, but exhibited abrupt declines in performance when the displays contained more objects and more features. Notably, the impairment was observed in memory-impaired patients with hippocampal lesions, not only in association with large MTL lesions that included perirhinal cortex. The pattern of performance suggested that patients encountered difficulty because working memory capacity was exceeded in the more difficult conditions such that performance needed to depend at least in part on long-term memory. Furthermore, when the burden on working memory was removed entirely, the patient with large MTL lesions performed as well as controls. Accordingly, we suggest that deficits on difficult discrimination tasks reported for patients with MTL lesions are due to impaired memory rather than impaired perception.

The hippocampus and visual perception

In this review, we will discuss the idea that the hippocampus may be involved in both memory and perception, contrary to theories that posit functional and neuroanatomical segregation of these processes. This suggestion is based on a number of recent neuropsychological and functional neuroimaging studies that have demonstrated that the hippocampus is involved in the visual discrimination of complex spatial scene stimuli. We argue that these findings cannot be explained by long-term memory or working memory processing or, in the case of patient findings, dysfunction beyond the medial temporal lobe (MTL). Instead, these studies point toward a role for the hippocampus in higher-order spatial perception. We suggest that the hippocampus processes complex conjunctions of spatial features, and that it may be more appropriate to consider the representations for which this structure is critical, rather than the cognitive processes that it mediates.

Memory formation, consolidation and transformation

Memory formation is a highly dynamic process. In this review we discuss traditional views of memory and offer some ideas about the nature of memory formation and transformation. We argue that memory traces are transformed over time in a number of ways, but that understanding these transformations requires careful analysis of the various representations and linkages that result from an experience. These transformations can involve: (1) the selective strengthening of only some, but not all, traces as a function of synaptic rescaling, or some other process that can result in selective survival of some traces; (2) the integration (or assimilation) of new information into existing knowledge stores; (3) the establishment of new linkages within existing knowledge stores; and (4) the up-dating of an existing episodic memory. We relate these ideas to our own work on reconsolidation to provide some grounding to our speculations that we hope will spark some new thinking in an area that is in need of transformation.