Neural adaptation across viewpoint and exemplar in fusiform cortex

Neural representations of perspectival shapes and attentional effects: Evidence from fMRI and MEG

Does the human brain represent perspectival shapes, i.e., viewpoint-dependent object shapes, especially in relatively higher-level visual areas such as the lateral occipital cortex? What is the temporal profile of the appearance and disappearance of neural representations of perspectival shapes? And how does attention influence these neural representations? To answer these questions, we employed functional magnetic resonance imaging (fMRI), magnetoencephalography (MEG), and multivariate decoding techniques to investigate spatiotemporal neural representations of perspectival shapes. Participants viewed rotated objects along with the corresponding objective shapes and perspectival shapes (i.e., rotated round, round, and oval) while we measured their brain activities. Our results revealed that shape classifiers trained on the basic shapes (i.e., round and oval) consistently identified neural representations in the lateral occipital cortex corresponding to the perspectival shapes of the viewed objects regardless of attentional manipulations. Additionally, this classification tendency toward the perspectival shapes emerged approximately 200 ms after stimulus presentation. Moreover, attention influenced the spatial dimension as the regions showing the perspectival shape classification tendency propagated from the occipital lobe to the temporal lobe. As for the temporal dimension, attention led to a more robust and enduring classification tendency towards perspectival shapes. In summary, our study outlines a spatiotemporal neural profile for perspectival shapes that suggests a greater degree of perspectival representation than is often acknowledged.

Event-related potential evidence for tactile orientation processing in the human brain

It is well known that information on stimulus orientation plays an important role in sensory processing. However, the neural mechanisms underlying somatosensory orientation perception are poorly understood. Adaptation has been widely used as a tool for examining sensitivity to specific features of sensory stimuli. Using the adaptation paradigm, we measured event-related potentials (ERPs) in response to tactile orientation stimuli presented pseudo-randomly to the right-hand palm in trials with all the same or different orientations. Twenty participants were asked to count the tactile orientation stimuli. The results showed that the adaptation-related N60 component was observed around contralateral central-parietal areas, possibly indicating orientation processing in the somatosensory regions. Conversely, the adaptation-related N120 component was identified bilaterally across hemispheres, suggesting the involvement of the frontoparietal circuitry in further tactile orientation processing. P300 component was found across the whole brain in all conditions and was associated with task demands, such as attention and stimulus counting. These findings help provide an understanding of the mechanisms of tactile orientation processing in the human brain.

Symmetric in the striate but asymmetric in the extrastriate cortex when processing three-quarter faces: Neural underpinnings for aesthetic appreciations

Faces and their aesthetic appreciation are a core element of social interaction. Although studies have been made on facial processing when looking at faces with different perspectives, a direct comparison of faces in the left to the right perspective is missing. Portraits in classical Western art indicate a preference of the left compared to the right perspective, but the neural underpinnings of such an asymmetry still have to be clarified. Using functional magnetic resonance imaging, the current study focuses on the processing of three-quarter faces seen with different perspectives. Seventeen participants were asked to passively look at photographs of six male and six female faces with a neutral expression; the photographs were taken from the left, right, and frontal perspectives while keeping their focus on the eyes. The results showed that specific brain areas were involved in processing the three-quarter faces in either symmetric or asymmetric ways. Viewing left and right three-quarter faces resulted in two mirror-like activations in the striate cortex corresponding to the symmetric layout of the left and right perspectives. Viewing the left face resulted additionally in an enhanced activation also in the left extrastriate cortex. The right perspective of male faces elicited a lower activation compared to other perspectives in face-selective areas of the brain. Our findings suggest that the preference of the left three-quarter face emerges already in the early visual pathway presumably prior to facial identification, emotional processing, and aesthetic appreciation. Our observations may have general importance in disentangling different neural components and processing stages in the spatiotemporal characteristics of artistic expressions.

Dissecting the default mode network: direct structural evidence on the morphology and axonal connectivity of the fifth component of the cingulum bundle

OBJECTIVE

Although a growing body of data support the functional connectivity between the precuneus and the medial temporal lobe during states of resting consciousness as well as during a diverse array of higher-order functions, direct structural evidence on this subcortical circuitry is scarce. Here, the authors investigate the very existence, anatomical consistency, morphology, and spatial relationships of the cingulum bundle V (CB-V), a fiber tract that has been reported to reside close to the inferior arm of the cingulum (CingI).

METHODS

Fifteen normal, formalin-fixed cerebral hemispheres from adults were treated with Klingler's method and subsequently investigated through the fiber microdissection technique in a medial to lateral direction.

RESULTS

A distinct group of fibers is invariably identified in the subcortical territory of the posteromedial cortex, connecting the precuneus and the medial temporal lobe. This tract follows the trajectory of the parietooccipital sulcus in a close spatial relationship with the CingI and the sledge runner fasciculus. It extends inferiorly to the parahippocampal place area and retrosplenial complex area, followed by a lateral curve to terminate toward the fusiform face area (Brodmann area [BA] 37) and lateral piriform area (BA35). Taking into account the aforementioned subcortical architecture, the CB-V allegedly participates as a major subcortical stream within the default mode network, possibly subserving the transfer of multimodal cues relevant to visuospatial, facial, and mnemonic information to the precuneal hub. Although robust clinical evidence on the functional role of this stream is lacking, the modern neurosurgeon should be aware of this tract when manipulating cerebral areas en route to lesions residing in or around the ventricular trigone.

CONCLUSIONS

Through the fiber microdissection technique, the authors were able to provide original, direct structural evidence on the existence, morphology, axonal connectivity, and correlative anatomy of what proved to be a discrete white matter pathway, previously described as the CB-V, connecting the precuneus and medial temporal lobe.

Emotional learning promotes perceptual predictions by remodeling stimulus representation in visual cortex

Emotions exert powerful effects on perception and memory, notably by modulating activity in sensory cortices so as to capture attention. Here, we examine whether emotional significance acquired by a visual stimulus can also change its cortical representation by linking neuronal populations coding for different memorized versions of the same stimulus, a mechanism that would facilitate recognition across different appearances. Using fMRI, we show that after pairing a given face with threat through conditioning, viewing this face activates the representation of another viewpoint of the same person, which itself was never conditioned, leading to robust repetition-priming across viewpoints in the ventral visual stream (including medial fusiform, lateral occipital, and anterior temporal cortex). We also observed a functional-anatomical segregation for coding view-invariant and view-specific identity information. These results indicate emotional signals may induce plasticity of stimulus representations in visual cortex, serving to generate new sensory predictions about different appearances of threat-associated stimuli.

Evidence for intact stimulus-specific neural adaptation for visual objects in schizophrenia and bipolar disorder: An ERP study

People with schizophrenia (SZ) or bipolar disorder (BD) experience dysfunction in visual processing. Dysfunctional neural tuning, in which neurons and neuronal populations are selectively activated by specific features of visual stimuli, may contribute to these deficits. Few studies have examined this possibility and there are inconsistent findings of tuning deficits in the literature. We utilized an event-related potential (ERP) paradigm to examine neural adaptation for visual objects, a measure of neural tuning whereby neurons respond less strongly to the repeated presentation of the same stimulus. Seventy-seven SZ, 53 BD, and 49 healthy comparison participants (HC) were examined. In three separate conditions, pictures of objects were presented repeatedly: the same object (SS), different objects from the same category (e.g., two different vases; SD), or different objects from different categories (e.g., a barrel and a clock, DD). Mass-univariate cluster-based permutation analyses identified electrodes and time-windows in which there were significant differences between the SS vs. DD and the SD vs. DD conditions. Mean ERP amplitudes were extracted from these clusters and analyzed for group differences. Results revealed a significant condition difference over parieto-occipital electrodes for the SS-DD comparison between 109–164 ms and for the SD-DD comparison between 78–203 ms, with larger amplitudes in the DD compared to either SS or SD condition. However, there were no significant differences in the pattern of results between groups. Thus, while we found neural adaptation effects using this ERP paradigm, we did not find evidence of group differences. Our results suggest that people with SZ or BD may not exhibit deficits in neural tuning for processing of visual objects using this EEG task with rapidly presented stimuli. However, the results are inconsistent with other studies using different methodologies (e.g., fMRI, behavioral tasks) that have found tuning deficits in people with schizophrenia.

fMRI evidence of aberrant neural adaptation for objects in schizophrenia and bipolar disorder

Functional magnetic resonance imaging (fMRI) adaptation (also known as fMRI repetition suppression) has been widely used to characterize stimulus selectivity in vivo, a fundamental feature of neuronal processing in the brain. We investigated whether SZ patients and BD patients show aberrant fMRI adaptation for object perception. About 52 SZ patients, 55 BD patients, and 53 community controls completed an object discrimination task with three conditions: the same object presented twice, two exemplars from the same category, and two exemplars from different categories. We also administered two functional localizer tasks. A region of interest analysis was employed to evaluate a priori hypotheses about the lateral occipital complex (LOC) and early visual cortex (EVC). An exploratory whole brain analysis was also conducted. In the LOC and EVC, controls showed the expected reduced fMRI responses to repeated presentation of the same objects compared with different objects (i.e., fMRI adaptation for objects, p < .001). SZ patients showed an adaptation effect that was significantly smaller compared with controls. BD patients showed a lack of fMRI adaptation. The whole brain analyses showed enhanced fMRI responses to repeated presentation of the same objects only in BD patients in several brain regions including anterior cingulate cortex. This study was the first to employ fMRI adaptation for objects in SZ and BD. The current findings provide empirical evidence of aberrant fMRI adaptation in the visual cortex in SZ and BD, but in distinctly different ways.

Conflicting demands of abstract and specific visual object processing resolved by frontoparietal networks

Object categorization and exemplar identification place conflicting demands on the visual system, yet humans easily perform these fundamentally contradictory tasks. Previous studies suggest the existence of dissociable visual processing subsystems to accomplish the two abilities-an abstract category (AC) subsystem that operates effectively in the left hemisphere and a specific exemplar (SE) subsystem that operates effectively in the right hemisphere. This multiple subsystems theory explains a range of visual abilities, but previous studies have not explored what mechanisms exist for coordinating the function of multiple subsystems and/or resolving the conflicts that would arise between them. We collected functional MRI data while participants performed two variants of a cue-probe working memory task that required AC or SE processing. During the maintenance phase of the task, the bilateral intraparietal sulcus (IPS) exhibited hemispheric asymmetries in functional connectivity consistent with exerting proactive control over the two visual subsystems: greater connectivity to the left hemisphere during the AC task, and greater connectivity to the right hemisphere during the SE task. Moreover, probe-evoked activation revealed activity in a broad frontoparietal network (containing IPS) associated with reactive control when the two visual subsystems were in conflict, and variations in this conflict signal across trials was related to the visual similarity of the cue-probe stimulus pairs. Although many studies have confirmed the existence of multiple visual processing subsystems, this study is the first to identify the mechanisms responsible for coordinating their operations.

Altered Dynamics of the fMRI Response to Faces in Individuals with Autism

Abnormal fMRI habituation in autism spectrum disorders (ASDs) has been proposed as a critical component in social impairment. This study investigated habituation to fearful faces and houses in ASD and whether fMRI measures of brain activity discriminate between ASD and typically developing (TD) controls. Two identical fMRI runs presenting masked fearful faces, houses, and scrambled images were collected. We found significantly slower fMRI responses to fearful faces but not houses in ASD. In addition, the pattern of slow to emerge amygdala activation to faces had robust discriminability [ASD vs. TD; area under the curve (AUC) = .852, p < .001]. In contrast, habituation to houses had no predictive value (AUC = .573, p = .365). Amygdala habituation to emotional faces may be useful for quantifying risk in ASD.

Human visual cortical responses to specular and matte motion flows

Determining the compositional properties of surfaces in the environment is an important visual capacity. One such property is specular reflectance, which encompasses the range from matte to shiny surfaces. Visual estimation of specular reflectance can be informed by characteristic motion profiles; a surface with a specular reflectance that is difficult to determine while static can be confidently disambiguated when set in motion. Here, we used fMRI to trace the sensitivity of human visual cortex to such motion cues, both with and without photometric cues to specular reflectance. Participants viewed rotating blob-like objects that were rendered as images (photometric) or dots (kinematic) with either matte-consistent or shiny-consistent specular reflectance profiles. We were unable to identify any areas in low and mid-level human visual cortex that responded preferentially to surface specular reflectance from motion. However, univariate and multivariate analyses identified several visual areas; V1, V2, V3, V3A/B, and hMT+, capable of differentiating shiny from matte surface flows. These results indicate that the machinery for extracting kinematic cues is present in human visual cortex, but the areas involved in integrating such information with the photometric cues necessary for surface specular reflectance remain unclear.

The resilience of object predictions: early recognition across viewpoints and exemplars

Recognition of everyday objects can be facilitated by top-down predictions. We have proposed that these predictions are derived from rudimentary image information, or gist, extracted rapidly from the low spatial frequencies (LSFs) (Bar Journal of Cognitive Neuroscience 15: 600–609, 2003). Because of the coarse nature of LSF representations, we hypothesized here that such predictions can accommodate changes in viewpoint as well as facilitate the recognition of visually similar objects. In a repetition-priming task, we indeed observed significant facilitation of target recognition that was primed by LSF objects across moderate viewpoint changes, as well as across visually similar exemplars. These results suggest that the LSF representations are specific enough to activate accurate predictions, yet flexible enough to overcome small changes in visual appearance. Such gist representations facilitate object recognition by accommodating changes in visual appearance due to viewing conditions, and help generalize from familiar to novel exemplars.

Separability of abstract-category and specific-exemplar visual object subsystems: evidence from fMRI pattern analysis

Previous research indicates that dissociable neural subsystems underlie abstract-category (AC) recognition and priming of objects (e.g., cat, piano) and specific-exemplar (SE) recognition and priming of objects (e.g., a calico cat, a different calico cat, a grand piano, etc.). However, the degree of separability between these subsystems is not known, despite the importance of this issue for assessing relevant theories. Visual object representations are widely distributed in visual cortex, thus a multivariate pattern analysis (MVPA) approach to analyzing functional magnetic resonance imaging (fMRI) data may be critical for assessing the separability of different kinds of visual object processing. Here we examined the neural representations of visual object categories and visual object exemplars using multi-voxel pattern analyses of brain activity elicited in visual object processing areas during a repetition-priming task. In the encoding phase, participants viewed visual objects and the printed names of other objects. In the subsequent test phase, participants identified objects that were either same-exemplar primed, different-exemplar primed, word-primed, or unprimed. In visual object processing areas, classifiers were trained to distinguish same-exemplar primed objects from word-primed objects. Then, the abilities of these classifiers to discriminate different-exemplar primed objects and word-primed objects (reflecting AC priming) and to discriminate same-exemplar primed objects and different-exemplar primed objects (reflecting SE priming) was assessed. Results indicated that (a) repetition priming in occipital-temporal regions is organized asymmetrically, such that AC priming is more prevalent in the left hemisphere and SE priming is more prevalent in the right hemisphere, and (b) AC and SE subsystems are weakly modular, not strongly modular or unified.

Visuo-haptic multisensory object recognition, categorization, and representation

Visual and haptic unisensory object processing show many similarities in terms of categorization, recognition, and representation. In this review, we discuss how these similarities contribute to multisensory object processing. In particular, we show that similar unisensory visual and haptic representations lead to a shared multisensory representation underlying both cross-modal object recognition and view-independence. This shared representation suggests a common neural substrate and we review several candidate brain regions, previously thought to be specialized for aspects of visual processing, that are now known also to be involved in analogous haptic tasks. Finally, we lay out the evidence for a model of multisensory object recognition in which top-down and bottom-up pathways to the object-selective lateral occipital complex are modulated by object familiarity and individual differences in object and spatial imagery.

Functional subdomains within human FFA

The fusiform face area (FFA) is a well-studied human brain region that shows strong activation for faces. In functional MRI studies, FFA is often assumed to be a homogeneous collection of voxels with similar visual tuning. To test this assumption, we used natural movies and a quantitative voxelwise modeling and decoding framework to estimate category tuning profiles for individual voxels within FFA. We find that the responses in most FFA voxels are strongly enhanced by faces, as reported in previous studies. However, we also find that responses of individual voxels are selectively enhanced or suppressed by a wide variety of other categories and that these broader tuning profiles differ across FFA voxels. Cluster analysis of category tuning profiles across voxels reveals three spatially segregated functional subdomains within FFA. These subdomains differ primarily in their responses for nonface categories, such as animals, vehicles, and communication verbs. Furthermore, this segregation does not depend on the statistical threshold used to define FFA from responses to functional localizers. These results suggest that voxels within FFA represent more diverse information about object and action categories than generally assumed.

Fusing concurrent EEG-fMRI with dynamic causal modeling: application to effective connectivity during face perception

Despite the wealth of research on face perception, the interactions between core regions in the face-sensitive network of the visual cortex are not well understood. In particular, the link between neural activity in face-sensitive brain regions measured by fMRI and EEG markers of face-selective processing in the N170 component is not well established. In this study, we used dynamic causal modeling (DCM) as a data fusion approach to integrate concurrently acquired EEG and fMRI data during the perception of upright compared with inverted faces. Data features derived from single-trial EEG variability were used as contextual modulators on fMRI-derived estimates of effective connectivity between key regions of the face perception network. The overall construction of our model space was highly constrained by the effects of task and ERP parameters on our fMRI data. Bayesian model selection suggested that the occipital face area (OFA) acted as a central gatekeeper directing visual information to the superior temporal sulcus (STS), the fusiform face area (FFA), and to a medial region of the fusiform gyrus (mFG). The connection from the OFA to the STS was strengthened on trials in which N170 amplitudes to upright faces were large. In contrast, the connection from the OFA to the mFG, an area known to be involved in object processing, was enhanced for inverted faces particularly on trials in which N170 amplitudes were small. Our results suggest that trial-by-trial variation in neural activity at around 170 ms, reflected in the N170 component, reflects the relative engagement of the OFA to STS/FFA network over the OFA to mFG object processing network for face perception. Importantly, the DCMs predicted the observed data significantly better by including the modulators derived from the N170, highlighting the value of incorporating EEG-derived information to explain interactions between regions as a multi-modal data fusion method for combined EEG-fMRI.