The role of surface information in object recognition: studies of a visual form agnosic and normal subjects

The effects of color and saturation on the enjoyment of real-life images

This study investigated the effects of color presence and saturation on the affective judgment of real-life images, as functions of the image's affective valence. In the first two experiments, participants observed and rated original color photos and their grayscale versions, presented in an interleaved order across two separate experimental sessions. Color photos were rated as more pleasant than grayscale photos when image valence was positive, and more unpleasant when image valence was negative. The third experiment consisted of the same original images and their versions with saturation reduced by 50%. Original photos were rated as more pleasant than saturation-reduced photos when image valence was positive, yet less unpleasant when image valence was negative, implying potentially separable mechanisms for processing color presence and saturation. Significant interactions were found between color or saturation mode and valence on affective judgment in all three experiments. The effects persisted after controlling for colorfulness and luminance between the color and grayscale (or de-saturated) conditions.

Temporal features of size constancy for perception and action in a real-world setting: A combined EEG-kinematics study

A stable representation of object size, in spite of continuous variations in retinal input due to changes in viewing distance, is critical for perceiving and acting in a real 3D world. In fact, our perceptual and visuo-motor systems exhibit size and grip constancies in order to compensate for the natural shrinkage of the retinal image with increased distance. The neural basis of this size-distance scaling remains largely unknown, although multiple lines of evidence suggest that size-constancy operations might take place remarkably early, already at the level of the primary visual cortex. In this study, we examined for the first time the temporal dynamics of size constancy during perception and action by using a combined measurement of event-related potentials (ERPs) and kinematics. Participants were asked to maintain their gaze steadily on a fixation point and perform either a manual estimation or a grasping task towards disks of different sizes placed at different distances. Importantly, the physical size of the target was scaled with distance to yield a constant retinal angle. Meanwhile, we recorded EEG data from 64 scalp electrodes and hand movements with a motion capture system. We focused on the first positive-going visual evoked component peaking at approximately 90 ms after stimulus onset. We found earlier latencies and greater amplitudes in response to bigger than smaller disks of matched retinal size, regardless of the task. In line with the ERP results, manual estimates and peak grip apertures were larger for the bigger targets. We also found task-related differences at later stages of processing from a cluster of central electrodes, whereby the mean amplitude of the P2 component was greater for manual estimation than grasping. Taken together, these findings provide novel evidence that size constancy for real objects at real distances occurs at the earliest cortical stages and that early visual processing does not change as a function of task demands.

Argentinean Psycholinguistic Picture Naming Test in color

Color has demonstrated to have an influence on picture naming tasks. Objects with high color diagnosticity are recalled faster than objects with low value. That is why the Argentinean Psycholinguistic Picture Naming Test in color (PAPDIC in Spanish) was designed. The items and semantic cues were built considering local psycholinguistic norms. A series of psychometric analyses were performed on a sample of patients with focal brain damage with (n = 11) and without (n = 14) aphasia, a sample of patients with degenerative disease (n = 46) and two samples of healthy participants (young n = 27, old n = 50). Evidence of convergent validity was obtained through the correlation with the brief Boston Naming Test (r = 0.871; p < .001); of criteria validity by means of contrasted groups analysis (t = 4.059, p < .001), and through the ROC curve analysis (AUC = 0.993). Scores' reliability was explored by means of an internal consistency analysis (KR20 = 0.905). These results indicate that the PAPDIC is a promising color naming test which can be applied in the field of clinical neuropsychology to identify anomia. This test has several advantages in comparison with the available naming tests in Argentina.

Shared cognitive mechanisms involved in the processing of scene texture and scene shape

Recent research has demonstrated that the parahippocampal place area represents both the shape and texture features of scenes, with the importance of each feature varying according to perceived scene category. Namely, shape features are predominately more diagnostic to the processing of artificial human–made scenes, while shape and texture are equally diagnostic in natural scene processing. However, to date little is known regarding the degree of interactivity or independence observed in the processing of these scene features. Furthermore, manipulating the scope of visual attention (i.e., globally vs. locally) when processing ensembles of multiple objects—stimuli that share a functional neuroanatomical link with scenes—has been shown to affect their cognitive visual representation. It remains unknown whether manipulating the scope of attention impacts scene processing in a similar manner. Using the well-established Garner speeded-classification behavioral paradigm, we investigated the influence of both feature diagnosticity and the scope of visual attention on potential interactivity or independence in the shape and texture processing of artificial human–made scenes. The results revealed asymmetric interference between scene shape and texture processing, with the more diagnostic feature (i.e., shape) interfering with the less diagnostic feature (i.e., texture), but not vice versa. Furthermore, this interference was attenuated and enhanced with more local and global visual processing strategies, respectively. These findings suggest that the scene shape and texture processing are mediated by shared cognitive mechanisms and that, although these representations are governed primarily via feature diagnosticity, they can nevertheless be influenced by the scope of visual attention.

The Treachery of Images: How Realism Influences Brain and Behavior

Although the cognitive sciences aim to ultimately understand behavior and brain function in the real world, for historical and practical reasons, the field has relied heavily on artificial stimuli, typically pictures. We review a growing body of evidence that both behavior and brain function differ between image proxies and real, tangible objects. We also propose a new framework for immersive neuroscience to combine two approaches: (i) the traditional build-up approach of gradually combining simplified stimuli, tasks, and processes; and (ii) a newer tear-down approach that begins with reality and compelling simulations such as virtual reality to determine which elements critically affect behavior and brain processing.

Vision: A Product of a Society of Independent Experts

A lesion of primary visual cortex, V1, can result in the perceived size of objects varying with the size of their retinal image. A new study shows that the pregrasp span of the hand of an individual with such a lesion remains tuned to the object's true size, providing evidence for separate representations mediating perceptual appearance and motor interactions.

Object responses are highly malleable, rather than invariant, with changes in object appearance

Theoretical frameworks of human vision argue that object responses remain stable, or 'invariant', despite changes in viewing conditions that can alter object appearance but not identity. Here, in a major departure from previous approaches that have relied on two-dimensional (2-D) images to study object processing, we demonstrate that changes in an object's appearance, but not its identity, can lead to striking shifts in behavioral responses to objects. We used inverse multidimensional scaling (MDS) to measure the extent to which arrangements of objects in a sorting task were similar or different when the stimuli were displayed as scaled 2-D images, three-dimensional (3-D) augmented reality (AR) projections, or real-world solids. We were especially interested in whether sorting behavior in each display format was based on conceptual (e.g., typical location) versus physical object characteristics. We found that 2-D images of objects were arranged according to conceptual (typical location), but not physical, properties. AR projections, conversely, were arranged primarily according to physical properties such as real-world size, elongation and weight, but not conceptual properties. Real-world solid objects, unlike both 2-D and 3-D images, were arranged using multidimensional criteria that incorporated both conceptual and physical object characteristics. Our results suggest that object responses can be strikingly malleable, rather than invariant, with changes in the visual characteristics of the stimulus. The findings raise important questions about limits of invariance in object processing, and underscore the importance of studying responses to richer stimuli that more closely resemble those we encounter in real-world environments.

Methods for Presenting Real-world Objects Under Controlled Laboratory Conditions

Our knowledge of human object vision is based almost exclusively on studies in which the stimuli are presented in the form of computerized two-dimensional (2-D) images. In everyday life, however, humans interact predominantly with real-world solid objects, not images. Currently, we know very little about whether images of objects trigger similar behavioral or neural processes as do real-world exemplars. Here, we present methods for bringing the real-world into the laboratory. We detail methods for presenting rich, ecologically-valid real-world stimuli under tightly-controlled viewing conditions. We describe how to match closely the visual appearance of real objects and their images, as well as novel apparatus and protocols that can be used to present real objects and computerized images on successively interleaved trials. We use a decision-making paradigm as a case example in which we compare willingness-to-pay (WTP) for real snack foods versus 2-D images of the same items. We show that WTP increases by 6.6% for food items displayed as real objects versus high-resolution 2-D colored images of the same foods -suggesting that real foods are perceived as being more valuable than their images. Although presenting real object stimuli under controlled conditions presents several practical challenges for the experimenter, this approach will fundamentally expand our understanding of the cognitive and neural processes that underlie naturalistic vision.

An examination of differential repetition priming effects for natural and man-made objects

It has been theorized that differential cognitive resources may be involved in the processing of information pertaining to natural and man-made categories, commonly referred to as category specificity. The present study used four experiments to assess whether a natural priming advantage exists and, if so, whether color, texture, color diagnosticity, object complexity, and familiarity could account for the categorical difference. To do so, a repetition priming paradigm was used in which masked primes were briefly presented, and targets were categorized as natural or man-made. Across four experiments, a greater degree of priming was observed for natural as opposed to man-made stimuli. Examination of stimulus characteristics that could account for the differences revealed that the natural priming advantage was in part driven by color diagnosticity and familiarity. Results of this study support the notion that different cognitive resources represent and/or are involved in the processing of natural and man-made categories.

Real-world size coding of solid objects, but not 2-D or 3-D images, in visual agnosia patients with bilateral ventral lesions

Patients with visual agnosia show severe deficits in recognizing two-dimensional (2-D) images of objects, despite the fact that early visual processes such as figure-ground segmentation, and stereopsis, are largely intact. Strikingly, however, these patients can nevertheless show a preservation in their ability to recognize real-world objects -a phenomenon known as the 'real-object advantage' (ROA) in agnosia. To uncover the mechanisms that support the ROA, patients were asked to identify objects whose size was congruent or incongruent with typical real-world size, presented in different display formats (real objects, 2-D and 3-D images). While recognition of images was extremely poor, real object recognition was surprisingly preserved, but only when physical size matched real-world size. Analogous display format and size manipulations did not influence the recognition of common geometric shapes that lacked real-world size associations. These neuropsychological data provide evidence for a surprising preservation of size-coding of real-world-sized tangible objects in patients for whom ventral contributions to image processing are severely disrupted. We propose that object size information is largely mediated by dorsal visual cortex and that this information, together with detailed representation of object shape which is also subserved by dorsal cortex, serve as the basis of the ROA.

Distinct visuo-motor brain dynamics for real-world objects versus planar images

Ultimately, we aim to generalize and translate scientific knowledge to the real world, yet current understanding of human visual perception is based predominantly on studies of two-dimensional (2-D) images. Recent cognitive-behavioral evidence shows that real objects are processed differently to images, although the neural processes that underlie these differences are unknown. Because real objects (unlike images) afford actions, they may trigger stronger or more prolonged activation in neural populations for visuo-motor action planning. Here, we recorded electroencephalography (EEG) when human observers viewed real-world three-dimensional (3-D) objects or closely matched 2-D images of the same items. Although responses to real objects and images were similar overall, there were critical differences. Compared to images, viewing real objects triggered stronger and more sustained event-related desynchronization (ERD) in the μ frequency band (8-13 Hz) - a neural signature of automatic motor preparation. Event-related potentials (ERPs) revealed a transient, early occipital negativity for real objects (versus images), likely reflecting 3-D stereoscopic differences, and a late sustained parietal amplitude modulation consistent with an 'old-new' memory advantage for real objects over images. Together, these findings demonstrate that real-world objects trigger stronger and more sustained action-related brain responses than images do. The results highlight important similarities and differences between brain responses to images and richer, more ecologically relevant, real-world objects.

Processing of chromatic information in a deep convolutional neural network

Deep convolutional neural networks are a class of machine-learning algorithms capable of solving non-trivial tasks, such as object recognition, with human-like performance. Little is known about the exact computations that deep neural networks learn, and to what extent these computations are similar to the ones performed by the primate brain. Here, we investigate how color information is processed in the different layers of the AlexNet deep neural network, originally trained on object classification of over 1.2M images of objects in their natural contexts. We found that the color-responsive units in the first layer of AlexNet learned linear features and were broadly tuned to two directions in color space, analogously to what is known of color responsive cells in the primate thalamus. Moreover, these directions are decorrelated and lead to statistically efficient representations, similar to the cardinal directions of the second-stage color mechanisms in primates. We also found, in analogy to the early stages of the primate visual system, that chromatic and achromatic information were segregated in the early layers of the network. Units in the higher layers of AlexNet exhibit on average a lower responsivity for color than units at earlier stages.

Graspable Objects Grab Attention More Than Images Do

The opportunity an object presents for action is known as an affordance. A basic assumption in previous research was that images of objects, which do not afford physical action, elicit effects on attention and behavior comparable with those of real-world tangible objects. Using a flanker task, we compared interference effects between real graspable objects and matched 2-D or 3-D images of the items. Compared with both 2-D and 3-D images, real objects yielded slower response times overall and elicited greater flanker interference effects. When the real objects were positioned out of reach or behind a transparent barrier, the pattern of response times and interference effects was comparable with that for 2-D images. Graspable objects exert a more powerful influence on attention and manual responses than images because of the affordances they offer for manual interaction. These results raise questions about whether images are suitable proxies for real objects in psychological research.

The real deal: Willingness-to-pay and satiety expectations are greater for real foods versus their images

Laboratory studies of human dietary choice have relied on computerized two-dimensional (2D) images as stimuli, whereas in everyday life, consumers make decisions in the context of real foods that have actual caloric content and afford grasping and consumption. Surprisingly, few studies have compared whether real foods are valued more than 2D images of foods, and in the studies that have, differences in the stimuli and testing conditions could have resulted in inflated bids for the real foods. Moreover, although the caloric content of food images has been shown to influence valuation, no studies to date have investigated whether 'real food exposure effects' on valuation reflect greater sensitivity to the caloric content of real foods versus images. Here, we compared willingness-to-pay (WTP) for, and expectations about satiety after consuming, everyday snack foods that were displayed as real foods versus 2D images. Critically, our 2D images were matched closely to the real foods for size, background, illumination, and apparent distance, and trial presentation and stimulus timing were identical across conditions. We used linear mixed effects modeling to determine whether effects of display format were modulated by food preference and the caloric content of the foods. Compared to food images, observers were willing to pay 6.62% more for (Experiment 1) and believed that they would feel more satiated after consuming (Experiment 2), foods displayed as real objects. Moreover, these effects appeared to be consistent across food preference, caloric content, as well as observers' estimates of the caloric content of the foods. Together, our results confirm that consumers' perception and valuation of everyday foods is influenced by the format in which they are displayed. Our findings raise important new insights into the factors that shape dietary choice in real-world contexts and highlight potential avenues for improving public health approaches to diet and obesity.

Attentional capture for tool images is driven by the head end of the tool, not the handle

Tools afford specialized actions that are tied closely to object identity. Although there is mounting evidence that functional objects, such as tools, capture visuospatial attention relative to non-tool competitors, this leaves open the question of which part of a tool drives attentional capture. We used a modified version of the Posner cueing task to determine whether attention is oriented towards the head versus the handle of realistic images of common elongated tools. We compared cueing effects for tools with control stimuli that consisted of images of fruit and vegetables of comparable elongation to the tools. Critically, our displays controlled for lower-level influences on attention that can arise from global shape asymmetries in the image cues. Observers were faster to detect low-contrast targets positioned near the head end versus the handle of tools. As expected, no lateralized performance bias was observed for the control stimuli. In a follow-up experiment, we confirmed that the bias towards tool heads was not due to inhibition of return as a result of early attentional orienting towards tool handles. Finally, we confirmed that real-world exemplars of the tools in the cueing studies were associated more strongly with specific grasping patterns than the elongated fruits and vegetables. Together, our results demonstrate that affordance effects on attentional capture are driven by the head end of a tool. Prioritizing the head end of a tool is adaptive because it ensures that the most relevant region of the object takes priority in selecting an effective motor plan.

Long-term memory color investigation: culture effect and experimental setting factors

Memory colors generated continuous interest in the color community. Previous studies focused on reflecting color chips and color samples in real scenes or on monitors. The cognitive effect of culture was rarely considered. In this paper, we performed a comprehensive investigation of the long-term memory colors of 26 familiar objects using the asymmetric color matching method among Chinese and German observers on a display. Three experiments were conducted to evaluate the variations introduced by culture, context-based gray image, and initial matching color. Memory colors of important objects were collected and representative memory colors were quantified in terms of CIELAB L^*, a^*, and b^* values. The intra- and inter-observer variations were analyzed by mean-color-difference-from-mean values and chromatic ellipses. The effects of different cultural groups and experimental settings were also shown.

Effects of age and type of picture on visuospatial working memory assessed with a computerized jigsaw-puzzle task

We investigated the effect of age and color in a computerized version of the jigsaw-puzzle task. In Experiment 1, young and older adults were presented with puzzles in color and black-and-white line drawings, varying in difficulty from 4 to 9 pieces. Older adults performed the task better with the black-and-white stimuli and younger adults performed better with the color ones. In Experiment 2, new older and young adults identified the same fragmented pictures as fast and accurately as possible. The older group identified the black-and-white stimuli faster than those presented in color, while the younger adults identified both similarly. In Experiment 3A, new older and young groups performed the puzzle task with the same color pictures and their monochrome versions. In Experiment 3B, participants performed a speeded identification task with the two sets. The findings of these experiments showed that older adults have a memory not a perceptual difficulty.

Integrative Cognitive Style in Middle Eastern and Western Groups

Integrative cognitive style among Middle Eastern immigrants to Canada and native-born Euro-Canadians was assessed by looking at their performance on a multidimensional classification task and an object sorting task. Results showed high levels of integrative thinking in Middle Eastern immigrants compared with Euro-Canadians. The contrasting differentiative cognitive style was avoided by the Middle Eastern group, whereas a higher level of differentiation was observed in the Euro-Canadian groups. These results are congruent with previous studies showing higher levels of integrative style in Middle Eastern groups than in Euro-Canadian groups. A secondary finding revealed higher levels of integrative thinking among Middle Easterners with comparatively low levels of Western education. In sum, findings show preferences for integrative thinking in Middle Eastern groups, and through new measures of cognitive style, qualitative aspects of integrative thinking, which have traditionally been viewed indirectly as the opposite of differentiative thinking, are revealed.

The Role of Facial Colour and Luminance in Visual and Audiovisual Speech Perception

We conducted four experiments to investigate the role of colour and luminance information in visual and audiovisual speech perception. In experiments la (stimuli presented in quiet conditions) and 1b (stimuli presented in auditory noise), face display types comprised naturalistic colour (NC), grey-scale (GS), and luminance inverted (LI) faces. In experiments 2a (quiet) and 2b (noise), face display types comprised NC, colour inverted (CI), LI, and colour and luminance inverted (CLI) faces. Six syllables and twenty-two words were used to produce auditory and visual speech stimuli. Auditory and visual signals were combined to produce congruent and incongruent audiovisual speech stimuli. Experiments 1a and 1b showed that perception of visual speech, and its influence on identifying the auditory components of congruent and incongruent audiovisual speech, was less for LI than for either NC or GS faces, which produced identical results. Experiments 2a and 2b showed that perception of visual speech, and influences on perception of incongruent auditory speech, was less for LI and CLI faces than for NC and CI faces (which produced identical patterns of performance). Our findings for NC and CI faces suggest that colour is not critical for perception of visual and audiovisual speech. The effect of luminance inversion on performance accuracy was relatively small (5%), which suggests that the luminance information preserved in LI faces is important for the processing of visual and audiovisual speech.

Color-Biased Regions of the Ventral Visual Pathway Lie between Face- and Place-Selective Regions in Humans, as in Macaques

The existence of color-processing regions in the human ventral visual pathway (VVP) has long been known from patient and imaging studies, but their location in the cortex relative to other regions, their selectivity for color compared with other properties (shape and object category), and their relationship to color-processing regions found in nonhuman primates remain unclear. We addressed these questions by scanning 13 subjects with fMRI while they viewed two versions of movie clips (colored, achromatic) of five different object classes (faces, scenes, bodies, objects, scrambled objects). We identified regions in each subject that were selective for color, faces, places, and object shape, and measured responses within these regions to the 10 conditions in independently acquired data. We report two key findings. First, the three previously reported color-biased regions (located within a band running posterior-anterior along the VVP, present in most of our subjects) were sandwiched between face-selective cortex and place-selective cortex, forming parallel bands of face, color, and place selectivity that tracked the fusiform gyrus/collateral sulcus. Second, the posterior color-biased regions showed little or no selectivity for object shape or for particular stimulus categories and showed no interaction of color preference with stimulus category, suggesting that they code color independently of shape or stimulus category; moreover, the shape-biased lateral occipital region showed no significant color bias. These observations mirror results in macaque inferior temporal cortex (Lafer-Sousa and Conway, 2013), and taken together, these results suggest a homology in which the entire tripartite face/color/place system of primates migrated onto the ventral surface in humans over the course of evolution.

SIGNIFICANCE STATEMENT

Here we report that color-biased cortex is sandwiched between face-selective and place-selective cortex on the bottom surface of the brain in humans. This face/color/place organization mirrors that seen on the lateral surface of the temporal lobe in macaques, suggesting that the entire tripartite system is homologous between species. This result validates the use of macaques as a model for human vision, making possible more powerful investigations into the connectivity, precise neural codes, and development of this part of the brain. In addition, we find substantial segregation of color from shape selectivity in posterior regions, as observed in macaques, indicating a considerable dissociation of the processing of shape and color in both species.

Distinct Visual Processing of Real Objects and Pictures of Those Objects in 7- to 9-month-old Infants

The present study examined 7- and 9-month-old infants' visual habituation to real objects and pictures of the same objects and their preferences between real and pictorial versions of the same objects following habituation. Different hypotheses would predict that infants may habituate faster to pictures than real objects (based on proposed theoretical links between behavioral habituation in infants and neuroimaging adaptation in adults) or to real objects vs. pictures (based on past infant electrophysiology data). Sixty-one 7-month-old infants and fifty-nine 9-month-old infants were habituated to either a real object or a picture of the same object and afterward preference tested with the habituation object paired with either the novel real object or its picture counterpart. Infants of both age groups showed basic information-processing advantages for real objects. Specifically, during the initial presentations, 9-month-old infants looked longer at stimuli in both formats than the 7-month olds but more importantly both age groups looked longer at real objects than pictures, though with repeated presentations, they habituated faster for real objects such that at the end of habituation, they looked equally at both types of stimuli. Surprisingly, even after habituation, infants preferred to look at the real objects, regardless of whether they had habituated to photos or real objects. Our findings suggest that from as early as 7-months of age, infants show strong preferences for real objects, perhaps because real objects are visually richer and/or enable the potential for genuine interactions.

Material properties from contours: New insights on object perception

In this work we explored phenomenologically the visual complexity of the material attributes on the basis of the contours that define the boundaries of a visual object. The starting point is the rich and pioneering work done by Gestalt psychologists and, more in detail, by Rubin, who first demonstrated that contours contain most of the information related to object perception, like the shape, the color and the depth. In fact, by investigating simple conditions like those used by Gestalt psychologists, mostly consisting of contours only, we demonstrated that the phenomenal complexity of the material attributes emerges through appropriate manipulation of the contours. A phenomenological approach, analogous to the one used by Gestalt psychologists, was used to answer the following questions. What are contours? Which attributes can be phenomenally defined by contours? Are material properties determined only by contours? What is the visual syntactic organization of object attributes? The results of this work support the idea of a visual syntactic organization as a new kind of object formation process useful to understand the language of vision that creates well-formed attribute organizations. The syntax of visual attributes can be considered as a new way to investigate the modular coding and, more generally, the binding among attributes, i.e., the issue of how the brain represents the pairing of shape and material properties.

Real-world objects are more memorable than photographs of objects

Research studies in psychology typically use two-dimensional (2D) images of objects as proxies for real-world three-dimensional (3D) stimuli. There are, however, a number of important differences between real objects and images that could influence cognition and behavior. Although human memory has been studied extensively, only a handful of studies have used real objects in the context of memory and virtually none have directly compared memory for real objects vs. their 2D counterparts. Here we examined whether or not episodic memory is influenced by the format in which objects are displayed. We conducted two experiments asking participants to freely recall, and to recognize, a set of 44 common household objects. Critically, the exemplars were displayed to observers in one of three viewing conditions: real-world objects, colored photographs, or black and white line drawings. Stimuli were closely matched across conditions for size, orientation, and illumination. Surprisingly, recall and recognition performance was significantly better for real objects compared to colored photographs or line drawings (for which memory performance was equivalent). We replicated this pattern in a second experiment comparing memory for real objects vs. color photos, when the stimuli were matched for viewing angle across conditions. Again, recall and recognition performance was significantly better for the real objects than matched color photos of the same items. Taken together, our data suggest that real objects are more memorable than pictorial stimuli. Our results highlight the importance of studying real-world object cognition and raise the potential for applied use in developing effective strategies for education, marketing, and further research on object-related cognition.

Accuracy and speed of material categorization in real-world images

It is easy to visually distinguish a ceramic knife from one made of steel, a leather jacket from one made of denim, and a plush toy from one made of plastic. Most studies of material appearance have focused on the estimation of specific material properties such as albedo or surface gloss, and as a consequence, almost nothing is known about how we recognize material categories like leather or plastic. We have studied judgments of high-level material categories with a diverse set of real-world photographs, and we have shown (Sharan, 2009) that observers can categorize materials reliably and quickly. Performance on our tasks cannot be explained by simple differences in color, surface shape, or texture. Nor can the results be explained by observers merely performing shape-based object recognition. Rather, we argue that fast and accurate material categorization is a distinct, basic ability of the visual system.

When concepts lose their color: a case of object-color knowledge impairment

Color is important in our daily interactions with objects, and plays a role in both low- and high-level visual processing. Previous neuropsychological studies have shown that color perception and object-color knowledge can doubly dissociate, and that both can dissociate from processing of object form. We present a case study of an individual who displayed an impairment for knowledge of the typical colors of objects, with preserved color perception and color naming. Our case also presented with a pattern of, if anything, worse performance for naming living items compared to non-living things. The findings of the experimental investigation are evaluated in light of two theories of conceptual organization in the brain: the Sensory/Functional Theory and the Domain-Specific Hypothesis. The dissociations observed in this case compel a model in which sensory/motor modality and semantic domain jointly constrain the organization of object knowledge.

Visual object agnosia is associated with a breakdown of object-selective responses in the lateral occipital cortex

Patients with visual object agnosia fail to recognize the identity of visually presented objects despite preserved semantic knowledge. Object agnosia may result from damage to visual cortex lying close to or overlapping with the lateral occipital complex (LOC), a brain region that exhibits selectivity to the shape of visually presented objects. Despite this anatomical overlap the relationship between shape processing in the LOC and shape representations in object agnosia is unknown. We studied a patient with object agnosia following isolated damage to the left occipito-temporal cortex overlapping with the LOC. The patient showed intact processing of object structure, yet often made identification errors that were mainly based on the global visual similarity between objects. Using functional Magnetic Resonance Imaging (fMRI) we found that the damaged as well as the contralateral, structurally intact right LOC failed to show any object-selective fMRI activity, though the latter retained selectivity for faces. Thus, unilateral damage to the left LOC led to a bilateral breakdown of neural responses to a specific stimulus class (objects and artefacts) while preserving the response to a different stimulus class (faces). These findings indicate that representations of structure necessary for the identification of objects crucially rely on bilateral, distributed coding of shape features.

How (and why) the visual control of action differs from visual perception

Vision not only provides us with detailed knowledge of the world beyond our bodies, but it also guides our actions with respect to objects and events in that world. The computations required for vision-for-perception are quite different from those required for vision-for-action. The former uses relational metrics and scene-based frames of reference while the latter uses absolute metrics and effector-based frames of reference. These competing demands on vision have shaped the organization of the visual pathways in the primate brain, particularly within the visual areas of the cerebral cortex. The ventral 'perceptual' stream, projecting from early visual areas to inferior temporal cortex, helps to construct the rich and detailed visual representations of the world that allow us to identify objects and events, attach meaning and significance to them and establish their causal relations. By contrast, the dorsal 'action' stream, projecting from early visual areas to the posterior parietal cortex, plays a critical role in the real-time control of action, transforming information about the location and disposition of goal objects into the coordinate frames of the effectors being used to perform the action. The idea of two visual systems in a single brain might seem initially counterintuitive. Our visual experience of the world is so compelling that it is hard to believe that some other quite independent visual signal-one that we are unaware of-is guiding our movements. But evidence from a broad range of studies from neuropsychology to neuroimaging has shown that the visual signals that give us our experience of objects and events in the world are not the same ones that control our actions.

The use of conceptual components in language production: an ERP study

According to frame-theory, concepts can be represented as structured frames that contain conceptual attributes (e.g., "color") and their values (e.g., "red"). A particular color value can be seen as a core conceptual component for (high color-diagnostic; HCD) objects (e.g., bananas) which are strongly associated with a typical color, but less so for (low color-diagnostic; LCD) objects (e.g., bicycles) that exist in many different colors. To investigate whether the availability of a core conceptual component (color) affects lexical access in language production, we conducted two experiments on the naming of visually presented HCD and LCD objects. Experiment 1 showed that, when naming latencies were matched for colored HCD and LCD objects, achromatic HCD objects were named more slowly than achromatic LCD objects. In Experiment 2 we recorded ERPs while participants performed a picture-naming task, in which achromatic target pictures were either preceded by an appropriately colored box (primed condition) or a black and white checkerboard (unprimed condition). We focused on the P2 component, which has been shown to reflect difficulty of lexical access in language production. Results showed that HCD resulted in slower object-naming and a more pronounced P2. Priming also yielded a more positive P2 but did not result in an RT difference. ERP waveforms on the P1, P2 and N300 components showed a priming by color-diagnosticity interaction, the effect of color priming being stronger for HCD objects than for LCD objects. The effect of color-diagnosticity on the P2 component suggests that the slower naming of achromatic HCD objects is (at least in part) due to more difficult lexical retrieval. Hence, the color attribute seems to affect lexical retrieval in HCD words. The interaction between priming and color-diagnosticity indicates that priming with a feature hinders lexical access, especially if the feature is a core feature of the target object.

Hierarchical processing in Balint's syndrome: a failure of flexible top-down attention

Patients with Balint’ s syndrome are typically impaired at perceiving multiple objects simultaneously, and at evaluating the relationship between multiple objects in a scene (simultanagnosia). These deficits may not only be observed in complex scenes, but also when local elements of individual objects must be integrated into a perceptual global whole. Thus, unlike normal observers, patients with simultanagnosia typically show a bias towards the local forms, even to the extent that they cannot identify the global stimuli. However, we have previously shown that global processing is still attainable in Balint patients in certain scenarios (e.g., when local elements are unfamiliar). This suggests that in addition to a possible perceptual deficit that favors the local elements in these patients, impaired attentional control may be at the core of their unique performance. To test this hypothesis we manipulated the perceptual saliency of the local and global elements in a compound letter task so that it included global-more-salient or local-more-salient displays. We show that a Balint patient was able to accurately identify both global and local targets as long as they were the salient aspect of the compound letter. However, substantial impairment was evident when either the global or local elements were the less salient aspect of the compound letter. We conclude that in Balint’ s syndrome there is a failure of flexible top-down attention both in biasing attention away from salient irrelevant aspects of the display (salience-based-selection) and in impaired disengagement from irrelevant but salient items once they have been selected.

Structural and functional changes across the visual cortex of a patient with visual form agnosia

Loss of shape recognition in visual-form agnosia occurs without equivalent losses in the use of vision to guide actions, providing support for the hypothesis of two visual systems (for "perception" and "action"). The human individual DF received a toxic exposure to carbon monoxide some years ago, which resulted in a persisting visual-form agnosia that has been extensively characterized at the behavioral level. We conducted a detailed high-resolution MRI study of DF's cortex, combining structural and functional measurements. We present the first accurate quantification of the changes in thickness across DF's occipital cortex, finding the most substantial loss in the lateral occipital cortex (LOC). There are reduced white matter connections between LOC and other areas. Functional measures show pockets of activity that survive within structurally damaged areas. The topographic mapping of visual areas showed that ordered retinotopic maps were evident for DF in the ventral portions of visual cortical areas V1, V2, V3, and hV4. Although V1 shows evidence of topographic order in its dorsal portion, such maps could not be found in the dorsal parts of V2 and V3. We conclude that it is not possible to understand fully the deficits in object perception in visual-form agnosia without the exploitation of both structural and functional measurements. Our results also highlight for DF the cortical routes through which visual information is able to pass to support her well-documented abilities to use visual information to guide actions.

I can see what you are doing: Action familiarity and affordance promote recovery from extinction

We assessed the effects of three factors on recovery from extinction in patients with lesions including the posterior parietal lobe: (a) whether objects were frequently used together in action versus whether they could be used in action together; (b) whether there was an effect of positioning objects for action; and (c) whether the surface properties of objects mediated performance. There was greater recovery from extinction for objects used frequently together, along with effects produced by objects that could be used together. There were also positive effects of correctly positioning objects for action. There were no effects of surface information on the benefit of reporting both members of a pair, though there were some effects on error trials. The results provide positive evidence for an effect on attention of affordances based on objects falling in plausible co-locations for action. Such affordances may also be influenced by the frequency with which objects are used together and can be generated from edge-based representations of objects (surface colour and depth are not necessary). However, surface-based representations may influence the speed with which action-related properties of objects engage attention.

Object ensemble processing in human anterior-medial ventral visual cortex

Our visual system can extract summary statistics from large collections of similar objects without forming detailed representations of the individual objects in the ensemble. Such object ensemble representation is adaptive and allows us to overcome the capacity limitation associated with representing specific objects. Surprisingly, little is known about the neural mechanisms supporting such object ensemble representation. Here we showed human observers identical photographs of the same object ensemble, different photographs depicting the same ensemble, or different photographs depicting different ensembles. We observed fMRI adaptation in anterior-medial ventral visual cortex whenever object ensemble statistics repeated, even when local image features differed across photographs. Interestingly, such object ensemble processing is closely related to texture and scene processing in the brain. In contrast, the lateral occipital area, a region involved in object-shape processing, showed adaptation only when identical photographs were repeated. These results provide the first step toward understanding the neural underpinnings of real-world object ensemble representation.

Haptic object perception: spatial dimensionality and relation to vision

Enabled by the remarkable dexterity of the human hand, specialized haptic exploration is a hallmark of object perception by touch. Haptic exploration normally takes place in a spatial world that is three-dimensional; nevertheless, stimuli of reduced spatial dimensionality are also used to display spatial information. This paper examines the consequences of full (three-dimensional) versus reduced (two-dimensional) spatial dimensionality for object processing by touch, particularly in comparison with vision. We begin with perceptual recognition of common human-made artefacts, then extend our discussion of spatial dimensionality in touch and vision to include faces, drawing from research on haptic recognition of facial identity and emotional expressions. Faces have often been characterized as constituting a specialized input for human perception. We find that contrary to vision, haptic processing of common objects is impaired by reduced spatial dimensionality, whereas haptic face processing is not. We interpret these results in terms of fundamental differences in object perception across the modalities, particularly the special role of manual exploration in extracting a three-dimensional structure.

Bringing the real world into the fMRI scanner: repetition effects for pictures versus real objects

Our understanding of the neural underpinnings of perception is largely built upon studies employing 2-dimensional (2D) planar images. Here we used slow event-related functional imaging in humans to examine whether neural populations show a characteristic repetition-related change in haemodynamic response for real-world 3-dimensional (3D) objects, an effect commonly observed using 2D images. As expected, trials involving 2D pictures of objects produced robust repetition effects within classic object-selective cortical regions along the ventral and dorsal visual processing streams. Surprisingly, however, repetition effects were weak, if not absent on trials involving the 3D objects. These results suggest that the neural mechanisms involved in processing real objects may therefore be distinct from those that arise when we encounter a 2D representation of the same items. These preliminary results suggest the need for further research with ecologically valid stimuli in other imaging designs to broaden our understanding of the neural mechanisms underlying human vision.

The role of color information on object recognition: a review and meta-analysis

In this study, we systematically review the scientific literature on the effect of color on object recognition. Thirty-five independent experiments, comprising 1535 participants, were included in a meta-analysis. We found a moderate effect of color on object recognition (d=0.28). Specific effects of moderator variables were analyzed and we found that color diagnosticity is the factor with the greatest moderator effect on the influence of color in object recognition; studies using color diagnostic objects showed a significant color effect (d=0.43), whereas a marginal color effect was found in studies that used non-color diagnostic objects (d=0.18). The present study did not permit the drawing of specific conclusions about the moderator effect of the object recognition task; while the meta-analytic review showed that color information improves object recognition mainly in studies using naming tasks (d=0.36), the literature review revealed a large body of evidence showing positive effects of color information on object recognition in studies using a large variety of visual recognition tasks. We also found that color is important for the ability to recognize artifacts and natural objects, to recognize objects presented as types (line-drawings) or as tokens (photographs), and to recognize objects that are presented without surface details, such as texture or shadow. Taken together, the results of the meta-analysis strongly support the contention that color plays a role in object recognition. This suggests that the role of color should be taken into account in models of visual object recognition.

Object knowledge modulates colour appearance

We investigated the memory colour effect for colour diagnostic artificial objects. Since knowledge about these objects and their colours has been learned in everyday life, these stimuli allow the investigation of the influence of acquired object knowledge on colour appearance. These investigations are relevant for questions about how object and colour information in high-level vision interact as well as for research about the influence of learning and experience on perception in general. In order to identify suitable artificial objects, we developed a reaction time paradigm that measures (subjective) colour diagnosticity. In the main experiment, participants adjusted sixteen such objects to their typical colour as well as to grey. If the achromatic object appears in its typical colour, then participants should adjust it to the opponent colour in order to subjectively perceive it as grey. We found that knowledge about the typical colour influences the colour appearance of artificial objects. This effect was particularly strong along the daylight axis.

Cortical brain regions associated with color processing: an FMRI study

To clarify whether the neural pathways concerning color processing are the same for natural objects, for artifacts objects and for non-objects we examined brain responses measured with functional magnetic resonance imaging (FMRI) during a covert naming task including the factors color (color vs. black&white (B&W)) and stimulus type (natural vs. artifacts vs. non-objects). Our results indicate that the superior parietal lobule and precuneus (BA 7) bilaterally, the right hippocampus and the right fusifom gyrus (V4) make part of a network responsible for color processing both for natural objects and artifacts, but not for non-objects. When color objects (both natural and artifacts) were contrasted with color non-objects we observed activations in the right parahippocampal gyrus (BA 35/36), the superior parietal lobule (BA 7) bilaterally, the left inferior middle temporal region (BA 20/21) and the inferior and superior frontal regions (BA 10/11/47). These additional activations suggest that colored objects recruit brain regions that are related to visual semantic information/retrieval and brain regions related to visuo-spatial processing. Overall, the results suggest that color information is an attribute that can improve object recognition (behavioral results) and activate a specific neural network related to visual semantic information that is more extensive than for B&W objects during object recognition.