'What' Is Happening in the Dorsal Visual Pathway

Redefining the resolution of semantic knowledge in the brain: Advances made by the introduction of models of semantics in neuroimaging

The boundaries of our understanding of conceptual representation in the brain have been redrawn since the introduction of explicit models of semantics. These models are grounded in vast behavioural datasets acquired in healthy volunteers. Here, we review the most important techniques which have been applied to detect semantic information in neuroimaging data and argue why semantic models are possibly the most valuable addition to the research of semantics in recent years. Using multivariate analysis, predictions based on patient lesion data have been confirmed during semantic processing in healthy controls. Secondly, this new method has given rise to new research avenues, e.g. the detection of semantic processing outside of the temporal cortex. As a future line of work, the same research strategy could be useful to study neurological conditions such as the semantic variant of primary progressive aphasia, which is characterized by pathological semantic processing.

An Information-Driven 2-Pathway Characterization of Occipitotemporal and Posterior Parietal Visual Object Representations

Recent studies have demonstrated the existence of rich visual representations in both occipitotemporal cortex (OTC) and posterior parietal cortex (PPC). Using fMRI decoding and a bottom-up data-driven approach, we showed that although robust object category representations exist in both OTC and PPC, there is an information-driven 2-pathway separation among these regions in the representational space, with occipitotemporal regions arranging hierarchically along 1 pathway and posterior parietal regions along another pathway. We obtained 10 independent replications of this 2-pathway distinction, accounting for 58-81% of the total variance of the region-wise differences in visual representation. The separation of the PPC regions from higher occipitotemporal regions was not driven by a difference in tolerance to changes in low-level visual features, did not rely on the presence of special object categories, and was present whether or not object category was task relevant. Our information-driven 2-pathway structure differs from the well-known ventral-what and dorsal-where/how characterization of posterior brain regions. Here both pathways contain rich nonspatial visual representations. The separation we see likely reflects a difference in neural coding scheme used by PPC to represent visual information compared with that of OTC.

Neuroanatomical substrates underlying contrast sensitivity

BACKGROUND

Contrast sensitivity (CS), a measurement of the ability to discriminate an object from its background, is an essential domain of visual functions. Eye aging or diseases are usually responsible for CS decline or impairment. However, whether neuroanatomical substrates are underlying CS is mostly unknown.

METHODS

High-resolution magnetic resonance imaging data of 100 healthy young subjects from the Human Connectome Project (HCP) dataset were used to calculate gray matter volume (GMV). CS was assessed using the Mars Contrast Sensitivity Test. A multiple regression analysis was used to investigate the relationship between CS and GMV in a voxel-wise manner within the whole gray matter.

RESULTS

The range of Mars_Final scores for the 100 participants was from 1.08 to 1.88, and we found significant positive correlations between the CS scores and GMV in the bilateral visual cortex. Precisely, the significant bilateral clusters were mainly located in bilateral V3A, with the superior parts extending to the bilateral posterior parietal cortex.

CONCLUSIONS

These findings suggest the critical role of the dorsal visual stream in CS processing, which may provide insights into the neuroanatomical mechanism of contrast sensitivity and its relation to some brain disorders.

The multifaceted abstract brain

concepts play a central role in human behaviour and constitute a critical component of the human conceptual system. Here, we investigate the neural basis of four types of abstract concepts, examining their similarities and differences through neuroimaging meta-analyses. We examine numerical and emotional concepts, and two higher-order abstract processes, morality judgements and theory of mind. Three main findings emerge. First, representation of abstract concepts is more widespread than is often assumed. Second, representations of different types of abstract concepts differ in important respects. Each of the domains examined here was associated with some unique areas. Third, some areas were commonly activated across domains and included inferior parietal, posterior cingulate and medial prefrontal cortex. We interpret these regions in terms of their role in episodic recall, event representation and social-emotional processing. We suggest that different types of abstract concepts can be represented and grounded through differing contributions from event-based, interoceptive, introspective and sensory-motor representations. The results underscore the richness and diversity of abstract concepts, argue against single-mechanism accounts for representation of all types of abstract concepts and suggest mechanisms for their direct and indirect grounding.This article is part of the theme issue 'Varieties of abstract concepts: development, use and representation in the brain'.

Dissociating neural activity associated with the subjective phenomenology of monocular stereopsis: An EEG study

The subjective phenomenology associated with stereopsis, of solid tangible objects separated by a palpable negative space, is conventionally thought to be a by-product of the derivation of depth from binocular disparity. However, the same qualitative impression has been reported in the absence of disparity, e.g., when viewing pictorial images monocularly through an aperture. Here we aimed to explore if we could identify dissociable neural activity associated with the qualitative impression of stereopsis in the absence of the processing of binocular disparities. We measured EEG activity while subjects viewed pictorial (non-stereoscopic) images of 2D and 3D geometric forms under four different viewing conditions (binocular, monocular, binocular aperture, monocular aperture). EEG activity was analysed by oscillatory source localization (beamformer technique) to examine power change in occipital and parietal regions across viewing and stimulus conditions in targeted frequency bands (alpha: 8-13 Hz & gamma: 60-90 Hz). We observed expected event-related gamma synchronization and alpha desynchronization in occipital cortex and predominant gamma synchronization in parietal cortex across viewing and stimulus conditions. However, only the viewing condition predicted to generate the strongest impression of stereopsis (monocular aperture) revealed significantly elevated gamma synchronization within the parietal cortex for the critical contrasts (3D vs. 2D form). These findings suggest dissociable neural processes specific to the qualitative impression of stereopsis as distinguished from disparity processing.

Gesturing tool use and tool transport actions modulates inferior parietal functional connectivity with the dorsal and ventral object processing pathways

Interacting with manipulable objects (tools) requires the integration of diverse computations supported by anatomically remote regions. Previous functional neuroimaging research has demonstrated the left supramarginal (SMG) exhibits functional connectivity to both ventral and dorsal pathways, supporting the integration of ventrally-mediated tool properties and conceptual knowledge with dorsally-computed volumetric and structural representations of tools. This architecture affords us the opportunity to test whether interactions between the left SMG, ventral visual pathway, and dorsal visual pathway are differentially modulated when participants plan and generate tool-directed gestures emphasizing functional manipulation (tool use gesturing) or structure-based grasping (tool transport gesturing). We found that functional connectivity between the left SMG, ventral temporal cortex (bilateral fusiform gyri), and dorsal visual pathway (left superior parietal lobule/posterior intraparietal sulcus) was maximal for tool transport planning and gesturing, whereas functional connectivity between the left SMG, left ventral anterior temporal lobe, and left frontal operculum was maximal for tool use planning and gesturing. These results demonstrate that functional connectivity to the left SMG is differentially modulated by tool use and tool transport gesturing, suggesting that distinct tool features computed by the two object processing pathways are integrated in the parietal lobe in the service of tool-directed action.

Temporal Dynamics of Shape Processing Differentiate Contributions of Dorsal and Ventral Visual Pathways

Although shape perception is primarily considered a function of the ventral visual pathway, previous research has shown that both dorsal and ventral pathways represent shape information. Here, we examine whether the shape-selective electrophysiological signals observed in dorsal cortex are a product of the connectivity to ventral cortex or are independently computed. We conducted multiple EEG studies in which we manipulated the input parameters of the stimuli so as to bias processing to either the dorsal or ventral visual pathway. Participants viewed displays of common objects with shape information parametrically degraded across five levels. We measured shape sensitivity by regressing the amplitude of the evoked signal against the degree of stimulus scrambling. Experiment 1, which included grayscale versions of the stimuli, served as a benchmark establishing the temporal pattern of shape processing during typical object perception. These stimuli evoked broad and sustained patterns of shape sensitivity beginning as early as 50 msec after stimulus onset. In Experiments 2 and 3, we calibrated the stimuli such that visual information was delivered primarily through parvocellular inputs, which mainly project to the ventral pathway, or through koniocellular inputs, which mainly project to the dorsal pathway. In the second and third experiments, shape sensitivity was observed, but in distinct spatio-temporal configurations from each other and from that elicited by grayscale inputs. Of particular interest, in the koniocellular condition, shape selectivity emerged earlier than in the parvocellular condition. These findings support the conclusion of distinct dorsal pathway computations of object shape, independent from the ventral pathway.

Impairments in action and perception after right intraparietal damage

We examined visually-guided reaching and perception in an individual who underwent resection of a small tumor in right intraparietal sulcus (pIPS). In the first experiment, she reached to targets presented on a touch screen. Vision was occluded from reach onset on half of the trials, whereas on the other half she had vision during the entire reach. For visually-guided reaching, she demonstrated significantly more reach errors for targets left of fixation versus right of fixation. However, there were no hemispatial differences when reaching without vision. Furthermore, her performance was consistent for reaches with either hand, providing evidence that pIPS encodes location based on an eye-centered reference frame. Second, previous studies reported that optic ataxics are more accurate when reaching to remembered versus visible target locations. We repeated the first experiment, adding a five second delay between stimulus presentation and reach initiation. In contrast to prior reports, she was less accurate in delayed versus immediate reaching. Finally, we examined whether a small pIPS resection would disrupt visuospatial processing in a simple perceptual task. We presented two small circles in succession in either the same location or offset at varying distances, and asked whether the two circles were presented in the same or different position. She was significantly more impaired left of fixation compared to right of fixation, providing evidence for a perceptual deficit after a dorsal stream lesion.

Origin and evolution of human speech: Emergence from a trimodal auditory, visual and vocal network

In recent years, there have been important additions to the classical model of speech processing as originally depicted by the Broca-Wernicke model consisting of an anterior, productive region and a posterior, perceptive region, both connected via the arcuate fasciculus. The modern view implies a separation into a dorsal and a ventral pathway conveying different kinds of linguistic information, which parallels the organization of the visual system. Furthermore, this organization is highly conserved in evolution and can be seen as the neural scaffolding from which the speech networks originated. In this chapter we emphasize that the speech networks are embedded in a multimodal system encompassing audio-vocal and visuo-vocal connections, which can be referred to an ancestral audio-visuo-motor pathway present in nonhuman primates. Likewise, we propose a trimodal repertoire for speech processing and acquisition involving auditory, visual and motor representations of the basic elements of speech: phoneme, observation of mouth movements, and articulatory processes. Finally, we discuss this proposal in the context of a scenario for early speech acquisition in infants and in human evolution.

Independent working memory resources for egocentric and allocentric spatial information

Visuospatial working memory enables us to maintain access to visual information for processing even when a stimulus is no longer present, due to occlusion, our own movements, or transience of the stimulus. Here we show that, when localizing remembered stimuli, the precision of spatial recall does not rely solely on memory for individual stimuli, but additionally depends on the relative distances between stimuli and visual landmarks in the surroundings. Across three separate experiments, we consistently observed a spatially selective improvement in the precision of recall for items located near a persistent landmark. While the results did not require that the landmark be visible throughout the memory delay period, it was essential that it was visible both during encoding and response. We present a simple model that can accurately capture human performance by considering relative (allocentric) spatial information as an independent localization estimate which degrades with distance and is optimally integrated with egocentric spatial information. Critically, allocentric information was encoded without cost to egocentric estimation, demonstrating independent storage of the two sources of information. Finally, when egocentric and allocentric estimates were put in conflict, the model successfully predicted the resulting localization errors. We suggest that the relative distance between stimuli represents an additional, independent spatial cue for memory recall. This cue information is likely to be critical for spatial localization in natural settings which contain an abundance of visual landmarks.

Category-selective processing in the two visual pathways as a function of stimulus degradation by noise

Understanding the organising principles and functional properties of the primate brain's numerous visually responsive cortical regions is one of the major goals in cognitive neuroscience. Functional magnetic resonance imaging (fMRI) studies have revealed that neural responses in higher-order visual cortex are shaped by object categories, task context, and spatiotemporal regularities. Beyond these properties, visual processing in the ventral pathway has been shown to be tightly linked to perceptual awareness, while the evidence regarding dorsal visual processing and awareness is mixed. Most previous studies targeting the dorsal pathway have used dichotomous "visible versus invisible" experimental designs and interocular suppression paradigms to modulate stimulus visibility. In this fMRI study, we sought to investigate category-selective processing of faces and tools in the ventral and dorsal visual streams as a function of parametric stimulus degradation by noise. Both frequentist and Bayesian statistics provide strong evidence for a linear relationship between category-selective processing and stimulus information in both visual pathways. Overall, multivariate category decoding accuracies turned out to be lower in the dorsal pathway. We discuss our results within the context of the emerging notion of highly interconnected visual streams, and provide an outlook on how future studies may help to further refine our understanding of the functional role of the dorsal pathway in visual object processing.

Neural Encoding and Decoding with Deep Learning for Dynamic Natural Vision

Convolutional neural network (CNN) driven by image recognition has been shown to be able to explain cortical responses to static pictures at ventral-stream areas. Here, we further showed that such CNN could reliably predict and decode functional magnetic resonance imaging data from humans watching natural movies, despite its lack of any mechanism to account for temporal dynamics or feedback processing. Using separate data, encoding and decoding models were developed and evaluated for describing the bi-directional relationships between the CNN and the brain. Through the encoding models, the CNN-predicted areas covered not only the ventral stream, but also the dorsal stream, albeit to a lesser degree; single-voxel response was visualized as the specific pixel pattern that drove the response, revealing the distinct representation of individual cortical location; cortical activation was synthesized from natural images with high-throughput to map category representation, contrast, and selectivity. Through the decoding models, fMRI signals were directly decoded to estimate the feature representations in both visual and semantic spaces, for direct visual reconstruction and semantic categorization, respectively. These results corroborate, generalize, and extend previous findings, and highlight the value of using deep learning, as an all-in-one model of the visual cortex, to understand and decode natural vision.

Temporal Dynamics and Response Modulation across the Human Visual System in a Spatial Attention Task: An ECoG Study

The selection of behaviorally relevant information from cluttered visual scenes (often referred to as "attention") is mediated by a cortical large-scale network consisting of areas in occipital, temporal, parietal, and frontal cortex that is organized into a functional hierarchy of feedforward and feedback pathways. In the human brain, little is known about the temporal dynamics of attentional processing from studies at the mesoscopic level of electrocorticography (ECoG), that combines millisecond temporal resolution with precise anatomical localization of recording sites. We analyzed high-frequency broadband responses (HFB) responses from 626 electrodes implanted in 8 epilepsy patients who performed a spatial attention task. Electrode locations were reconstructed using a probabilistic atlas of the human visual system. HFB responses showed high spatial selectivity and tuning, constituting ECoG response fields (RFs), within and outside the topographic visual system. In accordance with monkey physiology studies, both RF widths and onset latencies increased systematically across the visual processing hierarchy. We used the spatial specificity of HFB responses to quantitatively study spatial attention effects and their temporal dynamics to probe a hierarchical top-down model suggesting that feedback signals back propagate the visual processing hierarchy. Consistent with such a model, the strengths of attentional modulation were found to be greater and modulation latencies to be shorter in posterior parietal cortex, middle temporal cortex and ventral extrastriate cortex compared with early visual cortex. However, inconsistent with such a model, attention effects were weaker and more delayed in anterior parietal and frontal cortex.SIGNIFICANCE STATEMENT In the human brain, visual attention has been predominantly studied using methods with high spatial, but poor temporal resolution such as fMRI, or high temporal, but poor spatial resolution such as EEG/MEG. Here, we investigate temporal dynamics and attention effects across the human visual system at a mesoscopic level that combines precise spatial and temporal measurements by using electrocorticography in epilepsy patients performing a classical spatial attention task. Electrode locations were reconstructed using a probabilistic atlas of the human visual system, thereby relating them to topography and processing hierarchy. We demonstrate regional differences in temporal dynamics across the attention network. Our findings do not fully support a top-down model that promotes influences on visual cortex by reversing the processing hierarchy.

Mind the Depth: Visual Perception of Shapes Is Better in Peripersonal Space

Closer objects are invariably perceived as bigger than farther ones and are therefore easier to detect and discriminate. This is so deeply grounded in our daily experience that no question has been raised as to whether the advantage for near objects depends on other features (e.g., depth itself). In a series of five experiments (N = 114), we exploited immersive virtual environments and visual illusions (i.e., Ponzo) to probe humans’ perceptual abilities in depth and, specifically, in the space closely surrounding our body, termed peripersonal space. We reversed the natural distance scaling of size in favor of the farther object, which thus appeared bigger, to demonstrate a persistent shape-discrimination advantage for close objects. Psychophysical modeling further suggested a sigmoidal trend for this benefit, mirroring that found for multisensory estimates of peripersonal space. We argue that depth is a fundamental, yet overlooked, dimension of human perception and that future studies in vision and perception should be depth aware.

Spontaneous in-flight accommodation of hand orientation to unseen grasp targets: A case of action blindsight

The division of labour between the dorsal and ventral visual pathways is well established. The ventral stream supports object identification, while the dorsal stream supports online processing of visual information in the service of visually guided actions. Here, we report a case of an individual with a right inferior quadrantanopia who exhibited accurate spontaneous rotation of his wrist when grasping a target object in his blind visual field. His accurate wrist orientation was observed despite the fact that he exhibited no sensitivity to the orientation of the handle in a perceptual matching task. These findings indicate that non-geniculostriate visual pathways process basic volumetric information relevant to grasping, and reinforce the observation that phenomenal awareness is not necessary for an object's volumetric properties to influence visuomotor performance.

Spatial Frequency Tolerant Visual Object Representations in the Human Ventral and Dorsal Visual Processing Pathways

Primate ventral and dorsal visual pathways both contain visual object representations. Dorsal regions receive more input from magnocellular system while ventral regions receive inputs from both magnocellular and parvocellular systems. Due to potential differences in the spatial sensitivites of manocellular and parvocellular systems, object representations in ventral and dorsal regions may differ in how they represent visual input from different spatial scales. To test this prediction, we asked observers to view blocks of images from six object categories, shown in full spectrum, high spatial frequency (SF), or low SF. We found robust object category decoding in all SF conditions as well as SF decoding in nearly all the early visual, ventral, and dorsal regions examined. Cross-SF decoding further revealed that object category representations in all regions exhibited substantial tolerance across the SF components. No difference between ventral and dorsal regions was found in their preference for the different SF components. Further comparisons revealed that, whereas differences in the SF component separated object category representations in early visual areas, such a separation was much smaller in downstream ventral and dorsal regions. In those regions, variations among the object categories played a more significant role in shaping the visual representational structures. Our findings show that ventral and dorsal regions are similar in how they represent visual input from different spatial scales and argue against a dissociation of these regions based on differential sensitivity to different SFs.

Action and semantic tool knowledge - Effective connectivity in the underlying neural networks

Evidence from neuropsychological and imaging studies indicate that action and semantic knowledge about tools draw upon distinct neural substrates, but little is known about the underlying interregional effective connectivity. With fMRI and dynamic causal modeling (DCM) we investigated effective connectivity in the left-hemisphere (LH) while subjects performed (i) a function knowledge and (ii) a value knowledge task, both addressing semantic tool knowledge, and (iii) a manipulation (action) knowledge task. Overall, the results indicate crosstalk between action nodes and semantic nodes. Interestingly, effective connectivity was weakened between semantic nodes and action nodes during the manipulation task. Furthermore, pronounced modulations of effective connectivity within the fronto-parietal action system of the LH (comprising lateral occipito-temporal cortex, intraparietal sulcus, supramarginal gyrus, inferior frontal gyrus) were observed in a bidirectional manner during the processing of action knowledge. In contrast, the function and value knowledge tasks resulted in a significant strengthening of the effective connectivity between visual cortex and fusiform gyrus. Importantly, this modulation was present in both semantic tasks, indicating that processing different aspects of semantic knowledge about tools evokes similar effective connectivity patterns. Data revealed that interregional effective connectivity during the processing of tool knowledge occurred in a bidirectional manner with a weakening of connectivity between areas engaged in action and semantic knowledge about tools during the processing of action knowledge. Moreover, different semantic tool knowledge tasks elicited similar effective connectivity patterns.

The Neural and Behavioral Correlates of Anomia Recovery following Personalized Observation, Execution, and Mental Imagery Therapy: A Proof of Concept

The impact of sensorimotor strategies on aphasia recovery has rarely been explored. This paper reports on the efficacy of personalized observation, execution, and mental imagery (POEM) therapy, a new approach designed to integrate sensorimotor and language-based strategies to treat verb anomia, a frequent aphasia sign. Two participants with verb anomia were followed up in a pre-/posttherapy fMRI study. POEM was administered in a massed stimulation schedule, with personalized stimuli, resulting in significant improvement in both participants, with both trained and untrained items. Given that the latter finding is rarely reported in the literature, the evidence suggests that POEM favors the implementation of a word retrieval strategy that can be integrated and generalized. Changes in fMRI patterns following POEM reflect a reduction in the number of recruited areas supporting naming and the recruitment of brain areas that belong to the language and mirror neuron systems. The data provide evidence on the efficacy of POEM for verb anomia, while pointing to the added value of combined language and sensorimotor strategies for recovery from verb anomia, contributing to the consolidation of a word retrieval strategy that can be better generalized to untrained words. Future studies with a larger sample of participants are required to further explore this avenue.

Three-stage processing of category and variation information by entangled interactive mechanisms of peri-occipital and peri-frontal cortices

Object recognition has been a central question in human vision research. The general consensus is that the ventral and dorsal visual streams are the major processing pathways undertaking objects' category and variation processing. This overlooks mounting evidence supporting the role of peri-frontal areas in category processing. Yet, many aspects of visual processing in peri-frontal areas have remained unattended including whether these areas play role only during active recognition and whether they interact with lower visual areas or process information independently. To address these questions, subjects were presented with a set of variation-controlled object images while their EEG were recorded. Considerable amounts of category and variation information were decodable from occipital, parietal, temporal and prefrontal electrodes. Using information-selectivity indices, phase and Granger causality analyses, three processing stages were identified showing distinct directions of information transaction between peri-frontal and peri-occipital areas suggesting their parallel yet interactive role in visual processing. A brain-plausible model supported the possibility of interactive mechanisms in peri-occipital and peri-frontal areas. These findings, while promoting the role of prefrontal areas in object recognition, extend their contributions from active recognition, in which peri-frontal to peri-occipital pathways are activated by higher cognitive processes, to the general sensory-driven object and variation processing.

The Posterior Parietal Cortex in Adaptive Visual Processing

Although the primate posterior parietal cortex (PPC) has been largely associated with space, attention, and action-related processing, a growing number of studies have reported the direct representation of a diverse array of action-independent nonspatial visual information in the PPC during both perception and visual working memory. By describing the distinctions and the close interactions of visual representation with space, attention, and action-related processing in the PPC, here I propose that we may understand these diverse PPC functions together through the unique contribution of the PPC to adaptive visual processing and form a more integrated and structured view of the role of the PPC in vision, cognition, and action.

Content-specific activity in frontoparietal and default-mode networks during prior-guided visual perception

How prior knowledge shapes perceptual processing across the human brain, particularly in the frontoparietal (FPN) and default-mode (DMN) networks, remains unknown. Using ultra-high-field (7T) functional magnetic resonance imaging (fMRI), we elucidated the effects that the acquisition of prior knowledge has on perceptual processing across the brain. We observed that prior knowledge significantly impacted neural representations in the FPN and DMN, rendering responses to individual visual images more distinct from each other, and more similar to the image-specific prior. In addition, neural representations were structured in a hierarchy that remained stable across perceptual conditions, with early visual areas and DMN anchored at the two extremes. Two large-scale cortical gradients occur along this hierarchy: first, dimensionality of the neural representational space increased along the hierarchy; second, prior’s impact on neural representations was greater in higher-order areas. These results reveal extensive and graded influences of prior knowledge on perceptual processing across the brain.

Preserved Object Weight Processing after Bilateral Lateral Occipital Complex Lesions

Object interaction requires knowledge of the weight of an object, as well as its shape. The lateral occipital complex (LOC), an area within the ventral visual pathway, is well known to be critically involved in processing visual shape information. Recently, however, LOC has also been implicated in coding object weight before grasping-a result that is surprising because weight is a nonvisual object property that is more relevant for motor interaction than visual perception. Here, we examined the causal role of LOC in perceiving heaviness and in determining appropriate fingertip forces during object lifting. We studied perceptions of heaviness and lifting behavior in a neuropsychological patient (M.C.) who has large bilateral occipitotemporal lesions that include LOC. We compared the patient's performance to a group of 18 neurologically healthy age-matched controls. Participants were asked to lift and report the perceived heaviness of a set of equally weighted spherical objects of various sizes-stimuli which typically induce the size-weight illusion, in which the smaller objects feel heavier than the larger objects despite having identical mass. Despite her ventral stream lesions, M.C. experienced a robust size-weight illusion induced by visual cues to object volume, and the magnitude of the illusion in M.C. was comparable to age-matched controls. Similarly, M.C. evinced predictive fingertip force scaling to visual size cues during her initial lifts of the objects that were well within the normal range. These single-case neuropsychological findings suggest that LOC is unlikely to play a causal role in computing object weight.

Task- and domain-specific modulation of functional connectivity in the ventral and dorsal object-processing pathways

A whole-brain network of regions collectively supports the ability to recognize and use objects-the Tool Processing Network. Little is known about how functional interactions within the Tool Processing Network are modulated in a task-dependent manner. We designed an fMRI experiment in which participants were required to either generate object pantomimes or to carry out a picture matching task over the same images of tools, while holding all aspects of stimulus presentation constant across the tasks. The Tool Processing Network was defined with an independent functional localizer, and functional connectivity within the network was measured during the pantomime and picture matching tasks. Relative to tool picture matching, tool pantomiming led to an increase in functional connectivity between ventral stream regions and left parietal and frontal-motor areas; in contrast, the matching task was associated with an increase in functional connectivity among regions in ventral temporo-occipital cortex, and between ventral temporal regions and the left inferior parietal lobule. Graph-theory analyses over the functional connectivity data indicated that the left premotor cortex and left lateral occipital complex were hub-like (exhibited high betweenness centrality) during tool pantomiming, while ventral stream regions (left medial fusiform gyrus and left posterior middle temporal gyrus) were hub-like during the picture matching task. These results demonstrate task-specific modulation of functional interactions among a common set of regions, and indicate dynamic coupling of anatomically remote regions in task-dependent manner.

A Tale of Two Visual Systems: Invariant and Adaptive Visual Information Representations in the Primate Brain

Visual information processing contains two opposite needs. There is both a need to comprehend the richness of the visual world and a need to extract only pertinent visual information to guide thoughts and behavior at a given moment. I argue that these two aspects of visual processing are mediated by two complementary visual systems in the primate brain-specifically, the occipitotemporal cortex (OTC) and the posterior parietal cortex (PPC). The role of OTC in visual processing has been documented extensively by decades of neuroscience research. I review here recent evidence from human imaging and monkey neurophysiology studies to highlight the role of PPC in adaptive visual processing. I first document the diverse array of visual representations found in PPC. I then describe the adaptive nature of visual representation in PPC by contrasting visual processing in OTC and PPC and by showing that visual representations in PPC largely originate from OTC.

Visual illusions modify object size estimates for prospective action judgements

How does the eye guide the hand in an ever-changing world? The perception-action model posits that visually-guided actions rely on object size estimates that are computed from an egocentric perspective independently of the visual context. Accordingly, adjusting grip aperture to object size should be resistant to illusions emerging from the contrast between a target and surrounding elements. However, experimental studies gave discrepant results that have remained difficult to explain so far. Visual and proprioceptive information of the acting hand are potential sources of ambiguity in previous studies because the on-line corrections they allow may contribute to masking the illusory effect. To overcome this problem, we investigated the effect on prospective action judgements of the Ebbinghaus illusion, a visual illusion in which the perceived size of a central circle varies according to the size of surrounding circles. Participants had to decide whether they thought they would be able to grasp the central circle of an Ebbinghaus display between their index finger and thumb, without moving their hands. A control group had to judge the size of the central circle relative to a standard. Experiment 1 showed that the illusion affected perceptual and grasping judgements similarly. We further investigated the interaction between visual illusions and grip aperture representation by examining the effect of concurrent motor tasks on grasping judgements. We showed that participants underestimated their ability to grasp the circle when they were squeezing a ball between their index finger and thumb (Experiment 2), whereas they overestimated their ability when their fingers were spread apart (Experiment 3). The illusion also affected the grasping judgement task and modulated the interference of the squeezing movement, with the illusion of largeness enhancing the underestimation of one's grasping ability observed in Experiment 2. We conclude that visual context and body posture both influence action anticipation, and that perception and action support each other.

Visual and visuomotor processing of hands and tools as a case study of cross talk between the dorsal and ventral streams

A major principle of organization of the visual system is between a dorsal stream that processes visuomotor information and a ventral stream that supports object recognition. Most research has focused on dissociating processing across these two streams. Here we focus on how the two streams interact. We tested neurologically-intact and impaired participants in an object categorization task over two classes of objects that depend on processing within both streams-hands and tools. We measured how unconscious processing of images from one of these categories (e.g., tools) affects the recognition of images from the other category (i.e., hands). Our findings with neurologically-intact participants demonstrated that processing an image of a hand hampers the subsequent processing of an image of a tool, and vice versa. These results were not present in apraxic patients (N = 3). These findings suggest local and global inhibitory processes working in tandem to co-register information across the two streams.

Towards a unified perspective of object shape and motion processing in human dorsal cortex

Although object-related areas were discovered in human parietal cortex a decade ago, surprisingly little is known about the nature and purpose of these representations, and how they differ from those in the ventral processing stream. In this article, we review evidence for the unique contribution of object areas of dorsal cortex to three-dimensional (3-D) shape representation, the localization of objects in space, and in guiding reaching and grasping actions. We also highlight the role of dorsal cortex in form-motion interaction and spatiotemporal integration, possible functional relationships between 3-D shape and motion processing, and how these processes operate together in the service of supporting goal-directed actions with objects. Fundamental differences between the nature of object representations in the dorsal versus ventral processing streams are considered, with an emphasis on how and why dorsal cortex supports veridical (rather than invariant) representations of objects to guide goal-directed hand actions in dynamic visual environments.

Parietal-Occipital Interactions Underlying Control- and Representation-Related Processes in Working Memory for Nonspatial Visual Features

Although the manipulation of load is popular in visual working memory research, many studies confound general attentional demands with context binding by drawing memoranda from the same stimulus category. In this fMRI study of human observers (both sexes), we created high- versus low-binding conditions, while holding load constant, by comparing trials requiring memory for the direction of motion of one random dot kinematogram (RDK; 1M trials) versus for three RDKs (3M), or versus one RDK and two color patches (1M2C). Memory precision was highest for 1M trials and comparable for 3M and 1M2C trials. And although delay-period activity in occipital cortex did not differ between the three conditions, returning to baseline for all three, multivariate pattern analysis decoding of a remembered RDK from occipital cortex was also highest for 1M trials and comparable for 3M and 1M2C trials. Delay-period activity in intraparietal sulcus (IPS), although elevated for all three conditions, displayed more sensitivity to demands on context binding than to load per se. The 1M-to-3M increase in IPS signal predicted the 1M-to-3M declines in both behavioral and neural estimates of working memory precision. These effects strengthened along a caudal-to-rostral gradient, from IPS0 to IPS5. Context binding-independent load sensitivity was observed when analyses were lateralized and extended into PFC, with trend-level effects evident in left IPS and strong effects in left lateral PFC. These findings illustrate how visual working memory capacity limitations arise from multiple factors that each recruit dissociable brain systems.SIGNIFICANCE STATEMENT Visual working memory capacity predicts performance on a wide array of cognitive and real-world outcomes. At least two theoretically distinct factors are proposed to influence visual working memory capacity limitations: an amodal attentional resource that must be shared across remembered items; and the demands on context binding. We unconfounded these two factors by varying load with items drawn from the same stimulus category ("high demands on context binding") versus items drawn from different stimulus categories ("low demands on context binding"). The results provide evidence for the dissociability, and the neural bases, of these two theorized factors, and they specify that the functions of intraparietal sulcus may relate more strongly to the control of representations than to the general allocation of attention.

More than Action: The Dorsal Pathway Contributes to the Perception of 3-D Structure

An evolving view in cognitive neuroscience is that the dorsal visual pathway not only plays a key role in visuomotor behavior but that it also contributes functionally to the recognition of objects. To characterize the nature of the object representations derived by the dorsal pathway, we assessed perceptual performance in the context of the continuous flash suppression paradigm, which suppresses object processing in the ventral pathway while sparing computation in the dorsal pathway. In a series of experiments, prime stimuli, which were rendered imperceptible by the continuous flash suppression, still contributed to perceptual decisions related to the subsequent perceptible target stimuli. However, the contribution of the prime to perception was contingent on the prime's structural coherence, in that a perceptual advantage was observed only for targets primed by objects with legitimate 3-D structure. Finally, we obtained additional evidence to demonstrate that the processing of the suppressed objects was contingent on the magnocellular, rather than the parvocellular, system, further linking the processing of the suppressed stimuli to the dorsal pathway. Together, these results provide novel evidence that the dorsal pathway does not only support visuomotor control but, rather, that it also derives the structural description of 3-D objects and contributes to shape perception.

Deep Residual Network Predicts Cortical Representation and Organization of Visual Features for Rapid Categorization

The brain represents visual objects with topographic cortical patterns. To address how distributed visual representations enable object categorization, we established predictive encoding models based on a deep residual network, and trained them to predict cortical responses to natural movies. Using this predictive model, we mapped human cortical representations to 64,000 visual objects from 80 categories with high throughput and accuracy. Such representations covered both the ventral and dorsal pathways, reflected multiple levels of object features, and preserved semantic relationships between categories. In the entire visual cortex, object representations were organized into three clusters of categories: biological objects, non-biological objects, and background scenes. In a finer scale specific to each cluster, object representations revealed sub-clusters for further categorization. Such hierarchical clustering of category representations was mostly contributed by cortical representations of object features from middle to high levels. In summary, this study demonstrates a useful computational strategy to characterize the cortical organization and representations of visual features for rapid categorization.

Above and Beyond Objects: The Development of Infants' Spatial Concepts

Early in development infants form categorical representations of small-scale spatial relations, such as left vs right and above vs below. This spatial skill allows infants to experience coherence in the layout of the objects in their environment and to note the equivalence of a spatial relation across changes in objects. Comparisons across studies of infant spatial categorization offer insight into the processes that contribute to the development of this skill. Rather than viewing contrasting results across studies as contradictory, identifying how infant spatial categorization tasks recruit distinct processes can not only reconcile findings but also yield insight into the starting points, development, and emerging nature of infants' representations of spatial relations. Also, situating infants' spatial categorization in the context of advances in nonspatial domains may reveal synergistic relations among these domains, particularly in relation to advances in infants' manipulative play with objects and their acquisition of spatial language. A central argument is that broadening the study of infants' spatial categorization may yield further insights into the nature of early spatial concepts and the processes that promote their development.

Ventral and Dorsal Pathways Relate Differently to Visual Awareness of Body Postures under Continuous Flash Suppression

Visual perception includes ventral and dorsal stream processes. However, it is still unclear whether the former is predominantly related to conscious and the latter to nonconscious visual perception as argued in the literature. In this study upright and inverted body postures were rendered either visible or invisible under continuous flash suppression (CFS), while brain activity of human participants was measured with functional MRI (fMRI). Activity in the ventral body-sensitive areas was higher during visible conditions. In comparison, activity in the posterior part of the bilateral intraparietal sulcus (IPS) showed a significant interaction of stimulus orientation and visibility. Our results provide evidence that dorsal stream areas are less associated with visual awareness.

The Size Congruity Effect Vanishes in Grasping: Implications for the Processing of Numerical Information

Judgments of the physical size in which a numeral is presented are often affected by the task-irrelevant attribute of its numerical magnitude, the Size Congruity Effect (SCE). The SCE is typically interpreted as a marker of the automatic activation of numerical magnitude. However, a growing literature shows that the SCE is not robust, a possible indication that numerical information is not always activated in an automatic fashion. In the present study, we tested the SCE via grasping by way of resolving the automaticity debate. We found results that challenge the robustness of the SCE and, consequently, the validity of the automaticity assumption. The SCE was absent when participants grasped the physically larger object of a pair of 3D wooden numerals. An SCE was still recorded when the participants perceptually indicated the general location of the larger object, but not when they grasped that object. These results highlight the importance of the sensory domain when considering the generality of a perceptual effect.

Task Context Overrules Object- and Category-Related Representational Content in the Human Parietal Cortex

The dorsal, parietal visual stream is activated when seeing objects, but the exact nature of parietal object representations is still under discussion. Here we test 2 specific hypotheses. First, parietal cortex is biased to host some representations more than others, with a different bias compared with ventral areas. A prime example would be object action representations. Second, parietal cortex forms a general multiple-demand network with frontal areas, showing similar task effects and representational content compared with frontal areas. To differentiate between these hypotheses, we implemented a human neuroimaging study with a stimulus set that dissociates associated object action from object category while manipulating task context to be either action- or category-related. Representations in parietal as well as prefrontal areas represented task-relevant object properties (action representations in the action task), with no sign of the irrelevant object property (category representations in the action task). In contrast, irrelevant object properties were represented in ventral areas. These findings emphasize that human parietal cortex does not preferentially represent particular object properties irrespective of task, but together with frontal areas is part of a multiple-demand and content-rich cortical network representing task-relevant object properties.

Constructional apraxia

Since the classic papers of Kleist, Mayer Gross, and Critchley, constructional apraxia (CA) has been considered to be a typical sign of a parietal lobe lesion, and as a precious tool to appreciate the spatial abilities subserved by this lobe. However, the development of more sophisticated neuropsychologic models and methods of investigation has revealed several problematic aspects. It has become increasingly clear that CA is a heterogeneous construct that can be examined with very different tasks, that are only mildly interconnected, and tap various kinds of visuospatial, perceptual, attentional, planning, and motor mechanisms. On the basis of these considerations, the relationships between parietal lobe functions and constructional activities must be considered, taking into account on the one hand the heterogeneity of the tasks and of the cognitive functions requested by different kinds of constructional activities and, on the other hand, the plurality of functions and of processing streams linking different parts of the parietal lobes to the occipital and frontal lobes.

Graspable Objects Grab Attention More Than Images Do

The opportunity an object presents for action is known as an affordance. A basic assumption in previous research was that images of objects, which do not afford physical action, elicit effects on attention and behavior comparable with those of real-world tangible objects. Using a flanker task, we compared interference effects between real graspable objects and matched 2-D or 3-D images of the items. Compared with both 2-D and 3-D images, real objects yielded slower response times overall and elicited greater flanker interference effects. When the real objects were positioned out of reach or behind a transparent barrier, the pattern of response times and interference effects was comparable with that for 2-D images. Graspable objects exert a more powerful influence on attention and manual responses than images because of the affordances they offer for manual interaction. These results raise questions about whether images are suitable proxies for real objects in psychological research.

Perceptual integration rapidly activates dorsal visual pathway to guide local processing in early visual areas

Rapidly grouping local elements into an organized object (i.e., perceptual integration) is a fundamental yet challenging task, especially in noisy contexts. Previous studies demonstrate that ventral visual pathway, which is widely known to mediate object recognition, engages in the process by conveying object-level information processed in high-level areas to modulate low-level sensory areas. Meanwhile, recent evidence suggests that the dorsal visual pathway, which is not typically attributable to object recognition, is also involved in the process. However, the underlying whole-brain fine spatiotemporal neuronal dynamics remains unknown. Here we used magnetoencephalography (MEG) recordings in combination with a temporal response function (TRF) approach to dissociate the time-resolved neuronal response that specifically tracks the perceptual grouping course. We demonstrate that perceptual integration initiates robust and rapid responses along the dorsal visual pathway in a reversed hierarchical manner, faster than the ventral pathway. Specifically, the anterior intraparietal sulcus (IPS) responds first (i.e., within 100 ms), followed by activities backpropagating along the dorsal pathway to early visual areas (EVAs). The IPS activity causally modulates the EVA response, even when the global form information is task-irrelevant. The IPS-to-EVA response profile fails to appear when the global form could not be perceived. Our results support the crucial function of the dorsal visual pathway in perceptual integration, by quickly extracting a coarse global template (i.e., an initial object representation) within first 100 ms to guide subsequent local sensory processing so that the ambiguities in the visual inputs can be efficiently resolved.

How the brain integrates local elements into a global object (i.e., perceptual integration) in noisy contexts constitutes a fundamental yet challenging question in cognitive neuroscience. Here, we recorded brain activity by using magnetoencephalography from human subjects watching glass-pattern stimuli to examine the fine spatiotemporal neuronal responses during perceptual integration. We demonstrate that high-level brain regions initially extract a coarse global form of the inputs, which is then relayed along the dorsal visual pathway in a reversed hierarchical manner to low-level areas to modulate local analysis. This global-to-local modulation mechanism is especially beneficial in noisy environments by rapidly making an “initial guess” to guide detail analysis so that the ambiguities in inputs can be efficiently resolved.

Differential hemispheric and visual stream contributions to ensemble coding of crowd emotion

In crowds, where scrutinizing individual facial expressions is inefficient, humans can make snap judgments about the prevailing mood by reading "crowd emotion". We investigated how the brain accomplishes this feat in a set of behavioral and fMRI studies. Participants were asked to either avoid or approach one of two crowds of faces presented in the left and right visual hemifields. Perception of crowd emotion was improved when crowd stimuli contained goal-congruent cues and was highly lateralized to the right hemisphere. The dorsal visual stream was preferentially activated in crowd emotion processing, with activity in the intraparietal sulcus and superior frontal gyrus predicting perceptual accuracy for crowd emotion perception, whereas activity in the fusiform cortex in the ventral stream predicted better perception of individual facial expressions. Our findings thus reveal significant behavioral differences and differential involvement of the hemispheres and the major visual streams in reading crowd versus individual face expressions.

The large-scale organization of shape processing in the ventral and dorsal pathways

Although shape perception is considered a function of the ventral visual pathway, evidence suggests that the dorsal pathway also derives shape-based representations. In two psychophysics and neuroimaging experiments, we characterized the response properties, topographical organization and perceptual relevance of these representations. In both pathways, shape sensitivity increased from early visual cortex to extrastriate cortex but then decreased in anterior regions. Moreover, the lateral aspect of the ventral pathway and posterior regions of the dorsal pathway were sensitive to the availability of fundamental shape properties, even for unrecognizable images. This apparent representational similarity between the posterior-dorsal and lateral-ventral regions was corroborated by a multivariate analysis. Finally, as with ventral pathway, the activation profile of posterior dorsal regions was correlated with recognition performance, suggesting a possible contribution to perception. These findings challenge a strict functional dichotomy between the pathways and suggest a more distributed model of shape processing.

We rely on our sense of vision to perceive the world around us and the objects within it. We also use vision to guide our interactions with objects. One of the most influential theories in cognitive neuroscience is the idea that separate pathways within the brain support these two processes. The ventral pathway is in charge of vision-for-perception. It analyses the features that help us recognize objects, such as their color, size or shape, enabling us to identify the hammer in a toolbox, for example. The dorsal pathway is responsible for vision-for-action. It processes features that help us interact with objects, such as their movement and location, enabling us to use the hammer to strike a nail.

However, recent studies have suggested that the ventral and dorsal pathways may not be as independent as originally thought. Freud et al. now test this idea by examining if the dorsal vision-for-action pathway can also perceive and process objects.

Healthy volunteers viewed pictures of objects while lying inside a brain scanner. Some of the objects in the pictures were intact, whereas others had been distorted. If a brain region shows greater activation when viewing intact objects than distorted ones, it implies that that region is sensitive to the normal shapes of objects. Freud et al. found that both the ventral and dorsal pathways were sensitive to shape, with some areas in the two pathways showing highly similar responses. Furthermore, the shape sensitivity of certain regions within the dorsal pathway correlated with the volunteers’ ability to recognize the objects. This suggests that regions distributed across both pathways – and not just the ventral one – may contribute to object recognition.

The two-pathways hypothesis has governed our understanding of vision and of other sensory systems including hearing for several decades. By challenging the binary distinction between the two pathways, the results of Freud et al. suggest that models of sensory processing may require updating. This improved understanding may ultimately improve diagnosis and treatment of perceptual disorders such as agnosia, in which patients struggle to recognize objects.

New insights into the role of motion and form vision in neurodevelopmental disorders

A selective deficit in processing the global (overall) motion, but not form, of spatially extensive objects in the visual scene is frequently associated with several neurodevelopmental disorders, including preterm birth. Existing theories that proposed to explain the origin of this visual impairment are, however, challenged by recent research. In this review, we explore alternative hypotheses for why deficits in the processing of global motion, relative to global form, might arise. We describe recent evidence that has utilised novel tasks of global motion and global form to elucidate the underlying nature of the visual deficit reported in different neurodevelopmental disorders. We also examine the role of IQ and how the sex of an individual can influence performance on these tasks, as these are factors that are associated with performance on global motion tasks, but have not been systematically controlled for in previous studies exploring visual processing in clinical populations. Finally, we suggest that a new theoretical framework is needed for visual processing in neurodevelopmental disorders and present recommendations for future research.

Auditory object perception: A neurobiological model and prospective review

Interaction with the world is a multisensory experience, but most of what is known about the neural correlates of perception comes from studying vision. Auditory inputs enter cortex with its own set of unique qualities, and leads to use in oral communication, speech, music, and the understanding of emotional and intentional states of others, all of which are central to the human experience. To better understand how the auditory system develops, recovers after injury, and how it may have transitioned in its functions over the course of hominin evolution, advances are needed in models of how the human brain is organized to process real-world natural sounds and "auditory objects". This review presents a simple fundamental neurobiological model of hearing perception at a category level that incorporates principles of bottom-up signal processing together with top-down constraints of grounded cognition theories of knowledge representation. Though mostly derived from human neuroimaging literature, this theoretical framework highlights rudimentary principles of real-world sound processing that may apply to most if not all mammalian species with hearing and acoustic communication abilities. The model encompasses three basic categories of sound-source: (1) action sounds (non-vocalizations) produced by 'living things', with human (conspecific) and non-human animal sources representing two subcategories; (2) action sounds produced by 'non-living things', including environmental sources and human-made machinery; and (3) vocalizations ('living things'), with human versus non-human animals as two subcategories therein. The model is presented in the context of cognitive architectures relating to multisensory, sensory-motor, and spoken language organizations. The models' predictive values are further discussed in the context of anthropological theories of oral communication evolution and the neurodevelopment of spoken language proto-networks in infants/toddlers. These phylogenetic and ontogenetic frameworks both entail cortical network maturations that are proposed to at least in part be organized around a number of universal acoustic-semantic signal attributes of natural sounds, which are addressed herein.

Goal-Directed Visual Processing Differentially Impacts Human Ventral and Dorsal Visual Representations

Recent studies have challenged the ventral/"what" and dorsal/"where" two-visual-processing-pathway view by showing the existence of "what" and "where" information in both pathways. Is the two-pathway distinction still valid? Here, we examined how goal-directed visual information processing may differentially impact visual representations in these two pathways. Using fMRI and multivariate pattern analysis, in three experiments on human participants (57% females), by manipulating whether color or shape was task-relevant and how they were conjoined, we examined shape-based object category decoding in occipitotemporal and parietal regions. We found that object category representations in all the regions examined were influenced by whether or not object shape was task-relevant. This task effect, however, tended to decrease as task-relevant and irrelevant features were more integrated, reflecting the well-known object-based feature encoding. Interestingly, task relevance played a relatively minor role in driving the representational structures of early visual and ventral object regions. They were driven predominantly by variations in object shapes. In contrast, the effect of task was much greater in dorsal than ventral regions, with object category and task relevance both contributing significantly to the representational structures of the dorsal regions. These results showed that, whereas visual representations in the ventral pathway are more invariant and reflect "what an object is," those in the dorsal pathway are more adaptive and reflect "what we do with it." Thus, despite the existence of "what" and "where" information in both visual processing pathways, the two pathways may still differ fundamentally in their roles in visual information representation.SIGNIFICANCE STATEMENT Visual information is thought to be processed in two distinctive pathways: the ventral pathway that processes "what" an object is and the dorsal pathway that processes "where" it is located. This view has been challenged by recent studies revealing the existence of "what" and "where" information in both pathways. Here, we found that goal-directed visual information processing differentially modulates shape-based object category representations in the two pathways. Whereas ventral representations are more invariant to the demand of the task, reflecting what an object is, dorsal representations are more adaptive, reflecting what we do with the object. Thus, despite the existence of "what" and "where" information in both pathways, visual representations may still differ fundamentally in the two pathways.

Representation of Semantic Similarity in the Left Intraparietal Sulcus: Functional Magnetic Resonance Imaging Evidence

According to a recent study, semantic similarity between concrete entities correlates with the similarity of activity patterns in left middle IPS during category naming. We examined the replicability of this effect under passive viewing conditions, the potential role of visuoperceptual similarity, where the effect is situated compared to regions that have been previously implicated in visuospatial attention, and how it compares to effects of object identity and location. Forty-six subjects participated. Subjects passively viewed pictures from two categories, musical instruments and vehicles. Semantic similarity between entities was estimated based on a concept-feature matrix obtained in more than 1,000 subjects. Visuoperceptual similarity was modeled based on the HMAX model, the AlexNet deep convolutional learning model, and thirdly, based on subjective visuoperceptual similarity ratings. Among the IPS regions examined, only left middle IPS showed a semantic similarity effect. The effect was significant in hIP1, hIP2, and hIP3. Visuoperceptual similarity did not correlate with similarity of activity patterns in left middle IPS. The semantic similarity effect in left middle IPS was significantly stronger than in the right middle IPS and also stronger than in the left or right posterior IPS. The semantic similarity effect was similar to that seen in the angular gyrus. Object identity effects were much more widespread across nearly all parietal areas examined. Location effects were relatively specific for posterior IPS and area 7 bilaterally. To conclude, the current findings replicate the semantic similarity effect in left middle IPS under passive viewing conditions, and demonstrate its anatomical specificity within a cytoarchitectonic reference frame. We propose that the semantic similarity effect in left middle IPS reflects the transient uploading of semantic representations in working memory.

Vision and Action

Investigation of natural behavior has contributed a number of insights to our understanding of visual guidance of actions by highlighting the importance of behavioral goals and focusing attention on how vision and action play out in time. In this context, humans make continuous sequences of sensory-motor decisions to satisfy current behavioral goals, and the role of vision is to provide the relevant information for making good decisions in order to achieve those goals. This conceptualization of visually guided actions as a sequence of sensory-motor decisions has been formalized within the framework of statistical decision theory, which structures the problem and provides the context for much recent progress in vision and action. Components of a good decision include the task, which defines the behavioral goals, the rewards and costs associated with those goals, uncertainty about the state of the world, and prior knowledge.