Attention to Form or Surface Properties Modulates Different Regions of Human Occipitotemporal Cortex

Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions

Everyday interactions with common manipulable objects require the integration of conceptual knowledge about objects and actions with real-time sensory information about the position, orientation and volumetric structure of the grasp target. The ability to successfully interact with everyday objects involves analysis of visual form and shape, surface texture, material properties, conceptual attributes such as identity, function and typical context, and visuomotor processing supporting hand transport, grasp form, and object manipulation. Functionally separable brain regions across the dorsal and ventral visual pathways support the processing of these different object properties and, in cohort, are necessary for functional object use. Object-directed grasps display end-state-comfort: they anticipate in form and force the shape and material properties of the grasp target, and how the object will be manipulated after it is grasped. End-state-comfort is the default for everyday interactions with manipulable objects and implies integration of information across the ventral and dorsal visual pathways. We propose a model of how visuomotor and action representations in parietal cortex interact with object representations in ventral and lateral occipito-temporal cortex. One pathway, from the supramarginal gyrus to the middle and inferior temporal gyrus, supports the integration of action-related information, including hand and limb position (supramarginal gyrus) with conceptual attributes and an appreciation of the action goal (middle temporal gyrus). A second pathway, from posterior IPS to the fusiform gyrus and collateral sulcus supports the integration of grasp parameters (IPS) with the surface texture and material properties (e.g., weight distribution) of the grasp target. Reciprocal interactions among these regions are part of a broader network of regions that support everyday functional object interactions.

An embarrassment of richnesses: the PFC isn't the content NCC

Recent years have seen the rise of several theories saying that the prefrontal cortex (PFC) is a neural correlate of visual consciousness (NCC). Especially popular here are theories saying that the PFC is the 'content NCC' for vision, i.e. it contains those brain areas that are not only necessary for consciousness, but also determine 'what' it is that we visually experience (e.g. whether we experience green or red). This article points out how this "upper-deck" form of PFC theory is at odds with the character of visual experience: on the one hand, visual consciousness appears to contain copious amounts of content, with many properties (such as object, shape, or color) being simultaneously represented in many parts of the visual field. On the other hand, the functions that the PFC carries out (e.g. attention and working memory) are each dedicated to processing only a relatively small subset of available visual stimuli. In short, the PFC probably does not produce enough or the right kind of visual representations for it to supply all of the content found in visual experience, in which case the idea that the PFC is the content NCC for vision is probably false. This article also discusses data thought to undercut the idea that visual experience is informationally rich (inattentional blindness, etc.), along with theories of vision according to which "ensemble statistics" are used to represent features in the periphery of the visual field. I'll argue that these lines of evidence fail to close the apparently vast gap between the amount of visual content represented in the visual experience and the amount represented in the PFC.

Trypophobia, skin disease, and the visual discomfort of natural textures

In the last decade, the behavioral sciences have described the phenomenon of trypophobia, which is the discomfort felt by some individuals when viewing images containing clusters of bumps or holes. One evolutionary hypothesis for this phenomenon is that this visual discomfort represents an adaptation which helps organisms avoid skin disease and/or ectoparasites. Even though trypophobic imagery and disease imagery are both examples of visual textures, to date there has been no comparison of the visual discomfort elicited by these two specific kinds of textures within the larger context of the visual comfort elicited by natural texture imagery more generally. In the present study, we administered the Trypophobia Questionnaire (TQ) and recorded the visual comfort ratings elicited by a large set of standard natural texture images, including several trypophobic and skin disease images. In two independent samples, we found that while all observers find skin diseases uncomfortable to view, only those scoring high on the TQ rated trypophobic imagery equally uncomfortable. Comparable effects were observed using both standard ANOVA procedures as well as linear mixed effects modeling. Comparing the ratings of both high-TQ and low-TQ participants to the standard textures, we find remarkably consistent rank-order preferences, with the most unpleasant textures (as rated by both groups) exhibiting qualitative similarities to trypophobic imagery. However, we also find that low-level image statistics which have been previously shown to affect visual comfort are poor predictors of the visual comfort elicited by natural textures, including trypophobic and disease imagery. Our results suggest that a full understanding of the visual comfort elicited by natural textures, including those arising from skin disease, will ultimately depend upon a better understanding of cortical areas specialized for the perception of surface and material properties, and how these visual regions interact with emotional brain areas to evoke appropriate behavioral responses, like disgust.

Cortical thickness moderates intraindividual variability in prefrontal cortex activation patterns of older adults during walking

OBJECTIVE

Increased intraindividual variability (IIV) in behavioral and cognitive performance is a risk factor for adverse outcomes but research concerning hemodynamic signal IIV is limited. Cortical thinning occurs during aging and is associated with cognitive decline. Dual-task walking (DTW) performance in older adults has been related to cognition and neural integrity. We examined the hypothesis that reduced cortical thickness would be associated with greater increases in IIV in prefrontal cortex oxygenated hemoglobin (HbO2) from single tasks to DTW in healthy older adults while adjusting for behavioral performance.

METHOD

Participants were 55 healthy community-dwelling older adults (mean age = 74.84, standard deviation (SD) = 4.97). Structural MRI was used to quantify cortical thickness. Functional near-infrared spectroscopy (fNIRS) was used to assess changes in prefrontal cortex HbO2 during walking. HbO2 IIV was operationalized as the SD of HbO2 observations assessed during the first 30 seconds of each task. Linear mixed models were used to examine the moderation effect of cortical thickness throughout the cortex on HbO2 IIV across task conditions.

RESULTS

Analyses revealed that thinner cortex in several regions was associated with greater increases in HbO2 IIV from the single tasks to DTW (ps < .02).

CONCLUSIONS

Consistent with neural inefficiency, reduced cortical thickness in the PFC and throughout the cerebral cortex was associated with increases in HbO2 IIV from the single tasks to DTW without behavioral benefit. Reduced cortical thickness and greater IIV of prefrontal cortex HbO2 during DTW may be further investigated as risk factors for developing mobility impairments in aging.

The role of visual working memory in capacity-limited cross-modal ensemble coding

Ensemble coding refers to the brain's ability to rapidly extract summary statistics, such as average size and average cost, from a large set of visual stimuli. Although ensemble coding is thought to circumvent a capacity limit of visual working memory, we recently observed a VWM-like capacity limit in an ensemble task where observers extracted the average sweetness of groups of food pictures (i.e., they could only integrate information from four out of six available items), thus suggesting the involvement of VWM in this novel form of cross-modal ensemble coding. Therefore, across two experiments we investigated if this cross-modal ensemble capacity limit could be explained by individual differences in VWM processing. To test this, observers performed both an ensemble task and a VWM task, and we determined 1) how much information they integrated into their ensemble percepts, and 2) how much information they remembered from those displays. Interestingly, we found that individual differences in VWM capacity did not explain differences in performance on the ensemble coding task (i.e., high-capacity individuals did not have significantly higher "ensemble abilities" than low-capacity individuals). While our data cannot definitively state whether or not VWM is necessary to perform the ensemble task, we conclude that it is certainly not sufficient to support this cognitive process. We speculate that the capacity limit may be explained by 1) a bottleneck at the perceptual stage (i.e., a failure to process multiple visual features across multiple items, as there are no singular features that convey taste), or 2) the interaction of multiple cognitive systems (e.g., VWM, gustatory working memory, long term memory). Our results highlight the importance of examining ensemble perception across multiple sensory and cognitive domains to provide a clearer picture of the mechanisms underlying everyday behavior.

Sustainable materials: a linking bridge between material perception, affordance, and aesthetics

The perception of material properties, which refers to the way in which individuals perceive and interpret materials through their sensory experiences, plays a crucial role in our interaction with the environment. Affordance, on the other hand, refers to the potential actions and uses that materials offer to users. In turn, the perception of the affordances is modulated by the aesthetic appreciation that individuals experience when interacting with the environment. Although material perception, affordances, and aesthetic appreciation are recognized as essential to fostering sustainability in society, only a few studies have investigated this subject matter systematically and their reciprocal influences. This scarcity is partially due to the challenges offered by the complexity of combining interdisciplinary topics that explore interactions between various disciplines, such as psychophysics, neurophysiology, affective science, aesthetics, and social and environmental sciences. Outlining the main findings across disciplines, this review highlights the pivotal role of material perception in shaping sustainable behaviors. It establishes connections between material perception, affordance, aesthetics, and sustainability, emphasizing the need for interdisciplinary research and integrated approaches in environmental psychology. This integration is essential as it can provide insight into how to foster sustainable and durable changes.

Repulsive Aftereffects of Visual Space

Prolonged exposure to a sensory stimulus induces perceptual adaptation aftereffects. Traditionally, aftereffects are known to change the appearance of stimulus features, like contrast, color, or shape. However, shifts in the spatial position of objects have also been observed to follow adaptation. Here, I demonstrate that visual adaptation produced by different adapter stimuli generates a bi-directional spatial repulsion. Observers had to judge the distance between a probe dot pair presented in the adapted region and compare them to a reference dot pair presented in a region not affected by adaptation. If the probe dot pair was present inside the adapted area, observers underestimated the distance. If, however, the dot pair straddled the adapted area, the distance was perceived as larger with a stronger distance expansion than compression. Bi-directional spatial repulsion was found with a similar magnitude for size and density adapters. Localization estimates with mouse pointing revealed that adaptation also affected absolute position judgments. Bi-directional spatial repulsion is most likely produced by the lines of adapter stimuli since single bars used as adapters were sufficient to induce spatial repulsion. Spatial repulsion was stronger for stimuli presented in the periphery. This finding explains why distance expansion is stronger than distance compression.

A review of the impairments, preserved visual functions, and neuropathology in 21 patients with visual form agnosia - A unique defect with line drawings

We present a comprehensive review of the rare syndrome visual form agnosia (VFA). We begin by documenting its history, including the origins of the term, and the first case study labelled as VFA. The defining characteristics of the syndrome, as others have previously defined it, are then described. The impairments, preserved aspects of visual perception, and areas of brain damage in 21 patients who meet these defining characteristics are described in detail, including which tests were used to verify the presence or absence of key symptoms. From this, we note important similarities along with notable areas of divergence between patients. Damage to the occipital lobe (20/21), an inability to recognise line drawings (19/21), preserved colour vision (14/21), and visual field defects (16/21) were areas of consistency across most cases. We found it useful to distinguish between shape and form as distinct constructs when examining perceptual abilities in VFA patients. Our observations suggest that these patients often exhibit difficulties in processing simplified versions of form. Deficits in processing orientation and size were uncommon. Motion perception and visual imagery were not widely tested for despite being typically cited as defining features of the syndrome - although in the sample described, motion perception was never found to be a deficit. Moreover, problems with vision (e.g., poor visual acuity and the presence of hemianopias/scotomas in the visual fields) are more common than we would have thought and may also contribute to perceptual impairments in patients with VFA. We conclude that VFA is a perceptual disorder where the visual system has a reduced ability to synthesise lines together for the purposes of making sense of what images represent holistically.

Decoding individual differences in self-prioritization from the resting-state functional connectome

Although the self has traditionally been viewed as a higher-order mental function by most theoretical frameworks, recent research advocates a fundamental self hypothesis, viewing the self as a baseline function of the brain embedded within its spontaneous activities, which dynamically regulates cognitive processing and subsequently guides behavior. Understanding this fundamental self hypothesis can reveal where self-biased behaviors emerge and to what extent brain signals at rest can predict such biased behaviors. To test this hypothesis, we investigated the association between spontaneous neural connectivity and robust self-bias in a perceptual matching task using resting-state functional magnetic resonance imaging (fMRI) in 348 young participants. By decoding whole-brain connectivity patterns, the support vector regression model produced the best predictions of the magnitude of self-bias in behavior, which was evaluated via a nested cross-validation procedure. The out-of-sample generalizability was further authenticated using an external dataset of older adults. The functional connectivity results demonstrated that self-biased behavior was associated with distinct connections between the default mode, cognitive control, and salience networks. Consensus network and computational lesion analyses further revealed contributing regions distributed across six networks, extending to additional nodes, such as the thalamus, whose role in self-related processing remained unclear. These results provide evidence that self-biased behavior derives from spontaneous neural connectivity, supporting the fundamental self hypothesis. Thus, we propose an integrated neural network model of this fundamental self that synthesizes previous theoretical models and portrays the brain mechanisms by which the self emerges at rest internally and regulates responses to the external environment.

Taxonomic and thematic relations rely on different types of semantic features: Evidence from an fMRI meta-analysis and a semantic priming study

Taxonomic and thematic relations are major components of semantic representation but their neurocognitive underpinnings are still debated. We hypothesised that taxonomic relations preferentially activate parts of anterior temporal lobe (ATL) because they rely more on colour and shape features, while thematic relations preferentially activate temporoparietal cortex (TPC) because they rely more on action and location knowledge. We first conducted activation likelihood estimation (ALE) meta-analysis to assess evidence for neural specialisation in the existing fMRI literature (Study 1), then used a primed semantic judgement task to examine if the two relations are primed by different feature types (Study 2). We find that taxonomic relations show minimal feature-based specialisation but preferentially activate the lingual gyrus. Thematic relations are more dependent on action and location features and preferentially engage TPC. The meta-analysis also showed that lateral ATL is preferentially engaged by Thematic relations, which may reflect their greater reliance on verbal associations.

Similar object shape representation encoded in the inferolateral occipitotemporal cortex of sighted and early blind people

We can sense an object's shape by vision or touch. Previous studies suggested that the inferolateral occipitotemporal cortex (ILOTC) implements supramodal shape representations as it responds more to seeing or touching objects than shapeless textures. However, such activation in the anterior portion of the ventral visual pathway could be due to the conceptual representation of an object or visual imagery triggered by touching an object. We addressed these possibilities by directly comparing shape and conceptual representations of objects in early blind (who lack visual experience/imagery) and sighted participants. We found that bilateral ILOTC in both groups showed stronger activation during a shape verification task than during a conceptual verification task made on the names of the same manmade objects. Moreover, the distributed activity in the ILOTC encoded shape similarity but not conceptual association among objects. Besides the ILOTC, we also found shape representation in both groups' bilateral ventral premotor cortices and intraparietal sulcus (IPS), a frontoparietal circuit relating to object grasping and haptic processing. In contrast, the conceptual verification task activated both groups' left perisylvian brain network relating to language processing and, interestingly, the cuneus in early blind participants only. The ILOTC had stronger functional connectivity to the frontoparietal circuit than to the left perisylvian network, forming a modular structure specialized in shape representation. Our results conclusively support that the ILOTC selectively implements shape representation independently of visual experience, and this unique functionality likely comes from its privileged connection to the frontoparietal haptic circuit.

Spikiness and animacy as potential organizing principles of human ventral visual cortex

Considerable research has been devoted to understanding the fundamental organizing principles of the ventral visual pathway. A recent study revealed a series of 3-4 topographical maps arranged along the macaque inferotemporal (IT) cortex. The maps articulated a two-dimensional space based on the spikiness and animacy of visual objects, with "inanimate-spiky" and "inanimate-stubby" regions of the maps constituting two previously unidentified cortical networks. The goal of our study was to determine whether a similar functional organization might exist in human IT. To address this question, we presented the same object stimuli and images from "classic" object categories (bodies, faces, houses) to humans while recording fMRI activity at 7 Tesla. Contrasts designed to reveal the spikiness-animacy object space evoked extensive significant activation across human IT. However, unlike the macaque, we did not observe a clear sequence of complete maps, and selectivity for the spikiness-animacy space was deeply and mutually entangled with category-selectivity. Instead, we observed multiple new stimulus preferences in category-selective regions, including functional sub-structure related to object spikiness in scene-selective cortex. Taken together, these findings highlight spikiness as a promising organizing principle of human IT and provide new insights into the role of category-selective regions in visual object processing.

Towards imaging the infant brain at play

Infants' first-person experiences are crucial to early cognitive and neural development. To a vast extent, these early experiences involve play, which in infancy takes the form of object exploration. While at the behavioral level infant play has been studied both using specific tasks and in naturalistic scenarios, the neural correlates of object exploration have largely been studied in highly controlled task settings. These neuroimaging studies did not tap into the complexities of everyday play and what makes object exploration so important for development. Here, we review selected infant neuroimaging studies, spanning from typical, highly controlled screen-based studies on object perception to more naturalistic designs and argue for the importance of studying the neural correlates of key behaviors such as object exploration and language comprehension in naturalistic settings. We suggest that the advances in technology and analytic approaches allow measuring the infant brain at play with the use of functional near-infrared spectroscopy (fNIRS). Naturalistic fNIRS studies offer a new and exciting avenue to studying infant neurocognitive development in a way that will draw us away from our laboratory constructs and into an infant's everyday experiences that support their development.

Uncovering the fast, directional signal flow through the human temporal pole during semantic processing

The temporal pole (TP) plays a central role in semantic memory, yet its neural machinery is unknown. Intracerebral recordings in patients discriminating visually the gender or actions of an actor, yielded gender discrimination responses in the ventrolateral (VL) and tip (T) regions of right TP. Granger causality revealed task-specific signals travelling first forward from VL to T, under control of orbitofrontal cortex (OFC) and neighboring prefrontal cortex, and then, strongly, backwards from T to VL. Many other cortical regions provided inputs to or received outputs from both TP regions, often with longer delays, with ventral temporal afferents to VL signaling the actor's physical appearance. The TP response timing reflected more that of the connections to VL, controlled by OFC, than that of the input leads themselves. Thus, visual evidence for gender categories, collected by VL, activates category labels in T, and consequently, category features in VL, indicating a two-stage representation of semantic categories in TP.

Visuo-haptic object perception for robots: an overview

The object perception capabilities of humans are impressive, and this becomes even more evident when trying to develop solutions with a similar proficiency in autonomous robots. While there have been notable advancements in the technologies for artificial vision and touch, the effective integration of these two sensory modalities in robotic applications still needs to be improved, and several open challenges exist. Taking inspiration from how humans combine visual and haptic perception to perceive object properties and drive the execution of manual tasks, this article summarises the current state of the art of visuo-haptic object perception in robots. Firstly, the biological basis of human multimodal object perception is outlined. Then, the latest advances in sensing technologies and data collection strategies for robots are discussed. Next, an overview of the main computational techniques is presented, highlighting the main challenges of multimodal machine learning and presenting a few representative articles in the areas of robotic object recognition, peripersonal space representation and manipulation. Finally, informed by the latest advancements and open challenges, this article outlines promising new research directions.

Disentangling hand and tool processing: Distal effects of neuromodulation

Neural processing within a local brain region that responds to more than one object category (e.g., hands and tools) nonetheless have different functional connectivity patterns with other distal brain areas, which suggests that local processing can affect and/or be affected by processing in distal areas, in a category-specific way. Here we wanted to test whether administering either a hand- or tool-related training task in tandem with transcranial direct current stimulation (tDCS) to a region that responds both to hands and tools (posterior middle temporal gyrus; pMTG), modulated local and distal neural processing more for the trained than the untrained category in a subsequent fMRI task. After each combined tDCS/training session, participants viewed images of tools, hands, and animals, in an fMRI scanner. Using multivoxel pattern analysis, we found that tDCS stimulation to pMTG indeed improved the classification accuracy between tools vs. animals, but only when combined with a tool and not a hand training task. Surprisingly, tDCS stimulation to pMTG also improved classification accuracy between hands vs. animals when combined with a tool but not a hand training task. Our findings suggest that overlapping but functionally-specific networks may be engaged separately by using a category-specific training task together with tDCS - a strategy that can be applied more broadly to other cognitive domains using tDCS. By hypothesis, these effects on local processing are a direct result of within-domain connectivity constraints from domain-specific networks that are at play in the processing and organization of object representations.

The complexity of spontaneous brain activity changes in schizophrenia, bipolar disorder, and ADHD was examined using different variations of entropy

Adult attention deficit/hyperactivity disorder (ADHD), schizophrenia (SCHZ), and bipolar disorder (BP) have common symptoms and differences, and the underlying neural mechanisms are still unclear. This article will thoroughly discuss the differences between ADHD, BP, and SCHZ (31 healthy control and 31 ADHD; 34 healthy control and 34 BP; 42 healthy control and 42 SCHZ) relative to healthy subjects in combination with three atlases (et al., the Brainnetome atlas, the Dosenbach atlas, the Power atlas) and seven entropies (et al., approximate entropy (ApEn), sample entropy (SaEn), permutation entropy (PeEn), fuzzy entropy (FuEn), differential entropy (DiffEn), range entropy (RaEn), and dispersion entropy (DispEn)), as well as the prominent significant brain regions, in the hope of giving information that is more suitable for analyzing different diseases' entropy. First, the reliability (et al., intraclass correlation coefficient [ICC]) of seven kinds of entropy is calculated and analyzed by using the MSC dataset (10 subjects and 100 sessions in total) and simulation data; then, seven types of entropy and multiscale entropy expanded based on seven kinds of entropy are used to explore the differences and brain regions of ADHD, BP, and SCHZ relative to healthy subjects; and finally, by verifying the classification performance of the seven information entropies on ADHD, BP, and SCHZ, the effectiveness of the seven entropy methods is evaluated through these three methods. The core brain regions that affect the classification are given, and DiffEn performed best on ADHD, SaEn for BP, and RaEn for SCHZ.

The representation of shape and texture in category-selective regions of ventral-temporal cortex

Neuroimaging studies using univariate and multivariate approaches have shown that the fusiform face area (FFA) and parahippocampal place area (PPA) respond selectively to images of faces and places. The aim of this study was to determine the extent to which this selectivity to faces or places is based on the shape or texture properties of the images. Faces and houses were filtered to manipulate their texture properties, while preserving the shape properties (spatial envelope) of the images. In Experiment 1, multivariate pattern analysis (MVPA) showed that patterns of fMRI response to faces and houses in FFA and PPA were predicted by the shape properties, but not by the texture properties of the image. In Experiment 2, a univariate analysis (fMR‐adaptation) showed that responses in the FFA and PPA were sensitive to changes in both the shape and texture properties of the image. These findings can be explained by the spatial scale of the representation of images in the FFA and PPA. At a coarser scale (revealed by MVPA), the neural selectivity to faces and houses is sensitive to variation in the shape properties of the image. However, at a finer scale (revealed by fMR‐adaptation), the neural selectivity is sensitive to the texture properties of the image. By combining these neuroimaging paradigms, our results provide insights into the spatial scale of the neural representation of faces and places in the ventral‐temporal cortex.

Domain-specific connectivity drives the organization of object knowledge in the brain

The goal of this chapter is to review neuropsychological and functional MRI findings that inform a theory of the causes of functional specialization for semantic categories within occipito-temporal cortex-the ventral visual processing pathway. The occipito-temporal pathway supports visual object processing and recognition. The theoretical framework that drives this review considers visual object recognition through the lens of how "downstream" systems interact with the outputs of visual recognition processes. Those downstream processes include conceptual interpretation, grasping and object use, navigating and orienting in an environment, physical reasoning about the world, and inferring future actions and the inner mental states of agents. The core argument of this chapter is that innately constrained connectivity between occipito-temporal areas and other regions of the brain is the basis for the emergence of neural specificity for a limited number of semantic domains in the brain.

Two 'what' pathways for action and object recognition

The ventral visual stream is conceived as a pathway for object recognition. However, we also recognize the actions an object can be involved in. Here, we show that action recognition critically depends on a pathway in lateral occipitotemporal cortex, partially overlapping and topographically aligned with object representations that are precursors for action recognition. By contrast, object features that are more relevant for object recognition, such as color and texture, are typically found in ventral occipitotemporal cortex. We argue that occipitotemporal cortex contains similarly organized lateral and ventral 'what' pathways for action and object recognition, respectively. This account explains a number of observed phenomena, such as the duplication of object domains and the specific representational profiles in lateral and ventral cortex.

The Ties that Bind: Agnosia, Neglect and Selective Attention to Visual Scale

PURPOSE OF REVIEW

Historical and contemporary treatments of visual agnosia and neglect regard these disorders as largely unrelated. It is thought that damage to different neural processes leads directly to one or the other condition, yet apperceptive variants of agnosia and object-centered variants of neglect share remarkably similar deficits in the quality of conscious experience. Here we argue for a closer association between "apperceptive" variants of visual agnosia and "object-centered" variants of visual neglect. We introduce a theoretical framework for understanding these conditions based on "scale attention", which refers to selecting boundary and surface information at different levels of the structural hierarchy in the visual array.

RECENT FINDINGS

We review work on visual agnosia, the cortical structures and cortico-cortical pathways that underlie visual perception, visuospatial neglect and object-centered neglect, and attention to scale. We highlight direct and indirect pathways involved in these disorders and in attention to scale. The direct pathway involves the posterior vertical segments of the superior longitudinal fasciculus that are positioned to link the established dorsal and ventral attentional centers in the parietal cortex with structures in the inferior occipitotemporal cortex associated with visual apperceptive agnosia. The connections in the right hemisphere appear to be more important for visual conscious experience, whereas those in the left hemisphere appear to be more strongly associated with the planning and execution of visually guided grasps directed at multi-part objects such as tools. In the latter case, semantic and functional information must drive the selection of the appropriate hand posture and grasp points on the object. This view is supported by studies of grasping in patients with agnosia and in patients with neglect that show that the selection of grasp points when picking up a tool involves both scale attention and semantic contributions from inferotemporal cortex. The indirect pathways, which include the inferior fronto-occipital and horizontal components of the superior longitudinal fasciculi, involve the frontal lobe, working memory and the "multiple demands" network, which can shape the content of visual awareness through the maintenance of goal- and task-based abstractions and their influence on scale attention. Recent studies of human cortico-cortical pathways necessitate revisions to long-standing theoretical views on visual perception, visually guided action and their integrations. We highlight findings from a broad sample of seemingly disparate areas of research to support the proposal that attention to scale is necessary for typical conscious visual experience and for goal-directed actions that depend on functional and semantic information. Furthermore, we suggest that vertical pathways between the parietal and occipitotemporal cortex, along with indirect pathways that involve the premotor and prefrontal cortex, facilitate the operations of scale attention.

Conceptual representation of real-world surface material: Early integration with linguistic-labels indicated in the N400-component

Research in perception in the visual and auditory domains has traditionally focused on investigating highly controlled artificial stimulus material. However, a key feature of our perceptual system is the ease with which the input of a wide set of naturalistic co-occurring information is dealt with. This study investigated whether, during perception of real-world surface material, a conceptual representation is built that has the potential to interact with a linguistic description of the material directly. Short sentences were presented (e.g., This surface is smooth) followed by a matching or mismatching picture of a real-world surface material. The results showed early cross-modal integration effects during material surface perception in an N400-like potential, originating approximately 280 ms after stimulus presentation. Overall, these findings suggest a rather early influence of linguistic information on material perception, suggesting that in line with object representation, real-world materials are represented in the brain in a format that allows interaction with non-visual information.

Shared cognitive mechanisms involved in the processing of scene texture and scene shape

Recent research has demonstrated that the parahippocampal place area represents both the shape and texture features of scenes, with the importance of each feature varying according to perceived scene category. Namely, shape features are predominately more diagnostic to the processing of artificial human–made scenes, while shape and texture are equally diagnostic in natural scene processing. However, to date little is known regarding the degree of interactivity or independence observed in the processing of these scene features. Furthermore, manipulating the scope of visual attention (i.e., globally vs. locally) when processing ensembles of multiple objects—stimuli that share a functional neuroanatomical link with scenes—has been shown to affect their cognitive visual representation. It remains unknown whether manipulating the scope of attention impacts scene processing in a similar manner. Using the well-established Garner speeded-classification behavioral paradigm, we investigated the influence of both feature diagnosticity and the scope of visual attention on potential interactivity or independence in the shape and texture processing of artificial human–made scenes. The results revealed asymmetric interference between scene shape and texture processing, with the more diagnostic feature (i.e., shape) interfering with the less diagnostic feature (i.e., texture), but not vice versa. Furthermore, this interference was attenuated and enhanced with more local and global visual processing strategies, respectively. These findings suggest that the scene shape and texture processing are mediated by shared cognitive mechanisms and that, although these representations are governed primarily via feature diagnosticity, they can nevertheless be influenced by the scope of visual attention.

Prefrontal cortex activation during dual-task walking in older adults is moderated by thickness of several cortical regions

Dual tasking, a defined facet of executive control processes, is subserved, in part, by the prefrontal cortex (PFC). Previous functional near-infrared spectroscopy (fNIRS) studies revealed elevated PFC oxygenated hemoglobin (HbO₂) under Dual-Task-Walk (DTW) compared to Single-Task Walk (STW) conditions. Based on the concept of neural inefficiency (i.e., greater activation coupled with similar or worse performance), we hypothesized that decreased cortical thickness across multiple brain regions would be associated with greater HbO₂ increases from STW to DTW. Participants were 55 healthy community-dwelling older adults, whose cortical thickness was measured via MRI. HbO₂ levels in the PFC, measured via fNIRS, were assessed during active walking under STW and DTW conditions. Statistical analyses were adjusted for demographics and behavioral performance. Linear mixed-effects models revealed that the increase in HbO₂ from STW to DTW was moderated by cortical thickness in several regions. Specifically, thinner cortex in specific regions of the frontal, parietal, temporal, and occipital lobes, cingulate cortex, and insula was associated with greater increases in HbO₂ levels from single to dual-task walking. In conclusion, participants with thinner cortex in regions implicated in higher order control of walking employed greater neural resources, as measured by increased HbO₂, in the PFC during DTW, without demonstrating benefits to behavioral performance. To our knowledge, this is the first study to examine cortical thickness as a marker of neural inefficiency during active walking.

Visual texture agnosia caused by bilateral posterior cerebral artery stroke: a case study

A 57-year-old man presented with a bilateral posterior cerebral artery attack and was visually impaired. He had a hard time identifying familiar faces and shades. He also felt that the familiar building looked different, and complained that it was not possible to tell from visual information alone whether the food was cooked or the kimono fabric was soft.We assessed the patient's visual function using real materials and material images and was diagnosed with visual texture agnosia. There are few reports of visual texture agnosia, detailed evaluation is considered important because perceiving texture is important for activities of daily living.

Overlapping but distinct: Distal connectivity dissociates hand and tool processing networks

The processes and organizational principles of information involved in object recognition have been a subject of intense debate. These research efforts led to the understanding that local computations and feedforward/feedback connections are essential to our representations and their organization. Recent data, however, has demonstrated that distal computations also play a role in how information is locally processed. Here we focus on how long-range connectivity and local functional organization of information are related, by exploring regions that show overlapping category-preferences for two categories and testing whether their connections are related with distal representations in a category-specific way. We used an approach that relates functional connectivity with distal areas to local voxel-wise category-preferences. Specifically, we focused on two areas that show an overlap in category-preferences for tools and hands-the inferior parietal lobule/anterior intraparietal sulcus (IPL/aIPS) and the posterior middle temporal gyrus/lateral occipital temporal cortex (pMTG/LOTC) - and how connectivity from these two areas relate to voxel-wise category-preferences in two ventral temporal regions dedicated to the processing of tools and hands separately-the left medial fusiform gyrus and the fusiform body area respectively-as well as across the brain. We show that the functional connections of the two overlap areas correlate with categorical preferences for each category independently. These results show that regions that process both tools and hands maintain object topography in a category-specific way. This potentially allows for a category-specific flow of information that is pertinent to computing object representations.

The effect of visual distractors on visual working memory for surface roughness in the human brain

Research has confirmed that the visual working memory representation of objects' roughness is robust against illumination changes in the human ventral visual cortex and intraparietal sulcus, but not yet against visual distractors during memory maintenance. Thus, this study investigated the effects of visual distractors on roughness-related brain regions during the maintenance phase using multi-voxel pattern analysis (MVPA). We conducted an fMRI experiment in which participants were asked to memorize a sphere's roughness against visual distractors, presented during the delay period in random trials. Region of interest-based MVPA showed no contribution of the ventral visual cortex and intraparietal sulcus to the roughness memory, regardless of behavioral performance. Post hoc searchlight MVPA revealed an above-chance decoding performance level in the brain regions presumably related to haptic processing when no visual distractors were shown. In contrast, when visual distractors appeared in the delay period, decoding performance exceeded the chance level in the ventral visual cortex. These results suggest that when visual distractors are presented during the memory phase, both visual and haptic processing are related to visual working memory for roughness, and the weighting of modality changes depending on the presence of visual distractors.

Human brain activity reflecting facial attractiveness from skin reflection

Facial attraction has a great influence on our daily social interactions. Previous studies have mainly focused on the attraction from facial shape and expression. We recently found that faces with radiant skin appear to be more attractive than those with oily-shiny or matte skin. In the present study, we conducted functional magnetic resonance imaging (fMRI) and psychological experiments to determine the human brain activity that reflects facial attractiveness modulated by these skin reflection types. In the fMRI experiment, female subjects were shown successive images of unfamiliar female faces with matte, oily-shiny, or radiant skin. The subjects compared each face with the immediately preceding face in terms of attractiveness, age, and skin reflection, all based on the skin. The medial part of the orbitofrontal cortex (mOFC) was significantly more active when comparing attractiveness than when comparing skin reflection, suggesting that the mOFC is involved in processing facial attractiveness from skin reflection. In the psychological experiment, attractiveness rating was highest for radiant skin, followed by oily-shiny, and then matte skin. Comparison of the results of these experiments showed that mOFC activation level increased with attractiveness rating. These results suggest that the activation level of the mOFC reflects facial attractiveness from skin reflection.

Dynamic dot displays reveal material motion network in the human brain

There is growing research interest in the neural mechanisms underlying the recognition of material categories and properties. This research field, however, is relatively more recent and limited compared to investigations of the neural mechanisms underlying object and scene category recognition. Motion is particularly important for the perception of non-rigid materials, but the neural basis of non-rigid material motion remains unexplored. Using fMRI, we investigated which brain regions respond preferentially to material motion versus other types of motion. We introduce a new database of stimuli - dynamic dot materials - that are animations of moving dots that induce vivid percepts of various materials in motion, e.g. flapping cloth, liquid waves, wobbling jelly. Control stimuli were scrambled versions of these same animations and rigid three-dimensional rotating dots. Results showed that isolating material motion properties with dynamic dots (in contrast with other kinds of motion) activates a network of cortical regions in both ventral and dorsal visual pathways, including areas normally associated with the processing of surface properties and shape, and extending to somatosensory and premotor cortices. We suggest that such a widespread preference for material motion is due to strong associations between stimulus properties. For example viewing dots moving in a specific pattern not only elicits percepts of material motion; one perceives a flexible, non-rigid shape, identifies the object as a cloth flapping in the wind, infers the object's weight under gravity, and anticipates how it would feel to reach out and touch the material. These results are a first important step in mapping out the cortical architecture and dynamics in material-related motion processing.

Causal Evidence for a Double Dissociation between Object- and Scene-Selective Regions of Visual Cortex: A Preregistered TMS Replication Study

Natural scenes are characterized by individual objects as well as by global scene properties such as spatial layout. Functional neuroimaging research has shown that this distinction between object and scene processing is one of the main organizing principles of human high-level visual cortex. For example, object-selective regions, including the lateral occipital complex (LOC), were shown to represent object content (but not scene layout), while scene-selective regions, including the occipital place area (OPA), were shown to represent scene layout (but not object content). Causal evidence for a double dissociation between LOC and OPA in representing objects and scenes is currently limited, however. One TMS experiment, conducted in a relatively small sample (N = 13), reported an interaction between LOC and OPA stimulation and object and scene recognition performance (Dilks et al., 2013). Here, we present a high-powered preregistered replication of this study (N = 72, including male and female human participants), using group-average fMRI coordinates to target LOC and OPA. Results revealed unambiguous evidence for a double dissociation between LOC and OPA: relative to vertex stimulation, TMS over LOC selectively impaired the recognition of objects, while TMS over OPA selectively impaired the recognition of scenes. Furthermore, we found that these effects were stable over time and consistent across individual objects and scenes. These results show that LOC and OPA can be reliably and selectively targeted with TMS, even when defined based on group-average fMRI coordinates. More generally, they support the distinction between object and scene processing as an organizing principle of human high-level visual cortex.SIGNIFICANCE STATEMENT Our daily-life environments are characterized both by individual objects and by global scene properties. The distinction between object and scene processing features prominently in visual cognitive neuroscience, with fMRI studies showing that this distinction is one of the main organizing principles of human high-level visual cortex. However, causal evidence for the selective involvement of object- and scene-selective regions in processing their preferred category is less conclusive. Here, testing a large sample (N = 72) using an established paradigm and a preregistered protocol, we found that TMS over object-selective cortex (lateral occipital complex) selectively impaired object recognition, while TMS over scene-selective cortex (occipital place area) selectively impaired scene recognition. These results provide strong causal evidence for the distinction between object and scene processing in human visual cortex.

Neural sources of letter and Vernier acuity

Visual acuity can be measured in many different ways, including with letters and Vernier offsets. Prior psychophysical work has suggested that the two acuities are strongly linked given that they both depend strongly on retinal eccentricity and both are similarly affected in amblyopia. Here we used high-density EEG recordings to ask whether the underlying neural sources are common as suggested by the psychophysics or distinct. To measure visual acuity for letters, we recorded evoked potentials to 3 Hz alternations between intact and scrambled text comprised of letters of varying size. To measure visual acuity for Vernier offsets, we recorded evoked potentials to 3 Hz alternations between bar gratings with and without a set of Vernier offsets. Both alternation types elicited robust activity at the 3 Hz stimulus frequency that scaled in amplitude with both letter and offset size, starting near threshold. Letter and Vernier offset responses differed in both their scalp topography and temporal dynamics. The earliest evoked responses to letters occurred on lateral occipital visual areas, predominantly over the left hemisphere. Later responses were measured at electrodes over early visual cortex, suggesting that letter structure is first extracted in second-tier extra-striate areas and that responses over early visual areas are due to feedback. Responses to Vernier offsets, by contrast, occurred first at medial occipital electrodes, with responses at later time-points being more broadly distributed—consistent with feedforward pathway mediation. The previously observed commonalities between letter and Vernier acuity may be due to common bottlenecks in early visual cortex but not because the two tasks are subserved by a common network of visual areas.

Shitsukan - the Multisensory Perception of Quality

We often estimate, or perceive, the quality of materials, surfaces, and objects, what the Japanese refer to as 'shitsukan', by means of several of our senses. The majority of the literature on shitsukan perception has, though, tended to focus on the unimodal visual evaluation of stimulus properties. In part, this presumably reflects the widespread hegemony of the visual in the modern era and, in part, is a result of the growing interest, not to mention the impressive advances, in digital rendering amongst the computer graphics community. Nevertheless, regardless of such an oculocentric bias in so much of the empirical literature, it is important to note that several other senses often do contribute to the impression of the material quality of surfaces, materials, and objects as experienced in the real world, rather than just in virtual reality. Understanding the multisensory contributions to the perception of material quality, especially when combined with computational and neural data, is likely to have implications for a number of fields of basic research as well as being applicable to emerging domains such as, for example, multisensory augmented retail, not to mention multisensory packaging design.

A parietal region processing numerosity of observed actions: An FMRI study

When observing others' behavior, it is important to perceive not only the identity of the observed actions (OAs), but also the number of times they were performed. Given the mounting evidence implicating posterior parietal cortex in action observation, and in particular that of manipulative actions, the aim of this study was to identify the parietal region, if any, that contributes to the processing of observed manipulative action (OMA) numerosity, using the functional magnetic resonance imaging technique. Twenty‐one right‐handed healthy volunteers performed two discrimination tasks while in the scanner, responding to video stimuli in which an actor performed manipulative actions on colored target balls that appeared four times consecutively. The subjects discriminated between two small numerosities of either OMAs (“Action” condition) or colors of balls (“Ball” condition). A significant difference between the “Action” and “Ball” conditions was observed in occipito‐temporal cortex and the putative human anterior intraparietal sulcus (phAIP) area as well as the third topographic map of numerosity‐selective neurons at the post‐central sulcus (NPC3) of the left parietal cortex. A further region of interest analysis of the group‐average data showed that at the single voxel level the latter area, more than any other parietal or occipito‐temporal numerosity map, favored numerosity of OAs. These results suggest that phAIP processes the identity of OMAs, while neighboring NPC3 likely processes the numerosity of the identified OAs.

Children prefer pattern over shape during complex categorization

Numerous studies have shown that children tend to view objects with similar shapes as having the same category. However, these studies often adopt simple categorization tasks and ignore the perceptual dimension (e.g., surface pattern of objects) that likely attract children's attention. The purpose of this study was to test how children categorize when pattern competes against shape. In Experiment 1a children were presented with a target and several testing objects that shared the same shape, color, or texture as the target. The results indicated that children preferentially selected the shape-sharing objects. However, when the texture was replaced by pattern (Experiment 1b), there was no significant difference between shape and pattern choices. When shared features were intricately overlapped between different pairs of stimuli (Experiment 2), children preferentially chose objects that shared patterns over those that shared shapes. These findings are the first to reveal children's pattern preference in categorization, supporting the view that children's categorization is flexible.

Structural Disconnection of the Tool Use Network after Left Hemisphere Stroke Predicts Limb Apraxia Severity

Producing a tool use gesture is a complex process drawing upon the integration of stored knowledge of tools and their associated actions with sensory-motor mechanisms supporting the planning and control of hand and arm actions. Understanding how sensory-motor systems in parietal cortex interface with semantic representations of actions and objects in the temporal lobe remains a critical issue and is hypothesized to be a key determinant of the severity of limb apraxia, a deficit in producing skilled action after left hemisphere stroke. We used voxel-based and connectome-based lesion-symptom mapping with data from 57 left hemisphere stroke participants to assess the lesion sites and structural disconnection patterns associated with poor tool use gesturing. We found that structural disconnection among the left inferior parietal lobule, lateral and ventral temporal cortices, and middle and superior frontal gyri predicted the severity of tool use gesturing performance. Control analyses demonstrated that reductions in right-hand grip strength were associated with motor system disconnection, largely bypassing regions supporting tool use gesturing. Our findings provide evidence that limb apraxia may arise, in part, from a disconnection between conceptual representations in the temporal lobe and mechanisms enabling skilled action production in the inferior parietal lobule.

Context-dependent dynamic functional connectivity alteration of lateral occipital cortex in schizophrenia

Schizophrenia has long been associated with dysfunction in visual perception. One important region underlying this is lateral occipital cortex (LOC), a mid-level visual region critical for object recognition. Although LOC of patients has exhibited structural and functional abnormalities in MR brain imaging studies, how it interacts with other networks over time under rest and with task demands remains to be clarified. The present study investigated the spatial-temporal interaction of LOC with other brain networks by examining functional connectivity communities of the brain over time. We found increased temporal instability of LOC connectivity over time under both resting and task-switching conditions in patients. In the resting state, LOC of patients had increased interaction with the frontoparietal task-control network (FPTC) and thalamus compared with controls, while during task switching, LOC showed increased interaction with the default mode network (DMN). Temporal instability of LOC connectivity was positively correlated with patients' switching cost during task performance and with hallucination severity. These results indicate that reduced stability of LOC connectivity may be an important factor underlying neurocognitive dysfunctions and symptom severity in schizophrenia.

One bad apple spoils the whole bushel: The neural basis of outlier processing

How are outliers in an otherwise homogeneous object ensemble represented by our visual system? Are outliers ignored because they are the minority? Or do outliers alter our perception of an otherwise homogeneous ensemble? We have previously demonstrated ensemble representation in human anterior-medial ventral visual cortex (overlapping the scene-selective parahippocampal place area; PPA). In this study we investigated how outliers impact object-ensemble representation in this human brain region as well as visual representation throughout posterior brain regions. We presented a homogeneous ensemble followed by an ensemble containing either identical elements or a majority of identical elements with a few outliers. Human participants ignored the outliers and made a same/different judgment between the two ensembles. In PPA, fMRI adaptation was observed when the outliers in the second ensemble matched the items in the first, even though the majority of the elements in the second ensemble were distinct from those in the first; conversely, release from fMRI adaptation was observed when the outliers in the second ensemble were distinct from the items in the first, even though the majority of the elements in the second ensemble were identical to those in the first. A similarly robust outlier effect was also found in other brain regions, including a shape-processing region in lateral occipital cortex (LO) and task-processing fronto-parietal regions. These brain regions likely work in concert to flag the presence of outliers during visual perception and then weigh the outliers appropriately in subsequent behavioral decisions. To our knowledge, this is the first time the neural mechanisms involved in outlier processing have been systematically documented in the human brain. Such an outlier effect could well provide the neural basis mediating our perceptual experience in situations like "one bad apple spoils the whole bushel".

Neural responses to dynamic adaptation reveal the dissociation between the processing of the shape of contours and textures

Shape-adaptation studies show that surround textures can inhibit the processing of contours. Using event-related potentials (ERP), we examined the time-course of neural processes involved in contour-shape and texture-shape processing following adaptation to contours and textures. Contours were made of Gabor strings whose orientations were either tangential or orthogonal to the contour path, while textures were made of a series of contours arranged in parallel. We focused on two ERP components -P1, related to low-level visual processes and N1, broadly indicative of mid-level vision- and, on ERP difference waves (no-adaptor minus with-adaptor) to isolate the effects of adaptation, which are fundamentally distinct from individual processes driving P1 and N1 components. We found that in the absence of adaptation, the N1 component for contour-tests peaked later and increased in amplitude compared to the N1 for texture-tests. Following adaptation, the ERP difference wave for contour-tests revealed an early and a late component that were differentially affected by the presence of surround texture, but critically not by its orientation. For texture-tests, the early component was of opposite polarity for contours compared to texture adaptors. From the temporal sequence of ERP modulations, we conclude that texture processing begins before contour processing and encompasses the stages of perceptual processing reflected in both the low-level P1 and the mid-level N1 vision-related components. Our study provides novel evidence on the nature of separable and temporally distinct texture and contour processing mechanisms, shown in two difference wave components, that highlights the multi-faceted nature of dynamic adaptation to shape when presented in isolation and in context.

Predicting how color and shape combine in the human visual system to direct attention

Objects in a scene can be distinct from one another along a multitude of visual attributes, such as color and shape, and the more distinct an object is from its surroundings, the easier it is to find it. However, exactly how this distinctiveness advantage arises in vision is not well understood. Here we studied whether and how visual distinctiveness along different visual attributes (color and shape, assessed in four experiments) combine to determine an object’s overall distinctiveness in a scene. Unidimensional distinctiveness scores were used to predict performance in six separate experiments where a target object differed from distractor objects along both color and shape. Results showed that there is mathematical law determining overall distinctiveness as the simple sum of the distinctiveness scores along each visual attribute. Thus, the brain must compute distinctiveness scores independently for each visual attribute before summing them into the overall score that directs human attention.

Neural correlates of visual short-term memory for objects with material categories

Behavioral and neuroscience studies have shown that we can easily identify material categories, such as metal and fabric. Not only the early visual areas but also higher-order visual areas including the fusiform gyrus are known to be engaged in material perception. However, the brain mechanisms underlying visual short-term memory (VSTM) for material categories are unknown. To address this issue, we examined the neural correlates of VSTM for objects with material categories using a change detection task. In each trial, participants viewed a sample display containing two, four, or six objects having six material categories and were required to remember the locations and types of objects. After a brief delay, participants were asked to detect an object change based on the images or material categories in the test display (image-based and material-based conditions). Neuronal activity in the brain was assessed using functional magnetic resonance imaging (MRI). Behavioral results showed that the number of objects encoded did not increase as a function of set size in either image-based or material-based conditions. By contrast, MRI data showed a difference between the image-based and material-based conditions in percent signal change observed in a priori region of interest, the fusiform face area (FFA). Thus, we failed to achieve our research aim. However, the brain activation in the FFA correlated with the activation in the precentral/postcentral gyrus, which is related to haptic processing. Our findings indicate that the FFA may be involved in VSTM for objects with material categories in terms of the difference between images and material categories and that this memory may be mediated by the tactile properties of objects.

The Neurocognitive Basis of Spatial Reorientation

The ability to recover one's bearings when lost is a skill that is fundamental for spatial navigation. We review the cognitive and neural mechanisms that underlie this ability, with the aim of linking together previously disparate findings from animal behavior, human psychology, electrophysiology, and cognitive neuroscience. Behavioral work suggests that reorientation involves two key abilities: first, the recovery of a spatial reference frame (a cognitive map) that is appropriate to the current environment; and second, the determination of one's heading and location relative to that reference frame. Electrophysiological recording studies, primarily in rodents, have revealed potential correlates of these operations in place, grid, border/boundary, and head-direction cells in the hippocampal formation. Cognitive neuroscience studies, primarily in humans, suggest that the perceptual inputs necessary for these operations are processed by neocortical regions such as the retrosplenial complex, occipital place area and parahippocampal place area, with the retrosplenial complex mediating spatial transformations between the local environment and the recovered spatial reference frame, the occipital place area supporting perception of local boundaries, and the parahippocampal place area processing visual information that is essential for identification of the local spatial context. By combining results across these various literatures, we converge on a unified account of reorientation that bridges the cognitive and neural domains.

Investigating the visual number form area: a replication study

The influential triple-code model of number representation proposed that there are three distinct brain regions for three different numerical representations: verbal words, visual digits and abstract magnitudes. It was hypothesized that the region for visual digits, known as the number form area, would be in ventral occipitotemporal cortex (vOTC), near other visual category-specific regions, such as the visual word form area. However, neuroimaging investigations searching for a region that responds in a category-specific manner to the visual presentation of number symbols have yielded inconsistent results. Price & Ansari (Price, Ansari 2011 Neuroimage 57, 1205-1211) investigated whether any regions activated more in response to passively viewing digits in contrast with letters and visually similar nonsense symbols and identified a region in the left angular gyrus. By contrast, Grotheer et al. (Grotheer, Herrmann, Kovács 2016 J. Neurosci. 36, 88-97) found bilateral regions in vOTC which were more activated in response to digits than other stimuli categories while performing a one-back task. In the current study, we aimed to replicate the findings reported in Grotheer et al. with Price & Ansari's passive viewing task as this is the most stringent test of bottom-up, sensory-driven, category-specific perception. Moreover, we used the contrasts reported in both papers in order to test whether the discrepancy in findings could be attributed to the difference in analysis.

Domain-Specific Diaschisis: Lesions to Parietal Action Areas Modulate Neural Responses to Tools in the Ventral Stream

Neural responses to small manipulable objects ("tools") in high-level visual areas in ventral temporal cortex (VTC) provide an opportunity to test how anatomically remote regions modulate ventral stream processing in a domain-specific manner. Prior patient studies indicate that grasp-relevant information can be computed about objects by dorsal stream structures independently of processing in VTC. Prior functional neuroimaging studies indicate privileged functional connectivity between regions of VTC exhibiting tool preferences and regions of parietal cortex supporting object-directed action. Here we test whether lesions to parietal cortex modulate tool preferences within ventral and lateral temporal cortex. We found that lesions to the left anterior intraparietal sulcus, a region that supports hand-shaping during object grasping and manipulation, modulate tool preferences in left VTC and in the left posterior middle temporal gyrus. Control analyses demonstrated that neural responses to "place" stimuli in left VTC were unaffected by lesions to parietal cortex, indicating domain-specific consequences for ventral stream neural responses in the setting of parietal lesions. These findings provide causal evidence that neural specificity for "tools" in ventral and lateral temporal lobe areas may arise, in part, from online inputs to VTC from parietal areas that receive inputs via the dorsal visual pathway.

Modulations of emotional attention and spatial attention on human visual cortical activities

Background: Spatial attention could enhance the neural activities of attended locations in human visual cortex. As a salient stimulus, emotional image could enhance the responses in amygdala and visual areas. However, few studies examined the interaction of the attentional effects induced by emotional stimuli and spatial cues on the neural responses in visual areas.

Methods: In the present study, we used functional magnetic resonance imaging (fMRI) to examine the combined and separated effects of emotional image and spatial cue on the activities in human visual areas. A revised Posner cueing paradigm was utilized. Each participant viewed a fearful image and a peaceful image simultaneously in left and right visual fields. A spatial cue of two dots was then presented in one of the image positions. In this manner, the attentional effects for emotional image and spatial cue could be isolated and combined.

Results: The results showed that spatial cue enhanced the responses in V4, intraparietal sulcus (IPS) and lateral occipital area (LO), while emotional image could enhance the responses in V3, V4 and LO. Importantly, no significant interactions were found in any of the visual areas.

Conclusion: Our results indicate that the two kinds of attentional modulation might not be affected by each other. These findings shed light on the neural mechanism of the emotional attention.

Who's that Knocking at My Door? Neural Bases of Sound Source Identification

When hearing knocking on a door, a listener typically identifies both the action (forceful and repeated impacts) and the object (a thick wooden board) causing the sound. The current work studied the neural bases of sound source identification by switching listeners' attention toward these different aspects of a set of simple sounds during functional magnetic resonance imaging scanning: participants either discriminated the action or the material that caused the sounds, or they simply discriminated meaningless scrambled versions of them. Overall, discriminating action and material elicited neural activity in a left-lateralized frontoparietal network found in other studies of sound identification, wherein the inferior frontal sulcus and the ventral premotor cortex were under the control of selective attention and sensitive to task demand. More strikingly, discriminating materials elicited increased activity in cortical regions connecting auditory inputs to semantic, motor, and even visual representations, whereas discriminating actions did not increase activity in any regions. These results indicate that discriminating and identifying material requires deeper processing of the stimuli than discriminating actions. These results are consistent with previous studies suggesting that auditory perception is better suited to comprehend the actions than the objects producing sounds in the listeners' environment.

Gesturing tool use and tool transport actions modulates inferior parietal functional connectivity with the dorsal and ventral object processing pathways

Interacting with manipulable objects (tools) requires the integration of diverse computations supported by anatomically remote regions. Previous functional neuroimaging research has demonstrated the left supramarginal (SMG) exhibits functional connectivity to both ventral and dorsal pathways, supporting the integration of ventrally-mediated tool properties and conceptual knowledge with dorsally-computed volumetric and structural representations of tools. This architecture affords us the opportunity to test whether interactions between the left SMG, ventral visual pathway, and dorsal visual pathway are differentially modulated when participants plan and generate tool-directed gestures emphasizing functional manipulation (tool use gesturing) or structure-based grasping (tool transport gesturing). We found that functional connectivity between the left SMG, ventral temporal cortex (bilateral fusiform gyri), and dorsal visual pathway (left superior parietal lobule/posterior intraparietal sulcus) was maximal for tool transport planning and gesturing, whereas functional connectivity between the left SMG, left ventral anterior temporal lobe, and left frontal operculum was maximal for tool use planning and gesturing. These results demonstrate that functional connectivity to the left SMG is differentially modulated by tool use and tool transport gesturing, suggesting that distinct tool features computed by the two object processing pathways are integrated in the parietal lobe in the service of tool-directed action.

The role of putative human anterior intraparietal sulcus area in observed manipulative action discrimination

INTRODUCTION

Although it has become widely accepted that the action observation network (AON) includes three levels (occipito-temporal, parietal and premotor), little is known concerning the specific role of these levels within perceptual tasks probing action observation. Recent single cell studies suggest that the parietal level carries the information required to discriminate between two-alternative observed actions, but do not exclude possible contributions from the other two levels.

METHODS

Two functional magnetic resonance imaging experiments used a task-based attentional modulation paradigm in which subjects viewed videos of an actor performing a manipulative action on a coloured object, and discriminated between either two observed manipulative actions, two actors or two colours.

RESULTS

Both experiments demonstrated that relative to actor and colour discrimination, discrimination between observed manipulative actions involved the putative human anterior intraparietal sulcus (phAIP) area in parietal cortex. In one experiment, where the observed actions also differed with regard to effectors, premotor cortex was also specifically recruited.

CONCLUSIONS

Our results highlight the primary role of parietal cortex in discriminating between two-alternative observed manipulative actions, consistent with the view that this level plays a major role in representing the identity of an observed action.