Closely overlapping responses to tools and hands in left lateral occipitotemporal cortex

The Extrastriate Body Area Computes Desired Goal States during Action Planning

How do object perception and action interact at a neural level? Here we test the hypothesis that perceptual features, processed by the ventral visuoperceptual stream, are used as priors by the dorsal visuomotor stream to specify goal-directed grasping actions. We present three main findings, which were obtained by combining time-resolved transcranial magnetic stimulation and kinematic tracking of grasp-and-rotate object manipulations, in a group of healthy human participants (N = 22). First, the extrastriate body area (EBA), in the ventral stream, provides an initial structure to motor plans, based on current and desired states of a grasped object and of the grasping hand. Second, the contributions of EBA are earlier in time than those of a caudal intraparietal region known to specify the action plan. Third, the contributions of EBA are particularly important when desired and current object configurations differ, and multiple courses of actions are possible. These findings specify the temporal and functional characteristics for a mechanism that integrates perceptual processing with motor planning.

Object Domain and Modality in the Ventral Visual Pathway

The nature of domain-specific organization in higher-order visual cortex (ventral occipital temporal cortex, VOTC) has been investigated both in the case of visual experience deprivation and of modality of stimulation in sighted individuals. Object domain interacts in an intriguing and revelatory way with visual experience and modality of stimulation: selectivity for artifacts and scene domains is largely immune to visual deprivation and is multi-modal, whereas selectivity for animate items in lateral posterior fusiform gyrus is present only with visual stimulation. This domain-by-modality interaction is not readily accommodated by existing theories of VOTC representation. We conjecture that these effects reflect a distinction between the visual features that characterize different object domains and their interaction with different types of downstream computational systems.

Representational Similarity of Body Parts in Human Occipitotemporal Cortex

Regions in human lateral and ventral occipitotemporal cortices (OTC) respond selectively to pictures of the human body and its parts. What are the organizational principles underlying body part responses in these regions? Here we used representational similarity analysis (RSA) of fMRI data to test multiple possible organizational principles: shape similarity, physical proximity, cortical homunculus proximity, and semantic similarity. Participants viewed pictures of whole persons, chairs, and eight body parts (hands, arms, legs, feet, chests, waists, upper faces, and lower faces). The similarity of multivoxel activity patterns for all body part pairs was established in whole person-selective OTC regions. The resulting neural similarity matrices were then compared with similarity matrices capturing the hypothesized organizational principles. Results showed that the semantic similarity model best captured the neural similarity of body parts in lateral and ventral OTC, which followed an organization in three clusters: (1) body parts used as action effectors (hands, feet, arms, and legs), (2) noneffector body parts (chests and waists), and (3) face parts (upper and lower faces). Whole-brain RSA revealed, in addition to OTC, regions in parietal and frontal cortex in which neural similarity was related to semantic similarity. In contrast, neural similarity in occipital cortex was best predicted by shape similarity models. We suggest that the semantic organization of body parts in high-level visual cortex relates to the different functions associated with the three body part clusters, reflecting the unique processing and connectivity demands associated with the different types of information (e.g., action, social) different body parts (e.g., limbs, faces) convey. Significance statement: While the organization of body part representations in motor and somatosensory cortices has been well characterized, the principles underlying body part representations in visual cortex have not yet been explored. In the present fMRI study we used multivoxel pattern analysis and representational similarity analysis to characterize the organization of body maps in human occipitotemporal cortex (OTC). Results indicate that visual and shape dimensions do not fully account for the organization of body part representations in OTC. Instead, the representational structure of body maps in OTC appears strongly related to functional-semantic properties of body parts. We suggest that this organization reflects the unique processing and connectivity demands associated with the different types of information different body parts convey.

Direct comparisons of hand and mouth kinematics during grasping, feeding and fork-feeding actions

While a plethora of studies have examined the kinematics of human reach-to-grasp actions, few have investigated feeding, another ethologically important real-world action. Two seminal studies concluded that the kinematics of the mouth during feeding are comparable to those of the hand during grasping (Castiello, 1997; Churchill et al., 1999); however, feeding was done with a fork or spoon, not with the hand itself. Here, we directly compared grasping and feeding kinematics under equivalent conditions. Participants were presented with differently sized cubes of cheese (10-, 20- or 30-mm on each side) and asked to use the hand to grasp them or to use a fork to spear them and then bring them to the mouth to bite. We measured the apertures of the hand during grasping and the teeth during feeding, as well as reaching kinematics of the arm in both tasks. As in many past studies, we found that the hand oversized considerably larger (~11–27 mm) than the food item during grasping; moreover, the amount of oversizing scaled with food size. Surprisingly, regardless of whether the hand or fork was used to transport the food, the mouth oversized only slightly larger (~4–11 mm) than the food item during biting and the oversizing did not increase with food size. Total movement times were longer when using the fork compared to the hand, particularly when using the fork to bring food to the mouth. While reach velocity always peaked approximately halfway through the movement, relative to the reach the mouth opened more slowly than the hand, perhaps because less time was required for the smaller oversizing. Taken together, our results show that while many aspects of kinematics share some similarity between grasping and feeding, oversizing may reflect strategies unique to the hand vs. mouth (such as the need to have the digits approach the target surface perpendicularly for grip stability during lifting) and differences in the neural substrates of grasping and feeding.

Functional connectivity associated with hand shape generation: Imitating novel hand postures and pantomiming tool grips challenge different nodes of a shared neural network

Clinical research suggests that imitating meaningless hand postures and pantomiming tool-related hand shapes rely on different neuroanatomical substrates. We investigated the BOLD responses to different tasks of hand posture generation in 14 right handed volunteers. Conjunction and contrast analyses were applied to select regions that were either common or sensitive to imitation and/or pantomime tasks. The selection included bilateral areas of medial and lateral extrastriate cortex, superior and inferior regions of the lateral and medial parietal lobe, primary motor and somatosensory cortex, and left dorsolateral prefrontal, and ventral and dorsal premotor cortices. Functional connectivity analysis revealed that during hand shape generation the BOLD-response of every region correlated significantly with every other area regardless of the hand posture task performed, although some regions were more involved in some hand postures tasks than others. Based on between-task differences in functional connectivity we predict that imitation of novel hand postures would suffer most from left superior parietal disruption and that pantomiming hand postures for tools would be impaired following left frontal damage, whereas both tasks would be sensitive to inferior parietal dysfunction. We also unveiled that posterior temporal cortex is committed to pantomiming tool grips, but that the involvement of this region to the execution of hand postures in general appears limited. We conclude that the generation of hand postures is subserved by a highly interconnected task-general neural network. Depending on task requirements some nodes/connections will be more engaged than others and these task-sensitive findings are in general agreement with recent lesion studies.

Body selectivity in occipitotemporal cortex: Causal evidence

Perception of others' bodies provides information that is useful for a number of important social-cognitive processes. Evidence from neuroimaging methods has identified focal cortical regions that are highly selective for perceiving bodies and body parts, including the extrastriate body area (EBA) and fusiform body area (FBA). Our understanding of the functional properties of these regions, and their causal contributions to behavior, has benefitted from the study of neuropsychological patients and particularly from investigations using transcranial magnetic stimulation (TMS). We review this evidence, focusing on TMS studies that are revealing of how (and when) activity in EBA contributes to detecting people in natural scenes; to resolving their body shape, movements, actions, individual parts, and identities; and to guiding goal-directed behavior. These findings are considered in reference to a framework for body perception in which the patterns of neural activity in EBA and FBA jointly serve to make explicit the elements of the visual scene that correspond to the body and its parts. These representations are modulated by other sources of information such as prior knowledge, and are shared with wider brain networks involved in many aspects of social cognition.

The lateral occipitotemporal cortex in action

Understanding and responding to other people's actions is fundamental for social interactions. Whereas many studies emphasize the importance of parietal and frontal regions for these abilities, several lines of recent research show that the human lateral occipitotemporal cortex (LOTC) represents varied aspects of action, ranging from perception of tools and bodies and the way they typically move, to understanding the meaning of actions, to performing overt actions. Here, we highlight common themes across these lines of work, which have informed theories related to high-level vision, concepts, social cognition, and apraxia. We propose that patterns of activity in LOTC form representational spaces, the dimensions of which capture perceptual, semantic, and motor knowledge of how actions change the state of the world.

From where to what: a neuroanatomically based evolutionary model of the emergence of speech in humans

In the brain of primates, the auditory cortex connects with the frontal lobe via the temporal pole (auditory ventral stream; AVS) and via the inferior parietal lobe (auditory dorsal stream; ADS). The AVS is responsible for sound recognition, and the ADS for sound-localization, voice detection and integration of calls with faces. I propose that the primary role of the ADS in non-human primates is the detection and response to contact calls. These calls are exchanged between tribe members (e.g., mother-offspring) and are used for monitoring location. Detection of contact calls occurs by the ADS identifying a voice, localizing it, and verifying that the corresponding face is out of sight. Once a contact call is detected, the primate produces a contact call in return via descending connections from the frontal lobe to a network of limbic and brainstem regions. Because the ADS of present day humans also performs speech production, I further propose an evolutionary course for the transition from contact call exchange to an early form of speech. In accordance with this model, structural changes to the ADS endowed early members of the genus Homo with partial vocal control. This development was beneficial as it enabled offspring to modify their contact calls with intonations for signaling high or low levels of distress to their mother. Eventually, individuals were capable of participating in yes-no question-answer conversations. In these conversations the offspring emitted a low-level distress call for inquiring about the safety of objects (e.g., food), and his/her mother responded with a high- or low-level distress call to signal approval or disapproval of the interaction. Gradually, the ADS and its connections with brainstem motor regions became more robust and vocal control became more volitional. Speech emerged once vocal control was sufficient for inventing novel calls.

From where to what: a neuroanatomically based evolutionary model of the emergence of speech in humans

In the brain of primates, the auditory cortex connects with the frontal lobe via the temporal pole (auditory ventral stream; AVS) and via the inferior parietal lobe (auditory dorsal stream; ADS). The AVS is responsible for sound recognition, and the ADS for sound-localization, voice detection and integration of calls with faces. I propose that the primary role of the ADS in non-human primates is the detection and response to contact calls. These calls are exchanged between tribe members (e.g., mother-offspring) and are used for monitoring location. Detection of contact calls occurs by the ADS identifying a voice, localizing it, and verifying that the corresponding face is out of sight. Once a contact call is detected, the primate produces a contact call in return via descending connections from the frontal lobe to a network of limbic and brainstem regions. Because the ADS of present day humans also performs speech production, I further propose an evolutionary course for the transition from contact call exchange to an early form of speech. In accordance with this model, structural changes to the ADS endowed early members of the genus Homo with partial vocal control. This development was beneficial as it enabled offspring to modify their contact calls with intonations for signaling high or low levels of distress to their mother. Eventually, individuals were capable of participating in yes-no question-answer conversations. In these conversations the offspring emitted a low-level distress call for inquiring about the safety of objects (e.g., food), and his/her mother responded with a high- or low-level distress call to signal approval or disapproval of the interaction. Gradually, the ADS and its connections with brainstem motor regions became more robust and vocal control became more volitional. Speech emerged once vocal control was sufficient for inventing novel calls.

Concept Representation Reflects Multimodal Abstraction: A Framework for Embodied Semantics

Recent research indicates that sensory and motor cortical areas play a significant role in the neural representation of concepts. However, little is known about the overall architecture of this representational system, including the role played by higher level areas that integrate different types of sensory and motor information. The present study addressed this issue by investigating the simultaneous contributions of multiple sensory-motor modalities to semantic word processing. With a multivariate fMRI design, we examined activation associated with 5 sensory-motor attributes--color, shape, visual motion, sound, and manipulation--for 900 words. Regions responsive to each attribute were identified using independent ratings of the attributes' relevance to the meaning of each word. The results indicate that these aspects of conceptual knowledge are encoded in multimodal and higher level unimodal areas involved in processing the corresponding types of information during perception and action, in agreement with embodied theories of semantics. They also reveal a hierarchical system of abstracted sensory-motor representations incorporating a major division between object interaction and object perception processes.

Network activity underlying the illusory self-attribution of a dummy arm

Neuroimaging has demonstrated that the illusory self-attribution of body parts engages frontal and intraparietal brain areas, and recent evidence further suggests an involvement of visual body-selective regions in the occipitotemporal cortex. However, little is known about the principles of information exchange within this network. Here, using automated congruent versus incongruent visuotactile stimulation of distinct anatomical locations on the participant's right arm and a realistic dummy counterpart in an fMRI scanner, we induced an illusory self-attribution of the dummy arm. The illusion consistently activated a left-hemispheric network comprising ventral premotor cortex (PMv), intraparietal sulcus (IPS), and body-selective regions of the lateral occipitotemporal cortex (LOC). Importantly, during the illusion, the functional coupling of the PMv and the IPS with the LOC increased substantially, and dynamic causal modeling revealed a significant enhancement of connections from the LOC and the secondary somatosensory cortex to the IPS. These results comply with the idea that the brain's inference mechanisms rely on the hierarchical propagation of prediction error. During illusory self-attribution, unpredicted ambiguous sensory input about one's body configuration may result in the generation of such prediction errors in visual and somatosensory areas, which may be conveyed to parietal integrative areas.

Objects exhibit body model like shape distortions

Accurate knowledge about size and shape of the body derived from somatosensation is important to locate one’s own body in space. The internal representation of these body metrics (body model) has been assessed by contrasting the distortions of participants’ body estimates across two types of tasks (localization task vs. template matching task). Here, we examined to which extent this contrast is linked to the human body. We compared participants’ shape estimates of their own hand and non-corporeal objects (rake, post-it pad, CD-box) between a localization task and a template matching task. While most items were perceived accurately in the visual template matching task, they appeared to be distorted in the localization task. All items’ distortions were characterized by larger length underestimation compared to width. This pattern of distortion was maintained across orientation for the rake item only, suggesting that the biases measured on the rake were bound to an item-centric reference frame. This was previously assumed to be the case only for the hand. Although similar results can be found between non-corporeal items and the hand, the hand appears significantly more distorted than other items in the localization task. Therefore, we conclude that the magnitude of the distortions measured in the localization task is specific to the hand. Our results are in line with the idea that the localization task for the hand measures contributions of both an implicit body model that is not utilized in landmark localization with objects and other factors that are common to objects and the hand.

Left occipitotemporal cortex contributes to the discrimination of tool-associated hand actions: fMRI and TMS evidence

Functional neuroimaging studies have implicated the left lateral occipitotemporal cortex (LOTC) in both tool and hand perception but the functional role of this region is not fully known. Here, by using a task manipulation, we tested whether tool-/hand-selective LOTC contributes to the discrimination of tool-associated hand actions. Participants viewed briefly presented pictures of kitchen and garage tools while they performed one of two tasks: in the action task, they judged whether the tool is associated with a hand rotation action (e.g., screwdriver) or a hand squeeze action (e.g., garlic press), while in the location task they judged whether the tool is typically found in the kitchen (e.g., garlic press) or in the garage (e.g., screwdriver). Both tasks were performed on the same stimulus set and were matched for difficulty. Contrasting fMRI responses between these tasks showed stronger activity during the action task than the location task in both tool- and hand-selective LOTC regions, which closely overlapped. No differences were found in nearby object- and motion-selective control regions. Importantly, these findings were confirmed by a TMS study, which showed that effective TMS over the tool-/hand-selective LOTC region significantly slowed responses for tool action discriminations relative to tool location discriminations, with no such difference during sham TMS. We conclude that left LOTC contributes to the discrimination of tool-associated hand actions.

Spatiotemporal dynamics of early cortical gesture processing

Gesture processing has been consistently shown to be associated with activation of the inferior parietal lobe (IPL); however, little is known about the integration of IPL activation into the temporal dynamics of early sensory areas. Using a temporally graded repetition suppression paradigm, we examined the activation and time course of brain areas involved in hand gesture processing. We recorded event-related potentials in response to stimulus pairs of static hand images forming gestures of the popular rock-paper-scissors game and estimated their neuronal generators. We identified two main components associated with adaptive patterns related to stimulus repetition. The N190 component elicited at temporo-parietal sites adapted to repetitions of the same gesture and was associated with right-hemispheric extrastriate body area activation. A later component at parieto-occipital sites demonstrated temporally graded adaptation effects for all gestures with a left-hemispheric dominance. Source localization revealed concurrent activations of the right extrastriate body area, fusiform gyri bilaterally, and the left IPL at about 250 ms. The adaptation pattern derived from the graded repetition suppression paradigm demonstrates the functional sensitivity of these sources to gesture processing. Given the literature on IPL contribution to imitation, action recognition, and action execution, IPL activation at about 250 ms may represent the access into specific cognitive routes for gesture processing and may thus be involved in integrating sensory information from cortical body areas into subsequent visuo-motor transformation processes.

Body and object effectors: the organization of object representations in high-level visual cortex reflects body-object interactions

The principles driving the functional organization of object representations in high-level visual cortex are not yet fully understood. In four human fMRI experiments, we provide evidence that the organization of high-level visual cortex partly reflects the degree to which objects are typically controlled by the body to interact with the world, thereby extending the body's boundaries. Univariate whole-brain analysis showed an overlap between responses to body effectors (e.g., hands, feet, and limbs) and object effectors (e.g., hammers, combs, and tennis rackets) in lateral occipitotemporal cortex (LOTC) and parietal cortex. Region of interest analyses showed that a hand-selective region in left LOTC responded selectively to object effectors relative to a range of noneffector object control conditions (e.g., graspable objects, "act-on" objects, musical instruments). Object ratings showed that the strong response to object effectors in hand-selective LOTC was not due to general action-related object properties shared with these control conditions, such as hand priming, hand grasping, and hand-action centrality. Finally, whole-brain representational similarity analysis revealed that the similarity of multivoxel object response patterns in left lateral occipitotemporal cortex selectively predicted the degree to which objects were rated as being controlled by and extending the body. Together, these results reveal a clustering of body and object effector representations, indicating that the organization of object representations in high-level visual cortex partly reflects how objects relate to the body.

Nonvisual and visual object shape representations in occipitotemporal cortex: evidence from congenitally blind and sighted adults

Knowledge of object shape is primarily acquired through the visual modality but can also be acquired through other sensory modalities. In the present study, we investigated the representation of object shape in humans without visual experience. Congenitally blind and sighted participants rated the shape similarity of pairs of 33 familiar objects, referred to by their names. The resulting shape similarity matrices were highly similar for the two groups, indicating that knowledge of the objects' shapes was largely independent of visual experience. Using fMRI, we tested for brain regions that represented object shape knowledge in blind and sighted participants. Multivoxel activity patterns were established for each of the 33 aurally presented object names. Sighted participants additionally viewed pictures of these objects. Using representational similarity analysis, neural similarity matrices were related to the behavioral shape similarity matrices. Results showed that activity patterns in occipitotemporal cortex (OTC) regions, including inferior temporal (IT) cortex and functionally defined object-selective cortex (OSC), reflected the behavioral shape similarity ratings in both blind and sighted groups, also when controlling for the objects' tactile and semantic similarity. Furthermore, neural similarity matrices of IT and OSC showed similarities across blind and sighted groups (within the auditory modality) and across modality (within the sighted group), but not across both modality and group (blind auditory-sighted visual). Together, these findings provide evidence that OTC not only represents objects visually (requiring visual experience) but also represents objects nonvisually, reflecting knowledge of object shape independently of the modality through which this knowledge was acquired.

Distinct regions of right temporal cortex are associated with biological and human-agent motion: functional magnetic resonance imaging and neuropsychological evidence

In human lateral temporal cortex, some regions show specific sensitivity to human motion. Here we examine whether such effects reflect a general biological-nonbiological organizational principle or a process specific to human-agent processing by comparing processing of human, animal, and tool motion in a functional magnetic resonance imaging (fMRI) experiment with healthy participants and a voxel-based lesion-symptom mapping (VLSM) study of patients with brain damage (77 stroke patients). The fMRI experiment revealed that in the lateral temporal cortex, the posterior superior temporal sulcus shows a preference for human and animal motion, whereas the middle part of the right superior temporal sulcus/gyrus (mSTS/STG) shows a preference for human and functional tool motion. VLSM analyses also revealed that damage to this right mSTS/STG region led to more severe impairment in the recognition of human and functional tool motion relative to animal motion, indicating the causal role of this brain area in human-agent motion processing. The findings for the right mSTS/STG cannot be reduced to a preference for articulated motion or processing of social variables since neither factor is involved in functional tool motion recognition. We conclude that a unidimensional biological-nonbiological distinction cannot fully explain the visual motion effects in lateral temporal cortex. Instead, the results suggest the existence of distinct components in right posterior temporal cortex and mSTS/STG that are associated, respectively, with biological motion and human-agent motion processing.

Tripartite organization of the ventral stream by animacy and object size

Occipito-temporal cortex is known to house visual object representations, but the organization of the neural activation patterns along this cortex is still being discovered. Here we found a systematic, large-scale structure in the neural responses related to the interaction between two major cognitive dimensions of object representation: animacy and real-world size. Neural responses were measured with functional magnetic resonance imaging while human observers viewed images of big and small animals and big and small objects. We found that real-world size drives differential responses only in the object domain, not the animate domain, yielding a tripartite distinction in the space of object representation. Specifically, cortical zones with distinct response preferences for big objects, all animals, and small objects, are arranged in a spoked organization around the occipital pole, along a single ventromedial, to lateral, to dorsomedial axis. The preference zones are duplicated on the ventral and lateral surface of the brain. Such a duplication indicates that a yet unknown higher-order division of labor separates object processing into two substreams of the ventral visual pathway. Broadly, we suggest that these large-scale neural divisions reflect the major joints in the representational structure of objects and thus place informative constraints on the nature of the underlying cognitive architecture.

Seeking a bridge between language and motor cortices: a PPI study

The relation between the sensorimotor cortex and the language network has been widely discussed but still remains controversial. Two independent theories compete to explain how this area is involved during action-related verbs processing. The embodied view assumes that action word representations activate sensorimotor representations which are accessed when an action word is processed or when an action is observed. The abstract hypothesis states that the mental representations of words are abstract and independent of the objects' sensorimotor properties they refer to. We combined neuropsychological and fMRI-PPI connectivity data, to address action-related verbs processing in neurosurgical patients with lesions involving (N = 5) or sparing (N = 5) the primary motor cortex and healthy controls (N = 12). A lack of significant changes in the functional coupling between the left M1 cortex and functional nodes of the linguistic network during the verb generation task was found for all the groups. In addition, we found that the ability to perform an action verb naming task was not related to a damaged M1. These data showed that there was not a task-specific functional interaction active between M1 and the inferior frontal gyrus. We will discuss how these findings indicate that action words do not automatically activate the M1 cortex; we suggest rather that its enrolment could be related to other not strictly linguistic processing.

Watching the brain in action

Functional magnetic resonance imaging has been used to identify the different networks in the brain that underpin the use of tools by humans.

Decoding the neural mechanisms of human tool use

Sophisticated tool use is a defining characteristic of the primate species but how is it supported by the brain, particularly the human brain? Here we show, using functional MRI and pattern classification methods, that tool use is subserved by multiple distributed action-centred neural representations that are both shared with and distinct from those of the hand. In areas of frontoparietal cortex we found a common representation for planned hand- and tool-related actions. In contrast, in parietal and occipitotemporal regions implicated in hand actions and body perception we found that coding remained selectively linked to upcoming actions of the hand whereas in parietal and occipitotemporal regions implicated in tool-related processing the coding remained selectively linked to upcoming actions of the tool. The highly specialized and hierarchical nature of this coding suggests that hand- and tool-related actions are represented separately at earlier levels of sensorimotor processing before becoming integrated in frontoparietal cortex. DOI:http://dx.doi.org/10.7554/eLife.00425.001.

Body posture modulates action perception

Recent studies have highlighted cognitive and neural similarities between planning and perceiving actions. Given that action planning involves a simulation of potential action plans that depends on the actor's body posture, we reasoned that perceiving actions may also be influenced by one's body posture. Here, we test whether and how this influence occurs by measuring behavioral and cerebral (fMRI) responses in human participants predicting goals of observed actions, while manipulating postural congruency between their own body posture and postures of the observed agents. Behaviorally, predicting action goals is facilitated when the body posture of the observer matches the posture achieved by the observed agent at the end of his action (action's goal posture). Cerebrally, this perceptual postural congruency effect modulates activity in a portion of the left intraparietal sulcus that has previously been shown to be involved in updating neural representations of one's own limb posture during action planning. This intraparietal area showed stronger responses when the goal posture of the observed action did not match the current body posture of the observer. These results add two novel elements to the notion that perceiving actions relies on the same predictive mechanism as planning actions. First, the predictions implemented by this mechanism are based on the current physical configuration of the body. Second, during both action planning and action observation, these predictions pertain to the goal state of the action.

Tool selectivity in left occipitotemporal cortex develops without vision

Previous studies have provided evidence for a tool-selective region in left lateral occipitotemporal cortex (LOTC). This region responds selectively to pictures of tools and to characteristic visual tool motion. The present human fMRI study tested whether visual experience is required for the development of tool-selective responses in left LOTC. Words referring to tools, animals, and nonmanipulable objects were presented auditorily to 14 congenitally blind and 16 sighted participants. Sighted participants additionally viewed pictures of these objects. In whole-brain group analyses, sighted participants showed tool-selective activity in left LOTC in both visual and auditory tasks. Importantly, virtually identical tool-selective LOTC activity was found in the congenitally blind group performing the auditory task. Furthermore, both groups showed equally strong tool-selective activity for auditory stimuli in a tool-selective LOTC region defined by the picture-viewing task in the sighted group. Detailed analyses in individual participants showed significant tool-selective LOTC activity in 13 of 14 blind participants and 14 of 16 sighted participants. The strength and anatomical location of this activity were indistinguishable across groups. Finally, both blind and sighted groups showed significant resting state functional connectivity between left LOTC and a bilateral frontoparietal network. Together, these results indicate that tool-selective activity in left LOTC develops without ever having seen a tool or its motion. This finding puts constraints on the possible role that this region could have in tool processing and, more generally, provides new insights into the principles shaping the functional organization of OTC.

Selectivity for large nonmanipulable objects in scene-selective visual cortex does not require visual experience

The principles that determine the organization of object representations in ventral temporal cortex (VTC) remain elusive. Here, we focus on the parahippocampal place area (PPA), a region in medial VTC that has been shown to respond selectively to pictures of scenes. Recent studies further observed that this region also shows a preference for large nonmanipulable objects relative to other objects, which might reflect the suitability of large objects for navigation. The mechanisms underlying this selectivity remain poorly understood. We examined the extent to which PPA selectivity requires visual experience. Fourteen congenitally blind and matched sighted participants were tested on an auditory size judgment experiment involving large nonmanipulable objects, small objects (tools), and animals. Sighted participants additionally participated in a picture-viewing experiment. Replicating previous work, we found that the PPA responded selectively to large nonmanipulable objects, relative to tools and animals, in the sighted group viewing pictures. Importantly, this selectivity was also observed in the auditory experiment in both sighted and congenitally blind groups. In both groups, selectivity for large nonmanipulable objects was additionally observed in the retrosplenial complex (RSC) and the transverse occipital sulcus (TOS), regions previously implicated in scene perception and navigation. Finally, in both groups the PPA showed resting-state functional connectivity with TOS and RSC. These results provide new evidence that large object selectivity in PPA, and the intrinsic connectivity between PPA and other navigation-relevant regions, do not require visual experience. More generally, they show that the organization of object representations in VTC can develop, at least partly, without visual experience.

Conceptual object representations in human anterior temporal cortex

Interaction with everyday objects requires the representation of conceptual object properties, such as where and how an object is used. What are the neural mechanisms that support this knowledge? While research on semantic dementia has provided evidence for a critical role of the anterior temporal lobes (ATLs) in object knowledge, fMRI studies using univariate analysis have primarily implicated regions outside the ATL. In the present human fMRI study we used multivoxel pattern analysis to test whether activity patterns in ATLs carry information about conceptual object properties. Participants viewed objects that differed on two dimensions: where the object is typically found (in the kitchen or the garage) and how the object is commonly used (with a rotate or a squeeze movement). Anatomical region-of-interest analyses covering the ventral visual stream revealed that information about the location and action dimensions increased from posterior to anterior ventral temporal cortex, peaking in the temporal pole. Whole-brain multivoxel searchlight analysis confirmed these results, revealing highly significant and regionally specific information about the location and action dimensions in the anterior temporal lobes bilaterally. In contrast to conceptual object properties, perceptual and low-level visual properties of the objects were reflected in activity patterns in posterior lateral occipitotemporal cortex and occipital cortex, respectively. These results provide fMRI evidence that object representations in the anterior temporal lobes are abstracted away from perceptual properties, categorizing objects in semantically meaningful groups to support conceptual object knowledge.

Preference for orientations commonly viewed for one's own hand in the anterior intraparietal cortex

Brain regions in the intraparietal and the premotor cortices selectively process visual and multisensory events near the hands (peri-hand space). Visual information from the hand itself modulates this processing potentially because it is used to estimate the location of one’s own body and the surrounding space. In humans specific occipitotemporal areas process visual information of specific body parts such as hands. Here we used an fMRI block-design to investigate if anterior intraparietal and ventral premotor ‘peri-hand areas’ exhibit selective responses to viewing images of hands and viewing specific hand orientations. Furthermore, we investigated if the occipitotemporal ‘hand area’ is sensitive to viewed hand orientation. Our findings demonstrate increased BOLD responses in the left anterior intraparietal area when participants viewed hands and feet as compared to faces and objects. Anterior intraparietal and also occipitotemporal areas in the left hemisphere exhibited response preferences for viewing right hands with orientations commonly viewed for one’s own hand as compared to uncommon own hand orientations. Our results indicate that both anterior intraparietal and occipitotemporal areas encode visual limb-specific shape and orientation information.

Functional alterations in neural substrates of geometric reasoning in adults with high-functioning autism

Individuals with autism spectrum condition (ASC) are known to excel in some perceptual cognitive tasks, but such developed functions have been often regarded as "islets of abilities" that do not significantly contribute to broader intellectual capacities. However, recent behavioral studies have reported that individuals with ASC have advantages for performing Raven's (Standard) Progressive Matrices (RPM/RSPM), a standard neuropsychological test for general fluid intelligence, raising the possibility that ASC's cognitive strength can be utilized for more general purposes like novel problem solving. Here, the brain activity of 25 adults with high-functioning ASC and 26 matched normal controls (NC) was measured using functional magnetic resonance imaging (fMRI) to examine neural substrates of geometric reasoning during the engagement of a modified version of the RSPM test. Among the frontal and parietal brain regions involved in fluid intelligence, ASC showed larger activation in the left lateral occipitotemporal cortex (LOTC) during an analytic condition with moderate difficulty than NC. Activation in the left LOTC and ventrolateral prefrontal cortex (VLPFC) increased with task difficulty in NC, whereas such modulation of activity was absent in ASC. Furthermore, functional connectivity analysis revealed a significant reduction of activation coupling between the left inferior parietal cortex and the right anterior prefrontal cortex during both figural and analytic conditions in ASC. These results indicate altered pattern of functional specialization and integration in the neural system for geometric reasoning in ASC, which may explain its atypical cognitive pattern, including performance on the Raven's Matrices test.

Am I seeing my hand? Visual appearance and knowledge of controllability both contribute to the visual capture of a person's own body

When confronted with complex visual scenes in daily life, how do we know which visual information represents our own hand? We investigated the cues used to assign visual information to one's own hand. Wrist tendon vibration elicits an illusory sensation of wrist movement. The intensity of this illusion attenuates when the actual motionless hand is visually presented. Testing what kind of visual stimuli attenuate this illusion will elucidate factors contributing to visual detection of one's own hand. The illusion was reduced when a stationary object was shown, but only when participants knew it was controllable with their hands. In contrast, the visual image of their own hand attenuated the illusion even when participants knew that it was not controllable. We suggest that long-term knowledge about the appearance of the body and short-term knowledge about controllability of a visual object are combined to robustly extract our own body from a visual scene.

Does the human dorsal stream really process a category for tools?

Previously, Almeida et al. (2008) used a technique called Continuous Flash Suppression to show that human dorsal stream cortical areas specifically responded to a "tool category." Here, we used the same technique to clarify what attributes of tools are processed in the dorsal stream. We examined surface attributes and shape. A significant priming effect was found when we removed surface attributes by using line drawings instead of photographs. In a second experiment, we manipulated shape and we found that there were no significant priming effects when we used nonelongated tool pictures as tool prime stimuli. To better clarify the effect of shape attributes on priming effects, we conducted a further experiment using elongated stick-like rectangles as prime stimuli and found that elongated shapes significantly shortened the reaction time to the tool pictures as target stimuli. Additionally, when elongated vegetables were used as prime stimuli, the reaction time to the tool pictures as target stimuli was also significantly shortened, but there was no effect when stubby vegetables were used. Finally, when we controlled for orientation by presenting rotated elongated stick-like rectangles, diamond shapes, and cut circles as prime stimuli, we found that rectangles replicated the same significant priming effect as previous experiments, but the others did not. These results suggest that the dorsal stream processes elongated shapes but does not process the tool category specifically.