Temporal Frequency Tuning Reveals Interactions between the Dorsal and Ventral Visual Streams

Reciprocal interactions among parietal and occipito-temporal representations support everyday object-directed actions

Everyday interactions with common manipulable objects require the integration of conceptual knowledge about objects and actions with real-time sensory information about the position, orientation and volumetric structure of the grasp target. The ability to successfully interact with everyday objects involves analysis of visual form and shape, surface texture, material properties, conceptual attributes such as identity, function and typical context, and visuomotor processing supporting hand transport, grasp form, and object manipulation. Functionally separable brain regions across the dorsal and ventral visual pathways support the processing of these different object properties and, in cohort, are necessary for functional object use. Object-directed grasps display end-state-comfort: they anticipate in form and force the shape and material properties of the grasp target, and how the object will be manipulated after it is grasped. End-state-comfort is the default for everyday interactions with manipulable objects and implies integration of information across the ventral and dorsal visual pathways. We propose a model of how visuomotor and action representations in parietal cortex interact with object representations in ventral and lateral occipito-temporal cortex. One pathway, from the supramarginal gyrus to the middle and inferior temporal gyrus, supports the integration of action-related information, including hand and limb position (supramarginal gyrus) with conceptual attributes and an appreciation of the action goal (middle temporal gyrus). A second pathway, from posterior IPS to the fusiform gyrus and collateral sulcus supports the integration of grasp parameters (IPS) with the surface texture and material properties (e.g., weight distribution) of the grasp target. Reciprocal interactions among these regions are part of a broader network of regions that support everyday functional object interactions.

Neural and behavioral signatures of the multidimensionality of manipulable object processing

Understanding how we recognize objects requires unravelling the variables that govern the way we think about objects and the neural organization of object representations. A tenable hypothesis is that the organization of object knowledge follows key object-related dimensions. Here, we explored, behaviorally and neurally, the multidimensionality of object processing. We focused on within-domain object information as a proxy for the decisions we typically engage in our daily lives - e.g., identifying a hammer in the context of other tools. We extracted object-related dimensions from subjective human judgments on a set of manipulable objects. We show that the extracted dimensions are cognitively interpretable and relevant - i.e., participants are able to consistently label them, and these dimensions can guide object categorization; and are important for the neural organization of knowledge - i.e., they predict neural signals elicited by manipulable objects. This shows that multidimensionality is a hallmark of the organization of manipulable object knowledge.

Disentangling hand and tool processing: Distal effects of neuromodulation

Neural processing within a local brain region that responds to more than one object category (e.g., hands and tools) nonetheless have different functional connectivity patterns with other distal brain areas, which suggests that local processing can affect and/or be affected by processing in distal areas, in a category-specific way. Here we wanted to test whether administering either a hand- or tool-related training task in tandem with transcranial direct current stimulation (tDCS) to a region that responds both to hands and tools (posterior middle temporal gyrus; pMTG), modulated local and distal neural processing more for the trained than the untrained category in a subsequent fMRI task. After each combined tDCS/training session, participants viewed images of tools, hands, and animals, in an fMRI scanner. Using multivoxel pattern analysis, we found that tDCS stimulation to pMTG indeed improved the classification accuracy between tools vs. animals, but only when combined with a tool and not a hand training task. Surprisingly, tDCS stimulation to pMTG also improved classification accuracy between hands vs. animals when combined with a tool but not a hand training task. Our findings suggest that overlapping but functionally-specific networks may be engaged separately by using a category-specific training task together with tDCS - a strategy that can be applied more broadly to other cognitive domains using tDCS. By hypothesis, these effects on local processing are a direct result of within-domain connectivity constraints from domain-specific networks that are at play in the processing and organization of object representations.

Tackling the challenges of group network inference from intracranial EEG data

INTRODUCTION

Intracranial EEG (iEEG) data is a powerful way to map brain function, characterized by high temporal and spatial resolution, allowing the study of interactions among neuronal populations that orchestrate cognitive processing. However, the statistical inference and analysis of brain networks using iEEG data faces many challenges related to its sparse brain coverage, and its inhomogeneity across patients.

METHODS

We review these challenges and develop a methodological pipeline for estimation of network structure not obtainable from any single patient, illustrated on the inference of the interaction among visual streams using a dataset of 27 human iEEG recordings from a visual experiment employing visual scene stimuli. 100 ms sliding window and multiple band-pass filtered signals are used to provide temporal and spectral resolution. For the connectivity analysis we showcase two connectivity measures reflecting different types of interaction between regions of interest (ROI): Phase Locking Value as a symmetric measure of synchrony, and Directed Transfer Function-asymmetric measure describing causal interaction. For each two channels, initial uncorrected significance testing at p < 0.05 for every time-frequency point is carried out by comparison of the data-derived connectivity to a baseline surrogate-based null distribution, providing a binary time-frequency connectivity map. For each ROI pair, a connectivity density map is obtained by averaging across all pairs of channels spanning them, effectively agglomerating data across relevant channels and subjects. Finally, the difference of the mean map value after and before the stimulation is compared to the same statistic in surrogate data to assess link significance.

RESULTS

The analysis confirmed the function of the parieto-medial temporal pathway, mediating visuospatial information between dorsal and ventral visual streams during visual scene analysis. Moreover, we observed the anterior hippocampal connectivity with more posterior areas in the medial temporal lobe, and found the reciprocal information flow between early processing areas and medial place area.

DISCUSSION

To summarize, we developed an approach for estimating network connectivity, dealing with the challenge of sparse individual coverage of intracranial EEG electrodes. Its application provided new insights into the interaction between the dorsal and ventral visual streams, one of the iconic dualities in human cognition.

What tool representation, intuitive physics, and action have in common: The brain's first-person physics engine

An overlapping set of brain regions in parietal and frontal cortex are engaged by different types of tasks and stimuli: (i) making inferences about the physical structure and dynamics of the world, (ii) passively viewing, or actively interacting with, manipulable objects, and (iii) planning and execution of reaching and grasping actions. We suggest the observed neural overlap is because a common superordinate computation is engaged by each of those different tasks: A forward model of physical reasoning about how first-person actions will affect the world and be affected by unfolding physical events. This perspective offers an account of why some physical predictions are systematically incorrect - there can be a mismatch between how physical scenarios are experimentally framed and the native format of the inferences generated by the brain's first-person physics engine. This perspective generates new empirical expectations about the conditions under which physical reasoning may exhibit systematic biases.

Tool heads prime saccades

Tools are wielded by their handles, but a lot of information about their function comes from their heads (the action-ends). Here we investigated whether eye saccadic movements are primed by tool handles, or whether they are primed by tool heads. We measured human saccadic reaction times while subjects were performing an attentional task. We found that saccades were executed quicker when performed to the side congruent with the tool head, even though "toolness" was irrelevant for the task. Our results show that heads are automatically processed by the visual system to orient eye movements, indicating that eyes are attracted by functional parts of manipulable objects and by the characteristic information these parts convey.

Knowing how to do it or doing it? A double dissociation between tool-gesture production and tool-gesture knowledge

Deciding how to manipulate an object to fulfill a goal requires accessing different types of object-related information. How these different types of information are integrated and represented in the brain is still an open question. Here, we focus on examining two types of object-related information-tool-gesture knowledge (i.e., how to manipulate an object), and tool-gesture production (i.e., the actual manipulation of an object). We show a double dissociation between tool-gesture knowledge and tool-gesture production: Patient FP presents problems in pantomiming tool use in the context of a spared ability to perform judgments about an object's manipulation, whereas Patient LS can pantomime tool use, but is impaired at performing manipulation judgments. Moreover, we compared the location of the lesions in FP and LS with those sustained by two classic ideomotor apraxic patients (IMA), using a cortical thickness approach. Patient FP presented lesions in common with our classic IMA that included the left inferior parietal lobule (IPL), and specifically the supramarginal gyrus, the left parietal operculum, the left premotor cortex and the left inferior frontal gyrus, whereas Patient LS and our classic IMA patients presented common lesions in regions of the superior parietal lobule (SPL), motor areas (as primary somatosensory cortex, premotor cortex and primary motor cortex), and frontal areas. Our results show that tool-gesture production and tool-gesture knowledge can be behaviorally and neurally doubly dissociated and put strong constraints on extant theories of action and object recognition and use.

High-Level Representations in Human Occipito-Temporal Cortex Are Indexed by Distal Connectivity

Human object recognition is dependent on occipito-temporal cortex (OTC), but a complete understanding of the complex functional architecture of this area must account for how it is connected to the wider brain. Converging functional magnetic resonance imaging evidence shows that univariate responses to different categories of information (e.g., faces, bodies, and nonhuman objects) are strongly related to, and potentially shaped by, functional and structural connectivity to the wider brain. However, to date, there have been no systematic attempts to determine how distal connectivity and complex local high-level responses in occipito-temporal cortex (i.e., multivoxel response patterns) are related. Here, we show that distal functional connectivity is related to, and can reliably index, high-level representations for several visual categories (i.e., tools, faces, and places) within occipito-temporal cortex; that is, voxel sets that are strongly connected to distal brain areas show higher pattern discriminability than less well-connected sets do. We further show that in several cases, pattern discriminability is higher in sets of well-connected voxels than sets defined by local activation (e.g., strong amplitude responses to faces in fusiform face area). Together, these findings demonstrate the important relationship between the complex functional organization of occipito-temporal cortex and wider brain connectivity.SIGNIFICANCE STATEMENT Human object recognition relies strongly on OTC, yet responses in this broad area are often considered in relative isolation to the rest of the brain. We employ a novel connectivity-guided voxel selection approach with functional magnetic resonance imaging data to show higher sensitivity to information (i.e., higher multivoxel pattern discriminability) in voxel sets that share strong connectivity to distal brain areas, relative to (1) voxel sets that are less strongly connected, and in several cases, (2) voxel sets that are defined by strong local response amplitude. These findings underscore the importance of distal contributions to local processing in OTC.

Overlapping but distinct: Distal connectivity dissociates hand and tool processing networks

The processes and organizational principles of information involved in object recognition have been a subject of intense debate. These research efforts led to the understanding that local computations and feedforward/feedback connections are essential to our representations and their organization. Recent data, however, has demonstrated that distal computations also play a role in how information is locally processed. Here we focus on how long-range connectivity and local functional organization of information are related, by exploring regions that show overlapping category-preferences for two categories and testing whether their connections are related with distal representations in a category-specific way. We used an approach that relates functional connectivity with distal areas to local voxel-wise category-preferences. Specifically, we focused on two areas that show an overlap in category-preferences for tools and hands-the inferior parietal lobule/anterior intraparietal sulcus (IPL/aIPS) and the posterior middle temporal gyrus/lateral occipital temporal cortex (pMTG/LOTC) - and how connectivity from these two areas relate to voxel-wise category-preferences in two ventral temporal regions dedicated to the processing of tools and hands separately-the left medial fusiform gyrus and the fusiform body area respectively-as well as across the brain. We show that the functional connections of the two overlap areas correlate with categorical preferences for each category independently. These results show that regions that process both tools and hands maintain object topography in a category-specific way. This potentially allows for a category-specific flow of information that is pertinent to computing object representations.

Temporo-parietal brain regions are involved in higher order object perception

Lesions to posterior temporo-parietal brain regions are associated with deficits in perception of global, hierarchical shapes, but also with impairments in the processing of objects presented under demanding viewing conditions. Evidence from neuroimaging studies and lesion patterns observed in patients with simultanagnosia and agnosia for object orientation suggest similar brain regions to be involved in perception of global shapes and processing of objects in atypical ('non-canonical') orientation. In a localizer experiment, we identified individual temporo-parietal brain areas involved in global shape perception and found significantly higher BOLD signals during the processing of non-canonical compared to canonical objects. In a multivariate approach, we demonstrated that posterior temporo-parietal brain areas show distinct voxel patterns for non-canonical and canonical objects and that voxel patterns of global shapes are more similar to those of objects in non-canonical compared to canonical viewing conditions. These results suggest that temporo-parietal brain areas are not only involved in global shape perception but might serve a more general mechanism of complex object perception. Our results challenge a strict attribution of object processing to the ventral visual stream by suggesting specific dorsal contributions in more demanding viewing conditions.

Decoding stimuli (tool-hand) and viewpoint invariant grasp-type information

When we see a manipulable object (henceforth tool) or a hand performing a grasping movement, our brain is automatically tuned to how that tool can be grasped (i.e., its affordance) or what kind of grasp that hand is performing (e.g., a power or precision grasp). However, it remains unclear where visual information related to tools or hands are transformed into abstract grasp representations. We therefore investigated where different levels of abstractness in grasp information are processed: grasp information that is invariant to the kind of stimuli that elicits it (tool-hand invariance); and grasp information that is hand-specific but viewpoint-invariant (viewpoint invariance). We focused on brain areas activated when viewing both tools and hands, i.e., the posterior parietal cortices (PPC), ventral premotor cortices (PMv), and lateral occipitotemporal cortex/posterior middle temporal cortex (LOTC/pMTG). To test for invariant grasp representations, we presented participants with tool images and grasp videos (from first or third person perspective; 1pp or 3pp) inside an MRI scanner, and cross-decoded power versus precision grasps across (i) grasp perspectives (viewpoint invariance), (ii) tool images and grasp 1pp videos (tool-hand 1pp invariance), and (iii) tool images and grasp 3pp videos (tool-hand 3pp invariance). Tool-hand 1pp, but not tool-hand 3pp, invariant grasp information was found in left PPC, whereas viewpoint-invariant information was found bilaterally in PPC, left PMv, and left LOTC/pMTG. These findings suggest different levels of abstractness-where visual information is transformed into stimuli-invariant grasp representations/tool affordances in left PPC, and viewpoint invariant but hand-specific grasp representations in the hand network.

Within-category representational stability through the lens of manipulable objects

Our ability to recognize an object amongst many exemplars is one of our most important features, and one that putatively distinguishes humans from non-human animals and potentially from (current) computational and artificial intelligence models. We can recognize objects consistently regardless of when we see them suggesting that we have stable representations across time and different contexts. Importantly, little is known about how humans can replicate within-category object representations across time. Here, we investigate neural stability of within-category object representations by computing the similarity between representational geometries of activity patterns for 80 images of tools obtained on different functional magnetic resonance imaging (fMRI) scanning days. We show that within-category representational stability is observable in regions that span lateral and ventral temporal cortex, inferior and superior parietal cortex, and premotor cortex - regions typically associated with tool processing and visuospatial processing. We then focus on what kinds of representations best explain the representational geometries within these regions. We test the similarity of these geometries with those coming from the different layers of a convolutional neural network, and those coming from perceived and veridical visual similarity models. We find that regions supporting within-category representational stability show stronger relationship with higher-level visual/semantic features, suggesting that neural replicability is derived from perceived and higher-level visual information. Within category representational stability may thus originate from long-range cross talk between category-specific regions (and in this case strongly within ventral and lateral temporal cortex) over more abstract, rather than veridical/lower-level, visual (sensorial) representations, and perhaps in the service of object-centered representations.

When figure-ground segregation fails: Exploring antagonistic interactions in figure-ground perception

Perceptual fading of an artificial scotoma can be viewed as a failure of figure-ground segregation, providing a useful tool for investigating possible mechanisms and processes involved in figure-ground perception. Weisstein's antagonistic magnocellular/parvocellular stream figure-ground model proposes P stream activity encodes figure, and M stream activity encodes background. Where a boundary separates two regions, the region that is perceived as figure or ground is determined by the outcome of antagonism between M and P activity within each region and across the boundary between them. The region with the relatively stronger P "figure signal" is perceived as figure, and the region with the relatively stronger M "ground signal" is perceived as ground. From this perspective, fading occurs when the figure signal is overwhelmed by the ground signal. Strengthening the figure signal or weakening the ground signal should make the figure more resistant to fading. Based on research showing that red light suppresses M activity and short wavelength sensitive S-cones provide minimal input to M cells, we used red and blue light to reduce M activity in both figure and ground. The time to fade from stimulus onset until the figure completely disappeared was measured. Every combination of gray, green, red, and blue as figure and/or ground was tested. Compared with gray and green light, fade times were greatest when red or blue light either strengthened the figure signal by reducing M activity in the figure, or weakened the ground signal by reducing M activity in ground. The results support a dynamic antagonistic relationship between M and P activity contributing to figure-ground perception as envisioned in Weisstein's model.

Dissociated modulations of multivoxel activation patterns in the ventral and dorsal visual pathways by the temporal dynamics of stimuli

INTRODUCTION

Previous studies suggested temporal limitations of visual object identification in the ventral pathway. Moreover, multivoxel pattern analyses (MVPA) of fMRI activation have shown reliable encoding of various object categories including faces and tools in the ventral pathway. By contrast, the dorsal pathway is involved in reaching a target and grasping a tool, and quicker in processing the temporal dynamics of stimulus change. However, little is known about how activation patterns in both pathways may change according to the temporal dynamics of stimulus change.

METHODS

Here, we measured fMRI responses of two consecutive stimuli with varying interstimulus intervals (ISIs), and we compared how the two visual pathways respond to the dynamics of stimuli by using MVPA and information-based searchlight mapping.

RESULTS

We found that the temporal dynamics of stimuli modulate responses of the two visual pathways in opposite directions. Specifically, slower temporal dynamics (longer ISIs) led to greater activity and better MVPA results in the ventral pathway. However, faster temporal dynamics (shorter ISIs) led to greater activity and better MVPA results in the dorsal pathway.

CONCLUSIONS

These results are the first to show how temporal dynamics of stimulus change modulated multivoxel fMRI activation pattern change. And such temporal dynamic response function in different ROIs along the two visual pathways may shed lights on understanding functional relationship and organization of these ROIs.

Transcranial Direct Current Stimulation Alters Functional Network Structure in Humans: A Graph Theoretical Analysis

Transcranial direct current stimulation (tDCS) is routinely used in basic and clinical research, but its efficacy has been challenged on a methodological, statistical and technical basis recently. The arguments against tDCS derive from an insufficient understanding of how this technique interacts with brain processes physiologically. Because of its potential as a central tool in neuroscience, it is important to clarify whether tDCS affects neuronal activity. Here, we investigate influences of offline tDCS on network architecture measured by functional magnetic resonance imaging. Applied to one network node only, offline tDCS affects the architecture of the entire functional network. Furthermore, offline tDCS exerts polarity-specific effects on the topology of the functional network attached. Our results confirm in a functioning brain and in a bias free and independent fashion that offline tDCS influences neuronal activity. Moreover, our results suggest that network-specific connectivity has an important role in improving our understanding of the effects of tDCS.

Action at a distance on object-related ventral temporal representations

The representation of objects in ventral temporal cortex is relatively resilient to transformations in the stimuli. There is emerging recognition that ventral temporal object representations are forged via interactions among a broader network of regions that receive independent inputs about a stimulus. Here we test whether ventral temporal representations are causally modulated by disrupting processing in distal associative areas. We used transcranial direct current stimulation (tDCS) to stimulate left parietal areas and functional Magnetic Resonance Imaging (fMRI) to measure object-related neural responses in the ventral stream. We find that representational geometries and category discriminability within ventral temporal cortex, as well as functional connectivity between ventral temporal and parietal areas, are enhanced by anodal compared to cathodal stimulation of left parietal associative cortex. These results demonstrate that ventral temporal representations can be causally modulated by processing distal to the ventral stream.

What Role Does "Elongation" Play in "Tool-Specific" Activation and Connectivity in the Dorsal and Ventral Visual Streams?

Images of tools induce stronger activation than images of nontools in a left-lateralized network that includes ventral-stream areas implicated in tool identification and dorsal-stream areas implicated in tool manipulation. Importantly, however, graspable tools tend to be elongated rather than stubby, and so the tool-selective responses in some of these areas may, to some extent, reflect sensitivity to elongation rather than "toolness" per se. Using functional magnetic resonance imaging, we investigated the role of elongation in driving tool-specific activation in the 2 streams and their interconnections. We showed that in some "tool-selective" areas, the coding of toolness and elongation coexisted, but in others, elongation and toolness were coded independently. Psychophysiological interaction analysis revealed that toolness, but not elongation, had a strong modulation of the connectivity between the ventral and dorsal streams. Dynamic causal modeling revealed that viewing tools (either elongated or stubby) increased the connectivity from the ventral- to the dorsal-stream tool-selective areas, but only viewing elongated tools increased the reciprocal connectivity between these areas. Overall, these data disentangle how toolness and elongation affect the activation and connectivity of the tool network and help to resolve recent controversies regarding the relative contribution of "toolness" versus elongation in driving dorsal-stream "tool-selective" areas.

Direct electrical stimulation of the left frontal aslant tract disrupts sentence planning without affecting articulation

Sentence production involves mapping from deep structures that specify meaning and thematic roles to surface structures that specify the order and sequencing of production ready elements. We propose that the frontal aslant tract is a key pathway for sequencing complex actions with deep hierarchical structure. In the domain of language, and primarily with respect to the left FAT, we refer to this as the 'Syntagmatic Constraints On Positional Elements' (SCOPE) hypothesis. One prediction made by the SCOPE hypothesis is that disruption of the frontal aslant tract should disrupt sentence production at grammatical phrase boundaries, with no disruption of articulatory processes.  We test this prediction in a patient undergoing direct electrical stimulation mapping of the frontal aslant tract during an awake craniotomy to remove a left frontal brain tumor. We found that stimulation of the left FAT prolonged inter-word durations at the start of grammatical phrases, while inter-word durations internal to noun phrases were unaffected, and there was no effect on intra-word articulatory duration. These results provide initial support for the SCOPE hypothesis, and motivate novel directions for future research to explore the functions of this recently discovered component of the language system.

Gesturing tool use and tool transport actions modulates inferior parietal functional connectivity with the dorsal and ventral object processing pathways

Interacting with manipulable objects (tools) requires the integration of diverse computations supported by anatomically remote regions. Previous functional neuroimaging research has demonstrated the left supramarginal (SMG) exhibits functional connectivity to both ventral and dorsal pathways, supporting the integration of ventrally-mediated tool properties and conceptual knowledge with dorsally-computed volumetric and structural representations of tools. This architecture affords us the opportunity to test whether interactions between the left SMG, ventral visual pathway, and dorsal visual pathway are differentially modulated when participants plan and generate tool-directed gestures emphasizing functional manipulation (tool use gesturing) or structure-based grasping (tool transport gesturing). We found that functional connectivity between the left SMG, ventral temporal cortex (bilateral fusiform gyri), and dorsal visual pathway (left superior parietal lobule/posterior intraparietal sulcus) was maximal for tool transport planning and gesturing, whereas functional connectivity between the left SMG, left ventral anterior temporal lobe, and left frontal operculum was maximal for tool use planning and gesturing. These results demonstrate that functional connectivity to the left SMG is differentially modulated by tool use and tool transport gesturing, suggesting that distinct tool features computed by the two object processing pathways are integrated in the parietal lobe in the service of tool-directed action.

The dominant role of functional action representation in object recognition

Action representation of manipulable objects has been found to be involved in object recognition. Recently, studies have indicated the existence of two distinct action systems: functional action specifying how to use an object and structural action concerning how to grasp an object. Despite evidence revealing the systems' anatomical and functional differences, few preceding studies have dissociated their respective roles in object recognition. The present study aimed to tease apart their roles in the recognition of manipulable objects with a priming paradigm. Specifically, we used static stimuli (photos, Experiments 1 and 2) and dynamic stimuli (video clips, Experiments 3 and 4) depicting functional and structural action hand gestures as primes and measured the magnitude of functional and structural action priming effect in object recognition. We found that static and dynamic priming stimuli induced a robust action priming effect only for functional action prime-target pairs. Naming latencies of the target objects were shorter when functional action representations of the prime and target were congruent than when they were incongruent. Moreover, as compared to static priming photos, dynamic priming stimuli induced a larger functional action priming effect. By contrast, neither static nor dynamic priming stimuli elicited a structural action priming effect. Behavioral data from our four experiments provide consistent evidence of the dominant role of functional action representation in the recognition of manipulable objects, suggesting that action knowledge regarding how to use rather than grasp an object is more likely an intrinsic component of objects' conceptual representation.

Decoding Brain States for Planning Functional Grasps of Tools: A Functional Magnetic Resonance Imaging Multivoxel Pattern Analysis Study

OBJECTIVES

We used multivoxel pattern analysis (MVPA) to investigate neural selectivity for grasp planning within the left-lateralized temporo-parieto-frontal network of areas (praxis representation network, PRN) typically associated with tool-related actions, as studied with traditional neuroimaging contrasts.

METHODS

We used data from 20 participants whose task was to plan functional grasps of tools, with either right or left hands. Region of interest and whole-brain searchlight analyses were performed to show task-related neural patterns.

RESULTS

MVPA revealed significant contributions to functional grasp planning from the anterior intraparietal sulcus (aIPS) and its immediate vicinities, supplemented by inputs from posterior subdivisions of IPS, and the ventral lateral occipital complex (vLOC). Moreover, greater local selectivity was demonstrated in areas near the superior parieto-occipital cortex and dorsal premotor cortex, putatively forming the dorso-dorsal stream.

CONCLUSIONS

A contribution from aIPS, consistent with its role in prospective grasp formation and/or encoding of relevant tool properties (e.g., potential graspable parts), is likely to accompany the retrieval of manipulation and/or mechanical knowledge subserved by the supramarginal gyrus for achieving action goals. An involvement of vLOC indicates that MVPA is particularly sensitive to coding of object properties, their identities and even functions, for a support of grip formation. Finally, the engagement of the superior parieto-frontal regions as revealed by MVPA is consistent with their selectivity for transient features of tools (i.e., variable affordances) for anticipatory hand postures. These outcomes support the notion that, compared to traditional approaches, MVPA can reveal more fine-grained patterns of neural activity. (JINS, 2018, 24, 1013-1025).

Action and semantic tool knowledge - Effective connectivity in the underlying neural networks

Evidence from neuropsychological and imaging studies indicate that action and semantic knowledge about tools draw upon distinct neural substrates, but little is known about the underlying interregional effective connectivity. With fMRI and dynamic causal modeling (DCM) we investigated effective connectivity in the left-hemisphere (LH) while subjects performed (i) a function knowledge and (ii) a value knowledge task, both addressing semantic tool knowledge, and (iii) a manipulation (action) knowledge task. Overall, the results indicate crosstalk between action nodes and semantic nodes. Interestingly, effective connectivity was weakened between semantic nodes and action nodes during the manipulation task. Furthermore, pronounced modulations of effective connectivity within the fronto-parietal action system of the LH (comprising lateral occipito-temporal cortex, intraparietal sulcus, supramarginal gyrus, inferior frontal gyrus) were observed in a bidirectional manner during the processing of action knowledge. In contrast, the function and value knowledge tasks resulted in a significant strengthening of the effective connectivity between visual cortex and fusiform gyrus. Importantly, this modulation was present in both semantic tasks, indicating that processing different aspects of semantic knowledge about tools evokes similar effective connectivity patterns. Data revealed that interregional effective connectivity during the processing of tool knowledge occurred in a bidirectional manner with a weakening of connectivity between areas engaged in action and semantic knowledge about tools during the processing of action knowledge. Moreover, different semantic tool knowledge tasks elicited similar effective connectivity patterns.

Bilateral functional connectivity at rest predicts apraxic symptoms after left hemisphere stroke

Increasing evidence indicates that focal lesions following stroke cause alterations in connectivity among functional brain networks. Functional connectivity between hemispheres has been shown to be particularly critical for predicting stroke-related behavioral deficits and recovery of motor function and attention. Much less is known, however, about the relevance of interhemispheric functional connectivity for cognitive abilities like praxis that rely on strongly lateralized brain networks. In the current study, we examine correlations between symptoms of apraxia-a disorder of skilled action that cannot be attributed to lower-level sensory or motor impairments-and spontaneous, resting brain activity in functional MRI in chronic left hemisphere stroke patients and neurologically-intact control participants. Using a data-driven approach, we identified 32 regions-of-interest in which pairwise functional connectivity correlated with two distinct measures of apraxia, even when controlling for age, head motion, lesion volume, and other artifacts: overall ability to pantomime the typical use of a tool, and disproportionate difficulty pantomiming the use of tools associated with different, competing use and grasp-to-move actions (e.g., setting a kitchen timer versus picking it up). Better performance on both measures correlated with stronger interhemispheric functional connectivity. Relevant regions in the right hemisphere were often homologous to left hemisphere areas associated with tool use and action. Additionally, relative to overall pantomime accuracy, disproportionate difficulty pantomiming the use of tools associated with competing use and grasp actions was associated with weakened functional connectivity among a more strongly left-lateralized and peri-Sylvian set of brain regions. Finally, patient performance on both measures of apraxia was best predicted by a model that incorporated information about lesion location and functional connectivity, and functional connectivity continued to explain unique variance in behavior even after accounting for lesion loci. These results indicate that interhemispheric functional connectivity is relevant even for a strongly lateralized cognitive ability like praxis and emphasize the importance of the right hemisphere in skilled action.

Task- and domain-specific modulation of functional connectivity in the ventral and dorsal object-processing pathways

A whole-brain network of regions collectively supports the ability to recognize and use objects-the Tool Processing Network. Little is known about how functional interactions within the Tool Processing Network are modulated in a task-dependent manner. We designed an fMRI experiment in which participants were required to either generate object pantomimes or to carry out a picture matching task over the same images of tools, while holding all aspects of stimulus presentation constant across the tasks. The Tool Processing Network was defined with an independent functional localizer, and functional connectivity within the network was measured during the pantomime and picture matching tasks. Relative to tool picture matching, tool pantomiming led to an increase in functional connectivity between ventral stream regions and left parietal and frontal-motor areas; in contrast, the matching task was associated with an increase in functional connectivity among regions in ventral temporo-occipital cortex, and between ventral temporal regions and the left inferior parietal lobule. Graph-theory analyses over the functional connectivity data indicated that the left premotor cortex and left lateral occipital complex were hub-like (exhibited high betweenness centrality) during tool pantomiming, while ventral stream regions (left medial fusiform gyrus and left posterior middle temporal gyrus) were hub-like during the picture matching task. These results demonstrate task-specific modulation of functional interactions among a common set of regions, and indicate dynamic coupling of anatomically remote regions in task-dependent manner.

Visual and visuomotor processing of hands and tools as a case study of cross talk between the dorsal and ventral streams

A major principle of organization of the visual system is between a dorsal stream that processes visuomotor information and a ventral stream that supports object recognition. Most research has focused on dissociating processing across these two streams. Here we focus on how the two streams interact. We tested neurologically-intact and impaired participants in an object categorization task over two classes of objects that depend on processing within both streams-hands and tools. We measured how unconscious processing of images from one of these categories (e.g., tools) affects the recognition of images from the other category (i.e., hands). Our findings with neurologically-intact participants demonstrated that processing an image of a hand hampers the subsequent processing of an image of a tool, and vice versa. These results were not present in apraxic patients (N = 3). These findings suggest local and global inhibitory processes working in tandem to co-register information across the two streams.

A Role for the Frontal Aslant Tract in Speech Planning: A Neurosurgical Case Study

Frontal and temporal white matter pathways play key roles in language processing, but the specific computations supported by different tracts remain a matter of study. A role in speech planning has been proposed for a recently described pathway, the frontal aslant tract (FAT), which connects the posterior inferior frontal gyrus to the pre-SMA. Here, we use longitudinal functional and structural MRI and behavioral testing to evaluate the behavioral consequences of a lesion to the left FAT that was incurred during surgical resection of a frontal glioma in a 60-year-old woman, Patient AF. The pattern of performance in AF is compared, using the same measures, with that in a 37-year-old individual who underwent a left anterior temporal resection and hippocampectomy (Patient AG). AF and AG were both cognitively intact preoperatively but exhibited specific and doubly dissociable behavioral deficits postoperatively: AF had dysfluent speech but no word finding difficulty, whereas AG had word finding difficulty but otherwise fluent speech. Probabilistic tractography showed that the left FAT was lesioned postoperatively in AF (but not AG) whereas the inferior longitudinal fasciculus was lesioned in AG (but not AF). Those structural changes were supported by corresponding changes in functional connectivity to the posterior inferior frontal gyrus: decreased functional connectivity postoperatively between the posterior inferior frontal gyrus and pre-SMA in AF (but not AG) and decreased functional connectivity between the posterior inferior frontal gyrus and the middle temporal gyrus in AG (but not AF). We suggest from these findings that the left FAT serves as a key communicative link between sentence planning and lexical access processes.

More than Action: The Dorsal Pathway Contributes to the Perception of 3-D Structure

An evolving view in cognitive neuroscience is that the dorsal visual pathway not only plays a key role in visuomotor behavior but that it also contributes functionally to the recognition of objects. To characterize the nature of the object representations derived by the dorsal pathway, we assessed perceptual performance in the context of the continuous flash suppression paradigm, which suppresses object processing in the ventral pathway while sparing computation in the dorsal pathway. In a series of experiments, prime stimuli, which were rendered imperceptible by the continuous flash suppression, still contributed to perceptual decisions related to the subsequent perceptible target stimuli. However, the contribution of the prime to perception was contingent on the prime's structural coherence, in that a perceptual advantage was observed only for targets primed by objects with legitimate 3-D structure. Finally, we obtained additional evidence to demonstrate that the processing of the suppressed objects was contingent on the magnocellular, rather than the parvocellular, system, further linking the processing of the suppressed stimuli to the dorsal pathway. Together, these results provide novel evidence that the dorsal pathway does not only support visuomotor control but, rather, that it also derives the structural description of 3-D objects and contributes to shape perception.

Differential Tuning of Ventral and Dorsal Streams during the Generation of Common and Uncommon Tool Uses

Our use of tools is situated in different contexts. Prior evidence suggests that diverse regions within the ventral and dorsal streams represent information supporting common tool use. However, given the flexibility of object concepts, these regions may be tuned to different types of information when generating novel or uncommon uses of tools. To investigate this, we collected fMRI data from participants who reported common or uncommon tool uses in response to visually presented familiar objects. We performed a pattern dissimilarity analysis in which we correlated cortical patterns with behavioral measures of visual, action, and category information. The results showed that evoked cortical patterns within the dorsal tool use network reflected action and visual information to a greater extent in the uncommon use group, whereas evoked neural patterns within the ventral tool use network reflected categorical information more strongly in the common use group. These results reveal the flexibility of cortical representations of tool use and the situated nature of cortical representations more generally.

Planning Functional Grasps of Simple Tools Invokes the Hand-independent Praxis Representation Network: An fMRI Study

OBJECTIVES

Neuropsychological and neuroimaging evidence indicates that tool use knowledge and abilities are represented in the praxis representation network (PRN) of the left cerebral hemisphere. We investigated whether PRN would also underlie the planning of function-appropriate grasps of tools, even though such an assumption is inconsistent with some neuropsychological evidence for independent representations of tool grasping and skilled tool use.

METHODS

Twenty right-handed participants were tested in an event-related functional magnetic resonance imaging (fMRI) study wherein they planned functionally appropriate grasps of tools versus grasps of non-tools matched for size and/or complexity, and later executed the pantomimed grasps of these objects. The dominant right, and non-dominant left hands were used in two different sessions counterbalanced across participants. The tool and non-tool stimuli were presented at three different orientations, some requiring uncomfortable hand rotations for effective grips, with the difficulty matched for both hands.

RESULTS

Planning functional grasps of tools (vs. non-tools) was associated with significant asymmetrical increases of activity in the temporo/occipital-parieto-frontal networks. The greater involvement of the left hemisphere PRN was particularly evident when hand movement kinematics (including wrist rotations) for grasping tools and non-tools were matched. The networks engaged in the task for the dominant and non-dominant hand were virtually identical. The differences in neural activity for the two object categories disappeared during grasp execution.

CONCLUSIONS

The greater hand-independent engagement of the left-hemisphere praxis representation network for planning functional grasps reveals a genuine effect of an early affordance/function-based visual processing of tools. (JINS, 2017, 23, 108-120).

A few words on differentiating magno- and parvocellular contributions to vision on the basis of temporal frequency

A number of authors have proposed that changes in temporal frequency within the range of 0-30Hz may be used to differentiate contributions from the magno- and parvocellular systems. The present analyses estimate the percentage of active magnocellular cells as a function of frequency based on published cut-off values for magno- and parvocellular cells. These analyses indicate that varying the temporal frequency over the range of 0-30Hz has little effect upon the percentage of active magnocellular cells. The analyses were also carried out for a series of hypothetical cut-off frequencies and standard deviations of these frequencies for magnocellular cells. The results of these simulations indicate that even large alterations in these values do not alter the above conclusion to a noteworthy extent.

'What' Is Happening in the Dorsal Visual Pathway

The cortical visual system is almost universally thought to be segregated into two anatomically and functionally distinct pathways: a ventral occipitotemporal pathway that subserves object perception, and a dorsal occipitoparietal pathway that subserves object localization and visually guided action. Accumulating evidence from both human and non-human primate studies, however, challenges this binary distinction and suggests that regions in the dorsal pathway contain object representations that are independent of those in ventral cortex and that play a functional role in object perception. We review here the evidence implicating dorsal object representations, and we propose an account of the anatomical organization, functional contributions, and origins of these representations in the service of perception.