Grasping in the dark activates early visual cortices

Orientation representation in human visual cortices: contributions of non-visual information and action-related process

Orientation processing in the human brain plays a crucial role in guiding grasping actions toward an object. Remarkably, despite the absence of visual input, the human visual cortex can still process orientation information. Instead of visual input, non-visual information, including tactile and proprioceptive sensory input from the hand and arm, as well as feedback from action-related processes, may contribute to orientation processing. However, the precise mechanisms by which the visual cortices process orientation information in the context of non-visual sensory input and action-related processes remain to be elucidated. Thus, our study examined the orientation representation within the visual cortices by analyzing the blood-oxygenation-level-dependent (BOLD) signals under four action conditions: direct grasp (DG), air grasp (AG), non-grasp (NG), and uninformed grasp (UG). The images of the cylindrical object were shown at +45° or - 45° orientations, corresponding to those of the real object to be grasped with the whole-hand gesture. Participants judged their orientation under all conditions. Grasping was performed without online visual feedback of the hand and object. The purpose of this design was to investigate the visual areas under conditions involving tactile feedback, proprioception, and action-related processes. To address this, a multivariate pattern analysis was used to examine the differences among the cortical patterns of the four action conditions in orientation representation by classification. Overall, significant decoding accuracy over chance level was discovered for the DG; however, during AG, only the early visual areas showed significant accuracy, suggesting that the object's tactile feedback influences the orientation process in higher visual areas. The NG showed no statistical significance in any area, indicating that without the grasping action, visual input does not contribute to cortical pattern representation. Interestingly, only the dorsal and ventral divisions of the third visual area (V3d and V3v) showed significant decoding accuracy during the UG despite the absence of visual instructions, suggesting that the orientation representation was derived from action-related processes in V3d and visual recognition of object visualization in V3v. The processing of orientation information during non-visually guided grasping of objects relies on other non-visual sources and is specifically divided by the purpose of action or recognition.

Neural and behavioral signatures of the multidimensionality of manipulable object processing

Understanding how we recognize objects requires unravelling the variables that govern the way we think about objects and the neural organization of object representations. A tenable hypothesis is that the organization of object knowledge follows key object-related dimensions. Here, we explored, behaviorally and neurally, the multidimensionality of object processing. We focused on within-domain object information as a proxy for the decisions we typically engage in our daily lives - e.g., identifying a hammer in the context of other tools. We extracted object-related dimensions from subjective human judgments on a set of manipulable objects. We show that the extracted dimensions are cognitively interpretable and relevant - i.e., participants are able to consistently label them, and these dimensions can guide object categorization; and are important for the neural organization of knowledge - i.e., they predict neural signals elicited by manipulable objects. This shows that multidimensionality is a hallmark of the organization of manipulable object knowledge.

Ultra-high field fMRI identifies an action-observation network in the common marmoset

The observation of others' actions activates a network of temporal, parietal and premotor/prefrontal areas in macaque monkeys and humans. This action-observation network (AON) has been shown to play important roles in social action monitoring, learning by imitation, and social cognition in both species. It is unclear whether a similar network exists in New-World primates, which separated from Old-Word primates ~35 million years ago. Here we used ultra-high field fMRI at 9.4 T in awake common marmosets (Callithrix jacchus) while they watched videos depicting goal-directed (grasping food) or non-goal-directed actions. The observation of goal-directed actions activates a temporo-parieto-frontal network, including areas 6 and 45 in premotor/prefrontal cortices, areas PGa-IPa, FST and TE in occipito-temporal region and areas V6A, MIP, LIP and PG in the occipito-parietal cortex. These results show overlap with the humans and macaques' AON, demonstrating the existence of an evolutionarily conserved network that likely predates the separation of Old and New-World primates.

2-Deoxy-D-Glucose: A Novel Pharmacological Agent for Killing Hypoxic Tumor Cells, Oxygen Dependence-Lowering in Covid-19, and Other Pharmacological Activities

The nonmetabolizable glucose analog 2-deoxy-D-glucose (2-DG) has shown promising pharmacological activities, including inhibition of cancerous cell growth and N-glycosylation. It has been used as a glycolysis inhibitor and as a potential energy restriction mimetic agent, inhibiting pathogen-associated molecular patterns. Radioisotope derivatives of 2-DG have applications as tracers. Recently, 2-DG has been used as an anti-COVID-19 drug to lower the need for supplemental oxygen. In the present review, various pharmaceutical properties of 2-DG are discussed.

Engaging distributed cortical and cerebellar networks through motor execution, observation, and imagery

When we interact with the environment around us, we are sometimes active participants, making directed physical motor movements and other times only mentally engaging with our environment, taking in sensory information and internally planning our next move without directed physical movement. Traditionally, cortical motor regions and key subcortical structures such as the cerebellum have been tightly linked to motor initiation, coordination, and directed motor behavior. However, recent neuroimaging studies have noted the activation of the cerebellum and wider cortical networks specifically during various forms of motor processing, including the observations of actions and mental rehearsal of movements through motor imagery. This phenomenon of cognitive engagement of traditional motor networks raises the question of how these brain regions are involved in the initiation of movement without physical motor output. Here, we will review evidence for distributed brain network activation during motor execution, observation, and imagery in human neuroimaging studies as well as the potential for cerebellar involvement specifically in motor-related cognition. Converging evidence suggests that a common global brain network is involved in both movement execution and motor observation or imagery, with specific task-dependent shifts in these global activation patterns. We will further discuss underlying cross-species anatomical support for these cognitive motor-related functions as well as the role of cerebrocerebellar communication during action observation and motor imagery.

The role of temporal cortex in the control of attention

Attention is an indispensable component of active vision. Contrary to the widely accepted notion that temporal cortex processing primarily focusses on passive object recognition, a series of very recent studies emphasize the role of temporal cortex structures, specifically the superior temporal sulcus (STS) and inferotemporal (IT) cortex, in guiding attention and implementing cognitive programs relevant for behavioral tasks. The goal of this theoretical paper is to advance the hypothesis that the temporal cortex attention network (TAN) entails necessary components to actively participate in attentional control in a flexible task-dependent manner. First, we will briefly discuss the general architecture of the temporal cortex with a focus on the STS and IT cortex of monkeys and their modulation with attention. Then we will review evidence from behavioral and neurophysiological studies that support their guidance of attention in the presence of cognitive control signals. Next, we propose a mechanistic framework for executive control of attention in the temporal cortex. Finally, we summarize the role of temporal cortex in implementing cognitive programs and discuss how they contribute to the dynamic nature of visual attention to ensure flexible behavior.

Functional Imaging of the Cerebellum during Action Execution and Observation

We employed the ¹⁴C-deoxyglucose autoradiographic method to map the activity in the cerebellar cortex of rhesus monkeys that performed forelimb movements either in the light or in the dark and of monkeys that observed forelimb movements executed by a human experimenter. The execution of forelimb movements, both in the light and in the dark, activated the forelimb representations in the cerebellar hemispheric extensions of 1) vermian lobules IV-VI and 2) vermian lobule VIIIB, ipsilaterally to the moving forelimb. Activations in the former forelimb representation involved both a paravermal and a lateral hemispheric region. Also, Crus II posterior in the ansiform lobule (the hemispheric expansion of lobule VIIB) was activated bilaterally by execution of movements in the light but not in the dark. Action observation activated the lateral-most region of the forelimb representation in the lateral hemispheric extension of vermian lobules IV-VI, as well as the crus II posterior, bilaterally. Our results demonstrate that the cerebellar cortex, in addition to its involvement in the generation of movement, is also recruited in the perception of observed movements. Moreover, our findings suggest a modularity gradient in the primate cerebellar cortex, which progresses from unimodal (medially) to multimodal (laterally) functional areas.

Action perception and motor imagery: Mental practice of action

Motor cognition is related to the planning and generation of actions as well as to the recognition and imagination of motor acts. Recently, there is evidence that the motor system participates not only in overt actions but also in mental processes supporting covert actions. Within this framework, we have investigated the cortical areas engaged in execution, observation, and imagination of the same action, by the use of the high resolution quantitative ¹⁴C-deoxyglucose method in monkeys and by fMRI in humans, throughout the entire primate brain. Our data demonstrated that observing or imagining an action excites virtually the same sensory-motor cortical network which supports execution of that same action. In general agreement with the results of five relevant meta-analyses that we discuss extensively, our results imply mental practice, i.e. internal rehearsal of the action including movements and their sensory effects. We suggest that we actively perceive and imagine actions by selecting and running off-line restored sensory-motor memories, by mentally simulating the actions. We provide empirical evidence that mental simulation of actions underlies motor cognition, and conceptual representations are grounded in sensory-motor codes. Motor cognition may, therefore, be embodied and modal. Finally, we consider questions regarding agency attribution and the possible causal or epiphenomenal role the involved sensory-motor network could play in motor cognition.

The Role of the Prefrontal Cortex in Action Perception

In an attempt to shed light on the role of the prefrontal cortex in action perception, we used the quantitative 14C-deoxyglucose method to reveal the effects elicited by reaching-to-grasp in the light or in the dark and by observation of the same action executed by an external agent. We analyzed the cortical areas in the principal sulcus, the superior and inferior lateral prefrontal convexities and the orbitofrontal cortex of monkeys. We found that execution in the light and observation activated in common most of the lateral prefrontal and orbitofrontal cortical areas, with the exception of 9/46-dorsal activated exclusively for observation and 9/46-ventral, 11 and 13 activated only for execution. Execution in the dark implicated only the ventral bank of the principal sulcus and its adjacent inferior convexity along with areas 47/12-dorsal and 13, whereas execution in the light activated both banks of the principal sulcus and both superior and inferior convexities along with areas 10 and 11. Our results demonstrate that the prefrontal cortex integrates information in the service of both action generation and action perception, and are discussed in relation to its contribution in movement suppression during action observation and in attribution of action to the correct agent.

Sensory Substitution and Multimodal Mental Imagery

Many philosophers use findings about sensory substitution devices in the grand debate about how we should individuate the senses. The big question is this: Is "vision" assisted by (tactile) sensory substitution really vision? Or is it tactile perception? Or some sui generis novel form of perception? My claim is that sensory substitution assisted "vision" is neither vision nor tactile perception, because it is not perception at all. It is mental imagery: visual mental imagery triggered by tactile sensory stimulation. But it is a special form of mental imagery that is triggered by corresponding sensory stimulation in a different sense modality, which I call "multimodal mental imagery."

Neural activity in the medial parietal area V6A while grasping with or without visual feedback

Recent works have reported that grasping movements are controlled not only by the dorsolateral visual stream, as generally thought, but also by the dorsomedial visual stream, and in particular by the medial posterior parietal area V6A. To date, the grasping activity of V6A neurons has been studied only in darkness. Here we studied the effect of visual feedback on grasp-related discharges of V6A neurons while the monkey was preparing and executing the grasping of a handle. We found that V6A grasping activity could be excited or inhibited by visual information. The neural population was divided into Visual, Motor, and Visuomotor cells. The majority of Visual and Visuomotor neurons did not respond to passive observation of the handle, suggesting that vision of action, rather than object vision, is the most effective factor. The present findings highlight the role of the dorsomedial visual stream in integrating visual and motor signals to monitor and correct grasping.

Involvement of the superior temporal cortex in action execution and action observation

The role of the superior temporal sulcus (STs) in action execution and action observation remains unsettled. In an attempt to shed more light on the matter, we used the quantitative method of (14)C-deoxyglucose to reveal changes in activity, in the cortex of STs and adjacent inferior and superior temporal convexities of monkeys, elicited by reaching-to-grasp in the light or in the dark and by observation of the same action executed by an external agent. We found that observation of reaching-to-grasp activated the components of the superior temporal polysensory area [STP; including temporo-parieto-occipital association area (TPO), PGa, and IPa], the motion complex [including medial superior temporal area (MST), fundus of superior temporal area (FST), and dorsal and ventral parts of the middle temporal area (MTd and MTv, respectively)], and area TS2. A significant part of most of these activations was associated with observation of the goal-directed action, and a smaller part with the perception of arm-motion. Execution of reaching-to-grasp in the light-activated areas TS2, STP partially and marginally, and MT compared with the fixation but not to the arm-motion control. Consequently, MT-activation is associated with the arm-motion and not with the purposeful action. Finally, reaching-to-grasp in complete darkness activated all components of the motion complex. Conclusively, lack of visibility of our own actions involves the motion complex, whereas observation of others' actions engages area STP and the motion complex. Our previous and present findings together suggest that sensory effects are interweaved with motor commands in integrated action codes, and observation of an action or its execution in complete darkness triggers the retrieval of the visual representation of the action.

Action simulation in hallucination-prone adolescents

Theoretical and empirical accounts suggest that impairments in self-other discrimination processes are likely to promote the expression of hallucinations. Studies using a variety of paradigms involving self-performed actions argue in favor of perspective taking confusion in hallucination-prone subjects. However, our understanding of such processes during adolescence is still at an early stage. The present study thus aims (1) to delineate the neural correlates sustaining mental simulation of actions involving self-performed actions (first-person perspective; 1PP) and other-performed actions (third-person perspective; 3PP) during adolescence (2) to identify atypical activation patterns during 1PP/3PP mental simulation of actions in hallucination-prone adolescents (3) to examine whether differential risk for schizophrenia (clinical vs. genetic) is also associated with differential impairments in the 1PP/3PP mental simulation of actions during adolescence. Twenty-two typically developing controls (Control group; 6 females), 12 hallucination-prone adolescents [auditory hallucination (AH) group; 7 females] and 13 adolescents with 22q11.2 Deletion Syndrome (22q11.2DS group; 4 females) were included in the study. During the fMRI task, subjects were presented with a cue (self-other priming cues) indicating to perform the task using either a first person perspective (“you”-1PP) or a third person perspective (“best friend”-3PP) and then they were asked to mentally simulate actions based on the type of cue. Hallucination-proneness was assessed using a self-report questionnaire [Cardiff Anomalous Perception Scale (CAPS)]. Our results indicated that atypical patterns of cerebral activation, particularly in the key areas of self-other distinction, were found in both groups at risk for auditory hallucinations (AHs and 22q11.2DS). More precisely, adolescents in the AH group presented decreased activations in the right middle occipital gyrus BA19, left cingulate gyrus BA31, and right precuneus BA31 for the 3PP > 1PP contrast. Adolescents in the 22q11.2DS group presented decreased activations in the right superior occipital gyrus BA19, left caudate tail and left precuneus BA7 for the 3PP > 1PP contrast. In comparison to the Control group, only the 22q11.2DS adolescents showed a decreased activation for other-related cues (prime other > prime self contrast) in areas of visual imagery, episodic memory and social cognition. This study characterizes the neural correlates of mental imagery for actions during adolescence, and suggests that a differential risk for hallucination-proneness (clinical vs. genetic) is associated to similar patterns of atypical activations in key areas sustaining self-other discrimination processes. These observations may provide relevant information for future research and prevention strategies with regards to hallucination-proneness during adolescence.

Disparity-specific spatial interactions: evidence from EEG source imaging

Using cortical source estimation techniques based on high-density EEG and fMRI measurements in humans, we measured how a disparity-defined surround influenced the responses to the changing disparity of a central disk within five visual ROIs: V1, V4, lateral occipital complex (LOC), hMT+, and V3A. The responses in the V1 ROI were not consistently affected either by changes in the characteristics of the surround (correlated or uncorrelated) or by its disparity value, consistent with V1 being responsive only to absolute, not relative, disparity. Correlation in the surround increased the responses in the V4, LOC, and hMT+ ROIs over those measured with the uncorrelated surround. Thus, these extrastriate areas contain neurons that are sensitive to disparity differences. However, their evoked responses did not vary systematically with the surround disparity. Responses in the V3A ROI, in contrast, were increased by correlation in the surround and varied with its disparity. We modeled these V3A responses as attributable to a gain modulation of the absolute disparity response, where the gain amplitude is proportional to the center-surround disparity difference. An additional experiment identified a nonlinear center-surround interaction in V3A that facilitates the responses when center and surround are misaligned but suppresses it when they share the same disparity plane.