Visual pathways to perception and action

Dissociating representations of affect and motion in visual cortices

While a delicious dessert being presented to us may elicit strong feelings of happiness and excitement, the same treat falling slowly away can lead to sadness and disappointment. Our emotional response to the item depends on its visual motion direction. Despite this importance, it remains unclear whether (and how) cortical areas devoted to decoding motion direction represents or integrates emotion with perceived motion direction. Motion-selective visual area V5/MT+ sits, both functionally and anatomically, at the nexus of dorsal and ventral visual streams. These pathways, however, differ in how they are modulated by emotional cues. The current study was designed to disentangle how emotion and motion perception interact, as well as use emotion-dependent modulation of visual cortices to understand the relation of V5/MT+ to canonical processing streams. During functional magnetic resonance imaging (fMRI), approaching, receding, or static motion after-effects (MAEs) were induced on stationary positive, negative, and neutral stimuli. An independent localizer scan was conducted to identify the visual-motion area V5/MT+. Through univariate and multivariate analyses, we demonstrated that emotion representations in V5/MT+ share a more similar response profile to that observed in ventral visual than dorsal, visual structures. Specifically, V5/MT+ and ventral structures were sensitive to the emotional content of visual stimuli, whereas dorsal visual structures were not. Overall, this work highlights the critical role of V5/MT+ in the representation and processing of visually acquired emotional content. It further suggests a role for this region in utilizing affectively salient visual information to augment motion perception of biologically relevant stimuli.

An Evidence-Based Approach to Augmentative and Alternative Communication Design for Individuals With Cortical Visual Impairment

PURPOSE

This article highlights the contributions of three pillars of an evidence-based practice approach (service providers, researchers, and families/clients) in the development of a framework to offer a way forward for professionals, families, and technology companies to support optimal visual and communication outcomes of individuals with cortical visual impairment (CVI) who use augmentative and alternative communication (AAC). By providing available research findings as well as practical information and lived experiences, the article offers clinical considerations and design features that can lead to addressing the unique needs of these individuals.

METHOD

This article reviews literature concerning what is known about CVI and describes in detail and from multiple viewpoints important features required in AAC systems to support individuals with CVI and enable them to communicate effectively.

RESULTS

Components necessary for teams, communication partners, and AAC designers to optimize AAC system design in CVI are presented using external research evidence as internal evidence from lived experience to support their importance.

CONCLUSIONS

An AAC system design that is tailored to the unique visual processing characteristics in CVI is likely to promote positive communication outcomes. The presentation of the lived experience of an individual who has CVI themselves illustrates the need for individualized assessments and interventions that incorporate and reflect the research presented here.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.23902239.

Training for "Worst-Case" Scenarios in Sidestepping: Unifying Strength and Conditioning and Perception-Action Approaches

Sidesteps can impose high demands on the knee joint and lead to non-contact anterior cruciate ligament (ACL) injuries. Understanding how different constraints shape an athlete's movement strategy and the associated joint demands can help design training interventions to increase injury resilience. Motor capacities, such as muscular strength and power, act as boundaries for the safe execution of perceptual-motor skills and co-determine the emergence of unique movement strategies. Increasing single- and multi-joint strength enables a broader solution space for movement strategies and increases load tolerance. Manipulating task constraints during sidesteps can be used in the training process to systematically expose athletes to increasing demands (on the knee joint or any joint or structure) in preparation for "worst-case" scenarios. In particular, the type and timing of information available influence the preparation time, subsequently affecting the movement strategy and the associated magnitude of external knee joint loading (e.g., knee valgus moment). While an athlete's perceptual-cognitive skills contribute to the preparation time during in situ scenarios, attempts to further improve those skills with the aim of increasing athlete preparation time prior to "worst-case" scenarios are yet to demonstrate conclusive evidence of transfer to on-field situations. Therefore, in the current article, we reflect on the impact of different interacting constraints that influence the execution of sidesteps during in situ scenarios and impose high demands on the knee joint. Subsequently, we discuss how an integrated perspective, drawing on knowledge and perspectives from strength and conditioning and perception-action, may enhance an athlete's ability to withstand "worst-case" scenarios and adapt to perform varied movement executions when sidestepping.

The cost of aiming for the best answers: Inconsistent perception

The laws of physics and mathematics describe the world we live in as internally consistent. As these rules provide a very effective description, and our interaction with the world is also very effective, it seems self-evident that our perception follows these laws. As a result, when trying to explain imperfections in perception, we tend to impose consistency and introduce concepts such as deformations of visual space. In this review, we provide numerous examples that show that in many situations we perceive related attributes to have inconsistent values. We discuss how our tendency to assume consistency leads to erroneous conclusions on how we process sensory information. We propose that perception is not about creating a consistent internal representation of the outside world, but about answering specific questions about the outside world. As the information used to answer a question is specific for that question, this naturally leads to inconsistencies in perception and to an apparent dissociation between some perceptual judgments and related actions.

Causal involvement of the left angular gyrus in higher functions as revealed by transcranial magnetic stimulation: a systematic review

Transcranial magnetic stimulation (TMS) is a non-invasive technique that can transiently interfere with local cortical functioning, thus enabling inferences of causal left AG involvement in higher functions from experimentation with healthy participants. Here, we examine 35 studies that measure behavioural outcomes soon after or during targeting TMS to the left AG, by design and as documented by individual magnetic resonance images, in healthy adult participants. The reviewed evidence suggests a specific causal involvement of the left AG in a wide range of tasks involving language, memory, number processing, visuospatial attention, body awareness and motor planning functions. These core findings are particularly valuable to inform theoretical models of the left AG role(s) in higher functions, due to the anatomical specificity afforded by the selected studies and the complementarity of TMS to different methods of investigation. In particular, the variety of the operations within and between functions in which the left AG appears to be causally involved poses a formidable challenge to any attempts to identify a single computational process subserved by the left AG (as opposed to just outlining a broad type of functional contribution) that could apply across thematic areas. We conclude by highlighting directions for improvement in future experimentation with TMS, in order to strengthen the available evidence, while taking into account the anatomical heterogeneity of this brain region.

The clinical approach to the identification of higher-order visual dysfunction in neurodegenerative disease

PURPOSE OF REVIEW

This review is intended to assist the reader in gaining the knowledge and skills necessary for the recognition and assessment of higher-order visual dysfunction due to neurodegenerative diseases including Alzheimer's disease, dementia with Lewy bodies, Parkinson's dementia, corticobasal degeneration, Creutzfeldt-Jakob disease, and the posterior cortical atrophy syndrome. Clinical problem-solving and pattern recognition must be developed and practiced to accurately diagnosis disturbances of higher-order visual function, and knowledge of higher-order visual brain regions and their visual syndromes forms the foundation for deciphering symptoms presented by patients and/or their care partners. Tests of higher-order visual dysfunction must be assembled by the clinician and assessment can take time and effort. The use of screening tests, follow-up visits, and formal neuropsychological referrals are critical components for accurate diagnosis and these principles are reviewed here.

RECENT FINDINGS

A recent survey of neuro-ophthalmologists revealed that over half of the respondents report that 5-10% of their new patient referrals carry a diagnosis of neurodegenerative disease and many patients were referred for visual symptoms of unknown cause. Despite over a century of discovery related to higher-order visual functions of the human brain, translation of discovery to the clinical assessment of patients has been slow or absent. As with the approach to translational medicine in general, to see meaningful progress, an interdisciplinary approach is indispensable. The first step involves the application of discoveries from the field visual neuroscience by clinicians from the fields of ophthalmology, neurology, and neuropsychology, and from the disciplines of neuro-ophthalmology and behavioral neurology. The unmet need for recognition, assessment, and management of higher-order visual dysfunction in neurodegeneration is evident and clinicians can contribute to closing the gap by using the approach and the tools outlined in the review.

The Role of the Interaction between the Inferior Parietal Lobule and Superior Temporal Gyrus in the Multisensory Go/No-go Task

Information from multiple sensory modalities interacts. Using functional magnetic resonance imaging (fMRI), we aimed to identify the neural structures correlated with how cooccurring sound modulates the visual motor response execution. The reaction time (RT) to audiovisual stimuli was significantly faster than the RT to visual stimuli. Signal detection analyses showed no significant difference in the perceptual sensitivity (d') between audiovisual and visual stimuli, while the response criteria (β or c) of the audiovisual stimuli was decreased compared to the visual stimuli. The functional connectivity between the left inferior parietal lobule (IPL) and bilateral superior temporal gyrus (STG) was enhanced in Go processing compared with No-go processing of audiovisual stimuli. Furthermore, the left precentral gyrus (PreCG) showed enhanced functional connectivity with the bilateral STG and other areas of the ventral stream in Go processing compared with No-go processing of audiovisual stimuli. These results revealed that the neuronal network correlated with modulations of the motor response execution after the presentation of both visual stimuli along with cooccurring sound in a multisensory Go/Nogo task, including the left IPL, left PreCG, bilateral STG and some areas of the ventral stream. The role of the interaction between the IPL and STG in transforming audiovisual information into motor behavior is discussed. The current study provides a new perspective for exploring potential brain mechanisms underlying how humans execute appropriate behaviors on the basis of multisensory information.

Anatomical and functional connectomes underlying hierarchical visual processing in mouse visual system

Over the last 10 years, there has been a surge in interest in the rodent visual system resulting from the discovery of visual processing functions shared with primates V1, and of a complex anatomical structure in the extrastriate visual cortex. This surprisingly intricate visual system was elucidated by recent investigations using rapidly growing genetic tools primarily available in the mouse. Here, we examine the structural and functional connections of visual areas that have been identified in mice mostly during the past decade, and the impact of these findings on our understanding of brain functions associated with vision. Special attention is paid to structure-function relationships arising from the hierarchical organization, which is a prominent feature of the primate visual system. Recent evidence supports the existence of a hierarchical organization in rodents that contains levels that are poorly resolved relative to those observed in primates. This shallowness of the hierarchy indicates that the mouse visual system incorporates abundant non-hierarchical processing. Thus, the mouse visual system provides a unique opportunity to study non-hierarchical processing and its relation to hierarchical processing.

Parietal maps of visual signals for bodily action planning

The posterior parietal cortex (PPC) has long been understood as a high-level integrative station for computing motor commands for the body based on sensory (i.e., mostly tactile and visual) input from the outside world. In the last decade, accumulating evidence has shown that the parietal areas not only extract the pragmatic features of manipulable objects, but also subserve sensorimotor processing of others’ actions. A paradigmatic case is that of the anterior intraparietal area (AIP), which encodes the identity of observed manipulative actions that afford potential motor actions the observer could perform in response to them. On these bases, we propose an AIP manipulative action-based template of the general planning functions of the PPC and review existing evidence supporting the extension of this model to other PPC regions and to a wider set of actions: defensive and locomotor actions. In our model, a hallmark of PPC functioning is the processing of information about the physical and social world to encode potential bodily actions appropriate for the current context. We further extend the model to actions performed with man-made objects (e.g., tools) and artifacts, because they become integral parts of the subject’s body schema and motor repertoire. Finally, we conclude that existing evidence supports a generally conserved neural circuitry that transforms integrated sensory signals into the variety of bodily actions that primates are capable of preparing and performing to interact with their physical and social world.

Sequential motor learning transfers from real to virtual environment

Background

Skill acquisition of motor learning between virtual environments (VEs) and real environments (REs) may be related. Although studies have previously examined the transfer of motor learning in VEs and REs through the same tasks, only a small number of studies have focused on studying the transfer of motor learning in VEs and REs by using different tasks. Thus, detailed effects of the transfer of motor skills between VEs and REs remain controversial. Here, we investigated the transfer of sequential motor learning between VEs and REs conditions.

Methods

Twenty-seven healthy volunteers performed two types of sequential motor learning tasks; a visually cued button-press task in RE (RE task) and a virtual reaching task in VE (VE task). Participants were randomly assigned to two groups in the task order; the first group was RE task followed by VE task and the second group was VE task followed by RE task. Subsequently, the response time in RE task and VE task was compared between the two groups respectively.

Results

The results showed that the sequential reaching task in VEs was facilitated after the sequential finger task in REs.

Conclusions

These findings suggested that the sequential reaching task in VEs can be facilitated by a motor learning task comprising the same sequential finger task in REs, even when a different task is applied.

Is the pink ball still under review? Cricket umpires' perceptions of the pink ball for day/night matches

OBJECTIVES

The visibility of the pink ball used in day/night Test cricket has been under scrutiny, with recent research suggesting cricketers find the pink ball less visible at dusk under floodlights. With increasing interest in this match format, this study sought to investigate elite umpires' opinions pertaining to the visibility of the pink cricket ball during day/night matches.

DESIGN

Purposeful sampling of a cross-section of elite umpires with experience adjudicating matches played using a pink cricket ball.

METHODS

Twenty-seven international/first-class umpires completed a questionnaire consisting of Likert scale and free text responses covering perceptions of the pink cricket ball, with a particular emphasis on visibility.

RESULTS

The pink ball when viewed at night under floodlights was rated as being significantly more visible than the red ball during natural lighting (ps<0.050). Umpires who actively participated in training reported a significantly higher rating of the visibility of the pink ball (mean -3.14) at night under floodlights compared to those who didn't (mean p=0.010). No significant difference was reported in visibility in natural light or dusk under floodlights. Free text responses (n=10) revealed the following themes: use of eyewear (coverage 0.30), and adjustment to positioning (coverage 0.20) to improve visibility of the pink ball.

CONCLUSIONS

Umpires report the visibility of the pink ball is equal to the red in natural light and at dusk but is significantly better at night. Preference for the pink ball is likely due to the predominantly perceptual nature of visual tasks performed by umpires.

From Observed Action Identity to Social Affordances

Others' observed actions cause continuously changing retinal images, making it challenging to build neural representations of action identity. The monkey anterior intraparietal area (AIP) and its putative human homologue (phAIP) host neurons selective for observed manipulative actions (OMAs). The neuronal activity of both AIP and phAIP allows a stable readout of OMA identity across visual formats, but human neurons exhibit greater invariance and generalize from observed actions to action verbs. These properties stem from the convergence in AIP of superior temporal signals concerning: (i) observed body movements; and (ii) the changes in the body-object relationship. We propose that evolutionarily preserved mechanisms underlie the specification of observed-actions identity and the selection of motor responses afforded by them, thereby promoting social behavior.

The Neural Bases of Drawing. A Meta-analysis and a Systematic Literature Review of Neurofunctional Studies in Healthy Individuals

Drawing is a multi-component process requiring a wide range of cognitive abilities. Several studies on patients with focal brain lesions and functional neuroimaging studies on healthy individuals demonstrated that drawing is associated with a wide brain network. However, the neural structures specifically related to drawing remain to be better comprehended. We conducted a systematic review complemented by a meta-analytic approach to identify the core neural underpinnings related to drawing in healthy individuals. In analysing the selected studies, we took into account the type of the control task employed (i.e. motor or non-motor) and the type of drawn stimulus (i.e. geometric, figurative, or nonsense). The results showed that a fronto-parietal network, particularly on the left side of the brain, was involved in drawing when compared with other motor activities. Drawing figurative images additionally activated the inferior frontal gyrus and the inferior temporal cortex, brain areas involved in selection of semantic features of objects and in visual semantic processing. Moreover, copying more than drawing from memory was associated with the activation of extrastriate cortex (BA 18, 19). The activation likelihood estimation coordinate-based meta-analysis revealed a core neural network specifically associated with drawing which included the premotor area (BA 6) and the inferior parietal lobe (BA 40) bilaterally, and the left precuneus (BA 7).

These results showed that a fronto-parietal network is specifically involved in drawing and suggested that a crucial role is played by the (left) inferior parietal lobe, consistent with classical literature on constructional apraxia.

Superior Parietal Lobule: A Role in Relative Localization of Multiple Different Elements

Simultanagnosia is an impairment in processing multiple visual elements simultaneously consecutive to bilateral posterior parietal damage, and neuroimaging data have specifically implicated the superior parietal lobule (SPL) in multiple element processing. We previously reported that a patient with focal and bilateral lesions of the SPL performed slower than controls in visual search but only for stimuli consisting of separable lines. Here, we further explored this patient's visual processing of plain object (colored disk) versus object consisting of separable lines (letter), presented in isolation (single object) versus in triplets. Identification of objects was normal in isolation but dropped to chance level when surrounded by distracters, irrespective of eccentricity and spacing. We speculate that this poor performance reflects a deficit in processing objects' relative locations within the triplet (for colored disks), aggravated by a deficit in processing the relative location of each separable line (for letters). Confirming this, performance improved when the patient just had to detect the presence of a specific colored disk within the triplets (visual search instruction), while the inability to identify the middle letter was alleviated when the distracters were identical letters that could be grouped, thereby reducing the number of ways individual lines could be bound.

Making the World Behave: A New Embodied Account on Mobile Paradigm

In this review article, we describe the mobile paradigm, a method used for more than 50 years to assess how infants learn and remember sensorimotor contingencies. The literature on the mobile paradigm demonstrates that infants below 6 months of age can remember the learning environment weeks after when reminded periodically and integrate temporally distributed information across modalities. The latter ability is only possible if events occur within a temporal window of a few days, and the width of this required window changes as a function of age. A major critique of these conclusions is that the majority of this literature has neglected the embodied experience, such that motor behavior was considered an equivalent developmental substitute for verbal behavior. Over recent years, simulation and empirical work have highlighted the sensorimotor aspect and opened up a discussion for possible learning mechanisms and variability in motor preferences of young infants. In line with this recent direction, we present a new embodied account on the mobile paradigm which argues that learning sensorimotor contingencies is a core feature of development forming the basis for active exploration of the world and body. In addition to better explaining recent findings, this new framework aims to replace the dis-embodied approach to the mobile paradigm with a new understanding that focuses on variance and representations grounded in sensorimotor experience. Finally, we discuss a potential role for the dorsal stream which might be responsible for guiding action according to visual information, while infants learn sensorimotor contingencies in the mobile paradigm.

Two stream hypothesis of visual processing for navigation in mouse

Vision research has traditionally been studied in stationary subjects observing stimuli, and rarely during navigation. Recent research using virtual reality environments for mice has revealed that responses even in the primary visual cortex are modulated by spatial context - identical scenes presented in different positions of a room can elicit different responses. Here, we review these results and discuss how information from visual areas can reach navigational areas of the brain. Based on the observation that mouse higher visual areas cover different parts of the visual field, we propose that spatial signals are processed along two-streams based on visual field coverage. Specifically, this hypothesis suggests that landmark related signals are processed by areas biased to the central field, and self-motion related signals are processed by areas biased to the peripheral field.

The two-process theory of biological motion processing

Perception, identification, and understanding of others' actions from motion information are vital for our survival in the social world. A breakthrough in the understanding of action perception was the discovery that our visual system is sensitive to human action from the sparse motion input of only a dozen point lights, a phenomenon known as biological motion (BM) processing. Previous psychological and computational models cannot fully explain the emerging evidence for the existence of BM processing during early ontogeny. Here, we propose a two-process model of the mechanisms underlying BM processing. We hypothesize that the first system, the 'Step Detector,' rapidly processes the local foot motion and feet-below-the-body information that is specific to vertebrates, is less dependent on postnatal learning, and involves subcortical networks. The second system, the 'Bodily Action Evaluator,' slowly processes the fine global structure-from-motion, is specific to conspecific, and dependent on gradual learning processed in cortical networks. This proposed model provides new insight into research on the development of BM processing.

Neural Networks Supporting Phoneme Monitoring Are Modulated by Phonology but Not Lexicality or Iconicity: Evidence From British and Swedish Sign Language

Sign languages are natural languages in the visual domain. Because they lack a written form, they provide a sharper tool than spoken languages for investigating lexicality effects which may be confounded by orthographic processing. In a previous study, we showed that the neural networks supporting phoneme monitoring in deaf British Sign Language (BSL) users are modulated by phonology but not lexicality or iconicity. In the present study, we investigated whether this pattern generalizes to deaf Swedish Sign Language (SSL) users. British and SSLs have a largely overlapping phoneme inventory but are mutually unintelligible because lexical overlap is small. This is important because it means that even when signs lexicalized in BSL are unintelligible to users of SSL they are usually still phonologically acceptable. During fMRI scanning, deaf users of the two different sign languages monitored signs that were lexicalized in either one or both of those languages for phonologically contrastive elements. Neural activation patterns relating to different linguistic levels of processing were similar across SLs; in particular, we found no effect of lexicality, supporting the notion that apparent lexicality effects on sublexical processing of speech may be driven by orthographic strategies. As expected, we found an effect of phonology but not iconicity. Further, there was a difference in neural activation between the two groups in a motion-processing region of the left occipital cortex, possibly driven by cultural differences, such as education. Importantly, this difference was not modulated by the linguistic characteristics of the material, underscoring the robustness of the neural activation patterns relating to different linguistic levels of processing.

Virtually the same? How impaired sensory information in virtual reality may disrupt vision for action

Virtual reality (VR) is a promising tool for expanding the possibilities of psychological experimentation and implementing immersive training applications. Despite a recent surge in interest, there remains an inadequate understanding of how VR impacts basic cognitive processes. Due to the artificial presentation of egocentric distance cues in virtual environments, a number of cues to depth in the optic array are impaired or placed in conflict with each other. Moreover, realistic haptic information is all but absent from current VR systems. The resulting conflicts could impact not only the execution of motor skills in VR but also raise deeper concerns about basic visual processing, and the extent to which virtual objects elicit neural and behavioural responses representative of real objects. In this brief review, we outline how the novel perceptual environment of VR may affect vision for action, by shifting users away from a dorsal mode of control. Fewer binocular cues to depth, conflicting depth information and limited haptic feedback may all impair the specialised, efficient, online control of action characteristic of the dorsal stream. A shift from dorsal to ventral control of action may create a fundamental disparity between virtual and real-world skills that has important consequences for how we understand perception and action in the virtual world.

The medial pulvinar: function, origin and association with neurodevelopmental disorders

The pulvinar is primarily referred to for its role in visual processing. However, the 'visual pulvinar' only encompasses the inferior and lateral regions of this complex thalamic nucleus. The remaining medial portion (medial pulvinar, PM) establishes distinct cortical connectivity and has been associated with directed attention, executive functions and working memory. These functions are particularly impaired in neurodevelopmental disorders, including schizophrenia and attention deficit and hyperactivity disorder (ADHD), both of which have been associated with abnormal PM architecture and connectivity. With these disorders becoming more prevalent in modern societies, we review the literature to better understand how the PM can participate in the pathophysiology of cognitive disorders and how a better understanding of the development and function of this thalamic nucleus, which is most likely exclusive to the primate brain, can advance clinical research and treatments.

Whether Visual-related Structural and Functional Changes Occur in Brain of Patients with Acute Incomplete Cervical Cord Injury: A Multimodal Based MRI Study

Visual-related cortex plays an important role in the process of movement. It is of great importance to clarify whether traumatic spinal cord injury (SCI), which is a typical disease that results in sensorimotor dysfunction, leads to the alteration of visual-related brain structure and function area. To address this issue, multimodality MRI was applied on eleven patients with acute incomplete cervical cord injury (ICCI) and eleven healthy controls (HCs) to explore possible structural and functional changes of the brain. Voxel-based morphometry (VBM) analysis was performed to investigate the changes in brain structure of ICCI patients. The fractional amplitude of low-frequency fluctuations (fALFF) was used to characterize changes in regional neural activities, and independent component analysis (ICA) was carried out to explore alterations in the resting-state networks (RSNs) after ICCI. We also investigated correlations among brain imaging metrics and between the metrics and clinical variables. Compared with HCs, ICCI patients exhibited significant gray matter atrophy in the left hippocampus and parahippocampal gyrus, right superior frontal gyrus (SFG), and middle frontal gyrus (MFG) and also a decrease in fALFF in the left orbitofrontal cortex (OFC). Moreover, ICCI patients exhibited decreased intra-network functional connectivity (FC) in the medial vision network (mVN). The mean fALFF value was correlated with clinical motor scores of the left extremities and the total motor scores. Our findings proved that ICCI can not only cause structural changes in visual-related brain regions, but also result in visual-related brain functional alterations, revealing the possible mechanism of the effects of visual feedback training in motor function rehabilitation of SCI patients.

The functional neuroanatomy of face perception: from brain measurements to deep neural networks

A central goal in neuroscience is to understand how processing within the ventral visual stream enables rapid and robust perception and recognition. Recent neuroscientific discoveries have significantly advanced understanding of the function, structure and computations along the ventral visual stream that serve as the infrastructure supporting this behaviour. In parallel, significant advances in computational models, such as hierarchical deep neural networks (DNNs), have brought machine performance to a level that is commensurate with human performance. Here, we propose a new framework using the ventral face network as a model system to illustrate how increasing the neural accuracy of present DNNs may allow researchers to test the computational benefits of the functional architecture of the human brain. Thus, the review (i) considers specific neural implementational features of the ventral face network, (ii) describes similarities and differences between the functional architecture of the brain and DNNs, and (iii) provides a hypothesis for the computational value of implementational features within the brain that may improve DNN performance. Importantly, this new framework promotes the incorporation of neuroscientific findings into DNNs in order to test the computational benefits of fundamental organizational features of the visual system.

Supramodal agnosia for oblique mirror orientation in patients with periventricular leukomalacia

Periventricular leukomalacia (PVL) is characterized by focal necrosis at the level of the periventricular white matter, often observed in preterm infants. PVL is frequently associated with motor impairment and with visual deficits affecting primary stages of visual processes as well as higher visual cognitive abilities. Here we describe six PVL subjects, with normal verbal IQ, showing orientation perception deficits in both the haptic and visual domains. Subjects were asked to compare the orientation of two stimuli presented simultaneously or sequentially, using both a two alternative forced choice (2AFC) orientation-discrimination and a matching procedure. Visual stimuli were oriented gratings or bars or collinear short lines embedded within a random pattern. Haptic stimuli comprised two rotatable wooden sticks. PVL patients performed at chance in discriminating the oblique orientation, both for visual and haptic stimuli. Moreover when asked to reproduce the oblique orientation, they often oriented the stimulus along the symmetric mirror orientation. The deficit generalized to stimuli varying in many low level features, was invariant for spatiotopic object orientation, and also occurred for sequential presentations. The deficit was specific to oblique orientations, and not for horizontal or vertical stimuli. These findings show that PVL can affect a specific network involved with the supramodal perception of mirror symmetry orientation.

Object-based processes in the planning of goal-directed hand movements

Theories in motor control suggest that the parameters specified during the planning of goal-directed hand movements to a visual target are defined in spatial parameters like direction and amplitude. Recent findings in the visual attention literature, however, argue widely for early object-based selection processes. The present experiments were designed to examine the contributions of object-based and space-based selection processes to the preparation time of goal-directed pointing movements. Therefore, a cue was presented at a specific location. The question addressed was whether the initiation of responses to uncued target stimuli could benefit from being either within the same object (object based) or presented at the same direction (space based). Experiment 1 replicated earlier findings of object-based benefits for non-goal-directed responses. Experiment 2 confirmed earlier findings of space-based benefits for goal-directed hand pointing movements. In Experiments 3 and 4, space-based and object-based manipulations were combined while requiring goal-directed hand pointing movements. The results clearly favour the notion that the selection processes for goal-directed pointing movements are primarily object based. Implications for theories on selective attention and action planning are discussed.

A neuroanatomical predictor of mirror self-recognition in chimpanzees

The ability to recognize one's own reflection is shared by humans and only a few other species, including chimpanzees. However, this ability is highly variable across individual chimpanzees. In humans, self-recognition involves a distributed, right-lateralized network including frontal and parietal regions involved in the production and perception of action. The superior longitudinal fasciculus (SLF) is a system of white matter tracts linking these frontal and parietal regions. The current study measured mirror self-recognition (MSR) and SLF anatomy in 60 chimpanzees using diffusion tensor imaging. Successful self-recognition was associated with greater rightward asymmetry in the white matter of SLFII and SLFIII, and in SLFIII's gray matter terminations in Broca's area. We observed a visible progression of SLFIII's prefrontal extension in apes that show negative, ambiguous, and compelling evidence of MSR. Notably, SLFIII's terminations in Broca's area are not right-lateralized or particularly pronounced at the population level in chimpanzees, as they are in humans. Thus, chimpanzees with more human-like behavior show more human-like SLFIII connectivity. These results suggest that self-recognition may have co-emerged with adaptations to frontoparietal circuitry.

Memory for Spatial Locations in a Patient with Near Space Neglect and Optic Ataxia: Involvement of the Occipitotemporal Stream

Previous studies suggested that the occipitoparietal stream orients attention toward the near/lower space and is involved in immediate reaching, whereas the occipitotemporal stream orients attention toward the far/upper space and is involved in delayed reaching. In the present study, we investigated the role of the occipitotemporal stream in attention orienting and delayed reaching in a patient (GP) with bilateral damage to the occipitoparietal areas and optic ataxia. GP and healthy controls took part in three experiments. In the experiment 1, the participants bisected lines oriented along radial, vertical, and horizontal axes. GP bisected radial lines farther, and vertical lines more above, than the controls, consistent with an attentional bias toward the far/upper space and near/lower space neglect. The experiment 2 consisted of two tasks: (1) an immediate reaching task, in which GP reached target locations under visual control and (2) a delayed visual reaching task, in which GP and controls were asked to reach remembered target locations visually presented. We measured constant and variable distance and direction errors. In immediate reaching task, GP accurately reached target locations. In delayed reaching task, GP overshot remembered target locations, whereas the controls undershot them. Furthermore, variable errors were greater in GP than in the controls. In the experiment 3, GP and controls performed a delayed proprioceptive reaching task. Constant reaching errors did not differ between GP and the controls. However, variable direction errors were greater in GP than in the controls. We suggest that the occipitoparietal damage, and the relatively intact occipitotemporal region, produced in GP an attentional orienting bias toward the far/upper space (experiment 1). In turns, the attentional bias selectively shifted toward the far space remembered visual (experiment 2), but not proprioceptive (experiment 3), target locations. As a whole, these findings further support the hypothesis of an involvement of the occipitotemporal stream in delayed reaching. Furthermore, the observation that in both delayed reaching tasks the variable errors were greater in GP than in the controls suggested that in optic ataxia is present not only a visuo- but also a proprioceptivo-motor integration deficit.

How do the two visual streams interact with each other?

The current consensus divides primate cortical visual processing into two broad networks or "streams" composed of highly interconnected areas (Milner and Goodale 2006, 2008; Goodale 2014). The ventral stream, passing from primary visual cortex (V1) through to inferior parts of the temporal lobe, is considered to mediate the transformation of the contents of the visual signal into the mental furniture that guides memory, recognition and conscious perception. In contrast the dorsal stream, passing from V1 through to various areas in the posterior parietal lobe, is generally considered to mediate the visual guidance of action, primarily in real time. The brain, however, does not work through mutually insulated subsystems, and indeed there are well-documented interconnections between the two streams. Evidence for contributions from ventral stream systems to the dorsal stream comes from human neuropsychological and neuroimaging research, and indicates a crucial role in mediating complex and flexible visuomotor skills. Complementary evidence points to a role for posterior dorsal-stream visual analysis in certain aspects of 3-D perceptual function in the ventral stream. A series of studies of a patient with visual form agnosia has been instrumental in shaping our knowledge of what each stream can achieve in isolation; but it has also helped us to tease apart the relative dependence of parietal visuomotor systems on direct bottom-up visual inputs versus inputs redirected via perceptual systems within the ventral stream.

Developmental visual perception deficits with no indications of prosopagnosia in a child with abnormal eye movements

Visual categories are associated with eccentricity biases in high-order visual cortex: Faces and reading with foveally-biased regions, while common objects and space with mid- and peripherally-biased regions. As face perception and reading are among the most challenging human visual skills, and are often regarded as the peak achievements of a distributed neural network supporting common objects perception, it is unclear why objects, which also rely on foveal vision to be processed, are associated with mid-peripheral rather than with a foveal bias. Here, we studied BN, a 9 y.o. boy who has normal basic-level vision, abnormal (limited) oculomotor pursuit and saccades, and shows developmental object and contour integration deficits but with no indication of prosopagnosia. Although we cannot infer causation from the data presented here, we suggest that normal pursuit and saccades could be critical for the development of contour integration and object perception. While faces and perhaps reading, when fixated upon, take up a small portion of central visual field and require only small eye movements to be properly processed, common objects typically prevail in mid-peripheral visual field and rely on longer-distance voluntary eye movements as saccades to be brought to fixation. While retinal information feeds into early visual cortex in an eccentricity orderly manner, we hypothesize that propagation of non-foveal information to mid and high-order visual cortex critically relies on circuitry involving eye movements. Limited or atypical eye movements, as in the case of BN, may hinder normal information flow to mid-eccentricity biased high-order visual cortex, adversely affecting its development and consequently inducing visual perceptual deficits predominantly for categories associated with these regions.

Errors in interception can be predicted from errors in perception

It has been hypothesised that our actions are less susceptible to visual illusions than our perceptual judgements because similar information is processed for perception and action in separate pathways. We test this hypothesis for subjects intercepting a moving object that appears to move at a different speed than its true speed due to an illusion. The object was a moving Gabor patch: a sinusoidal grating of which the luminance contrast is modulated by a two-dimensional Gaussian. We manipulated the patch's apparent speed by moving the grating relative to the Gaussian. We used separate two-interval forced choice discrimination tasks to determine how moving the grating influenced ten people's judgements of the object's position and velocity while they were fixating. Based on their perceptual judgements, and knowing that our ability to correct for errors that arise from relying on incorrect judgements are limited by a sensorimotor delay of about 100 msec, we predicted the extent to which subjects would tap ahead of or behind similar targets when trying to intercept them at the fixation location. The predicted errors closely matched the actual errors that subjects made when trying to intercept the targets. This finding does not support the two visual streams hypothesis. The results are consistent with the idea that the extent to which an illusion influences an action tells us something about the extent to which the action relies on the percept in question.

Interaction of Perception and Action in Discrete and Continuous Rapid Aiming Tasks

Previously, we have shown that discrete and continuous rapid aiming tasks are governed by distinct visuomotor control mechanisms by assessing the combined visual illusion effects on the perceived and effective index of difficulty (ID). All participants were perceptually biased by the combined visual illusion before they performed the rapid aiming tasks. In the current study, the authors manipulated the order of performing perceptual and motor tasks to examine whether perceptual or motor experience with the illusory visual target would influence the subsequent perceived and effective ID in discrete and continuous tapping tasks. The results supported our hypothesis showing that perceptual experience with the illusory visual target in the discrete condition reduced the effective ID in the subsequent discrete tapping task, and motor experience with the illusory visual target in the continuous condition reduced the illusion effects on the perceived ID in the subsequent perceptual judgment task. The study demonstrates the coinfluence of perception and action, and suggests that perception and action influence one another with different magnitude depending on the spatial frame of reference used to perform the perceptuomotor task.

Visual motion serves but is not under the purview of the dorsal pathway

Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual motion tasks critically depend on the structural integrity of regions outside the dorsal pathway. Here, based on numerous studies, I propose that visual motion signals are swiftly transmitted via multiple non-hierarchical routes to primary motion-dedicated processing regions (MT/V5 and MST) that are not part of the dorsal pathway, and then propagated to a multiplicity of brain areas according to task demands, reaching these regions earlier than the dorsal/ventral hierarchical flow. This not only places MT/V5 at the same or even earlier visual processing stage as that of V1, but can also elucidate many findings with implications to visual awareness. While the integrity of the non-hierarchical motion pathway is necessary for all visual motion perception, it is insufficient on its own, and the transfer of visual motion signals to additional brain areas is crucial to allow the different motion perception tasks (e.g. optic flow, visuo-vestibular balance, movement observation, dynamic form detection and perception, and even reading). I argue that this lateral visual motion pathway can be distinguished from the dorsal pathway not only based on faster response latencies and distinct anatomical connections, but also based on its full field representation. I also distinguish between this primary lateral visual motion pathway sensitive to all motion in the visual field, and a much less investigated optic flow sensitive medial processing pathway (from V1 to V6 and V6A) that appears to be part of the dorsal pathway. Multiple additional predictions are provided that allow testing this proposal and distinguishing between the visual pathways.

Insights into Seeing and Grasping: Distinguishing the Neural Correlates of Perception and Action

Vision contributes to both perception and visuomotor control, and it has been suggested that many higher brain structures specialize in one or the other function. An alternative view, presented here, is that most higher brain areas participate in both visuomotor and perceptual functions. In the anterior frontal cortex, for example, the activity of one population of neurons reflects perceptual reports about a visual stimulus, whereas the activity of an intermingled population reflects movements aimed at the same stimulus. Similarly, posterior parietal and inferior temporal areas appear to function in both visual perception and visuomotor control. Visuomotor signals in higher order cortical areas could contribute to the perception of one’s own action. They also might reflect the existence of two systems for visual information processing: one stressing accuracy for the control of movement and the other generating hypotheses about the world.

Slowing of information processing speed without motor slowing in multiple sclerosis observed during two crossing-off tasks

INTRODUCTION

Slowing of information processing speed (IPS) is often considered one of the primary deficits seen in multiple sclerosis (MS). IPS is usually measured by tasks that involve many cognitive functions. The aim of this study was to determine whether similar IPS slowing can also be observed during two simple, timed, psychomotor crossing-off tasks.

METHOD

The Crossing-Off Test (COT), a simple psychomotor task, was performed under two conditions (COT1 corresponded to writing habits, COT2 used horizontal sweeping) in 25 relapsing-remitting MS patients (EDSS 0-1) and 25 healthy controls.

RESULTS

The MS group compared with the control group was impaired on COT1 (P=0.0043) and not on COT2 (P=0.4), and the COT1 performance of MS patients with EDSS 1 was more impaired than those of patients with EDSS 0 (P=0.008).

DISCUSSION/CONCLUSION

These results indicate that only some of the IPS cognitive subcomponents linked with COT1 tasks are initially involved in the slowing of IPS during MS, suggesting that different mechanisms are involved in each tested version of the COT.

Oculomotor Adaptation Elicited By Intra-Saccadic Visual Stimulation: Time-Course of Efficient Visual Target Perturbation

Perception of our visual environment strongly depends on saccadic eye movements, which in turn are calibrated by saccadic adaptation mechanisms elicited by systematic movement errors. Current models of saccadic adaptation assume that visual error signals are acquired only after saccade completion, because the high speed of saccade execution disturbs visual processing (saccadic "suppression" and "mislocalization"). Complementing a previous study from our group, here we report that visual information presented during saccades can drive adaptation mechanisms and we further determine the critical time window of such error processing. In 15 healthy volunteers, shortening adaptation of reactive saccades toward a ±8° visual target was induced by flashing the target for 2 ms less eccentrically than its initial location either near saccade peak velocity ("PV" condition) or peak deceleration ("PD") or saccade termination ("END"). Results showed that, as compared to the "CONTROL" condition (target flashed at its initial location upon saccade termination), saccade amplitude decreased all throughout the "PD" and "END" conditions, reaching significant levels in the second adaptation and post-adaptation blocks. The results of nine other subjects tested in a saccade lengthening adaptation paradigm with the target flashing near peak deceleration ("PD" and "CONTROL" conditions) revealed no significant change of gain, confirming that saccade shortening adaptation is easier to elicit. Also, together with this last result, the stable gain observed in the "CONTROL" conditions of both experiments suggests that mislocalization of the target flash is not responsible for the saccade shortening adaptation demonstrated in the first group. Altogether, these findings reveal that the visual "suppression" and "mislocalization" phenomena related to saccade execution do not prevent brief visual information delivered "in-flight" from being processed to elicit oculomotor adaptation.

Monitoring Different Phonological Parameters of Sign Language Engages the Same Cortical Language Network but Distinctive Perceptual Ones

The study of signed languages allows the dissociation of sensorimotor and cognitive neural components of the language signal. Here we investigated the neurocognitive processes underlying the monitoring of two phonological parameters of sign languages: handshape and location. Our goal was to determine if brain regions processing sensorimotor characteristics of different phonological parameters of sign languages were also involved in phonological processing, with their activity being modulated by the linguistic content of manual actions. We conducted an fMRI experiment using manual actions varying in phonological structure and semantics: (1) signs of a familiar sign language (British Sign Language), (2) signs of an unfamiliar sign language (Swedish Sign Language), and (3) invented nonsigns that violate the phonological rules of British Sign Language and Swedish Sign Language or consist of nonoccurring combinations of phonological parameters. Three groups of participants were tested: deaf native signers, deaf nonsigners, and hearing nonsigners. Results show that the linguistic processing of different phonological parameters of sign language is independent of the sensorimotor characteristics of the language signal. Handshape and location were processed by different perceptual and task-related brain networks but recruited the same language areas. The semantic content of the stimuli did not influence this process, but phonological structure did, with nonsigns being associated with longer RTs and stronger activations in an action observation network in all participants and in the supramarginal gyrus exclusively in deaf signers. These results suggest higher processing demands for stimuli that contravene the phonological rules of a signed language, independently of previous knowledge of signed languages. We suggest that the phonological characteristics of a language may arise as a consequence of more efficient neural processing for its perception and production.

Lack of depth constancy for grasping movements in both virtual and real environments

Recent studies on visuomotor processes using virtual setups have suggested that actions are affected by similar biases as perceptual tasks. In particular, a strong lack of depth constancy is revealed, resembling biases in perceptual estimates of relative depth. With this study we aim to understand whether these findings are mostly caused by a lack of metric accuracy of the visuomotor system or by the limited cues provided by the use of virtual reality. We addressed this issue by comparing grasping movements towards a spherical object located at four distances (420, 450, 480, and 510 mm) performed in three conditions: 1) virtual, in which the target was a virtual object defined by binocular cues, 2) glow-in-the-dark, in which the object was painted with luminous paint but no other cue was provided, and 3) full-cue, in which the movement was performed with the lights on and all the environmental information was available. Results revealed a striking effect of object distance on grip aperture equally in all three conditions. Specifically, grip aperture gradually decreased with increase in object distance, proving a consistent lack of depth constancy. These findings clearly demonstrate that systematic biases in grasping actions are not induced by the use of virtual environments and that action and perception may involve the same visual information, which does not engage a metric reconstruction of the scene.

How Weight Affects the Perceived Spacing between the Thumb and Fingers during Grasping

We know much about mechanisms determining the perceived size and weight of lifted objects, but little about how these properties of size and weight affect the body representation (e.g. grasp aperture of the hand). Without vision, subjects (n = 16) estimated spacing between fingers and thumb (perceived grasp aperture) while lifting canisters of the same width (6.6cm) but varied weights (300, 600, 900, and 1200 g). Lifts were performed by movement of either the wrist, elbow or shoulder to examine whether lifting with different muscle groups affects the judgement of grasp aperture. Results for perceived grasp aperture were compared with changes in perceived weight of objects of different sizes (5.2, 6.6, and 10 cm) but the same weight (600 g). When canisters of the same width but different weights were lifted, perceived grasp aperture decreased 4.8% [2.2 ‒ 7.4] (mean [95% CI]; P < 0.001) from the lightest to the heaviest canister, no matter how they were lifted. For objects of the same weight but different widths, perceived weight decreased 42.3% [38.2 ‒ 46.4] from narrowest to widest (P < 0.001), as expected from the size-weight illusion. Thus, despite a highly distorted perception of the weight of objects based on their size, we conclude that proprioceptive afferents maintain a reasonably stable perception of the aperture of the grasping hand over a wide range of object weights. Given the small magnitude of this 'weight-grasp aperture' illusion, we propose the brain has access to a relatively stable 'perceptual ruler' to aid the manipulation of different objects.

Effects of visual feedback absence on force control during isometric contraction

PURPOSE

The aim of the study was to evaluate the force control in the complete absence of visual feedback and the effect of repeated contractions without visual feedback.

METHODS

Twelve physically active males (age 23 ± 1 years; stature 1.74 ± 0.07 m; body mass 71 ± 6 kg) performed isometric tasks at 20, 40 and 60% maximal voluntary contraction (MVC) for 20 s. For each intensity, a trial with force visual feedback (FB) was followed by 3 trials without FB (noFB-1, noFB-2, noFB-3). During contraction, force and surface electromyogram (EMG) from the vastus lateralis muscle were recorded. From force signal, the coefficient of variation (CV, force stability index), the distance of force from target (ΔF, force accuracy index) and the time within the target (t-target) were determined. From EMG signal, the root mean square (RMS) and mean frequency (MF) were calculated.

RESULTS

MVC was 679.14 ± 38.22 N. In noFB-1, CV was similar to FB, ΔF was higher and t-target lower (P < 0.05) than in FB. EMG-RMS in noFB-1 was lower than in FB at 40 and 60%MVC (P < 0.05). A decrease in ΔF between noFB-1 and noFB-3 (P < 0.05) and an increase in t-target from noFB-1 to noFB-3 (P < 0.05) occurred at 20% MVC. A difference in EMG-RMS among noFB conditions was retrieved only at 60% MVC (P < 0.05).

CONCLUSIONS

These findings suggest that the complete absence of visual feedback decreased force accuracy but did not affect force stability. Moreover, the repetition of noFB trials improved force accuracy at low exercise intensity, suggesting that real-time visual information could be obviated by other feedbacks for force control.

Cortical processing of object affordances for self and others' action

The perception of objects does not rely only on visual brain areas, but also involves cortical motor regions. In particular, different parietal and premotor areas host neurons discharging during both object observation and grasping. Most of these cells often show similar visual and motor selectivity for a specific object (or set of objects), suggesting that they might play a crucial role in representing the “potential motor act” afforded by the object. The existence of such a mechanism for the visuomotor transformation of object physical properties in the most appropriate motor plan for interacting with them has been convincingly demonstrated in humans as well. Interestingly, human studies have shown that visually presented objects can automatically trigger the representation of an action provided that they are located within the observer's reaching space (peripersonal space). The “affordance effect” also occurs when the presented object is outside the observer's peripersonal space, but inside the peripersonal space of an observed agent. These findings recently received direct support by single neuron studies in monkey, indicating that space-constrained processing of objects in the ventral premotor cortex might be relevant to represent objects as potential targets for one's own or others' action.