Two visual pathways – Where have they taken us and where will they lead in future?

Exploring perceptual grouping by proximity principle in multistable dot lattices: Dissociation between vision-for-perception and vision-for-action

Perceptual grouping, a fundamental mechanism in our visual system, significantly influences our interpretation of and interaction with the surrounding world. This study explores the impact of the proximity principle from the perspective of the Two Visual Systems (TVS) model. The TVS model argues that the visual system comprises two distinct streams: the ventral stream, which forms the neural basis for "vision-for-perception," and the dorsal stream, which underlies "vision-for-action." We designed a perceptual grouping task using dot lattices as well as a line-orientation discrimination task. Data were collected using vocal and mouse methods for the vision-for-perception mode, and joystick and pen-paper methods for the vision-for-action mode. Each method, except for vocal, included separate blocks for right and left hands. The proximity data were fitted using exponential and power models. Linear mixed-effects models were used for the statistical analyses. The results revealed similar line-orientation discrimination accuracy across all conditions. The exponential model emerged as the best fit, demonstrating adherence to the Pure Distance Law in both perceptual modes. Sensitivity to the proximity principle was higher in the vision-for-action mode compared to the vision-for-perception. In terms of orientation biases, a strong preference for vertical orientation was observed in the vision-for-perception mode, whereas a noticeable preference toward either of the oblique orientations was detected in the vision-for-action mode. Analysis of free-drawn lines demonstrated an affordance bias in the vision-for-action mode. This suggests a remarkable tendency to perceive organizations within specific orientations that offer more affordances due to the interaction between the body postures and tools.

Identifying novel data-driven subgroups in congenital heart disease using multi-modal measures of brain structure

Individuals with congenital heart disease (CHD) have an increased risk of neurodevelopmental impairments. Given the hypothesized complexity linking genomics, atypical brain structure, cardiac diagnoses and their management, and neurodevelopmental outcomes, unsupervised methods may provide unique insight into neurodevelopmental variability in CHD. Using data from the Pediatric Cardiac Genomics Consortium Brain and Genes study, we identified data-driven subgroups of individuals with CHD from measures of brain structure. Using structural magnetic resonance imaging (MRI; N = 93; cortical thickness, cortical volume, and subcortical volume), we identified subgroups that differed primarily on cardiac anatomic lesion and language ability. In contrast, using diffusion MRI (N = 88; white matter connectivity strength), we identified subgroups that were characterized by differences in associations with rare genetic variants and visual-motor function. This work provides insight into the differential impacts of cardiac lesions and genomic variation on brain growth and architecture in patients with CHD, with potentially distinct effects on neurodevelopmental outcomes.

On the connection between creativity and aesthetics

Within cognitive psychology, there are separate experimental fields devoted to the study of creativity, on the one hand, and aesthetics, on the other, with virtually no cross-talk between them. In this article, I propose a means of uniting creativity and aesthetics via a consideration of the mechanisms of cultural evolution. I call this the creativity/aesthetics cycle. The basic tenet of the model is that creativity and aesthetics mediate, respectively, the processes of variation (production) and selection (perception or consumption) in evolutionary models of culture. By means of this cycle, creators produce works that they hope will be evaluated positively by consumers, where such appraisals ultimately feed back to influence the subsequent decision-making processes of creators. I discuss the implications of this model for the fields of creativity and aesthetics.

Processing of complex traffic scenes for effective steering and collision avoidance: a perspective, from research into human control, on the challenges for sensor-based autonomous vehicles on urban roads

An overview is provided of behavioral research into human steering and collision avoidance including the processing of optic flow, optical looming and the role of the human mobile gaze system. A consideration is then made of the issues that may occur for autonomous vehicles (AV) when they move from grid-type road networks into complex inner-city streets and interact with human drivers, pedestrians and cyclists. Comparisons between human processing and AV processing of these interactions are made. This raises issues as to whether AV control systems need to mimic human visual processing more closely and highlights the need for AV systems to develop a "theory of road users" that allows attribution of intent to other drivers, cyclists or pedestrians. Guidelines for the development of a "theory of road users" for AVs are suggested.

Modal and amodal cognition: an overarching principle in various domains of psychology

Accounting for how the human mind represents the internal and external world is a crucial feature of many theories of human cognition. Central to this question is the distinction between modal as opposed to amodal representational formats. It has often been assumed that one but not both of these two types of representations underlie processing in specific domains of cognition (e.g., perception, mental imagery, and language). However, in this paper, we suggest that both formats play a major role in most cognitive domains. We believe that a comprehensive theory of cognition requires a solid understanding of these representational formats and their functional roles within and across different domains of cognition, the developmental trajectory of these representational formats, and their role in dysfunctional behavior. Here we sketch such an overarching perspective that brings together research from diverse subdisciplines of psychology on modal and amodal representational formats so as to unravel their functional principles and their interactions.

Cortical Correlates of Visuospatial Switching Processes Between Egocentric and Allocentric Frames of Reference: A fNIRS Study

Human beings represent spatial information according to egocentric (body-to-object) and allocentric (object-to-object) frames of reference. In everyday life, we constantly switch from one frame of reference to another in order to react effectively to the specific needs of the environment and task demands. However, to the best of our knowledge, no study to date has investigated the cortical activity of switching and non-switching processes between egocentric and allocentric spatial encodings. To this aim, a custom-designed visuo-spatial memory task was administered and the cortical activities underlying switching vs non-switching spatial processes were investigated. Changes in concentrations of oxygenated and deoxygenated haemoglobin were measured using functional near-infrared spectroscopy (fNIRS). Participants were asked to memorize triads of geometric objects and then make two consecutive judgments about the same triad. In the non-switching condition, both spatial judgments considered the same frame of reference: only egocentric or only allocentric. In the switching condition, if the first judgment was egocentric, the second one was allocentric (or vice versa). The results showed a generalized activation of the frontal regions during the switching compared to the non-switching condition. Additionally, increased cortical activity was found in the temporo-parietal junction during the switching condition compared to the non-switching condition. Overall, these results illustrate the cortical activity underlying the processing of switching between body position and environmental stimuli, showing an important role of the temporo-parietal junction and frontal regions in the preparation and switching between egocentric and allocentric reference frames.

Coming to grips with reality: Real grasps, but not pantomimed grasps, resist a simultaneous tilt illusion

Investigations of grasping real, 3D objects subjected to illusory effects from a pictorial background often choose in-flight grasp aperture as the primary variable to test the hypothesis that the visuomotor system resists the illusion. Here we test an equally important feature of grasps that has received less attention: in-flight grasp orientation. The current study tested a variant of the simultaneous tilt illusion using a mirror-apparatus to manipulate the availability of haptic feedback. Participants performed grasps with haptic feedback (real grasps) and without it (pantomime grasps), reaching for the reflection of a real, 3D bar atop a background grating that induced a 1.1° bias in the perceived orientation of the bar in a separate sample of participants. Analysis of the hand's in-flight grasp orientation at early, late, and end stages of the reach showed that at no point were the real grasps biased by the illusion. In contrast, pantomimed grasps were affected by the illusion at the late and end stages of the reach. At each stage, the effect on the real grasps was significantly weaker than the effect of the illusion as measured by the mean point of subjective equality (PSE) in a two-alternative forced-choice task. In contrast, the effect on the pantomime grasps was statistically indistinguishable from the mean PSE at all three stages of the reach. These findings reinforce the idea that in-flight grasp orientation, like grasp aperture to pictorial illusions of target size, is refractory to pictorial backgrounds that bias perceived orientation.

A focus on the multiple interfaces between action and perception and their neural correlates

Successful behaviour relies on the appropriate interplay between action and perception. The well-established dorsal and ventral stream theories depicted two distinct functional pathways for the processes of action and perception, respectively. In physiological conditions, the two pathways closely cooperate in order to produce successful adaptive behaviour. As the coupling between perception and action exists, this requires an interface that is responsible for a common reading of the two functions. Several studies have proposed different types of perception and action interfaces, suggesting their role in the creation of the shared interaction channel. In the present review, we describe three possible perception and action interfaces: i) the motor code, including common coding approaches, ii) attention, and iii) object affordance; we highlight their potential neural correlates. From this overview, a recurrent neural substrate that underlies all these interface functions appears to be crucial: the parieto-frontal circuit. This network is involved in the mirror mechanism which underlies the perception and action interfaces identified as common coding and motor code theories. The same network is also involved in the spotlight of attention and in the encoding of potential action towards objects; these are manifested in the perception and action interfaces for common attention and object affordance, respectively. Within this framework, most studies were dedicated to the description of the role of the inferior parietal lobule; growing evidence, however, suggests that the superior parietal lobule also plays a crucial role in the interplay between action and perception. The present review proposes a novel model that is inclusive of the superior parietal regions and their relative contribution to the different action and perception interfaces.

Maintaining eye fixation relieves pressure of cognitive action control

Cognitive control enables humans to behave guided by their current goals and intentions. Cognitive control in one task generally suffers when humans try to engage in another task on top. However, we discovered an additional task that supports conflict resolution. In two experiments, participants performed a spatial cognitive control task. For different blocks of trials, they either received no instruction regarding eye movements or were asked to maintain the eyes fixated on a stimulus. The additional eye fixation task did not reduce task performance, but selectively ameliorated the adverse effects of cognitive conflicts on reaction times (Experiment 1). Likewise, in urgent situations, the additional task reduced performance impairments due to stimulus-driven processing overpowering cognitive control (Experiment 2). These findings suggest that maintaining eye fixation locks attentional resources that would otherwise induce spatial cognitive conflicts. This reveals an attentional disinhibition that boosts goal-directed action by relieving pressure from cognitive control.

The interaction between first-episode drug-naïve schizophrenia and age based on gray matter volume and its molecular analysis: a multimodal magnetic resonance imaging study

OBJECTIVES

Schizophrenia is a neurodevelopmental disorder characterized by progressive and widespread gray matter (GM) atrophy. Studies have shown that normal brain development has an impact on schizophrenia-induced GM alterations. However, the neuropathology and underlying molecular mechanisms of interaction between age and schizophrenia are unclear.

METHODS

This study enrolled 66/84 first-episode drug-naïve patients with early-onset/adult-onset schizophrenia ((EOS)/(AOS)) and matched normal controls (NC) (46 adolescents/73 adults), undergoing T1-weighted high-resolution magnetic resonance imaging. Gray matter volume (GMV) in four groups was detected using 2-way analyses of variance with diagnosis and age as factors. Then, factors-related volume maps and neurotransmitter maps were spatially correlated using JuSpace to determine the relationship to molecular structure.

RESULTS

Compared to AOS, EOS and adult NC had larger GMV in right middle frontal gyrus. Compared to adolescent NC, EOS and adult NC had smaller GMV in right lingual gyrus, right fusiform gyrus, and right cerebellum_6. Disease-induced GMV reductions were mainly distributed in frontal, parietal, thalamus, visual, motor cortex, and medial temporal lobe structures. Age-induced GMV alterations were mainly distributed in visual and motor cortex. The changed GMV induced by schizophrenia, age, and their interaction was related to dopaminergic and serotonergic receptors. Age is also related to glutamate receptors, and schizophrenia is also associated with GABAaergic and noradrenergic receptors.

CONCLUSIONS

Our results revealed the multimodal neural mechanism of interaction between disease and age. We emphasized age-related GM abnormalities of ventral stream of visual perceptual pathways and high-level cognitive brain in EOS, which may be affected by imbalance of excitatory and inhibitory neurotransmitters.

Visuo-haptic object perception for robots: an overview

The object perception capabilities of humans are impressive, and this becomes even more evident when trying to develop solutions with a similar proficiency in autonomous robots. While there have been notable advancements in the technologies for artificial vision and touch, the effective integration of these two sensory modalities in robotic applications still needs to be improved, and several open challenges exist. Taking inspiration from how humans combine visual and haptic perception to perceive object properties and drive the execution of manual tasks, this article summarises the current state of the art of visuo-haptic object perception in robots. Firstly, the biological basis of human multimodal object perception is outlined. Then, the latest advances in sensing technologies and data collection strategies for robots are discussed. Next, an overview of the main computational techniques is presented, highlighting the main challenges of multimodal machine learning and presenting a few representative articles in the areas of robotic object recognition, peripersonal space representation and manipulation. Finally, informed by the latest advancements and open challenges, this article outlines promising new research directions.

Carroll's Three-Stratum (3S) Cognitive Ability Theory at 30 Years: Impact, 3S-CHC Theory Clarification, Structural Replication, and Cognitive-Achievement Psychometric Network Analysis Extension

Carroll's treatise on the structure of human cognitive abilities is a milestone in psychometric intelligence research. Thirty years later, Carroll's work continues to influence research on intelligence theories and the development and interpretation of intelligence tests. A historical review of the relations between the 3S and CHC theories necessitates the recommendation that the theories of Cattell, Horn, and Carroll be reframed as a family of obliquely correlated CHC theories-not a single CHC theory. Next, a previously unpublished Carroll exploratory factor analysis of 46 cognitive and achievement tests is presented. A complimentary bifactor analysis is presented that reinforces Carroll's conclusion that his 3S model more accurately represents the structure of human intelligence than two prominent alternative models. Finally, a Carroll-recommended higher-stratum psychometric network analysis (PNA) of CHC cognitive, reading, and math variables is presented. The PNA results demonstrate how PNA can complement factor analysis and serve as a framework for identifying and empirically evaluating cognitive-achievement causal relations and mechanisms (e.g., developmental cascade and investment theories), with an eye toward improved cognitive-achievement intervention research. It is believed that Carroll, given his long-standing interest in school learning, would welcome the integration of theory-driven factor and PNA research.

49words: An active alert hypnosis protocol for stress regulation

People, worldwide, are in dire need of stress regulation. This paper presents a six step alert self-hypnosis protocol that individuals can use to regulate a wide variety of stresses. A brief anonymized case reports from a diverse range of clients follows the protocol's six step outline. The step-by-step algorithm can be modified to address the unique circumstances of each client. Finally, summaries of neuroscience research provide possible explanations for the observed efficacy of the approach.

Mesoscopic architecture enhances communication across the macaque connectome revealing structure-function correspondence in the brain

Analyzing the brain in terms of organizational structures at intermediate scales provides an approach to unravel the complexity arising from interactions between its large number of components. Focusing on a wiring diagram that spans the cortex, basal ganglia, and thalamus of the macaque brain, we identify robust modules in the network that provide a mesoscopic-level description of its topological architecture. Surprisingly, we find that the modular architecture facilitates rapid communication across the network, instead of localizing activity as is typically expected in networks having community organization. By considering processes of diffusive spreading and coordination, we demonstrate that the specific pattern of inter- and intramodular connectivity in the network allows propagation to be even faster than equivalent randomized networks with or without modular structure. This pattern of connectivity is seen at different scales and is conserved across principal cortical divisions, as well as subcortical structures. Furthermore, we find that the physical proximity between areas is insufficient to explain the modular organization, as similar mesoscopic structures can be obtained even after factoring out the effect of distance constraints on the connectivity. By supplementing the topological information about the macaque connectome with physical locations, volumes, and functions of the constituent areas and analyzing this augmented dataset, we reveal a counterintuitive role played by the modular architecture of the brain in promoting global coordination of its activity. It suggests a possible explanation for the ubiquity of modularity in brain networks.

The effects of Müller-Lyer illusion on toe clearance height in stair ascent

BACKGROUND

The appearance of a stair can impact the safe negotiation of stair climbing. Increasing toe clearance height is a common strategy for reducing the risk of tripping when stepping onto a raised surface.

RESEARCH QUESTION

Can the Müller-Lyer illusion cause people to increase their toe clearance height when walking over a stair?

METHODS

Indoors, 15 healthy individuals (9 women and 6 men) walked up a 3-step staircase with each step 60 cm wide, 18 cm tall, and 30.5 cm deep. Outdoors, 253 people walked up a 2-step staircase with each step 6 m wide, 15 cm tall, and 38 cm deep. Four visual conditions were displayed at both the indoor and outdoor locations: fins out, fins in, line, and control.

RESULTS

While the fins out stairs were perceived taller than all the other displayed stair conditions, the toe clearance height was not different between display conditions when tested indoors. However, toe clearance height was greater in the fins out condition when compared to all other conditions for the outdoor stairs location.

SIGNIFICANCE

In the natural environment when walkers were oblivious to themselves being filmed and not having any knowledge of the task demand, the Müller-Lyer illusion significantly impacted their toe clearance height.

Serial dependence for oculomotor control depends on early sensory signals

To create an accurate percept of the world, the visual system relies on past experience and prior assumptions.¹ For example, although the retinal projection of an object moving in depth changes drastically, we still perceive the object at a constant size and velocity.^2,3 Consequently, if we see the same object with a constant retinal size at two different depth levels, the perceived size differs (illustrated by the Ponzo illusion). Past experience also directly influences perceptual judgments, an effect known as serial dependence.^4,5 Such sequential effects have also been reported for oculomotor behavior, even on the trial-by-trial level.^6-10 An integration of past experiences seems like a smart and sophisticated mechanism to reduce uncertainty and improve behavior in a world full of statistical regularities. By leveraging the Ponzo illusion to dissociate perceived size and speed from retinal signals, we show that serial-dependence effects for oculomotor control are mediated by retinal error signals. These sequential effects likely take place in early sensory processing because they transfer to different visual stimuli. In contrast to recently reported history effects for perceptual decisions,¹¹ sequential effects for oculomotor control deviate from perceptual mechanisms by not integrating spatial context and by ignoring size and velocity constancy. Although this dissociation might appear suboptimal, we argue that this effect reveals the different goals of the oculomotor and perceptual systems. The oculomotor system tries to reduce retinal error signals to bring and keep the target close to the fovea, whereas the visual system interprets retinal input to achieve an accurate representation of the world.¹².

The clinical approach to the identification of higher-order visual dysfunction in neurodegenerative disease

PURPOSE OF REVIEW

This review is intended to assist the reader in gaining the knowledge and skills necessary for the recognition and assessment of higher-order visual dysfunction due to neurodegenerative diseases including Alzheimer's disease, dementia with Lewy bodies, Parkinson's dementia, corticobasal degeneration, Creutzfeldt-Jakob disease, and the posterior cortical atrophy syndrome. Clinical problem-solving and pattern recognition must be developed and practiced to accurately diagnosis disturbances of higher-order visual function, and knowledge of higher-order visual brain regions and their visual syndromes forms the foundation for deciphering symptoms presented by patients and/or their care partners. Tests of higher-order visual dysfunction must be assembled by the clinician and assessment can take time and effort. The use of screening tests, follow-up visits, and formal neuropsychological referrals are critical components for accurate diagnosis and these principles are reviewed here.

RECENT FINDINGS

A recent survey of neuro-ophthalmologists revealed that over half of the respondents report that 5-10% of their new patient referrals carry a diagnosis of neurodegenerative disease and many patients were referred for visual symptoms of unknown cause. Despite over a century of discovery related to higher-order visual functions of the human brain, translation of discovery to the clinical assessment of patients has been slow or absent. As with the approach to translational medicine in general, to see meaningful progress, an interdisciplinary approach is indispensable. The first step involves the application of discoveries from the field visual neuroscience by clinicians from the fields of ophthalmology, neurology, and neuropsychology, and from the disciplines of neuro-ophthalmology and behavioral neurology. The unmet need for recognition, assessment, and management of higher-order visual dysfunction in neurodegeneration is evident and clinicians can contribute to closing the gap by using the approach and the tools outlined in the review.

Reunification of Object and View-Center Background Information in the Primate Medial Temporal Lobe

Recent work has shown that the medial temporal lobe (MTL), including the hippocampus (HPC) and its surrounding limbic cortices, plays a role in scene perception in addition to episodic memory. The two basic factors of scene perception are the object (“what”) and location (“where”). In this review, we first summarize the anatomical knowledge related to visual inputs to the MTL and physiological studies examining object-related information processed along the ventral pathway briefly. Thereafter, we discuss the space-related information, the processing of which was unclear, presumably because of its multiple aspects and a lack of appropriate task paradigm in contrast to object-related information. Based on recent electrophysiological studies using non-human primates and the existing literature, we proposed the “reunification theory,” which explains brain mechanisms which construct object-location signals at each gaze. In this reunification theory, the ventral pathway signals a large-scale background image of the retina at each gaze position. This view-center background signal reflects the first person’s perspective and specifies the allocentric location in the environment by similarity matching between images. The spatially invariant object signal and view-center background signal, both of which are derived from the same retinal image, are integrated again (i.e., reunification) along the ventral pathway-MTL stream, particularly in the perirhinal cortex. The conjunctive signal, which represents a particular object at a particular location, may play a role in scene perception in the HPC as a key constituent element of an entire scene.

Online control of rapid target-directed aiming using blurred visual feedback

The accuracy and precision of target-directed aiming is contingent upon the availability of online visual feedback. The present study aimed to examine the visual regulation of aiming with blurred vision. The aiming task was executed using a stylus on a graphics digitizing board, which was translated onto a screen in the form of a cursor (representing the moving limb) and target. The vision conditions involved the complete disappearance or blur of the cursor alone, target alone, and cursor+target. These conditions involved leaving the screen uncovered or covering with a diffusing sheet to induce blur. The distance between the screen and sheet was increased to make the blur progressively more severe (0 cm, 3 cm). Results showed significantly less radial and variable error under blurred compared to no vision of the cursor and cursor+target. These findings were corroborated by the movement kinematics including a shorter proportion of time to peak velocity, more negative within-participant correlation between the distances travelled to and after peak velocity, and lower spatial variability from peak velocity to the end of the movement under blurred vision. The superior accuracy and precision under the blurred compared to no vision conditions is consistent with functioning visual regulation of aiming, which is primarily contingent upon the online visual feedback of the moving limb. This outcome may be attributed to the processing of low spatial-high temporal frequencies. Potential implications for low vision diagnostics are discussed.

Precision in grasping: Consistent with Weber's law, but constrained by "safety margins"

Whether the visuomotor coding of size in grasping obeys Weber's law is currently debated. Following up on previous work from our laboratory, here we investigated the precision associated with the maximum in-flight index-thumb aperture (MGA) in grasping small-to-medium sized objects. We report three main findings. First, grasp preparation was longer with 5 mm objects and became increasingly faster as object size increased from 10 to 20-40 mm. Second, MGA variable errors increased as sizes increased from 5 to 10-20 mm, whereas they decreased as size reached 40 mm. Third, MGA distributions were symmetrical with 5 mm objects, but became increasingly right-skewed as size increased. These results, as well as a re-analysis of previous findings, suggest that the precision of visuomotor representations varies as a function of size, consistent with the key principle underlying Weber's law. However, a fundamental constraint on precision grips (the MGA must always exceed physical size) changes the skew of the distribution and reduces the variability of MGAs as size increases from very small to medium.

Human face and gaze perception is highly context specific and involves bottom-up and top-down neural processing

This review summarizes human perception and processing of face and gaze signals. Face and gaze signals are important means of non-verbal social communication. The review highlights that: (1) some evidence is available suggesting that the perception and processing of facial information starts in the prenatal period; (2) the perception and processing of face identity, expression and gaze direction is highly context specific, the effect of race and culture being a case in point. Culture affects by means of experiential shaping and social categorization the way in which information on face and gaze is collected and perceived; (3) face and gaze processing occurs in the so-called 'social brain'. Accumulating evidence suggests that the processing of facial identity, facial emotional expression and gaze involves two parallel and interacting pathways: a fast and crude subcortical route and a slower cortical pathway. The flow of information is bi-directional and includes bottom-up and top-down processing. The cortical networks particularly include the fusiform gyrus, superior temporal sulcus (STS), intraparietal sulcus, temporoparietal junction and medial prefrontal cortex.

A change in perspective: The interaction of saccadic and pursuit eye movements in oculomotor control and perception

Due to the close relationship between oculomotor behavior and visual processing, eye movements have been studied in many different areas of research over the last few decades. While these studies have brought interesting insights, specialization within each research area comes at the potential cost of a narrow and isolated view of the oculomotor system. In this review, we want to expand this perspective by looking at the interactions between the two most important types of voluntary eye movements: saccades and pursuit. Recent evidence indicates multiple interactions and shared signals at the behavioral and neurophysiological level for oculomotor control and for visual perception during pursuit and saccades. Oculomotor control seems to be based on shared position- and velocity-related information, which leads to multiple behavioral interactions and synergies. The distinction between position- and velocity-related information seems to be also present at the neurophysiological level. In addition, visual perception seems to be based on shared efferent signals about upcoming eye positions and velocities, which are to some degree independent of the actual oculomotor response. This review suggests an interactive perspective on the oculomotor system, based mainly on different types of sensory input, and less so on separate subsystems for saccadic or pursuit eye movements.

[The relationship between visual dysfunction and cognitive deficit in schizophrenia]

OBJECTIVE

To investigate whether visual processing abnormalities are the result of visual dysfunction involving cognitive impairment or independent abnormalities and to identify the relationship of visual impairments with cognitive functions and severity of psychopathological symptoms.

MATERIAL AND METHODS

We compared results of visual size perception and actions on objects (motor assessment) in patients with schizophrenia (n=37), including patients with non-resistant schizophrenia (n=19) and healthy individuals (n=20). Cognitive impairments were assessed with BACS. Severity of schizophrenia symptoms was assessed with PANSS.

RESULTS

The error in the visual size perception test was smaller in healthy controls compared with non-resistant patients (p<0.03). There are no significant differences between non-resistant patients and other groups. Also, there are no significant differences in motor assessment between healthy controls and patients with schizophrenia. In the visual size perception test, the amount of error correlates with cognitive impairments (r= -0.84, p<0.001), and the severity of psychotic symptoms on PANSS (r=0.55, p<0.05).

CONCLUSION

Changes in visual threshold in patients with schizophrenia are correlated with cognitive dysfunction and reflect dysfunction in the parvocellular system.

Landmark cueing and exogenous (onset) cueing: How are they related?

Attentional consequences of (i) mere onset of a peripheral visual cue, and (ii)encoding spatially predictive, landmark features of that cue were studied in two experiments. Target location was associated with landmark features of peripheral cues. Cue onset elicited both attention capture (Experiment Two) and inhibition of return (Experiment One) effects. In both experiments, attentional effects of landmark features of the cues were observed early in practice, and diminished with time on task. Contrary to hypotheses based on models that liken attention to a moving spotlight or zoom lens, in both experiments attentional effects of landmark features were confined to the location where the cue was presented. To explain this, we enlist the concept of attentional priority maps, and propose that visual encoding causes attentional priorities to be updated via alternative input routes and mechanisms. We suggest that onset cueing effects are associated with retinotectal 'spatial indexing', which registers the location, but not the attributes of new stimuli, while landmark cueing effects are associated with interaction between spatial indexing and dorsal stream visual processing of attentionally relevant landmark features.

Review: Sport Performance and the Two-visual-system Hypothesis of Vision: Two Pathways but Still Many Questions

SIGNIFICANCE

The two-visual-system hypothesis (TVSH) provides a framework for understanding the nature of the visual information athletes are likely to rely on during competition. If valid, the framework provides a valuable means of evaluating the likely efficacy of different vision training tools that claim to improve the sport performance of athletes.The TVSH has been used to explain that many of the existing methods of testing and training vision may be ineffective to improve on-field sport performance. The TVSH suggests that the visual pathway used to control actions on-field may be different-and rely on different visual information-to the pathway often tested and trained off-field. However, the central claims of the TVSH are increasingly questioned, and this has implications for our understanding of vision and sport performance. The aim of this article is to outline the implications of the TVSH for the visual control of actions in sport. We first provide a summary of the TVSH and outline how the visual information used to control actions might differ from that usually tested. Second, we look at the evidence from studies of sports that are (and are not) consistent with the TVSH and the implications they have for training vision. Finally, we take a wider look at the impact of the TVSH on the sport sciences and other complementary theories that hold implications for training vision to improve sport performance.

Sequential motor learning transfers from real to virtual environment

Background

Skill acquisition of motor learning between virtual environments (VEs) and real environments (REs) may be related. Although studies have previously examined the transfer of motor learning in VEs and REs through the same tasks, only a small number of studies have focused on studying the transfer of motor learning in VEs and REs by using different tasks. Thus, detailed effects of the transfer of motor skills between VEs and REs remain controversial. Here, we investigated the transfer of sequential motor learning between VEs and REs conditions.

Methods

Twenty-seven healthy volunteers performed two types of sequential motor learning tasks; a visually cued button-press task in RE (RE task) and a virtual reaching task in VE (VE task). Participants were randomly assigned to two groups in the task order; the first group was RE task followed by VE task and the second group was VE task followed by RE task. Subsequently, the response time in RE task and VE task was compared between the two groups respectively.

Results

The results showed that the sequential reaching task in VEs was facilitated after the sequential finger task in REs.

Conclusions

These findings suggested that the sequential reaching task in VEs can be facilitated by a motor learning task comprising the same sequential finger task in REs, even when a different task is applied.

The Diversity of Eyes and Vision

Every aspect of vision, from the opsin proteins to the eyes and the ways that they serve animal behavior, is incredibly diverse. It is only with an evolutionary perspective that this diversity can be understood and fully appreciated. In this review, I describe and explain the diversity at each level and try to convey an understanding of how the origin of the first opsin some 800 million years ago could initiate the avalanche that produced the astonishing diversity of eyes and vision that we see today. Despite the diversity, many types of photoreceptors, eyes, and visual roles have evolved multiple times independently in different animals, revealing a pattern of eye evolution strictly guided by functional constraints and driven by the evolution of gradually more demanding behaviors. I conclude the review by introducing a novel distinction between active and passive vision that points to uncharted territories in vision research. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Anatomy and White Matter Connections of the Lingual Gyrus and Cuneus

BACKGROUND

The medial occipital lobe, composed of the lingual gyrus and cuneus, is necessary for both basic and higher level visual processing. It is also known to facilitate cross-modal, nonvisual functions, such as linguistic processing and verbal memory, after the loss of the visual senses. A detailed cortical model elucidating the white matter connectivity associated with this area could improve our understanding of the interacting brain networks that underlie complex human processes and postoperative outcomes related to vision and language.

METHODS

Generalized q-sampling imaging tractography, validated by gross anatomic dissection for qualitative visual agreement, was performed on 10 healthy adult controls obtained from the Human Connectome Project.

RESULTS

Major white matter connections were identified by tractography and validated by gross dissection, which connected the medial occipital lobe with itself and the adjacent cortices, especially the temporal lobe. The short- and long-range connections identified consisted mainly of U-shaped association fibers, intracuneal fibers, and inferior fronto-occipital fasciculus, inferior longitudinal fasciculus, middle longitudinal fasciculus, and lingual-fusiform connections.

CONCLUSIONS

The medial occipital lobe is an extremely interconnected system, supporting its ability to perform coordinated basic visual processing, but also serves as a center for many long-range association fibers, supporting its importance in nonvisual functions, such as language and memory. The presented data represent clinically actionable anatomic information that can be used in multimodal navigation of white matter lesions in the medial occipital lobe to prevent neurologic deficits and improve patients' quality of life after cerebral surgery.

A distinction concerning vision-for-action and affordance perception

In this paper, I offer a discussion concerning the conceptual connection between the notion of vision-for-action and the one of affordance perception. I first analyze the notion of vision-for-action. I then analyze a notion usually coupled with it: the notion of affordance perception, the main insights behind which are guiding several current neuroscientific enterprises and the related philosophical speculations. Then, I argue that we should not couple these two notions with a light heart: though these two processes can be, from a theoretical point of view, related, we should be careful in inferring the actual and effective occurrence of the latter in the presence of the former. This will be done by carrying out a conceptual analysis of the experimental evidence coming from the 'Two Visual Systems Model', which is the main reference in the literature on affordance perception and vision-for-action. My point has strong philosophical implications for our view concerning the best interpretation of how vision-for-action really works, and the specific relation it actually entertains with affordance perception.

A double dissociation between action and perception in bimanual grasping: evidence from the Ponzo and the Wundt-Jastrow illusions

Research on visuomotor control suggests that visually guided actions toward objects rely on functionally distinct computations with respect to perception. For example, a double dissociation between grasping and between perceptual estimates was reported in previous experiments that pit real against illusory object size differences in the context of the Ponzo illusion. While most previous research on the relation between action and perception focused on one-handed grasping, everyday visuomotor interactions also entail the simultaneous use of both hands to grasp objects that are larger in size. Here, we examined whether this double dissociation extends to bimanual movement control. In Experiment 1, participants were presented with different-sized objects embedded in the Ponzo Illusion. In Experiment 2, we tested whether the dissociation between perception and action extends to a different illusion, the Wundt-Jastrow illusion, which has not been previously used in grasping experiments. In both experiments, bimanual grasping trajectories reflected the differences in physical size between the objects; At the same time, perceptual estimates reflected the differences in illusory size between the objects. These results suggest that the double dissociation between action and perception generalizes to bimanual movement control. Unlike conscious perception, bimanual grasping movements are tuned to real-world metrics, and can potentially resist irrelevant information on relative size and depth.

What Does Dorsal Cortex Contribute to Perception?

According to the influential "Two Visual Pathways" hypothesis, the cortical visual system is segregated into two pathways, with the ventral, occipitotemporal pathway subserving object perception, and the dorsal, occipitoparietal pathway subserving the visuomotor control of action. However, growing evidence suggests that the dorsal pathway also plays a functional role in object perception. In the current article, we present evidence that the dorsal pathway contributes uniquely to the perception of a range of visuospatial attributes that are not redundant with representations in ventral cortex. We describe how dorsal cortex is recruited automatically during perception, even when no explicit visuomotor response is required. Importantly, we propose that dorsal cortex may selectively process visual attributes that can inform the perception of potential actions on objects and environments, and we consider plausible developmental and cognitive mechanisms that might give rise to these representations. As such, we consider whether naturalistic stimuli, such as real-world solid objects, might engage dorsal cortex more so than simplified or artificial stimuli such as images that do not afford action, and how the use of suboptimal stimuli might limit our understanding of the functional contribution of dorsal cortex to visual perception.

Neural correlates of object and action naming practice

Word retrieval deficits are a common problem in patients with stroke-induced brain damage. While complete recovery of language in chronic aphasia is rare, patients' naming ability can be significantly improved by speech therapy. A growing number of neuroimaging studies have tried to pinpoint the neural changes associated with successful outcome of naming treatment. However, the mechanisms supporting naming practice in the healthy brain have received little attention. Yet, understanding these mechanisms is crucial for teasing them apart from functional reorganization following brain damage. To address this issue, we trained a group of healthy monolingual Italian speakers on naming pictured objects and actions for ten consecutive days and scanned them before and after training. Although activity during object versus action naming dissociated in several regions (lateral occipitotemporal, parietal and left inferior frontal cortices), training effects for the two word classes were similar and included activation decreases in classical language regions of the left hemisphere (posterior inferior frontal gyrus, anterior insula), potentially due to decreased lexical selection demands. Additionally, MVPA revealed training-related activation changes in the left parietal and temporal cortices associated with the retrieval of knowledge from episodic memory (precuneus, angular gyrus) and facilitated access to phonological word forms (posterior superior temporal sulcus).

Accident Vulnerability and Vision for Action: A Pilot Investigation

Many accidents, such as those involving collisions or trips, appear to involve failures of vision, but the association between accident risk and vision as conventionally assessed is weak or absent. We addressed this conundrum by embracing the distinction inspired by neuroscientific research, between vision for perception and vision for action. A dual-process perspective predicts that accident vulnerability will be associated more strongly with vision for action than vision for perception. In this preliminary investigation, older and younger adults, with relatively high and relatively low self-reported accident vulnerability (Accident Proneness Questionnaire), completed three behavioural assessments targeting vision for perception (Freiburg Visual Acuity Test); vision for action (Vision for Action Test-VAT); and the ability to perform physical actions involving balance, walking and standing (Short Physical Performance Battery). Accident vulnerability was not associated with visual acuity or with performance of physical actions but was associated with VAT performance. VAT assesses the ability to link visual input with a specific action-launching a saccadic eye movement as rapidly as possible, in response to shapes presented in peripheral vision. The predictive relationship between VAT performance and accident vulnerability was independent of age, visual acuity and physical performance scores. Applied implications of these findings are considered.

A review of grasping as the movements of digits in space

It is tempting to describe human reach-to-grasp movements in terms of two, more or less independent visuomotor channels, one relating hand transport to the object’s location and the other relating grip aperture to the object’s size. Our review of experimental work questions this framework for reasons that go beyond noting the dependence between the two channels. Both the lack of effect of size illusions on grip aperture and the finding that the variability in grip aperture does not depend on the object’s size indicate that size information is not used to control grip aperture. An alternative is to describe grip formation as emerging from controlling the movements of the digits in space. Each digit’s trajectory when grasping an object is remarkably similar to its trajectory when moving to tap the same position on its own. The similarity is also evident in the fast responses when the object is displaced. This review develops a new description of the speed-accuracy trade-off for multiple effectors that is applied to grasping. The most direct support for the digit-in-space framework is that prism-induced adaptation of each digit’s tapping movements transfers to that digit’s movements when grasping, leading to changes in grip aperture for adaptation in opposite directions for the two digits. We conclude that although grip aperture and hand transport are convenient variables to describe grasping, treating grasping as movements of the digits in space is a more suitable basis for understanding the neural control of grasping.

Identifying Cortical Substrates Underlying the Phenomenology of Stereopsis and Realness: A Pilot fMRI Study

Viewing a real scene or a stereoscopic image (e.g., 3D movies) with both eyes yields a vivid subjective impression of object solidity, tangibility, immersive negative space and sense of realness; something that is not experienced when viewing single pictures of 3D scenes normally with both eyes. This phenomenology, sometimes referred to as stereopsis, is conventionally ascribed to the derivation of depth from the differences in the two eye's images (binocular disparity). Here we report on a pilot study designed to explore if dissociable neural activity associated with the phenomenology of realness can be localized in the cortex. In order to dissociate subjective impression from disparity processing, we capitalized on the finding that the impression of realness associated with stereoscopic viewing can also be generated when viewing a single picture of a 3D scene with one eye through an aperture. Under a blocked fMRI design, subjects viewed intact and scrambled images of natural 3-D objects, and scenes under three viewing conditions: (1) single pictures viewed normally with both eyes (binocular); (2) single pictures viewed with one eye through an aperture (monocular-aperture); and (3) stereoscopic anaglyph images of the same scenes viewed with both eyes (binocular stereopsis). Fixed-effects GLM contrasts aimed at isolating the phenomenology of stereopsis demonstrated a selective recruitment of similar posterior parietal regions for both monocular and binocular stereopsis conditions. Our findings provide preliminary evidence that the cortical processing underlying the subjective impression of realness may be dissociable and distinct from the derivation of depth from disparity.

Dissociating neural activity associated with the subjective phenomenology of monocular stereopsis: An EEG study

The subjective phenomenology associated with stereopsis, of solid tangible objects separated by a palpable negative space, is conventionally thought to be a by-product of the derivation of depth from binocular disparity. However, the same qualitative impression has been reported in the absence of disparity, e.g., when viewing pictorial images monocularly through an aperture. Here we aimed to explore if we could identify dissociable neural activity associated with the qualitative impression of stereopsis in the absence of the processing of binocular disparities. We measured EEG activity while subjects viewed pictorial (non-stereoscopic) images of 2D and 3D geometric forms under four different viewing conditions (binocular, monocular, binocular aperture, monocular aperture). EEG activity was analysed by oscillatory source localization (beamformer technique) to examine power change in occipital and parietal regions across viewing and stimulus conditions in targeted frequency bands (alpha: 8-13 Hz & gamma: 60-90 Hz). We observed expected event-related gamma synchronization and alpha desynchronization in occipital cortex and predominant gamma synchronization in parietal cortex across viewing and stimulus conditions. However, only the viewing condition predicted to generate the strongest impression of stereopsis (monocular aperture) revealed significantly elevated gamma synchronization within the parietal cortex for the critical contrasts (3D vs. 2D form). These findings suggest dissociable neural processes specific to the qualitative impression of stereopsis as distinguished from disparity processing.

Trajectories of brain development in school-age children born preterm with very low birth weight

Preterm birth (gestational age < 37 weeks) with very low birth weight (VLBW, birth weight ≤ 1500 g) is associated with lifelong cognitive deficits, including in executive function, and persistent alterations in cortical and subcortical structures. However, it remains unclear whether “catch-up” growth is possible in the preterm/VLBW brain. Longitudinal structural MRI was conducted with children born preterm with VLBW (n = 41) and term-born peers participating in the Norwegian Mother and Child Cohort Study (MoBa) (n = 128) at two timepoints in early school age (mean ages 8.0 and 9.3 years). Images were analyzed with the FreeSurfer 5.3.0 longitudinal stream to assess differences in development of cortical thickness, surface area, and brain structure volumes, as well as associations with executive function development (NEPSY Statue and WMS-III Spatial Span scores) and perinatal health markers. No longitudinal group × time effects in cortical thickness, surface area, or subcortical volumes were seen, indicating similar brain growth trajectories in the groups over an approximately 16-month period in middle childhood. Higher IQ scores within the VLBW group were associated with greater surface area in left parieto-occipital and inferior temporal regions. Among VLBW preterm-born children, cortical surface area was smaller across the cortical mantle, and cortical thickness was thicker occipitally and frontally and thinner in lateral parietal and posterior temporal areas. Smaller volumes of corpus callosum, right globus pallidus, and right thalamus persisted in the VLBW group from timepoint 1 to 2. VLBW children had on average IQ 1 SD below term-born MoBa peers and significantly worse scores on WMS-III Spatial Span. Executive function scores did not show differential associations with morphometry between groups cross-sectionally or longitudinally. This study investigated divergent or “catch-up” growth in terms of cortical thickness, surface area, and volumes of subcortical gray matter structures and corpus callosum in children born preterm/VLBW and did not find group × time interactions. Greater surface area at mean age 9.3 in left parieto-occipital and inferior temporal cortex was associated with higher IQ in the VLBW group. These results suggest that preterm VLBW children may have altered cognitive networks, yet have structural growth trajectories that appear generally similar to their term-born peers in this early school age window.

A network view on brain regions involved in experts' object and pattern recognition: Implications for the neural mechanisms of skilled visual perception

Skilled visual object and pattern recognition form the basis of many everyday behaviours. The game of chess has often been used as a model case for studying how long-term experience aides in perceiving objects and their spatio-functional interrelations. Earlier research revealed two brain regions, posterior middle temporal gyrus (pMTG) and collateral sulcus (CoS), to be linked to chess experts' superior object and pattern recognition, respectively. Here we elucidated the brain networks these two expertise-related regions are embedded in, employing resting-state functional connectivity analysis and meta-analytic connectivity modelling with the BrainMap database. pMTG was preferentially connected with dorsal visual stream areas and a parieto-prefrontal network for action planning, while CoS was preferentially connected with posterior medial cortex and hippocampus, linked to scene perception, perspective-taking and navigation. Functional profiling using BrainMap meta-data revealed that pMTG was linked to semantic processing as well as inhibition and attention, while CoS was linked to face and shape perception as well as passive viewing. Our findings suggest that pMTG subserves skilled object recognition by mediating the link between object identity and object affordances, while CoS subserves skilled pattern recognition by linking the position of individual objects with typical spatio-functional layouts of their environment stored in memory.

Preserved Object Weight Processing after Bilateral Lateral Occipital Complex Lesions

Object interaction requires knowledge of the weight of an object, as well as its shape. The lateral occipital complex (LOC), an area within the ventral visual pathway, is well known to be critically involved in processing visual shape information. Recently, however, LOC has also been implicated in coding object weight before grasping-a result that is surprising because weight is a nonvisual object property that is more relevant for motor interaction than visual perception. Here, we examined the causal role of LOC in perceiving heaviness and in determining appropriate fingertip forces during object lifting. We studied perceptions of heaviness and lifting behavior in a neuropsychological patient (M.C.) who has large bilateral occipitotemporal lesions that include LOC. We compared the patient's performance to a group of 18 neurologically healthy age-matched controls. Participants were asked to lift and report the perceived heaviness of a set of equally weighted spherical objects of various sizes-stimuli which typically induce the size-weight illusion, in which the smaller objects feel heavier than the larger objects despite having identical mass. Despite her ventral stream lesions, M.C. experienced a robust size-weight illusion induced by visual cues to object volume, and the magnitude of the illusion in M.C. was comparable to age-matched controls. Similarly, M.C. evinced predictive fingertip force scaling to visual size cues during her initial lifts of the objects that were well within the normal range. These single-case neuropsychological findings suggest that LOC is unlikely to play a causal role in computing object weight.

Towards a unified perspective of object shape and motion processing in human dorsal cortex

Although object-related areas were discovered in human parietal cortex a decade ago, surprisingly little is known about the nature and purpose of these representations, and how they differ from those in the ventral processing stream. In this article, we review evidence for the unique contribution of object areas of dorsal cortex to three-dimensional (3-D) shape representation, the localization of objects in space, and in guiding reaching and grasping actions. We also highlight the role of dorsal cortex in form-motion interaction and spatiotemporal integration, possible functional relationships between 3-D shape and motion processing, and how these processes operate together in the service of supporting goal-directed actions with objects. Fundamental differences between the nature of object representations in the dorsal versus ventral processing streams are considered, with an emphasis on how and why dorsal cortex supports veridical (rather than invariant) representations of objects to guide goal-directed hand actions in dynamic visual environments.