The role of human ventral visual cortex in motion perception

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Dissociating representations of affect and motion in visual cortices

While a delicious dessert being presented to us may elicit strong feelings of happiness and excitement, the same treat falling slowly away can lead to sadness and disappointment. Our emotional response to the item depends on its visual motion direction. Despite this importance, it remains unclear whether (and how) cortical areas devoted to decoding motion direction represents or integrates emotion with perceived motion direction. Motion-selective visual area V5/MT+ sits, both functionally and anatomically, at the nexus of dorsal and ventral visual streams. These pathways, however, differ in how they are modulated by emotional cues. The current study was designed to disentangle how emotion and motion perception interact, as well as use emotion-dependent modulation of visual cortices to understand the relation of V5/MT+ to canonical processing streams. During functional magnetic resonance imaging (fMRI), approaching, receding, or static motion after-effects (MAEs) were induced on stationary positive, negative, and neutral stimuli. An independent localizer scan was conducted to identify the visual-motion area V5/MT+. Through univariate and multivariate analyses, we demonstrated that emotion representations in V5/MT+ share a more similar response profile to that observed in ventral visual than dorsal, visual structures. Specifically, V5/MT+ and ventral structures were sensitive to the emotional content of visual stimuli, whereas dorsal visual structures were not. Overall, this work highlights the critical role of V5/MT+ in the representation and processing of visually acquired emotional content. It further suggests a role for this region in utilizing affectively salient visual information to augment motion perception of biologically relevant stimuli.

Sensorimotor and Frontoparietal Network Connectivity Are Associated With Subsequent Maintenance of Gait Speed and Episodic Memory in Older Adults

BACKGROUND

Slow gait is predictive of functional impairments in older adults, while concomitant slow gait and cognitive complaints are associated with a greater risk for cognitive decline and dementia. However, functional neural correlates for gait speed maintenance are unclear. As the sensorimotor network (SMN) and frontoparietal network (FPN) are integral components of these functions, this study investigated differences in SMN and FPN in older adults with/without gait speed decline over 24 months; and whether these networks were associated with the maintenance of cognitive function.

METHODS

We included 42 community-dwelling older adults aged >70 years from the MOBILIZE Boston Study. Resting-state fMRI was performed at the study baseline. Participant characteristics, gait speed, Mini-Mental State Examination, and Hopkins Verbal Learning Test (HVLT) were assessed at baseline and at 24-month follow-up. Decliners were identified as individuals with >0.05 meters/second decline in gait speed from baseline to 24 months. Of the 26 decliners and 16 maintainers, decliners exhibited a significant decline in delayed-recall performance on the HVLT over 24 months.

RESULTS

Controlling for baseline age and multiple comparisons, contrary to initial hypothesis, maintainers exhibited lower baseline primary motor and premotor connectivity (p = .01) within the SMN, and greater baseline ventral visual-supramarginal gyrus connectivity within the FPN (p = .02) compared to decliners. Lower primary motor-premotor connectivity was correlated with maintenance of delayed-recall performance on the HVLT (p = .04).

CONCLUSION

These findings demonstrated a potential compensatory mechanism involved in the link between the decline in gait speed and episodic memory, whereby baseline connectivity of the SMN and FPN may underlie subsequent maintenance of gait speed and cognitive function in old age.

Dissociation in neuronal encoding of object versus surface motion in the primate brain

A paradox exists in our understanding of motion processing in the primate visual system: neurons in the dorsal motion processing stream often strikingly fail to encode long-range and perceptually salient jumps of a moving stimulus. Psychophysical studies suggest that such long-range motion, which requires integration over more distant parts of the visual field, may be based on higher-order motion processing mechanisms that rely on feature or object tracking. Here, we demonstrate that ventral visual area V4, long recognized as critical for processing static scenes, includes neurons that maintain direction selectivity for long-range motion, even when conflicting local motion is present. These V4 neurons exhibit specific selectivity for the motion of objects, i.e., targets with defined boundaries, rather than the motion of surfaces behind apertures, and are selective for direction of motion over a broad range of spatial displacements and defined by a variety of features. Motion direction at a range of speeds can be accurately decoded on single trials from the activity of just a few V4 neurons. Thus, our results identify a novel motion computation in the ventral stream that is strikingly different from, and complementary to, the well-established system in the dorsal stream, and they support the hypothesis that the ventral stream system interacts with the dorsal stream to achieve the higher level of abstraction critical for tracking dynamic objects.

The structural basis of age-related decline in global motion perception at fast and slow speeds

A decrease in global motion perception (GMP) has been reported in older adults, and this age-related decline in GMP varies with the speed of global motion. However, no studies have investigated whether the asynchronous age-related decline in GMP is related to degenerative changes in brain structure. In this study, the random dot kinematogram paradigm and structural magnetic resonance imaging were used to investigate the asynchronous aging of GMP at fast and slow speeds (called fast GMP and slow GMP, respectively) and their relationships with brain structure. Ninety-four older adults (65.74 ± 4.50 yrs) and 90 younger adults (22.83 ± 4.84 yrs) participated in the experiment. The results showed that older adults had higher motion coherence thresholds (MCT) than younger adults at both fast and slow speeds. Brain-behavior correlation analyses of younger adults revealed that none of the correlations between morphological measures and MCTs survived correction for multiple comparisons. For older adults, slow MCT was correlated with cortical thickness in the bilateral V4v, V5/MT+, left V7, V8, LO, and surface area in the right V7. Fast MCT was significantly correlated with gray matter volume in the right V7 and thickness in the left V5/MT+. These results support the view that global motion extraction occurs within two speed-tuned systems that are at least partially independent in terms of their neural substrates, which deteriorate with age at different speeds. Aging of GMP is also associated with morphological changes in the visual cortex. Age-related cerebral atrophy in the dorsal stream may impair both fast and slow GMP, whereas aging of the ventral stream specifically impairs slow GMP.

Disentangling Object Category Representations Driven by Dynamic and Static Visual Input

Humans can label and categorize objects in a visual scene with high accuracy and speed, a capacity well characterized with studies using static images. However, motion is another cue that could be used by the visual system to classify objects. To determine how motion-defined object category information is processed by the brain in the absence of luminance-defined form information, we created a novel stimulus set of "object kinematograms" to isolate motion-defined signals from other sources of visual information. Object kinematograms were generated by extracting motion information from videos of 6 object categories and applying the motion to limited-lifetime random dot patterns. Using functional magnetic resonance imaging (fMRI) (n = 15, 40% women), we investigated whether category information from the object kinematograms could be decoded within the occipitotemporal and parietal cortex and evaluated whether the information overlapped with category responses to static images from the original videos. We decoded object category for both stimulus formats in all higher-order regions of interest (ROIs). More posterior occipitotemporal and ventral regions showed higher accuracy in the static condition, while more anterior occipitotemporal and dorsal regions showed higher accuracy in the dynamic condition. Further, decoding across the two stimulus formats was possible in all regions. These results demonstrate that motion cues can elicit widespread and robust category responses on par with those elicited by static luminance cues, even in ventral regions of visual cortex that have traditionally been associated with primarily image-defined form processing.SIGNIFICANCE STATEMENT Much research on visual object recognition has focused on recognizing objects in static images. However, motion is a rich source of information that humans might also use to categorize objects. Here, we present the first study to compare neural representations of several animate and inanimate objects when category information is presented in two formats: static cues or isolated dynamic motion cues. Our study shows that, while higher-order brain regions differentially process object categories depending on format, they also contain robust, abstract category representations that generalize across format. These results expand our previous understanding of motion-derived animate and inanimate object category processing and provide useful tools for future research on object category processing driven by multiple sources of visual information.

Radiographic Response Assessment Strategies for Early-Phase Brain Trials in Complex Tumor Types and Drug Combinations: from Digital "Flipbooks" to Control Systems Theory

There is an urgent need for drug development in brain tumors. While current radiographic response assessment provides instructions for identifying large treatment effects in simple high- and low-grade gliomas, there remains a void of strategies to evaluate complex or difficult to measure tumors or tumors of mixed grade with enhancing and non-enhancing components. Furthermore, most patients exhibit some period of alteration in tumor growth after starting a new therapy, but simple response categorization (e.g., stable disease, progressive disease) fails to provide any meaningful insight into the depth or degree of potential "subclinical" therapeutic response. We propose a creative solution to these issues based on a tiered strategy meant to increase confidence in identifying therapeutic effects even in the most challenging tumor types, while also providing a framework for complex evaluation of combination and sequential treatment schemes. Specifically, we demonstrate the utility of digital "flipbooks" to quickly identify subtle changes in complex tumors. We show how a modified Levin criteria can be used to quantify the degree of visual changes, while establishing estimates of the association between tumor volume and visual inspection. Lastly, we introduce the concept of quantifying therapeutic response using control systems theory. We propose measuring changes in volume (proportional), the area under the volume vs. time curve (integral) and changes in growth rates (derivative) to utilize a "PID" controller model of single or combination therapeutic activity.

Temporally and functionally distinct large-scale brain network dynamics supporting task switching

Objective:

Our daily activities require frequent switches among competing responses at the millisecond time scale. We determined the spatiotemporal characteristics and functional significance of rapid, large-scale brain network dynamics during task switching.

Methods:

This cross-sectional study investigated patients with drug-resistant focal epilepsy who played a Lumosity cognitive flexibility training game during intracranial electroencephalography (iEEG) recording. According to a given task rule, unpredictably switching across trials, participants had to swipe the screen in the direction the stimulus was pointing or moving. Using this data, we described the spatiotemporal characteristics of iEEG high-gamma augmentation occurring more intensely during switch than repeat trials, unattributable to the effect of task rule (pointing or moving), within-stimulus congruence (the direction of stimulus pointing and moving was same or different in a given trial), or accuracy of an immediately preceding response. Diffusion-weighted imaging (DWI) tractography determined whether distant cortical regions showing enhanced activation during task switch trials were directly connected by white matter tracts. Trial-by-trial iEEG analysis deduced whether the intensity of task switch-related high-gamma augmentation was altered through practice and whether high-gamma amplitude predicted the accuracy of an upcoming response among switch trials.

Results:

The average number of completed trials during five-minute gameplay was 221.4 per patient (range: 171–285). Task switch trials increased the response times, whereas later trials reduced them. Analysis of iEEG signals sampled from 860 brain sites effectively elucidated the distinct spatiotemporal characteristics of task switch, task rule, and post-error-specific high-gamma modulations. Post-cue, task switch-related high-gamma augmentation was initiated in the right calcarine cortex after 260 ms, right precuneus after 330 ms, right entorhinal after 420 ms, and bilateral anterior middle-frontal gyri after 450 ms. DWI tractography successfully showed the presence of direct white matter tracts connecting the right visual areas to the precuneus and anterior middle-frontal regions but not between the right precuneus and anterior middle-frontal regions. Task-related high-gamma amplitudes in later trials were reduced in the calcarine, entorhinal and anterior middle-frontal regions, but increased in the precuneus. Functionally, enhanced post-cue precuneus high-gamma augmentation improved the accuracy of subsequent responses among switch trials.

Conclusions:

Our multimodal analysis uncovered two temporally and functionally distinct network dynamics supporting task switching. High-gamma augmentation in the visual-precuneus pathway may reflect the neural process facilitating an attentional shift to a given updated task rule. High-gamma activity in the visual-dorsolateral prefrontal pathway, rapidly reduced through practice, may reflect the cost of executing appropriate stimulus-response translation.

Cortical pathways during Postural Control: new insights from functional EEG source connectivity

Postural control is a complex feedback system that relies on vast array of sensory inputs in order to maintain a stable upright stance. The brain cortex plays a crucial role in the processing of this information and in the elaboration of a successful adaptive strategy to external stimulation preventing loss of balance and falls. In the present work, the participants postural control system was challenged by disrupting the upright stance via a mechanical skeletal muscle vibration applied to the calves. The EEG source connectivity method was used to investigate the cortical response to the external stimulation and highlight the brain network primarily involved in high-level coordination of the postural control system. The cortical network reconfiguration was assessed during two experimental conditions of eyes open and eyes closed and the network flexibility (i.e. its dynamic reconfiguration over time) was correlated with the sample entropy of the stabilogram sway. The results highlight two different cortical strategies in the alpha band: the predominance of frontal lobe connections during open eyes and the strengthening of temporal-parietal network connections in the absence of visual cues. Furthermore, a high correlation emerges between the flexibility in the regions surrounding the right temporo-parietal junction and the sample entropy of the CoP sway, suggesting their centrality in the postural control system. These results open the possibility to employ network-based flexibility metrics as markers of a healthy postural control system, with implications in the diagnosis and treatment of postural impairing diseases.

Applications of dynamic visual acuity test in clinical ophthalmology

Dynamic visual acuity test (DVAT) plays a key role in the assessment of vestibular function, the visual function of athletes, as well as various ocular diseases. As the visual pathways conducting dynamic and static signals are different, DVATs may have potential advantages over the traditional visual acuity tests commonly used, such as static visual acuity, contrast sensitivity, and static perimetry. Here, we provide a review of commonly applied DVATs and their several uses in clinical ophthalmology. These data indicate that the DVAT has its unique clinical significance in the evaluation of several ocular disorders.

Reduced evoked activity and cortical oscillations are correlated with anisometric amblyopia and impairment of visual acuity

Amblyopia is a developmental disorder associated with abnormal visual experience during early childhood commonly arising from strabismus and/or anisometropia and leading to dysfunctions in visual cortex and to various visual deficits. The different forms of neuronal activity that are attenuated in amblyopia have been only partially characterized. In electrophysiological recordings of healthy human brain, the presentation of visual stimuli is associated with event-related activity and oscillatory responses. It has remained poorly understood whether these forms of activity are reduced in amblyopia and whether possible dysfunctions would arise from lower- or higher-order visual areas. We recorded neuronal activity with magnetoencephalography (MEG) from anisometropic amblyopic patients and control participants during two visual tasks presented separately for each eye and estimated neuronal activity from source-reconstructed MEG data. We investigated whether event-related and oscillatory responses would be reduced for amblyopia and localized their cortical sources. Oscillation amplitudes and evoked responses were reduced for stimuli presented to the amblyopic eye in higher-order visual areas and in parietal and prefrontal cortices. Importantly, the reduction of oscillation amplitudes but not that of evoked responses was correlated with decreased visual acuity in amblyopia. These results show that attenuated oscillatory responses are correlated with visual deficits in anisometric amblyopia.

Divergent Thinking Influences the Perception of Ambiguous Visual Illusions

This study investigated the relationships between personality and creativity in the perception of two different ambiguous visual illusions. Previous research has suggested that Industriousness and Openness/Intellect (as measured by the Big Five Aspects Scale) are both associated with individual differences in perceptual switching rates for binocular rivalry stimuli. Here, we examined whether these relationships generalise to the Necker Cube and the Spinning Dancer illusions. In the experimental phase of this study, participants viewed these ambiguous figures under both static and dynamic, as well as free-view and fixation, conditions. As predicted, perceptual switching rates were higher: (a) for the static Necker Cube than the Spinning Dancer, and (b) in free-view compared with fixation conditions. In the second phase of the study, personality type and divergent thinking were measured using the Big Five Aspects Scale and the Alternate Uses Task, respectively. Higher creativity/divergent thinking (as measured by the Alternate Uses Task) was found to predict greater switching rates for the static Necker Cube (but not the Spinning Dancer) under both free-view and fixation conditions. These findings suggest that there are differences in the perceptual processing of creative individuals.

Characterization of Feedback Neurons in the High-Level Visual Cortical Areas That Project Directly to the Primary Visual Cortex in the Cat

Previous studies indicate that top-down influence plays a critical role in visual information processing and perceptual detection. However, the substrate that carries top-down influence remains poorly understood. Using a combined technique of retrograde neuronal tracing and immunofluorescent double labeling, we characterized the distribution and cell type of feedback neurons in cat's high-level visual cortical areas that send direct connections to the primary visual cortex (V1: area 17). Our results showed: (1) the high-level visual cortex of area 21a at the ventral stream and PMLS area at the dorsal stream have a similar proportion of feedback neurons back projecting to the V1 area, (2) the distribution of feedback neurons in the higher-order visual area 21a and PMLS was significantly denser than in the intermediate visual cortex of area 19 and 18, (3) feedback neurons in all observed high-level visual cortex were found in layer II-III, IV, V, and VI, with a higher proportion in layer II-III, V, and VI than in layer IV, and (4) most feedback neurons were CaMKII-positive excitatory neurons, and few of them were identified as inhibitory GABAergic neurons. These results may argue against the segregation of ventral and dorsal streams during visual information processing, and support "reverse hierarchy theory" or interactive model proposing that recurrent connections between V1 and higher-order visual areas constitute the functional circuits that mediate visual perception. Also, the corticocortical feedback neurons from high-level visual cortical areas to the V1 area are mostly excitatory in nature.

Eye Movement Evaluation in Multiple Sclerosis and Parkinson's Disease Using a Standardized Oculomotor and Neuro-Ophthalmic Disorder Assessment (SONDA)

Evaluating the state of the oculomotor system of a patient is one of the fundamental tests done in neuro-ophthalmology. However, up to date, very few quantitative standardized tests of eye movements' quality exist, limiting this assessment to confrontational tests reliant on subjective interpretation. Furthermore, quantitative tests relying on eye movement properties, such as pursuit gain and saccade dynamics are often insufficient to capture the complexity of the underlying disorders and are often (too) long and tiring. In this study, we present SONDA (Standardized Oculomotor and Neurological Disorder Assessment): this test is based on analyzing eye tracking recorded during a short and intuitive continuous tracking task. We tested patients affected by Multiple Sclerosis (MS) and Parkinson's Disease (PD) and find that: (1) the saccadic dynamics of the main sequence alone are not sufficient to separate patients from healthy controls; (2) the combination of spatio-temporal and statistical properties of saccades and saccadic dynamics enables an identification of oculomotor abnormalities in both MS and PD patients. We conclude that SONDA constitutes a powerful screening tool that allows an in-depth evaluation of (deviant) oculomotor behavior in a few minutes of non-invasive testing.

Midlevel visual deficits after strokes involving area human V4

We present the results of 51 stroke patients with free central visual fields of which about half suffer from clear deficits of midlevel vision undetected by standard clinical tests. These patients yield significantly elevated thresholds for detection and/or discrimination between forms defined by motion, colour, or line orientation ('texture'). As demonstrated by voxel-based lesion-symptom mapping (VLSM) the underlying lesions involve mainly area human V4 (hV4) located in the posterior third of the fusiform gyrus and extending into the lingual gyrus. Patient's detection thresholds correlate only very weakly between the submodalities tested, indicating partly separate neural networks on mid-level vision for colour, motion, and texture detection. Correlations are far stronger for form discrimination tasks, indicating partly shared mechanisms for even simple form discrimination of distinct visual submodalities. We conclude that deficits of visual perception are far more common after strokes in visual brain areas than is apparent in clinical practice. Our results further clarify the functional organization of midlevel visual cortical areas.

Altered large-scale organization of shape processing in visual agnosia

Recent findings suggest that both dorsal and ventral visual pathways process shape information. Nevertheless, a lesion to the ventral pathway alone can result in visual agnosia, an impairment in shape perception. Here, we explored the neural basis of shape processing in a patient with visual agnosia following a circumscribed right hemisphere ventral lesion and evaluated longitudinal changes in the neural profile of shape representations. The results revealed a reduction of shape sensitivity slopes along the patient's right ventral pathway and a similar reduction in the contralesional left ventral pathway. Remarkably, posterior parts of the dorsal pathway bilaterally also evinced a reduction in shape sensitivity. These findings were similar over a two-year interval, revealing that a focal cortical lesion can lead to persistent large-scale alterations of the two visual pathways. These alterations are consistent with the view that a distributed network of regions contributes to shape perception.

Effect of Visual Field Location on Global Motion Perception: A Developmental Study

Previous work has shown that motion perception in school-age children is similar to that of adults for fast speeds but is immature at slow speeds for stimuli presented in the central visual field. This study examined whether visual field location affects this developmental pattern. We measured left/right and up/down global motion direction discrimination for fast and slow speeds in 7- to 10-year-old children and in adults with stimuli presented to upper, central, or lower visual fields. For left/right direction discrimination, children showed significantly higher (worse) coherence thresholds than adults for slow, but not fast, speeds in the central visual field. In the upper and lower visual fields, children showed significantly higher coherence thresholds than adults for both speeds. For up/down direction discrimination, children showed similar performance to adults for the central visual field. In the upper and lower visual fields, children performed significantly worse than adults; this finding was speed-tuned only for the lower visual field. Thus, children show immature global motion perception in the periphery even when performance in central vision is adult-like. These results enrich our understanding of motion perception development in children with typical vision.

Investigating face and house discrimination at foveal to parafoveal locations reveals category-specific characteristics

Since perceptual and neural face sensitivity is associated with a foveal bias, and neural place sensitivity is associated with a peripheral bias (integration over space), we hypothesized that face perception ability will decline more with eccentricity than place perception ability. We also wanted to examine whether face perception ability would show a left visual field (LeVF) bias due to earlier reports suggesting right hemisphere dominance for faces, or would show an upper or lower visual field bias. Participants performed foveal and parafoveal face and house discrimination tasks for upright or inverted stimuli (≤4°) while their eye movements were monitored. Low-level visual tasks were also measured. The eccentricity-related accuracy reductions were evident for all categories. Through detailed analyses we found (i) a robust face inversion effect across the parafovea, while for houses an opposite effect was found, (ii) higher eccentricity-related sensitivity for face performance than for house performance (via inverted vs. upright within-category eccentricity-driven reductions), (iii) within-category but not across-category performance associations across eccentricities, and (iv) no hemifield biases. Our central to parafoveal investigations suggest that high-level vision processing may be reflected in behavioural performance.

Reevaluating hMT+ and hV4 functional specialization for motion and static contrast using fMRI-guided repetitive transcranial magnetic stimulation

Although visual areas hMT+ and hV4 are considered to have segregated functions for the processing of motion and form within dorsal and ventral streams, respectively, more recent evidence favors some functional overlap. Here we use fMRI-guided online repetitive transcranial magnetic stimulation (rTMS) to test two associated hypotheses: that area hV4 is causally involved in the perception of motion and hMT+ in the perception of static form. We use variations of a common global stimulus to test two dynamic motion-based tasks and two static form-based tasks in ipsilateral and contralateral visual fields. We find that rTMS to both hMT+ and hV4 significantly impairs direction discrimination and causes a perceptual slowing of motion, implicating hV4 in motion perception. Stimulation of hMT+ impairs motion in both visual fields, implying that disruption to one hMT+ disrupts the other with both needed for optimal performance. For the second hypothesis, we find the novel result that hV4 stimulation markedly reduces perceived contrast of a static stimulus. hMT+ stimulation also produces an effect, implicating it in static contrast perception. Our findings are the first to show that rTMS of hV4 can produce a large perceptual effect and, taken together, suggest a less rigid functional segregation between hMT+ and hV4 than previously thought.

A visual illusion that influences perception and action through the dorsal pathway

There are two main anatomically and physiologically defined visual pathways connecting the primary visual cortex with higher visual areas: the ventral and the dorsal pathway. The influential two-visual-systems hypothesis postulates that visual attributes are analyzed differently for different functions: in the dorsal pathway visual information is analyzed to guide actions, whereas in the ventral pathway visual information is analyzed for perceptual judgments. We here show that a person who cannot identify objects due to an extensive bilateral ventral brain lesion is able to judge the velocity at which an object moves. Moreover, both his velocity judgements and his interceptive actions are as susceptible to a motion illusion as those of people without brain lesions. These findings speak in favor of the idea that dorsal structures process information about attributes such as velocity, irrespective of whether such information is used for perceptual judgments or to guide actions.

Beyond Rehabilitation of Acuity, Ocular Alignment, and Binocularity in Infantile Strabismus

Infantile strabismus impairs the perception of all attributes of the visual scene. High spatial frequency components are no longer visible, leading to amblyopia. Binocularity is altered, leading to the loss of stereopsis. Spatial perception is impaired as well as detection of vertical orientation, the fastest movements, directions of movement, the highest contrasts and colors. Infantile strabismus also affects other vision-dependent processes such as control of postural stability. But presently, rehabilitative therapies for infantile strabismus by ophthalmologists, orthoptists and optometrists are restricted to preventing or curing amblyopia of the deviated eye, aligning the eyes and, whenever possible, preserving or restoring binocular vision during the critical period of development, i.e., before ~10 years of age. All the other impairments are thus ignored; whether they may recover after strabismus treatment even remains unknown. We argue here that medical and paramedical professionals may extend their present treatments of the perceptual losses associated with infantile strabismus. This hypothesis is based on findings from fundamental research on visual system organization of higher mammals in particular at the cortical level. In strabismic subjects (as in normal-seeing ones), information about all of the visual attributes converge, interact and are thus inter-dependent at multiple levels of encoding ranging from the single neuron to neuronal assemblies in visual cortex. Thus if the perception of one attribute is restored this may help to rehabilitate the perception of other attributes. Concomitantly, vision-dependent processes may also improve. This could occur spontaneously, but still should be assessed and validated. If not, medical and paramedical staff, in collaboration with neuroscientists, will have to break new ground in the field of therapies to help reorganize brain circuitry and promote more comprehensive functional recovery. Findings from fundamental research studies in both young and adult patients already support our hypothesis and are reviewed here. For example, presenting different contrasts to each eye of a strabismic patient during training sessions facilitates recovery of acuity in the amblyopic eye as well as of 3D perception. Recent data also demonstrate that visual recoveries in strabismic subjects improve postural stability. These findings form the basis for a roadmap for future research and clinical development to extend presently applied rehabilitative therapies for infantile strabismus.

Age-Related Changes in Global Motion Coherence: Conflicting Haemodynamic and Perceptual Responses

Our aim was to use both behavioural and neuroimaging data to identify indicators of perceptual decline in motion processing. We employed a global motion coherence task and functional Near Infrared Spectroscopy (fNIRS). Healthy adults (n = 72, 18-85) were recruited into the following groups: young (n = 28, mean age = 28), middle-aged (n = 22, mean age = 50), and older adults (n = 23, mean age = 70). Participants were assessed on their motion coherence thresholds at 3 different speeds using a psychophysical design. As expected, we report age group differences in motion processing as demonstrated by higher motion coherence thresholds in older adults. Crucially, we add correlational data showing that global motion perception declines linearly as a function of age. The associated fNIRS recordings provide a clear physiological correlate of global motion perception. The crux of this study lies in the robust linear correlation between age and haemodynamic response for both measures of oxygenation. We hypothesise that there is an increase in neural recruitment, necessitating an increase in metabolic need and blood flow, which presents as a higher oxygenated haemoglobin response. We report age-related changes in motion perception with poorer behavioural performance (high motion coherence thresholds) associated with an increased haemodynamic response.

Neural Correlates of Speed-Tuned Motion Perception in Healthy Adults

It has been suggested that slow and medium-to-fast speeds of motion may be processed by at least partially separate mechanisms. The purpose of this study was to establish the cortical areas activated during motion-defined form and global motion tasks as a function of speed, using functional magnetic resonance imaging. Participants performed discrimination tasks with random dot stimuli at high coherence, at coherence near their own thresholds, and for random motion. Stimuli were moving at 0.1 or 5 deg/s. In the motion-defined form task, lateral occipital complex, V5/MT+ and intraparietal sulcus showed greater activation by high or near-threshold coherence than by random motion stimuli; V5/MT+ and intraparietal sulcus demonstrated greater activation for 5 than 0.1 deg/s dot motion. In the global motion task, only high coherence stimuli elicited significant activation over random motion; this activation was primarily in nonclassical motion areas. V5/MT+ was active for all motion conditions and showed similar activation for coherent and random motion. No regions demonstrated speed-tuning effects for global motion. These results suggest that similar cortical systems are activated by slow- and medium-speed stimuli during these tasks in healthy adults.

Three-Dimensional Representations of Objects in Dorsal Cortex are Dissociable from Those in Ventral Cortex

An established conceptualization of visual cortical function is one in which ventral regions mediate object perception while dorsal regions support spatial information processing and visually guided action. This division has been contested by evidence showing that dorsal regions are also engaged in the representation of object shape, even when actions are not required. The critical question is whether these dorsal, object-based representations are dissociable from ventral representations, and whether they play a functional role in object recognition. We examined the neural and behavioral profile of patients with impairments in object recognition following ventral cortex damage. In a functional magnetic resonanace imaging experiment, the blood oxygen level-dependent response in the ventral, but not dorsal, cortex of the patients evinced less sensitivity to object 3D structure compared with that of healthy controls. Consistently, in psychophysics experiments, the patients exhibited significant impairments in object perception, but still revealed residual sensitivity to object-based structural information. Together, these findings suggest that, although in the intact system there is considerable crosstalk between dorsal and ventral cortices, object representations in dorsal cortex can be computed independently from those in ventral cortex. While dorsal representations alone are unable to support normal object perception, they can, nevertheless, support a coarse description of object structural information.

Dynamic Network Communication in the Human Functional Connectome Predicts Perceptual Variability in Visual Illusion

Ubiquitous variability between individuals in visual perception is difficult to standardize and has thus essentially been ignored. Here we construct a quantitative psychophysical measure of illusory rotary motion based on the Pinna-Brelstaff figure (PBF) in 73 healthy volunteers and investigate the neural circuit mechanisms underlying perceptual variation using functional magnetic resonance imaging (fMRI). We acquired fMRI data from a subset of 42 subjects during spontaneous and 3 stimulus conditions: expanding PBF, expanding modified-PBF (illusion-free) and expanding modified-PBF with physical rotation. Brain-wide graph analysis of stimulus-evoked functional connectivity patterns yielded a functionally segregated architecture containing 3 discrete hierarchical networks, commonly shared between rest and stimulation conditions. Strikingly, communication efficiency and strength between 2 networks predominantly located in visual areas robustly predicted individual perceptual differences solely in the illusory stimulus condition. These unprecedented findings demonstrate that stimulus-dependent, not spontaneous, dynamic functional integration between distributed brain networks contributes to perceptual variability in humans.

Developmental visual perception deficits with no indications of prosopagnosia in a child with abnormal eye movements

Visual categories are associated with eccentricity biases in high-order visual cortex: Faces and reading with foveally-biased regions, while common objects and space with mid- and peripherally-biased regions. As face perception and reading are among the most challenging human visual skills, and are often regarded as the peak achievements of a distributed neural network supporting common objects perception, it is unclear why objects, which also rely on foveal vision to be processed, are associated with mid-peripheral rather than with a foveal bias. Here, we studied BN, a 9 y.o. boy who has normal basic-level vision, abnormal (limited) oculomotor pursuit and saccades, and shows developmental object and contour integration deficits but with no indication of prosopagnosia. Although we cannot infer causation from the data presented here, we suggest that normal pursuit and saccades could be critical for the development of contour integration and object perception. While faces and perhaps reading, when fixated upon, take up a small portion of central visual field and require only small eye movements to be properly processed, common objects typically prevail in mid-peripheral visual field and rely on longer-distance voluntary eye movements as saccades to be brought to fixation. While retinal information feeds into early visual cortex in an eccentricity orderly manner, we hypothesize that propagation of non-foveal information to mid and high-order visual cortex critically relies on circuitry involving eye movements. Limited or atypical eye movements, as in the case of BN, may hinder normal information flow to mid-eccentricity biased high-order visual cortex, adversely affecting its development and consequently inducing visual perceptual deficits predominantly for categories associated with these regions.

Visual motion serves but is not under the purview of the dorsal pathway

Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual motion tasks critically depend on the structural integrity of regions outside the dorsal pathway. Here, based on numerous studies, I propose that visual motion signals are swiftly transmitted via multiple non-hierarchical routes to primary motion-dedicated processing regions (MT/V5 and MST) that are not part of the dorsal pathway, and then propagated to a multiplicity of brain areas according to task demands, reaching these regions earlier than the dorsal/ventral hierarchical flow. This not only places MT/V5 at the same or even earlier visual processing stage as that of V1, but can also elucidate many findings with implications to visual awareness. While the integrity of the non-hierarchical motion pathway is necessary for all visual motion perception, it is insufficient on its own, and the transfer of visual motion signals to additional brain areas is crucial to allow the different motion perception tasks (e.g. optic flow, visuo-vestibular balance, movement observation, dynamic form detection and perception, and even reading). I argue that this lateral visual motion pathway can be distinguished from the dorsal pathway not only based on faster response latencies and distinct anatomical connections, but also based on its full field representation. I also distinguish between this primary lateral visual motion pathway sensitive to all motion in the visual field, and a much less investigated optic flow sensitive medial processing pathway (from V1 to V6 and V6A) that appears to be part of the dorsal pathway. Multiple additional predictions are provided that allow testing this proposal and distinguishing between the visual pathways.

Lesions to right posterior parietal cortex impair visual depth perception from disparity but not motion cues

The posterior parietal cortex (PPC) is understood to be active when observers perceive three-dimensional (3D) structure. However, it is not clear how central this activity is in the construction of 3D spatial representations. Here, we examine whether PPC is essential for two aspects of visual depth perception by testing patients with lesions affecting this region. First, we measured subjects' ability to discriminate depth structure in various 3D surfaces and objects using binocular disparity. Patients with lesions to right PPC (N = 3) exhibited marked perceptual deficits on these tasks, whereas those with left hemisphere lesions (N = 2) were able to reliably discriminate depth as accurately as control subjects. Second, we presented an ambiguous 3D stimulus defined by structure from motion to determine whether PPC lesions influence the rate of bistable perceptual alternations. Patients' percept durations for the 3D stimulus were generally within a normal range, although the two patients with bilateral PPC lesions showed the fastest perceptual alternation rates in our sample. Intermittent stimulus presentation reduced the reversal rate similarly across subjects. Together, the results suggest that PPC plays a causal role in both inferring and maintaining the perception of 3D structure with stereopsis supported primarily by the right hemisphere, but do not lend support to the view that PPC is a critical contributor to bistable perceptual alternations.This article is part of the themed issue 'Vision in our three-dimensional world'.

Dorsal and ventral stream contributions to form-from-motion perception in a patient with form-from motion deficit: a case report

The main model of visual processing in primates proposes an anatomo-functional distinction between the dorsal stream, specialized in spatio-temporal information, and the ventral stream, processing essentially form information. However, these two pathways also communicate to share much visual information. These dorso-ventral interactions have been studied using form-from-motion (FfM) stimuli, revealing that FfM perception first activates dorsal regions (e.g., MT+/V5), followed by successive activations of ventral regions (e.g., LOC). However, relatively little is known about the implications of focal brain damage of visual areas on these dorso-ventral interactions. In the present case report, we investigated the dynamics of dorsal and ventral activations related to FfM perception (using topographical ERP analysis and electrical source imaging) in a patient suffering from a deficit in FfM perception due to right extrastriate brain damage in the ventral stream. Despite the patient's FfM impairment, both successful (observed for the highest level of FfM signal) and absent/failed FfM perception evoked the same temporal sequence of three processing states observed previously in healthy subjects. During the first period, brain source localization revealed cortical activations along the dorsal stream, currently associated with preserved elementary motion processing. During the latter two periods, the patterns of activity differed from normal subjects: activations were observed in the ventral stream (as reported for normal subjects), but also in the dorsal pathway, with the strongest and most sustained activity localized in the parieto-occipital regions. On the other hand, absent/failed FfM perception was characterized by weaker brain activity, restricted to the more lateral regions. This study shows that in the present case report, successful FfM perception, while following the same temporal sequence of processing steps as in normal subjects, evoked different patterns of brain activity. By revealing a brain circuit involving the most rostral part of the dorsal pathway, this study provides further support for neuro-imaging studies and brain lesion investigations that have suggested the existence of different brain circuits associated with different profiles of interaction between the dorsal and the ventral streams.

Here, there and everywhere: higher visual function and the dorsal visual stream

The dorsal visual stream, often referred to as the 'where' stream, represents the pathway taken by visual information from the primary visual cortex to the posterior parietal lobe and onwards. It partners the ventral or 'what' stream, the subject of a previous review and largely a temporal-based system. Here, we consider the dorsal stream disorders of perception (simultanagnosia, akinetopsia) along with their consequences on action (eg, optic ataxia and oculomotor apraxia, along with Balint's syndrome). The role of the dorsal stream in blindsight and hemispatial neglect is also considered.

Area V5-a microcosm of the visual brain

Area V5 of the visual brain, first identified anatomically in 1969 as a separate visual area, is critical for the perception of visual motion. As one of the most intensively studied parts of the visual brain, it has yielded many insights into how the visual brain operates. Among these are: the diversity of signals that determine the functional capacities of a visual area; the relationship between single cell activity in a specialized visual area and perception of, and preference for, attributes of a visual stimulus; the multiple asynchronous inputs into, and outputs from, an area as well as the multiple operations that it undertakes asynchronously; the relationship between activity at given, specialized, areas of the visual brain and conscious awareness; and the mechanisms used to “bind” signals from one area with those from another, with a different specialization, to give us our unitary perception of the visual world. Hence V5 is, in a sense, a microcosm of the visual world and its study gives important insights into how the whole visual brain is organized—anatomically, functionally and perceptually.

The contribution of LM to the neuroscience of movement vision

The significance of early and sporadic reports in the 19th century of impairments of motion vision following brain damage was largely unrecognized. In the absence of satisfactory post-mortem evidence, impairments were interpreted as the consequence of a more general disturbance resulting from brain damage, the location and extent of which was unknown. Moreover, evidence that movement constituted a special visual perception and may be selectively spared was similarly dismissed. Such skepticism derived from a reluctance to acknowledge that the neural substrates of visual perception may not be confined to primary visual cortex. This view did not persist. First, it was realized that visual movement perception does not depend simply on the analysis of spatial displacements and temporal intervals, but represents a specific visual movement sensation. Second persuasive evidence for functional specialization in extrastriate cortex, and notably the discovery of cortical area V5/MT, suggested a separate region specialized for motion processing. Shortly thereafter the remarkable case of patient LM was published, providing compelling evidence for a selective and specific loss of movement vision. The case is reviewed here, along with an assessment of its contribution to visual neuroscience.

Ventral aspect of the visual form pathway is not critical for the perception of biological motion

Identifying the movements of those around us is fundamental for many daily activities, such as recognizing actions, detecting predators, and interacting with others socially. A key question concerns the neurobiological substrates underlying biological motion perception. Although the ventral "form" visual cortex is standardly activated by biologically moving stimuli, whether these activations are functionally critical for biological motion perception or are epiphenomenal remains unknown. To address this question, we examined whether focal damage to regions of the ventral visual cortex, resulting in significant deficits in form perception, adversely affects biological motion perception. Six patients with damage to the ventral cortex were tested with sensitive point-light display paradigms. All patients were able to recognize unmasked point-light displays and their perceptual thresholds were not significantly different from those of three different control groups, one of which comprised brain-damaged patients with spared ventral cortex (n > 50). Importantly, these six patients performed significantly better than patients with damage to regions critical for biological motion perception. To assess the necessary contribution of different regions in the ventral pathway to biological motion perception, we complement the behavioral findings with a fine-grained comparison between the lesion location and extent, and the cortical regions standardly implicated in biological motion processing. This analysis revealed that the ventral aspects of the form pathway (e.g., fusiform regions, ventral extrastriate body area) are not critical for biological motion perception. We hypothesize that the role of these ventral regions is to provide enhanced multiview/posture representations of the moving person rather than to represent biological motion perception per se.

Global processing in amblyopia: a review

Amblyopia is a neurodevelopmental disorder of the visual system that is associated with disrupted binocular vision during early childhood. There is evidence that the effects of amblyopia extend beyond the primary visual cortex to regions of the dorsal and ventral extra-striate visual cortex involved in visual integration. Here, we review the current literature on global processing deficits in observers with either strabismic, anisometropic, or deprivation amblyopia. A range of global processing tasks have been used to investigate the extent of the cortical deficit in amblyopia including: global motion perception, global form perception, face perception, and biological motion. These tasks appear to be differentially affected by amblyopia. In general, observers with unilateral amblyopia appear to show deficits for local spatial processing and global tasks that require the segregation of signal from noise. In bilateral cases, the global processing deficits are exaggerated, and appear to extend to specialized perceptual systems such as those involved in face processing.

Training-induced recovery of low-level vision followed by mid-level perceptual improvements in developmental object and face agnosia

Long-term deprivation of normal visual inputs can cause perceptual impairments at various levels of visual function, from basic visual acuity deficits, through mid-level deficits such as contour integration and motion coherence, to high-level face and object agnosia. Yet it is unclear whether training during adulthood, at a post-developmental stage of the adult visual system, can overcome such developmental impairments. Here, we visually trained LG, a developmental object and face agnosic individual. Prior to training, at the age of 20, LG's basic and mid-level visual functions such as visual acuity, crowding effects, and contour integration were underdeveloped relative to normal adult vision, corresponding to or poorer than those of 5–6 year olds (Gilaie-Dotan, Perry, Bonneh, Malach & Bentin, 2009). Intensive visual training, based on lateral interactions, was applied for a period of 9 months. LG's directly trained but also untrained visual functions such as visual acuity, crowding, binocular stereopsis and also mid-level contour integration improved significantly and reached near-age-level performance, with long-term (over 4 years) persistence. Moreover, mid-level functions that were tested post-training were found to be normal in LG. Some possible subtle improvement was observed in LG's higher-order visual functions such as object recognition and part integration, while LG's face perception skills have not improved thus far. These results suggest that corrective training at a post-developmental stage, even in the adult visual system, can prove effective, and its enduring effects are the basis for a revival of a developmental cascade that can lead to reduced perceptual impairments.