The role of cortical area V5/MT+ in speed-tuned directional anisotropies in global motion perception

Interaction between spatial perception and temporal perception enables preservation of cause-effect relationship: Visual psychophysics and neuronal dynamics

INTRODUCTION

Visual perception of moving objects is integral to our day-to-day life, integrating visual spatial and temporal perception. Most research studies have focused on finding the brain regions activated during motion perception. However, an empirically validated general mathematical model is required to understand the modulation of the motion perception. Here, we develop a mathematical formulation of the modulation of the perception of a moving object due to a change in speed, under the formulation of the invariance of causality.

METHODS

We formulated the perception of a moving object as the coordinate transformation from a retinotopic space onto perceptual space and derived a quantitative relationship between spatiotemporal coordinates. To validate our model, we undertook the analysis of two experiments: (i) the perceived length of the moving arc, and (ii) the perceived time while observing moving stimuli. We performed a magnetic resonance imaging (MRI) tractography investigation of subjects to demarcate the anatomical correlation of the modulation of the perception of moving objects.

RESULTS

Our theoretical model shows that the interaction between visual-spatial and temporal perception, during the perception of moving object is described by coupled linear equations; and experimental observations validate our model. We observed that cerebral area V5 may be an anatomical correlate for this interaction. The physiological basis of interaction is shown by a Lotka-Volterra system delineating interplay between acetylcholine and dopamine neurotransmitters, whose concentrations vary periodically with the orthogonal phase shift between them, occurring at the axodendritic synapse of complex cells at area V5.

CONCLUSION

Under the invariance of causality in the representation of events in retinotopic space and perceptual space, the speed modulates the perception of a moving object. This modulation may be due to variations of the tuning properties of complex cells at area V5 due to the dynamic interaction between acetylcholine and dopamine. Our analysis is the first significant study, to our knowledge, that establishes a mathematical linkage between motion perception and causality invariance.

The structural basis of age-related decline in global motion perception at fast and slow speeds

A decrease in global motion perception (GMP) has been reported in older adults, and this age-related decline in GMP varies with the speed of global motion. However, no studies have investigated whether the asynchronous age-related decline in GMP is related to degenerative changes in brain structure. In this study, the random dot kinematogram paradigm and structural magnetic resonance imaging were used to investigate the asynchronous aging of GMP at fast and slow speeds (called fast GMP and slow GMP, respectively) and their relationships with brain structure. Ninety-four older adults (65.74 ± 4.50 yrs) and 90 younger adults (22.83 ± 4.84 yrs) participated in the experiment. The results showed that older adults had higher motion coherence thresholds (MCT) than younger adults at both fast and slow speeds. Brain-behavior correlation analyses of younger adults revealed that none of the correlations between morphological measures and MCTs survived correction for multiple comparisons. For older adults, slow MCT was correlated with cortical thickness in the bilateral V4v, V5/MT+, left V7, V8, LO, and surface area in the right V7. Fast MCT was significantly correlated with gray matter volume in the right V7 and thickness in the left V5/MT+. These results support the view that global motion extraction occurs within two speed-tuned systems that are at least partially independent in terms of their neural substrates, which deteriorate with age at different speeds. Aging of GMP is also associated with morphological changes in the visual cortex. Age-related cerebral atrophy in the dorsal stream may impair both fast and slow GMP, whereas aging of the ventral stream specifically impairs slow GMP.

Longitudinal study of infants receiving extra motor stimulation, full‐term control infants, and infants born preterm: High‐density EEG analyses of cortical activity in response to visual motion

Electroencephalography was used to investigate the effects of extrastimulation and preterm birth on the development of visual motion perception during early infancy. Infants receiving extra motor stimulation in the form of baby swimming, a traditionally raised control group, and preterm born infants were presented with an optic flow pattern simulating forward and reversed self‐motion and unstructured random visual motion before and after they achieved self‐produced locomotion. Extrastimulated infants started crawling earlier and displayed significantly shorter N2 latencies in response to visual motion than their full‐term and preterm peers. Preterm infants could not differentiate between visual motion conditions, nor did they significantly decrease their latencies with age and locomotor experience. Differences in induced activities were also observed with desynchronized theta‐band activity in all infants, but with more mature synchronized alpha–beta band activity only in extrastimulated infants after they had become mobile. Compared with the other infants, preterm infants showed more widespread desynchronized oscillatory activities at lower frequencies at the age of 1 year (corrected for prematurity). The overall advanced performance of extrastimulated infants was attributed to their enriched motor stimulation. The poorer responses in the preterm infants could be related to impairment of the dorsal visual stream that is specialized in the processing of visual motion.

Visual Neuropsychology in Development: Anatomo-Functional Brain Mechanisms of Action/Perception Binding in Health and Disease

Vision is the main entrance for environmental input to the human brain. Even if vision is our most used sensory modality, its importance is not limited to environmental exploration. Rather it has strong links to motor competences, further extending to cognitive and social aspects of human life. These multifaceted relationships are particularly important in developmental age and become dramatically evident in presence of complex deficits originating from visual aberrancies. The present review summarizes the available neuropsychological evidence on the development of visual competences, with a particular focus on the associated visuo-motor integration skills in health and disease. With the aim of supporting future research and interventional settings, the goal of the present review is to constitute a solid base to help the translation of neuropsychological hypotheses into straightforward empirical investigations and rehabilitation/training protocols. This approach will further increase the impact, ameliorate the acceptance, and ease the use and implementation of lab-derived intervention protocols in real-life situations.

Effect of Visual Field Location on Global Motion Perception: A Developmental Study

Previous work has shown that motion perception in school-age children is similar to that of adults for fast speeds but is immature at slow speeds for stimuli presented in the central visual field. This study examined whether visual field location affects this developmental pattern. We measured left/right and up/down global motion direction discrimination for fast and slow speeds in 7- to 10-year-old children and in adults with stimuli presented to upper, central, or lower visual fields. For left/right direction discrimination, children showed significantly higher (worse) coherence thresholds than adults for slow, but not fast, speeds in the central visual field. In the upper and lower visual fields, children showed significantly higher coherence thresholds than adults for both speeds. For up/down direction discrimination, children showed similar performance to adults for the central visual field. In the upper and lower visual fields, children performed significantly worse than adults; this finding was speed-tuned only for the lower visual field. Thus, children show immature global motion perception in the periphery even when performance in central vision is adult-like. These results enrich our understanding of motion perception development in children with typical vision.

Neural activity for hip-knee control in those with anterior cruciate ligament reconstruction: A task-based functional connectivity analysis

Anterior cruciate ligament injury may induce neurophysiological changes for sensorimotor control. Neuroimaging investigations have revealed unique brain activity patterns for knee movement following injury, indicating potential neural mechanisms underlying aberrant neuromuscular control that may contribute to heightened risk of secondary injury, altered movement patterns and poor patient outcomes. However, neuroimaging paradigms thus far have been limited to single joint, single motion knee tasks. Therefore, we sought to overcome prior limitations to understand the effects of injury on neural control of lower extremity movement by employing a multi-joint motor paradigm and determining differences in neural activity between ACL-reconstructed (ACLr) individuals relative to healthy matched controls. Fifteen patients with left anterior cruciate ligament reconstruction and fifteen matched healthy controls participated in this study. Neural activity was examined using functional magnetic resonance imaging during a block-designed knee-hip movement paradigm (similar to a supine heel-slide). Participants for each group were monitored and task performance was controlled via a metronome to ensure the same spatial-temporal parameters. We observed that those with ACL reconstruction displayed increased activation within the intracalcarine cortex, lingual gyrus, occipital fusiform gyrus, lateral occipital cortex, angular gyrus, and superior parietal lobule relative to controls. A follow-up task-based functional connectivity analyses using seed regions identified from the group analysis revealed connectivity among fronto-insular-temporal and sensorimotor regions within the ACLr participants. The results of this fMRI investigation suggest ACLr individuals require increased activity and connectivity in areas responsible for visual-spatial cognition and orientation, and attention for hip and knee motor control.

Motion direction, luminance contrast, and speed perception: An unexpected meeting

Motion direction and luminance contrast are two central features in the representation of visual motion in humans. In five psychophysical experiments, we showed that these two features affect the perceived speed of a visual stimulus. Our data showed a surprising interaction between contrast and direction. Participants perceived downward moving stimuli as faster than upward or rightward stimuli, but only at high contrast. Likewise, luminance contrast produced an underestimation of motion speed, but mostly when the stimuli moved downward. We explained these novel phenomena by means of a theoretical model, accounting for prior knowledge of motion dynamics.

Neural Correlates of Speed-Tuned Motion Perception in Healthy Adults

It has been suggested that slow and medium-to-fast speeds of motion may be processed by at least partially separate mechanisms. The purpose of this study was to establish the cortical areas activated during motion-defined form and global motion tasks as a function of speed, using functional magnetic resonance imaging. Participants performed discrimination tasks with random dot stimuli at high coherence, at coherence near their own thresholds, and for random motion. Stimuli were moving at 0.1 or 5 deg/s. In the motion-defined form task, lateral occipital complex, V5/MT+ and intraparietal sulcus showed greater activation by high or near-threshold coherence than by random motion stimuli; V5/MT+ and intraparietal sulcus demonstrated greater activation for 5 than 0.1 deg/s dot motion. In the global motion task, only high coherence stimuli elicited significant activation over random motion; this activation was primarily in nonclassical motion areas. V5/MT+ was active for all motion conditions and showed similar activation for coherent and random motion. No regions demonstrated speed-tuning effects for global motion. These results suggest that similar cortical systems are activated by slow- and medium-speed stimuli during these tasks in healthy adults.

Visual Acceleration Perception for Simple and Complex Motion Patterns

Humans are able to judge whether a target is accelerating in many viewing contexts, but it is an open question how the motion pattern per se affects visual acceleration perception. We measured acceleration and deceleration detection using patterns of random dots with horizontal (simpler) or radial motion (more visually complex). The results suggest that we detect acceleration better when viewing radial optic flow than horizontal translation. However, the direction within each type of pattern has no effect on performance and observers detect acceleration and deceleration similarly within each condition. We conclude that sensitivity to the presence of acceleration is generally higher for more complex patterns, regardless of the direction within each type of pattern or the sign of acceleration.

When brain damage "improves" perception: neglect patients can localize motion-shifted probes better than controls

When we look at bars flashed against a moving background, we see them displaced in the direction of the upcoming motion (flash-grab illusion). It is still debated whether these motion-induced position shifts are low-level, reflexive consequences of stimulus motion or high-level compensation engaged only when the stimulus is tracked with attention. To investigate whether attention is a causal factor for this striking illusory position shift, we evaluated the flash-grab illusion in six patients with damaged attentional networks in the right hemisphere and signs of left visual neglect and six age-matched controls. With stimuli in the top, right, and bottom visual fields, neglect patients experienced the same amount of illusion as controls. However, patients showed no significant shift when the test was presented in their left hemifield, despite having equally precise judgments. Thus, paradoxically, neglect patients perceived the position of the flash more veridically in their neglected hemifield. These results suggest that impaired attentional processes can reduce the interaction between a moving background and a superimposed stationary flash, and indicate that attention is a critical factor in generating the illusory motion-induced shifts of location.

Effects of radial direction and eccentricity on acceleration perception

Radial optic flow can elicit impressions of self-motion--vection--or of objects moving relative to the observer, but there is disagreement as to whether humans have greater sensitivity to expanding or to contracting optic flow. Although most studies agree there is an anisotropy in sensitivity to radial optic flow, it is unclear whether this asymmetry is a function of eccentricity. The issue is further complicated by the fact that few studies have examined how acceleration sensitivity is affected, even though observers and objects in the environment seldom move at a constant speed. To address these issues, we investigated the effects of direction and eccentricity on the ability to detect acceleration in radial optic flow. Our results indicate that observers are better at detecting acceleration when viewing contraction compared with expansion and that eccentricity has no effect on the ability to detect accelerating radial optic flow. Ecological interpretations are discussed.

Motion direction biases and decoding in human visual cortex

Functional magnetic resonance imaging (fMRI) studies have relied on multivariate analysis methods to decode visual motion direction from measurements of cortical activity. Above-chance decoding has been commonly used to infer the motion-selective response properties of the underlying neural populations. Moreover, patterns of reliable response biases across voxels that underlie decoding have been interpreted to reflect maps of functional architecture. Using fMRI, we identified a direction-selective response bias in human visual cortex that: (1) predicted motion-decoding accuracy; (2) depended on the shape of the stimulus aperture rather than the absolute direction of motion, such that response amplitudes gradually decreased with distance from the stimulus aperture edge corresponding to motion origin; and 3) was present in V1, V2, V3, but not evident in MT+, explaining the higher motion-decoding accuracies reported previously in early visual cortex. These results demonstrate that fMRI-based motion decoding has little or no dependence on the underlying functional organization of motion selectivity.

Stereomotion scotomas occur after binocular combination

Stereomotion scotomas are a surprisingly common visual impairment that result in an observer's inability to accurately report the direction of an object's motion in depth in restricted parts of the visual field. In this study we investigated the role of binocular cues to motion in depth. Using stimuli containing only non-stationary cues to stereomotion, we measured sensitivity across the visual field and identified areas of significant impairment in stereomotion processing in over 50% of otherwise healthy observers. These impairments vary idiosyncratically in extent and location between observers. We established that these impairments occur for a variety of visual stimuli, as long as they share the property that stimulus motion is exclusively defined by interocular and velocity differences. We tested for concordant impairments at relatively early stages along the visual pathway, i.e. changes in sensitivity across the visual field to local eye-dominance, monocular motion or instantaneous binocular disparity. Although we find variability in sensitivity across the visual field of our observers for all visual tasks, this variability across visual field locations did not correlate with the impairments in stereomotion processing. We therefore conclude that these stereomotion scotomas are due to impaired processing of dynamic cues after the stage of binocular combination.

Longitudinal study of perception of structured optic flow and random visual motion in infants using high-density EEG

Electroencephalogram (EEG) was used in infants at 3-4 months and 11-12 months to longitudinally study brain electrical activity as the infants were exposed to structured forwards and reversed optic flow, and non-structured random visual motion. Analyses of visual evoked potential (VEP) and temporal spectral evolution (TSE, time-dependent amplitude changes) were performed on EEG data recorded with a 128-channel sensor array. VEP results showed infants to significantly differentiate between the radial motion conditions, but only at 11-12 months where they showed shortest latency for forwards optic flow and longest latency for random visual motion. When the TSE results of the motion conditions were compared with those of a static non-flow dot pattern, infants at 3-4 and 11-12 months both showed significant differences in induced activity. A decrease in amplitudes at 5-7 Hz was observed as desynchronized theta-band activity at both 3-4 and 11-12 months, while an increase in amplitudes at 9-13 Hz was observed as synchronized alpha-band activity only at 11-12 months. It was concluded that brain electrical activities related to visual motion perception change during the first year of life, and these changes can be observed both in the VEP and induced activities of EEG. With adequate neurobiological development and locomotor experience infants around 1 year of age rely, more so than when they were younger, on structured optic flow and show a more adult-like specialization for motion where faster oscillating cell assemblies have fewer but more specialized neurons, resulting in improved visual motion perception.

Global motion perception in 2-year-old children: a method for psychophysical assessment and relationships with clinical measures of visual function

PURPOSE

We developed and validated a technique for measuring global motion perception in 2-year-old children, and assessed the relationship between global motion perception and other measures of visual function.

METHODS

Random dot kinematogram (RDK) stimuli were used to measure motion coherence thresholds in 366 children at risk of neurodevelopmental problems at 24 ± 1 months of age. RDKs of variable coherence were presented and eye movements were analyzed offline to grade the direction of the optokinetic reflex (OKR) for each trial. Motion coherence thresholds were calculated by fitting psychometric functions to the resulting datasets. Test-retest reliability was assessed in 15 children, and motion coherence thresholds were measured in a group of 10 adults using OKR and behavioral responses. Standard age-appropriate optometric tests also were performed.

RESULTS

Motion coherence thresholds were measured successfully in 336 (91.8%) children using the OKR technique, but only 31 (8.5%) using behavioral responses. The mean threshold was 41.7 ± 13.5% for 2-year-old children and 3.3 ± 1.2% for adults. Within-assessor reliability and test-retest reliability were high in children. Children's motion coherence thresholds were significantly correlated with stereoacuity (LANG I & II test, ρ = 0.29, P < 0.001; Frisby, ρ = 0.17, P = 0.022), but not with binocular visual acuity (ρ = 0.11, P = 0.07). In adults OKR and behavioral motion coherence thresholds were highly correlated (intraclass correlation = 0.81, P = 0.001).

CONCLUSIONS

Global motion perception can be measured in 2-year-old children using the OKR. This technique is reliable and data from adults suggest that motion coherence thresholds based on the OKR are related to motion perception. Global motion perception was related to stereoacuity in children.

Human cortical and behavioral sensitivity to patterns of complex motion at eccentricity

Complex patterns of image motion (contracting, expanding, rotating, and spiraling fields) are important in the coordination of visually guided behaviors. Whereas specialized detectors in monkey visual cortex show selectivity for particular patterns of complex motion, their representation in human visual cortex remains unclear. In the present study, functional magnetic resonance imaging (fMRI) was used to investigate the sensitivity of functionally defined regions of human visual cortex to parametrically modulated complex motion trajectories, coupled with complementary psychophysical testing. A unique stimulus design made it possible to disambiguate the neural responses and psychophysical sensitivity to complex motions per se from the distribution of local motions relative to the fovea, which are known to enhance cortical activity when presented radial to fixation. This involved presenting several small, separate motion fields in the periphery in a manner that distinguished them from global optic flow patterns. The patterns were morphed through complex motion space in a systematic time-locked fashion when presented in the scanner. Anisotropies were observed in the fMRI signal, marked by an enhanced response to expanding vs. contracting fields, even in early visual cortex. Anisotropies in the psychophysical sensitivity measures followed a similar pattern that was correlated with activity in areas hV4, V5/MT, and MST. This represents the first systematic examination of complex motion perception at both a behavioral and neural level in human observers. The characteristic processing anisotropy revealed in both data sets can inform models of complex motion processing, particularly with respect to computations performed in early visual cortex.

Integration of motion responses underlying directional motion anisotropy in human early visual cortical areas

Recent imaging studies have reported directional motion biases in human visual cortex when perceiving moving random dot patterns. It has been hypothesized that these biases occur as a result of the integration of motion detector activation along the path of motion in visual cortex. In this study we investigate the nature of such motion integration with functional MRI (fMRI) using different motion stimuli. Three types of moving random dot stimuli were presented, showing either coherent motion, motion with spatial decorrelations or motion with temporal decorrelations. The results from the coherent motion stimulus reproduced the centripetal and centrifugal directional motion biases in V1, V2 and V3 as previously reported. The temporally decorrelated motion stimulus resulted in both centripetal and centrifugal biases similar to coherent motion. In contrast, the spatially decorrelated motion stimulus resulted in small directional motion biases that were only present in parts of visual cortex coding for higher eccentricities of the visual field. In combination with previous results, these findings indicate that biased motion responses in early visual cortical areas most likely depend on the spatial integration of a simultaneously activated motion detector chain.

Psychometrically matched tasks evaluating differential fMRI activation during form and motion processing

OBJECTIVE

Deficits in visual perception and working memory are commonly observed in neuropsychiatric disorders and have been investigated using functional MRI (fMRI). However, interpretation of differences in brain activation may be confounded with differences in task performance between groups. Differences in task difficulty across conditions may also pose interpretative issues in studies of visual processing in healthy subjects.

METHOD

To address these concerns, the present study characterized brain activation in tasks that were psychometrically matched for difficulty; fMRI was used to assess brain activation in 10 healthy subjects during discrimination and working memory judgments for static and moving stimuli. For all task conditions, performance accuracy was matched at 70.7%.

RESULTS

Areas associated with V2 and V5 in the dorsal stream were activated during motion processing tasks and V4 in the ventral stream were activated during form processing tasks. Frontoparietal areas associated with working memory were also statistically significant during the working memory tasks.

CONCLUSIONS

Application of psychophysical methods to equate task demands provides a practical method to equate performance levels across conditions in fMRI studies and to compare healthy and cognitively impaired groups at comparable levels of effort. These psychometrically matched tasks can be applied to patients with a variety of cognitive disorders to investigate dysfunction of multiple a priori defined brain regions. Measuring the changes in typical activation patterns in patients with these diseases can be useful for monitoring disease progression, evaluating new drug treatments, and possibly for developing methods for early diagnosis.

Directional anisotropy of motion responses in retinotopic cortex

Recently, evidence has emerged for a radial orientation bias in early visual cortex. These results predict that in early visual cortex a tangential bias should be present for motion direction. We tested this prediction in a human imaging study, using a translating random dot pattern that slowly rotated its motion direction 360 degrees in cycles of 54 s. In addition, polar angle and eccentricity mapping were performed. This allowed the measurement of the BOLD response across the visual representations of the different retinotopic areas. We found that, in V1, V2, and V3, BOLD responses were consistently enhanced for centrifugal and centripetal motion, relative to tangential motion. The relative magnitude of the centrifugal and centripetal response biases changed with visual eccentricity. We found no motion direction biases in MT+. These results are in line with previously observed anisotropies in motion sensitivity across the visual field. However, the observation of radial motion biases in early visual cortex is surprising considering the evidence for a radial orientation bias. An additional experiment was performed to resolve this apparent conflict in results. The additional experiment revealed that the observed motion direction biases most likely originate from anisotropies in long range horizontal connections within visual cortex.

Asymmetrical cortical processing of radial expansion/contraction in infants and adults

We report asymmetrical cortical responses (steady-state visual evoked potentials) to radial expansion and contraction in human infants and adults. Forty-four infants (22 3-month-olds and 22 4-month-olds) and nine adults viewed dynamic dot patterns which cyclically (2.1 Hz) alternate between radial expansion (or contraction) and random directional motion. The first harmonic (F1) response in the steady-state VEP response must arise from mechanisms sensitive to the global radial motion structure. We compared F1 amplitudes between expansion-random and contraction-random motion alternations. F1 amplitudes for contraction were significantly larger than those for expansion for the older infants and adults but not for the younger infants. These results suggest that the human cortical motion mechanisms have asymmetrical sensitivity for radial expansion vs. contraction, which develops at around 4 months of age. The relation between development of sensitivity to radial motion and cortical motion mechanisms is discussed.

Low- and high-level first-order random-dot kinematograms: evidence from fMRI

Maximum motion displacement (Dmax) represents the largest dot displacement in a random-dot kinematogram (RDK) at which direction of motion can be discriminated. Direction discrimination thresholds for maximum motion displacement (Dmax) are not fixed but are stimulus dependent. For first-order RDKs, Dmax is larger as dot size increases and/or dot density decreases. Dmax may be limited by the receptive field size of low-level motion detectors when the dots comprising the RDK are small and densely spaced. With RDKs of increased dot size/decreased dot density, however, Dmax exceeds the spatial limits of these detectors and is likely determined by high-level feature-matching mechanisms. Using functional MRI, we obtained greater activation in posterior occipital areas for low-level RDKs and greater activation in extra-striate occipital and parietal areas for high-level RDKs. This is the first reported neuroimaging evidence supporting proposed low-level and high-level models of motion processing for first-order random-dot stimuli.

Visual motion direction is represented in population-level neural response as measured by magnetoencephalography

We investigated whether direction information is represented in the population-level neural response evoked by the visual motion stimulus, as measured by magnetoencephalography. Coherent motions with varied speed, varied direction, and different coherence level were presented using random dot kinematography. Peak latency of responses to motion onset was inversely related to speed in all directions, as previously reported, but no significant effect of direction on latency changes was identified. Mutual information entropy (IE) calculated using four-direction response data increased significantly (>2.14) after motion onset in 41.3% of response data and maximum IE was distributed at approximately 20 ms after peak response latency. When response waveforms showing significant differences (by multivariate discriminant analysis) in distribution of the three waveform parameters (peak amplitude, peak latency, and 75% waveform width) with stimulus directions were analyzed, 87 waveform stimulus directions (80.6%) were correctly estimated using these parameters. Correct estimation rate was unaffected by stimulus speed, but was affected by coherence level, even though both speed and coherence affected response amplitude similarly. Our results indicate that speed and direction of stimulus motion are represented in the distinct properties of a response waveform, suggesting that the human brain processes speed and direction separately, at least in part.