The neural basis of form and form-motion integration from static and dynamic translational Glass patterns: A rTMS investigation

The influence of form on motion signal processing in the ventral intraparietal area of macaque monkeys

The visual system relies on both motion and form signals to perceive the direction of self-motion, yet the coordination mechanisms between these two elements in this process remain elusive. In the current study, we employed heading perception as a model to delve into the interaction characteristics between form and motion signals. We recorded the responses of neurons in the ventral intraparietal area (VIP), an area with strong heading selectivity, to motion-only, form-only, and combined stimuli of simulated self-motion. Intriguingly, VIP neurons responded to form-only cues defined by Glass patterns, although they exhibited no tuning selectivity. In combined condition, introducing a small offset between form and motion cues significantly enhanced neuronal sensitivity to motion cues. However, with a larger offset, the enhancement effect on sensitivity became comparatively smaller. Moreover, we observed that the influence of form cues on neuronal response to motion cues is more pronounced in the later stage (1-2 s) of stimulation, with a relatively smaller effect in the early stage (0-1 s). This suggests a dynamic interaction between motion and form cues over time for heading perception. In summary, our study uncovered that in area VIP, form information plays a role in constructing accurate self-motion perception. This adds valuable insights into the complex dynamics of how the brain integrates motion and form cues for the perception of one's own movements.

Perception of complex Glass patterns through spatial summation across unique frames

When processing visual information from the surroundings, human vision depends on the constant integration of form and motion cues. Dynamic Glass patterns (GPs) may be used to study how such visual integration occurs in the human visual system. Dynamic GPs are visual stimuli composed of two or more unique frames consisting of different configurations of dot pairs, called dipoles, presented in rapid succession. Previous psychophysical studies showed that the discrimination of translational and circular dynamic GPs is influenced by both the number of unique frames and the pattern update rate. In this study, we manipulated these two variables to assess their influence on the discrimination threshold of circular, radial, and spiral GPs, partially replicating previous findings on circular GPs. Our results indicate that circular GPs are more easily perceived than radial and spiral GPs, showing lower discrimination thresholds. Furthermore, we found that discrimination thresholds vary as a function of the number of unique frames but not as a function of the pattern update rate. Specifically, coherence thresholds decreased with increasing the number of unique frames. In conclusion, our findings support the existence of spatial summation of form signals coming from the unique frames that generate complex GPs. On the other hand, they do not support temporal integration of local form-motion signals based on the pattern update rate.

Attention influences the effects of the previous form orientation on the current motion direction estimation

Recent studies have found that the estimates of motion directions are biased toward the previous form orientations, showing serial dependence, and the serial dependence does not involve cognitive abilities. In the current study, we conducted two experiments to investigate whether and how attention-a cognitive ability-affected the serial dependence. The results showed that serial dependence was present in the current study, reproducing the previous findings. Importantly, when the attentional load reduced the reliability (i.e., estimation accuracy and precision) of previous form orientations (Experiment 1), the serial dependence decreased, meaning that the biases of motion direction estimates toward previous form orientations were reduced; in contrast, when the attentional load reduced the reliability of current motion directions (Experiment 2), the serial dependence increased, meaning that the biases of motion direction estimates toward previous form orientations were increased. These trends were well consistent with the prediction of the Bayesian inference theory. Therefore, the current study revealed the involvement of attention in the serial dependence of current motion direction estimation on the previous form orientation, demonstrating that the serial dependence was cognitive and the attentional effect can be a Bayesian inference process, initially revealing its computational mechanism.

Serial dependencies between form orientation and motion direction are asymmetric

Much work has been done to uncover the mechanisms underlying form and motion information integration. However, no study examined the symmetry of the integration of form and motion across the temporal domain (i.e., serial dependence). In Experiment 1, we presented form and motion displays sequentially. In the form displays, dot pairs were oriented toward one screen position, indicating the form orientation; in the motion displays, dots moved radially outward. Their motion trajectories were oriented toward one screen position, indicating the motion direction. In each trial, participants reported their perceived form orientation after the form display or their perceived motion direction after the motion display. We found that the current trial's perceived motion direction was biased toward the previous trial's form orientation and vice versa, indicating serial dependencies between form orientation and motion direction. In Experiment 2, we changed the form and motion displays' reliability by varying the two displays' dot densities. The results showed that the serial dependence of form orientation on motion direction perception decreased only with increasing the current motion display's reliability; neither the reliability of the previous motion display nor that of the current form display significantly affected the serial dependence of motion direction on form orientation perception. Hence, serial dependencies between form orientation and motion direction were asymmetric. Our across-temporal integrations between form and motion, together with the simultaneous integration of form and motion revealed in the previous studies, depict a comprehensive mechanism underlying the integration of the two pieces of information.

Lack of orientation specific adaptation to vertically oriented Glass patterns in human visual cortex: an fMRI adaptation investigation

The perception of coherent form configurations in natural scenes relies on the activity of early visual areas that respond to local orientation cues. Subsequently, high-level visual areas pool these local signals to construct a global representation of the initial visual input. However, it is still debated whether neurons in the early visual cortex respond also to global form features. Glass patterns (GPs) are visual stimuli employed to investigate local and global form processing and consist of randomly distributed dots pairs called dipoles arranged to form specific global configurations. In the current study, we used GPs and functional magnetic resonance imaging (fMRI) adaptation to reveal the visual areas that subserve the processing of oriented GPs. Specifically, we adapted participants to vertically oriented GP, then we presented test GPs having either the same or different orientations with respect to the adapting GP. We hypothesized that if local form features are processed exclusively by early visual areas and global form by higher-order visual areas, then the effect of visual adaptation should be more pronounced in higher tier visual areas as it requires global processing of the pattern. Contrary to this expectation, our results revealed that adaptation to GPs is robust in early visual areas (V1, V2, and V3), but not in higher tier visual areas (V3AB and V4v), suggesting that form cues in oriented GPs are primarily derived from local-processing mechanisms that originate in V1. Finally, adaptation to vertically oriented GPs causes a modification in the BOLD response within early visual areas, regardless of the relative orientations of the adapting and test stimuli, indicating a lack of orientation selectivity.

A comparison of equivalent noise methods in investigating local and global form and motion integration

Static and dynamic cues within certain spatiotemporal proximity are used to evoke respective global percepts of form and motion. The limiting factors in this process are, first, internal noise, which indexes local orientation/direction detection, and, second, sampling efficiency, which relates to the processing and the representation of global orientation/direction. These parameters are quantified using the equivalent noise (EN) paradigm. EN has been implemented with just two levels: high and low noise. However, when using this simplified version, one must assume the shape of the overall noise dependence, as the intermediate points are missing. Here, we investigated whether two distinct EN methods, the 8-point and the simplified 2-point version, reveal comparable parameter estimates. This was performed for three different types of stimuli: random dot kinematograms, and static and dynamic translational Glass patterns, to investigate how constant internal noise estimates are, and how sampling efficiency might vary over tasks. The results indicated substantial compatibility between estimates over a wide range of external noise levels sampled with eight data points, and a simplified version producing two highly informative data points. Our findings support the use of a simplified procedure to estimate essential form-motion integration parameters, paving the way for rapid and critical applications to populations that cannot tolerate protracted measurements.

Mechanisms Underlying Directional Motion Processing and Form-Motion Integration Assessed with Visual Perceptual Learning

Dynamic Glass patterns (GPs) are visual stimuli commonly employed to study form–motion interactions. There is brain imaging evidence that non-directional motion induced by dynamic GPs and directional motion induced by random dot kinematograms (RDKs) depend on the activity of the human motion complex (hMT+). However, whether dynamic GPs and RDKs rely on the same processing mechanisms is still up for dispute. The current study uses a visual perceptual learning (VPL) paradigm to try to answer this question. Identical pre- and post-tests were given to two groups of participants, who had to discriminate random/noisy patterns from coherent form (dynamic GPs) and motion (RDKs). Subsequently, one group was trained on dynamic translational GPs, whereas the other group on RDKs. On the one hand, the generalization of learning to the non-trained stimulus would indicate that the same mechanisms are involved in the processing of both dynamic GPs and RDKs. On the other hand, learning specificity would indicate that the two stimuli are likely to be processed by separate mechanisms possibly in the same cortical network. The results showed that VPL is specific to the stimulus trained, suggesting that directional and non-directional motion may depend on different neural mechanisms.

Visual Short-Term Memory for Coherent and Sequential Motion: A rTMS Investigation

We investigated the role of the human medio-temporal complex (hMT+) in the memory encoding and storage of a sequence of four coherently moving random dot kinematograms (RDKs), by applying repetitive transcranial magnetic stimulation (rTMS) during an early or late phase of the retention interval. Moreover, in a second experiment, we also tested whether disrupting the functional integrity of hMT+ during the early phase impaired the precision of the encoded motion directions. Overall, results showed that both recognition accuracy and precision were worse in middle serial positions, suggesting the occurrence of primacy and recency effects. We found that rTMS delivered during the early (but not the late) phase of the retention interval was able to impair not only recognition of RDKs, but also the precision of the retained motion direction. However, such impairment occurred only for RDKs presented in middle positions along the presented sequence, where performance was already closer to chance level. Altogether these findings suggest an involvement of hMT+ in the memory encoding of visual motion direction. Given that both position sequence and rTMS modulated not only recognition but also the precision of the stored information, these findings are in support of a model of visual short-term memory with a variable resolution of each stored item, consistent with the assigned amount of memory resources, and that such item-specific memory resolution is supported by the functional integrity of area hMT+.

Electrophysiological aftereffects of high-frequency transcranial random noise stimulation (hf-tRNS): an EEG investigation

There is evidence that high-frequency transcranial random noise stimulation (hf-tRNS) is effective in improving behavioural performance in several visual tasks. However, so far there has been limited research into the spatial and temporal characteristics of hf-tRNS-induced facilitatory effects. In the present study, electroencephalogram (EEG) was used to investigate the spatial and temporal dynamics of cortical activity modulated by offline hf-tRNS on performance on a motion direction discrimination task. We used EEG to measure the amplitude of motion-related VEPs over the parieto-occipital cortex, as well as oscillatory power spectral density (PSD) at rest. A time-frequency decomposition analysis was also performed to investigate the shift in event-related spectral perturbation (ERSP) in response to the motion stimuli between the pre- and post-stimulation period. The results showed that the accuracy of the motion direction discrimination task was not modulated by offline hf-tRNS. Although the motion task was able to elicit motion-dependent VEP components (P1, N2, and P2), none of them showed any significant change between pre- and post-stimulation. We also found a time-dependent increase of the PSD in alpha and beta bands regardless of the stimulation protocol. Finally, time-frequency analysis showed a modulation of ERSP power in the hf-tRNS condition for gamma activity when compared to pre-stimulation periods and Sham stimulation. Overall, these results show that offline hf-tRNS may induce moderate aftereffects in brain oscillatory activity.

Temporal characteristics of global form perception in translational and circular Glass patterns

The human visual system is continuously exposed to a natural environment with static and moving objects that the visual system needs to continuously integrate and process. Glass patterns (GPs) are a class of visual stimuli widely used to study how the human visual system processes and integrates form and motion signals. GPs are made of pairs of dots that elicit a strong percept of global form. A rapid succession of unique frames originates dynamic GPs. Previous psychophysical studies showed that dynamic translational GPs are easier to detect than the static version because of the spatial summation across the unique frames composing the pattern. However, it is not clear whether the same mechanism is involved in dynamic circular GPs. In the present study, we psychophysically investigated the role of the temporal and spatial summation in the perception of both translational and circular GPs. We manipulated the number of unique frames in dynamic GPs and the update rate of the frames presentation. The results suggest that spatial and temporal summation across unique frames takes place for both translational and circular GPs. Moreover, the number of unique frames and the pattern update rate equally influence the discrimination thresholds of translational and circular GPs. These results show that form and motion integration is likely to be processed similarly for translational and circular GPs.

Spatial and Temporal Selectivity of Translational Glass Patterns Assessed With the Tilt After-Effect

Glass patterns (GPs) have been widely employed to investigate the mechanisms underlying processing of global form from locally oriented cues. The current study aimed to psychophysically investigate the level at which global orientation is extracted from translational GPs using the tilt after-effect (TAE) and manipulating the spatiotemporal properties of the adapting pattern. We adapted participants to translational GPs and tested with sinewave gratings. In Experiment 1, we investigated whether orientation-selective units are sensitive to the temporal frequency of the adapting GP. We used static and dynamic translational GPs, with dynamic GPs refreshed at different temporal frequencies. In Experiment 2, we investigated the spatial frequency selectivity of orientation-selective units by manipulating the spatial frequency content of the adapting GPs. The results showed that the TAE peaked at a temporal frequency of ∼30 Hz, suggesting that orientation-selective units responding to translational GPs are sensitive to high temporal frequencies. In addition, TAE from translational GPs peaked at lower spatial frequencies than the dipoles' spatial constant. These effects are consistent with form-motion integration at low and intermediate levels of visual processing.

Investigating the Interaction Between Form and Motion Processing: A Review of Basic Research and Clinical Evidence

A widely held view of the visual system supported the perspective that the primate brain is organized in two main specialized streams, called the ventral and dorsal streams. The ventral stream is known to be involved in object recognition (e.g., form and orientation). In contrast, the dorsal stream is thought to be more involved in spatial recognition (e.g., the spatial relationship between objects and motion direction). Recent evidence suggests that these two streams are not segregated but interact with each other. A class of visual stimuli known as Glass patterns has been developed to shed light on this process. Glass patterns are visual stimuli made of pairs of dots, called dipoles, that give the percept of a specific form or apparent motion, depending on the spatial and temporal arrangement of the dipoles. In this review, we show an update of the neurophysiological, brain imaging, psychophysical, clinical, and brain stimulation studies which have assessed form and motion integration mechanisms, and the level at which this occurs in the human and non-human primate brain. We also discuss several studies based on non-invasive brain stimulation techniques that used different types of visual stimuli to assess the cortico-cortical interactions in the visual cortex for the processing of form and motion information. Additionally, we discuss the timing of specific visual processing in the ventral and dorsal streams. Finally, we report some parallels between healthy participants and neurologically impaired patients in the conscious processing of form and motion.

Implied Motion From Form Shows Motion Aids the Perception of Global Form in Amblyopia

Purpose

Global motion and global form perception have been found to be abnormal in the presence of amblyopia. How such deficits manifest in visual function reliant on the interactions between these two visual processing mechanisms has not been adequately explored. In the current study, we use dynamic Glass patterns (dGlass) to measure implied motion thresholds in variable external noise to investigate the local and global limitations of processing.

Methods

A total of 13 amblyopes (eight strabismic and five anisometropic, mean interocular visual acuity difference 0.30 ± 0.12 logMAR) and six visually normal controls discriminated the overall implied motion of dGlass generated by presenting nine independent sets of static Glass patterns over 0.5 seconds. The orientation of dipole elements was derived from the Gaussian distribution with prescribed mean and standard deviation that served as external noise. Thresholds at varying external noise were fitted to a set of linear amplifier models that were statistically compared to investigate the contribution of local and global processing parameters.

Results

The implied motion thresholds were higher for strabismic (4.33° ± 1.34°) compared to anisometropic (2.32° ± 0.76°) amblyopia and controls (2.28° ± 0.50°) in the no-noise condition. The multivariate ANOVA analysis showed no difference between amblyopic and control observers at the no-noise and high-noise levels (P > 0.1). The statistical comparison of nested models showed normal internal noise and sampling efficiency parameters for both strabismic and anisometropic amblyopia (PS >0.50).

Conclusions

The normal thresholds for implied motion in this study would suggest that motion aids the perception of global form cues present in dynamic Glass patterns. Our results challenge the proposed dorsal stream vulnerability in developmental disorders such as amblyopia.

Limited Attention Diminishes Spatial Suppression From Large Field Glass Patterns

Glass patterns (GPs) consist of randomly distributed dot pairs (dipoles) whose orientations are determined by specific geometric transforms. We investigated the role of visuospatial attention in the processing of global form from GPs by measuring the effect of distraction on adaptation to GPs. In the nondistracted condition, observers were adapted to coherent GPs. After the adaptation period, they were presented with a test GP divided in two halves along the vertical and were required to judge which side of the test GP was more coherent. In the attention-distracted condition, a high-load rapid serial visual presentation task was performed during the adapting period. The magnitude of the form after-effect was measured using a technique that measures the coherence level at which the test GP appears random. The rationale was that if attention has a modulatory effect on the spatial summation of dipoles, in the attention-distracted condition, we should expect a weaker form after-effect. However, the results showed stronger form after-effect in the attention-distracted condition than in the nondistracted condition, suggesting that distraction during adaptation increases the strength of form adaptation. Additional experiments suggested that distraction may reduce the spatial suppression from large-scale textures, strengthening the spatial summation of local-oriented signals.

Reevaluating hMT+ and hV4 functional specialization for motion and static contrast using fMRI-guided repetitive transcranial magnetic stimulation

Although visual areas hMT+ and hV4 are considered to have segregated functions for the processing of motion and form within dorsal and ventral streams, respectively, more recent evidence favors some functional overlap. Here we use fMRI-guided online repetitive transcranial magnetic stimulation (rTMS) to test two associated hypotheses: that area hV4 is causally involved in the perception of motion and hMT+ in the perception of static form. We use variations of a common global stimulus to test two dynamic motion-based tasks and two static form-based tasks in ipsilateral and contralateral visual fields. We find that rTMS to both hMT+ and hV4 significantly impairs direction discrimination and causes a perceptual slowing of motion, implicating hV4 in motion perception. Stimulation of hMT+ impairs motion in both visual fields, implying that disruption to one hMT+ disrupts the other with both needed for optimal performance. For the second hypothesis, we find the novel result that hV4 stimulation markedly reduces perceived contrast of a static stimulus. hMT+ stimulation also produces an effect, implicating it in static contrast perception. Our findings are the first to show that rTMS of hV4 can produce a large perceptual effect and, taken together, suggest a less rigid functional segregation between hMT+ and hV4 than previously thought.