What is noise for the motion system?

Integrated Perceptual Decisions Rely on Parallel Evidence Accumulation

The ability to make accurate and timely decisions, such as judging when it is safe to cross the road, is the foundation of adaptive behavior. While the computational and neural processes supporting simple decisions on isolated stimuli have been well characterized, decision-making in the real world often requires integration of discrete sensory events over time and space. Most previous experimental work on perceptual decision-making has focused on tasks that involve only a single, task-relevant source of sensory input. It remains unclear, therefore, how such integrative decisions are regulated computationally. Here we used psychophysics, electroencephalography, and computational modeling to understand how the human brain combines visual motion signals across space in the service of a single, integrated decision. To that purpose, we presented two random-dot kinematograms in the left and the right visual hemifields. Coherent motion signals were shown briefly and concurrently in each location, and healthy adult human participants of both sexes reported the average of the two motion signals. We directly tested competing predictions arising from influential serial and parallel accounts of visual processing. Using a biologically plausible model of motion filtering, we found evidence in favor of parallel integration as the fundamental computational mechanism regulating integrated perceptual decisions.

Associations Between Autism Spectrum Quotient and Integration of Visual Stimuli in 9-year-old Children: Preliminary Evidence of Sex Differences

PURPOSE

The dorsal stream vulnerability hypothesis posits that the dorsal stream, responsible for visual motion and visuo-motor processing, may be particularly vulnerable during neurodevelopment. Consistent with this, autism spectrum disorder (ASD) has been associated with deficits in global motion integration, though deficits in ventral stream tasks, such as form identification, have also been reported. In the current study, we examined whether a similar pattern of results is found in a cohort of 381 children born with neurodevelopmental risk factors and exhibiting a wide spectrum of caregiver-reported autistic traits.

METHODS

We examined the associations between global motion perception, global form perception, fine motor function, visual-motor integration, and autistic traits (autism spectrum quotient, AQ) using linear regression, accounting for possible interactions with sex and other factors relevant to neurodevelopment.

RESULTS

All assessments of dorsal stream function were significantly associated with AQ such that worse performance predicted higher AQ scores. We also observed a significant sex interaction, with worse global form perception associated with higher AQ in boys (n = 202) but not girls (n = 179).

CONCLUSION

We found widespread associations between dorsal stream functions and autistic traits. These associations were observed in a large group of children with a range of AQ scores, demonstrating a range of visual function across the full spectrum of autistic traits. In addition, ventral function was associated with AQ in boys but not girls. Sex differences in the associations between visual processing and neurodevelopment should be considered in the designs of future studies.

Optimal policy for uncertainty estimation concurrent with decision making

Decision making often depends on vague information that leads to uncertainty, which is a quantity contingent not on choice but on probability distributions of sensory evidence and other cognitive variables. Uncertainty may be computed in parallel and interact with decision making. Here, we adapt the classic random-dot motion direction discrimination task to allow subjects to indicate their uncertainty without having to form a decision first. The subjects' choices and reaction times for perceptual decisions and uncertainty responses are measured, respectively. We then build a value-based model in which decisions are based on optimizing value computed from a drift-diffusion process. The model accounts for key features of subjects' behavior and the variation across the individuals. It explains how the addition of the uncertainty option affects perceptual decision making. Our work establishes a value-based theoretical framework for studying uncertainty and perceptual decisions that can be readily applied in future investigations of the underlying neural mechanism.

Daily fluctuations in visual motion discriminability contribute to daily fluctuations in continuous visuomotor performance

In ball sports such as table tennis, in which a ball moving at high speed is hit, an athlete's brain needs to process the motion information of the ball, predict the arrival point, and form a motor command to direct the racket there. Therefore, day-to-day fluctuations in visuomotor performance may be ascribed to fluctuations in visual motion discriminability, but it is not clear how the two are related. To examine this point, university table tennis players performed a motion direction discrimination (MDD) task and continuous visuomotor (CVM) task over 10 days as an estimation of visual motion discriminability and visuomotor performance, respectively. In the MDD task, using a joystick, participants distinguished the direction of a global coherent motion of target dots moving in the same direction on a PC monitor from innumerable dots moving in random directions. In the CVM task, participants hit sequential targets moving fast from right to left on the PC monitor by operating the cursor on the left side of the monitor up and down using the prehensile force of their thumb and index finger. The scores in the MDD and CVM tasks fluctuated day by day and showed a significant and moderate correlation between the MDD task score for the visual field in which the participants captured the target in the CVM task and the CVM task score. This correlation was confirmed even with the target moving from left to right. The fluctuations in the onset latency and the endpoint position of the cursor movement approaching the target were correlated with those of the visual motion discriminability, suggesting the contribution of motion vision to the speed and accuracy of the visuomotor performance. Moreover, these relationships were prominent in veteran players. For table tennis athletes, especially experienced players, fluctuations in the visual motion discrimination performance in a visual field specific for capturing a ball may be responsible for the fluctuations in continuous visuomotor (striking) performance.

Persistent activity in human parietal cortex mediates perceptual choice repetition bias

Humans and other animals tend to repeat or alternate their previous choices, even when judging sensory stimuli presented in a random sequence. It is unclear if and how sensory, associative, and motor cortical circuits produce these idiosyncratic behavioral biases. Here, we combined behavioral modeling of a visual perceptual decision with magnetoencephalographic (MEG) analyses of neural dynamics, across multiple regions of the human cerebral cortex. We identified distinct history-dependent neural signals in motor and posterior parietal cortex. Gamma-band activity in parietal cortex tracked previous choices in a sustained fashion, and biased evidence accumulation toward choice repetition; sustained beta-band activity in motor cortex inversely reflected the previous motor action, and biased the accumulation starting point toward alternation. The parietal, not motor, signal mediated the impact of previous on current choice and reflected individual differences in choice repetition. In sum, parietal cortical signals seem to play a key role in shaping choice sequences.

Psychophysics and computational modeling of feature-continuous motion perception

Sensory decision-making is frequently studied using categorical tasks, even though the feature space of most stimuli is continuous. Recently, it has become more common to measure feature perception in a gradual fashion, say when studying motion perception across the full space of directions. However, continuous reports can be contaminated by perceptual or motor biases. Here, we examined such biases on perceptual reports by comparing two response methods. With the first method, participants reported motion direction in a motor reference frame by moving a trackball. With the second method, participants used a perceptual frame of reference with a perceptual comparison stimulus. We tested biases using three different versions of random dot kinematograms. We found strong and systematic biases in responses when reporting the direction in a motor frame of reference. For the perceptual frame of reference, these systematic biases were not evident. Independent of the response method, we also detected a systematic misperception where subjects sometimes confuse the physical stimulus direction with its opposite direction. This was confirmed using a von Mises mixture model that estimated the contribution of veridical perception, misperception, and guessing. Importantly, the more sensitive perceptual reporting method revealed that, with increasing levels of sensory evidence, perceptual performance increases not only in the form of higher detection probability, but under certain conditions also in the form of increased precision.

Test-retest reliability for common tasks in vision science

Research in perception and attention has typically sought to evaluate cognitive mechanisms according to the average response to a manipulation. Recently, there has been a shift toward appreciating the value of individual differences and the insight gained by exploring the impacts of between-participant variation on human cognition. However, a recent study suggests that many robust, well-established cognitive control tasks suffer from surprisingly low levels of test-retest reliability (Hedge, Powell, & Sumner, 2018b). We tested a large sample of undergraduate students (n = 160) in two sessions (separated by 1-3 weeks) on four commonly used tasks in vision science. We implemented measures that spanned a range of perceptual and attentional processes, including motion coherence (MoCo), useful field of view (UFOV), multiple-object tracking (MOT), and visual working memory (VWM). Intraclass correlations ranged from good to poor, suggesting that some task measures are more suitable for assessing individual differences than others. VWM capacity (intraclass correlation coefficient [ICC] = 0.77), MoCo threshold (ICC = 0.60), UFOV middle accuracy (ICC = 0.60), and UFOV outer accuracy (ICC = 0.74) showed good-to-excellent reliability. Other measures, namely the maximum number of items tracked in MOT (ICC = 0.41) and UFOV number accuracy (ICC = 0.48), showed moderate reliability; the MOT threshold (ICC = 0.36) and UFOV inner accuracy (ICC = 0.30) showed poor reliability. In this paper, we present these results alongside a summary of reliabilities estimated previously for other vision science tasks. We then offer useful recommendations for evaluating test-retest reliability when considering a task for use in evaluating individual differences.

Mechanisms Underlying Directional Motion Processing and Form-Motion Integration Assessed with Visual Perceptual Learning

Dynamic Glass patterns (GPs) are visual stimuli commonly employed to study form–motion interactions. There is brain imaging evidence that non-directional motion induced by dynamic GPs and directional motion induced by random dot kinematograms (RDKs) depend on the activity of the human motion complex (hMT+). However, whether dynamic GPs and RDKs rely on the same processing mechanisms is still up for dispute. The current study uses a visual perceptual learning (VPL) paradigm to try to answer this question. Identical pre- and post-tests were given to two groups of participants, who had to discriminate random/noisy patterns from coherent form (dynamic GPs) and motion (RDKs). Subsequently, one group was trained on dynamic translational GPs, whereas the other group on RDKs. On the one hand, the generalization of learning to the non-trained stimulus would indicate that the same mechanisms are involved in the processing of both dynamic GPs and RDKs. On the other hand, learning specificity would indicate that the two stimuli are likely to be processed by separate mechanisms possibly in the same cortical network. The results showed that VPL is specific to the stimulus trained, suggesting that directional and non-directional motion may depend on different neural mechanisms.

Visual Motion Coherence Responses in Human Visual Cortex

Random dot kinematograms (RDKs) have recently been used to train subjects with cortical scotomas to perform direction of motion discrimination, partially restoring visual motion perception. To study the recovery of visual perception, it is important to understand how visual areas in normal subjects and subjects with cortical scotomas respond to RDK stimuli. Studies in normal subjects have shown that blood oxygen level-dependent (BOLD) responses in human area hV5/MT+ increase monotonically with coherence, in general agreement with electrophysiology studies in primates. However, RDK responses in prior studies were obtained while the subject was performing fixation, not a motion discrimination condition. Furthermore, BOLD responses were gauged against a baseline condition of uniform illumination or static dots, potentially decreasing the specificity of responses for the spatial integration of local motion signals (motion coherence). Here, we revisit this question starting from a baseline RDK condition of no coherence, thereby isolating the component of BOLD response due specifically to the spatial integration of local motion signals. In agreement with prior studies, we found that responses in the area hV5/MT+ of healthy subjects were monotonically increasing when subjects fixated without performing a motion discrimination task. In contrast, when subjects were performing an RDK direction of motion discrimination task, responses in the area hV5/MT+ remained flat, changing minimally, if at all, as a function of motion coherence. A similar pattern of responses was seen in the area hV5/MT+ of subjects with dense cortical scotomas performing direction of motion discrimination for RDKs presented inside the scotoma. Passive RDK presentation within the scotoma elicited no significant hV5/MT+ responses. These observations shed further light on how visual cortex responses behave as a function of motion coherence, helping to prepare the ground for future studies using these methods to study visual system recovery after injury.

Dividing attention influences contextual facilitation and revision during language comprehension

Although we often seem to successfully comprehend language in the face of distraction, few studies have examined the role of sustained attention in critical components of sentence processing, such as integrating information over a sentence and revising predictions when unexpected information is encountered. The current study investigated the impact of attention on sentence processing using a novel dual-task paradigm. Participants read weakly and strongly constraining sentences with expected or unexpected endings while also tracking the motion of dots in the background, and their EEG was recorded. Under full attention, the amplitude of the N400 component of the ERP, a measure of semantic access, was reduced (facilitated) in a graded fashion by contextual strength and fit. This context-based facilitation was attenuated when attention was divided, suggesting that sustained attention is important for building up message-level representations. In contrast, the post-N400 frontal positivity that has been observed to prediction violations and associated with revision processes was unaffected by dividing attention. However, under divided attention, participants also elicited posteriorly-distributed effects to these violations. Thus, predictive processes seem to be engaged even when attention is divided, but additional resources may then be required to process unexpected information.

Vision for the blind: visual psychophysics and blinded inference for decision models

Evidence accumulation models like the diffusion model are increasingly used by researchers to identify the contributions of sensory and decisional factors to the speed and accuracy of decision-making. Drift rates, decision criteria, and nondecision times estimated from such models provide meaningful estimates of the quality of evidence in the stimulus, the bias and caution in the decision process, and the duration of nondecision processes. Recently, Dutilh et al. (Psychonomic Bulletin & Review 26, 1051–1069, 2019) carried out a large-scale, blinded validation study of decision models using the random dot motion (RDM) task. They found that the parameters of the diffusion model were generally well recovered, but there was a pervasive failure of selective influence, such that manipulations of evidence quality, decision bias, and caution also affected estimated nondecision times. This failure casts doubt on the psychometric validity of such estimates. Here we argue that the RDM task has unusual perceptual characteristics that may be better described by a model in which drift and diffusion rates increase over time rather than turn on abruptly. We reanalyze the Dutilh et al. data using models with abrupt and continuous-onset drift and diffusion rates and find that the continuous-onset model provides a better overall fit and more meaningful parameter estimates, which accord with the known psychophysical properties of the RDM task. We argue that further selective influence studies that fail to take into account the visual properties of the evidence entering the decision process are likely to be unproductive.

Cerebellar tDCS Alters the Perception of Optic Flow

Studies have shown that the cerebellar vermis is involved in the perception of motion. However, it is unclear how the cerebellum influences motion perception. tDCS is a non-invasive brain stimulation technique that can reduce (through cathodal stimulation) or increase neuronal excitability (through anodal stimulation). To explore the nature of the cerebellar involvement on large-field global motion perception (i.e., optic flow-like motion), we applied tDCS on the cerebellar midline while participants performed an optic flow motion discrimination task. Our results show that anodal tDCS improves discrimination threshold for optic flow perception, but only for left-right motion in contrast to up-down motion discrimination. This result was evident within the first 10 min of stimulation and was also found post-stimulation. Cathodal stimulation did not have any significant effects on performance in any direction. The results show that discrimination of optic flow can be improved with tDCS of the cerebellar midline and provide further support for the role of the human midline cerebellum in the perception of optic flow.

Motion Coherence and Luminance Contrast Interact in Driving Visual Gamma-Band Activity

Synchronized neuronal population activity in the gamma-frequency range (>30 Hz) correlates with the bottom-up drive of various visual features. It has been hypothesized that gamma-band synchronization enhances the gain of neuronal representations, yet evidence remains sparse. We tested a critical prediction of the gain hypothesis, which is that features that drive synchronized gamma-band activity interact super-linearly. To test this prediction, we employed whole-head magnetencephalography in human subjects and investigated if the strength of visual motion (motion coherence) and luminance contrast interact in driving gamma-band activity in visual cortex. We found that gamma-band activity (64-128 Hz) monotonically increased with coherence and contrast, while lower frequency activity (8-32 Hz) decreased with both features. Furthermore, as predicted for a gain mechanism, we found a multiplicative interaction between motion coherence and contrast in their joint drive of gamma-band activity. The lower frequency activity did not show such an interaction. Our findings provide evidence that gamma-band activity acts as a cortical gain mechanism that nonlinearly combines the bottom-up drive of different visual features.

Effects of Temporal Expectations on the Perception of Motion Gestalts

Gestalt psychology has traditionally ignored the role of attention in perception, leading to the view that autonomous processes create perceptual configurations that are then attended. More recent research, however, has shown that spatial attention influences a form of Gestalt perception: the coherence of random-dot kinematograms (RDKs). Using ERPs, we investigated whether temporal expectations exert analogous attentional effects on the perception of coherence level in RDKs. Participants were presented fixed-length sequences of RDKs and reported the coherence level of a target RDK. The target was indicated immediately after its appearance by a postcue. Target expectancy increased as the sequence progressed until target presentation; afterward, remaining RDKs were perceived without target expectancy. Expectancy influenced the amplitudes of ERP components P1 and N2. Crucially, expectancy interacted with coherence level at N2, but not at P1. Specifically, P1 amplitudes decreased linearly as a function of RDK coherence irrespective of expectancy, whereas N2 exhibited a quadratic dependence on coherence: larger amplitudes for RDKs with intermediate coherence levels, and only when they were expected. These results suggest that expectancy at early processing stages is an unspecific, general readiness for perception. At later stages, expectancy becomes stimulus specific and nonlinearly related to Gestalt coherence.

Evidence accumulation during perceptual decision-making is sensitive to the dynamics of attentional selection

The ability to select and combine multiple sensory inputs in support of accurate decisions is a hallmark of adaptive behaviour. Attentional selection is often needed to prioritize task-relevant stimuli relative to irrelevant, potentially distracting stimuli. As most studies of perceptual decision-making to date have made use of task-relevant stimuli only, relatively little is known about how attention modulates decision making. To address this issue, we developed a novel 'integrated' decision-making task, in which participants judged the average direction of successive target motion signals while ignoring concurrent and spatially overlapping distractor motion signals. In two experiments that varied the role of attentional selection, we used regression to quantify the influence of target and distractor stimuli on behaviour. Using electroencephalography, we characterised the neural correlates of decision making, attentional selection and feature-specific responses to target and distractor signals. While targets strongly influenced perceptual decisions and associated neural activity, we also found that concurrent and spatially coincident distractors exerted a measurable bias on both behaviour and brain activity. Our findings suggest that attention operates as a real-time but imperfect filter during perceptual decision-making by dynamically modulating the contributions of task-relevant and irrelevant sensory inputs.

Population receptive field estimates for motion-defined stimuli

The processing of motion changes throughout the visual hierarchy, from spatially restricted ‘local motion’ in early visual cortex to more complex large-field ‘global motion’ at later stages. Here we used functional magnetic resonance imaging (fMRI) to examine spatially selective responses in these areas related to the processing of random-dot stimuli defined by differences in motion. We used population receptive field (pRF) analyses to map retinotopic cortex using bar stimuli comprising coherently moving dots. In the first experiment, we used three separate background conditions: no background dots (dot-defined bar-only), dots moving coherently in the opposite direction to the bar (kinetic boundary) and dots moving incoherently in random directions (global motion). Clear retinotopic maps were obtained for the bar-only and kinetic-boundary conditions across visual areas V1–V3 and in higher dorsal areas. For the global-motion condition, retinotopic maps were much weaker in early areas and became clear only in higher areas, consistent with the emergence of global-motion processing throughout the visual hierarchy. However, in a second experiment we demonstrate that this pattern is not specific to motion-defined stimuli, with very similar results for a transparent-motion stimulus and a bar defined by a static low-level property (dot size) that should have driven responses particularly in V1. We further exclude explanations based on stimulus visibility by demonstrating that the observed differences in pRF properties do not follow the ability of observers to localise or attend to these bar elements. Rather, our findings indicate that dorsal extrastriate retinotopic maps may primarily be determined by the visibility of the neural responses to the bar relative to the background response (i.e. neural signal-to-noise ratios) and suggests that claims about stimulus selectivity from pRF experiments must be interpreted with caution.

Visual short-term memory for coherent motion in video game players: evidence from a memory-masking paradigm

In this study, we investigated visual short-term memory for coherent motion in action video game players (AVGPs), non-action video game players (NAVGPs), and non-gamers (control group: CONs). Participants performed a visual memory-masking paradigm previously used with macaque monkeys and humans. In particular, we tested whether video game players form a more robust visual short-term memory trace for coherent moving stimuli during the encoding phase, and whether such memory traces are less affected by an intervening masking stimulus presented 0.2 s after the offset of the to-be-remembered sample. The results showed that task performance of all groups was affected by the masking stimulus, but video game players were affected to a lesser extent than controls. Modelling of performance values and reaction times revealed that video game players have a lower guessing rate than CONs, and higher drift rates than CONs, indicative of more efficient perceptual decisions. These results suggest that video game players exhibit a more robust VSTM trace for moving objects and this trace is less prone to external interference.

Confirmation Bias through Selective Overweighting of Choice-Consistent Evidence

People's assessments of the state of the world often deviate systematically from the information available to them [1]. Such biases can originate from people's own decisions: committing to a categorical proposition, or a course of action, biases subsequent judgment and decision-making. This phenomenon, called confirmation bias [2], has been explained as suppression of post-decisional dissonance [3, 4]. Here, we provide insights into the underlying mechanism. It is commonly held that decisions result from the accumulation of samples of evidence informing about the state of the world [5-8]. We hypothesized that choices bias the accumulation process by selectively altering the weighting (gain) of subsequent evidence, akin to selective attention. We developed a novel psychophysical task to test this idea. Participants viewed two successive random dot motion stimuli and made two motion-direction judgments: a categorical discrimination after the first stimulus and a continuous estimation of the overall direction across both stimuli after the second stimulus. Participants' sensitivity for the second stimulus was selectively enhanced when that stimulus was consistent with the initial choice (compared to both, first stimuli and choice-inconsistent second stimuli). A model entailing choice-dependent selective gain modulation explained this effect better than several alternative mechanisms. Choice-dependent gain modulation was also established in another task entailing averaging of numerical values instead of motion directions. We conclude that intermittent choices direct selective attention during the evaluation of subsequent evidence, possibly due to decision-related feedback in the brain [9]. Our results point to a recurrent interplay between decision-making and selective attention.

The effects of high-frequency transcranial random noise stimulation (hf-tRNS) on global motion processing: An equivalent noise approach

BACKGROUND

High frequency transcranial random noise stimulation (hf-tRNS) facilitates performance in several perceptual and cognitive tasks, however, little is known about the underlying modulatory mechanisms.

OBJECTIVE

In this study we compared the effects of hf-tRNS to those of anodal and cathodal tDCS in a global motion direction discrimination task. An equivalent noise (EN) paradigm was used to assess how hf-tRNS modulates the mechanisms underlying local and global motion processing.

METHOD

Motion coherence threshold and slope of the psychometric function were estimated using an 8AFC task in which observers had to discriminate the motion direction of a random dot kinematogram presented either in the left or right visual hemi-field. During the task hf-tRNS, anodal and cathodal tDCS were delivered over the left hMT⁺. In a subsequent experiment we implemented an EN paradigm in order to investigate the effects of hf-tRNS on the mechanisms involved in visual motion integration (i.e., internal noise and sampling).

RESULTS

hf-tRNS reduced the motion coherence threshold but did not affect the slope of the psychometric function, suggesting no modulation of stimulus discriminability. Anodal and cathodal tDCS did not produce any modulatory effects. EN analysis in the last experiment found that hf-tRNS modulates sampling but not internal noise, suggesting that hf-tRNS modulates the integration of local motion cues.

CONCLUSION

hf-tRNS interacts with the output neurons tuned to directions near to the directional signal, incrementing the signal-to-noise ratio and the pooling of local motion cues and thus increasing the sensitivity for global moving stimuli.

Computer-animated stimuli to measure motion sensitivity: constraints on signal design in the Jacky dragon

Identifying perceptual thresholds is critical for understanding the mechanisms that underlie signal evolution. Using computer-animated stimuli, we examined visual speed sensitivity in the Jacky dragon Amphibolurus muricatus, a species that makes extensive use of rapid motor patterns in social communication. First, focal lizards were tested in discrimination trials using random-dot kinematograms displaying combinations of speed, coherence, and direction. Second, we measured subject lizards’ ability to predict the appearance of a secondary reinforcer (1 of 3 different computer-generated animations of invertebrates: cricket, spider, and mite) based on the direction of movement of a field of drifting dots by following a set of behavioural responses (e.g., orienting response, latency to respond) to our virtual stimuli. We found an effect of both speed and coherence, as well as an interaction between these 2 factors on the perception of moving stimuli. Overall, our results showed that Jacky dragons have acute sensitivity to high speeds. We then employed an optic flow analysis to match the performance to ecologically relevant motion. Our results suggest that the Jacky dragon visual system may have been shaped to detect fast motion. This pre-existing sensitivity may have constrained the evolution of conspecific displays. In contrast, Jacky dragons may have difficulty in detecting the movement of ambush predators, such as snakes and of some invertebrate prey. Our study also demonstrates the potential of the computer-animated stimuli technique for conducting nonintrusive tests to explore motion range and sensitivity in a visually mediated species.

Optic flow detection is not influenced by visual-vestibular congruency

Optic flow patterns generated by self-motion relative to the stationary environment result in congruent visual-vestibular self-motion signals. Incongruent signals can arise due to object motion, vestibular dysfunction, or artificial stimulation, which are less common. Hence, we are predominantly exposed to congruent rather than incongruent visual-vestibular stimulation. If the brain takes advantage of this probabilistic association, we expect observers to be more sensitive to visual optic flow that is congruent with ongoing vestibular stimulation. We tested this expectation by measuring the motion coherence threshold, which is the percentage of signal versus noise dots, necessary to detect an optic flow pattern. Observers seated on a hexapod motion platform in front of a screen experienced two sequential intervals. One interval contained optic flow with a given motion coherence and the other contained noise dots only. Observers had to indicate which interval contained the optic flow pattern. The motion coherence threshold was measured for detection of laminar and radial optic flow during leftward/rightward and fore/aft linear self-motion, respectively. We observed no dependence of coherence thresholds on vestibular congruency for either radial or laminar optic flow. Prior studies using similar methods reported both decreases and increases in coherence thresholds in response to congruent vestibular stimulation; our results do not confirm either of these prior reports. While methodological differences may explain the diversity of results, another possibility is that motion coherence thresholds are mediated by neural populations that are either not modulated by vestibular stimulation or that are modulated in a manner that does not depend on congruency.

Motor actions influence subsequent sensorimotor decisions

Sensorimotor decisions are influenced by factors beyond the current sensory input, but little is known about the effect of preceding motor actions. Here, we show that choice-unrelated motor actions influence subsequent sensorimotor decisions. By instructing participants to perform choice-unrelated motor responses before visuomotor decisions, we could manipulate upcoming decisions in a directed fashion. Subjects tended not to repeat the instructed motor response. Our results show that simple motor behaviors can influence subsequent sensorimotor decision.

Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias

While judging their sensory environments, decision-makers seem to use the uncertainty about their choices to guide adjustments of their subsequent behaviour. One possible source of these behavioural adjustments is arousal: decision uncertainty might drive the brain's arousal systems, which control global brain state and might thereby shape subsequent decision-making. Here, we measure pupil diameter, a proxy for central arousal state, in human observers performing a perceptual choice task of varying difficulty. Pupil dilation, after choice but before external feedback, reflects three hallmark signatures of decision uncertainty derived from a computational model. This increase in pupil-linked arousal boosts observers' tendency to alternate their choice on the subsequent trial. We conclude that decision uncertainty drives rapid changes in pupil-linked arousal state, which shape the serial correlation structure of ongoing choice behaviour.

Perceived duration of brief visual events is mediated by timing mechanisms at the global stages of visual processing

There is a growing body of evidence pointing to the existence of modality-specific timing mechanisms for encoding sub-second durations. For example, the duration compression effect describes how prior adaptation to a dynamic visual stimulus results in participants underestimating the duration of a sub-second test stimulus when it is presented at the adapted location. There is substantial evidence for the existence of both cortical and pre-cortical visual timing mechanisms; however, little is known about where in the processing hierarchy the cortical mechanisms are likely to be located. We carried out a series of experiments to determine whether or not timing mechanisms are to be found at the global processing level. We had participants adapt to random dot patterns that varied in their motion coherence, thus allowing us to probe the visual system at the level of motion integration. Our first experiment revealed a positive linear relationship between the motion coherence level of the adaptor stimulus and duration compression magnitude. However, increasing the motion coherence level in a stimulus also results in an increase in global speed. To test whether duration compression effects were driven by global speed or global motion, we repeated the experiment, but kept global speed fixed while varying motion coherence levels. The duration compression persisted, but the linear relationship with motion coherence was absent, suggesting that the effect was driven by adapting global speed mechanisms. Our results support previous claims that visual timing mechanisms persist at the level of global processing.

Sensitivity of the avian motion system to light and dark stimuli

Global motion perception is important for mobile organisms. In laterally eyed birds, global motion appears to be processed in the entopallium, a neural structure that is part of the tectofugal pathway. Electrophysiological research has shown that motion selective cells in the entopallium are most responsive to small dark moving targets. Here, we investigated whether this bias toward dark targets of entopallial cells is mirrored by perceptual performance in a motion detection task in pigeons. We measured the detection thresholds of pigeons using random dot stimuli that consisted of either black or white dots on a gray background. We found that thresholds were significantly lower when using black dots as opposed to white dots. This heightened sensitivity is also noted in the learning rates of the pigeons. That is, we found that the pigeons learned the detection task significantly faster when the stimuli consisted of black dots. We believe that our results have important implications for the understanding of the functional role of the entopallium and the ON and OFF pathways in the avian motion system.

Motor cortex activity predicts response alternation during sensorimotor decisions

Our actions are constantly guided by decisions based on sensory information. The motor cortex is traditionally viewed as the final output stage in this process, merely executing motor responses based on these decisions. However, it is not clear if, beyond this role, the motor cortex itself impacts response selection. Here, we report activity fluctuations over motor cortex measured using MEG, which are unrelated to choice content and predict responses to a visuomotor task seconds before decisions are made. These fluctuations are strongly influenced by the previous trial's response and predict a tendency to switch between response alternatives for consecutive decisions. This alternation behaviour depends on the size of neural signals still present from the previous response. Our results uncover a response-alternation bias in sensorimotor decision making. Furthermore, they suggest that motor cortex is more than an output stage and instead shapes response selection during sensorimotor decision making.

The motor cortex executes responses based on sensory choices, but it is unknown whether it also impacts response selection. Here, Pape and Siegel show that motor cortex activity present before decision making predicts responses and that this activity is influenced by previous button-presses.

Action Video Games Improve Direction Discrimination of Parafoveal Translational Global Motion but Not Reaction Times

Playing action video games enhances visual motion perception. However, there is psychophysical evidence that action video games do not improve motion sensitivity for translational global moving patterns presented in fovea. This study investigates global motion perception in action video game players and compares their performance to that of non-action video game players and non-video game players. Stimuli were random dot kinematograms presented in the parafovea. Observers discriminated the motion direction of a target random dot kinematogram presented in one of the four visual quadrants. Action video game players showed lower motion coherence thresholds than the other groups. However, when the task was performed at threshold, we did not find differences between groups in terms of distributions of reaction times. These results suggest that action video games improve visual motion sensitivity in the near periphery of the visual field, rather than speed response.

Motion Detection and Motion Verbs

Recent theories propose that semantic representation and sensorimotor processing have a common substrate via simulation. We tested the prediction that comprehension interacts with perception, using a standard psychophysics methodology. While passively listening to verbs that referred to upward or downward motion, and to control verbs that did not refer to motion, 20 subjects performed a motion-detection task, indicating whether or not they saw motion in visual stimuli containing threshold levels of coherent vertical motion. A signal detection analysis revealed that when verbs were directionally in-congruent with the motion signal, perceptual sensitivity was impaired. Word comprehension also affected decision criteria and reaction times, but in different ways. The results are discussed with reference to existing explanations of embodied processing and the potential of psychophysical methods for assessing interactions between language and perception.

Visual arts training is linked to flexible attention to local and global levels of visual stimuli

Observational drawing skill has been shown to be associated with the ability to focus on local visual details. It is unclear whether superior performance in local processing is indicative of the ability to attend to, and flexibly switch between, local and global levels of visual stimuli. It is also unknown whether these attentional enhancements remain specific to observational drawing skill or are a product of a wide range of artistic activities. The current study aimed to address these questions by testing if flexible visual processing predicts artistic group membership and observational drawing skill in a sample of first-year bachelor's degree art students (n=23) and non-art students (n=23). A pattern of local and global visual processing enhancements was found in relation to artistic group membership and drawing skill, with local processing ability found to be specifically related to individual differences in drawing skill. Enhanced global processing and more fluent switching between local and global levels of hierarchical stimuli predicted both drawing skill and artistic group membership, suggesting that these are beneficial attentional mechanisms for art-making in a range of domains. These findings support a top-down attentional model of artistic expertise and shed light on the domain specific and domain-general attentional enhancements induced by proficiency in the visual arts.

A Distinct Mechanism of Temporal Integration for Motion through Depth

Temporal integration of visual motion has been studied extensively within the frontoparallel plane (i.e., 2D). However, the majority of motion occurs within a 3D environment, and it is unknown whether the principles from 2D motion processing generalize to more realistic 3D motion. We therefore characterized and compared temporal integration underlying 2D (left/right) and 3D (toward/away) direction discrimination in human observers, varying motion coherence across a range of viewing durations. The resulting discrimination-versus-duration functions followed three stages, as follows: (1) a steep improvement during the first ∼150 ms, likely reflecting early sensory processing; (2) a subsequent, more gradual benefit of increasing duration over several hundreds of milliseconds, consistent with some form of temporal integration underlying decision formation; and (3) a final stage in which performance ceased to improve with duration over ∼1 s, which is consistent with an upper limit on integration. As previously found, improvements in 2D direction discrimination with time were consistent with near-perfect integration. In contrast, 3D motion sensitivity was lower overall and exhibited a substantial departure from perfect integration. These results confirm that there are overall differences in sensitivity for 2D and 3D motion that are consistent with a sensory difference between binocular and dichoptic sensory mechanisms. They also reveal a difference at the integration stage, in which 3D motion is not accumulated as perfectly as in the 2D motion model system.

Effects of crowding and attention on high-levels of motion processing and motion adaptation

The motion after-effect (MAE) persists in crowding conditions, i.e., when the adaptation direction cannot be reliably perceived. The MAE originating from complex moving patterns spreads into non-adapted sectors of a multi-sector adapting display (i.e., phantom MAE). In the present study we used global rotating patterns to measure the strength of the conventional and phantom MAEs in crowded and non-crowded conditions, and when attention was directed to the adapting stimulus and when it was diverted away from the adapting stimulus. The results show that: (i) the phantom MAE is weaker than the conventional MAE, for both non-crowded and crowded conditions, and when attention was focused on the adapting stimulus and when it was diverted from it, (ii) conventional and phantom MAEs in the crowded condition are weaker than in the non-crowded condition. Analysis conducted to assess the effect of crowding on high-level of motion adaptation suggests that crowding is likely to affect the awareness of the adapting stimulus rather than degrading its sensory representation, (iii) for high-level of motion processing the attentional manipulation does not affect the strength of either conventional or phantom MAEs, neither in the non-crowded nor in the crowded conditions. These results suggest that high-level MAEs do not depend on attention and that at high-level of motion adaptation the effects of crowding are not modulated by attention.

Sensitivity of a harbor seal (Phoca vitulina) to coherent visual motion in random dot displays

Motion vision is one of the fundamental properties of the visual system and is involved in numerous tasks. Previous work has shown that harbor seals are able to perceive visual motion. Tying in with this experimental finding, we assessed the sensitivity of harbor seals to visual motion using random dot displays. In these random dot displays, either all or a percentage of the dots plotted in the display area move into one direction which is referred to as percent coherence. Using random dot displays allows determining motion sensitivity free from form or position cues. Moreover, when reducing the lifetime of the dots, the experimental subjects need to rely on the global motion over the display area instead of on local motion events, such as the streaks of single dots. For marine mammals, the interpretation of global motion stimuli seems important in the context of locomotion, orientation and foraging. The first experiment required the seal to detect coherent motion directed upwards in one out of two stimulus displays and psychophysical motion coherence detection thresholds were obtained ranging from 5% to 35% coherence. At the beginning of the second experiment, which was conducted to reduce the differential flickering of the motion stimulus as secondary cue, the seal was directly able to transfer from coherent motion detection to a discrimination of coherent motion direction, leftward versus rightward. The seal performed well even when the duration of the local motion event was extremely short in the last experiment, in which noise was programmed as random position noise. Its coherence threshold was determined at 23% coherence in this experiment. This motion sensitivity compares well to the performance of most species tested so far excluding monkeys, humans and cats. To conclude, harbor seals possess an effective global motion processing system. For seals, the interpretation of global and coherent motion might e. g. play a role in the interpretation of optic flow information or when breaking the camouflage of cryptic prey items.

Transcranial alternating current stimulation attenuates visual motion adaptation

Transcranial alternating current stimulation (tACS) is used in clinical applications and basic neuroscience research. Although its behavioral effects are evident from prior reports, current understanding of the mechanisms that underlie these effects is limited. We used motion perception, a percept with relatively well known properties and underlying neural mechanisms to investigate tACS mechanisms. Healthy human volunteers showed a surprising improvement in motion sensitivity when visual stimuli were paired with 10 Hz tACS. In addition, tACS reduced the motion-after effect, and this reduction was correlated with the improvement in motion sensitivity. Electrical stimulation had no consistent effect when applied before presenting a visual stimulus or during recovery from motion adaptation. Together, these findings suggest that perceptual effects of tACS result from an attenuation of adaptation. Important consequences for the practical use of tACS follow from our work. First, because this mechanism interferes only with adaptation, this suggests that tACS can be targeted at subsets of neurons (by adapting them), even when the applied currents spread widely throughout the brain. Second, by interfering with adaptation, this mechanism provides a means by which electrical stimulation can generate behavioral effects that outlast the stimulation.

The influence of spatiotemporal structure of noisy stimuli in decision making

Decision making is a process of utmost importance in our daily lives, the study of which has been receiving notable attention for decades. Nevertheless, the neural mechanisms underlying decision making are still not fully understood. Computational modeling has revealed itself as a valuable asset to address some of the fundamental questions. Biophysically plausible models, in particular, are useful in bridging the different levels of description that experimental studies provide, from the neural spiking activity recorded at the cellular level to the performance reported at the behavioral level. In this article, we have reviewed some of the recent progress made in the understanding of the neural mechanisms that underlie decision making. We have performed a critical evaluation of the available results and address, from a computational perspective, aspects of both experimentation and modeling that so far have eluded comprehension. To guide the discussion, we have selected a central theme which revolves around the following question: how does the spatiotemporal structure of sensory stimuli affect the perceptual decision-making process? This question is a timely one as several issues that still remain unresolved stem from this central theme. These include: (i) the role of spatiotemporal input fluctuations in perceptual decision making, (ii) how to extend the current results and models derived from two-alternative choice studies to scenarios with multiple competing evidences, and (iii) to establish whether different types of spatiotemporal input fluctuations affect decision-making outcomes in distinctive ways. And although we have restricted our discussion mostly to visual decisions, our main conclusions are arguably generalizable; hence, their possible extension to other sensory modalities is one of the points in our discussion.

Perception of complex motion in humans and pigeons (Columba livia)

In the primate visual system, local motion signals are pooled to create a global motion percept. Like primates, many birds are highly dependent on vision for their survival, yet relatively little is known about motion perception in birds. We used random-dot stimuli to investigate pigeons' ability to detect complex motion (radial, rotation, and spiral) compared to humans. Our human participants had a significantly lower threshold for rotational and radial motion when compared to spiral motion. The data from the pigeons, however, showed that the pigeons were most sensitive to rotational motion and least sensitive to radial motion, while sensitivity for spiral motion was intermediate. We followed up the pigeon results with an investigation of the effect of display aperture shape for rotational motion and velocity gradient for radial motion. We found no effect of shape of the aperture on thresholds, but did observe that radial motion containing accelerating dots improved thresholds. However, this improvement did not reach the thresholds levels observed for rotational motion. In sum, our experiments demonstrate that the pooling mechanism in the pigeon motion system is most efficient for rotation.

The role of human ventral visual cortex in motion perception

Visual motion perception is fundamental to many aspects of visual perception. Visual motion perception has long been associated with the dorsal (parietal) pathway and the involvement of the ventral 'form' (temporal) visual pathway has not been considered critical for normal motion perception. Here, we evaluated this view by examining whether circumscribed damage to ventral visual cortex impaired motion perception. The perception of motion in basic, non-form tasks (motion coherence and motion detection) and complex structure-from-motion, for a wide range of motion speeds, all centrally displayed, was assessed in five patients with a circumscribed lesion to either the right or left ventral visual pathway. Patients with a right, but not with a left, ventral visual lesion displayed widespread impairments in central motion perception even for non-form motion, for both slow and for fast speeds, and this held true independent of the integrity of areas MT/V5, V3A or parietal regions. In contrast with the traditional view in which only the dorsal visual stream is critical for motion perception, these novel findings implicate a more distributed circuit in which the integrity of the right ventral visual pathway is also necessary even for the perception of non-form motion.

Age-related changes in fine motion direction discriminations

The present study used an equivalent noise method to characterize the sources of reduced performance in fine discrimination of motion with age. We varied the density of the displays, the speed and speed variability and the temporal correlation of dots' motion in successive frames to assess their effect on the sensitivity to motion direction. The results showed that, in all experimental conditions, the older observers had higher levels of internal noise. Both age groups used the stimulus information less efficiently at slow speed and most efficiently when the moving elements were uncorrelated across frames. The older observers were less efficient than the younger observers in all conditions except at high speed where the efficiency of the two age groups was the same. We fitted two biologically plausible models to the experimental data: a modified version of the local-to-global direction encoding model (Dakin et al. in Vis Res 45:3027-3049, 2005) and a model for pooling of motion information in medial temporal area (MT) where the neuronal responses were correlated (Huang and Lisberger in J Neurophysiol 101:3012-3030, 2009). The modeling results indicate that the correlation in neuronal responses is essential to characterize the influence of speed and speed variability on the sensitivity to direction information. For the younger observers, a single set of parameters can account for the effect of noise and the spatio-temporal parameters of the stimuli, while, for the older observers, a change in the correlation of neuronal activity and the directional tuning bandwidth with the levels of external noise is needed. The findings are discussed with respect to optimal use of the dynamic information to overcome the negative effect of aging.

Motion words selectively modulate direction discrimination sensitivity for threshold motion

Can speech selectively modulate the sensitivity of a sensory system so that, in the presence of a suitable linguistic context, the discrimination of certain perceptual features becomes more or less likely? In this study, participants heard upward or downward motion words followed by a single visual field of random dots moving upwards or downwards. The time interval between the onsets of the auditory and the visual stimuli was varied parametrically. Motion direction could be either discriminable (suprathreshold motion) or non-discriminable (threshold motion). Participants had to judge whether the dots were moving upward or downward. Results show a double dissociation between discrimination sensitivity (d′) and reaction times depending on whether vertical motion was above or at threshold. With suprathreshold motion, responses were faster for congruent directions of words and dots, but sensitivity was equal across conditions. With threshold motion, sensitivity was higher for congruent directions of words and dots, but responses were equally fast across conditions. The observed differences in sensitivity and response times were largest when the dots appeared 450 ms after word onset, that is, consistently with electrophysiology, at the time the up/down semantics of the word had become available. These data suggest that word meanings can alter the balance between signal and noise within the visual system and affect the perception of low-level sensory features.

Visual short-term memory for global motion revealed by directional and speed-tuned masking

Neurobehavioral research with non-human primates has shown that different attributes of motion stimuli, such as direction and speed can be stored in visual short-term memory (VSTM) with a high degree of accuracy. We examined VSTM for global motion with a memory masking paradigm to determine which stimulus attributes are important in the storage process. We presented in two visual quadrants global motion random dot kinematograms (RDKs), whereas in the two remaining visual quadrants we presented random-motion RDKs. This pattern of stimulation was displayed in two distinct temporal intervals, i.e., sample and test stimuli (duration: 200 ms), separated in time by a 3.2-s delay period. During the delay period a random- or directional-motion mask was presented briefly (200 ms) either at the beginning, in the middle or at the end of the delay period. The results showed that the mask mainly interferes with performance when displayed 200 ms after the offset of the sample and when it had a coherent direction rather than random directions. Moreover, the mask is significantly more effective when its direction and speed matched that of the remembered sample. These results support the notion that the memory representation of global motion is selective for direction and speed, being compromised by intervening directional stimuli presented immediately after the encoding phase. Moreover, this selectivity suggests that the same neural mechanisms involved in the processing of global motion may be recruited for its storage.

Closing the Gates to Consciousness: Distractors Activate a Central Inhibition Process

The paradigm of distractor-induced blindness has previously been used to track the transition from unconscious to conscious visual processing. In a variation of this paradigm used in this study, participants (n = 13) had to detect an orientation change of tilted bars (target) embedded in a dynamic random pattern; the onset of the target was signaled by the presentation of a color cue. Occasional orientation changes preceding the cue served as distractors and severely impaired the target's detection. ERPs showed that a frontal negativity was cumulatively activated by the distractors, and early sensory components were not affected. In a control condition, the target was defined by a coherent motion of the bars. Orientation changes preceding the motion target did not affect its detection, and the frontal suppression process was not observed. However, we obtained a significant reduction of the sensory components. The data support the notion that distractors that share the target's features trigger a cumulative inhibition process preventing the conscious representation of the inhibited features. Explorative source modeling suggests that this process originates in the pFC. A top–down modulation of sensory processing could not be observed.

Motion processing deficits in migraine are related to contrast sensitivity

Background: There are conflicting reports concerning the ability of people with migraine to detect and discriminate visual motion. Previous studies used different displays and none adequately assessed other parameters that could affect performance, such as those that could indicate precortical dysfunction.

Methods: Motion-direction detection, discrimination and relative motion thresholds were compared from participants with and without migraine. Potentially relevant visual covariates were included (contrast sensitivity; acuity; stereopsis; visual discomfort, stress, triggers; dyslexia).

Results: For each task, migraine participants were less accurate than a control group and had impaired contrast sensitivity, greater visual discomfort, visual stress and visual triggers. Only contrast sensitivity correlated with performance on each motion task; it also mediated performance.

Conclusions: Impaired performance on certain motion tasks can be attributed to impaired contrast sensitivity early in the visual system rather than a deficit in cortical motion processing per se. There were, however, additional differences for global and relative motion thresholds embedded in noise, suggesting changes in extrastriate cortex in migraine. Tasks to study the effects of noise on performance at different levels of the visual system and across modalities are recommended. A battery of standard visual tests should be included in any future work on the visual system and migraine.

Pooling elementary motion signals into perception of global motion direction

Six observers were asked to indicate in which of two opposite directions, to the right or to the left, an entire display appeared to move, based on the proportion of right vs leftward motion elements, each of which was distinctly visible. The performance of each observer was described by Thurstone's discriminative processes and Bernoulli trial models which described empirical psychometric functions equally well. Although formally it was impossible to discriminate between these two models, treating observer as a counting device which measures a randomly selected subsample of all available motion elements had certain advantages. According to the Bernoulli trial model decisions about the global motion direction in a range of 12-800 elements were based on taking into account about 4±2 random moving dot elements. This small number is not due to cancellation of the opposite motion vectors since the motion direction recognition performance did not improve after the compared motion directions were made orthogonal. This may indicate that the motion pooling mechanism studied in our experiment is strongly limited in capacity.

Cortical network dynamics of perceptual decision-making in the human brain

Goal-directed behavior requires the flexible transformation of sensory evidence about our environment into motor actions. Studies of perceptual decision-making have shown that this transformation is distributed across several widely separated brain regions. Yet, little is known about how decision-making emerges from the dynamic interactions among these regions. Here, we review a series of studies, in which we characterized the cortical network interactions underlying a perceptual decision process in the human brain. We used magnetoencephalography to measure the large-scale cortical population dynamics underlying each of the sub-processes involved in this decision: the encoding of sensory evidence and action plan, the mapping between the two, and the attentional selection of task-relevant evidence. We found that these sub-processes are mediated by neuronal oscillations within specific frequency ranges. Localized gamma-band oscillations in sensory and motor cortices reflect the encoding of the sensory evidence and motor plan. Large-scale oscillations across widespread cortical networks mediate the integrative processes connecting these local networks: Gamma- and beta-band oscillations across frontal, parietal, and sensory cortices serve the selection of relevant sensory evidence and its flexible mapping onto action plans. In sum, our results suggest that perceptual decisions are mediated by oscillatory interactions within overlapping local and large-scale cortical networks.

Does the noise matter? Effects of different kinematogram types on smooth pursuit eye movements and perception

We investigated how the human visual system and the pursuit system react to visual motion noise. We presented three different types of random-dot kinematograms at five different coherence levels. For transparent motion, the signal and noise labels on each dot were preserved throughout each trial, and noise dots moved with the same speed as the signal dots but in fixed random directions. For white noise motion, every 20 ms the signal and noise labels were randomly assigned to each dot and noise dots appeared at random positions. For Brownian motion, signal and noise labels were also randomly assigned, but the noise dots moved at the signal speed in a direction that varied randomly from moment to moment. Neither pursuit latency nor early eye acceleration differed among the different types of kinematograms. Late acceleration, pursuit gain, and perceived speed all depended on kinematogram type, with good agreement between pursuit gain and perceived speed. For transparent motion, pursuit gain and perceived speed were independent of coherence level. For white and Brownian motions, pursuit gain and perceived speed increased with coherence but were higher for white than for Brownian motion. This suggests that under our conditions, the pursuit system integrates across all directions of motion but not across all speeds.