The motion aftereffect reloaded

Adaptation in the visual system: Networked fatigue or suppressed prediction error signalling?

Our brains are constantly adapting to changes in our visual environments. Neural adaptation exerts a persistent influence on the activity of sensory neurons and our perceptual experience, however there is a lack of consensus regarding how adaptation is implemented in the visual system. One account describes fatigue-based mechanisms embedded within local networks of stimulus-selective neurons (networked fatigue models). Another depicts adaptation as a product of stimulus expectations (predictive coding models). In this review, I evaluate neuroimaging and psychophysical evidence that poses fundamental problems for predictive coding models of neural adaptation. Specifically, I discuss observations of distinct repetition and expectation effects, as well as incorrect predictions of repulsive adaptation aftereffects made by predictive coding accounts. Based on this evidence, I argue that networked fatigue models provide a more parsimonious account of adaptation effects in the visual system. Although stimulus expectations can be formed based on recent stimulation history, any consequences of these expectations are likely to co-occur (or interact) with effects of fatigue-based adaptation. I conclude by proposing novel, testable hypotheses relating to interactions between fatigue-based adaptation and other predictive processes, focusing on stimulus feature extrapolation phenomena.

Inattentional aftereffects: The role of attention on the strength of the motion aftereffect

The way that attention affects the processing of visual information is one of the most intriguing fields in the study of visual perception. One way to examine this interaction is by studying the way perceptual aftereffects are modulated by attention. In the present study, we have manipulated attention during adaptation to translational motion generated by coherently moving random dots, in order to investigate the effect of the distraction of attention on the strength of the peripheral dynamic motion aftereffect (MAE). A foveal rapid serial visual presentation task (RSVP) of varying difficulty was introduced during the adaptation period while the adaptation and test stimuli were presented peripherally. Furthermore, to examine the interaction between the physical characteristics of the stimulus and attention, we have manipulated the motion coherence level of the adaptation stimuli. Our results suggested that the removal of attention through an irrelevant task modulated the MAE's magnitude moderately and that such an effect depends on the stimulus strength. We also showed that the MAE still persists with subthreshold and unattended stimuli, suggesting that perhaps attention is not required for the complete development of the MAE.

Autokinesis Reveals a Threshold for Perception of Visual Motion

In natural viewing conditions, the brain can optimally integrate retinal and extraretinal signals to maintain a stable visual perception. These mechanisms, however, may fail in circumstances where extraction of a motion signal is less viable such as impoverished visual scenes. This can result in a phenomenon known as autokinesis in which one may experience apparent motion of a small visual stimulus in an otherwise completely dark environment. In this study, we examined the effect of autokinesis on visual perception of motion in human observers. We used a novel method with optical tracking in which the visual motion was reported manually by the observer. Experiment results show at lower speeds of motion, the perceived direction of motion was more aligned with the effect of autokinesis, whereas in the light or at higher speeds in the dark, it was more aligned with the actual direction of motion. These findings have important implications for understanding how the stability of visual representation in the brain can affect accurate perception of motion signals.

Audiovisual interactions outside of visual awareness during motion adaptation

Motion aftereffects (MAEs), illusory motion experienced in a direction opposed to real motion experienced during prior adaptation, have been used to assess audiovisual interactions. In a previous study from our laboratory, we demonstrated that a congruent direction of auditory motion presented concurrently with visual motion during adaptation strengthened the consequent visual MAE, compared to when auditory motion was incongruent in direction. Those judgments of MAE strength, however, could have been influenced by expectations or response bias from mere knowledge of the state of audiovisual congruity during adaptation. To prevent such knowledge, we now employed continuous flash suppression to render visual motion perceptually invisible during adaptation, ensuring that observers were completely unaware of visual adapting motion and only aware of the motion direction of the sound they were hearing. We found a small but statistically significant congruence effect of sound on adaptation strength produced by invisible adaptation motion. After considering alternative explanations for this finding, we conclude that auditory motion can impact the strength of visual processing produced by translational visual motion even when that motion transpires outside of awareness.

Temporal dynamics of normalization reweighting

For decades, neural suppression in early visual cortex has been thought to be fixed. But recent work has challenged this assumption by showing that suppression can be reweighted based on recent history; when pairs of stimuli are repeatedly presented together, suppression between them strengthens. Here we investigate the temporal dynamics of this process using a steady-state visual evoked potential (SSVEP) paradigm that provides a time-resolved, direct index of suppression between pairs of stimuli flickering at different frequencies (5 and 7 Hz). Our initial analysis of an existing electroencephalography (EEG) dataset (N = 100) indicated that suppression increases substantially during the first 2-5 seconds of stimulus presentation (with some variation across stimulation frequency). We then collected new EEG data (N = 100) replicating this finding for both monocular and dichoptic mask arrangements in a preregistered study designed to measure reweighting. A third experiment (N = 20) used source-localized magnetoencephalography and found that these effects are apparent in primary visual cortex (V1), consistent with results from neurophysiological work. Because long-standing theories propose inhibition/excitation differences in autism, we also compared reweighting between individuals with high versus low autistic traits, and with and without an autism diagnosis, across our three datasets (total N = 220). We find no compelling differences in reweighting that are associated with autism. Our results support the normalization reweighting model and indicate that for prolonged stimulation, increases in suppression occur on the order of 2-5 seconds after stimulus onset.

Dissociating representations of affect and motion in visual cortices

While a delicious dessert being presented to us may elicit strong feelings of happiness and excitement, the same treat falling slowly away can lead to sadness and disappointment. Our emotional response to the item depends on its visual motion direction. Despite this importance, it remains unclear whether (and how) cortical areas devoted to decoding motion direction represents or integrates emotion with perceived motion direction. Motion-selective visual area V5/MT+ sits, both functionally and anatomically, at the nexus of dorsal and ventral visual streams. These pathways, however, differ in how they are modulated by emotional cues. The current study was designed to disentangle how emotion and motion perception interact, as well as use emotion-dependent modulation of visual cortices to understand the relation of V5/MT+ to canonical processing streams. During functional magnetic resonance imaging (fMRI), approaching, receding, or static motion after-effects (MAEs) were induced on stationary positive, negative, and neutral stimuli. An independent localizer scan was conducted to identify the visual-motion area V5/MT+. Through univariate and multivariate analyses, we demonstrated that emotion representations in V5/MT+ share a more similar response profile to that observed in ventral visual than dorsal, visual structures. Specifically, V5/MT+ and ventral structures were sensitive to the emotional content of visual stimuli, whereas dorsal visual structures were not. Overall, this work highlights the critical role of V5/MT+ in the representation and processing of visually acquired emotional content. It further suggests a role for this region in utilizing affectively salient visual information to augment motion perception of biologically relevant stimuli.

Conserved neural dynamics and computations across species in olfaction

Interpreting chemical information and translating it into ethologically relevant output is a common challenge of olfactory systems across species. Are computations performed by olfactory circuits conserved across species to overcome these common challenges? To understand this, we compared odor responses in the locust antennal lobe (AL) and mouse olfactory bulb (OB). We found that odors activated nearly mutually exclusive neural ensembles during stimulus presentation ('ON response') and after stimulus termination ('OFF response'). Strikingly, ON and OFF responses evoked by a single odor were anticorrelated with each other. 'Inverted' OFF responses enhanced contrast between odors experienced close together in time. Notably, OFF responses persisted long after odor termination in both AL and OB networks, indicating a form of short-term memory. Taken together, our results reveal key neurodynamic features underlying olfactory computations that are conserved across insect and mammalian olfactory systems.

Object Image Size Is a Fundamental Coding Dimension in Human Vision: New Insights and Model

In previous psychophysical work we found that luminance contrast is integrated over retinal area subject to contrast gain control. If different mechanisms perform this operation for a range of superimposed retinal regions of different sizes, this could provide the basis for size-coding. To test this idea we included two novel features in a standard adaptation paradigm to discount more pedestrian accounts of repulsive size-aftereffects. First, we used spatially jittering luminance-contrast adaptors to avoid simple contour displacement aftereffects. Second, we decoupled adaptor and target spatial frequency to avoid the well-known spatial frequency shift aftereffect. Empirical results indicated strong evidence of a bidirectional size adaptation aftereffect. We show that the textbook population model is inappropriate for our results, and develop our existing model of contrast perception to include multiple size mechanisms with divisive surround-suppression from the largest mechanism. For a given stimulus patch, this delivers a blurred step-function of responses across the population, with contrast and size encoded by the height and lateral position of the step. Unlike for textbook population coding schemes, our human results (N = 4 male, N = 4 female) displayed two asymmetries: (i) size aftereffects were greatest for targets smaller than the adaptor, and (ii) on that side of the function, results did not return to baseline, even when targets were 25% of adaptor diameter. Our results and emergent model properties provide evidence for a novel dimension of visual coding (size) and a novel strategy for that coding, consistent with previous results on contrast detection and discrimination for various stimulus sizes.

Selective Enhancement of Post-Sleep Visual Motion Perception by Repetitive Tactile Stimulation during Sleep

Tactile sensations can bias visual perception in the awake state while visual sensitivity is known to be facilitated by sleep. It remains unknown, however, whether the tactile sensation during sleep can bias the visual improvement after sleep. Here, we performed nap experiments in human participants (n = 56, 18 males, 38 females) to demonstrate that repetitive tactile motion stimulation on the fingertip during slow wave sleep selectively enhanced subsequent visual motion detection. The visual improvement was associated with slow wave activity. The high activation at the high beta frequency was found in the occipital electrodes after the tactile motion stimulation during sleep, indicating a visual-tactile cross-modal interaction during sleep. Furthermore, a second experiment (n = 14, 14 females) to examine whether a hand- or head-centered coordination is dominant for the interpretation of tactile motion direction showed that the biasing effect on visual improvement occurs according to the hand-centered coordination. These results suggest that tactile information can be interpreted during sleep, and can induce the selective improvement of post-sleep visual motion detection.SIGNIFICANCE STATEMENT Tactile sensations can bias our visual perception as a form of cross-modal interaction. However, it was reported only in the awake state. Here we show that repetitive directional tactile motion stimulation on the fingertip during slow wave sleep selectively enhanced subsequent visual motion perception. Moreover, the visual improvement was positively associated with sleep slow wave activity. The tactile motion stimulation during slow wave activity increased the activation at the high beta frequency over the occipital electrodes. The visual improvement occurred in agreement with a hand-centered reference frame. These results suggest that our sleeping brain can interpret tactile information based on a hand-centered reference frame, which can cause the sleep-dependent improvement of visual motion detection.

Perceptual Biases as the Side Effect of a Multisensory Adaptive System: Insights from Verticality and Self-Motion Perception

Perceptual biases can be interpreted as adverse consequences of optimal processes which otherwise improve system performance. The review presented here focuses on the investigation of inaccuracies in multisensory perception by focusing on the perception of verticality and self-motion, where the vestibular sensory modality has a prominent role. Perception of verticality indicates how the system processes gravity. Thus, it represents an indirect measurement of vestibular perception. Head tilts can lead to biases in perceived verticality, interpreted as the influence of a vestibular prior set at the most common orientation relative to gravity (i.e., upright), useful for improving precision when upright (e.g., fall avoidance). Studies on the perception of verticality across development and in the presence of blindness show that prior acquisition is mediated by visual experience, thus unveiling the fundamental role of visuo-vestibular interconnections across development. Such multisensory interactions can be behaviorally tested with cross-modal aftereffect paradigms which test whether adaptation in one sensory modality induces biases in another, eventually revealing an interconnection between the tested sensory modalities. Such phenomena indicate the presence of multisensory neural mechanisms that constantly function to calibrate self-motion dedicated sensory modalities with each other as well as with the environment. Thus, biases in vestibular perception reveal how the brain optimally adapts to environmental requests, such as spatial navigation and steady changes in the surroundings.

Naturalistic stimuli in touch research

Neural mechanisms of touch are typically studied in laboratory settings using robotic or other types of well-controlled devices. Such stimuli are very different from highly complex naturalistic human-to-human touch interactions. The lack of scientifically useful naturalistic stimuli hampers progress, particularly in social touch research. Vision science, on the other hand, has benefitted from inventions such as virtual reality systems that have provided researchers with precision control of naturalistic stimuli. In the field of touch research, producing and manipulating stimuli is particularly challenging due to the complexity of skin mechanics. Here, we review the history of touch neuroscience focusing on the contrast between strictly controlled and naturalistic stimuli, and compare the field to vision science. We discuss new methods that may overcome obstacles with precision-controlled tactile stimuli, and recent successes in naturalistic texture production. In social touch research, precise tracking and measurement of naturalistic human-to-human touch interactions offer exciting new possibilities.

Common and independent processing of visual motion perception and oculomotor response

Visual motion signals are used not only to drive motion perception but also to elicit oculomotor responses. A fundamental question is whether perceptual and oculomotor processing of motion signals shares a common mechanism. This study aimed to address this question using visual motion priming, in which the perceived direction of a directionally ambiguous stimulus is biased in the same (positive priming) or opposite (negative priming) direction as that of a priming stimulus. The priming effect depends on the duration of the priming stimulus. It is assumed that positive and negative priming are mediated by high- and low-level motion systems, respectively. Participants were asked to judge the perceived direction of a π-phase-shifted test grating after a smoothly drifting priming grating during varied durations. Their eye movements were measured while the test grating was presented. The perception and eye movements were discrepant under positive priming and correlated under negative priming on a trial-by-trial basis when an interstimulus interval was inserted between the priming and test stimuli, indicating that the eye movements were evoked by the test stimulus per se. These findings suggest that perceptual and oculomotor responses are induced by a common mechanism at a low level of motion processing but by independent mechanisms at a high level of motion processing.

Short-latency ocular following responses to motion stimuli are strongly affected by temporal modulations of the visual content during the initial fixation period

Neuronal and psychophysical responses to a visual stimulus are known to depend on the preceding history of visual stimulation, but the effect of stimulation history on reflexive eye movements has received less attention. Here, we quantify these effects using short-latency ocular following responses (OFRs), a valuable tool for studying early motion processing. We recorded, in human subjects, the horizontal OFRs induced by drifting vertical 1D pink noise. The stimulus was preceded by 600 to 1000 ms of maintained fixation (on a visible cross), and we explored the effect of different stimuli (“fixation patterns”) presented during the fixation period. We found that any temporal modulation present during the fixation period reduced the magnitude of the subsequent OFRs. Even changes in the overall luminance during the fixation period induced significant suppression. The magnitude of the effect was a function of both spatial and temporal structure of the fixation pattern. Suppression that was selective for both relative orientation and relative spatial frequency accounted for a considerable fraction of total suppression. Finally, changes in stimulus temporal structure alone (i.e. “flicker” versus “transparent motion”) led to changes in the spatial frequency tuning of suppression. In the time domain, the suppression developed quickly: 100 ms of temporal modulation in the fixation pattern produced up to 80% of maximal suppression. Recovery from suppression was instead more gradual, taking up to several seconds. By presenting transparent motion during the fixation period, with opposite motion signals having different spatial frequency content, we also discovered a direction-selective component of suppression, which depended on both the frequency and the direction of the moving stimulus.

Expectations about motion direction affect perception and anticipatory smooth pursuit differently

Smooth pursuit eye movements and visual motion perception rely on the integration of current sensory signals with past experience. Experience shapes our expectation of current visual events and can drive eye movement responses made in anticipation of a target, such as anticipatory pursuit. Previous research revealed consistent effects of expectation on anticipatory pursuit-eye movements follow the expected target direction or speed-and contrasting effects on motion perception, but most studies considered either eye movement or perceptual responses. The current study directly compared effects of direction expectation on perception and anticipatory pursuit within the same direction discrimination task to investigate whether both types of responses are affected similarly or differently. Observers (n = 10) viewed high-coherence random-dot kinematograms (RDKs) moving rightward and leftward with a probability of 50%, 70%, or 90% in a given block of trials to build up an expectation of motion direction. They were asked to judge motion direction of interleaved low-coherence RDKs (0%-15%). Perceptual judgements were compared with changes in anticipatory pursuit eye movements as a function of probability. Results show that anticipatory pursuit velocity scaled with probability and followed direction expectation (attraction bias), whereas perceptual judgments were biased opposite to direction expectation (repulsion bias). Control experiments suggest that the repulsion bias in perception was not caused by retinal slip induced by anticipatory pursuit, or by motion adaptation. We conclude that direction expectation can be processed differently for perception and anticipatory pursuit.NEW & NOTEWORTHY We show that expectations about motion direction that are based on long-term trial history affect perception and anticipatory pursuit differently. Whereas anticipatory pursuit direction was coherent with the expected motion direction (attraction bias), perception was biased opposite to the expected direction (repulsion bias). These opposite biases potentially reveal different ways in which perception and action utilize prior information and support the idea of different information processing for perception and pursuit.

Tactile interactions in the path of tactile apparent motion

Perceptual completion is a fundamental perceptual function serving to maintain robust perception against noise. For example, we can perceive a vivid experience of motion even for the discrete inputs across time and space (apparent motion: AM). In vision, stimuli irrelevant to AM perception are suppressed to maintain smooth AM perception along the AM trajectory where no physical inputs are applied. We investigated whether such perceptual masking induced by perceptual completion of dynamic inputs is general across sensory modalities by focusing on touch. Participants tried to detect a vibro-tactile target stimulus presented along the trajectory of AM induced by two other tactile stimuli on the forearm. In a control condition, the inducing stimuli were applied simultaneously, resulting in no motion percept. Tactile target detection was impaired with tactile AM. Our findings support the notion that the perceptual masking induced by perceptual completion mechanism of AM is a general function rather than a sensory specific effect.

Plastic changes in primate motor cortex following paired peripheral nerve stimulation

Repeated paired stimulation of two peripheral nerves can produce lasting changes in motor cortical excitability, but little is known of the underlying neuronal basis. Here, we trained two macaque monkeys to perform selective thumb and index finger abduction movements. Neural activity was recorded from the contralateral primary motor cortex during task performance, and following stimulation of the ulnar and median nerves, and the nerve supplying the extensor digitorum communis (EDC) muscle. Responses were compared before and after 1 h of synchronous or asynchronous paired ulnar/median nerve stimulation. Task performance was significantly enhanced after asynchronous and impaired after synchronous stimulation. The amplitude of short latency neural responses to median and ulnar nerve stimulation was increased after asynchronous stimulation; later components were reduced after synchronous stimulation. Synchronous stimulation increased neural activity during thumb movement and decreased it during index finger movement; asynchronous stimulation decreased activity during both movements. To assess how well neural activity could separate behavioral or sensory conditions, linear discriminant analysis was used to decode which nerve was stimulated, or which digit moved. Decoding accuracy for nerve stimulation was decreased after synchronous and increased after asynchronous paired stimulation. Decoding accuracy for task performance was decreased after synchronous but was unchanged after asynchronous paired stimulation. Paired stimulation produces changes in motor cortical circuits that outlast the stimulation. Some of these changes depend on precise stimulus timing.

NEW & NOTEWORTHY Paired stimulation of peripheral nerves for 1 h induced lasting changes in neural responses within the motor cortex to nerve stimulation and to performance of a behavioral task. These changes were sufficient to alter the efficiency with which activity could encode stimulus type. Stimuli that can be easily applied noninvasively in human subjects can alter central motor circuits.

Processing moving visual scenes during upright stance in elderly patients with mild cognitive impairment

Background

The ability to maintain balance in an upright stance gradually worsens with age and is even more difficult for patients with cognitive disorders. Cognitive impairment plays a probable role in the worsening of stability. The purpose of this study was to expose subjects with mild cognitive impairment (MCI) and healthy, age-matched controls to moving visual scenes in order to examine their postural adaptation abilities.

Methods

We observed postural responses to moving visual stimulation while subjects stood on a force platform. The visual disturbance was created by interposing a moving picture in four directions (forward, backward, right, and left). The pre-stimulus (a static scene for 10 s), stimulus (a dynamic visual scene for 20 seconds) and post-stimulus (a static scene for 20 seconds) periods were evaluated. We separately analyzed the total path (TP) of the center of pressure (COP) and the root mean square (RMS) of the COP displacement in all four directions.

Results

We found differences in the TP of the COP during the post-stimulus period for all stimulus directions except in motion towards the subject (left p = 0.006, right p = 0.004, and away from the subject p = 0.009). Significant RMS differences between groups were also observed during the post-stimulus period in all directions except when directed towards the subject (left p = 0.002, right p = 0.007, and away from the subject p = 0.014).

Conclusion

Exposing subjects to a moving visual scene induced greater destabilization in MCI subjects compared to healthy elderly controls. Surprisingly, the moving visual scene also induced significant aftereffects in the MCI group. Our findings indicate that the MCI group had diminished adaptation to the dynamic visual scene and recovery. These results suggest that even mild cognitive deficits can impair sensory information integration and alter the sensory re-weighing process.

Size aftereffect is non-local

It is well known that prolonged exposure to a certain size stimulus alters the perceived size of a subsequently presented stimulus at the same location. How the rest of the visual space is affected by this size adaptation, however, has not been systematically studied before. Here, to fill this gap in literature, we tested size adaptation at the adapter location as well as the rest of the visual space. We used peripherally presented solid discs (Experiment 1) and rings (Experiment 2) as adapter and target (test) stimuli. Observers adapted to a mid-sized stimulus and judged the size of the subsequently presented smaller or larger target stimuli. Results showed that the perceived sizes of target stimuli were repelled away from the adapter size, not only at the adapter location but also at other locations. These findings demonstrate that size adaptation causes widespread distortion of the visual space and alters perceived size. We discuss possible computational models that may underpin the perceptual effect.

Invisible Adaptation: The Effect of Awareness on the Strength of the Motion Aftereffect

The ability to process information despite the lack of perceptual awareness is one of the most fascinating aspects of the visual system. Such unconscious processing is often investigated using adaptation, where any presence of the former can be traced by its footprint on aftereffects following the latter. We have investigated the mechanisms of the motion aftereffect (MAE) using random dot displays of varying motion coherence as well as crowding to modulate both the physical as well as the perceptual strength of the adaptation stimulus. Perceptual strength was quantitatively measured as the performance in a forced-choice direction-discrimination task. A motion-nulling technique was used to quantitatively measure the strength of the MAE. We show that the strength of the dynamic MAE is independently influenced by both the physical stimulus strength as well as the subjective perceptual strength, with the effect of the former being more prominent than that of the latter. We further show that the MAE still persists under conditions of subthreshold perception. Our results suggest that perceptual awareness can influence the strength of visual processing, but the latter is not fully dependent on the former and can still take place at its partial or even total absence.

Short- and long-term forms of neural adaptation: An ERP investigation of dynamic motion aftereffects

Adaptation is essential to interact with a dynamic and changing environment, and can be observed on different timescales. Previous studies on a motion paradigm called dynamic motion aftereffect (dMAE) showed that neural adaptation can establish even in very short timescales. However, the neural mechanisms underlying such rapid form of neural plasticity is still debated. In the present study, short- and long-term forms of neural plasticity were investigated using dynamic motion aftereffect combined with EEG (Electroencephalogram). Participants were adapted to directional drifting gratings for either short (640 msec) or long (6.4 sec) durations. Both adaptation durations led to motion aftereffects on the perceived direction of a dynamic and directionally ambiguous test pattern, but the long adaptation produced stronger dMAE. In line with behavioral results, we found robust changes in the event-related potentials elicited by the dynamic test pattern within 64-112 msec time range. These changes were mainly clustered over occipital and parieto-occipital scalp sites. Within this time range, the aftereffects induced by long adaptation were stronger than those by short adaptation. Moreover, the aftereffects by each adaptation duration were in the opposite direction. Overall, these EEG findings suggest that dMAEs reflect changes in cortical areas mediating low- and mid-level visual motion processing. They further provide evidence that short- and long-term forms of motion adaptation lead to distinct changes in neural activity, and hence support the view that adaptation is an active time-dependent process which involves different neural mechanisms.

Neural, functional, and aesthetic impacts of spatially heterogeneous flicker: A potential role of natural flicker

Spatially heterogeneous flicker, characterized by probabilistic and locally independent luminance modulations, abounds in nature. It is generated by flames, water surfaces, rustling leaves, and so on, and it is pleasant to the senses. It affords spatiotemporal multistability that allows sensory activation conforming to the biases of the visual system, thereby generating the perception of spontaneous motion and likely facilitating the calibration of motion detectors. One may thus hypothesize that spatially heterogeneous flicker might potentially provide restoring stimuli to the visual system that engage fluent (requiring minimal top-down control) and self-calibrating processes. Here, we present some converging behavioral and electrophysiological evidence consistent with this idea. Spatially heterogeneous (multistable) flicker (relative to controls matched in temporal statistics) reduced posterior EEG (electroencephalography) beta power implicated in long-range neural interactions that impose top-down influences on sensory processing. Further, the degree of spatiotemporal multistability, the amount of posterior beta-power reduction, and the aesthetic responses to flicker were closely associated. These results are consistent with the idea that the pleasantness of natural flicker may derive from its spatiotemporal multistability that affords fluent and self-calibrating visual processing.

Dichoptic vision in the absence of attention: neither fusion nor rivalry

When the two eyes' processing streams meet in visual cortex, two things can happen: sufficiently similar monocular inputs are combined into a fused representation, whereas markedly different inputs engage in rivalry. Interestingly, the emergence of rivalry appears to require attention. Withdrawing attention causes the alternating monocular dominance that characterizes rivalry to cease, apparently allowing both monocular signals to be processed simultaneously. What happens to these signals in this case, however, remains something of a mystery; are they fused into an integrated representation? In a set of experiments, we show this not to be the case: visual aftereffects are consistent with the simultaneous yet separate presence of two segregated monocular representations, rather than a joint representation. These results provide evidence that dichoptic vision without attention prompts a third and previously unknown mode, where both eyes' inputs receive equal processing, but escape interocular fusion.

A review of visual aftereffects in schizophrenia

Psychosis-a cardinal symptom of schizophrenia-has been associated with a failure to appropriately create or use stored regularities about past states of the world to guide the interpretation of incoming information, which leads to abnormal perceptions and beliefs. The visual system provides a test bed for investigating the role of prior experience and prediction, as accumulated knowledge of the world informs our current perception. More specifically, the strength of visual aftereffects, illusory percepts that arise after prolonged viewing of a visual stimulus, can serve as a valuable measure of the influence of prior experience on current visual processing. In this paper, we review findings from a largely older body of work on visual aftereffects in schizophrenia, attempt to reconcile discrepant findings, highlight the role of antipsychotic medication, consider mechanistic interpretations for behavioral effects, and propose directions for future research.

Laws of concatenated perception: Vision goes for novelty, decisions for perseverance

Every instant of perception depends on a cascade of brain processes calibrated to the history of sensory and decisional events. In the present work, we show that human visual perception is constantly shaped by two contrasting forces exerted by sensory adaptation and past decisions. In a series of experiments, we used multilevel modeling and cross-validation approaches to investigate the impact of previous stimuli and decisions on behavioral reports during adjustment and forced-choice tasks. Our results revealed that each perceptual report is permeated by opposite biases from a hierarchy of serially dependent processes: Low-level adaptation repels perception away from previous stimuli, whereas decisional traces attract perceptual reports toward the recent past. In this hierarchy of serial dependence, "continuity fields" arise from the inertia of decisional templates and not from low-level sensory processes. This finding is consistent with a Two-process model of serial dependence in which the persistence of readout weights in a decision unit compensates for sensory adaptation, leading to attractive biases in sequential perception. We propose a unified account of serial dependence in which functionally distinct mechanisms, operating at different stages, promote the differentiation and integration of visual information over time.

The Role of Bottom-Up and Top-Down Cortical Interactions in Adaptation to Natural Scene Statistics

Adaptation is a mechanism by which cortical neurons adjust their responses according to recently viewed stimuli. Visual information is processed in a circuit formed by feedforward (FF) and feedback (FB) synaptic connections of neurons in different cortical layers. Here, the functional role of FF-FB streams and their synaptic dynamics in adaptation to natural stimuli is assessed in psychophysics and neural model. We propose a cortical model which predicts psychophysically observed motion adaptation aftereffects (MAE) after exposure to geometrically distorted natural image sequences. The model comprises direction selective neurons in V1 and MT connected by recurrent FF and FB dynamic synapses. Psychophysically plausible model MAEs were obtained from synaptic changes within neurons tuned to salient direction signals of the broadband natural input. It is conceived that, motion disambiguation by FF-FB interactions is critical to encode this salient information. Moreover, only FF-FB dynamic synapses operating at distinct rates predicted psychophysical MAEs at different adaptation time-scales which could not be accounted for by single rate dynamic synapses in either of the streams. Recurrent FF-FB pathways thereby play a role during adaptation in a natural environment, specifically in inducing multilevel cortical plasticity to salient information and in mediating adaptation at different time-scales.

Experimental manipulation of visual attention affects body size adaptation but not body dissatisfaction

OBJECTIVE

Prolonged exposure to large/small bodies causes aftereffects in perceived body size. Outside the laboratory, individuals repeatedly exposed to small (large) bodies tend to over- (under-) estimate their size and exhibit increased (decreased) body dissatisfaction. Why, among individuals exposed to approximately equivalent distributions of body sizes, only some develop body size and shape misperception and/or body dissatisfaction is not yet fully understood.

METHOD

We exposed 61 women to high and low adiposity bodies simultaneously, instructing half to attend to high, and half to low adiposity bodies.

RESULTS

Participants in the high adiposity attention condition's perception of "normal" body size significantly increased in adiposity, and vice versa.

DISCUSSION

This suggests that visual attention moderates body size aftereffects. Interventions encouraging visual attention to more realistic ranges of bodies may therefore reduce body misperception. No change in body dissatisfaction was found, suggesting that changes in the perceptual component (misperception) may not necessarily affect the attitudinal component (dissatisfaction) of body image distortion.

The contribution of local and global motion adaptation in the repulsive direction aftereffect

After adapting to a certain motion direction, our perception of a similar direction will be repelled away from the adapting direction, a phenomenon known as the direction aftereffect (DAE). As the motion system consists of local and global processing stages, it remains unclear how the adaptation of the two stages contributes in producing the DAE. The present study addresses this question by independently inducing adaptation at local and global motion-processing levels. Local adaptation was manipulated by presenting test stimuli at either adapted or nonadapted locations. Global adaptation was manipulated by embedding one or five global motion directions in the adapting motion. Repulsive DAE, when measured using a multiple-element test pattern, was stronger when it was produced by global adaptation than when produced by local adaptation. Specifically, the DAE resulting from local adaptation (a) decreased when test orientations differed from adapting orientation, (b) decreased when local directions were disambiguated using plaid stimuli, (c) remained the same even when attention was focused at specific test locations during adaptation, and (d) increased when tested with a single element. Overall, these findings suggest that the strength of repulsive DAE depends on both the motion-processing level at which adaptation occurs and the level at which the DAE was tested. Furthermore, the repulsive DAE arising from local adaptation alone can be explained by the propagation of local speed repulsion instead of local direction repulsion. Findings are discussed in the context of how motion aftereffects arise from the adaptation of a hierarchical motion system.

Motion adaptation and attention: A critical review and meta-analysis

The motion aftereffect (MAE) provides a behavioural probe into the mechanisms underlying motion perception, and has been used to study the effects of attention on motion processing. Visual attention can enhance detection and discrimination of selected visual signals. However, the relationship between attention and motion processing remains contentious: not all studies find that attention increases MAEs. Our meta-analysis reveals several factors that explain superficially discrepant findings. Across studies (37 independent samples, 76 effects) motion adaptation was significantly and substantially enhanced by attention (Cohen's d = 1.12, p < .0001). The effect more than doubled when adapting to translating (vs. expanding or rotating) motion. Other factors affecting the attention-MAE relationship included stimulus size, eccentricity and speed. By considering these behavioural analyses alongside neurophysiological work, we conclude that feature-based (rather than spatial, or object-based) attention is the biggest driver of sensory adaptation. Comparisons between naïve and non-naïve observers, different response paradigms, and assessment of 'file-drawer effects' indicate that neither response bias nor publication bias are likely to have significantly inflated the estimated effect of attention.

Functional correlate and delineated connectivity pattern of human motion aftereffect responses substantiate a subjacent visual-vestibular interaction

The visual motion aftereffect (MAE) is the most prominent aftereffect in the visual system. Regarding its function, psychophysical studies suggest its function to be a form of sensory error correction, possibly also triggered by incongruent visual-vestibular stimulation. Several observational imaging experiments have deducted an essential role for region MT+ in the perception of a visual MAE but not provided conclusive evidence. Potential confounders with the MAE such as ocular motor performance, attention, and vection sensations have also never been controlled for. Aim of this neuroimaging study was to delineate the neural correlates of MAE and its subjacent functional connectivity pattern. A rotational MAE (n = 22) was induced using differing visual stimuli whilst modulating ocular motor parameters in a 3T scanner. Data was analyzed with SPM12. Eye movements as a response to the same stimuli were studied by means of high-resolution videooculography. Analysis for all stimuli gave bilateral activations along the dorsal visual stream with an emphasis on area MT. The onset of a visual MAE revealed an additional response in the right medial superior temporal area (MST) and a concurrent deactivation of vestibular hub region OP2. There was no correlation for the BOLD effects during the MAE with either ocular motor or attention parameters. The functional correlate of a visual MAE in humans may be represented in the interaction between region MT and area MST. This MAE representation is independent of a potential afternystagmus, attention and the presence of egomotion sensations. Connectivity analyses showed that in the event of conflicting visual-vestibular motion information (here MAE) area MST and area OP2 may act as the relevant mediating network hubs.

Evidence for distinct levels of neural adaptation to both coherent and incoherently moving visual surfaces in visual area hMT

Visual adaptation describes the processes by which the visual system alters its operating properties in response to changes in the environment. It is one of the mechanisms controlling visual perceptual bistability - when two perceptual solutions are available - by controlling the duration of each percept. Moving plaids are an example of such ambiguity. They can be perceived as two surfaces sliding incoherently over each other or as a single coherent surface. Here, we investigated, using fMRI, whether activity in the human motion complex (hMT+), a region tightly related to the perceptual integration of visual motion, is modulated by distinct forms of visual adaptation to coherent or incoherent perception of moving plaids. Our hypothesis is that exposure to global coherent or incoherent moving stimuli leads to different levels of measurable adaptation, reflected in hMT+ activity. We found that the strength of the measured visual adaptation effect depended on whether subjects integrated (coherent percept) or segregated (incoherent percept) surface motion signals. Visual motion adaptation was significant both for coherent motion and globally incoherent surface motion. Although not as strong as to the coherent percept, visual adaptation due to the incoherent percept also affects hMT+. This shows that adaptation can contribute to regulate percept duration during visual bistability, with distinct weights, depending on the type of percept. Our findings suggest a link between bistability and adaptation mechanisms, both due to coherent and incoherent motion percepts, but in an asymmetric manner. These asymmetric adaptation weights have strong implications in models of perceptual decision and may explain asymmetry of perceptual interpretation periods.

Cortical alterations in phobic postural vertigo - a multimodal imaging approach

Objective

Functional dizziness syndromes are among the most common diagnoses made in patients with chronic dizziness, but their underlying neural characteristics are largely unknown. The aim of this neuroimaging study was to analyze the disease‐specific brain changes in patients with phobic postural vertigo (PPV).

Methods

We measured brain morphology, task response, and functional connectivity in 44 patients with PPV and 44 healthy controls.

Results

The analyses revealed a relative structural increase in regions of the prefrontal cortex and the associated thalamic projection zones as well as in the primary motor cortex. Morphological increases in the ventrolateral prefrontal cortex positively correlated with disease duration, whereas increases in dorsolateral, medial, and ventromedial prefrontal areas positively correlated with the Beck depression index. Visual motion stimulation caused an increased task‐dependent activity in the subgenual anterior cingulum and a significantly longer duration of the motion aftereffect in the patients. Task‐based functional connectivity analyses revealed aberrant involvement of interoceptive, fear generalization, and orbitofrontal networks.

Interpretation

Our findings agree with some of the typical characteristics of functional dizziness syndromes, for example, excessive self‐awareness, anxious appraisal, and obsessive controlling of posture. This first evidence indicates that the disease‐specific mechanisms underlying PPV are related to networks involved in mood regulation, fear generalization, interoception, and cognitive control. They do not seem to be the result of aberrant processing in cortical visual, visual motion, or vestibular regions.

Sustained Rhythmic Brain Activity Underlies Visual Motion Perception in Zebrafish

Following moving visual stimuli (conditioning stimuli, CS), many organisms perceive, in the absence of physical stimuli, illusory motion in the opposite direction. This phenomenon is known as the motion aftereffect (MAE). Here, we use MAE as a tool to study the neuronal basis of visual motion perception in zebrafish larvae. Using zebrafish eye movements as an indicator of visual motion perception, we find that larvae perceive MAE. Blocking eye movements using optogenetics during CS presentation did not affect MAE, but tectal ablation significantly weakened it. Using two-photon calcium imaging of behaving GCaMP3 larvae, we find post-stimulation sustained rhythmic activity among direction-selective tectal neurons associated with the perception of MAE. In addition, tectal neurons tuned to the CS direction habituated, but neurons in the retina did not. Finally, a model based on competition between direction-selective neurons reproduced MAE, suggesting a neuronal circuit capable of generating perception of visual motion.

Mentalizing Another's Visual World-A Novel Exploration via Motion Aftereffect

Past research on level 2 visual perspective-taking (VPT) has mostly focused on understanding the mental rotation involved when one adopts others' perspective; the mechanisms underlying how the visual world of others is mentally represented remain unclear. In three studies, we addressed this question by adopting a novel VPT task with motion stimuli and exploring the aftereffect on motion discrimination from the self-perspective. Overall the results showed a facilitation aftereffect when participants were instructed to take the avatar's perspective. Meanwhile, participants' self-reported perspective-taking tendencies correlated with the aftereffect for both instructed and spontaneous VPT tasks, when the “to-be-adopted” perspective required the participants to mentally transform their self-body clockwise. Specifically, while facilitation was induced for participants with low self-reported perspective-taking tendencies (e.g., viewing a leftward motion stimulus under another's perspective enhanced subsequent perception of leftward motion from the self-perspective), those with high self-reported perspective-taking tendencies showed an adaptation aftereffect (e.g., viewing a leftward motion stimulus under another's perspective weakened subsequent perception of leftward motion from the self-perspective). For these individuals, the adaptation effect indicated the engagement of direction-selective neurons in processing of the subsequent congruent-direction motion from self's perspective. These findings suggest that motion perception from different perspectives (self vs. another) may share the same direction-selective neural circuitry, and this possibility depends on observers' general perspective-taking tendencies.

Adaptation to Skew Distortions of Natural Scenes and Retinal Specificity of Its Aftereffects

Image skew is one of the prominent distortions that exist in optical elements, such as in spectacle lenses. The present study evaluates adaptation to image skew in dynamic natural images. Moreover, the cortical levels involved in skew coding were probed using retinal specificity of skew adaptation aftereffects. Left and right skewed natural image sequences were shown to observers as adapting stimuli. The point of subjective equality (PSE), i.e., the skew amplitude in simple geometrical patterns that is perceived to be unskewed, was used to quantify the aftereffect of each adapting skew direction. The PSE, in a two-alternative forced choice paradigm, shifted toward the adapting skew direction. Moreover, significant adaptation aftereffects were obtained not only at adapted, but also at non-adapted retinal locations during fixation. Skew adaptation information was transferred partially to non-adapted retinal locations. Thus, adaptation to skewed natural scenes induces coordinated plasticity in lower and higher cortical areas of the visual pathway.

Perceptual decisions are biased by the cost to act

Perceptual decisions are classically thought to depend mainly on the stimulus characteristics, probability and associated reward. However, in many cases, the motor response is considered to be a neutral output channel that only reflects the upstream decision. Contrary to this view, we show that perceptual decisions can be recursively influenced by the physical resistance applied to the response. When participants reported the direction of the visual motion by left or right manual reaching movement with different resistances, their reports were biased towards the direction associated with less effortful option. Repeated exposure to such resistance on hand during perceptual judgements also biased subsequent judgements using voice, indicating that effector-dependent motor costs not only biases the report at the stage of motor response, but also changed how the sensory inputs are transformed into decisions. This demonstrates that the cost to act can influence our decisions beyond the context of the specific action.

DOI:http://dx.doi.org/10.7554/eLife.18422.001

Imagine you are in an orchard, trying to decide which of the many apples to pick. On what do you base your decision? Most research into this type of decision-making has focused on how the brain uses visual information – about features such as colour, size and shape – to make a choice. But what about the effort required to obtain the apple? Does an apple at the top of the tree look more or less tempting than the low-hanging fruit?

To answer this kind of question, Hagura et al. asked volunteers to decide whether dots on a screen were moving to the left or to the right. The volunteers indicated their choice by moving one of two levers. If they thought the dots were moving to the right, they moved a lever in their right hand. If they thought the dots were moving to the left, they moved a lever in their left hand. What the volunteers did not know, however, is that one of the levers was slightly heavier and therefore harder to move than the other.

Hagura et al. found that the volunteers biased their decisions away from the direction that would require the most effort. If the right-hand lever was heavier, the volunteers decided that dots with ambiguous motion were moving to the left. Those for whom the left-hand lever was heavier felt that the same dots were moving to the right. The participants showed this bias despite failing to notice that the levers had different weights. Moreover, they continued to show the bias even when subsequently asked to simply say their answers rather than use the levers.

These results indicate that the effort required to act on a decision can influence the decision itself. The fact that participants were biased even when responding verbally, and despite being unaware that the levers differed in weight, suggests that they were not deliberately choosing the easier option. Instead, the cost to act changed how they perceived the stimuli themselves. The findings also suggest that it might be possible to help people make better decisions by designing environments in which less favourable options require more effort.

DOI:http://dx.doi.org/10.7554/eLife.18422.002

Electrophysiological correlates of motion extrapolation: An investigation on the CNV

Motion extrapolation (ME), the ability to estimate the current position of moving objects hidden by an occluder, is critical to interact with a dynamic environment. In a typical paradigm, participants estimate time to contact (TTC) by pressing a button when they estimate the occluded moving target reaches a certain cue. Research using this paradigm has shown that motion adaptation of the occluded area produces a shift in the TTC estimate (Gilden et al., 1995). We examined the effect of motion adaptation on the contingent negative variation (CNV), a frontal electrophysiological component (Tecce, 1972) that could reflect the activity of an accumulator (Buhusi and Meck, 2005) for time processing. We predicted that longer TTC estimates due to previous visual motion adaptation would result in a larger CNV because the accumulator can collect more time units. Results showed that motion adaptation actually modulates the CNV, but the CNV amplitude did not correlate with TTC duration, falsifying the accumulator hypothesis. We suggest that motion adaptation interferes with the remembered speed (stored during the visible part of the trajectory) that may be used as input by higher cognitive function to guide the temporal update of target position, regardless of the TTC estimate.

Individual differences in visual motion perception and neurotransmitter concentrations in the human brain

Recent studies have shown that interindividual variability can be a rich source of information regarding the mechanism of human visual perception. In this study, we examined the mechanisms underlying interindividual variability in the perception of visual motion, one of the fundamental components of visual scene analysis, by measuring neurotransmitter concentrations using magnetic resonance spectroscopy. First, by psychophysically examining two types of motion phenomena-motion assimilation and contrast-we found that, following the presentation of the same stimulus, some participants perceived motion assimilation, while others perceived motion contrast. Furthermore, we found that the concentration of the excitatory neurotransmitter glutamate-glutamine (Glx) in the dorsolateral prefrontal cortex (Brodmann area 46) was positively correlated with the participant's tendency to motion assimilation over motion contrast; however, this effect was not observed in the visual areas. The concentration of the inhibitory neurotransmitter γ-aminobutyric acid had only a weak effect compared with that of Glx. We conclude that excitatory process in the suprasensory area is important for an individual's tendency to determine antagonistically perceived visual motion phenomena.This article is part of the themed issue 'Auditory and visual scene analysis'.

Opposite effects of high- and low-frequency transcranial random noise stimulation probed with visual motion adaptation

Transcranial random noise stimulation (tRNS) is a recent neuro-modulation technique whose effects at both behavioural and neural level are still debated. Here we employed the well-known phenomenon of motion after-effect (MAE) in order to investigate the effects of high- vs. low-frequency tRNS on motion adaptation and recovery. Participants were asked to estimate the MAE duration following prolonged adaptation (20 s) to a complex moving pattern, while being stimulated with either sham or tRNS across different blocks. Different groups were administered with either high- or low-frequency tRNS. Stimulation sites were either bilateral human MT complex (hMT⁺) or frontal areas. The results showed that, whereas no effects on MAE duration were induced by stimulating frontal areas, when applied to the bilateral hMT⁺, high-frequency tRNS caused a significant decrease in MAE duration whereas low-frequency tRNS caused a significant corresponding increase in MAE duration. These findings indicate that high- and low-frequency tRNS have opposed effects on the adaptation-dependent unbalance between neurons tuned to opposite motion directions, and thus on neuronal excitability.

Multisensory Integration in Self Motion Perception

Self motion perception involves the integration of visual, vestibular, somatosensory and motor signals. This article reviews the findings from single unit electrophysiology, functional and structural magnetic resonance imaging and psychophysics to present an update on how the human and non-human primate brain integrates multisensory information to estimate one’s position and motion in space. The results indicate that there is a network of regions in the non-human primate and human brain that processes self motion cues from the different sense modalities.

Decision-level adaptation in motion perception

Prolonged exposure to visual stimuli causes a bias in observers' responses to subsequent stimuli. Such adaptation-induced biases are usually explained in terms of changes in the relative activity of sensory neurons in the visual system which respond selectively to the properties of visual stimuli. However, the bias could also be due to a shift in the observer's criterion for selecting one response rather than the alternative; adaptation at the decision level of processing rather than the sensory level. We investigated whether adaptation to implied motion is best attributed to sensory-level or decision-level bias. Three experiments sought to isolate decision factors by changing the nature of the participants' task while keeping the sensory stimulus unchanged. Results showed that adaptation-induced bias in reported stimulus direction only occurred when the participants' task involved a directional judgement, and disappeared when adaptation was measured using a non-directional task (reporting where motion was present in the display, regardless of its direction). We conclude that adaptation to implied motion is due to decision-level bias, and that a propensity towards such biases may be widespread in sensory decision-making.

Visual Adaptation

Sensory systems continuously mold themselves to the widely varying contexts in which they must operate. Studies of these adaptations have played a long and central role in vision science. In part this is because the specific adaptations remain a powerful tool for dissecting vision, by exposing the mechanisms that are adapting. That is, "if it adapts, it's there." Many insights about vision have come from using adaptation in this way, as a method. A second important trend has been the realization that the processes of adaptation are themselves essential to how vision works, and thus are likely to operate at all levels. That is, "if it's there, it adapts." This has focused interest on the mechanisms of adaptation as the target rather than the probe. Together both approaches have led to an emerging insight of adaptation as a fundamental and ubiquitous coding strategy impacting all aspects of how we see.