Illusory motion reversals from unambiguous motion with visual, proprioceptive, and tactile stimuli

Dual muscle tendon vibration does not impede performance of a goal-directed aiming task

AIMS

Application of muscle-tendon vibration within the frequency range of 70-120Hz has been studied as a tool to stimulate somatosensory afferents with both the goal of studying human sensorimotor control and of improving post-stroke motor performance. Specific to applications for rehabilitation, current evidence is mixed as to whether dual muscle-tendon vibration is detrimental to the performance of goal-directed upper-limb movements. The current study aimed to determine the effects of muscle-tendon vibration over the wrist flexors and extensors (dual vibration) on performance of a computer goal-directed aiming task.

METHODS

Twenty healthy participants were assigned to the vibration or control group. An aiming task that involved acquiring targets by moving an unseen cursor on a screen was performed. Vision of the cursor and hand were unavailable throughout the four blocks of movement execution. Only the vibration group received dual vibration throughout four blocks. Task performance was assessed using measures of endpoint accuracy and timing. Perceived hand location was assessed using a set of questions and a computerised conscious perception task.

RESULTS

The vibration group had significantly shorter reaction times, without any change in endpoint accuracy, indicating more efficient and effective movement planning. The vibration group did report illusory movement sensation, which was reduced by block 4.

CONCLUSIONS

Dual vibration did not adversely affect aiming accuracy and showed some improvement in reaction time. The present findings support the potential for using dual vibration to stimulate the somatosensory system as participants improved their performance of a novel goal-directed movement. Notably, improvements were maintained when the vibration was removed.

When a bank becomes a bank, and a bank is the bank but not the bank: Multistability of homonyms' meaning

Perceptual multistability is well-known and mostly visually demonstrated: Common examples are Necker's cube or Rubin's face-vase that produce qualitatively different percepts continuously oscillating between the solutions despite physically stable stimuli. We lack knowledge about similar phenomena in other domains, for instance in linguistics, where we are faced with homonyms that create multistability of cognitive semantics, differently assigned meanings of identical words. Our participants listened to repeated presentations of homonyms for which two or even three meanings could be assigned, and they reported the dominant meaning perceived at a certain point in time. Results showed that most participants experienced multistability of meaning for homonyms, with semiperiodic changes in dominant meaning similar to multistabity in perception. These findings suggest that multistability is a general property of the brain's neural architecture that resolves ambiguity irrespective of the level of representation.

New insights into binocular rivalry from the reconstruction of evolving percepts using model network dynamics

When the two eyes are presented with highly distinct stimuli, the resulting visual percept generally switches every few seconds between the two monocular images in an irregular fashion, giving rise to a phenomenon known as binocular rivalry. While a host of theoretical studies have explored potential mechanisms for binocular rivalry in the context of evoked model dynamics in response to simple stimuli, here we investigate binocular rivalry directly through complex stimulus reconstructions based on the activity of a two-layer neuronal network model with competing downstream pools driven by disparate monocular stimuli composed of image pixels. To estimate the dynamic percept, we derive a linear input-output mapping rooted in the non-linear network dynamics and iteratively apply compressive sensing techniques for signal recovery. Utilizing a dominance metric, we are able to identify when percept alternations occur and use data collected during each dominance period to generate a sequence of percept reconstructions. We show that despite the approximate nature of the input-output mapping and the significant reduction in neurons downstream relative to stimulus pixels, the dominant monocular image is well-encoded in the network dynamics and improvements are garnered when realistic spatial receptive field structure is incorporated into the feedforward connectivity. Our model demonstrates gamma-distributed dominance durations and well obeys Levelt's four laws for how dominance durations change with stimulus strength, agreeing with key recurring experimental observations often used to benchmark rivalry models. In light of evidence that individuals with autism exhibit relatively slow percept switching in binocular rivalry, we corroborate the ubiquitous hypothesis that autism manifests from reduced inhibition in the brain by systematically probing our model alternation rate across choices of inhibition strength. We exhibit sufficient conditions for producing binocular rivalry in the context of natural scene stimuli, opening a clearer window into the dynamic brain computations that vary with the generated percept and a potential path toward further understanding neurological disorders.

Perceptual Awareness and Its Relationship with Consciousness: Hints from Perceptual Multistability

Many interesting theories of consciousness have been proposed, but so far, there is no “unified” theory capable of encompassing all aspects of this phenomenon. We are all aware of what it feels like to be conscious and what happens if there is an absence of consciousness. We are becoming more and more skilled in measuring consciousness states; nevertheless, we still “don’t get it” in its deeper essence. How does all the processed information converge from different brain areas and structures to a common unity, giving us this very private “feeling of being conscious”, despite the constantly changing flow of information between internal and external states? “Multistability” refers to a class of perceptual phenomena where subjective awareness spontaneously and continuously alternates between different percepts, although the objective stimuli do not change, supporting the idea that the brain “interprets” sensorial input in a “constructive” way. In this perspective paper, multistability and perceptual awareness are discussed as a methodological window for understanding the “local” states of consciousness, a privileged position from which it is possible to observe the brain dynamics and mechanisms producing the subjective phenomena of perceptual awareness in the very moment they are happening.

Motion Direction Discrimination with Tactile Random-Dot Kinematograms

Motion detection is a fundamental sensory function for multiple modalities, including touch, but the mechanisms underlying tactile motion detection are not well understood. While previous findings supported the existence of high-level feature tracking, it remains unclear whether there also exist low-level motion sensing that directly detects a local spatio-temporal correlation in the skin-stimulation pattern. To elucidate this mechanism, we presented, on braille displays, tactile random-dot kinematograms, similar to those widely used in visual motion research, which enables us to independently manipulate feature trackability and various parameters of local motion. We found that a human observer is able to detect the direction of difficult-to-track tactile motions presented to the fingers and palms. In addition, the direction-discrimination performance was better when the stimuli were presented along the fingers than when presented across the fingers. These results indicate that low-level motion sensing, in addition to high-level tracking, contribute to tactile motion perception.

Illusory Motion Reversal in Touch

Psychophysical visual experiments have shown illusory motion reversal (IMR), in which the perceived direction of motion is the opposite of its actual direction. The tactile form of this illusion has also been reported. However, it remains unclear which stimulus characteristics affect the magnitude of IMR. We closely examined the effect of stimulus characteristics on IMR by presenting moving sinusoid gratings and random-dot patterns to 10 participants' fingerpads at different spatial periods, speeds, and indentation depths. All participants perceived a motion direction opposite to the veridical direction some of the time. The illusion was more prevalent at spatial periods of 1 and 2 mm and at extreme speeds of 20 and 320 mm/s. We observed stronger IMR for gratings and much weaker IMR for a random-dot pattern, indicating that edge orientation might be a major contributor to this illusion. These results show that the optimal parameters for IMR are consistent with the characteristics of motion-selective neurons in the somatosensory cortex, as most of these neurons are also orientation-selective. We speculate that these neurons could be the neural substrate that accounts for tactile IMR.

Muscle Vibration-Induced Illusions: Review of Contributing Factors, Taxonomy of Illusions and User’s Guide

Limb muscle vibration creates an illusory limb movement in the direction corresponding to lengthening of the vibrated muscle. Neck muscle vibration results in illusory motion of visual and auditory stimuli. Attributed to the activation of muscle spindles, these and related effects are of great interest as a tool in research on proprioception, for rehabilitation of sensorimotor function and for multisensory immersive virtual environments. However, these illusions are not easy to elicit in a consistent manner. We review factors that influence them, propose their classification in a scheme that links this area of research to perception theory, and provide practical suggestions to researchers. Local factors that determine the illusory effect of vibration include properties of the vibration stimulus such as its frequency, amplitude and duration, and properties of the vibrated muscle, such as contraction and fatigue. Contextual (gestalt) factors concern the relationship of the vibrated body part to the rest of the body and the environment. Tactile and visual cues play an important role, and so does movement, imagined or real. The best-known vibration illusions concern one’s own body and can be classified as ‘first-order’ due to a direct link between activity in muscle spindles and the percept. More complex illusions involve other sensory modalities and external objects, and provide important clues regarding the hidden role of proprioception, our ‘silent’ sense. Our taxonomy makes explicit this and other distinctions between different illusory effects. We include User’s Guide with tips for anyone wishing to conduct a vibration study.

The 'laws' of binocular rivalry: 50 years of Levelt's propositions

It has been fifty years since Levelt's monograph On Binocular Rivalry (1965) was published, but its four propositions that describe the relation between stimulus strength and the phenomenology of binocular rivalry remain a benchmark for theorists and experimentalists even today. In this review, we will revisit the original conception of the four propositions and the scientific landscape in which this happened. We will also provide a brief update concerning distributions of dominance durations, another aspect of Levelt's monograph that has maintained a prominent presence in the field. In a critical evaluation of Levelt's propositions against current knowledge of binocular rivalry we will then demonstrate that the original propositions are not completely compatible with what is known today, but that they can, in a straightforward way, be modified to encapsulate the progress that has been made over the past fifty years. The resulting modified, propositions are shown to apply to a broad range of bistable perceptual phenomena, not just binocular rivalry, and they allow important inferences about the underlying neural systems. We argue that these inferences reflect canonical neural properties that play a role in visual perception in general, and we discuss ways in which future research can build on the work reviewed here to attain a better understanding of these properties.

On the cyclic nature of perception in vision versus audition

Does our perceptual awareness consist of a continuous stream, or a discrete sequence of perceptual cycles, possibly associated with the rhythmic structure of brain activity? This has been a long-standing question in neuroscience. We review recent psychophysical and electrophysiological studies indicating that part of our visual awareness proceeds in approximately 7-13 Hz cycles rather than continuously. On the other hand, experimental attempts at applying similar tools to demonstrate the discreteness of auditory awareness have been largely unsuccessful. We argue and demonstrate experimentally that visual and auditory perception are not equally affected by temporal subsampling of their respective input streams: video sequences remain intelligible at sampling rates of two to three frames per second, whereas audio inputs lose their fine temporal structure, and thus all significance, below 20-30 samples per second. This does not mean, however, that our auditory perception must proceed continuously. Instead, we propose that audition could still involve perceptual cycles, but the periodic sampling should happen only after the stage of auditory feature extraction. In addition, although visual perceptual cycles can follow one another at a spontaneous pace largely independent of the visual input, auditory cycles may need to sample the input stream more flexibly, by adapting to the temporal structure of the auditory inputs.

Auditory and tactile signals combine to influence vision during binocular rivalry

Resolution of perceptual ambiguity is one function of cross-modal interactions. Here we investigate whether auditory and tactile stimuli can influence binocular rivalry generated by interocular temporal conflict in human subjects. Using dichoptic visual stimuli modulating at different temporal frequencies, we added modulating sounds or vibrations congruent with one or the other visual temporal frequency. Auditory and tactile stimulation both interacted with binocular rivalry by promoting dominance of the congruent visual stimulus. This effect depended on the cross-modal modulation strength and was absent when modulation depth declined to 33%. However, when auditory and tactile stimuli that were too weak on their own to bias binocular rivalry were combined, their influence over vision was very strong, suggesting the auditory and tactile temporal signals combined to influence vision. Similarly, interleaving discrete pulses of auditory and tactile stimuli also promoted dominance of the visual stimulus congruent with the supramodal frequency. When auditory and tactile stimuli were presented at maximum strength, but in antiphase, they had no influence over vision for low temporal frequencies, a null effect again suggesting audio-tactile combination. We also found that the cross-modal interaction was frequency-sensitive at low temporal frequencies, when information about temporal phase alignment can be perceptually tracked. These results show that auditory and tactile temporal processing is functionally linked, suggesting a common neural substrate for the two sensory modalities and that at low temporal frequencies visual activity can be synchronized by a congruent cross-modal signal in a frequency-selective way, suggesting the existence of a supramodal temporal binding mechanism.

Touch interacts with vision during binocular rivalry with a tight orientation tuning

Multisensory integration is a common feature of the mammalian brain that allows it to deal more efficiently with the ambiguity of sensory input by combining complementary signals from several sensory sources. Growing evidence suggests that multisensory interactions can occur as early as primary sensory cortices. Here we present incompatible visual signals (orthogonal gratings) to each eye to create visual competition between monocular inputs in primary visual cortex where binocular combination would normally take place. The incompatibility prevents binocular fusion and triggers an ambiguous perceptual response in which the two images are perceived one at a time in an irregular alternation. One key function of multisensory integration is to minimize perceptual ambiguity by exploiting cross-sensory congruence. We show that a haptic signal matching one of the visual alternatives helps disambiguate visual perception during binocular rivalry by both prolonging the dominance period of the congruent visual stimulus and by shortening its suppression period. Importantly, this interaction is strictly tuned for orientation, with a mismatch as small as 7.5° between visual and haptic orientations sufficient to annul the interaction. These results indicate important conclusions: first, that vision and touch interact at early levels of visual processing where interocular conflicts are first detected and orientation tunings are narrow, and second, that haptic input can influence visual signals outside of visual awareness, bringing a stimulus made invisible by binocular rivalry suppression back to awareness sooner than would occur without congruent haptic input.

Multistability in perception: binding sensory modalities, an overview

This special issue presents research concerning multistable perception in different sensory modalities. Multistability occurs when a single physical stimulus produces alternations between different subjective percepts. Multistability was first described for vision, where it occurs, for example, when different stimuli are presented to the two eyes or for certain ambiguous figures. It has since been described for other sensory modalities, including audition, touch and olfaction. The key features of multistability are: (i) stimuli have more than one plausible perceptual organization; (ii) these organizations are not compatible with each other. We argue here that most if not all cases of multistability are based on competition in selecting and binding stimulus information. Binding refers to the process whereby the different attributes of objects in the environment, as represented in the sensory array, are bound together within our perceptual systems, to provide a coherent interpretation of the world around us. We argue that multistability can be used as a method for studying binding processes within and across sensory modalities. We emphasize this theme while presenting an outline of the papers in this issue. We end with some thoughts about open directions and avenues for further research.

Onset rivalry: the initial dominance phase is independent of ongoing perceptual alternations

Binocular rivalry has been used to study a wide range of visual processes, from the integration of low-level features to the selection of signals that reach awareness. However, many of these studies do not distinguish between early and late phases of rivalry. There is clear evidence that the “onset” stage of rivalry is characterized by stable, yet idiosyncratic biases that are not evident in the average dominance of sustained rivalry viewing. Low-level stimulus features also have robust effects in the onset phase that are not seen in sustained rivalry, suggesting these phases may be driven at least partly by different neural mechanisms. The effects of high-level cognitive and affective factors at onset are less clear but also show differences from their effects in sustained viewing. These findings have important implications for the interpretation of any rivalry experiments using brief presentation paradigms and for understanding how the brain copes with binocular discrepancies in natural viewing conditions in which our eyes constantly move around an ever-changing environment. This review will summarize current research and explore the factors influencing this “onset” stage.

The psychophysics of brain rhythms

It is becoming increasingly apparent that brain oscillations in various frequency bands play important roles in perceptual and attentional processes. Understandably, most of the associated experimental evidence comes from human or animal electrophysiological studies, allowing direct access to the oscillatory activities. However, such periodicities in perception and attention should, in theory, also be observable using the proper psychophysical tools. Here, we review a number of psychophysical techniques that have been used by us and other authors, in successful and sometimes unsuccessful attempts, to reveal the rhythmic nature of perceptual and attentional processes. We argue that the two existing and largely distinct debates about discrete vs. continuous perception and parallel vs. sequential attention should in fact be regarded as two facets of the same question: how do brain rhythms shape the psychological operations of perception and attention?

Neural correlates of the continuous Wagon Wheel Illusion: a functional MRI study

After prolonged viewing of a continuous periodic motion stimulus at frequencies around 10 Hz, observers experience a fleeting impression of reversed motion: the continuous Wagon Wheel Illusion (c-WWI). To account for this phenomenon it has been proposed that attentional mechanisms discretely sample motion information. Alternative accounts argue that the illusion relies on the spurious activation of motion detectors, which under the effect of adaptation could trigger a reversed percept. We investigated the neural correlates of the c-WWI using fMRI (3T). Subjects viewed a vertically bisected ring containing a radial grating unambiguously rotating at 10 Hz; they continuously reported the perceived motion direction within each half of the ring. The two halves always rotated in opposite directions, allowing us to separately explore illusory reversals occurring within each hemifield. Comparing BOLD activity during illusory (c-WWI) or real perceptual periods revealed systematic differences in right parietal regions, in addition to the right motion complex MT+. This activation pattern did not depend on the side on which the illusion occurred, and could not be accounted for by purely perceptual switch-related activity-known to encompass parietal regions during other bistable effects. This first characterization of the fMRI correlates of the c-WWI may have implications for the different theoretical explanations of the phenomenon.

The effect of adapting speed, duration, and distance on the tactile motion aftereffect

We investigated the effect of adapting speed, duration, and distance on the frequency of occurrence, duration, and vividness of the tactile motion aftereffect (tMAE). Using a cylindrical drum with a patterned surface we adapted the glabrous surface of the right hand at two speeds (14 and 28 cm/s) and three durations (60, 120, and 240 s). Distance was explored in the interaction of adapting speed and duration. The results showed that the frequency of occurrence, duration, and vividness of the tMAE increased with adapting speed. There was also a positive relationship between adapting duration and the frequency of occurrence, but not the duration or vividness, of the illusion. Distance was only a factor when it came to the duration of the tMAE. Taken together, these results show the importance of adapting parameters, particularly speed, on the tMAE.

Stochastic variations in sensory awareness are driven by noisy neuronal adaptation: evidence from serial correlations in perceptual bistability

When the sensory system is subjected to ambiguous input, perception alternates between interpretations in a seemingly random fashion. Although neuronal noise obviously plays a role, the neural mechanism for the generation of randomness at the slow time scale of the percept durations (multiple seconds) is unresolved. Here significant nonzero serial correlations are reported in series of visual percept durations (to the author's knowledge for the first time accounting for duration impurities caused by reaction time, drift, and incomplete percepts). Serial correlations for perceptual rivalry using structure-from-motion ambiguity were smaller than for binocular rivalry using orthogonal gratings. A spectrum of computational models is considered, and it is concluded that noise in adaptation of percept-related neurons causes the serial correlations. This work bridges, in a physiologically plausible way, widely appreciated deterministic modeling and randomness in experimental observations of visual rivalry.