Touch Accelerates Visual Awareness

Visualisation ergonomics and robotic surgery

Stereopsis may be an advantage of robotic surgery. Perceived robotic ergonomic advantages in visualisation include better exposure, three-dimensional vision, surgeon camera control, and line of sight screen location. Other ergonomic factors relating to visualisation include stereo-acuity, vergence-accommodation mismatch, visual-perception mismatch, visual-vestibular mismatch, visuospatial ability, visual fatigue, and visual feedback to compensate for lack of haptic feedback. Visual fatigue symptoms may be related to dry eye or accommodative/binocular vision stress. Digital eye strain can be measured by questionnaires and objective tests. Management options include treatment of dry eye, correction of refractive error, and management of accommodation and vergence anomalies. Experienced robotic surgeons can use visual cues like tissue deformation and surgical tool information as surrogates for haptic feedback.

Cerebral Projection of Mirrored Touch via sLORETA Imaging

Touch is one of the primary communication tools. Interestingly, the sensation of touch can also be experienced when observed in another person. Due to the system of mirror neurons, it is, in fact, being mapped on the somatosensory cortex of the observer. This phenomenon can be triggered not only by observing touch in another individual, but also by a mirror reflection of the contralateral limb. Our study aims to evaluate and localize changes in the intracerebral source activity via sLORETA imaging during the haptic stimulation of hands, while modifying this contact by a mirror illusion. A total of 10 healthy volunteers aged 23-42 years attended the experiment. The electrical brain activity was detected via scalp EEG. First, we registered the brain activity during resting state with open and with closed eyes, each for 5 min. Afterwards, the subjects were seated at a table with a mirror reflecting their left hand and occluding their right hand. The EEG was then recorded in 2 min sequencies during four modifications of the experiment (haptic contact on both hands, stimulation of the left hand only, right hand only and without any tactile stimuli). We randomized the order of the modifications for each participant. The obtained EEG data were converted into the sLORETA program and evaluated statistically at the significance level of p ≤ 0.05. The subjective experience of all the participants was registered using a survey. A statistically significant difference in source brain activity occurred during all four modifications of our experiment in the beta-2, beta-3 and delta frequency bands, resulting in the activation of 10 different Brodmann areas varying by modification. The results suggest that the summation of stimuli secured by interpersonal haptic contact modified by mirror illusion can activate the brain areas integrating motor, sensory and cognitive functions and further areas related to communication and understanding processes, including the mirror neuron system. We believe these findings may have potential for therapy.

Guns Are Not Faster to Enter Awareness After Seeing a Black Face: Absence of Race-Priming in a Gun/Tool Task During Continuous Flash Suppression

In the Weapon Identification Task (WIT), Black faces prime the identification of guns compared with tools. We measured race-induced changes in visual awareness of guns and tools using continuous flash suppression (CFS). Eighty-four participants, primed with Black or Asian faces, indicated the location of a gun or tool target that was temporarily rendered invisible through CFS, which provides a sensitive measure of effects on early visual processing. The same participants also completed a standard (non-CFS) WIT. We replicated the standard race-priming effect in the WIT. In the CFS task, Black and Asian primes did not affect the time guns and tools needed to enter awareness. Thus, race priming does not alter early visual processing but does change the identification of guns and tools. This confirms that race-priming originates from later post-perceptual memory- or response-related processing.

Tactile information affects alternating visual percepts during binocular rivalry using naturalistic objects

INTRODUCTION

Past studies have provided evidence that the effects of tactile stimulation on binocular rivalry are mediated by primitive features (orientation and spatial frequency) common in vision and touch. In this study, we examined whether such effects on binocular rivalry can be obtained through the roughness of naturalistic objects. In three experiments, the total dominant time of visual percepts of two objects was measured under binocular rivalry when participants touched one of the objects.

RESULT

In Experiment 1, the total dominant time for the image of artificial turf and bathmat was prolonged by congruent tactile stimulation and shortened by incongruent tactile stimulation. In Experiment 2, we used the same stimuli but rotated their visual images in opposite directions. The dominant time for either image was prolonged by congruent tactile stimulation. In Experiment 3, we used different types of stimuli, smooth marble and rough fabric, and noted significant effects of the congruent and incongruent tactile stimulation on the dominant time of visual percepts.

CONCLUSION

These three experiments demonstrated that visuo-tactile interaction on binocular rivalry can be mediated by roughness.

Direction-selective modulation of visual motion rivalry by collocated tactile motion

Early models of multisensory integration posited that cross-modal signals only converged in higher-order association cortices and that vision automatically dominates. However, recent studies have challenged this view. In this study, the significance of the alignment of motion axes and spatial alignment across visual and tactile stimuli, as well as the effect of hand visibility on visuo-tactile interactions were examined. Using binocular rivalry, opposed motions were presented to each eye and participants were required to track the perceived visual direction. A tactile motion that was either a leftward or rightward sweep across the fingerpad was intermittently presented. Results showed that tactile effects on visual percepts were dependent on the alignment of motion axes: rivalry between up/down visual motions was not modulated at all by left/right tactile motion. On the other hand, visual percepts could be altered by tactile motion signals when both modalities shared a common axis of motion: a tactile stimulus could maintain the dominance duration of a congruent visual stimulus and shorten its suppression period. The effects were also conditional on the spatial alignment of the visual and tactile stimuli, being eliminated when the tactile device was displaced 15 cm away to the right of the visual stimulus. In contrast, visibility of the hand touching the tactile stimulus facilitated congruent switches relative to a visual-only baseline but did not present a significant advantage overall. In sum, these results show a low-level sensory interaction that is conditional on visual and tactile stimuli sharing a common motion axis and location in space.

Semantic and spatial congruency mould audiovisual integration depending on perceptual awareness

Information integration is considered a hallmark of human consciousness. Recent research has challenged this tenet by showing multisensory interactions in the absence of awareness. This psychophysics study assessed the impact of spatial and semantic correspondences on audiovisual binding in the presence and absence of visual awareness by combining forward-backward masking with spatial ventriloquism. Observers were presented with object pictures and synchronous sounds that were spatially and/or semantically congruent or incongruent. On each trial observers located the sound, identified the picture and rated the picture's visibility. We observed a robust ventriloquist effect for subjectively visible and invisible pictures indicating that pictures that evade our perceptual awareness influence where we perceive sounds. Critically, semantic congruency enhanced these visual biases on perceived sound location only when the picture entered observers' awareness. Our results demonstrate that crossmodal influences operating from vision to audition and vice versa are interactively controlled by spatial and semantic congruency in the presence of awareness. However, when visual processing is disrupted by masking procedures audiovisual interactions no longer depend on semantic correspondences.

Novel procedure for generating continuous flash suppression: Seurat meets Mondrian

Continuous flash suppression (CFS) entails presentation of a stationary target to one eye and an animated sequence of arrays of geometric figures, the mask, to the other eye. The prototypical CFS sequence comprises different sized rectangles of various colors, dubbed Mondrians. Presented as a rapid, changing sequence to one eye, Mondrians or other similarly constructed textured arrays can abolish awareness of the target viewed by the other eye for many seconds at a time, producing target suppression durations much longer than those associated with conventional binocular rivalry. We have devised an animation technique that replaces meaningless Mondrian figures with recognizable visual objects and scenes as inducers of CFS, allowing explicit manipulation of the visual semantic content of those masks. By converting each image of these CFS sequences into successively presented objects or scenes each comprised of many small, circular patches of color, we create pointillist CFS sequences closely matched in terms of their spatio-temporal power spectra. Randomly rearranging the positions of the pointillist patches scrambles the images so they are no longer recognizable. CFS sequences comprising a stream of different objects produces more robust interocular suppression than do sequences comprising a stream of different scenes, even when the two categories of CFS are matched in root mean square contrast and spatial frequency content. Factors promoting these differences in CFS potency could range from low-level, image-based features to high-level factors including attention and recognizability. At the same time, object- and scene-based CFS sequences, when themselves suppressed from awareness, do not differ in their durations of suppression, implying that semantic content of those images comprising CFS sequences are not registered during suppression. The pointillist technique itself offers a potentially useful means for examining the impact of high-level image meaning on aspects of visual perception other than interocular suppression.

Visual and somatosensory information contribute to distortions of the body model

Distorted representations of the body are observed in healthy individuals as well as in neurological and psychiatric disorders. Distortions of the body model have been attributed to the somatotopic cerebral representation. Recently, it has been demonstrated that visual biases also contribute to those distortions. To better understand the sources of such distortions, we compared the metric representations across five body parts affording different degrees of tactile sensitivity and visual accessibility. We evaluated their perceived dimensions using a Line Length Judgment task. We found that most body parts were underestimated in their dimensions. The estimation error relative to their length was predicted by their tactile acuity, supporting the influence of the cortical somatotopy on the body model. However, tactile acuity did not explain the distortions observed for the width. Visual accessibility in turn does appear to mediate body distortions, as we observed that the dimensions of the dorsal portion of the neck were the only ones accurately perceived. Coherent with the multisensory nature of body representations, we argue that the perceived dimensions of body parts are estimated by integrating visual and somatosensory information, each weighted differently, based on their availability for a given body part and a given spatial dimension.

Effects of Multimodal Association on Ambiguous Perception in Binocular Rivalry

When two eyes view dissimilar images, an observer typically reports ambiguous perception called binocular rivalry where the subjective perception fluctuates between the two inputs. This perceptual instability is often comprised of exclusive dominance of each image and a transition state called piecemeal state where the two images are intermingled in patchwork manner. Herein, we investigated the effects of multimodal association of sensory congruent pair, arbitrary pair, and reverse pair on piecemeal state in order to see how each level of association affects the ambiguous perception during binocular rivalry. To induce the multisensory associations, we designed a matching task with audiovisual feedback where subjects were required to respond according to given pairing rules. We found that explicit audiovisual associations can substantially affect the piecemeal state during binocular rivalry and that this congruency effect that reduces the amount of visual ambiguity originates primarily from explicit audiovisual association training rather than common sensory features. Furthermore, when one information is associated with multiple information, recent and preexisting associations work collectively to influence the perceptual ambiguity during rivalry. Our findings show that learned multimodal association directly affects the temporal dynamics of ambiguous perception during binocular rivalry by modulating not only the exclusive dominance but also the piecemeal state in a systematic manner.

Individual differences in continuous flash suppression: Potency and linkages to binocular rivalry dynamics

Binocular rivalry (BR) and continuous flash suppression (CFS) are compelling psychophysical phenomena involving interocular suppression. Using an individual differences approach we assessed whether interocular suppression induced by CFS is predictable in potency from characteristics of BR that are plausibly governed by interocular inhibition. We found large individual differences in BR dynamics and, in addition, in the strength of CFS as gauged by the incidence and durations of breakthroughs in CFS during an extended viewing periods. CFS's potency waned with repeated trials, but stable individual differences persisted despite these mean shifts. We also discovered large individual differences in the strength of the post-CFS shift in BR dominance produced by interocular suppression. While CFS breakthroughs were significantly negatively correlated with shifts in BR dominance after CFS, there were no significant associations between individual differences in alternation rate during pre-CFS binocular rivalry and either breakthroughs during CFS or post-CFS dominance shifts. Bayesian hypothesis tests and highest posterior density intervals confirmed the weak association between these two forms of interocular suppression. Thus, our findings suggest that the substantial individual differences in BR dynamics and CFS effectiveness are modestly related but not entirely mediated by one common neural substrate.

Touch engages visual spatial contextual processing

The spatial context in which we view a visual stimulus strongly determines how we perceive the stimulus. In the visual tilt illusion, the perceived orientation of a visual grating is affected by the orientation signals in its surrounding context. Conceivably, the spatial context in which a visual grating is perceived can be defined by interactive multisensory information rather than visual signals alone. Here, we tested the hypothesis that tactile signals engage the neural mechanisms supporting visual contextual modulation. Because tactile signals also convey orientation information and touch can selectively interact with visual orientation perception, we predicted that tactile signals would modulate the visual tilt illusion. We applied a bias-free method to measure the tilt illusion while testing visual-only, tactile-only or visuo-tactile contextual surrounds. We found that a tactile context can influence visual tilt perception. Moreover, combining visual and tactile orientation information in the surround results in a larger tilt illusion relative to the illusion achieved with the visual-only surround. These results demonstrate that the visual tilt illusion is subject to multisensory influences and imply that non-visual signals access the neural circuits whose computations underlie the contextual modulation of vision.

Invisible Flashes Alter Perceived Sound Location

Information integration across the senses is fundamental for effective interactions with our environment. The extent to which signals from different senses can interact in the absence of awareness is controversial. Combining the spatial ventriloquist illusion and dynamic continuous flash suppression (dCFS), we investigated in a series of two experiments whether visual signals that observers do not consciously perceive can influence spatial perception of sounds. Importantly, dCFS obliterated visual awareness only on a fraction of trials allowing us to compare spatial ventriloquism for physically identical flashes that were judged as visible or invisible. Our results show a stronger ventriloquist effect for visible than invisible flashes. Critically, a robust ventriloquist effect emerged also for invisible flashes even when participants were at chance when locating the flash. Collectively, our findings demonstrate that signals that we are not aware of in one sensory modality can alter spatial perception of signals in another sensory modality.

Slow and steady, not fast and furious: Slow temporal modulation strengthens continuous flash suppression

Continuous flash suppression (CFS) involves the presentation of a rapidly changing Mondrian sequence to one eye and a static target in the other eye. Targets presented in this manner remain suppressed for several seconds at a time, and this has seen the prevalent use of CFS in studies of unconscious visual processes. However, the mechanisms behind CFS remain unclear, complicating its use and the comprehension of results obtained with the paradigm. For example, some studies report observations indicative of faster, visual masking processes whereas others suggest slower, rivalry processes. To reconcile this discrepancy, this study investigates the effect of temporal frequency content and Mondrian pattern structure on CFS suppression. Our results show predominant influences of spatial edges and low temporal-frequency content, which are similar to binocular rivalry, affording a parsimonious alternative in unifying the two paradigms.

Face proprioception does not modulate access to visual awareness of emotional faces in a continuous flash suppression paradigm

An important question in neuroscience is which multisensory information, presented outside of awareness, can influence the nature and speed of conscious access to our percepts. Recently, proprioceptive feedback of the hand was reported to lead to faster awareness of congruent hand images in a breaking continuous flash suppression (b-CFS) paradigm. Moreover, a vast literature suggests that spontaneous facial mimicry can improve emotion recognition, even without awareness of the stimulus face. However, integration of visual and proprioceptive information about the face to date has not been tested with CFS. The modulation of visual awareness of emotional faces by facial proprioception was investigated across three separate experiments. Face proprioception was induced with voluntary facial expressions or with spontaneous facial mimicry. Frequentist statistical analyses were complemented with Bayesian statistics. No evidence of multisensory integration was found, suggesting that proprioception does not modulate access to visual awareness of emotional faces in a CFS paradigm.