Multisensory determinants of orientation perception: task-specific sex differences

[Gender morphology of Broca's motor speech area]

OBJECTIVE

To study the general patterns and differences in the macroscopic structure of Broca's motor speech area in the left and right hemispheres of male and female brains.

MATERIAL AND METHODS

The study was conducted on MRI images of the brains of 9 men and 9 women (36 hemispheres in total). All the people were between the ages of 20 and 30, without any mental or neurological disorders. The localization and structure of the main sulci and gyri of Broca's area, namely the pars triangularis and pars opercularis, were studied. In addition, the topography of the main sulci in Broca's motor speech area, namely their shape, length, and relative position to the other sulci, was analyzed.

RESULTS

The features of the localization of the sulci in Broca's area, the differences in the number of additional sulci in the pars triangularis and pars opercularis of male and female brains, as well as the degree of asymmetry of Broca's area in the left and right hemispheres of the brains of men and women were established.In modern neuroscience a new scientific direction of genderology, which studies the behavior and cognitive functions of males and females, is rapidly developing.

CONCLUSION

Broca's motor speech area of the brain of men and women differs in macroscopic structure.

Enhancement of visual cues to self-motion during a visual/vestibular conflict

Perceiving our orientation and motion requires sensory information provided by vision, our body and acceleration. Normally, these cues are redundant however in some situations they can conflict. Here, we created a visual-vestibular conflict by simulating a body-upright virtual world while participants were either standing (no conflict), supine or prone (conflict) and assessed the perception of "forward" distance travelled induced by visual motion. Some participants felt they were standing upright even when lying, indicating a visual reorientation illusion (VRI). We previously showed that when experiencing a VRI, visually induced self-motion is enhanced. Here, we determined if there was a relationship between VRI vulnerability and sensory weighting. Confirming our previous findings, the VRI-vulnerable group showed enhanced self-motion perception. We then assessed the relative weightings of visual and non-visual cues in VRI-vulnerable and VRI-resistant individuals using the Oriented Character Recognition Test. Surprisingly, VRI-vulnerable individuals weighted visual cues less and gravity cues more compared to VRI-resistant individuals. These findings are in line with robust integration where, when the difference between two cues is large, the discrepant cue (here gravity) is ignored. Ignoring the gravity cue then leads to relatively more emphasis being placed on visual information and thus a higher gain.

Bayesian causal inference in visuotactile integration in children and adults

If cues from different sensory modalities share the same cause, their information can be integrated to improve perceptual precision. While it is well established that adults exploit sensory redundancy by integrating cues in a Bayes optimal fashion, whether children under 8 years of age combine sensory information in a similar fashion is still under debate. If children differ from adults in the way they infer causality between cues, this may explain mixed findings on the development of cue integration in earlier studies. Here we investigated the role of causal inference in the development of cue integration, by means of a visuotactile localization task. Young children (6-8 years), older children (9.5-12.5 years) and adults had to localize a tactile stimulus, which was presented to the forearm simultaneously with a visual stimulus at either the same or a different location. In all age groups, responses were systematically biased toward the position of the visual stimulus, but relatively more so when the distance between the visual and tactile stimulus was small rather than large. This pattern of results was better captured by a Bayesian causal inference model than by alternative models of forced fusion or full segregation of the two stimuli. Our results suggest that already from a young age the brain implicitly infers the probability that a tactile and a visual cue share the same cause and uses this probability as a weighting factor in visuotactile localization.

Long-duration head down bed rest as an analog of microgravity: Effects on the static perception of upright

BACKGROUND:

Humans demonstrate many physiological changes in microgravity for which long-duration head down bed rest (HDBR) is a reliable analog. However, information on how HDBR affects sensory processing is lacking.

OBJECTIVE:

We previously showed [25] that microgravity alters the weighting applied to visual cues in determining the perceptual upright (PU), an effect that lasts long after return. Does long-duration HDBR have comparable effects?

METHODS:

We assessed static spatial orientation using the luminous line test (subjective visual vertical, SVV) and the oriented character recognition test (PU) before, during and after 21 days of 6° HDBR in 10 participants. Methods were essentially identical as previously used in orbit [25].

RESULTS:

Overall, HDBR had no effect on the reliance on visual relative to body cues in determining the PU. However, when considering the three critical time points (pre-bed rest, end of bed rest, and 14 days post-bed rest) there was a significant decrease in reliance on visual relative to body cues, as found in microgravity. The ratio had an average time constant of 7.28 days and returned to pre-bed-rest levels within 14 days. The SVV was unaffected.

CONCLUSIONS:

We conclude that bed rest can be a useful analog for the study of the perception of static self-orientation during long-term exposure to microgravity. More detailed work on the precise time course of our effects is needed in both bed rest and microgravity conditions.

Reliability of the Crossed-Hands Deficit in Tactile Temporal Order Judgements

Crossing the hands over the midline impairs performance on a tactile temporal order judgement (TOJ) task, resulting in the crossed-hands deficit. This deficit results from a conflict between two reference frames - one internal (somatotopic) and the other external (spatial) - for coding stimulus location. The substantial individual differences observed in the crossed-hands deficit highlight the differential reliance on these reference frames. For example, women have been reported to place a greater emphasis on the external reference frame than men, resulting in a larger crossed-hands deficit for women. It has also been speculated that individuals with an eating disorder place a greater weight on the external reference frame. Further exploration of individual differences in reference frame weighing using a tactile TOJ task requires that the reliability of the task be established. In Experiment 1, we investigated the reliability of the tactile TOJ task across two sessions separated by one week and found high reliability in the magnitude of the crossed-hands deficit. In Experiment 2, we report the split-half reliability across multiple experiments (both published and unpublished). Overall, tactile TOJ reliability was high. Experiments with small to moderate crossed-hands deficits showed good reliability; those with larger deficits showed even higher reliability. Researchers should try to maximize the size of the effect when interested in individual differences in the use of the internal and external reference frames.

Somatosensory Loss Influences the Adoption of Self-Centered Versus Decentered Perspectives

The body and the self are commonly experienced as forming a unity. Experiencing the external world as distinct from the self and the body strongly relies on adopting a single self-centered perspective which results in integrating multisensory sensations into one egocentric body-centered reference frame. Body posture and somatosensory representations have been reported to influence perception and specifically the reference frame relative to which multisensory sensations are coded. In the study reported here, we investigated the role of somatosensory and visual information in adopting self-centered and decentered spatial perspectives. Two deafferented patients who have neither tactile nor proprioceptive perception below the head and a group of age-matched control participants performed a graphesthesia task, consisting of the recognition of ambiguous letters (b, d, p, and q) drawn tactilely on head surfaces. To answer which letter was drawn, the participants can adopt either a self-centered perspective or a decentered one (i.e., centered on a body part or on an external location). The participants' responses can be used, in turn, to infer the way the left-right and top-bottom letters' axes are assigned with respect to the left-right and top-bottom axes of their body. In order to evaluate the influence of body posture, the ambiguous letters were drawn on the participants' forehead, left, and right surfaces of the head, with the head aligned or rotated in yaw relative to the trunk. In order to evaluate the role of external information, the participants completed the task with their eyes open in one session and closed in another one. The results obtained in control participants revealed that their preferred perspective varied with body posture but not with vision. Different results were obtained with the deafferented patients who overall do not show any significant effect of their body posture on their preferred perspective. This result suggests that the orientation of their self is not influenced by their physical body. There was an effect of vision for only one of the two patients. The deafferented patients rely on strategies that are more prone to interindividual differences, which highlights the crucial role of somatosensory information in adopting self-centered spatial perspectives.

The Weighting of Cues to Upright Following Stroke With and Without a History of Pushing

OBJECTIVE

Perceived upright depends on three main factors: vision, graviception, and the internal representation of the long axis of the body. We assessed the relative contributions of these factors in individuals with sub-acute and chronic stroke and controls using a novel tool; the Oriented Character Recognition Test (OCHART). We also considered whether individuals who displayed active pushing or had a history of pushing behaviours had different weightings than those with no signs of pushing.

METHOD

Three participants experienced a stroke 6 months prior: eight with a history of pushing. In total, 12 participants served as healthy aged-matched controls. Visual and graviceptive cues were dissociated by orienting the visual background left, right, or upright relative to the body, or by orienting the body left, right, or upright relative to gravity. A three-vector model was used to quantify the weightings of vision, graviception, and the body to the perceptual upright.

RESULTS

The control group showed weightings of 13% vision, 25% graviception, and 62% body. Some individuals with stroke showed a similar pattern; others, particularly those with recent stroke, showed different patterns, for example, being unaffected by one of the three factors. The participant with active pushing behaviour displayed an ipsilesional perceptual bias (>30°) and was not affected by visual cues to upright.

CONCLUSION

The results of OCHART may be used to quantify the weightings of multisensory inputs in individuals post-stroke and may help characterize perceptual sources of pushing behaviours.

Enhanced Reality Showing Long-Lasting Analgesia after Total Knee Arthroplasty: Prospective, Randomized Clinical Trial

To overcome the limitation of short-term efficacy of virtual reality (VR), an enhanced reality (ER) analgesia, (combination of the VR, real-time motion capture, mirror therapy [MT]) involving a high degree of patients’ presence or embodiment was explored. Patients, who underwent unilateral total knee arthroplasty (TKA), received ER analgesia. The duration was 5 times a week, for 2 weeks for one group and 5 times a week, for 1 week in the other. Visual Analogue Scale (VAS) at rest and during movement, active knee range of motion (ROM) for flexion and extension were measured repeatedly. After screening 157 patients, 60 were included. Pre-interventional evaluation was performed at 6.7 days and ER was initiated at 12.4 days after surgery. Evaluation was performed at 5, 12, 33 days after the initiation of ER. Analgesia in the 2 week therapy group was effective until the third evaluation (p = 0.000), whereas in the other group, it was effective only until the second evaluation (p = 0.010). Improvement in ROM in the 2 week group was also maintained until the third evaluation (p = 0.037, p = 0.009). It could lay the foundations for the development of safe and long-lasting analgesic tools.

Unbounded evidence accumulation characterizes subjective visual vertical forced-choice perceptual choice and confidence

Humans can subjectively yet quantitatively assess choice confidence based on perceptual precision even when a perceptual decision is made without an immediate reward or feedback. However, surprisingly little is known about choice confidence. Here we investigate the dynamics of choice confidence by merging two parallel conceptual frameworks of decision making, signal detection theory and sequential analyses (i.e., drift-diffusion modeling). Specifically, to capture end-point statistics of binary choice and confidence, we built on a previous study that defined choice confidence in terms of psychophysics derived from signal detection theory. At the same time, we augmented this mathematical model to include accumulator dynamics of a drift-diffusion model to characterize the time dependence of the choice behaviors in a standard forced-choice paradigm in which stimulus duration is controlled by the operator. Human subjects performed a subjective visual vertical task, simultaneously reporting binary orientation choice and probabilistic confidence. Both binary choice and confidence experimental data displayed statistics and dynamics consistent with both signal detection theory and evidence accumulation, respectively. Specifically, the computational simulations showed that the unbounded evidence accumulator model fits the confidence data better than the classical bounded model, while bounded and unbounded models were indistinguishable for binary choice data. These results suggest that the brain can utilize mechanisms consistent with signal detection theory-especially when judging confidence without time pressure.NEW & NOTEWORTHY We found that choice confidence data show dynamics consistent with evidence accumulation for a forced-choice subjective visual vertical task. We also found that the evidence accumulation appeared unbounded when judging confidence, which suggests that the brain utilizes mechanisms consistent with signal detection theory to determine choice confidence.

Do Visual and Vestibular Inputs Compensate for Somatosensory Loss in the Perception of Spatial Orientation? Insights from a Deafferented Patient

The present study aimed at investigating the consequences of a massive loss of somatosensory inputs on the perception of spatial orientation. The occurrence of possible compensatory processes for external (i.e., object) orientation perception and self-orientation perception was examined by manipulating visual and/or vestibular cues. To that aim, we compared perceptual responses of a deafferented patient (GL) with respect to age-matched Controls in two tasks involving gravity-related judgments. In the first task, subjects had to align a visual rod with the gravitational vertical (i.e., Subjective Visual Vertical: SVV) when facing a tilted visual frame in a classic Rod-and-Frame Test. In the second task, subjects had to report whether they felt tilted when facing different visuo-postural conditions which consisted in very slow pitch tilts of the body and/or visual surroundings away from vertical. Results showed that, much more than Controls, the deafferented patient was fully dependent on spatial cues issued from the visual frame when judging the SVV. On the other hand, the deafferented patient did not rely at all on visual cues for self-tilt detection. Moreover, the patient never reported any sensation of tilt up to 18° contrary to Controls, hence showing that she did not rely on vestibular (i.e., otoliths) signals for the detection of very slow body tilts either. Overall, this study demonstrates that a massive somatosensory deficit substantially impairs the perception of spatial orientation, and that the use of the remaining sensory inputs available to a deafferented patient differs regarding whether the judgment concerns external vs. self-orientation.

Contribution of Bodily and Gravitational Orientation Cues to Face and Letter Recognition

Sensory information provided by the vestibular system is crucial in cognitive processes such as the ability to recognize objects. The orientation at which objects are most easily recognized--the perceptual upright (PU)--is influenced by body orientation with respect to gravity as detected from the somatosensory and vestibular systems. To date, the influence of these sensory cues on the PU has been measured using a letter recognition task. Here we assessed whether gravitational influences on letter recognition also extend to human face recognition. 13 right-handed observers were positioned in four body orientations (upright, left-side-down, right-side-down, supine) and visually discriminated ambiguous characters ('p'-from-'d'; 'i'-from-'!') and ambiguous faces used in popular visual illusions ('young woman'-from-'old woman'; 'grinning man'-from-'frowning man') in a forced-choice paradigm. The two transition points (e.g., 'p-to-d' and 'd-to-p'; 'young woman-to-old woman' and 'old woman-to-young woman') were fit with a sigmoidal psychometric function and the average of these transitions was taken as the PU for each stimulus category. The results show that both faces and letters are more influenced by body orientation than gravity. However, faces are more optimally recognized when closer in alignment with body orientation than letters--which are more influenced by gravity. Our results indicate that the brain does not utilize a common representation of upright that governs recognition of all object categories. Distinct areas of ventro-temporal cortex that represent faces and letters may weight bodily and gravitational cues differently--possibly to facilitate the specific demands of face and letter recognition.

Dissociating vestibular and somatosensory contributions to spatial orientation

Inferring object orientation in the surroundings heavily depends on our internal sense of direction of gravity. Previous research showed that this sense is based on the integration of multiple information sources, including visual, vestibular (otolithic), and somatosensory signals. The individual noise characteristics and contributions of these sensors can be studied using spatial orientation tasks, such as the subjective visual vertical (SVV) task. A recent study reported that patients with complete bilateral vestibular loss perform similar as healthy controls on these tasks, from which it was conjectured that the noise levels of both otoliths and body somatosensors are roll-tilt dependent. Here, we tested this hypothesis in 10 healthy human subjects by roll tilting the head relative to the body to dissociate tilt-angle dependencies of otolith and somatosensory noise. Using a psychometric approach, we measured the perceived orientation, and its variability, of a briefly flashed line relative to the gravitational vertical (SVV). Measurements were taken at multiple body-in-space orientations (-90 to 90°, steps of 30°) and head-on-body roll tilts (30° left ear down, aligned, 30° right ear down). Results showed that verticality perception is processed in a head-in-space reference frame, with a systematic SVV error that increased with larger head-in-space orientations. Variability patterns indicated a larger contribution of the otolith organs around upright and a more substantial contribution of the body somatosensors at larger body-in-space roll tilts. Simulations show that these findings are consistent with a statistical model that involves tilt-dependent noise levels of both otolith and somatosensory signals, confirming dynamic shifts in the weights of sensory inputs with tilt angle.

Subjective Visual Vertical Tilt Attraction to the Side of Rod Presentation: Effects of Age, Sex, and Vestibular Disorders

OBJECTIVE

The aim of this study was to evaluate the effect of initial rod position on the subjective visual vertical (SVV) tilt and to investigate the effect of sex and age on the SVV tilt induced by this initial position.

STUDY DESIGN

Prospective cross-sectional study.

SETTING

Tertiary referral center.

PATIENTS

The study included 6598 consecutive patients with a large range of vestibular disorders and 333 control subjects. The mean age was 55 years (range, 3-97), and the sex ratio was 0.6.

INTERVENTION

SVV was measured by presenting a phosphorescent rod 12 times in total darkness with a 45-degree deviation from the vertical alternatively on the right and left. The patient was asked to replace the bar vertically with a remote control.

RESULTS

On average, SVV at each iteration was tilted to the side of the rod presentation. It was stronger in female subjects, in younger individuals (<20 years) and seniors (>50). It was also higher in patients with a left vestibular loss in comparison to those with a right involvement.

CONCLUSIONS

These effects suggest that short-term visual memory and multisensory cortical processing interfere with SVV measurements.

Quantitative orientation preference and susceptibility to space motion sickness simulated in a virtual reality environment

Orientation preference should appear when variable weightings of spatial orientation cues are used between individuals. It is possible that astronauts' orientation preferences could be a potential predictor for susceptibility to space motion sickness (SMS). The present study was conducted to confirm this relationship on Earth by quantifying orientation preferences and simulating SMS in a virtual reality environment. Two tests were carried out. The first was to quantitatively determine one's orientation preference. Thirty-two participants' vision and body cue preferences were determined by measuring perceptual up (PU) orientations. The ratio of vision and body vector (ROVB) was used as the indicator of one's orientation preference. The second test was to visually induce motion sickness symptoms that represent similar sensory conflicts as SMS using a virtual reality environment. Relationships between ROVB values and motion sickness scores were analyzed, which revealed cubic functions by using optimal fits. According to ROVB level, participants were divided into three groups - body group, vision group, and confusion group - and the factor of gender was further considered as a covariate in the analysis. Consistent differences in motion sickness scores were observed between the three groups. Thus, orientation preference had a significant relationship with susceptibility to simulated SMS symptoms. This knowledge could assist with astronaut selection and might be a useful countermeasure when developing new preflight trainings.

Slow changing postural cues cancel visual field dependence on self-tilt detection

Interindividual differences influence the multisensory integration process involved in spatial perception. Here, we assessed the effect of visual field dependence on self-tilt detection relative to upright, as a function of static vs. slow changing visual or postural cues. To that aim, we manipulated slow rotations (i.e., 0.05° s(-1)) of the body and/or the visual scene in pitch. Participants had to indicate whether they felt being tilted forward at successive angles. Results show that thresholds for self-tilt detection substantially differed between visual field dependent/independent subjects, when only the visual scene was rotated. This difference was no longer present when the body was actually rotated, whatever the visual scene condition (i.e., absent, static or rotated relative to the observer). These results suggest that the cancellation of visual field dependence by dynamic postural cues may rely on a multisensory reweighting process, where slow changing vestibular/somatosensory inputs may prevail over visual inputs.

Where is uphill? Exploring sex differences when reorienting on a sloped environment presented through 2-D images

One of the spatial abilities that has recently revealed a remarkable variability in performance is that of using terrain slope to reorient. Previous studies have shown a very large disadvantage for females when the slope of the floor is the only information useful for encoding a goal location. However, the source of this sex difference is still unclear. The slope of the environment provides a directional source of information that is perceived through dissociable visual and kinesthetic sensory modalities. Here we focused on the visual information, and examined whether there are sex differences in the perception of a slope presented through 2-D images with a desktop computer connected to an eye-tracking device. Participants had to identify and point to the uphill direction by looking at different orientations of two virtual, slanted environments (one indoor and one outdoor). Men were quicker and more accurate than women, indicating that the female difficulty with slope emerges at an early, unisensory, perceptual level. However, the eye-tracking data revealed no sex differences in the slope cues used, providing no support to the hypothesis of sex-specific, visual-processing strategies. Interestingly, performance correlated with a test of mental rotation, and we speculate that the disadvantage in mental rotation ability might be an important factor responsible for females' difficulty using slope.

Greater visual averaging of face identity for own-gender faces

Recent evidence suggests that observers can rapidly form an average representation based on a set of simultaneously presented faces. Here, we replicate this finding and show that the tendency to process sets of faces in terms of an average representation is greater for own-gender faces. Male and female participants viewed sets of four male or female faces before deciding whether or not a subsequently presented single test face had been present in the set. Incorrect endorsement that it was one of the set members was greater when the test face was a morphed average of the four faces than when it was an actual set member, and this effect was strongest when the gender of the faces was the same as the observer's. The finding that observers were more likely to incorrectly endorse own-gender (vs. other-gender) faces forms an exception to the often reported own-gender advantage in face recognition.

Gender and line size factors modulate the deviations of the subjective visual vertical induced by head tilt

Background

The subjective visual vertical (SVV, the visual estimation of gravitational direction) is commonly considered as an indicator of the sense of orientation. The present study examined the impact of two methodological factors (the angle size of the stimulus and the participant's gender) on deviations of the SVV caused by head tilt. Forty healthy participants (20 men and 20 women) were asked to make visual vertical adjustments of a light bar with their head held vertically or roll-tilted by 30° to the left or to the right. Line angle sizes of 0.95° and 18.92° were presented.

Results

The SVV tended to move in the direction of head tilt in women but away from the direction of head tilt in men. Moreover, the head-tilt effect was also modulated by the stimulus' angle size. The large angle size led to deviations in the direction of head-tilt, whereas the small angle size had the opposite effect.

Conclusions

Our results showed that gender and line angle size have an impact on the evaluation of the SVV. These findings must be taken into account in the growing body of research that uses the SVV paradigm in disease settings. Moreover, this methodological issue may explain (at least in part) the discrepancies found in the literature on the head-tilt effect.

Perceived object stability depends on multisensory estimates of gravity

Background

How does the brain estimate object stability? Objects fall over when the gravity-projected centre-of-mass lies outside the point or area of support. To estimate an object's stability visually, the brain must integrate information across the shape and compare its orientation to gravity. When observers lie on their sides, gravity is perceived as tilted toward body orientation, consistent with a representation of gravity derived from multisensory information. We exploited this to test whether vestibular and kinesthetic information affect this visual task or whether the brain estimates object stability solely from visual information.

Methodology/Principal Findings

In three body orientations, participants viewed images of objects close to a table edge. We measured the critical angle at which each object appeared equally likely to fall over or right itself. Perceived gravity was measured using the subjective visual vertical. The results show that the perceived critical angle was significantly biased in the same direction as the subjective visual vertical (i.e., towards the multisensory estimate of gravity).

Conclusions/Significance

Our results rule out a general explanation that the brain depends solely on visual heuristics and assumptions about object stability. Instead, they suggest that multisensory estimates of gravity govern the perceived stability of objects, resulting in objects appearing more stable than they are when the head is tilted in the same direction in which they fall.

Is inefficient multisensory processing associated with falls in older people?

Although falling is a significant problem for older persons, little is understood about its underlying causes. Spatial cognition and balance maintenance rely on the efficient integration of information across the main senses. We investigated general multisensory efficiency in older persons with a history of falls compared to age- and sensory acuity-matched controls and younger adults using a sound-induced flash illusion. Older fallers were as susceptible to the illusion as age-matched, non-fallers or younger adults at a short delay of 70 ms between the auditory and visual stimuli. Both older adult groups were more susceptible to the illusion at longer SOAs than younger adults. However, with increasing delays between the visual and auditory stimuli, older fallers did not show a decline in the frequency at which the illusion was experienced even with delays of up to 270 ms. We argue that this relatively higher susceptibility to the illusion reflects inefficient audio-visual processing in the central nervous system and has important implications for the diagnosis and rehabilitation of falling in older persons.

Crossing the hands is more confusing for females than males

A conflict between an egocentric and an external reference frame can be highlighted by examining the marked deficit observed with tactile temporal order judgments (TOJ) when the hands are crossed. The anecdotally-reported large individual differences in the magnitude of this crossed-hands deficit were explored here by testing a large group of participants (48; 24 female). Given that females have been shown to be more visually dependent than males in the potentially related rod-and-frame test (RFT), we hypothesized that females would show a larger influence of the external reference frame (i.e., a larger crossed-hands deficit). As predicted, female participants produced larger tactile TOJ deficits compared to our male participants. We also administered the RFT in these participants with hands crossed and uncrossed. Crossing the hands increased the effect of the frame in the RFT, more so for females than males, further highlighting the potential difference in the way that each sex accommodates reference frame conflicts. Finally, examining the relation between the two tasks revealed a significant correlation, with larger frame effects associated with larger crossed-hands TOJ deficits, but this only held for males. We speculate that sex-specific differences in multisensory processing and spatial ability may explain why females are less able to disambiguate a crossed-hands posture than are males.