Mental rotation for spatial environment recognition

Sensorimotor Underpinnings of Mathematical Imagination: Qualitative Analysis

Many mathematicians have a rich internal world of mental imagery. Using elementary mathematical skills, this study probes the mathematical imagination's sensorimotor foundations. Mental imagery is perturbed using body position: having the head and vestibular system in different positions with respect to gravity. No two mathematicians described the same imagery. Eight out of 11 habitually visualize, one uses sensorimotor imagery, and two do not habitually used mental imagery. Imagery was both intentional and partly autonomous. For example, coordinate planes rotated, drifted, wobbled, or slid down from vertical to horizontal. Parabolae slid into place or, on one side, a parabola arm reached upward in gravity. The sensorimotor foundation of imagery was evidenced in several ways. The imagery was placed with respect to the body. Further, the imagery had a variety of relationships to the body, such as the body being the coordinate system or the coordinate system being placed in front of the eyes for easy viewing by the mind's eye. The mind's eye, mind's arm, and awareness almost always obeyed the geometry of the real eye and arm. The imagery and body behaved as a dyad, so that the imagery moved or placed itself for the convenience of the mind's eye or arm, which in turn moved to follow the imagery. With eyes closed, participants created a peripersonal imagery space, along with the peripersonal space of the unseen environment. Although mathematics is fundamentally abstract, imagery was sometimes concrete or used a concrete substrate or was placed to avoid being inside concrete objects, such as furniture. Mathematicians varied in the numbers of components of mental imagery and the ways they interacted. The autonomy of the imagery was sometimes of mathematical interest, suggesting that the interaction of imagery habits and autonomy can be a source of mathematical creativity.

Vestibular stimulation interferes with the dynamics of an internal representation of gravity

The remembered vanishing location of a moving target has been found to be displaced downward in the direction of gravity (representational gravity) and more so with increasing retention intervals, suggesting that the visual spatial updating recruits an internal model of gravity. Despite being consistently linked with gravity, few inquiries have been made about the role of vestibular information in these trends. Previous experiments with static tilting of observers' bodies suggest that under conflicting cues between the idiotropic vector and vestibular signals, the dynamic drift in memory is reduced to a constant displacement along the body's main axis. The present experiment aims to replicate and extend these outcomes while keeping the observers' bodies unchanged in relation to physical gravity by varying the gravito-inertial acceleration using a short-radius centrifuge. Observers were shown, while accelerated to varying degrees, targets moving along several directions and were required to indicate the perceived vanishing location after a variable interval. Increases of the gravito-inertial force (up to 1.4G), orthogonal to the idiotropic vector, did not affect the direction of representational gravity, but significantly disrupted its time course. The role and functioning of an internal model of gravity for spatial perception and orientation are discussed in light of the results.

The Thatcher Illusion: Rotating the Viewer Instead of the Picture

Faces are difficult to recognise when presented upside down. This effect of face inversion was effectively demonstrated with the ‘Thatcher illusion’ by Thompson (1980 Perception9 483–484). It has been tacitly assumed that this effect is due to inversion relative to retinal coordinates. Here we tested whether it is due to egocentric (ie retinal) inversion or whether the orientation of the body with respect to gravity also influences the face-inversion effect. A 3-D human turntable was used to test subjects in 5 different body-tilt (roll) orientations: 0°, 45°, 90°, 135°, and 180°. The stimuli consisted of 4 ‘normal’ and 4 ‘thatcherised’ faces and were presented in 8 different orientations in the picture plane. The subjects had to decide in a yes – no task whether the faces were ‘normal’ or ‘thatcherised’. Analysis of the d' values revealed a significant effect of stimulus orientation and body tilt. The significant effect of body tilt was due to a drop in d' values in the 135° orientation. This result is compared to findings of studies on the subjective visual vertical, where larger errors occurred in body-tilt orientations between 90° and 180°. The present findings suggest that the face-inversion effect relies mainly on retinal coordinates, but that in head-down body-tilt orientations around 135° the gravitational reference frame has a major influence on the perception of faces.

Spatial cognition, body representation and affective processes: the role of vestibular information beyond ocular reflexes and control of posture

A growing number of studies in humans demonstrate the involvement of vestibular information in tasks that are seemingly remote from well-known functions such as space constancy or postural control. In this review article we point out three emerging streams of research highlighting the importance of vestibular input: (1) Spatial Cognition: Modulation of vestibular signals can induce specific changes in spatial cognitive tasks like mental imagery and the processing of numbers. This has been shown in studies manipulating body orientation (changing the input from the otoliths), body rotation (changing the input from the semicircular canals), in clinical findings with vestibular patients, and in studies carried out in microgravity. There is also an effect in the reverse direction; top-down processes can affect perception of vestibular stimuli. (2) Body Representation: Numerous studies demonstrate that vestibular stimulation changes the representation of body parts, and sensitivity to tactile input or pain. Thus, the vestibular system plays an integral role in multisensory coordination of body representation. (3) Affective Processes and Disorders: Studies in psychiatric patients and patients with a vestibular disorder report a high comorbidity of vestibular dysfunctions and psychiatric symptoms. Recent studies investigated the beneficial effect of vestibular stimulation on psychiatric disorders, and how vestibular input can change mood and affect. These three emerging streams of research in vestibular science are-at least in part-associated with different neuronal core mechanisms. Spatial transformations draw on parietal areas, body representation is associated with somatosensory areas, and affective processes involve insular and cingulate cortices, all of which receive vestibular input. Even though a wide range of different vestibular cortical projection areas has been ascertained, their functionality still is scarcely understood.

Disambiguation of mental rotation by spatial frames of reference

Previous research has shown that our ability to imagine object rotations is limited and associated with spatial reference frames; performance is poor unless the axis of rotation is aligned with the object-intrinsic frame or with the environmental frame. Here, we report an active effect of these reference frames on the process of mental rotation: they can disambiguate object rotations when the axis of rotation is ambiguous. Using novel mental rotation stimuli, in which the rotational axes between pairs of objects can be defined with respect to multiple frames of reference, we demonstrate that the vertical axis is preferentially used for imagined object rotations over the object-intrinsic axis for an efficient minimum rotation. In contrast, the object-intrinsic axis can play a decisive role when the vertical axis is absent as a way of resolving the ambiguity of rotational motion. When interpreted in conjunction with recent advances in the Bayesian framework for motion perception, our results suggest that these spatial frames of reference are incorporated into an internal model of object rotations, thereby shaping our ability to imagine the transformation of an object's spatial structure.

Mental imagery of self-location during spontaneous and active self-other interactions: an electrical neuroimaging study

Substantial data from the cognitive neurosciences point to the importance of bodily processing for the development of a comprehensive theory of the self. A key aspect of the bodily self is self-location, the experience that the self is localized at a specific position in space within one's bodily borders (embodied self-location). Although the neural mechanisms of self-location have been studied by manipulating the spatial location of one's visual perspective during mental imagery, such experiments were conducted in constrained, explicit, and unecological contexts such as explicit instructions in a prone/seated position, although most human interactions occur spontaneously while standing/walking. Using a motor paradigm, we investigated the behavioral and neural mechanisms of spontaneous self-location and mental body transformations during active human interaction. Using own-body imagery using spontaneous and explicit changes in self-location in standing participants, we report that spontaneous interactions with an avatar are neurally indistinguishable from explicit own-body transformation with disembodied self-location but differ from explicit own-body transformation with embodied self-location at 400-600 ms after stimulus onset. We discuss these findings with respect to the neural mechanisms of perspective-taking and self-location in spontaneous human interaction.

Walking on a line: a motor paradigm using rotation and reflection symmetry to study mental body transformations

Researchers have recently reintroduced the own-body in the center of the social interaction theory. From the discovery of the mirror neurons in the ventral premotor cortex of the monkey's brain, a human embodied model of interindividual relationship based on simulation processes has been advanced, according to which we tend to embody spontaneously the other individuals' behavior when interacting. Although the neurocognitive mechanisms of the embodiment process have started being described, the mechanisms of self-location during embodiment are still less known. Here, we designed a motor paradigm which allows investigating in ecologically more valid conditions whether we embody another person's intransitive action with an embodied or disembodied self-location. Accordingly, we propose a phenomenological model of self-other interaction showing how perspective-taking mechanisms may relate on mental body transformation and offering a promising way to investigate the different sorts of intersubjectivity.

Four types of visual mental imagery processing in upright and tilted observers

We investigated the role of body position on performance in four distinct types of mental imagery processing. Previous studies used the upright body position as standard procedure and therefore do not address the issue of whether mental imagery tasks are processed in accordance with ego-centered or gravitational coordinates. In the present study, the subjects were brought into one of three different body positions: upright, horizontal, or supine. In each of these body positions, we measured performance in four imagery tasks, which assessed (1) the ability to generate vivid, high-resolution mental images; (2) the ability to compose mental images from separate parts; (3) the ability to inspect patterns in mental images; and, (4) the ability to mentally rotate patterns in images. Not all processes were affected in the same way when subjects performed them in different body positions. Performance in the image composition and detection tasks depended on body position, whereas there was no such effect for the transformation and resolution tasks.

Active, passive and snapshot exploration in a virtual environment: influence on scene memory, reorientation and path memory

We investigated the importance of active, passive and snapshot exploration on spatial memory in a virtual city. The exploration consisted in traveling along a series of streets. 'Active exploration' was performed by giving directions to the subject who controlled his displacement with a joystick. During 'passive' exploration, the travel was imposed by the computer. Finally, during 'snapshot exploration', simple views of the scene were presented sequentially every 4 m. Travel velocity was the same in all cases. The three visual exploration modes were compared with three spatial memory measures: (1) scene recognition, (2) at the end of the path, reorientation toward the departure point and (3) drawings of the path shape. Scene recognition and estimation of the direction of the starting point of the path were not affected by the mode of exploration. In contrast, reproduction of the shape of the path was affected: the errors of reproduction were greater for the snapshot exploration than for the other two conditions; there was no difference between the other two conditions. These results suggest that (1) 2D image features from a visual scene are memorized. Moreover, (2) pointing towards the origin of the path relies on motion duration integration or a frame of reference integrated during displacement. Finally, (3) drawing the path shape involves a deliberate reconstruction process.