Crossmodal interaction between the mental number line and peripersonal haptic space representation in sighted and blind individuals

Perception and discrimination of real-life emotional vocalizations in early blind individuals

Introduction

The capacity to understand others' emotions and react accordingly is a key social ability. However, it may be compromised in case of a profound sensory loss that limits the contribution of available contextual cues (e.g., facial expression, gestures, body posture) to interpret emotions expressed by others. In this study, we specifically investigated whether early blindness affects the capacity to interpret emotional vocalizations, whose valence may be difficult to recognize without a meaningful context.

Methods

We asked a group of early blind (N = 22) and sighted controls (N = 22) to evaluate the valence and the intensity of spontaneous fearful and joyful non-verbal vocalizations.

Results

Our data showed that emotional vocalizations presented alone (i.e., with no contextual information) are similarly ambiguous for blind and sighted individuals but are perceived as more intense by the former possibly reflecting their higher saliency when visual experience is unavailable.

Disussion

Our study contributes to a better understanding of how sensory experience shapes ememotion recognition.

Direct reciprocity and reputation shape trust decisions similarly in blind and sighted individuals

This study addresses the effects of blindness on trust. Using an auditory version of the multi-round Trust Game, we investigated the effect of reputation and reciprocity on trust decisions in early blind and sighted participants. During each round of the game, participants were endowed with a sum of money and had to decide how much they wanted to invest in their partners, who were manipulated as a function of their good or bad reputation and individualistic or cooperative behavior. The data showed that negative first impression about the partner (bad reputation and/or selfish behavior) impacted more blind participants than sighted ones. However, following repeated interactions with the partners, the overall mean investment aligned between the blind and sighted groups. We interpret these findings as suggesting that blindness may guide participants to a more cautionary behavior when dealing with partners with negative initial characteristics.

Early visual deprivation disrupts the mental representation of numbers in visually impaired children

Several shreds of evidence indicate that visual deprivation does not alter numerical competence neither in adults nor in children. However, studies reporting non-impaired numerical abilities in the visually impaired population present some limitations: (a) they mainly assessed the ability to process numbers (e.g. mathematical competence) rather than represent numbers (e.g. mental number line); (b) they principally focused on positive rather than negative number estimates; (c) they investigated numerical abilities in adult individuals except one focusing on children (Crollen et al. in Cognition 210:104586, 2021). Overall, this could limit a comprehensive explanation of the role exerted by vision on numerical processing when vision is compromised. Here we investigated how congenital visual deprivation affects the ability to represent positive and negative numbers in horizontal and sagittal planes in visually impaired children (thirteen children with low vision, eight children with complete blindness, age range 6-15 years old). We adapted the number-to-position paradigm adopted by Crollen et al. (Cognition 210:104586, 2021), asking children to indicate the spatial position of positive and negative numbers on a graduated rule positioned horizontally or sagittally in the frontal plane. Results suggest that long-term visual deprivation alters the ability to identify the spatial position of numbers independently of the spatial plane and the number polarity. Moreover, results indicate that relying on poor visual acuity is detrimental for low vision children when asked to localize both positive and negative numbers in space, suggesting that visual experience might have a differential role in numerical processing depending on number polarity. Such findings add knowledge related to the impact of visual experience on numerical processing. Since both positive and negative numbers are fundamental aspects of learning mathematical principles, the outcomes of the present study inform about the need to implement early rehabilitation strategies to prevent the risk of numerical difficulties in visually impaired children.

How visual is the « number sense »? Insights from the blind

Is vision a necessary building block for the foundations of mathematical cognition? A straightforward model to test the causal role visual experience plays in the development of numerical abilities is to study people born without sight. In this review we will demonstrate that congenitally blind people can develop numerical abilities that equal or even surpass those of sighted individuals, despite representing numbers using a qualitatively different representational format. We will also show that numerical thinking in blind people maps onto regions typically involved in visuo-spatial processing in the sighted, highlighting how intrinsic computational biases may constrain the reorganization of numerical networks in case of early visual deprivation. More generally, we will illustrate how the study of arithmetic abilities in congenitally blind people represents a compelling model to understand how sensory experience scaffolds the development of higher-level cognitive representations.

Viewing of figurative paintings affects pseudoneglect as measured by line bisection

Neurologically intact individuals usually show a leftward bias in spatial attention, known as pseudoneglect, likely reflecting a right-hemisphere dominance in the control of spatial attention. A leftward bias also seems to manifest when individuals are asked to provide aesthetic judgments about visual stimuli, like artworks. However, whether artwork perception affects the allocation of spatial attention has never been directly investigated. Here, we assessed whether viewing figurative paintings affects hemispheric imbalance in the control of spatial attention by asking participants to bisect a series of lines presented on a grey background, on figurative paintings or on non-artistic photographs of real-world scenes, while either simply observing or explicitly evaluating each image. In line with previous evidence, participants showed a leftward bisection bias in the baseline condition, reflecting pseudoneglect. Critically, the presence of a painting in the background (irrespective of whether an aesthetic evaluation was required or not) significantly shifted the bias further to the left compared to when lines were bisected over a grey background (baseline) or a photographed scene. This finding suggests that perception of visual art may affect the control of spatial attention, possibly tapping on right-hemisphere resources related to visuospatial exploration, regardless of reward apprehension mechanisms (at least when images do not evoke strong emotional reactions leading to polarized like/dislike judgements).

The Effect of Blindness on Spatial Asymmetries

The human cerebral cortex is asymmetrically organized with hemispheric lateralization pervading nearly all neural systems of the brain. Whether the lack of normal visual development affects hemispheric specialization subserving the deployment of visuospatial attention asymmetries is controversial. In principle, indeed, the lack of early visual experience may affect the lateralization of spatial functions, and the blind may rely on a different sensory input compared to the sighted. In this review article, we thus present a current state-of-the-art synthesis of empirical evidence concerning the effects of visual deprivation on the lateralization of various spatial processes (i.e., including line bisection, mirror symmetry, and localization tasks). Overall, the evidence reviewed indicates that spatial processes are supported by a right hemispheric network in the blind, hence, analogously to the sighted. Such a right-hemisphere dominance, however, seems more accentuated in the blind as compared to the sighted as indexed by the greater leftward bias shown in different spatial tasks. This is possibly the result of the more pronounced involvement of the right parietal cortex during spatial tasks in blind individuals compared to the sighted, as well as of the additional recruitment of the right occipital cortex, which would reflect the cross-modal plastic phenomena that largely characterize the blind brain.

The left posterior cerebellum is involved in orienting attention along the mental number line: An online-TMS study

Although converging evidence suggests that the posterior cerebellum is involved in visuospatial functions and in the orienting of attention, a clear topography of cerebellar regions causally involved in the control of spatial attention is still missing. In this study, we aimed to shed light on this issue by using online neuronavigated transcranial magnetic stimulation (TMS) to temporarily interfere with posterior medial (Vermis lobule VII) and left lateral (Crus I/II) cerebellar activity during a task measuring visuospatial (landmark task, Experiment 1 and 2) and representational (number bisection task, Experiment 2) asymmetries in the orienting of attention. At baseline, participants showed attentional biases consistent with the literature, that is a leftward and upward bias with horizontal and vertical lines, respectively, and a leftward bias in number bisection. Critically, TMS over the left cerebellar hemisphere significantly counteracted pseudoneglect in the number bisection task, whilst not affecting attentional biases in the landmark task. In turn, TMS over the posterior vermis did not affect performance in either task. Taken together, our findings suggest that the left posterior cerebellar hemisphere (but not the posterior vermis) is a critical node of an extended brain network subtending the control of spatial attention, at least when attention needs to be allocated to an internal representational space and a certain degree of mental manipulation is required (as in the number bisection task).

The accuracy of auditory spatial judgments in the visually impaired is dependent on sound source distance

Blindness leads to substantial enhancements in many auditory abilities, and deficits in others. It is unknown how severe visual losses need to be before changes in auditory abilities occur, or whether the relationship between severity of visual loss and changes in auditory abilities is proportional and systematic. Here we show that greater severity of visual loss is associated with increased auditory judgments of distance and room size. On average participants with severe visual losses perceived sounds to be twice as far away, and rooms to be three times larger, than sighted controls. Distance estimates for sighted controls were most accurate for closer sounds and least accurate for farther sounds. As the severity of visual impairment increased, accuracy decreased for closer sounds and increased for farther sounds. However, it is for closer sounds that accurate judgments are needed to guide rapid motor responses to auditory events, e.g. planning a safe path through a busy street to avoid collisions with other people, and falls. Interestingly, greater visual impairment severity was associated with more accurate room size estimates. The results support a new hypothesis that crossmodal calibration of audition by vision depends on the severity of visual loss.

The Role of Binocular Vision in Driving Pseudoneglect in Visual and Haptic Bisection: Evidence From Strabismic and Monocular Blind Individuals

Prior studies have shown that strabismic amblyopes do not exhibit pseudoneglect in visual line bisection, suggesting that the right-hemisphere dominance in the control of spatial attention may depend on a normally developing binocular vision. In this study, we aimed to investigate whether an abnormal binocular childhood experience also affects spatial attention in the haptic modality, thus reflecting a supramodal effect. To this aim, we compared the performance of normally sighted, strabismic and early monocular blind participants in a visual and a haptic line bisection task. In visual line bisection, strabismic individuals tended to err to the right of the veridical midpoint, in contrast with normally sighted participants who showed pseudoneglect. Monocular blind participants exhibited high variability in their visual performance, with a tendency to bisect toward the direction of the functioning eye. In turn, in haptic bisection, all participants consistently erred towards the left of the veridical midpoint. Taken together, our findings support the view that pseudoneglect in the visual and haptic modality relies on different functional and neural mechanisms.

Spatial biases in deaf, blind, and deafblind individuals as revealed by a haptic line bisection task

In this study, we investigated whether auditory deprivation leads to a more balanced bilateral control of spatial attention in the haptic space. We tested four groups of participants: early deaf, early blind, deafblind, and control (normally hearing and sighted) participants. Using a haptic line bisection task, we found that while normally hearing individuals (even when blind) showed a significant tendency to bisect to the left of the veridical midpoint (i.e., pseudoneglect), deaf individuals did not show any significant directional bias. This was the case of both deaf signers and non-signers, in line with prior findings obtained using a visual line bisection task. Interestingly, deafblind individuals also erred significantly to the left, resembling the pattern of early blind and control participants. Overall, these data critically suggest that deafness induces changes in the hemispheric asymmetry subtending the orientation of spatial attention also in the haptic modality. Moreover, our findings indicate that what counterbalances the right-hemisphere dominance in the control of spatial attention is not the lack of auditory input per se, nor sign language use, but rather the heavier reliance on visual experience induced by early auditory deprivation.

The spatial representation of number, time, and serial order following sensory deprivation: A systematic review

The spatial representation of numerical and temporal information is thought to be rooted in our multisensory experiences. Accordingly, we may expect visual or auditory deprivation to affect the way we represent numerical magnitude and time spatially. Here, we systematically review recent findings on how blind and deaf individuals represent abstract concepts such as magnitude and time (e.g., past/future, serial order of events) in a spatial format. Interestingly, available evidence suggests that sensory deprivation does not prevent the spatial "re-mapping" of abstract information, but differences compared to normally sighted and hearing individuals may emerge depending on the specific dimension considered (i.e., numerical magnitude, time as past/future, serial order). Herein we discuss how the study of sensory deprived populations may shed light on the specific, and possibly distinct, mechanisms subserving the spatial representation of these concepts. Furthermore, we pinpoint unresolved issues that need to be addressed by future studies to grasp a full understanding of the spatial representation of abstract information associated with visual and auditory deprivation.

Emotion processing in early blind and sighted individuals

OBJECTIVE

Emotion processing is known to be mediated by a complex network of cortical and subcortical regions with evidence of specialized hemispheric lateralization within the brain. In light of prior evidence indicating that lateralization of cognitive functions (such as language) may depend on normal visual development, we investigated whether the lack of prior visual experience would have an impact on the development of specialized hemispheric lateralization in emotional processing.

METHOD

We addressed this issue by comparing performance in early blind and sighted controls on a dichotic listening task requiring the detection of specific emotional vocalizations (i.e., suggestive of happiness or sadness) presented independently to either ear.

RESULTS

Consistent with previous studies, we found that sighted individuals showed enhanced detection of positive vocalizations when presented in the right ear (i.e., processed within the left hemisphere) and negative vocalizations when presented in the left ear (i.e., right hemisphere). It is interesting to note that although blind individuals were as accurate as sighted controls in detecting the valance of the vocalization, performance was not consistent with any pattern of specialized hemispheric lateralization.

CONCLUSIONS

Overall, these results suggest that although the lack of prior visual experience may not lead to impaired emotion processing performance, the underlying neurophysiological substrate (i.e., degree of special hemispheric lateralization) may depend on normal visual development. (PsycINFO Database Record

Related but different: Examining pseudoneglect in audition, touch and vision

Although researchers have consistently demonstrated a leftward attentional bias in visual and representational (e.g. tactile/mental number line) line bisection tasks, the results from audition have been mixed. Differences in methodology between auditory and visual bisection tasks, especially with regards to the location of stimuli of peripersonal versus extrapersonal space, have also meant that researchers have not been able to compare performance in visual, tactile and auditory line bisection directly. In this research, 39 neurologically typical individuals participated in standard visual and tactile line bisection tasks, together with a newly developed auditory line bisection task. Results demonstrated significant leftward bisection biases across all three modalities. Hence, we demonstrate auditory pseudoneglect in peripersonal space for the first time. Tactile and auditory line bisections showed a relatively small but statistically reliable correlation, but neither task correlated with visual line bisection. This suggests that the processes underlying auditory line bisection are not synonymous to those involved in visual perceptual bisection, and further we argue that this bias may be related to representational pseudoneglect.

The effect of hand movements on numerical bisection judgments in early blind and sighted individuals

Recent evidence suggests that in representing numbers blind individuals might be affected differently by proprioceptive cues (e.g., hand positions, head turns) than are sighted individuals. In this study, we asked a group of early blind and sighted individuals to perform a numerical bisection task while executing hand movements in left or right peripersonal space and with either hand. We found that in bisecting ascending numerical intervals, the hemi-space in which the hand was moved (but not the moved hand itself) influenced the bisection bias similarly in both early blind and sighted participants. However, when numerical intervals were presented in descending order, the moved hand (and not the hemi-space in which it was moved) affected the bisection bias in all participants. Overall, our data show that the operation to be performed on the mental number line affects the activated spatial reference frame, regardless of participants' previous visual experience. In particular, both sighted and early blind individuals' representation of numerical magnitude is mainly rooted in world-centered coordinates when numerical information is given in canonical orientation (i.e., from small to large), whereas hand-centered coordinates become more relevant when the scanning of the mental number line proceeds in non-canonical direction.

Biases in spatial bisection induced by viewing male and female faces

Research on visual attention triggered by face gender is still relatively sparse. In the present study, three experiments are reported in which male and female participants were required to estimate the midpoint of a line (i.e., the "line bisection task"): at each end of the line a face was presented. Depending on the experimental condition, faces could be of the same gender (i.e., two males or two females) or the opposite gender. Experiments 1 and 2 converged in showing that when a male face was presented at the right and a female face at the left endpoint of the line, a clear rightward bias emerged compared to the other experimental conditions, indicating that male faces captured attention more than female faces. Importantly, male faces used across Experiments 1 and 2 were rated as more threatening than female faces, suggesting that perceived level of threat may have been responsible for the observed bias toward the male face. Experiment 3 corroborated this hypothesis by finding an attentional bias toward the male face with high threat (angry) faces but not with low threat (smiling) faces.

Spatial imagery relies on a sensory independent, though sensory sensitive, functional organization within the parietal cortex: a fMRI study of angle discrimination in sighted and congenitally blind individuals

Although vision offers distinctive information to space representation, individuals who lack vision since birth often show perceptual and representational skills comparable to those found in sighted individuals. However, congenitally blind individuals may result in impaired spatial analysis, when engaging in 'visual' spatial features (e.g., perspective or angle representation) or complex spatial mental abilities. In the present study, we measured behavioral and brain responses using functional magnetic resonance imaging in sighted and congenitally blind individuals during spatial imagery based on a modified version of the mental clock task (e.g., angle discrimination) and a simple recognition control condition, as conveyed across distinct sensory modalities: visual (sighted individuals only), tactile and auditory. Blind individuals were significantly less accurate during the auditory task, but comparable-to-sighted during the tactile task. As expected, both groups showed common neural activations in intraparietal and superior parietal regions across visual and non-visual spatial perception and imagery conditions, indicating the more abstract, sensory independent functional organization of these cortical areas, a property that we named supramodality. At the same time, however, comparisons in brain responses and functional connectivity patterns across experimental conditions demonstrated also a functional lateralization, in a way that correlated with the distinct behavioral performance in blind and sighted individuals. Specifically, blind individuals relied more on right parietal regions, mainly in the tactile and less in the auditory spatial processing. In sighted, spatial representation across modalities relied more on left parietal regions. In conclusions, intraparietal and superior parietal regions subserve supramodal spatial representations in sighted and congenitally blind individuals. Differences in their recruitment across non-visual spatial processing in sighted and blind individuals may be related to distinctive behavioral performance and/or mental strategies adopted when they deal with the same spatial representation as conveyed through different sensory modalities.

Spatial Associations in Numerical Cognition—From Single Digits to Arithmetic

The literature on spatial associations during number processing is dominated by the SNARC (spatial–numerical association of response codes) effect. We describe spatial biases found for single digits and pairs of numbers, first in the “original” speeded parity task and then extending the scope to encompass different tasks, a range of measures, and various populations. Then we review theoretical accounts before surveying the emerging evidence for similar spatial associations during mental arithmetic. We conclude that the mental number line hypothesis and an embodied approach are useful frameworks for further studies.

Representational pseudoneglect: a review

Pseudoneglect, the tendency to be biased towards the left-hand side of space, is a robust and consistent behavioural observation best demonstrated on the task of visuospatial line bisection, where participants are asked to centrally bisect visually presented horizontal lines at the perceived centre. A number of studies have revealed that a representational form of pseudoneglect exists, occurring when participants are asked to either mentally represent a stimulus or explore a stimulus using touch in the complete absence of direct visuospatial processing. Despite the growing number of studies that have demonstrated representational pseudoneglect there exists no current and comprehensive review of these findings and no discussion of a theoretical framework into which these findings may fall. An important gap in the current representational pseudoneglect literature is a discussion of the developmental trajectory of the bias. The focus of the current review is to outline studies that have observed representational pseudoneglect in healthy participants, consider a theoretical framework for these observations, and address the impact of lifespan factors such as cognitive ageing on the phenomenon.

Different effects of numerical magnitude on visual and proprioceptive reference frames

This study assessed whether numerical magnitude affects the setting of basic spatial coordinates and reference frames, namely the subjective straight ahead. Three tasks were given to 24 right-handed healthy participants: a proprioceptive and a visuo-proprioceptive task, requiring pointing to the subjective straight ahead, and a visual task, requiring a perceptual judgment about the straight ahead position of a light moving left-to-right, or right-to-left. A control task, requiring the bisection of rods of different lengths, was also given. The four tasks were performed under conditions of passive auditory numerical (i.e., listening to small, “2,” and large, “8,” numbers), and neutral auditory-verbal (“blah”) stimulation. Numerical magnitude modulated the participants’ deviations in the visual straight ahead task, when the movement of the light was from left-to-right, with the small number bringing about a leftward deviation, the large number a rightward deviation. A similar directional modulation was found in the rod bisection task, in line with previous evidence. No effects of numerical magnitude were found on the proprioceptive and visuo-proprioceptive straight ahead tasks. These results suggest that the spatial effects induced by the activation of the mental number line extend to an egocentric frame of reference but only when a portion of horizontal space has to be “actively” explored.

Numbers reorient visuo-spatial attention during cancellation tasks

Numbers induce shifts of spatial attention on the left or the right sides of external space as a function of their magnitude. However, whether this number-space association is restricted to the linear horizontal extensions, or extends to the whole visual scene, is still an open question. This study investigates, by means of a cancellation paradigm, the influence of numerical magnitude during scanning tasks in which participants freely explore complex visual scenes unconstrained towards either the horizontal or the vertical unidimensional axes. Five cancellation tasks were adapted in which Arabic digits were used as targets or distracters, in structured (lines and columns) or unstructured visual displays, with a smaller (2 or 3 types of distracters) or larger (10 or more types of distracters) sets of stimuli. Results show that the participants' hits distribution was a function of number magnitude: shifted on the left for small and on the right for large numbers. This effect was maximised when numerical cues were sparse, randomly arranged and, critically, irrelevant to the task. Overall, this study provides novel evidence from visuo-spatial exploratory cancellation tasks for an attentional shift induced by number magnitude.

Touching base: The effect of participant and stimulus modulation factors on a haptic line bisection task

Acquiring information about our environment through touch is vital in everyday life. Yet very little literature exists about factors that may influence haptic or tactile processing. Recent neuroimaging studies have reported haptic laterality effects that parallel those reported in the visual literature. With the use of a haptic variant of the classical line bisection task, the present study aimed to determine the presence of laterality effects on a behavioural level. Specifically, three handedness groups including strong dextrals, strong sinistrals, and-the to-date largely neglected group of-mixed-handers were examined in their ability to accurately bisect stimuli constructed from corrugated board strips of various lengths. Stimulus factors known to play a role in visuospatial perception including stimulus location, the hand used for bisection, and direction of exploration were systematically varied through pseudo-randomisation. Similar to the visual domain, stimulus location and length as well as participants' handedness and the hand used for bisection exerted a significant influence on participants' estimate of the centre of haptically explored stimuli. However, these effects differed qualitatively from those described for the visual domain, and the factor direction of exploration did not exert any significant effect. This indicates that laterality effects reported on a neural level are sufficiently pronounced to result in measurable behavioural effects. The results, first, add to laterality effects reported for the visual and auditory domain, second, are in line with supramodal spatial processing and third, provide additional evidence to a conceptualisation of pseudoneglect and neglect as signs of hemispheric attentional asymmetries.

Number magnitude to finger mapping is disembodied and topological

It has been shown that humans associate fingers with numbers because finger counting strategies interact with numerical judgements. At the same time, there is evidence that there is a relation between number magnitude and space as small to large numbers seem to be represented from left to right. In the present study, we investigated whether number magnitude to finger mapping is embodied (related to the order of fingers on the hand) or disembodied (spatial). We let healthy human volunteers name random numbers between 1 and 30, while simultaneously tapping a random finger. Either the hands were placed directly next to each other, 30 cm apart, or the hands were crossed such that the left hand was on the right side of the body mid-line. The results show that naming a smaller number than the previous one was associated with tapping a finger to the left of the previously tapped finger. This shows that there is a spatial (disembodied) mapping between number magnitude and fingers. Furthermore, we show that this mapping is topological rather than metrically scaled.

Tapping effects on numerical bisection

Numerical magnitude is believed to be represented along a mental number line (MNL), and there is evidence to suggest that the activation of the MNL affects the perception and representation of external space. In the present study, we investigated whether a spatial motor task affects numerical processing in the auditory modality. Blindfolded participants were presented with a numerical interval bisection task, while performing a tapping task with either their left or right hand, either in the fronto-central, fronto-left, or fronto-right peripersonal space. Results showed that tapping significantly influenced the participants' numerical bisection, with tapping in the left side of space increasing the original tendency to err leftward, and tapping to the right reducing such bias. Importantly, the effect depended on the side of space in which the tapping activity was performed, regardless of which hand was used. Tapping with either the left or right hand in the fronto-central space did not affect the participants' bias. These findings offer novel support for the existence of bidirectional interactions between external and internal representations of space.