Visual size perception and haptic calibration during development

Correctly establishing evidence for cue combination via gains in sensory precision: Why the choice of comparator matters

Studying how sensory signals from different sources (sensory cues) are integrated within or across multiple senses allows us to better understand the perceptual computations that lie at the foundation of adaptive behaviour. As such, determining the presence of precision gains - the classic hallmark of cue combination - is important for characterising perceptual systems, their development and functioning in clinical conditions. However, empirically measuring precision gains to distinguish cue combination from alternative perceptual strategies requires careful methodological considerations. Here, we note that the majority of existing studies that tested for cue combination either omitted this important contrast, or used an analysis approach that, unknowingly, strongly inflated false positives. Using simulations, we demonstrate that this approach enhances the chances of finding significant cue combination effects in up to 100% of cases, even when cues are not combined. We establish how this error arises when the wrong cue comparator is chosen and recommend an alternative analysis that is easy to implement but has only been adopted by relatively few studies. By comparing combined-cue perceptual precision with the best single-cue precision, determined for each observer individually rather than at the group level, researchers can enhance the credibility of their reported effects. We also note that testing for deviations from optimal predictions alone is not sufficient to ascertain whether cues are combined. Taken together, to correctly test for perceptual precision gains, we advocate for a careful comparator selection and task design to ensure that cue combination is tested with maximum power, while reducing the inflation of false positives.

The effect of visuo-haptic exploration on the development of the geometric cross-sectioning ability

Cross-sectioning is a shape understanding task where the participants must infer and interpret the spatial features of three-dimensional (3D) solids by depicting their internal two-dimensional (2D) arrangement. An increasing body of research provides evidence of the crucial role of sensorimotor experience in acquiring these complex geometrical concepts. Here, we focused on how cross-sectioning ability emerges in young children and the influence of multisensory visuo-haptic experience in geometrical learning through two experiments. In Experiment 1, we compared the 3D printed version of the Santa Barbara Solids Test (SBST) with its classical paper version; in Experiment 2, we contrasted the children's performance in the SBST before and after the visual or visuo-haptic experience. In Experiment 1, we did not identify an advantage in visualizing 3D shapes over the classical 2D paper test. In contrast, in Experiment 2, we found that children who had the experience of a combination of visual and tactile information during the exploration phase improved their performance in the SBST compared with children who were limited to visual exploration. Our study demonstrates how practicing novel multisensory strategies improves children's understanding of complex geometrical concepts. This outcome highlights the importance of introducing multisensory experience in educational training and the need to make way for developing new technologies that could improve learning abilities in children.

Cortical signatures of visual body representation develop in human infancy

Human infants cannot report their experiences, limiting what we can learn about their bodily awareness. However, visual cortical responses to the body, linked to visual awareness and selective attention in adults, can be easily measured in infants and provide a promising marker of bodily awareness in early life. We presented 4- and 8-month-old infants with a flickering (7.5 Hz) video of a hand being stroked and recorded steady-state visual evoked potentials (SSVEPs). In half of the trials, the infants also received tactile stroking synchronously with visual stroking. The 8-month-old, but not the 4-month-old infants, showed a significant enhancement of SSVEP responses when they received tactile stimulation concurrent with the visually observed stroking. Follow-up experiments showed that this enhancement did not occur when the visual hand was presented in an incompatible posture with the infant's own body or when the visual stimulus was a body-irrelevant video. Our findings provide a novel insight into the development of bodily self-awareness in the first year of life.

Spatial Memory and Blindness: The Role of Visual Loss on the Exploration and Memorization of Spatialized Sounds

Spatial memory relies on encoding, storing, and retrieval of knowledge about objects’ positions in their surrounding environment. Blind people have to rely on sensory modalities other than vision to memorize items that are spatially displaced, however, to date, very little is known about the influence of early visual deprivation on a person’s ability to remember and process sound locations. To fill this gap, we tested sighted and congenitally blind adults and adolescents in an audio-spatial memory task inspired by the classical card game “Memory.” In this research, subjects (blind, n = 12; sighted, n = 12) had to find pairs among sounds (i.e., animal calls) displaced on an audio-tactile device composed of loudspeakers covered by tactile sensors. To accomplish this task, participants had to remember the spatialized sounds’ position and develop a proper mental spatial representation of their locations. The test was divided into two experimental conditions of increasing difficulty dependent on the number of sounds to be remembered (8 vs. 24). Results showed that sighted participants outperformed blind participants in both conditions. Findings were discussed considering the crucial role of visual experience in properly manipulating auditory spatial representations, particularly in relation to the ability to explore complex acoustic configurations.

Multisensory Perception and Learning: Linking Pedagogy, Psychophysics, and Human–Computer Interaction

In this review, we discuss how specific sensory channels can mediate the learning of properties of the environment. In recent years, schools have increasingly been using multisensory technology for teaching. However, it still needs to be sufficiently grounded in neuroscientific and pedagogical evidence. Researchers have recently renewed understanding around the role of communication between sensory modalities during development. In the current review, we outline four principles that will aid technological development based on theoretical models of multisensory development and embodiment to foster in-depth, perceptual, and conceptual learning of mathematics. We also discuss how a multidisciplinary approach offers a unique contribution to development of new practical solutions for learning in school. Scientists, engineers, and pedagogical experts offer their interdisciplinary points of view on this topic. At the end of the review, we present our results, showing that one can use multiple sensory inputs and sensorimotor associations in multisensory technology to improve the discrimination of angles, but also possibly for educational purposes. Finally, we present an application, the ‘RobotAngle’ developed for primary (i.e., elementary) school children, which uses sounds and body movements to learn about angles.

Supervised Multisensory Calibration Signals Are Evident in VIP But Not MSTd

Multisensory plasticity enables our senses to dynamically adapt to each other and the external environment, a fundamental operation that our brain performs continuously. We searched for neural correlates of adult multisensory plasticity in the dorsal medial superior temporal area (MSTd) and the ventral intraparietal area (VIP) in 2 male rhesus macaques using a paradigm of supervised calibration. We report little plasticity in neural responses in the relatively low-level multisensory cortical area MSTd. In contrast, neural correlates of plasticity are found in higher-level multisensory VIP, an area with strong decision-related activity. Accordingly, we observed systematic shifts of VIP tuning curves, which were reflected in the choice-related component of the population response. This is the first demonstration of neuronal calibration, together with behavioral calibration, in single sessions. These results lay the foundation for understanding multisensory neural plasticity, applicable broadly to maintaining accuracy for sensorimotor tasks.SIGNIFICANCE STATEMENT Multisensory plasticity is a fundamental and continual function of the brain that enables our senses to adapt dynamically to each other and to the external environment. Yet, very little is known about the neuronal mechanisms of multisensory plasticity. In this study, we searched for neural correlates of adult multisensory plasticity in the dorsal medial superior temporal area (MSTd) and the ventral intraparietal area (VIP) using a paradigm of supervised calibration. We found little plasticity in neural responses in the relatively low-level multisensory cortical area MSTd. By contrast, neural correlates of plasticity were found in VIP, a higher-level multisensory area with strong decision-related activity. This is the first demonstration of neuronal calibration, together with behavioral calibration, in single sessions.

The Body across the Lifespan: On the Relation between Interoceptive Sensibility and High-Order Body Representations

Background: Interoceptive information plays a pivotal role in building higher-order cognitive body representations (BR) that neuropsychological and neuroimaging evidence classifies as action-oriented (i.e., body schema) or non-action-oriented (i.e., visuo-spatial body map). This study aimed to explore the development of BR, considering the association with the interoceptive sensibility throughout the lifespan. Methods: Two hundred thirty-nine healthy participants divided into five age groups (7 to 8 years; 9 to 10 years; 18 to 40 years; 41 to 60 years; over 60 years) completed a self-report measure of interoceptive sensibility (the Self-Awareness Questionnaire; SAQ) and were given tasks assessing the two BR (action-oriented: hand laterality task; non-action-oriented: frontal body evocation task). Results: Both children (7–8 and 9–10 years) and older adults (over 60 years) performed worse than young (18–40 years) and middle-aged adults (41–60 years) in action- and non-action-oriented BR tasks. Moderation analyses showed that the SAQ score significantly moderated the relationship between age and action-oriented BR. Conclusions: The current results are consistent with inverted U-shaped developmental curves for action- and non-action-oriented BR. As an innovative aspect, the ability to mentally represent one’s own body parts in diverse states could be negatively affected by higher interoceptive sensibility levels in childhood and late adulthood.

Size-Distance Scaling With Absolute and Relative Auditory Distance Information

In the dynamic 3D space, it is critical for survival to perceive size of an object and rescale it with distance from an observer. Humans can perceive distance via not only vision but also audition, which plays an important role in the localization of objects, especially in visually ambiguous environments. However, whether and how auditory distance information contributes to visual size perception is not well understood. To address this issue, we investigated the efficiency of size-distance scaling by using auditory distance information that was conveyed by binaurally recorded auditory stimuli. We examined the effects of absolute distance information of a single sound sequence (Experiment 1) and relative distance information between two sound sequences (Experiment 2) on visual size estimation performances in darkened and well-lit environments. We demonstrated that humans could perform size-distance disambiguation by using auditory distance information even in darkness. Curiously, relative distance information was more efficient in size-distance scaling than absolute distance information, suggesting a high reliance on relative auditory distance information in our visual spatial experiences. The results highlight a benefit of audiovisual interaction for size-distance processing and calibration of external events under visually degraded situations.

Temporal representation impairment in developmental dyslexia for unisensory and multisensory stimuli

Dyslexia has been associated with a problem in visual-audio integration mechanisms. Here, we investigate for the first time the contribution of unisensory cues on multisensory audio and visual integration in 32 dyslexic children by modelling results using the Bayesian approach. Non-linguistic stimuli were used. Children performed a temporal task: they had to report whether the middle of three stimuli was closer in time to the first one or to the last one presented. Children with dyslexia, compared with typical children, exhibited poorer unimodal thresholds, requiring greater temporal distance between items for correct judgements, while multisensory thresholds were well predicted by the Bayesian model. This result suggests that the multisensory deficit in dyslexia is due to impaired audio and visual inputs rather than impaired multisensory processing per se. We also observed that poorer temporal skills correlated with lower reading skills in dyslexic children, suggesting that this temporal capability can be linked to reading abilities.

Development of visual perception of others' actions: Children's judgment of lifted weight

Humans are excellent at perceiving different features of the actions performed by others. For instance, by viewing someone else manipulating an unknown object, one can infer its weight–an intrinsic feature otherwise not directly accessible through vision. How such perceptual skill develops during childhood remains unclear. To confront this gap, the current study had children (N:63, 6–10 years old) and adults (N:21) judge the weight of objects after observing videos of an actor lifting them. Although 6-year-olds could already discriminate different weights, judgment accuracy had not reached adult-like levels by 10 years of age. Additionally, children’s stature was a more reliable predictor of their ability to read others’ actions than was their chronological age. This paper discusses the results in light of a potential link between motor development and action perception.

Hand size underestimation grows during childhood

Cortical body size representations are distorted in the adult, from low-level motor and sensory maps to higher levels multisensory and cognitive representations. Little is known about how such representations are built and evolve during infancy and childhood. Here we investigated how hand size is represented in typically developing children aged 6 to 10. Participants were asked to estimate their hand size using two different sensory modalities (visual or haptic). We found a distortion (underestimation) already present in the youngest children. Crucially, such distortion increases with age and regardless of the sensory modality used to access the representation. Finally, underestimation is specific for the body as no bias was found for object estimation. This study suggests that the brain does not keep up with the natural body growth. However, since motor behavior nor perception were impaired, the distortion seems functional and/or compensated for, for proper interaction with the external environment.

Coarse to Fine Audio-Visual Size Correspondences Develop During Primary School Age

Developmental studies have shown that children can associate visual size with non-visual and apparently unrelated stimuli, such as pure tone frequencies. Most research to date has focused on audio-visual size associations by showing that children can associate low pure tone frequencies with large objects, and high pure tone frequencies with small objects. Researchers relate these findings to coarser association, i.e., less precise associations for which binary categories of stimuli are used such as in the case of low versus high frequencies and large versus small visual stimuli. This study investigates how finer, more precise, crossmodal audio-visual associations develop during primary school age (from 6 to 11 years old). To unveil such patterns, we took advantage of a range of auditory pure tones and tested how primary school children match sounds with visually presented shapes. We tested 66 children (6-11 years old) in an audio-visual matching task involving a range of pure tone frequencies. Visual stimuli were circles or angles of different sizes. We asked participants to indicate the shape matching the sound. All children associated large objects/angles with low pitch, and small objects/angles with high pitch sounds. Interestingly, older children made greater use of intermediate visual sizes to provide their responses. Indeed, audio-visual associations for finer differences between stimulus features such as size and pure tone frequencies, may develop later depending on the maturation of supramodal size perception processes. Considering our results, we suggest that audio-visual size correspondences can be used for educational purposes by aiding the discrimination of sizes, including angles of different aperture. Moreover, their use should be shaped according to children's specific developmental stage.

The Role of Visual Experience in Auditory Space Perception around the Legs

It is widely accepted that vision plays a key role in the development of spatial skills of the other senses. Recent works have shown that blindness is often associated with auditory spatial deficits. The majority of previous studies have focused on understanding the representation of the upper frontal body space where vision and actions have a central role in mapping the space, however less research has investigated the back space and the space around the legs. Here we investigate space perception around the legs and the role of previous visual experience, by studying sighted and blind participants in an audio localization task (front-back discrimination). Participants judged if a sound was delivered in their frontal or back space. The results showed that blindfolded sighted participants were more accurate than blind participants in the frontal space. However, both groups were similarly accurate when auditory information was delivered in the back space. Blind individuals performed the task with similar accuracy for sounds delivered in the frontal and back space, while sighted people performed better in the frontal space. These results suggest that visual experience influences auditory spatial representations around the legs. Moreover, these results suggest that hearing and vision play different roles in different spaces.

Discovering the sense of touch: protocol for a randomised controlled trial examining the efficacy of a somatosensory discrimination intervention for children with hemiplegic cerebral palsy

BACKGROUND

Of children with hemiplegic cerebral palsy, 75% have impaired somatosensory function, which contributes to learned non-use of the affected upper limb. Currently, motor learning approaches are used to improve upper-limb motor skills in these children, but few studies have examined the effect of any intervention to ameliorate somatosensory impairments. Recently, Sense© training was piloted with a paediatric sample, seven children with hemiplegic cerebral palsy, demonstrating statistically and clinically significant change in limb position sense, goal performance and bimanual hand-use. This paper describes a protocol for a Randomised Controlled Trial of Sense© for Kids training, hypothesising that its receipt will improve somatosensory discrimination ability more than placebo (dose-matched Goal Directed Therapy via Home Program). Secondary hypotheses include that it will alter brain activation in somatosensory processing regions, white-matter characteristics of the thalamocortical tracts and improve bimanual function, activity and participation more than Goal Directed Training via Home Program.

METHODS AND DESIGN

This is a single blind, randomised matched-pair, placebo-controlled trial. Participants will be aged 6-15 years with a confirmed description of hemiplegic cerebral palsy and somatosensory discrimination impairment, as measured by the sense©_assess Kids. Participants will be randomly allocated to receive 3h a week for 6 weeks of either Sense© for Kids or Goal Directed Therapy via Home Program. Children will be matched on age and severity of somatosensory discrimination impairment. The primary outcome will be somatosensory discrimination ability, measured by sense©_assess Kids score. Secondary outcomes will include degree of brain activation in response to a somatosensory task measured by functional MRI, changes in the white matter of the thalamocortical tract measured by diffusion MRI, bimanual motor function, activity and participation.

DISCUSSION

This study will assess the efficacy of an intervention to increase somatosensory discrimination ability in children with cerebral palsy. It will explore clinically important questions about the efficacy of intervening in somatosensation impairment to improve bimanual motor function, compared with focusing on motor impairment directly, and whether focusing on motor impairment alone can affect somatosensory ability.

TRIAL REGISTRATION

This trial is registered with the Australian New Zealand Clinical Trials Registry, registration number: ACTRN12618000348257. World Health Organisation universal trial number: U1111-1210-1726.

The State of the Science on Sensory Factors and Their Impact on Daily Life for Children: A Scoping Review

The objective of this study was to identify and synthesize research about how sensory factors affect daily life of children. We designed a conceptual model to guide a scoping review of research published from 2005 to October 2014 (10 years). We searched MEDLINE, CINAHL, and PsycINFO and included studies about sensory perception/processing; children, adolescents/young adults; and participation. We excluded studies about animals, adults, and review articles. Our process resulted in 261 articles meeting criteria. Research shows that children with conditions process sensory input differently than peers. Neuroscience evidence supports the relationship between sensory-related behaviors and brain activity. Studies suggest that sensory processing is linked to social participation, cognition, temperament, and participation. Intervention research illustrates the importance of contextually relevant practices. Future work can examine the developmental course of sensory processing aspects of behavior across the general population and focus on interventions that support children's sensory processing as they participate in their daily lives.

Multisensory Perception of Contradictory Information in an Environment of Varying Reliability: Evidence for Conscious Perception and Optimal Causal Inference

Two psychophysical experiments examined multisensory integration of visual-auditory (Experiment 1) and visual-tactile-auditory (Experiment 2) signals. Participants judged the location of these multimodal signals relative to a standard presented at the median plane of the body. A cue conflict was induced by presenting the visual signals with a constant spatial discrepancy to the other modalities. Extending previous studies, the reliability of certain modalities (visual in Experiment 1, visual and tactile in Experiment 2) was varied from trial to trial by presenting signals with either strong or weak location information (e.g., a relatively dense or dispersed dot cloud as visual stimulus). We investigated how participants would adapt to the cue conflict from the contradictory information under these varying reliability conditions and whether participants had insight to their performance. During the course of both experiments, participants switched from an integration strategy to a selection strategy in Experiment 1 and to a calibration strategy in Experiment 2. Simulations of various multisensory perception strategies proposed that optimal causal inference in a varying reliability environment not only depends on the amount of multimodal discrepancy, but also on the relative reliability of stimuli across the reliability conditions.

Incidental learning in a multisensory environment across childhood

Multisensory information has been shown to modulate attention in infants and facilitate learning in adults, by enhancing the amodal properties of a stimulus. However, it remains unclear whether this translates to learning in a multisensory environment across middle childhood, and particularly in the case of incidental learning. One hundred and eighty‐one children aged between 6 and 10 years participated in this study using a novel Multisensory Attention Learning Task (MALT). Participants were asked to respond to the presence of a target stimulus whilst ignoring distractors. Correct target selection resulted in the movement of the target exemplar to either the upper left or right screen quadrant, according to category membership. Category membership was defined either by visual‐only, auditory‐only or multisensory information. As early as 6 years of age, children demonstrated greater performance on the incidental categorization task following exposure to multisensory audiovisual cues compared to unisensory information. These findings provide important insight into the use of multisensory information in learning, and particularly on incidental category learning. Implications for the deployment of multisensory learning tasks within education across development will be discussed.

The Development of Tactile Perception

Touch is the first of our senses to develop, providing us with the sensory scaffold on which we come to perceive our own bodies and our sense of self. Touch also provides us with direct access to the external world of physical objects, via haptic exploration. Furthermore, a recent area of interest in tactile research across studies of developing children and adults is its social function, mediating interpersonal bonding. Although there are a range of demonstrations of early competence with touch, particularly in the domain of haptics, the review presented here indicates that many of the tactile perceptual skills that we take for granted as adults (e.g., perceiving touches in the external world as well as on the body) take some time to develop in the first months of postnatal life, likely as a result of an extended process of connection with other sense modalities which provide new kinds of information from birth (e.g., vision and audition). Here, we argue that because touch is of such fundamental importance across a wide range of social and cognitive domains, it should be placed much more centrally in the study of early perceptual development than it currently is.

Does somatosensation change with age in children and adolescents? A systematic review

BACKGROUND

Somatosensory modalities, such as touch, proprioception and haptic ability, greatly influence the achievement of developmental milestones for children. Describing somatosensory impairment, natural variability and typical or expected developmental changes across age groups will help establish frameworks for intervention in clinical populations. This systematic review aimed to determine how different somatosensory modalities develop across childhood into adolescence to use as a point of reference for children at risk of somatosensory impairment.

METHODS

Searches of five electronic databases were undertaken through EBSCO-host (MEDLINE, CINAHL, PsycINFO, SPORTDiscus and ERIC) for studies measuring at least one somatosensory modality in typically developing individuals between birth and 18 years and analysed by age. Characteristics of studies were collected including country of origin, sample size, demographics and outcome measure used. Quality assessment and data extraction were performed by two independent reviewers.

RESULTS

Twenty three cross-sectional studies were included from a total of 188 articles retrieved: 8 examined aspects of touch, 5 proprioception and 10 haptic ability. Variability of study designs and variation in assessment tools precluded any formal meta-analysis.

CONCLUSIONS

Somatosensation matures through childhood into adolescence; however, the present review found the pattern of somatosensory development varied depending on the assessment tool used and the aspect of somatosensation being measured, making it difficult to describe typical performance. There is a need for comprehensive assessment batteries to measure the somatosensation, including touch, proprioception and haptic ability, of children at risk of somatosensory impairment to aid in the development of effective interventions.

Cognitive robots in the development and rehabilitation of children with developmental disorders

Cognitive robots constitute a highly interdisciplinary approach to the issue of therapy of children with developmental disorders. Cognitive robots become more popular, especially in action and language integration areas, joining the experience of psychologists, neuroscientists, philosophers, and even engineers. The concept of a robot as a cognitive companion for humans may be very useful. The interaction between humans and cognitive robots may be a mediator of movement patterns, learning behaviors from demonstrations, group activities, and social behaviors, as far as higher-order concepts such as symbol manipulation capabilities, words acquisition, and sensorimotor knowledge organization. Moreover there is an occupation to check many theories, such as transferring the knowledge and skills between humans and robots. Although several robotic solutions for children have been proposed the diffusion of aforementioned ideas is still limited. The review summarizes the current and future role of cognitive robots in the development and rehabilitation of children with developmental disorders.

Task-dependent calibration of auditory spatial perception through environmental visual observation

Visual information is paramount to space perception. Vision influences auditory space estimation. Many studies show that simultaneous visual and auditory cues improve precision of the final multisensory estimate. However, the amount or the temporal extent of visual information, that is sufficient to influence auditory perception, is still unknown. It is therefore interesting to know if vision can improve auditory precision through a short-term environmental observation preceding the audio task and whether this influence is task-specific or environment-specific or both. To test these issues we investigate possible improvements of acoustic precision with sighted blindfolded participants in two audio tasks [minimum audible angle (MAA) and space bisection] and two acoustically different environments (normal room and anechoic room). With respect to a baseline of auditory precision, we found an improvement of precision in the space bisection task but not in the MAA after the observation of a normal room. No improvement was found when performing the same task in an anechoic chamber. In addition, no difference was found between a condition of short environment observation and a condition of full vision during the whole experimental session. Our results suggest that even short-term environmental observation can calibrate auditory spatial performance. They also suggest that echoes can be the cue that underpins visual calibration. Echoes may mediate the transfer of information from the visual to the auditory system.

Development of multisensory integration from the perspective of the individual neuron

The ability to use cues from multiple senses in concert is a fundamental aspect of brain function. It maximizes the brain’s use of the information available to it at any given moment and enhances the physiological salience of external events. Because each sense conveys a unique perspective of the external world, synthesizing information across senses affords computational benefits that cannot otherwise be achieved. Multisensory integration not only has substantial survival value but can also create unique experiences that emerge when signals from different sensory channels are bound together. However, neurons in a newborn’s brain are not capable of multisensory integration, and studies in the midbrain have shown that the development of this process is not predetermined. Rather, its emergence and maturation critically depend on cross-modal experiences that alter the underlying neural circuit in such a way that optimizes multisensory integrative capabilities for the environment in which the animal will function.

Models and processes of multisensory cue combination

Fundamental to our perception of a unified and stable environment is the capacity to combine information across the senses. Although this process appears seamless as an adult, the brain's ability to successfully perform multisensory cue combination takes years to develop and relies on a number of complex processes including cue integration, cue calibration, causal inference, and reference frame transformations. Further complexities exist because multisensory cue combination is implemented across time by populations of noisy neurons. In this review, we discuss recent behavioral studies exploring how the brain combines information from different sensory systems, neurophysiological studies relating behavior to neuronal activity, and a theory of neural sensory encoding that can account for many of these experimental findings.

Supervised calibration relies on the multisensory percept

Multisensory plasticity enables us to dynamically adapt sensory cues to one another and to the environment. Without external feedback, "unsupervised" multisensory calibration reduces cue conflict in a manner largely independent of cue reliability. But environmental feedback regarding cue accuracy ("supervised") also affects calibration. Here we measured the combined influence of cue accuracy and cue reliability on supervised multisensory calibration, using discrepant visual and vestibular motion stimuli. When the less reliable cue was inaccurate, it alone got calibrated. However, when the more reliable cue was inaccurate, cues were yoked and calibrated together in the same direction. Strikingly, the less reliable cue shifted away from external feedback, becoming less accurate. A computational model in which supervised and unsupervised calibration work in parallel, where the former only relies on the multisensory percept, but the latter can calibrate cues individually, accounts for the observed behavior. In combination, they could ultimately achieve the optimal solution of both external accuracy and internal consistency.