Children do not recalibrate motor-sensory temporal order after exposure to delayed sensory feedback

The temporal context in bayesian models of interval timing: Recent advances and future directions

Sensory perception, motor control, and cognition necessitate reliable timing in the range of milliseconds to seconds, which implies the existence of a highly accurate timing system. Yet, partly owing to the fact that temporal processing is modulated by contextual factors, perceived time is not isomorphic to physical time. Temporal estimates exhibit regression to the mean of an interval distribution (global context) and are also affected by preceding trials (local context). Recent Bayesian models of interval timing have provided important insights regarding these observations, but questions remain as to how exposure to past intervals shapes perceived time. In this article, we provide a brief overview of Bayesian models of interval timing and their contribution to current understanding of context effects. We then proceed to highlight recent developments in the field concerning precision weighting of Bayesian evidence in both healthy timing and disease and the neurophysiological and neurochemical signatures of timing prediction errors. We further aim to bring attention to current outstanding questions for Bayesian models of interval timing, such as the likelihood conceptualization. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Multisensory Perception and Learning: Linking Pedagogy, Psychophysics, and Human–Computer Interaction

In this review, we discuss how specific sensory channels can mediate the learning of properties of the environment. In recent years, schools have increasingly been using multisensory technology for teaching. However, it still needs to be sufficiently grounded in neuroscientific and pedagogical evidence. Researchers have recently renewed understanding around the role of communication between sensory modalities during development. In the current review, we outline four principles that will aid technological development based on theoretical models of multisensory development and embodiment to foster in-depth, perceptual, and conceptual learning of mathematics. We also discuss how a multidisciplinary approach offers a unique contribution to development of new practical solutions for learning in school. Scientists, engineers, and pedagogical experts offer their interdisciplinary points of view on this topic. At the end of the review, we present our results, showing that one can use multiple sensory inputs and sensorimotor associations in multisensory technology to improve the discrimination of angles, but also possibly for educational purposes. Finally, we present an application, the ‘RobotAngle’ developed for primary (i.e., elementary) school children, which uses sounds and body movements to learn about angles.

The Role of Awareness on Motor-Sensory Temporal Recalibration

Temporal recalibration (TR) may arise to realign asynchronous stimuli after exposure to a short, constant delay between voluntary movement and sensory stimulus. The objective of this study was to determine if awareness of the temporal lag between a motor response (i.e., a keypress) and a sensory event (i.e., a visual flash) is necessary for TR to occur. We further investigated whether manipulating the required motor and perceptual judgment tasks modified the influence of awareness on TR. Participants (n = 48) were randomly divided between two groups (Group 1: Aware and Group 2: Unaware). The Aware group was told of the temporal lag between their keypress and visual flash at the beginning of the experiment, whereas the Unaware group was not. All participants completed eight blocks of trials, in which the motor task (single or repetitive tap), perceptual judgment task (judging the temporal order of the keypress in relation to the visual flash or judging whether the two stimuli were simultaneous or not), and fixed temporal lag between keypress and visual flash (0 or 100 ms) varied. TR was determined by comparing judgments between corresponding blocks of trials in which the temporal lag was 0 or 100 ms. Results revealed that both the Aware and Unaware groups demonstrated a similar magnitude of TR across all motor and perceptual judgment tasks, such that the magnitude of TR did not vary between Aware and Unaware participants. These results suggest that awareness of a temporal lag does not influence the magnitude of TR achieved and that motor and perceptual judgment task demands do not modulate the influence of awareness on TR.

Stronger saccadic suppression of displacement and blanking effect in children

Humans do not notice small displacements to objects that occur during saccades, termed saccadic suppression of displacement (SSD), and this effect is reduced when a blank is introduced between the pre- and postsaccadic stimulus (Bridgeman, Hendry, & Stark, 1975; Deubel, Schneider, & Bridgeman, 1996). While these effects have been studied extensively in adults, it is unclear how these phenomena are characterized in children. A potentially related mechanism, saccadic suppression of contrast sensitivity-a prerequisite to achieve a stable percept-is stronger for children (Bruno, Brambati, Perani, & Morrone, 2006). However, the evidence for how transsaccadic stimulus displacements may be suppressed or integrated is mixed. While they can integrate basic visual feature information from an early age, they cannot integrate multisensory information (Gori, Viva, Sandini, & Burr, 2008; Nardini, Jones, Bedford, & Braddick, 2008), suggesting a failure in the ability to integrate more complex sensory information. We tested children 7 to 12 years old and adults 19 to 23 years old on their ability to perceive intrasaccadic stimulus displacements, with and without a postsaccadic blank. Results showed that children had stronger SSD than adults and a larger blanking effect. Children also had larger undershoots and more variability in their initial saccade endpoints, indicating greater intrinsic uncertainty, and they were faster in executing corrective saccades to account for these errors. Together, these results suggest that children may have a greater internal expectation or prediction of saccade error than adults; thus, the stronger SSD in children may be due to higher intrinsic uncertainty in target localization or saccade execution.

Sensory experience during early sensitive periods shapes cross-modal temporal biases

Typical human perception features stable biases such as perceiving visual events as later than synchronous auditory events. The origin of such perceptual biases is unknown. To investigate the role of early sensory experience, we tested whether a congenital, transient loss of pattern vision, caused by bilateral dense cataracts, has sustained effects on audio-visual and tactile-visual temporal biases and resolution. Participants judged the temporal order of successively presented, spatially separated events within and across modalities. Individuals with reversed congenital cataracts showed a bias towards perceiving visual stimuli as occurring earlier than auditory (Expt. 1) and tactile (Expt. 2) stimuli. This finding stood in stark contrast to normally sighted controls and sight-recovery individuals who had developed cataracts later in childhood: both groups exhibited the typical bias of perceiving vision as delayed compared to audition. These findings provide strong evidence that cross-modal temporal biases depend on sensory experience during an early sensitive period.

Active touch facilitates object size perception in children but not adults: A multisensory event related potential study

In order to increase perceptual precision the adult brain dynamically combines redundant information from different senses depending on their reliability. During object size estimation, for example, visual, auditory and haptic information can be integrated to increase the precision of the final size estimate. Young children, however, do not integrate sensory information optimally and instead rely on active touch. Whether this early haptic dominance is reflected in age-related differences in neural mechanisms and whether it is driven by changes in bottom-up perceptual or top-down attentional processes has not yet been investigated. Here, we recorded event-related-potentials from a group of adults and children aged 5-7 years during an object size perception task using auditory, visual and haptic information. Multisensory information was presented either congruently (conveying the same information) or incongruently (conflicting information). No behavioral responses were required from participants. When haptic size information was available via actively tapping the objects, response amplitudes in the mid-parietal area were significantly reduced by information congruency in children but not in adults between 190 ms-250 ms and 310 ms-370 ms. These findings indicate that during object size perception only children's brain activity is modulated by active touch supporting a neural maturational shift from sensory dominance in early childhood to optimal multisensory benefit in adulthood.

The capacity to learn new motor and perceptual calibrations develops concurrently in childhood

Learning new movements through an error-based process called motor adaptation is thought to involve multiple mechanisms which are still largely not understood. Previous studies have shown that young children adapt movement more slowly than adults, perhaps supporting the involvement of distinct neural circuits that come online at different stages of development. Recent studies in adults have shown that in addition to recalibrating a movement, motor adaptation also leads to changes in the perception of that movement. However, we do not yet understand the relationship between the processes that underlie motor and perceptual recalibration. Here we studied motor and perceptual recalibration with split-belt walking adaptation in adults and children aged 6-8 years. Consistent with previous work, we found that this group of children adapted their walking patterns more slowly than adults, though individual children ranged from slow to adult-like in their adaptation rates. Perceptual recalibration was also reduced in the same group of children compared to adults, with individual children ranging from having no recalibration to having adult-like recalibration. In sum, faster motor adaptation and the ability to recalibrate movement perception both come online within a similar age-range, raising the possibility that the same sensorimotor mechanisms underlie these processes.

Audio-motor but not visuo-motor temporal recalibration speeds up sensory processing

Perception of synchrony between one's own action (a finger tap) and the sensory feedback thereof (a visual flash or an auditory pip) can be recalibrated after exposure to an artificially inserted delay between them (temporal recalibration effect: TRE). TRE might be mediated by a compensatory shift of motor timing (when did I tap?) and/or the sensory timing of the feedback (when did I hear/see the feedback?). To examine this, we asked participants to voluntarily tap their index finger at a constant pace while receiving visual or auditory feedback (a flash or pip) that was either synced or somewhat delayed relative to the tap. Following this exposure phase, they then performed a simple reaction time (RT) task to measure the sensory timing of the exposure stimulus, and a sensorimotor synchronization (SMS) task (tapping in synchrony with a flash or pip as pacing stimulus) to measure the point of subjective synchrony between the tap and pacing stimulus. The results showed that after exposure to delayed auditory feedback, participants tapped earlier (~21.5 ms) relative to auditory pacing stimuli (= temporal recalibration) and reacted faster (~5.6 ms) to auditory stimuli. For visual exposure and test stimuli, there were no such compensatory effects. These results indicate that adjustments of audio-motor synchrony can to some extent be explained by a change in the speed of auditory sensory processing. We discuss this in terms of an attentional modulation of sensory processing.

Age-Related Changes in Sensorimotor Temporal Binding

The causal relationship between a voluntary movement and a sensory event is crucial for experiencing agency. Sensory events must occur within a certain delay from a voluntary movement to be perceived as self-generated. Therefore, temporal sensitivity, i.e., the ability to discriminate temporal asynchronies between motor and sensory events, is important for sensorimotor binding. Moreover, differences in the physical propagation of external stimuli can sometimes challenge sensorimotor binding, generating illusory asynchrony. To overcome this problem, the brain adjusts the perceptual timing of sensory and motor events. This mechanism, named sensorimotor recalibration, helps keeping causality judgments accurate. As humans age, the broad decline in sensory and motor processing may reduce temporal sensitivity, and compromise sensorimotor recalibration. In the current study, we investigated the effect of aging on sensorimotor temporal binding by measuring changes in both temporal sensitivity and recalibration. Young and elderly adults were exposed to a prolonged physical delay between a voluntary movement (a keypress) and its perceptual consequence (a visual stimulus). Before and after this exposure, participants performed a sensorimotor temporal order judgment (TOJ) task. As expected, elderly adults showed reduced sensorimotor recalibration and sensitivity as compared to young adults, suggesting that aging affects sensorimotor temporal binding.

Spatial modulation of motor-sensory recalibration in early deaf individuals

Audition dominates other senses in temporal processing, and in the absence of auditory cues, temporal perception can be compromised. Moreover, after auditory deprivation, visual attention is selectively enhanced for peripheral visual stimuli. In this study, we assessed whether early hearing loss affects motor-sensory recalibration, the ability to adjust the timing of an action and its sensory effect based on the recent experience. Early deaf participants and hearing controls were asked to discriminate the temporal order between a motor action (a keypress) and a visual stimulus (a white circle) before and after adaptation to a delay between the two events. To examine the effects of spatial modulation, we presented visual stimuli in both central and peripheral visual fields. Results showed overall higher temporal JNDs (Just Noticeable Difference) for deaf participants as compared to hearing controls suggesting that the auditory information is important for the calibration of motor-sensory timing. Adaptation to a motor-sensory delay induced distinctive effect in the two groups of participants, with hearing controls showing a recalibration effect for central stimuli only whereas deaf individuals for peripheral visual stimuli only. Our results suggest that auditory deprivation affects motor-sensory recalibration and that the mechanism underlying motor-sensory recalibration is susceptible to spatial modulation.

Predictive coding of multisensory timing

The sense of time is foundational for perception and action, yet it frequently departs significantly from physical time. In the paper we review recent progress on temporal contextual effects, multisensory temporal integration, temporal recalibration, and related computational models. We suggest that subjective time arises from minimizing prediction errors and adaptive recalibration, which can be unified in the framework of predictive coding, a framework rooted in Helmholtz's 'perception as inference'.

Cognitive robots in the development and rehabilitation of children with developmental disorders

Cognitive robots constitute a highly interdisciplinary approach to the issue of therapy of children with developmental disorders. Cognitive robots become more popular, especially in action and language integration areas, joining the experience of psychologists, neuroscientists, philosophers, and even engineers. The concept of a robot as a cognitive companion for humans may be very useful. The interaction between humans and cognitive robots may be a mediator of movement patterns, learning behaviors from demonstrations, group activities, and social behaviors, as far as higher-order concepts such as symbol manipulation capabilities, words acquisition, and sensorimotor knowledge organization. Moreover there is an occupation to check many theories, such as transferring the knowledge and skills between humans and robots. Although several robotic solutions for children have been proposed the diffusion of aforementioned ideas is still limited. The review summarizes the current and future role of cognitive robots in the development and rehabilitation of children with developmental disorders.

Auditory dominance in motor-sensory temporal recalibration

Perception of synchrony between one’s own action (e.g. a finger tap) and the sensory feedback thereof (e.g. a flash or click) can be shifted after exposure to an induced delay (temporal recalibration effect, TRE). It remains elusive, however, whether the same mechanism underlies motor-visual (MV) and motor-auditory (MA) TRE. We examined this by measuring crosstalk between MV- and MA-delayed feedbacks. During an exposure phase, participants pressed a mouse at a constant pace while receiving visual or auditory feedback that was either delayed (+150 ms) or subjectively synchronous (+50 ms). During a post-test, participants then tried to tap in sync with visual or auditory pacers. TRE manifested itself as a compensatory shift in the tap–pacer asynchrony (a larger anticipation error after exposure to delayed feedback). In experiment 1, MA and MV feedback were either both synchronous (MV-sync and MA-sync) or both delayed (MV-delay and MA-delay), whereas in experiment 2, different delays were mixed across alternating trials (MV-sync and MA-delay or MV-delay and MA-sync). Exposure to consistent delays induced equally large TREs for auditory and visual pacers with similar build-up courses. However, with mixed delays, we found that synchronized sounds erased MV-TRE, but synchronized flashes did not erase MA-TRE. These results suggest that similar mechanisms underlie MA- and MV-TRE, but that auditory feedback is more potent than visual feedback to induce a rearrangement of motor-sensory timing.