Spatial sonification of letters on tablets to stimulate literacy skills and handwriting in 5 y-o children: A pilot study

Online reach adjustments induced by real-time movement sonification

Movement sonification can improve motor control in both healthy subjects (e.g., learning or refining a sport skill) and those with sensorimotor deficits (e.g., stroke patients and deafferented individuals). It is not known whether improved motor control and learning from movement sonification are driven by feedback-based real-time ("online") trajectory adjustments, adjustments to internal models over multiple trials, or both. We searched for evidence of online trajectory adjustments (muscle twitches) in response to movement sonification feedback by comparing the kinematics and error of reaches made with online (i.e., real-time) and terminal sonification feedback. We found that reaches made with online feedback were significantly more jerky than reaches made with terminal feedback, indicating increased muscle twitching (i.e., online trajectory adjustment). Using a between-subject design, we found that online feedback was associated with improved motor learning of a reach path and target over terminal feedback; however, using a within-subjects design, we found that switching participants who had learned with online sonification feedback to terminal feedback was associated with a decrease in error. Thus, our results suggest that, with our task and sonification, movement sonification leads to online trajectory adjustments which improve internal models over multiple trials, but which themselves are not helpful online corrections.

Does modifying visual feedback facilitate learning to write new pseudoletters?

Learning to write relies on the efficient integration of visual and proprioceptive feedback, with a transition from a control, based on the visual inspection of the written trace at the beginning of the learning process to a more predictive control, based mainly on handwriting movement, in proficient writers. The aim of this study was to test the effect of a partial deletion of the written trace, as well as the effect of supplementary visual information, on handwriting kinematics in a learning task. Twenty-four adults learned to write six new pseudoletters using their non-dominant hand on a touch screen digital tablet. Three pseudoletters were trained with modified visual feedback conditions and the other three, in the control condition, i.e. without any visual modification. Results revealed that, in the short-term, the pseudoletters learned with modified visual feedback were traced faster and more fluently than those learned in the control condition, without spatial accuracy reduction. This method seems to be efficient in adults, which is a prerequisite before testing a method with children.