Acceleration and deceleration at constant speed: systematic modulation of motion perception by kinematic sonification

Perceptual coupling in human dyads: Kinematics does not affect interpersonal synchronization

The minimal, essential condition for individuals to interact is that they exchange information via at least one sensory channel. Once informational coupling is established, it enables basic forms of coordinated behavior to spontaneously emerge from the interaction. Our previous study revealed different coordination dynamics in dyads engaged in a joint finger-tapping task based on visual versus auditory coupling. This observation led us to propose the 'modality-dependent hypothesis', which posits that coordination dynamics are influenced by the sensory modality mediating informational coupling. However, recognizing that different modalities have inherent differences in accessing spatiotemporal features of perceived movement, we formulated the alternative 'kinematic hypothesis'. This hypothesis posits that differences in dynamics would vanish given equivalent kinematic information across modalities. The study involved forty (N = 40) participants, grouped into twenty (N = 20) dyads, who engaged in a joint finger-tapping task. This task was conducted under varying conditions of visual and auditory coupling, with manipulations in the access to kinematic information, categorized as discrete and continuous. Contrary to our initial predictions, the results strongly supported the 'modality-dependent hypothesis'. We observed that visual and auditory coupling consistently yielded distinct attractor dynamics, regardless of the access to kinematic information. Furthermore, all conditions of auditory coupling resulted in higher levels of synchronization than their visual counterparts. These findings suggest that the differences in interpersonal synchronization are predominantly influenced by the sensory modality, rather than the continuity of kinematic information. Our study highlights the significance of sensorimotor interactions in interpersonal synchronization and addresses the potential of sonification strategies in supporting motor training and rehabilitation.

Submovement interpersonal coupling is associated to audio-motor coordination performance

Acting in concert with others, a key aspect of our social life, requires behavioral coordination between persons on multiple timescales. When zooming in on the kinematic properties of movements, it appears that small speed fluctuations, called submovements, are embedded within otherwise smooth end-point trajectories. Submovements, by occurring at a faster timescale than that of movements, offer a novel window upon the functional relationship between distinct motor timescales. In this regard, it has previously been shown that when partners visually synchronize their movements, they also coordinate the timing of their submovement by following an alternated pattern. However, it remains unclear whether the mechanisms behind submovement coordination are domain-general or specific to the visual modality, and whether they have relevance for interpersonal coordination also at the scale of whole movements. In a series of solo and dyadic tasks, we show that submovements are also present and coordinated across partners when sensorimotor interactions are mediated by auditory feedback only. Importantly, the accuracy of task-instructed interpersonal coordination at the movement level correlates with the strength of submovement coordination. These results demonstrate that submovement coordination is a potentially fundamental mechanism that participates in interpersonal motor coordination regardless of the sensory domain mediating the interaction.

Does Music Therapy Improve Gait after Traumatic Brain Injury and Spinal Cord Injury? A Mini Systematic Review and Meta-Analysis

There is a growing body of research examining the potential benefits of music therapy-based auditory stimulation (MT) for individuals with movement disorders in improving gait performance. However, there is limited knowledge about the effects of MT on gait outcomes in individuals with traumatic brain injury (TBI) or spinal cord injury (SCI). A previous review of MT's impact on gait in TBI had limitations, and there are no studies on its effects on gait in SCI. In this study, we conducted a meta-analysis to more thoroughly evaluate the impact of MT on gait outcomes in individuals with TBI and SCI. We systematically searched through eight databases and found six studies on MT in TBI and four on SCI. Our meta-analysis showed that MT has positive medium effect improvements on spatiotemporal aspects of gait in individuals with TBI (Hedge's g: 0.52) and SCI (0.53). These findings suggest that MT could be a practical intervention for enhancing different aspects of gait in these populations, although the limited number and "fair" quality of the studies included in the meta-analysis may affect the generalizability of the outcomes. Further research is needed to fully understand the mechanisms by which MT may influence gait and determine the optimal parameters for its use.

Auditory Stimulation Improves Gait and Posture in Cerebral Palsy: A Systematic Review with Between- and Within-Group Meta-Analysis

The past decade has seen an increased interest in the implementation of auditory stimulation (AStim) for managing gait and postural deficits in people with cerebral palsy. Although existing reviews report beneficial effects of AStim on the spatiotemporal and kinematic parameters of gait, there are still numerous limitations that need to be addressed to correctly interpret these results. For instance, existing reviews have failed to characterize the effects of AStim by conducting separate between and within-group meta-analyses, these reviews have not evaluated the influence of AStim on postural outcomes, and nor have included several high-quality existing trials. In this study, we conducted between- and within-group meta-analyses to establish a state of evidence for the influence of AStim on gait and postural outcomes in people with cerebral palsy. We searched the literature according to PRISMA-P guidelines across 10 databases. Of 1414 records, 14 studies, including a total of 325 people with cerebral palsy, met the inclusion criterion. We report a significant enhancement in gait speed, stride length, cadence, and gross motor function (standing and walking) outcomes with AStim compared to conventional physiotherapy. The findings from this analysis reveal the beneficial influence of AStim on the spatiotemporal and kinematic parameters of gait and postural stability in people with cerebral palsy. Furthermore, we discuss the futurized implementation of smart wearables that can deliver person-centred AStim rehabilitation in people with cerebral palsy.

A functional magnetic resonance imaging examination of audiovisual observation of a point-light string quartet using intersubject correlation and physical feature analysis

We use functional Magnetic Resonance Imaging (fMRI) to explore synchronized neural responses between observers of audiovisual presentation of a string quartet performance during free viewing. Audio presentation was accompanied by visual presentation of the string quartet as stick figures observed from a static viewpoint. Brain data from 18 musical novices were obtained during audiovisual presentation of a 116 s performance of the allegro of String Quartet, No. 14 in D minor by Schubert played by the 'Quartetto di Cremona.' These data were analyzed using intersubject correlation (ISC). Results showed extensive ISC in auditory and visual areas as well as parietal cortex, frontal cortex and subcortical areas including the medial geniculate and basal ganglia (putamen). These results from a single fixed viewpoint of multiple musicians are greater than previous reports of ISC from unstructured group activity but are broadly consistent with related research that used ISC to explore listening to music or watching solo dance. A feature analysis examining the relationship between brain activity and physical features of the auditory and visual signals yielded findings of a large proportion of activity related to auditory and visual processing, particularly in the superior temporal gyrus (STG) as well as midbrain areas. Motor areas were also involved, potentially as a result of watching motion from the stick figure display of musicians in the string quartet. These results reveal involvement of areas such as the putamen in processing complex musical performance and highlight the potential of using brief naturalistic stimuli to localize distinct brain areas and elucidate potential mechanisms underlying multisensory integration.

How to orchestrate a soccer team: Generalized synchronization promoted by rhythmic acoustic stimuli

Interpersonal coordination requires precise actions concerted in space and time in a self-organized manner. We found, using soccer teams as a testing ground, that a common timeframe provided by adequate acoustic stimuli improves the interplay between teammates. We provide quantitative evidence that the connectivity between teammates and the scoring rate of male soccer teams improve significantly when playing under the influence of an appropriate acoustic environment. Unexpectedly, female teams do not show any improvement under the same experimental conditions. We show by follow-up experiments that the acoustic rhythm modulates the attention level of the participants with a pronounced tempo preference and a marked gender difference in the preferred tempo. These results lead to a consistent explanation in terms of the dynamical system theory, nonlinear resonances, and dynamic attention theory, which may illuminate generic mechanisms of the brain dynamics and may have an impact on the design of novel training strategies in team sports.

Loudness affects motion: asymmetric volume of auditory feedback results in asymmetric gait in healthy young adults

Background

The potential of auditory feedback for motor learning in the rehabilitation of various diseases has become apparent in recent years. However, since the volume of auditory feedback has played a minor role so far and its influence has hardly been considered, we investigate the volume effect of auditory feedback on gait pattern and gait direction and its interaction with pitch.

Methods

Thirty-two healthy young participants were randomly divided into two groups: Group 1 (n = 16) received a high pitch (150-250 Hz) auditory feedback; group 2 (n = 16) received a lower pitch (95-112 Hz) auditory feedback. The feedback consisted of a real-time sonification of the right and left foot ground contact. After an initial condition (no auditory feedback and full vision), both groups realized a 30-minute habituation period followed by a 30-minute asymmetry period. At any condition, the participants were asked to walk blindfolded and with auditory feedback towards a target at 15 m distance and were stopped 5 m before the target. Three different volume conditions were applied in random order during the habituation period: loud, normal, and quiet. In the subsequent asymmetry period, the three volume conditions baseline, right quiet and left quiet were applied in random order.

Results

In the habituation phase, the step width from the loud to the quiet condition showed a significant interaction of volume*pitch with a decrease at high pitch (group 1) and an increase at lower pitch (group 2) (group 1: loud 1.02 ± 0.310, quiet 0.98 ± 0.301; group 2: loud 0.95 ± 0.229, quiet 1.11 ± 0.298). In the asymmetry period, a significantly increased ground contact time on the side with reduced volume could be found (right quiet: left foot 0.988 ± 0.033, right foot 1.003 ± 0.040, left quiet: left foot 1.004 ± 0.036, right foot 1.002 ± 0.033).

Conclusions

Our results suggest that modifying the volume of auditory feedback can be an effective way to improve gait symmetry. This could facilitate gait therapy and rehabilitation of hemiparetic and arthroplasty patients, in particular if gait improvement based on verbal corrections and conscious motor control is limited.

Effects of auditory feedback on gait behavior, gaze patterns and outcome performance in long jumping

In the current study, we conducted two experiments to investigate the impact of concurrent, action-induced auditory feedback on gait patterns, gaze behavior and outcome performance in long jumping. In Experiment 1, we examined the effects of present vs. absent auditory feedback on gait, gaze and performance outcome measures. Results revealed a significant interaction effect between condition (present vs. absent auditory feedback) and phase (acceleration vs. zeroing-in phase) on participants' step lengths indicating that the absence (rather than the presence) of auditory feedback led to facilitatory effects in terms of a more prototypical gait pattern (i.e., shorter steps in the acceleration phase and longer steps in the zeroing-in phase). Similarly, the absent auditory feedback led to a higher gaze stability in terms of less switches between areas of interest (AOIs). However, there was no effect on jumped distance. In Experiment 2, we scrutinized the influence of concurrent vs. delayed auditory feedback on all three performance parameters. In contrast to concurrent feedback, delayed auditory feedback negatively affected all three measures: participants showed (i) dysfunctional deviations from their prototypical gait pattern (i.e., shorter steps across both phases of the run-up), (ii) less stable, maladaptive gaze patterns (i.e., more switches between AOIs) and (iii) poorer jumping performance (i.e., shorter jumped distances). Together, the two experiments provide clear evidence for the impact of concurrent, action-induced auditory feedback on the coordination of complex, rhythmical motor tasks such as the long jump.

Hand rehabilitation with sonification techniques in the subacute stage of stroke

After a stroke event, most survivors suffer from arm paresis, poor motor control and other disabilities that make activities of daily living difficult, severely affecting quality of life and personal independence. This randomized controlled trial aimed at evaluating the efficacy of a music-based sonification approach on upper limbs motor functions, quality of life and pain perceived during rehabilitation. The study involved 65 subacute stroke individuals during inpatient rehabilitation allocated into 2 groups which underwent usual care dayweek) respectively of standard upper extremity motor rehabilitation or upper extremity treatment with sonification techniques. The Fugl-Meyer Upper Extremity Scale, Box and Block Test and the Modified Ashworth Scale were used to perform motor assessment and the McGill Quality of Life-it and the Numerical Pain Rating Scale to assess quality of life and pain. The assessment was performed at baseline, after 2 weeks, at the end of treatment and at follow-up (1 month after the end of treatment). Total scores of the Fugl-Meyer Upper Extremity Scale (primary outcome measure) and hand and wrist sub scores, manual dexterity scores of the affected and unaffected limb in the Box and Block Test, pain scores of the Numerical Pain Rating Scale (secondary outcomes measures) significantly improved in the sonification group compared to the standard of care group (time*group interaction < 0.05). Our findings suggest that music-based sonification sessions can be considered an effective standardized intervention for the upper limb in subacute stroke rehabilitation.

Modulation of ellipses drawing by sonification

Most studies on the regulation of speed and trajectory during ellipse drawing have used visual feedback. We used online auditory feedback (sonification) to induce implicit movement changes independently from vision. The sound was produced by filtering a pink noise with a band-pass filter proportional to movement speed. The first experiment was performed in 2D. Healthy participants were asked to repetitively draw ellipses during 45 s trials whilst maintaining a constant sonification pattern (involving pitch variations during the cycle). Perturbations were produced by modifying the slope of the mapping without informing the participants. All participants adapted spontaneously their speed: they went faster if the slope decreased and slower if it increased. Higher velocities were achieved by increasing both the frequency of the movements and the perimeter of the ellipses, but slower velocities were achieved mainly by decreasing the perimeter of the ellipses. The shape and the orientation of the ellipses were not significantly altered. The analysis of the speed-curvature power law parameters showed consistent modulations of the speed gain factor, while the exponent remained stable. The second experiment was performed in 3D and showed similar results, except that the main orientation of the ellipse also varied with the changes in speed. In conclusion, this study demonstrated implicit modulation of movement speed by sonification and robust stability of the ellipse geometry. Participants appeared to limit the decrease in movement frequency during slowing down to maintain a rhythmic and not discrete motor regimen.

Auditory Coding of Reaching Space

Reaching movements are usually initiated by visual events and controlled visually and kinesthetically. Lately, studies have focused on the possible benefit of auditory information for localization tasks, and also for movement control. This explorative study aimed to investigate if it is possible to code reaching space purely by auditory information. Therefore, the precision of reaching movements to merely acoustically coded target positions was analyzed. We studied the efficacy of acoustically effect-based and of additional acoustically performance-based instruction and feedback and the role of visual movement control. Twenty-four participants executed reaching movements to merely acoustically presented, invisible target positions in three mutually perpendicular planes in front of them. Effector-endpoint trajectories were tracked using inertial sensors. Kinematic data regarding the three spatial dimensions and the movement velocity were sonified. Thus, acoustic instruction and real-time feedback of the movement trajectories and the target position of the hand were provided. The subjects were able to align their reaching movements to the merely acoustically instructed targets. Reaching space can be coded merely acoustically, additional visual movement control does not enhance reaching performance. On the basis of these results, a remarkable benefit of kinematic movement acoustics for the neuromotor rehabilitation of everyday motor skills can be assumed.

Audio cues enhance mirroring of arm motion when visual cues are scarce

Swing in a crew boat, a good jazz riff, a fluid conversation: these tasks require extracting sensory information about how others flow in order to mimic and respond. To determine what factors influence coordination, we build an environment to manipulate incoming sensory information by combining virtual reality and motion capture. We study how people mirror the motion of a human avatar's arm as we occlude the avatar. We efficiently map the transition from successful mirroring to failure using Gaussian process regression. Then, we determine the change in behaviour when we introduce audio cues with a frequency proportional to the speed of the avatar's hand or train individuals with a practice session. Remarkably, audio cues extend the range of successful mirroring to regimes where visual information is sparse. Such cues could facilitate joint coordination when navigating visually occluded environments, improve reaction speed in human-computer interfaces or measure altered physiological states and disease.

Dual Mode Gait Sonification for Rehabilitation After Unilateral Hip Arthroplasty

The pattern of gait after hip arthroplasty strongly affects regeneration and quality of life. Acoustic feedback could be a supportive method for patients to improve their walking ability and to regain a symmetric and steady gait. In this study, a new gait sonification method with two different modes—real-time feedback (RTF) and instructive model sequences (IMS)—is presented. The impact of the method on gait symmetry and steadiness of 20 hip arthroplasty patients was investigated. Patients were either assigned to a sonification group (SG) (n = 10) or a control group (CG) (n = 10). All of them performed 10 gait training sessions (TS) lasting 20 min, in which kinematic data were measured using an inertial sensor system. Results demonstrate converging step lengths of the affected and unaffected leg over time in SG compared with a nearly parallel development of both legs in CG. Within the SG, a higher variability of stride length and stride time was found during the RTF training mode in comparison to the IMS mode. Therefore, the presented dual mode method provides the potential to support gait rehabilitation as well as home-based gait training of orthopedic patients with various restrictions.

Effects of (music-based) rhythmic auditory cueing training on gait and posture post-stroke: A systematic review & dose-response meta-analysis

Gait dysfunctions are common post-stroke. Rhythmic auditory cueing has been widely used in gait rehabilitation for movement disorders. However, a consensus regarding its influence on gait and postural recovery post-stroke is still warranted. A systematic review and meta-analysis was performed to analyze the effects of auditory cueing on gait and postural stability post-stroke. Nine academic databases were searched according to PRISMA guidelines. The eligibility criteria for the studies were a) studies were randomized controlled trials or controlled clinical trials published in English, German, Hindi, Punjabi or Korean languages b) studies evaluated the effects of auditory cueing on spatiotemporal gait and/or postural stability parameters post-stroke c) studies scored ≥4 points on the PEDro scale. Out of 1,471 records, 38 studies involving 968 patients were included in this present review. The review and meta-analyses revealed beneficial effects of training with auditory cueing on gait and postural stability. A training dosage of 20–45 minutes session, for 3–5 times a week enhanced gait performance, dynamic postural stability i.e. velocity (Hedge’s g: 0.73), stride length (0.58), cadence (0.75) and timed-up and go test (−0.76). This review strongly recommends the incorporation of rhythmic auditory cueing based training in gait and postural rehabilitation, post-stroke.

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

The role of auditory information on perceptual-motor processes has gained increased interest in sports and psychology research in recent years. Numerous neurobiological and behavioral studies have demonstrated the close interaction between auditory and motor areas of the brain, and the importance of auditory information for movement execution, control, and learning. In applied research, artificially produced acoustic information and real-time auditory information have been implemented in sports and rehabilitation to improve motor performance in athletes, healthy individuals, and patients affected by neurological or movement disorders. However, this research is scattered both across time and scientific disciplines. The aim of this paper is to provide an overview about the interaction between movement and sound and review the current literature regarding the effect of natural movement sounds, movement sonification, and rhythmic auditory information in sports and motor rehabilitation. The focus here is threefold: firstly, we provide an overview of empirical studies using natural movement sounds and movement sonification in sports. Secondly, we review recent clinical and applied studies using rhythmic auditory information and sonification in rehabilitation, addressing in particular studies on Parkinson's disease and stroke. Thirdly, we summarize current evidence regarding the cognitive mechanisms and neural correlates underlying the processing of auditory information during movement execution and its mental representation. The current state of knowledge here reviewed provides evidence of the feasibility and effectiveness of the application of auditory information to improve movement execution, control, and (re)learning in sports and motor rehabilitation. Findings also corroborate the critical role of auditory information in auditory-motor coupling during motor (re)learning and performance, suggesting that this area of clinical and applied research has a large potential that is yet to be fully explored.

Role of Sonification and Rhythmic Auditory Cueing for Enhancing Gait Associated Deficits Induced by Neurotoxic Cancer Therapies: A Perspective on Auditory Neuroprosthetics

Patients undergoing chemotherapy, radiotherapy, and immunotherapy experience neurotoxic changes in the central and peripheral nervous system. These neurotoxic changes adversely affect functioning in the sensory, motor, and cognitive domains. Thereby, considerably affecting autonomic activities like gait and posture. Recent evidence from a range of systematic reviews and meta-analyses have suggested the beneficial influence of music-based external auditory stimulations i.e., rhythmic auditory cueing and real-time auditory feedback (sonification) on gait and postural stability in population groups will balance disorders. This perspective explores the conjunct implications of auditory stimulations during cancer treatment to simultaneously reduce gait and posture related deficits. Underlying neurophysiological mechanisms by which auditory stimulations might influence motor performance have been discussed. Prompt recognition of this sensorimotor training strategy in future studies can have a widespread impact on patient care in all areas of oncology.

Training proprioception with sound: effects of real-time auditory feedback on intermodal learning

Our study analyzed the effects of real-time auditory feedback on intermodal learning during a bilateral knee repositioning task. Thirty healthy participants were randomly allocated to control and experimental groups. Participants performed an active knee joint repositioning task for the four target angles (20°, 40°, 60°, and 80°) bilaterally, with or without additional real-time auditory feedback. Here, the frequency of auditory feedback was mapped to the knee's angle range (0-90°). Retention measurements were performed on the same four angles, without auditory feedback, after 15 min and 24 hours. A generalized knee proprioception test was performed after the 24-h retention measurement on three untrained knee angles (15°, 35°, and 55°). Statistical analysis revealed a significant enhancement of knee proprioception, shown as a lower knee repositioning error with auditory feedback. This enhancement of proprioception also persisted in tests performed between the 5th and 6th auditory-motor training blocks (without auditory feedback). Enhancement in proprioception also remained stable during retention measurements (after 15 min and 24 h). Similarly, enhancement in the generalized proprioception on untrained knee angles was evident in the experimental group. This study extends our previous findings and demonstrates the beneficial effects of real-time auditory feedback to facilitate intermodal learning by enhancing knee proprioception in a persisting and generalized manner.