Visual tuning and metrical perception of realistic point-light dance movements

Exposure to multisensory and visual static or moving stimuli enhances processing of nonoptimal visual rhythms

Research has shown that visual moving and multisensory stimuli can efficiently mediate rhythmic information. It is possible, therefore, that the previously reported auditory dominance in rhythm perception is due to the use of nonoptimal visual stimuli. Yet it remains unknown whether exposure to multisensory or visual-moving rhythms would benefit the processing of rhythms consisting of nonoptimal static visual stimuli. Using a perceptual learning paradigm, we tested whether the visual component of the multisensory training pair can affect processing of metric simple two integer-ratio nonoptimal visual rhythms. Participants were trained with static (AVstat), moving-inanimate (AVinan), or moving-animate (AVan) visual stimuli along with auditory tones and a regular beat. In the pre- and posttraining tasks, participants responded whether two static-visual rhythms differed or not. Results showed improved posttraining performance for all training groups irrespective of the type of visual stimulation. To assess whether this benefit was auditory driven, we introduced visual-only training with a moving or static stimulus and a regular beat (Vinan). Comparisons between Vinan and Vstat showed that, even in the absence of auditory information, training with visual-only moving or static stimuli resulted in an enhanced posttraining performance. Overall, our findings suggest that audiovisual and visual static or moving training can benefit processing of nonoptimal visual rhythms.

Audiovisual synchrony perception in observing human motion to music

To examine how individuals perceive synchrony between music and body motion, we investigated the characteristics of synchrony perception during observation of a Japanese Radio Calisthenics routine. We used the constant stimuli method to present video clips of an individual performing an exercise routine. We generated stimuli with a range of temporal shifts between the visual and auditory streams, and asked participants to make synchrony judgments. We then examined which movement-feature points agreed with music beats when the participants perceived synchrony. We found that extremities (e.g., hands and feet) reached the movement endpoint or moved through the lowest position at music beats associated with synchrony. Movement onsets never agreed with music beats. To investigate whether visual information about the feature points was necessary for synchrony perception, we conducted a second experiment where only limited portions of video clips were presented to the participants. Participants consistently judged synchrony even when the video image did not contain the critical feature points, suggesting that a prediction mechanism contributes to synchrony perception. To discuss the meaning of these feature points with respect to synchrony perception, we examined the temporal relationship between the motion of body parts and the ground reaction force (GRF) of exercise performers, which reflected the total force acting on the performer. Interestingly, vertical GRF showed local peaks consistently synchronized with music beats for most exercises, with timing that was closely correlated with the timing of movement feature points. This result suggests that synchrony perception in humans is based on some global variable anticipated from visual information, instead of the feature points found in the motion of individual body parts. In summary, the present results indicate that synchrony perception during observation of human motion to music depends largely on spatiotemporal prediction of the performer's motion.

Steps Toward a Universal Grammar of Dance: Local Grouping Structure in Basic Human Movement Perception

The general goal of this paper is to investigate the structure of our unconscious mental representation of dance: we do not perceive dance as an unanalyzed flow of movement, but we unconsciously create a mental representation regulated by structural principles. Specifically, this article examines local grouping principles in dance perception inspired by Lerdahl and Jackendoff's (1983) approach to musical grouping. I spell out the basic perceptual dimensions at work in basic human movement perception, and on that basis, I propose six principles of change that determine group boundaries in dance (change of body part, orientation, level, direction, speed, quality). I experimentally test the relevance and interaction of these principles, and find that they are organized on a scale of relative strength. This experiment thus supports the hypothesis that grouping is a general cognitive capacity applying across domains and modalities, and shows how specific grouping principles are stated in relation to modality-specific and domain-specific dimensions. More generally, it takes a step toward the development of a generative theory of dance that should help extend the research avenue of comparing complex temporal cognitive activities across modalities (visual, auditory) and purposes (referential, non-referential), which so far involves spoken language, signed language and music.

Superior Visual Timing Sensitivity in Auditory But Not Visual World Class Drum Corps Experts

World class drum corps require cooperation among performance artists to render precisely synchronized and asynchronized events. For example, drum corps visual aesthetics often feature salient radial and rotational motion displays from the color guard. Accordingly, extensive color guard training might predict superior visual timing sensitivity to asynchronies in radial and rotational motion displays. Less intuitively, one might instead predict superior visual timing sensitivity among world class drum corps musicians, who regularly subdivide musical tempos into brief time units. This prediction arises from the possibility that auditory training transfers cross-modally. Here, we investigated whether precise visual temporal order judgments (TOJs) more strongly align with color guard’s visual training or musicians’ auditory training. To mimic color guard visual displays, stimuli comprised bilateral plaid patterns that radiated or rotated before changing direction asynchronously. Human participants indicated whether the direction changed first on the left or right, called a TOJ. Twenty-five percussionists, 67 brass players, and 29 color guard members from a world class drum corps collectively completed 67,760 visual TOJ trials. Percussionists exhibited significantly lower TOJ thresholds than did brass players, who exhibited significantly lower TOJ thresholds than did the color guard. Group median thresholds spanned an order of magnitude, ranging between 29 ms (percussionists judging rotational asynchronies) and 290 ms (color guard judging radial asynchronies). The results suggest that visual timing can improve more by training cross-modally than intramodally, even when intramodal training and testing stimuli closely match. More broadly, pre-existing training histories can provide a unique window into the timing sensitivity of the nervous system.

Does dance training influence beat sensorimotor synchronization? Differences in finger-tapping sensorimotor synchronization between competitive ballroom dancers and nondancers

Sensorimotor synchronization is the coordination of rhythmic movement with an external beat. Dancers often synchronize each beat of their motion with an external rhythm. Compared with social dancing, competitive ballroom dancing requires a higher level of sensorimotor ability. Although previous studies have found that dance experience may facilitate sensorimotor synchronization, they did not examine this in competitive ballroom dancers. Thus, the present study compared sensorimotor synchronization in 41 nondancers and 41 skilled, competitive ballroom dancers as they performed a simple beat synchronization finger-tapping task. All participants finger-tapped freely at their preferred tempo before the formal experiments. Participants were then required to synchronize their finger-tapping with auditory, visual, or combined audiovisual signals in separate experiments and at varying tempos. To assess sensorimotor plasticity, the participants then repeated the free-tapping task after completing all three finger-tapping experiments. Compared with nondancers, dancers showed more accurate and stable beat synchronization. Dancers tapped before onset of all three types of sensorimotor stimulation, indicating a significant negative mean asynchrony and had a tendency to anticipate (predict) the stimuli. Dancers tended to auditory stimulation for beat sensorimotor synchronization, whereas nondancers tended to visual stimuli. Dancers had a faster tempo preference in the initial free-tapping task; however, the preferred tapping tempo increased in all participants in the second free-tapping task, suggesting that beat induction is affected by practice. Together these findings suggest that dance experience enhances sensorimotor synchronization and sensorimotor plasticity, with ballroom dancers tending to auditory stimulation for beat induction.

Your move or mine? Music training and kinematic compatibility modulate synchronization with self- versus other-generated dance movement

Motor simulation has been implicated in how musicians anticipate the rhythm of another musician's action to achieve interpersonal synchronization. Here, we investigated whether similar mechanisms govern a related form of rhythmic action: dance. We examined (1) whether synchronization with visual dance stimuli was influenced by movement agency, (2) whether music training modulated simulation efficiency, and (3) what cues were relevant for simulating the dance rhythm. Participants were first recorded dancing the basic Charleston steps paced by a metronome, and later in a synchronization task they tapped to the rhythm of their own point-light dance stimuli, stimuli of another physically matched participant or one matched in movement kinematics, and a quantitative average across individuals. Results indicated that, while there was no overall "self advantage" and synchronization was generally most stable with the least variable (averaged) stimuli, motor simulation was driven-indicated by high tap-beat variability correlations-by familiar movement kinematics rather than morphological features. Furthermore, music training facilitated simulation, such that musicians outperformed non-musicians when synchronizing with others' movements but not with their own movements. These findings support action simulation as underlying synchronization in dance, linking action observation and rhythm processing in a common motor framework.

Visual Enhancement of Illusory Phenomenal Accents in Non-Isochronous Auditory Rhythms

Musical rhythms encompass temporal patterns that often yield regular metrical accents (e.g., a beat). There have been mixed results regarding perception as a function of metrical saliency, namely, whether sensitivity to a deviant was greater in metrically stronger or weaker positions. Besides, effects of metrical position have not been examined in non-isochronous rhythms, or with respect to multisensory influences. This study was concerned with two main issues: (1) In non-isochronous auditory rhythms with clear metrical accents, how would sensitivity to a deviant be modulated by metrical positions? (2) Would the effects be enhanced by multisensory information? Participants listened to strongly metrical rhythms with or without watching a point-light figure dance to the rhythm in the same meter, and detected a slight loudness increment. Both conditions were presented with or without an auditory interference that served to impair auditory metrical perception. Sensitivity to a deviant was found greater in weak beat than in strong beat positions, consistent with the Predictive Coding hypothesis and the idea of metrically induced illusory phenomenal accents. The visual rhythm of dance hindered auditory detection, but more so when the latter was itself less impaired. This pattern suggested that the visual and auditory rhythms were perceptually integrated to reinforce metrical accentuation, yielding more illusory phenomenal accents and thus lower sensitivity to deviants, in a manner consistent with the principle of inverse effectiveness. Results were discussed in the predictive framework for multisensory rhythms involving observed movements and possible mediation of the motor system.

Sensorimotor Synchronization with Different Metrical Levels of Point-Light Dance Movements

Rhythm perception and synchronization have been extensively investigated in the auditory domain, as they underlie means of human communication such as music and speech. Although recent studies suggest comparable mechanisms for synchronizing with periodically moving visual objects, the extent to which it applies to ecologically relevant information, such as the rhythm of complex biological motion, remains unknown. The present study addressed this issue by linking rhythm of music and dance in the framework of action-perception coupling. As a previous study showed that observers perceived multiple metrical periodicities in dance movements that embodied this structure, the present study examined whether sensorimotor synchronization (SMS) to dance movements resembles what is known of auditory SMS. Participants watched a point-light figure performing two basic steps of Swing dance cyclically, in which the trunk bounced at every beat and the limbs moved at every second beat, forming two metrical periodicities. Participants tapped synchronously to the bounce of the trunk with or without the limbs moving in the stimuli (Experiment 1), or tapped synchronously to the leg movements with or without the trunk bouncing simultaneously (Experiment 2). Results showed that, while synchronization with the bounce (lower-level pulse) was not influenced by the presence or absence of limb movements (metrical accent), synchronization with the legs (beat) was improved by the presence of the bounce (metrical subdivision) across different movement types. The latter finding parallels the “subdivision benefit” often demonstrated in auditory tasks, suggesting common sensorimotor mechanisms for visual rhythms in dance and auditory rhythms in music.