Intuitive visualizations of pitch and loudness in speech

Multilevel rhythms in multimodal communication

It is now widely accepted that the brunt of animal communication is conducted via several modalities, e.g. acoustic and visual, either simultaneously or sequentially. This is a laudable multimodal turn relative to traditional accounts of temporal aspects of animal communication which have focused on a single modality at a time. However, the fields that are currently contributing to the study of multimodal communication are highly varied, and still largely disconnected given their sole focus on a particular level of description or their particular concern with human or non-human animals. Here, we provide an integrative overview of converging findings that show how multimodal processes occurring at neural, bodily, as well as social interactional levels each contribute uniquely to the complex rhythms that characterize communication in human and non-human animals. Though we address findings for each of these levels independently, we conclude that the most important challenge in this field is to identify how processes at these different levels connect. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.

Considerations on Effective Feedback in Computerized Speech Training for Dysarthric Speakers

Introduction: In this article, we consider the role of feedback in computerized speech training for patients with dysarthric speech due to acquired neurological disorders such as Parkinson's disease and stroke. Methods: Based on literature from different fields, we review several issues that play a role when designing feedback for computerized speech training, including serious games. Results: Which speech dimensions (e.g., articulation, loudness) to target in computerized speech feedback, and at what level of detail to provide the feedback, depend on the focus of the specific speech therapy and the technical feasibility of providing reliable speech feedback. Furthermore, feedback that provides knowledge of results generally appears equally effective as knowledge of performance feedback, and is more easily provided in computerized speech training systems. Implicit feedback can be more motivating than explicit feedback (e.g., in serious games), but may be harder to understand. Multimodal feedback is preferred over unimodal feedback to ensure that the feedback message is optimally perceived. Mild negative task-oriented feedback can enhance effort but should be balanced with positive feedback, such as feedback referring to patients' progress. Finally, a balance should be found between the motivational advantages of high-frequency immediate feedback (e.g., in serious games) and the advantages of low-frequency and delayed feedback in preventing patients from becoming dependent on augmented feedback. Conclusions: Several aspects play a role in designing feedback for computerized speech training for dysarthric speakers. Decisions on these aspects should be made carefully, accounting for the specific characteristics of the patient group that is targeted, the focus of the specific speech therapy, and the technological possibilities that are available.