1
|
Schiavio A, Witek MAG, Stupacher J. Meaning-making and creativity in musical entrainment. Front Psychol 2024; 14:1326773. [PMID: 38235276 PMCID: PMC10792053 DOI: 10.3389/fpsyg.2023.1326773] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 12/05/2023] [Indexed: 01/19/2024] Open
Abstract
In this paper we suggest that basic forms of musical entrainment may be considered as intrinsically creative, enabling further creative behaviors which may flourish at different levels and timescales. Rooted in an agent's capacity to form meaningful couplings with their sonic, social, and cultural environment, musical entrainment favors processes of adaptation and exploration, where innovative and functional aspects are cultivated via active, bodily experience. We explore these insights through a theoretical lens that integrates findings from enactive cognitive science and creative cognition research. We center our examination on the realms of groove experience and the communicative and emotional dimensions of music, aiming to present a novel preliminary perspective on musical entrainment, rooted in the fundamental concepts of meaning-making and creativity. To do so, we draw from a suite of approaches that place particular emphasis on the role of situated experience and review a range of recent empirical work on entrainment (in musical and non-musical settings), emphasizing the latter's biological and cognitive foundations. We conclude that musical entrainment may be regarded as a building block for different musical creativities that shape one's musical development, offering a concrete example for how this theory could be empirically tested in the future.
Collapse
Affiliation(s)
- Andrea Schiavio
- School of Arts and Creative Technologies, University of York, York, United Kingdom
- Centre for Systematic Musicology, University of Graz, Graz, Austria
| | - Maria A. G. Witek
- Department of Music, School of Languages, Cultures, Art History and Music, University of Birmingham, Birmingham, United Kingdom
| | - Jan Stupacher
- Center for Music in the Brain, Aarhus University and The Royal Academy of Music Aarhus/Aalborg, Aarhus, Denmark
| |
Collapse
|
2
|
Kershenbaum AM, Galassi M, Shattuck-Hufnagel S, Bachan S, Zipse L. The Effect of Prosodic Timing Structure on Unison Production in People With Aphasia. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2023:1-27. [PMID: 38035543 DOI: 10.1044/2023_ajslp-22-00304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/02/2023]
Abstract
PURPOSE Unison production is a common aphasia treatment technique in which the clinician and the person with aphasia (PWA) produce phrases aloud together. It can be implemented using a typical "conversational," syntax-influenced prosodic timing structure, or with a "metrical," beat-based timing structure, but to date no study has directly compared these two approaches. This study compared the effects of metrical versus conversational prosodic timing during unison production on the (a) accuracy of participants' spoken output and (b) timing alignment of participants' productions with the stimuli. METHOD PWAs and controls listened to conversationally timed and metrically timed sentences and repeated them in unison with audio recordings. Productions were transcribed and scored in two ways: (a) Accuracy was calculated as the percentage of correctly produced syllables, and (b) timing alignment was determined by extracting the voice onset moment of identical target syllables in the unison stimuli and participant productions in both conditions and comparing the corresponding time points. RESULTS Metrical timing yielded a greater number of accurate syllables in both groups, with larger effect in PWAs than in controls. Both groups exhibited more anticipatory, less variable timing when speaking along with metrical stimuli, though evidence of such prediction was also present in the conversational condition. CONCLUSIONS Results suggest that unison production works via entrainment-a process that utilizes prediction to guide synchronous production of spoken output. Metrically regular stimuli may facilitate this process as they are more rhythmically predictable. Future work will examine key behavioral variables that predict benefit from unison production and metrical timing.
Collapse
Affiliation(s)
- Ayelet M Kershenbaum
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA
| | | | | | | | | |
Collapse
|
3
|
Rong P, Benson J. Intergenerational choral singing to improve communication outcomes in Parkinson's disease: Development of a theoretical framework and an integrated measurement tool. INTERNATIONAL JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2023; 25:722-745. [PMID: 36106430 DOI: 10.1080/17549507.2022.2110281] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Purpose: This study presented an initial step towards developing the evidence base for intergenerational choral singing as a communication-focussed rehabilitative approach for Parkinson's disease (PD).Method: A theoretical framework was established to conceptualise the rehabilitative effect of intergenerational choral singing on four domains of communication impairments - motor drive, timing mechanism, sensorimotor integration, higher-level cognitive and affective functions - as well as activity/participation, and quality of life. A computer-assisted multidimensional acoustic analysis was developed to objectively assess the targeted domains of communication impairments. Voice Handicap Index and the World Health Organization's Quality of Life assessment-abbreviated version were used to obtain patient-reported outcomes at the activity/participation and quality of life levels. As a proof of concept, a single subject with PD was recruited to participate in 9 weekly 1-h intergenerational choir rehearsals. The subject was assessed before, 1 week post, and 8 weeks post-choir.Result: Notable trends of improvement were observed in multiple domains of communication impairments at 1 week post-choir. Some improvements were maintained at 8 weeks post-choir. Patient-reported outcomes exhibited limited pre-post changes.Conclusion: This study provided the theoretical groundwork and an empirical measurement tool for future validation of intergenerational choral singing as a novel rehabilitation for PD.
Collapse
Affiliation(s)
- Panying Rong
- Department of Speech-Language-Hearing: Sciences & Disorders, University of Kansas, Lawrence, KS, USA and
| | | |
Collapse
|
4
|
Hong Y, Chen S, Zhou F, Chan A, Tang T. Phonetic entrainment in L2 human-robot interaction: an investigation of children with and without autism spectrum disorder. Front Psychol 2023; 14:1128976. [PMID: 37404579 PMCID: PMC10315851 DOI: 10.3389/fpsyg.2023.1128976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 05/19/2023] [Indexed: 07/06/2023] Open
Abstract
Phonetic entrainment is a phenomenon in which people adjust their phonetic features to approach those of their conversation partner. Individuals with Autism Spectrum Disorder (ASD) have been reported to show some deficits in entrainment during their interactions with human interlocutors, though deficits in terms of significant differences from typically developing (TD) controls were not always registered. One reason related to the inconsistencies of whether deficits are detected or not in autistic individuals is that the conversation partner's speech could hardly be controlled, and both the participants and the partners might be adjusting their phonetic features. The variabilities in the speech of conversation partners and various social traits exhibited might make the phonetic entrainment (if any) of the participants less detectable. In this study, we attempted to reduce the variability of the interlocutors by employing a social robot and having it do a goal-directed conversation task with children with and without ASD. Fourteen autistic children and 12 TD children participated the current study in their second language English. Results showed that autistic children showed comparable vowel formants and mean fundamental frequency (f0) entrainment as their TD peers, but they did not entrain their f0 range as the TD group did. These findings suggest that autistic children were capable of exhibiting phonetic entrainment behaviors similar to TD children in vowel formants and f0, particularly in a less complex situation where the speech features and social traits of the interlocutor were controlled. Furthermore, the utilization of a social robot may have increased the interest of these children in phonetic entrainment. On the other hand, entrainment of f0 range was more challenging for these autistic children even in a more controlled situation. This study demonstrates the viability and potential of using human-robot interactions as a novel method to evaluate abilities and deficits in phonetic entrainment in autistic children.
Collapse
Affiliation(s)
- Yitian Hong
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Si Chen
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- Department of Chinese and Bilingual Studies, Research Centre for Language, Cognition, and Neuroscience, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- Research Institute for Smart Ageing, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- The HK PolyU-PekingU Research Centre on Chinese Linguistics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Fang Zhou
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Angel Chan
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- Department of Chinese and Bilingual Studies, Research Centre for Language, Cognition, and Neuroscience, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
- The HK PolyU-PekingU Research Centre on Chinese Linguistics, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Tempo Tang
- Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| |
Collapse
|
5
|
Wynn CJ, Barrett TS, Borrie SA. Rhythm Perception, Speaking Rate Entrainment, and Conversational Quality: A Mediated Model. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2022; 65:2187-2203. [PMID: 35617456 PMCID: PMC9567410 DOI: 10.1044/2022_jslhr-21-00293] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Revised: 10/10/2021] [Accepted: 03/26/2022] [Indexed: 05/19/2023]
Abstract
PURPOSE Acoustic-prosodic entrainment, defined as the tendency for individuals to modify their speech behaviors to more closely align with the behaviors of their conversation partner, plays an important role in successful interaction. From a mechanistic perspective, acoustic-prosodic entrainment is, by its very nature, a rhythmic activity. Accordingly, it is highly plausible that an individual's rhythm perception abilities play a role in their ability to successfully entrain. Here, we examine the impact of rhythm perception in speaking rate entrainment and subsequent conversational quality. METHOD A round-robin paradigm was used to collect 90 dialogues from neurotypical adults. Additional assessments determined participants' rhythm perception abilities, social competence, and partner familiarity (i.e., whether the conversation partners knew each other prior to the interaction. Mediation analysis was used to examine the relationships between rhythm perception scores, speaking rate entrainment (using a measure of static local synchrony), and a measure of conversational success (i.e., conversational quality) based on third-party listener observations. Findings were compared to the same analysis with three additional predictive factors: participant gender, partner familiarity, and social competence. RESULTS Results revealed a relationship between rhythm perception and speaking rate entrainment. In unfamiliar conversation partners, there was a relationship between speaking rate entrainment and conversational quality. The relationships between entrainment and each of the three additional factors (i.e., gender, partner familiarity, and social competence) were nonsignificant. CONCLUSIONS In unfamiliar conversation partners, better rhythm perception abilities were indicative of increased conversational quality mediated by higher levels of speaking rate entrainment. These results support theoretical postulations specifying rhythm perception abilities as a component of acoustic-prosodic entrainment, which, in turn, facilitates conversational success. Knowledge of this relationship contributes to the development of a causal framework for considering a mechanism by which rhythm perception deficits in clinical populations may impact conversational success.
Collapse
Affiliation(s)
- Camille J. Wynn
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan, UT
| | | | - Stephanie A. Borrie
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan, UT
| |
Collapse
|
6
|
Musical improvisation enhances interpersonal coordination in subsequent conversation: Motor and speech evidence. PLoS One 2021; 16:e0250166. [PMID: 33857238 PMCID: PMC8049323 DOI: 10.1371/journal.pone.0250166] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2020] [Accepted: 03/31/2021] [Indexed: 11/19/2022] Open
Abstract
This study explored the effects of musical improvisation between dyads of same-sex strangers on subsequent behavioural alignment. Participants-all non-musicians-conversed before and after either improvising music together (Musical Improvisation-MI-group) or doing a motoric non-rhythmic cooperative task (building a tower together using wooden blocks; the Hands-Busy-HB-group). Conversations were free, but initially guided by an adaptation of the Fast Friends Questionnaire for inducing talk among students who are strangers and meeting for the first time. Throughout, participants' motion was recorded with an optical motion-capture system (Mocap) and analysed in terms of speed cross-correlations. Their conversations were also recorded on separate channels using headset microphones and were analysed in terms of the periodicity displayed by rhythmic peaks in the turn transitions across question and answer pairs (Q+A pairs). Compared with their first conversations, the MI group in the second conversations showed: (a) a very rapid, partially simultaneous anatomical coordination between 0 and 0.4 s; (b) delayed mirror motoric coordination between 0.8 and 1.5 s; and (c) a higher proportion of Periodic Q+A pairs. In contrast, the HB group's motoric coordination changed slightly in timing but not in degree of coordination between the first and second conversations, and there was no significant change in the proportion of periodic Q+A pairs they produced. These results show a convergent effect of prior musical interaction on joint body movement and use of shared periodicity across speech turn-transitions in conversations, suggesting that interaction in music and speech may be mediated by common processes.
Collapse
|
7
|
Santos TDD, Pardo JS, Bressmann T. Interlocutor accommodation of gradually altered nasal signal levels in a model speaker. PHONETICA 2021; 78:95-112. [PMID: 33651926 DOI: 10.1515/phon-2019-0105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/18/2019] [Accepted: 11/09/2020] [Indexed: 06/12/2023]
Abstract
BACKGROUND Phonetic accommodation is observed when interacting speakers gradually converge (or diverge) on phonetic features over the course of a conversation. The present experiment investigated whether gradual changes in the nasal signal levels of a pre-recorded model speaker would lead to accommodation in the nasalance scores of the interlocutor in a speech-shadowing experiment. METHODS Twenty female speakers in two groups repeated sentences after a pre-recorded model speaker whose nasal signal level was gradually increased or decreased over the course of the experiment. Outcome measures were the mean nasalance scores at the initial baseline, maximum nasal signal level, minimum nasal signal level and final baseline conditions. The order of presentation of the maximum and minimum nasal signal levels was varied between the two groups. RESULTS The results showed a significant effect of condition in F(3) = 2.86, p = 0.045. Both groups of participants demonstrated lower nasalance scores in response to increased nasal signal levels in the model (phonetic divergence). The group that was first presented with the maximum nasal signal levels demonstrated lower nasalance scores for the minimum nasal signal level condition (phonetic convergence). CONCLUSION Speakers showed a consistent divergent reaction to a more nasal-sounding model speaker, but their response to a less nasal-sounding model may depend on the order of presentation of the manipulations. More research is needed to investigate the effects of increased versus decreased nasality in the speech of an interlocutor.
Collapse
Affiliation(s)
- Telma Dias Dos Santos
- Department of Speech-Language Pathology, University of Toronto, Toronto, ON, Canada
- Department of Speech-Language Pathology, Pontifical Catholic University of São Paulo, São Paulo, SP, Brazil
| | - Jennifer S Pardo
- Department of Psychology, Montclair State University, Montclair, NJ, USA
| | - Tim Bressmann
- Department of Speech-Language Pathology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
8
|
Polyanskaya L, Busà MG, Ordin M. Capturing Cross-linguistic Differences in Macro-rhythm: The Case of Italian and English. LANGUAGE AND SPEECH 2020; 63:242-263. [PMID: 30864487 DOI: 10.1177/0023830919835849] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
We tested the hypothesis that languages can be classified by their degree of tonal rhythm (Jun, 2014). The tonal rhythms of English and Italian were quantified using the following parameters: (a) regularity of tonal alternations in time, measured as durational variability in peak-to-peak and valley-to-valley intervals; (b) magnitude of F0 excursions, measured as the range of frequencies covered by the speaker between consecutive F0 maxima and minima; (c) number of tonal target points per intonational unit; and (d) similarity of F0 rising and falling contours within intonational units. The results show that, as predicted by Jun's prosodic typology (2014), Italian has a stronger tonal rhythm than English, expressed by higher regularity in the distribution of F0 minima turning points, larger F0 excursions, and more frequent tonal targets, indicating alternating phonological H and L tones. This cross-language difference can be explained by the relative load of F0 and durational ratios on the perception and production of speech rhythm and prominence. We suggest that research on the role of speech rhythm in speech processing and language acquisition should not be restricted to syllabic rhythm, but should also examine the role of cross-language differences in tonal rhythm.
Collapse
Affiliation(s)
| | - Maria Grazia Busà
- Dipartimento di Studi Linguistici e Letterari (DiSLL), Università degli Studi di Padova, Italy
| | - Mikhail Ordin
- Basque Centre on Cognition, Brain and Language, Spain; Ikerbasque-Basque Foundation for Science, Spain
| |
Collapse
|
9
|
Wynn CJ, Borrie SA. Methodology Matters: The Impact of Research Design on Conversational Entrainment Outcomes. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2020; 63:1352-1360. [PMID: 32407655 PMCID: PMC7842120 DOI: 10.1044/2020_jslhr-19-00243] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Purpose Conversational entrainment describes the tendency for individuals to alter their communicative behaviors to more closely align with those of their conversation partner. This communication phenomenon has been widely studied, and thus, the methodologies used to examine it are diverse. Here, we summarize key differences in research design and present a test case to examine the effect of methodology on entrainment outcomes. Method Sixty neurotypical adults were randomly assigned to experimental groups formed by a 2 × 2 factorial combination of two independent variables: stimuli organization (blocked vs. random presentation) and stimuli modality (auditory-only vs. audiovisual stimuli). Individuals participated in a quasiconversational design in which the speech of a virtual interlocutor was manipulated to produce fast and slow speech rate conditions. Results There was a significant effect of stimuli organization on entrainment outcomes. Individuals in the blocked, but not the random, groups altered their speech rate to align with the speech rate of the virtual interlocutor. There were no effect of stimuli modality and no interaction between modality and organization on entrainment outcomes. Conclusion Findings highlight the importance of methodological decisions on entrainment outcomes. This underscores the need for more comprehensive research regarding entrainment methodology.
Collapse
Affiliation(s)
- Camille J. Wynn
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| | - Stephanie A. Borrie
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| |
Collapse
|
10
|
Olmstead AJ, Lee J, Viswanathan N. The Role of the Speaker, the Listener, and Their Joint Contributions During Communicative Interactions: A Tripartite View of Intelligibility in Individuals With Dysarthria. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2020; 63:1106-1114. [PMID: 32302251 DOI: 10.1044/2020_jslhr-19-00233] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Purpose We present a tripartite view of intelligibility in which the contributions of both the speaker and listener, as well as their joint effort during interaction, are considered. While considerable research has examined communicative interactions in situ, there is a critical gap in current knowledge on how speech intelligibility unfolds during such interactions. Here, we argue that research examining speech intelligibility in communicative interactions may provide important groundwork for advancement in clinical interventions for individuals with dysarthria. Method First, we describe the view and argue for its consideration as a powerful way of thinking about speech intelligibility. We then briefly situate the view in the relevant literature on speech intelligibility and existing theoretical frameworks. We then identify suitable methodological paradigms for studying joint contributions to intelligibility and, lastly, discuss the clinical application and potential impact of this tripartite view. Conclusions Speech communication occurs through interaction; however, in the laboratory and clinic, emphasis is usually placed on individual speakers and listeners. We have proposed that it is critical to consider how the joint contributions of speakers and listeners affect speech intelligibility in communicative interaction. This conceptualization is well aligned with the International Classification of Functioning, Disability and Health, and the findings from such an approach will allow us to better understand how to maximize available resources to enhance speech intelligibility.
Collapse
Affiliation(s)
- Annie J Olmstead
- Department of Communication Sciences and Disorders, Pennsylvania State University, University Park
| | - Jimin Lee
- Department of Communication Sciences and Disorders, Pennsylvania State University, University Park
| | - Navin Viswanathan
- Department of Communication Sciences and Disorders, Pennsylvania State University, University Park
| |
Collapse
|
11
|
Borrie SA, Barrett TS, Liss JM, Berisha V. Sync Pending: Characterizing Conversational Entrainment in Dysarthria Using a Multidimensional, Clinically Informed Approach. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2020; 63:83-94. [PMID: 31855608 PMCID: PMC7213480 DOI: 10.1044/2019_jslhr-19-00194] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2019] [Revised: 07/11/2019] [Accepted: 09/10/2019] [Indexed: 05/19/2023]
Abstract
Purpose Despite the import of conversational entrainment to successful spoken dialogue, the systematic characterization of this behavioral syncing phenomenon represents a critical gap in the field of speech pathology. The goal of this study was to acoustically characterize conversational entrainment in the context of dysarthria using a multidimensional approach previously validated in healthy populations (healthy conversations; Borrie, Barrett, Willi, & Berisha, 2019). Method A large corpus of goal-oriented conversations between participants with dysarthria and healthy participants (disordered conversations) was elicited using a "spot the difference" task. Expert clinical assessment of entrainment and a measure of conversational success (communicative efficiency) was obtained for each of the audio-recorded conversations. Conversational entrainment of acoustic features representing rhythmic, articulatory, and phonatory dimensions of speech was identified using cross-recurrence quantification analysis with clinically informed model parameters and validated with a sham condition involving conversational participants who did not converse with one another. The relationship between conversational entrainment and communicative efficiency was examined. Results Acoustic evidence of entrainment was observed in phonatory, but not rhythmic and articulatory, behavior, a finding that differs from healthy conversations in which entrainment was observed in all speech signal dimensions. This result, that disordered conversations showed less acoustic entrainment than healthy conversations, is corroborated by clinical assessment of entrainment in which the disordered conversations were rated, overall, as being less in sync than healthy conversations. Furthermore, acoustic entrainment was predictive of communicative efficiency, corroborated by a relationship between clinical assessment and the same outcome measure. Conclusions The findings confirm our hypothesis that the pathological speech production parameters of dysarthria disrupt the seemingly ubiquitous phenomenon of conversational entrainment, thus advancing entrainment deficits as an important variable in dysarthria, one that may have causative effects on the success of everyday communication. Results further reveal that while this approach provides a broad overview, methodologies for characterizing conversational entrainment in dysarthria must continue to be developed and refined, with a focus on clinical utility. Supplemental Material https://osf.io/ktg5q.
Collapse
Affiliation(s)
- Stephanie A. Borrie
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| | | | - Julie M. Liss
- Department of Speech and Hearing Science, Arizona State University, Tempe
| | - Visar Berisha
- Department of Speech and Hearing Science, Arizona State University, Tempe
- School of Electrical, Computer and Energy Engineering, Arizona State University, Tempe
| |
Collapse
|
12
|
Wynn CJ, Borrie SA, Pope KA. Going With the Flow: An Examination of Entrainment in Typically Developing Children. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2019; 62:3706-3713. [PMID: 31618138 PMCID: PMC7201337 DOI: 10.1044/2019_jslhr-s-19-0116] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Purpose Conversational entrainment is the tendency for individuals to modify their behavior to more closely converge with the behavior of their communication partner and is an important aspect of successful interaction. Evidence of entrainment in adults is robust, yet research regarding its development in children is sparse. Here, we investigate the emergence of entrainment skills in typically developing children. Method Data were collected from a total of 50 typically developing children between the ages of 5 and 14 years. Children participated in a quasiconversational paradigm with a virtual interlocutor. Speech rate of the interlocutor was digitally manipulated to produce fast and slow speech rate conditions. Results Data from the fast and slow conditions were compared using linear mixed models. Results indicated that children, regardless of age, did not alter their speech to match the rate of the virtual interlocutor. Conclusions Findings suggest that entrainment in children may not be as robust as entrainment in adults and therefore not adequately captured with the current experimental paradigm. Modifications to the current paradigm will help identify a methodology sufficiently sensitive to capture the speech alignment phenomenon in children and provide much needed information regarding the typical stages of entrainment development.
Collapse
Affiliation(s)
- Camille J. Wynn
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| | - Stephanie A. Borrie
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| | - Kiersten A. Pope
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| |
Collapse
|
13
|
Kory-Westlund JM, Breazeal C. A Long-Term Study of Young Children's Rapport, Social Emulation, and Language Learning With a Peer-Like Robot Playmate in Preschool. Front Robot AI 2019; 6:81. [PMID: 33501096 PMCID: PMC7806079 DOI: 10.3389/frobt.2019.00081] [Citation(s) in RCA: 26] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2019] [Accepted: 08/16/2019] [Indexed: 11/13/2022] Open
Abstract
Prior research has demonstrated the importance of children's peers for their learning and development. In particular, peer interaction, especially with more advanced peers, can enhance preschool children's language growth. In this paper, we explore one factor that may modulate children's language learning with a peer-like social robot: rapport. We explore connections between preschool children's learning, rapport, and emulation of the robot's language during a storytelling intervention. We performed a long-term field study in a preschool with 17 children aged 4-6 years. Children played a storytelling game with a social robot for 8 sessions over two months. For some children, the robot matched the level of its stories to the children's language ability, acting as a slightly more advanced peer (Matched condition); for the others, the robot did not match the story level (Unmatched condition). We examined children's use of target vocabulary words and key phrases used by the robot, children's emulation of the robot's stories during their own storytelling, and children's language style matching (LSM-a measure of overlap in function word use and speaking style associated with rapport and relationship) to see whether they mirrored the robot more over time. We found that not only did children emulate the robot more over time, but also, children who emulated more of the robot's phrases during storytelling scored higher on the vocabulary posttest. Children with higher LSM scores were more likely to emulate the robot's content words in their stories. Furthermore, the robot's personalization in the Matched condition led to increases in both children's emulation and their LSM scores. Together, these results suggest first, that interacting with a more advanced peer is beneficial for children, and second, that children's emulation of the robot's language may be related to their rapport and their learning. This is the first study to empirically support that rapport may be a modulating factor in children's peer learning, and furthermore, that a social robot can serve as an effective intervention for language development by leveraging this insight.
Collapse
|
14
|
Lubold N, Borrie SA, Barrett TS, Willi M, Berisha V. Do Conversational Partners Entrain on Articulatory Precision? INTERSPEECH 2019; 2019:1931-1935. [PMID: 34307640 PMCID: PMC8299429 DOI: 10.21437/interspeech.2019-1786] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The communication phenomenon known as conversational entrainment occurs when dialogue partners align or adapt their behavior to one another while conversing. Associated with rapport, trust, and communicative efficiency, entrainment appears to facilitate conversational success. In this work, we explore how conversational partners entrain or align on articulatory precision or the clarity with which speakers articulate their spoken productions. Articulatory precision also has implications for conversational success as precise articulation can enhance speech understanding and intelligibility. However, in conversational speech, speakers tend to reduce their articulatory precision, preferring low-cost, imprecise speech. Speakers may adapt their articulation and become more precise depending on feedback from their listeners. Given the potential of entrainment, we are interested in how conversational partners adapt or entrain their articulatory precision to one another. We explore this phenomenon in 57 task-based dialogues. Controlling for the influence of speaking rate, we find that speakers entrain on articulatory precision, with significant alignment on articulation of consonants. We discuss the potential applications that speaker alignment on precision might have for modeling conversation and implementing strategies for enhancing communicative success in human-human and human-computer interactions.
Collapse
Affiliation(s)
| | | | | | - Megan Willi
- California State University Chico, Chico, CA, USA
| | | |
Collapse
|
15
|
Kory-Westlund JM, Breazeal C. Exploring the Effects of a Social Robot's Speech Entrainment and Backstory on Young Children's Emotion, Rapport, Relationship, and Learning. Front Robot AI 2019; 6:54. [PMID: 33501069 PMCID: PMC7806080 DOI: 10.3389/frobt.2019.00054] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2019] [Accepted: 06/24/2019] [Indexed: 11/13/2022] Open
Abstract
In positive human-human relationships, people frequently mirror or mimic each other's behavior. This mimicry, also called entrainment, is associated with rapport and smoother social interaction. Because rapport in learning scenarios has been shown to lead to improved learning outcomes, we examined whether enabling a social robotic learning companion to perform rapport-building behaviors could improve children's learning and engagement during a storytelling activity. We enabled the social robot to perform two specific rapport and relationship-building behaviors: speech entrainment and self-disclosure (shared personal information in the form of a backstory about the robot's poor speech and hearing abilities). We recruited 86 children aged 3–8 years to interact with the robot in a 2 × 2 between-subjects experimental study testing the effects of robot entrainment Entrainment vs. No entrainment and backstory about abilities Backstory vs. No Backstory. The robot engaged the children one-on-one in conversation, told a story embedded with key vocabulary words, and asked children to retell the story. We measured children's recall of the key words and their emotions during the interaction, examined their story retellings, and asked children questions about their relationship with the robot. We found that the robot's entrainment led children to show more positive emotions and fewer negative emotions. Children who heard the robot's backstory were more likely to accept the robot's poor hearing abilities. Entrainment paired with backstory led children to use more of the key words and match more of the robot's phrases in their story retells. Furthermore, these children were more likely to consider the robot more human-like and were more likely to comply with one of the robot's requests. These results suggest that the robot's speech entrainment and backstory increased children's engagement and enjoyment in the interaction, improved their perception of the relationship, and contributed to children's success at retelling the story.
Collapse
Affiliation(s)
| | - Cynthia Breazeal
- MIT Media Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| |
Collapse
|
16
|
Lagrois MÉ, Palmer C, Peretz I. Poor Synchronization to Musical Beat Generalizes to Speech. Brain Sci 2019; 9:E157. [PMID: 31277417 PMCID: PMC6680836 DOI: 10.3390/brainsci9070157] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2019] [Accepted: 07/01/2019] [Indexed: 12/24/2022] Open
Abstract
The rhythmic nature of speech may recruit entrainment mechanisms in a manner similar to music. In the current study, we tested the hypothesis that individuals who display a severe deficit in synchronizing their taps to a musical beat (called beat-deaf here) would also experience difficulties entraining to speech. The beat-deaf participants and their matched controls were required to align taps with the perceived regularity in the rhythm of naturally spoken, regularly spoken, and sung sentences. The results showed that beat-deaf individuals synchronized their taps less accurately than the control group across conditions. In addition, participants from both groups exhibited more inter-tap variability to natural speech than to regularly spoken and sung sentences. The findings support the idea that acoustic periodicity is a major factor in domain-general entrainment to both music and speech. Therefore, a beat-finding deficit may affect periodic auditory rhythms in general, not just those for music.
Collapse
Affiliation(s)
- Marie-Élaine Lagrois
- International Laboratory for Brain, Music, and Sound Research, Montreal, QC H3C 3J7, Canada.
- Department of Psychology, University of Montreal, Montreal, QC H3C 3J7, Canada.
| | - Caroline Palmer
- International Laboratory for Brain, Music, and Sound Research, Montreal, QC H3C 3J7, Canada
- Department of Psychology, McGill University, Montreal, QC H3A 1B1, Canada
| | - Isabelle Peretz
- International Laboratory for Brain, Music, and Sound Research, Montreal, QC H3C 3J7, Canada
- Department of Psychology, University of Montreal, Montreal, QC H3C 3J7, Canada
| |
Collapse
|
17
|
Ordin M, Polyanskaya L, Gómez DM, Samuel AG. The Role of Native Language and the Fundamental Design of the Auditory System in Detecting Rhythm Changes. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2019; 62:835-852. [PMID: 30969888 DOI: 10.1044/2018_jslhr-s-18-0299] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Purpose We investigated whether rhythm discrimination is mainly driven by the native language of the listener or by the fundamental design of the human auditory system and universal cognitive mechanisms shared by all people irrespective of rhythmic patterns in their native language. Method In multiple experiments, we asked participants to listen to 2 continuous acoustic sequences and to determine whether their rhythms were the same or different (AX discrimination). Participants were native speakers of 4 languages with different rhythmic properties (Spanish, French, English, and German) to understand whether the predominant rhythmic patterns of a native language affect sensitivity, bias, and reaction time in detecting rhythmic changes in linguistic (Experiment 2) and in nonlinguistic (Experiments 1 and 2) acoustic sequences. We examined sensitivity and bias measures, as well as reaction times. We also computed Bayes factors in order to assess the effect of native language. Results All listeners performed better (i.e., responded faster and manifested higher sensitivity and accuracy) when detecting the presence or absence of a rhythm change when the 1st stimulus in an AX test pair exhibited regular rhythm (i.e., a syllable-timed rhythmic pattern) than when the 1st stimulus exhibited irregular rhythm (i.e., stress-timed rhythmic pattern). This result pattern was observed both on linguistic and nonlinguistic stimuli and was not modulated by the native language of the participant. Conclusion We conclude that rhythm change detection is a fundamental function of a processing system that relies on general auditory mechanisms and is not modulated by linguistic experience.
Collapse
Affiliation(s)
- Mikhail Ordin
- Basque Centre on Cognition, Brain and Language, Donostia, Spain
- Ikerbasque, Basque Foundation for Science, Bilbao, Spain
| | | | - David Maximiliano Gómez
- Institute of Educational Sciences, Universidad de O'Higgins, Rancagua, Chile
- Center for Advanced Research in Education, Universidad de Chile, Santiago
| | - Arthur G Samuel
- Basque Centre on Cognition, Brain and Language, Donostia, Spain
- Ikerbasque, Basque Foundation for Science, Bilbao, Spain
- Department of Psychology, Stony Brook University, NY
| |
Collapse
|
18
|
Borrie SA, Barrett TS, Willi MM, Berisha V. Syncing Up for a Good Conversation: A Clinically Meaningful Methodology for Capturing Conversational Entrainment in the Speech Domain. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2019; 62:283-296. [PMID: 30950701 PMCID: PMC6436892 DOI: 10.1044/2018_jslhr-s-18-0210] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Purpose Conversational entrainment, the phenomenon whereby communication partners synchronize their behavior, is considered essential for productive and fulfilling conversation. Lack of entrainment could, therefore, negatively impact conversational success. Although studied in many disciplines, entrainment has received limited attention in the field of speech-language pathology, where its implications may have direct clinical relevance. Method A novel computational methodology, informed by expert clinical assessment of conversation, was developed to investigate conversational entrainment across multiple speech dimensions in a corpus of experimentally elicited conversations involving healthy participants. The predictive relationship between the methodology output and an objective measure of conversational success, communicative efficiency, was then examined. Results Using a real versus sham validation procedure, we find evidence of sustained entrainment in rhythmic, articulatory, and phonatory dimensions of speech. We further validate the methodology, showing that models built on speech signal entrainment measures consistently outperform models built on nonentrained speech signal measures in predicting communicative efficiency of the conversations. Conclusions A multidimensional, clinically meaningful methodology for capturing conversational entrainment, validated in healthy populations, has implications for disciplines such as speech-language pathology where conversational entrainment represents a critical knowledge gap in the field, as well as a potential target for remediation.
Collapse
Affiliation(s)
- Stephanie A. Borrie
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| | - Tyson S. Barrett
- Department of Kinesiology and Health Sciences, Utah State University, Logan
| | - Megan M. Willi
- Department of Communication Sciences and Disorders, California State University, Chico
| | - Visar Berisha
- Department of Speech and Hearing Science, Arizona State University, Tempe
- School of Electrical, Computer and Energy Engineering, Arizona State University, Tempe
| |
Collapse
|
19
|
Judgments of Intelligence and Likability of Young Adult Female Speakers of American English: The Influence of Vocal Fry and the Surrounding Acoustic-Prosodic Context. J Voice 2018; 32:538-545. [DOI: 10.1016/j.jvoice.2017.08.002] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2017] [Revised: 07/29/2017] [Accepted: 08/01/2017] [Indexed: 11/21/2022]
|
20
|
Wynn CJ, Borrie SA, Sellers TP. Speech Rate Entrainment in Children and Adults With and Without Autism Spectrum Disorder. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2018; 27:965-974. [PMID: 29800942 PMCID: PMC6195024 DOI: 10.1044/2018_ajslp-17-0134] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2017] [Accepted: 01/24/2018] [Indexed: 05/16/2023]
Abstract
PURPOSE Conversational entrainment, a phenomenon whereby people modify their behaviors to match their communication partner, has been evidenced as critical to successful conversation. It is plausible that deficits in entrainment contribute to the conversational breakdowns and social difficulties exhibited by people with autism spectrum disorder (ASD). This study examined speech rate entrainment in children and adult populations with and without ASD. METHOD Sixty participants including typically developing children, children with ASD, typically developed adults, and adults with ASD participated in a quasi-conversational paradigm with a pseudoconfederate. The confederate's speech rate was digitally manipulated to create slow and fast speech rate conditions. RESULTS Typically developed adults entrained their speech rate in the quasi-conversational paradigm, using a faster rate during the fast speech rate conditions and a slower rate during the slow speech rate conditions. This entrainment pattern was not evident in adults with ASD or in children populations. CONCLUSION Findings suggest that speech rate entrainment is a developmentally acquired skill and offers preliminary evidence of speech rate entrainment deficits in adults with ASD. Impairments in this area may contribute to the conversational breakdowns and social difficulties experienced by this population. Future work is needed to advance this area of inquiry.
Collapse
Affiliation(s)
- Camille J Wynn
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| | - Stephanie A Borrie
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| | - Tyra P Sellers
- Department of Special Education and Rehabilitation, Utah State University, Logan
| |
Collapse
|
21
|
Freeman V, Pisoni DB. Speech rate, rate-matching, and intelligibility in early-implanted cochlear implant users. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2017; 142:1043. [PMID: 28863583 PMCID: PMC5566554 DOI: 10.1121/1.4998590] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/17/2017] [Revised: 07/19/2017] [Accepted: 07/26/2017] [Indexed: 05/09/2023]
Abstract
An important speech-language outcome for deaf people with cochlear implants is speech intelligibility-how well their speech is understood by others, which also affects social functioning. Beyond simply uttering recognizable words, other speech-language skills may affect communicative competence, including rate-matching or converging toward interlocutors' speech rates. This initial report examines speech rate-matching and its relations to intelligibility in 91 prelingually deaf cochlear implant users and 93 typically hearing peers age 3 to 27 years. Live-voice spoken sentences were repeated and later transcribed by multiple hearing listeners. Speech intelligibility was calculated as proportions of words correctly transcribed. For speech rate-matching measures, speech rates (syllables/s) were normalized as percentages faster or slower than examiners' speech rates. Cochlear implant users had slower speech rates, less accurate and less consistent rate-matching, and poorer speech intelligibility than hearing peers. Among cochlear implant users, speech rate and rate-matching were correlated with intelligibility: faster talkers and better rate-matchers were more intelligible. Rate-matching and intelligibility improved during preschool, with cochlear implant users delayed by about a year compared to hearing peers. By school-age, rate-matching and intelligibility were good overall, but delays persisted for many cochlear implant users. Interventions targeting rate-matching skills are therefore warranted in speech-language therapy for this population.
Collapse
Affiliation(s)
- Valerie Freeman
- Department of Communication Sciences and Disorders, Oklahoma State University, 042 Murray Hall, Stillwater, Oklahoma 74078, USA
| | - David B Pisoni
- Speech Research Laboratory, Department of Psychological and Brain Sciences, Indiana University, 1101 East 10th Street, Bloomington, Indiana 47405, USA
| |
Collapse
|
22
|
Borrie SA, Delfino CR. Conversational Entrainment of Vocal Fry in Young Adult Female American English Speakers. J Voice 2017; 31:513.e25-513.e32. [DOI: 10.1016/j.jvoice.2016.12.005] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2016] [Revised: 12/04/2016] [Accepted: 12/07/2016] [Indexed: 11/16/2022]
|
23
|
Duran ND, Fusaroli R. Conversing with a devil's advocate: Interpersonal coordination in deception and disagreement. PLoS One 2017; 12:e0178140. [PMID: 28574996 PMCID: PMC5456047 DOI: 10.1371/journal.pone.0178140] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2016] [Accepted: 05/09/2017] [Indexed: 11/19/2022] Open
Abstract
This study investigates the presence of dynamical patterns of interpersonal coordination in extended deceptive conversations across multimodal channels of behavior. Using a novel "devil's advocate" paradigm, we experimentally elicited deception and truth across topics in which conversational partners either agreed or disagreed, and where one partner was surreptitiously asked to argue an opinion opposite of what he or she really believed. We focus on interpersonal coordination as an emergent behavioral signal that captures interdependencies between conversational partners, both as the coupling of head movements over the span of milliseconds, measured via a windowed lagged cross correlation (WLCC) technique, and more global temporal dependencies across speech rate, using cross recurrence quantification analysis (CRQA). Moreover, we considered how interpersonal coordination might be shaped by strategic, adaptive conversational goals associated with deception. We found that deceptive conversations displayed more structured speech rate and higher head movement coordination, the latter with a peak in deceptive disagreement conversations. Together the results allow us to posit an adaptive account, whereby interpersonal coordination is not beholden to any single functional explanation, but can strategically adapt to diverse conversational demands.
Collapse
Affiliation(s)
- Nicholas D. Duran
- School of Social and Behavioral Sciences, Arizona State University, Glendale, Arizona, United States of America
| | | |
Collapse
|
24
|
Borrie SA, Lansford KL, Barrett TS. Rhythm Perception and Its Role in Perception and Learning of Dysrhythmic Speech. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2017; 60:561-570. [PMID: 28241307 DOI: 10.1044/2016_jslhr-s-16-0094] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/08/2016] [Accepted: 09/11/2016] [Indexed: 05/13/2023]
Abstract
PURPOSE The perception of rhythm cues plays an important role in recognizing spoken language, especially in adverse listening conditions. Indeed, this has been shown to hold true even when the rhythm cues themselves are dysrhythmic. This study investigates whether expertise in rhythm perception provides a processing advantage for perception (initial intelligibility) and learning (intelligibility improvement) of naturally dysrhythmic speech, dysarthria. METHOD Fifty young adults with typical hearing participated in 3 key tests, including a rhythm perception test, a receptive vocabulary test, and a speech perception and learning test, with standard pretest, familiarization, and posttest phases. Initial intelligibility scores were calculated as the proportion of correct pretest words, while intelligibility improvement scores were calculated by subtracting this proportion from the proportion of correct posttest words. RESULTS Rhythm perception scores predicted intelligibility improvement scores but not initial intelligibility. On the other hand, receptive vocabulary scores predicted initial intelligibility scores but not intelligibility improvement. CONCLUSIONS Expertise in rhythm perception appears to provide an advantage for processing dysrhythmic speech, but a familiarization experience is required for the advantage to be realized. Findings are discussed in relation to the role of rhythm in speech processing and shed light on processing models that consider the consequence of rhythm abnormalities in dysarthria.
Collapse
Affiliation(s)
- Stephanie A Borrie
- Department of Communicative Disorders and Deaf Education, Utah State University, Logan
| | - Kaitlin L Lansford
- School of Communication Sciences and Disorders, Florida State University, Tallahassee
| | | |
Collapse
|
25
|
Späth M, Aichert I, Ceballos-Baumann AO, Wagner-Sonntag E, Miller N, Ziegler W. Entraining with another person's speech rhythm: Evidence from healthy speakers and individuals with Parkinson's disease. CLINICAL LINGUISTICS & PHONETICS 2016; 30:68-85. [PMID: 26786186 DOI: 10.3109/02699206.2015.1115129] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
This study examines entrainment of speech timing and rhythm with a model speaker in healthy persons and individuals with Parkinson's. We asked whether participants coordinate their speech initiation and rhythm with the model speaker, and whether the regularity of metrical structure of sentences influences this behaviour. Ten native German speakers with hypokinetic dysarthria following Parkinson's and 10 healthy controls heard a sentence ('prime') and subsequently read aloud another sentence ('target'). Speech material comprised 32 metrically regular and irregular sentences, respectively. Turn-taking delays and alignment of speech rhythm were measured using speech wave analyses. Results showed that healthy participants initiated speech more closely in rhythm with the model speaker than patients. Metrically regular prime sentences induced anticipatory responses relative to metrically irregular primes. Entrainment of speech rhythm was greater in metrically regular targets, especially in individuals with Parkinson's. We conclude that individuals with Parkinson's may exploit metrically regular cues in speech.
Collapse
Affiliation(s)
- Mona Späth
- a Clinical Neuropsychology Research Group (EKN), Institute of Phonetics and Speech Processing , Ludwig-Maximilians-University Munich , Munich , Germany
| | - Ingrid Aichert
- a Clinical Neuropsychology Research Group (EKN), Institute of Phonetics and Speech Processing , Ludwig-Maximilians-University Munich , Munich , Germany
| | - Andrés O Ceballos-Baumann
- b Department of Neurology and Clinical Neurophysiology , Schön Klinik München Schwabing , Munich , Germany
| | - Edith Wagner-Sonntag
- b Department of Neurology and Clinical Neurophysiology , Schön Klinik München Schwabing , Munich , Germany
| | - Nick Miller
- c Institute of Health and Society, Newcastle University , Newcastle upon Tyne , Great Britain
| | - Wolfram Ziegler
- a Clinical Neuropsychology Research Group (EKN), Institute of Phonetics and Speech Processing , Ludwig-Maximilians-University Munich , Munich , Germany
| |
Collapse
|
26
|
Michael J, Bogart K, Tylén K, Krueger J, Bech M, Østergaard JR, Fusaroli R. Training in Compensatory Strategies Enhances Rapport in Interactions Involving People with Möbius Syndrome. Front Neurol 2015; 6:213. [PMID: 26500605 PMCID: PMC4597112 DOI: 10.3389/fneur.2015.00213] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2015] [Accepted: 09/18/2015] [Indexed: 11/13/2022] Open
Abstract
In the exploratory study reported here, we tested the efficacy of an intervention designed to train teenagers with Möbius syndrome (MS) to increase the use of alternative communication strategies (e.g., gestures) to compensate for their lack of facial expressivity. Specifically, we expected the intervention to increase the level of rapport experienced in social interactions by our participants. In addition, we aimed to identify the mechanisms responsible for any such increase in rapport. In the study, five teenagers with MS interacted with three naïve participants without MS before the intervention, and with three different naïve participants without MS after the intervention. Rapport was assessed by self-report and by behavioral coders who rated videos of the interactions. Individual non-verbal behavior was assessed via behavioral coders, whereas verbal behavior was automatically extracted from the sound files. Alignment was assessed using cross recurrence quantification analysis and mixed-effects models. The results showed that observer-coded rapport was greater after the intervention, whereas self-reported rapport did not change significantly. Observer-coded gesture and expressivity increased in participants with and without MS, whereas overall linguistic alignment decreased. Fidgeting and repetitiveness of verbal behavior also decreased in both groups. In sum, the intervention may impact non-verbal and verbal behavior in participants with and without MS, increasing rapport as well as overall gesturing, while decreasing alignment.
Collapse
Affiliation(s)
- John Michael
- Department of Cognitive Science, Central European University, Budapest, Hungary
- Center for Subjectivity Research, Copenhagen University, Copenhagen, Denmark
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark
| | - Kathleen Bogart
- School of Psychological Science, Oregon State University, Corvallis, OR, USA
| | - Kristian Tylén
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark
- Center for Semiotics, Aarhus University, Aarhus, Denmark
| | - Joel Krueger
- Department of Sociology, Philosophy, and Anthropology, University of Exeter, Exeter, UK
| | - Morten Bech
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark
| | | | - Riccardo Fusaroli
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark
- Center for Semiotics, Aarhus University, Aarhus, Denmark
| |
Collapse
|
27
|
Jiao Y, Berisha V, Tu M, Liss J. Convex weighting criteria for speaking rate estimation. IEEE/ACM TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING 2015; 23:1421-1430. [PMID: 26167516 PMCID: PMC4497798 DOI: 10.1109/taslp.2015.2434213] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Speaking rate estimation directly from the speech waveform is a long-standing problem in speech signal processing. In this paper, we pose the speaking rate estimation problem as that of estimating a temporal density function whose integral over a given interval yields the speaking rate within that interval. In contrast to many existing methods, we avoid the more difficult task of detecting individual phonemes within the speech signal and we avoid heuristics such as thresholding the temporal envelope to estimate the number of vowels. Rather, the proposed method aims to learn an optimal weighting function that can be directly applied to time-frequency features in a speech signal to yield a temporal density function. We propose two convex cost functions for learning the weighting functions and an adaptation strategy to customize the approach to a particular speaker using minimal training. The algorithms are evaluated on the TIMIT corpus, on a dysarthric speech corpus, and on the ICSI Switchboard spontaneous speech corpus. Results show that the proposed methods outperform three competing methods on both healthy and dysarthric speech. In addition, for spontaneous speech rate estimation, the result show a high correlation between the estimated speaking rate and ground truth values.
Collapse
Affiliation(s)
- Yishan Jiao
- Department of Speech and Hearing Science, Arizona State University
| | - Visar Berisha
- Department of Speech and Hearing Science, Arizona State University
| | - Ming Tu
- Department of Speech and Hearing Science, Arizona State University
| | - Julie Liss
- Department of Speech and Hearing Science, Arizona State University
| |
Collapse
|
28
|
Borrie SA, Lubold N, Pon-Barry H. Disordered speech disrupts conversational entrainment: a study of acoustic-prosodic entrainment and communicative success in populations with communication challenges. Front Psychol 2015; 6:1187. [PMID: 26321996 PMCID: PMC4532918 DOI: 10.3389/fpsyg.2015.01187] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2015] [Accepted: 07/27/2015] [Indexed: 11/13/2022] Open
Abstract
Conversational entrainment, a pervasive communication phenomenon in which dialogue partners adapt their behaviors to align more closely with one another, is considered essential for successful spoken interaction. While well-established in other disciplines, this phenomenon has received limited attention in the field of speech pathology and the study of communication breakdowns in clinical populations. The current study examined acoustic-prosodic entrainment, as well as a measure of communicative success, in three distinctly different dialogue groups: (i) healthy native vs. healthy native speakers (Control), (ii) healthy native vs. foreign-accented speakers (Accented), and (iii) healthy native vs. dysarthric speakers (Disordered). Dialogue group comparisons revealed significant differences in how the groups entrain on particular acoustic–prosodic features, including pitch, intensity, and jitter. Most notably, the Disordered dialogues were characterized by significantly less acoustic-prosodic entrainment than the Control dialogues. Further, a positive relationship between entrainment indices and communicative success was identified. These results suggest that the study of conversational entrainment in speech pathology will have essential implications for both scientific theory and clinical application in this domain.
Collapse
Affiliation(s)
- Stephanie A Borrie
- Human Interaction Lab, Department of Communicative Disorders and Deaf Education, Utah State University , Logan, UT, USA
| | - Nichola Lubold
- School of Computing, Informatics, and Decision Systems Engineering, Arizona State University , Tempe, AZ, USA
| | - Heather Pon-Barry
- Department of Computer Science, Mount Holyoke College , South Hadley, MA, USA
| |
Collapse
|
29
|
Fogg-Rogers L, Buetow S, Talmage A, McCann CM, Leão SHS, Tippett L, Leung J, McPherson KM, Purdy SC. Choral singing therapy following stroke or Parkinson's disease: an exploration of participants' experiences. Disabil Rehabil 2015. [PMID: 26200449 DOI: 10.3109/09638288.2015.1068875] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
PURPOSE People with stroke or Parkinson's disease (PD) live with reduced mood, social participation and quality of life (QOL). Communication difficulties affect 90% of people with PD (dysarthria) and over 33% of people with stroke (aphasia). These consequences are disabling in many ways. However, as singing is typically still possible, its therapeutic use is of increasing interest. This article explores the experiences of and factors influencing participation in choral singing therapy (CST) by people with stroke or PD and their significant others. METHOD Participants (eight people with stroke, six with PD) were recruited from a community music therapy choir running CST. Significant others (seven for stroke, two for PD) were also recruited. Supported communication methods were used as needed to undertake semi-structured interviews (total N = 23). RESULTS Thematic analysis indicated participants had many unmet needs associated with their condition, which motivated them to explore self-management options. CST participation was described as an enjoyable social activity, and participation was perceived as improving mood, language, breathing and voice. CONCLUSIONS Choral singing was perceived by people with stroke and PD to help them self-manage some of the consequences of their condition, including social isolation, low mood and communication difficulties. IMPLICATIONS FOR REHABILITATION Choral singing therapy (CST) is sought out by people with stroke and PD to help self-manage symptoms of their condition. Participation is perceived as an enjoyable activity which improves mood, voice and language symptoms. CST may enable access to specialist music therapy and speech language therapy protocols within community frameworks.
Collapse
Affiliation(s)
- Laura Fogg-Rogers
- a Science Communication Unit, University of the West of England , Bristol , UK .,b Centre for Brain Research, The University of Auckland , Auckland , New Zealand
| | - Stephen Buetow
- b Centre for Brain Research, The University of Auckland , Auckland , New Zealand
| | - Alison Talmage
- b Centre for Brain Research, The University of Auckland , Auckland , New Zealand
| | - Clare M McCann
- b Centre for Brain Research, The University of Auckland , Auckland , New Zealand .,c Department of Speech Science , School of Psychology, The University of Auckland , Auckland , New Zealand , and
| | - Sylvia H S Leão
- b Centre for Brain Research, The University of Auckland , Auckland , New Zealand .,c Department of Speech Science , School of Psychology, The University of Auckland , Auckland , New Zealand , and
| | - Lynette Tippett
- b Centre for Brain Research, The University of Auckland , Auckland , New Zealand
| | - Joan Leung
- b Centre for Brain Research, The University of Auckland , Auckland , New Zealand .,c Department of Speech Science , School of Psychology, The University of Auckland , Auckland , New Zealand , and
| | | | - Suzanne C Purdy
- b Centre for Brain Research, The University of Auckland , Auckland , New Zealand .,c Department of Speech Science , School of Psychology, The University of Auckland , Auckland , New Zealand , and
| |
Collapse
|