1
|
Machart L, Vilain A, Lœvenbruck H, Tiede M, Ménard L. Exposure to Canadian French Cued Speech Improves Consonant Articulation in Children With Cochlear Implants: Acoustic and Articulatory Data. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024:1-27. [PMID: 38457261 DOI: 10.1044/2023_jslhr-23-00078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/10/2024]
Abstract
PURPOSE One of the strategies that can be used to support speech communication in deaf children is cued speech, a visual code in which manual gestures are used as additional phonological information to supplement the acoustic and labial speech information. Cued speech has been shown to improve speech perception and phonological skills. This exploratory study aims to assess whether and how cued speech reading proficiency may also have a beneficial effect on the acoustic and articulatory correlates of consonant production in children. METHOD Eight children with cochlear implants (from 5 to 11 years of age) and with different receptive proficiency in Canadian French Cued Speech (three children with low receptive proficiency vs. five children with high receptive proficiency) are compared to 10 children with typical hearing (from 4 to 11 years of age) on their production of stop and fricative consonants. Articulation was assessed with ultrasound measurements. RESULTS The preliminary results reveal that cued speech proficiency seems to sustain the development of speech production in children with cochlear implants and to improve their articulatory gestures, particularly for the place contrast in stops as well as fricatives. CONCLUSION This work highlights the importance of studying objective data and comparing acoustic and articulatory measurements to better characterize speech production in children.
Collapse
Affiliation(s)
- Laura Machart
- Université Grenoble Alpes, CNRS, LPNC, France
- Université Grenoble Alpes, CNRS, Grenoble INP (Institute of Engineering), GIPSA-Lab, France
| | - Anne Vilain
- Université Grenoble Alpes, CNRS, Grenoble INP (Institute of Engineering), GIPSA-Lab, France
| | | | | | - Lucie Ménard
- Department of Linguistics, Université du Québec à Montréal, Canada
| |
Collapse
|
2
|
Zhang Z, Wei C, Cao K, Liu Y. Factors Affecting Visual-Only Speech Recognition in Individuals With Cochlear Implants. EAR, NOSE & THROAT JOURNAL 2024:1455613241234821. [PMID: 38404016 DOI: 10.1177/01455613241234821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/27/2024] Open
Abstract
Objectives: Several reports have underlined the benefits of speechreading (visual-only speech recognition) on speech recognition in individuals with hearing loss after cochlear implantation (CI). However, the factors that would affect the ability of speechreading are unclear. The aim of the present study is to assess the factors that affect speechreading abilities in CI users. Methods: A total of 104 participants were enrolled in this retrospective study. They viewed silent videos of sentences being spoken by a model and were tasked with repeating what they thought had been said. They were tested under audio-only and visual-only conditions. Factors (such as the age, the age of CI; <3 years old vs 3-8 years old; male vs female, etc) believed to affect speechreading abilities were analyzed. Results: The age range of the participants is 8 to 34 years. CI users showed significantly different speechreading abilities among themselves. The authors found that age and hearing loss at 3 to 8 years of age were positively related to superior speechreading recognition scores. Conclusions: CI users followed a more complex method of perceptual compensation. Those who have suffered hearing loss between 3 and 8 years of age are more sensitive to developing an advantage in speech recognition by using speechreading. Older age positively affects speechreading abilities; thus, the more experience CI has, the greater speechreading ability they may exhibit.
Collapse
Affiliation(s)
- Zhikai Zhang
- Department of Otolaryngology-Head and Neck Surgery, Beijing Chao-Yang Hospital, Capital Medical University, Beijing, China
- Department of Otolaryngology-Head and Neck Surgery, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Chaogang Wei
- Department of Otolaryngology-Head and Neck Surgery, Peking University First Hospital, Beijing, China
| | - Keli Cao
- Department of Otorhinolaryngology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences Peking Union Medical College, Beijing, China
| | - Yuhe Liu
- Department of Otolaryngology-Head and Neck Surgery, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| |
Collapse
|
3
|
Van Bogaert L, Machart L, Gerber S, Lœvenbruck H, Vilain A. Speech rehabilitation in children with cochlear implants using a multisensory (French Cued Speech) or a hearing-focused (Auditory Verbal Therapy) approach. Front Hum Neurosci 2023; 17:1152516. [PMID: 37250702 PMCID: PMC10219235 DOI: 10.3389/fnhum.2023.1152516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 03/31/2023] [Indexed: 05/31/2023] Open
Abstract
Introduction Early exposure to a rich linguistic environment is essential as soon as the diagnosis of deafness is made. Cochlear implantation (CI) allows children to have access to speech perception in their early years. However, it provides only partial acoustic information, which can lead to difficulties in perceiving some phonetic contrasts. This study investigates the contribution of two spoken speech and language rehabilitation approaches to speech perception in children with CI using a lexicality judgment task from the EULALIES battery. Auditory Verbal Therapy (AVT) is an early intervention program that relies on auditory learning to enhance hearing skills in deaf children with CI. French Cued Speech, also called Cued French (CF), is a multisensory communication tool that disambiguates lip reading by adding a manual gesture. Methods In this study, 124 children aged from 60 to 140 months were included: 90 children with typical hearing skills (TH), 9 deaf children with CI who had participated in an AVT program (AVT), 6 deaf children with CI with high Cued French reading skills (CF+), and 19 deaf children with CI with low Cued French reading skills (CF-). Speech perception was assessed using sensitivity (d') using both the hit and false alarm rates, as defined in signal-detection theory. Results The results show that children with cochlear implants from the CF- and CF+ groups have significantly lower performance compared to children with typical hearing (TH) (p < 0.001 and p = 0.033, respectively). Additionally, children in the AVT group also tended to have lower scores compared to TH children (p = 0.07). However, exposition to AVT and CF seems to improve speech perception. The scores of the children in the AVT and CF+ groups are closer to typical scores than those of children in the CF- group, as evidenced by a distance measure. Discussion Overall, the findings of this study provide evidence for the effectiveness of these two speech and language rehabilitation approaches, and highlight the importance of using a specific approach in addition to a cochlear implant to improve speech perception in children with cochlear implants.
Collapse
Affiliation(s)
- Lucie Van Bogaert
- Université Grenoble Alpes, Université Savoie Mont Blanc, CNRS, LPNC, Grenoble, France
- Université Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, Grenoble, France
| | - Laura Machart
- Université Grenoble Alpes, Université Savoie Mont Blanc, CNRS, LPNC, Grenoble, France
- Université Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, Grenoble, France
| | - Silvain Gerber
- Université Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, Grenoble, France
| | - Hélène Lœvenbruck
- Université Grenoble Alpes, Université Savoie Mont Blanc, CNRS, LPNC, Grenoble, France
| | - Anne Vilain
- Université Grenoble Alpes, CNRS, Grenoble INP, GIPSA-lab, Grenoble, France
| | - Consortium EULALIESCostaMaudGillet-PerretEstelleMacLeodAndrea A. N.MeloniGenevièvePuissantClarisseRoseYvanUniversité Grenoble Alpes, France; CRTLA, Centre Hospitalier Universitaire Grenoble Alpes, France; University of Alberta, Edmonton, Canada; Université Grenoble Alpes, France and Université de Montréal, Montréal, Canada; Université Grenoble Alpes, France; Memorial University, Newfoundland, Canada
| |
Collapse
|
4
|
Bayard C, Machart L, Strauß A, Gerber S, Aubanel V, Schwartz JL. Cued Speech Enhances Speech-in-Noise Perception. JOURNAL OF DEAF STUDIES AND DEAF EDUCATION 2019; 24:223-233. [PMID: 30809665 DOI: 10.1093/deafed/enz003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/26/2018] [Revised: 01/28/2019] [Accepted: 01/31/2019] [Indexed: 06/09/2023]
Abstract
Speech perception in noise remains challenging for Deaf/Hard of Hearing people (D/HH), even fitted with hearing aids or cochlear implants. The perception of sentences in noise by 20 implanted or aided D/HH subjects mastering Cued Speech (CS), a system of hand gestures complementing lip movements, was compared with the perception of 15 typically hearing (TH) controls in three conditions: audio only, audiovisual, and audiovisual + CS. Similar audiovisual scores were obtained for signal-to-noise ratios (SNRs) 11 dB higher in D/HH participants compared with TH ones. Adding CS information enabled D/HH participants to reach a mean score of 83% in the audiovisual + CS condition at a mean SNR of 0 dB, similar to the usual audio score for TH participants at this SNR. This confirms that the combination of lipreading and Cued Speech system remains extremely important for persons with hearing loss, particularly in adverse hearing conditions.
Collapse
Affiliation(s)
| | | | - Antje Strauß
- Zukunftskolleg, FB Sprachwissenschaft, University of Konstanz
| | | | | | | |
Collapse
|
5
|
Aparicio M, Peigneux P, Charlier B, Balériaux D, Kavec M, Leybaert J. The Neural Basis of Speech Perception through Lipreading and Manual Cues: Evidence from Deaf Native Users of Cued Speech. Front Psychol 2017; 8:426. [PMID: 28424636 PMCID: PMC5371603 DOI: 10.3389/fpsyg.2017.00426] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2016] [Accepted: 03/07/2017] [Indexed: 11/13/2022] Open
Abstract
We present here the first neuroimaging data for perception of Cued Speech (CS) by deaf adults who are native users of CS. CS is a visual mode of communicating a spoken language through a set of manual cues which accompany lipreading and disambiguate it. With CS, sublexical units of the oral language are conveyed clearly and completely through the visual modality without requiring hearing. The comparison of neural processing of CS in deaf individuals with processing of audiovisual (AV) speech in normally hearing individuals represents a unique opportunity to explore the similarities and differences in neural processing of an oral language delivered in a visuo-manual vs. an AV modality. The study included deaf adult participants who were early CS users and native hearing users of French who process speech audiovisually. Words were presented in an event-related fMRI design. Three conditions were presented to each group of participants. The deaf participants saw CS words (manual + lipread), words presented as manual cues alone, and words presented to be lipread without manual cues. The hearing group saw AV spoken words, audio-alone and lipread-alone. Three findings are highlighted. First, the middle and superior temporal gyrus (excluding Heschl's gyrus) and left inferior frontal gyrus pars triangularis constituted a common, amodal neural basis for AV and CS perception. Second, integration was inferred in posterior parts of superior temporal sulcus for audio and lipread information in AV speech, but in the occipito-temporal junction, including MT/V5, for the manual cues and lipreading in CS. Third, the perception of manual cues showed a much greater overlap with the regions activated by CS (manual + lipreading) than lipreading alone did. This supports the notion that manual cues play a larger role than lipreading for CS processing. The present study contributes to a better understanding of the role of manual cues as support of visual speech perception in the framework of the multimodal nature of human communication.
Collapse
Affiliation(s)
- Mario Aparicio
- Laboratory of Cognition, Language and Development, Centre de Recherches Neurosciences et Cognition, Université Libre de Bruxelles,Brussels, Belgium
| | - Philippe Peigneux
- Neuropsychology and Functional Neuroimaging Research Unit (UR2NF), Centre de Recherches Cognition et Neurosciences, Université Libre de Bruxelles,Brussels, Belgium
| | - Brigitte Charlier
- Laboratory of Cognition, Language and Development, Centre de Recherches Neurosciences et Cognition, Université Libre de Bruxelles,Brussels, Belgium
| | - Danielle Balériaux
- Department of Radiology, Clinics of Magnetic Resonance, Erasme HospitalBrussels, Belgium
| | - Martin Kavec
- Department of Radiology, Clinics of Magnetic Resonance, Erasme HospitalBrussels, Belgium
| | - Jacqueline Leybaert
- Laboratory of Cognition, Language and Development, Centre de Recherches Neurosciences et Cognition, Université Libre de Bruxelles,Brussels, Belgium
| |
Collapse
|
6
|
Pimperton H, Ralph-Lewis A, MacSweeney M. Speechreading in Deaf Adults with Cochlear Implants: Evidence for Perceptual Compensation. Front Psychol 2017; 8:106. [PMID: 28223951 PMCID: PMC5294775 DOI: 10.3389/fpsyg.2017.00106] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2016] [Accepted: 01/16/2017] [Indexed: 11/13/2022] Open
Abstract
Previous research has provided evidence for a speechreading advantage in congenitally deaf adults compared to hearing adults. A 'perceptual compensation' account of this finding proposes that prolonged early onset deafness leads to a greater reliance on visual, as opposed to auditory, information when perceiving speech which in turn results in superior visual speech perception skills in deaf adults. In the current study we tested whether previous demonstrations of a speechreading advantage for profoundly congenitally deaf adults with hearing aids, or no amplificiation, were also apparent in adults with the same deafness profile but who have experienced greater access to the auditory elements of speech via a cochlear implant (CI). We also tested the prediction that, in line with the perceptual compensation account, receiving a CI at a later age is associated with superior speechreading skills due to later implanted individuals having experienced greater dependence on visual speech information. We designed a speechreading task in which participants viewed silent videos of 123 single words spoken by a model and were required to indicate which word they thought had been said via a free text response. We compared congenitally deaf adults who had received CIs in childhood or adolescence (N = 15) with a comparison group of hearing adults (N = 15) matched on age and education level. The adults with CI showed significantly better scores on the speechreading task than the hearing comparison group. Furthermore, within the group of adults with CI, there was a significant positive correlation between age at implantation and speechreading performance; earlier implantation was associated with lower speechreading scores. These results are both consistent with the hypothesis of perceptual compensation in the domain of speech perception, indicating that more prolonged dependence on visual speech information in speech perception may lead to improvements in the perception of visual speech. In addition our study provides metrics of the 'speechreadability' of 123 words produced in British English: one derived from hearing adults (N = 61) and one from deaf adults with CI (N = 15). Evidence for the validity of these 'speechreadability' metrics come from correlations with visual lexical competition data.
Collapse
Affiliation(s)
- Hannah Pimperton
- Institute of Cognitive Neuroscience, University College London London, UK
| | - Amelia Ralph-Lewis
- Institute of Cognitive Neuroscience, University College London London, UK
| | - Mairéad MacSweeney
- Institute of Cognitive Neuroscience, University College LondonLondon, UK; Deafness, Cognition and Language Centre, University College LondonLondon, UK
| |
Collapse
|
7
|
Bernstein LE, Eberhardt SP, Auer ET. Audiovisual spoken word training can promote or impede auditory-only perceptual learning: prelingually deafened adults with late-acquired cochlear implants versus normal hearing adults. Front Psychol 2014; 5:934. [PMID: 25206344 PMCID: PMC4144091 DOI: 10.3389/fpsyg.2014.00934] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2014] [Accepted: 08/05/2014] [Indexed: 12/02/2022] Open
Abstract
Training with audiovisual (AV) speech has been shown to promote auditory perceptual learning of vocoded acoustic speech by adults with normal hearing. In Experiment 1, we investigated whether AV speech promotes auditory-only (AO) perceptual learning in prelingually deafened adults with late-acquired cochlear implants. Participants were assigned to learn associations between spoken disyllabic C(=consonant)V(=vowel)CVC non-sense words and non-sense pictures (fribbles), under AV and then AO (AV-AO; or counter-balanced AO then AV, AO-AV, during Periods 1 then 2) training conditions. After training on each list of paired-associates (PA), testing was carried out AO. Across all training, AO PA test scores improved (7.2 percentage points) as did identification of consonants in new untrained CVCVC stimuli (3.5 percentage points). However, there was evidence that AV training impeded immediate AO perceptual learning: During Period-1, training scores across AV and AO conditions were not different, but AO test scores were dramatically lower in the AV-trained participants. During Period-2 AO training, the AV-AO participants obtained significantly higher AO test scores, demonstrating their ability to learn the auditory speech. Across both orders of training, whenever training was AV, AO test scores were significantly lower than training scores. Experiment 2 repeated the procedures with vocoded speech and 43 normal-hearing adults. Following AV training, their AO test scores were as high as or higher than following AO training. Also, their CVCVC identification scores patterned differently than those of the cochlear implant users. In Experiment 1, initial consonants were most accurate, and in Experiment 2, medial consonants were most accurate. We suggest that our results are consistent with a multisensory reverse hierarchy theory, which predicts that, whenever possible, perceivers carry out perceptual tasks immediately based on the experience and biases they bring to the task. We point out that while AV training could be an impediment to immediate unisensory perceptual learning in cochlear implant patients, it was also associated with higher scores during training.
Collapse
Affiliation(s)
- Lynne E. Bernstein
- Communication Neuroscience Laboratory, Department of Speech and Hearing Science, George Washington UniversityWashington, DC, USA
| | | | | |
Collapse
|
8
|
Havy M, Nazzi T, Bertoncini J. Phonetic processing during the acquisition of new words in 3-to-6-year-old French-speaking deaf children with cochlear implants. JOURNAL OF COMMUNICATION DISORDERS 2013; 46:181-192. [PMID: 23295076 DOI: 10.1016/j.jcomdis.2012.12.002] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/23/2012] [Revised: 11/23/2012] [Accepted: 12/01/2012] [Indexed: 06/01/2023]
Abstract
UNLABELLED The present study explores phonetic processing in deaf children with cochlear implants (CIs) when they have to learn phonetically similar words. Forty-six 34-to-78-month-old French-speaking deaf children with CIs were tested on 16 different trials. In each trial, they were first trained with two word-object pairings, and then a third object was presented and labeled with one of the familiar words. Children were asked to match one of the previously labeled objects with the third (same-labeled) object. Each pair of words contrasted on either the initial consonant or the first vowel by one or several phonetic features. The results show that deaf children with CIs are able to establish a new referential link between a word and an object. However, their performance is lower than that previously observed in normal-hearing children (NH). In such a situation, they process contrasts involving several phonetic features correctly, but show difficulties with minimal contrasts. The ability to recruit fine phonetic sensitivity during word learning appears to be influenced mainly by duration of implant use, with an overall increase of performance during the 3 years after implantation. There was no chronological age effect, nor age at implantation effect on the quality of processing. Difficulty with minimal contrasts and the absence of any age at implantation effects in this age range are discussed in light of recent studies on lexical development. LEARNING OUTCOMES After reading this article, the reader will be able to recognize the perceptual skills of children with cochlear implants and distinguish those perceptual features that are difficult for the children to perceive.
Collapse
Affiliation(s)
- Mélanie Havy
- Université Paris Descartes, Sorbonne Paris Cité, Paris, France.
| | | | | |
Collapse
|