1
|
Plain B, Pielage H, Zekveld AA, Richter M, Bhuiyan TA, van de Ven SRB, Kramer SE. Incorporating Virtual Reality Agents During a Dichotic Speech Reception Task: Insights From the Heart. Ear Hear 2024:00003446-990000000-00354. [PMID: 39565283 DOI: 10.1097/aud.0000000000001597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2024]
Abstract
OBJECTIVES Listening effort is moderated by not only task difficulty, but also success importance. In real communication scenarios, success importance varies based upon the social context. However, in the laboratory, it can be challenging to manipulate social context without compromising experimental control. Outside of hearing sciences, studies have applied virtual reality (VR) to incorporate social context in a controlled and repeatable manner. Several of these studies have demonstrated that social manipulations in VR can reliably elicit changes in cardiovascular measures. Here, we investigated the effect of adding VR agents to a speech reception task, while measuring from the cardiovascular system. DESIGN Twenty-eight, normally hearing participants undertook a dichotic speech reception task. Sentences in stationary noise were presented dichotically, that is, different sentences presented simultaneously to each ear. Participants were tasked to either repeat one of the sentences (single-sentence condition) or both of the sentences (dual-sentence condition). The task was conducted under two VR conditions: (1) in the presence of agents, who provided sporadic performance feedback and (2) in the presence of nonagent controls, without any feedback given. Alongside task performance, we quantified changes in cardiovascular measures, relative to pretask baselines: heart rate variability, pre-ejection period, heart rate, and blood pressure. After each condition, participants rated their subjective effort, difficulty, performance, and engagement. RESULTS Performance and the subjective perception of performance were lower, while subjective effort and difficulty were higher, in the dual-sentence condition, compared with the single-sentence condition. Heart rate was the only cardiovascular measure that was sensitive to the experimental manipulations. Contrary to our expectations, heart rate increased in the nonagent control conditions, compared with the agent conditions. An exploratory analysis revealed heart rate fluctuations within a trial: heart rate was higher during the first 6 sec of the trial (reflecting the presentence masking noise and the sentence presentation) in the dual-sentence condition, compared with the single-sentence condition. CONCLUSIONS This study was the first to incorporate VR agents who provided performance feedback during a dichotic speech reception task. Our results suggest that the VR agents did not increase success importance, which could be attributed to a lack of realism of the agents. We also demonstrated that the cardiovascular response to experimental manipulations may differ depending on the data window selected for analysis.
Collapse
Affiliation(s)
- Bethany Plain
- Amsterdam University Medical Center, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
- Eriksholm Research Centre, Snekkersten, Denmark
| | - Hidde Pielage
- Amsterdam University Medical Center, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
- Eriksholm Research Centre, Snekkersten, Denmark
| | - Adriana A Zekveld
- Amsterdam University Medical Center, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Michael Richter
- School of Psychology, Faculty of Health, Liverpool John Moores University, Liverpool, United Kingdom
| | | | - Sjors R B van de Ven
- Amsterdam University Medical Center, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Sophia E Kramer
- Amsterdam University Medical Center, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| |
Collapse
|
2
|
Kondaurova MV, Smith A, Mishra R, Zheng Q, Kondaurova I, Francis AL, Sallee E. Empatica E4 Assessment of Child Physiological Measures of Listening Effort During Remote and In-Person Communication. Am J Audiol 2024:1-10. [PMID: 39374495 DOI: 10.1044/2024_aja-24-00078] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/09/2024] Open
Abstract
PURPOSE Telepractice is a growing service model that delivers aural rehabilitation to deaf and hard-of hearing children via telecommunications technology. Despite known benefits of telepractice, this delivery approach may increase patients' listening effort (LE) characterized as an allocation of cognitive resources toward an auditory task. The study tested techniques for collecting physiological measures of LE in normal-hearing (NH) children during remote (referred to as tele-) and in-person communication using the wearable Empatica E4 wristband. METHOD Participants were 10 children (age range: 9-12 years old) who came to two tele- and two in-person weekly sessions, order counterbalanced. During each session, the children heard a short passage read by the clinical provider, completed an auditory passage comprehension task, and self-rated their effort as a part of the larger study. Measures of electrodermal activity and blood volume pulse amplitude were collected from the child E4 wristband. RESULTS No differences in child subjective, physiological measures of LE or passage comprehension scores were found between in-person sessions and telesessions. However, an effect of treatment duration on subjective and physiological measures of LE was identified. Children self-reported a significant increase in LE over time. However, their physiological measures demonstrated a trend indicating a decrease in LE. A significant association between subjective measures and the passage comprehension task was found suggesting that those children who reported more effort demonstrated a higher proportion of correct responses. CONCLUSIONS The study demonstrated the feasibility of collection of physiological measures of LE in NH children during remote and in-person communication using the E4 wristband. The results suggest that measures of LE are multidimensional and may reflect different sources of, or cognitive responses to, increased listening demand. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.27122064.
Collapse
Affiliation(s)
- Maria V Kondaurova
- Department of Psychological and Brain Sciences, University of Louisville, KY
| | - Alan Smith
- Department of Otolaryngology Head and Neck Surgery and Communicative Disorders, University of Louisville, KY
| | - Ruchik Mishra
- Department of Electrical & Computer Engineering, J.B. Speed School of Engineering, University of Louisville, KY
| | - Qi Zheng
- Department of Bioinformatics and Biostatistics, School of Public Health & Information Sciences, University of Louisville, KY
| | - Irina Kondaurova
- Department of Bioinformatics and Biostatistics, School of Public Health & Information Sciences, University of Louisville, KY
| | - Alexander L Francis
- Department of Speech, Language, and Hearing Sciences, Purdue University, West Lafayette, IN
| | - Emily Sallee
- Department of Otolaryngology Head and Neck Surgery and Communicative Disorders, University of Louisville, KY
| |
Collapse
|
3
|
Ceuleers D, Degeest S, Swinnen F, Baudonck N, Kestens K, Dhooge I, Keppler H. Dual-Task Interference in the Assessment of Listening Effort: Results of Normal-Hearing Adults, Cochlear Implant Users, and Hearing Aid Users. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:3201-3216. [PMID: 39106210 DOI: 10.1044/2024_jslhr-23-00636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/09/2024]
Abstract
PURPOSE The purpose of the current study was to assess dual-task interference (i.e., changes between the dual-task and baseline condition) in a listening effort dual-task paradigm in normal-hearing (NH) adults, hearing aid (HA) users, and cochlear implant (CI) users. METHOD Three groups of 31 participants were included: (a) NH adults, (b) HA users, and (c) CI users. The dual-task paradigm consisted of a primary speech understanding task in a quiet condition, and a favorable and unfavorable noise condition, and a secondary visual memory task. Dual-task interference was calculated for both tasks, and participants were classified based on their patterns of interference. Descriptive analyses were established and differences between the three groups were examined. RESULTS The descriptive results showed varying patterns of dual-task interference between the three listening conditions. Most participants showed the pattern of visual memory interference (i.e., worse results for the secondary task in the dual-task condition and no difference for the primary task) in the quiet condition, whereas the pattern of speech understanding priority trade-off (i.e., worse results for the secondary task in the dual-task condition and better results for the primary task) was most prominent in the unfavorable noise condition. Particularly, in HA and CI users, this shift was seen. However, the patterns of dual-task interference were not statistically different between the three groups. CONCLUSIONS Results of this study may provide additional insight into the interpretation of dual-task paradigms for measuring listening effort in diverse participant groups. It highlights the importance of considering both the primary and secondary tasks for accurate interpretation of results. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.26409088.
Collapse
Affiliation(s)
| | | | - Freya Swinnen
- Department of Otorhinolaryngology, Head and Neck Surgery, Ghent University Hospital, Belgium
| | - Nele Baudonck
- Department of Otorhinolaryngology, Head and Neck Surgery, Ghent University Hospital, Belgium
| | - Katrien Kestens
- Department of Rehabilitation Sciences, Ghent University, Belgium
| | - Ingeborg Dhooge
- Department of Head and Skin, Ghent University, Belgium
- Department of Otorhinolaryngology, Head and Neck Surgery, Ghent University Hospital, Belgium
| | - Hannah Keppler
- Department of Otorhinolaryngology, Head and Neck Surgery, Ghent University Hospital, Belgium
- Department of Rehabilitation Sciences, Ghent University, Belgium
| |
Collapse
|
4
|
Keur-Huizinga L, Kramer SE, de Geus EJC, Zekveld AA. A Multimodal Approach to Measuring Listening Effort: A Systematic Review on the Effects of Auditory Task Demand on Physiological Measures and Their Relationship. Ear Hear 2024; 45:1089-1106. [PMID: 38880960 PMCID: PMC11325958 DOI: 10.1097/aud.0000000000001508] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Accepted: 03/18/2024] [Indexed: 06/18/2024]
Abstract
OBJECTIVES Listening effort involves the mental effort required to perceive an auditory stimulus, for example in noisy environments. Prolonged increased listening effort, for example due to impaired hearing ability, may increase risk of health complications. It is therefore important to identify valid and sensitive measures of listening effort. Physiological measures have been shown to be sensitive to auditory task demand manipulations and are considered to reflect changes in listening effort. Such measures include pupil dilation, alpha power, skin conductance level, and heart rate variability. The aim of the current systematic review was to provide an overview of studies to listening effort that used multiple physiological measures. The two main questions were: (1) what is the effect of changes in auditory task demand on simultaneously acquired physiological measures from various modalities? and (2) what is the relationship between the responses in these physiological measures? DESIGN Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, relevant articles were sought in PubMed, PsycInfo, and Web of Science and by examining the references of included articles. Search iterations with different combinations of psychophysiological measures were performed in conjunction with listening effort-related search terms. Quality was assessed using the Appraisal Tool for Cross-Sectional Studies. RESULTS A total of 297 articles were identified from three databases, of which 27 were included. One additional article was identified from reference lists. Of the total 28 included articles, 16 included an analysis regarding the relationship between the physiological measures. The overall quality of the included studies was reasonable. CONCLUSIONS The included studies showed that most of the physiological measures either show no effect to auditory task demand manipulations or a consistent effect in the expected direction. For example, pupil dilation increased, pre-ejection period decreased, and skin conductance level increased with increasing auditory task demand. Most of the relationships between the responses of these physiological measures were nonsignificant or weak. The physiological measures varied in their sensitivity to auditory task demand manipulations. One of the identified knowledge gaps was that the included studies mostly used tasks with high-performance levels, resulting in an underrepresentation of the physiological changes at lower performance levels. This makes it difficult to capture how the physiological responses behave across the full psychometric curve. Our results support the Framework for Understanding Effortful Listening and the need for a multimodal approach to listening effort. We furthermore discuss focus points for future studies.
Collapse
Affiliation(s)
- Laura Keur-Huizinga
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology—Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
- Department of Biological Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Sophia E. Kramer
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology—Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| | - Eco J. C. de Geus
- Department of Biological Psychology, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands
| | - Adriana A. Zekveld
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology—Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, The Netherlands
| |
Collapse
|
5
|
Niizato T, Nishiyama Y, Oka Y, Aung PT, Nomura S. Toward stressor-free stress estimation: The integrated information theory explains the information dynamics of stress. iScience 2024; 27:110583. [PMID: 39211542 PMCID: PMC11357877 DOI: 10.1016/j.isci.2024.110583] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Revised: 07/15/2024] [Accepted: 07/22/2024] [Indexed: 09/04/2024] Open
Abstract
Recent neurological studies have revealed several detailed stress mechanisms. However, the latent variables behind stress study still interpret stress responses as difficult. Therefore, we propose a stressor-free method of stress evaluation using Integrated Information Theory (IIT) to address these issues. We conducted experiments inducing acute stress responses against tasks with three levels of difficulty, easy, moderate, and difficult, to verify the IIT in stress study. The moderate condition was related to active coping with stress. By contrast, the easy and difficult conditions are related to passive stress coping. Especially, the easy condition seemed to cause boredom. Our results revealed that the degree of entangled system fluctuation was associated with the subjective ratings for the tasks. Interestingly, our method could also evaluate stress as a state of boredom that had not received much research attention. Our method can be an alternative stress estimation method to overcome the latent variable problem.
Collapse
Affiliation(s)
- Takayuki Niizato
- Department of Intelligent Interaction Technologies, Institute of Systems and Information Engineering, University of Tsukuba, Tsukuba, Ibaraki, Japan
| | - Yuta Nishiyama
- Department of Information and Management Systems Engineering, Nagaoka University of Technology, Nagaoka, Niigata, Japan
| | - Yuta Oka
- Department of Information and Management Systems Engineering, Nagaoka University of Technology, Nagaoka, Niigata, Japan
| | - Poe Thinzar Aung
- Department of Information and Management Systems Engineering, Nagaoka University of Technology, Nagaoka, Niigata, Japan
| | - Shusaku Nomura
- Department of Information and Management Systems Engineering, Nagaoka University of Technology, Nagaoka, Niigata, Japan
| |
Collapse
|
6
|
Xu S, Zhang H, Fan J, Jiang X, Zhang M, Guan J, Ding H, Zhang Y. Auditory Challenges and Listening Effort in School-Age Children With Autism: Insights From Pupillary Dynamics During Speech-in-Noise Perception. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:2410-2453. [PMID: 38861391 DOI: 10.1044/2024_jslhr-23-00553] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2024]
Abstract
PURPOSE This study aimed to investigate challenges in speech-in-noise (SiN) processing faced by school-age children with autism spectrum conditions (ASCs) and their impact on listening effort. METHOD Participants, including 23 Mandarin-speaking children with ASCs and 19 age-matched neurotypical (NT) peers, underwent sentence recognition tests in both quiet and noisy conditions, with a speech-shaped steady-state noise masker presented at 0-dB signal-to-noise ratio in the noisy condition. Recognition accuracy rates and task-evoked pupil responses were compared to assess behavioral performance and listening effort during auditory tasks. RESULTS No main effect of group was found on accuracy rates. Instead, significant effects emerged for autistic trait scores, listening conditions, and their interaction, indicating that higher trait scores were associated with poorer performance in noise. Pupillometric data revealed significantly larger and earlier peak dilations, along with more varied pupillary dynamics in the ASC group relative to the NT group, especially under noisy conditions. Importantly, the ASC group's peak dilation in quiet mirrored that of the NT group in noise. However, the ASC group consistently exhibited reduced mean dilations than the NT group. CONCLUSIONS Pupillary responses suggest a different resource allocation pattern in ASCs: An initial sharper and larger dilation may signal an intense, narrowed resource allocation, likely linked to heightened arousal, engagement, and cognitive load, whereas a subsequent faster tail-off may indicate a greater decrease in resource availability and engagement, or a quicker release of arousal and cognitive load. The presence of noise further accentuates this pattern. This highlights the unique SiN processing challenges children with ASCs may face, underscoring the importance of a nuanced, individual-centric approach for interventions and support.
Collapse
Affiliation(s)
- Suyun Xu
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-Being, Shanghai, China
| | - Hua Zhang
- Department of Child and Adolescent Psychiatry, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, China
| | - Juan Fan
- Department of Child and Adolescent Psychiatry, Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, China
| | - Xiaoming Jiang
- Institute of Linguistics, Shanghai International Studies University, China
| | - Minyue Zhang
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-Being, Shanghai, China
| | | | - Hongwei Ding
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-Being, Shanghai, China
| | - Yang Zhang
- Department of Speech-Language-Hearing Sciences and Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis
| |
Collapse
|
7
|
Keur-Huizinga L, Huizinga NA, Zekveld AA, Versfeld NJ, van de Ven SRB, van Dijk WAJ, de Geus EJC, Kramer SE. Effects of hearing acuity on psychophysiological responses to effortful speech perception. Hear Res 2024; 448:109031. [PMID: 38761554 DOI: 10.1016/j.heares.2024.109031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 05/02/2024] [Accepted: 05/13/2024] [Indexed: 05/20/2024]
Abstract
In recent studies, psychophysiological measures have been used as markers of listening effort, but there is limited research on the effect of hearing loss on such measures. The aim of the current study was to investigate the effect of hearing acuity on physiological responses and subjective measures acquired during different levels of listening demand, and to investigate the relationship between these measures. A total of 125 participants (37 males and 88 females, age range 37-72 years, pure-tone average hearing thresholds at the best ear between -5.0 to 68.8 dB HL and asymmetry between ears between 0.0 and 87.5 dB) completed a listening task. A speech reception threshold (SRT) test was used with target sentences spoken by a female voice masked by male speech. Listening demand was manipulated using three levels of intelligibility: 20 % correct speech recognition, 50 %, and 80 % (IL20 %/IL50 %/IL80 %, respectively). During the task, peak pupil dilation (PPD), heart rate (HR), pre-ejection period (PEP), respiratory sinus arrhythmia (RSA), and skin conductance level (SCL) were measured. For each condition, subjective ratings of effort, performance, difficulty, and tendency to give up were also collected. Linear mixed effects models tested the effect of intelligibility level, hearing acuity, hearing asymmetry, and tinnitus complaints on the physiological reactivity (compared to baseline) and subjective measures. PPD and PEP reactivity showed a non-monotonic relationship with intelligibility level, but no such effects were found for HR, RSA, or SCL reactivity. Participants with worse hearing acuity had lower PPD at all intelligibility levels and showed lower PEP baseline levels. Additionally, PPD and SCL reactivity were lower for participants who reported suffering from tinnitus complaints. For IL80 %, but not IL50 % or IL20 %, participants with worse hearing acuity rated their listening effort to be relatively high compared to participants with better hearing. The reactivity of the different physiological measures were not or only weakly correlated with each other. Together, the results suggest that hearing acuity may be associated with altered sympathetic nervous system (re)activity. Research using psychophysiological measures as markers of listening effort to study the effect of hearing acuity on such measures are best served by the use of the PPD and PEP.
Collapse
Affiliation(s)
- Laura Keur-Huizinga
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology - Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, De Boelelaan 1117, Amsterdam, the Netherlands; Department of Biological Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands.
| | - Nicole A Huizinga
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology - Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, De Boelelaan 1117, Amsterdam, the Netherlands; Department of Biological Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Adriana A Zekveld
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology - Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, De Boelelaan 1117, Amsterdam, the Netherlands
| | - Niek J Versfeld
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology - Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, De Boelelaan 1117, Amsterdam, the Netherlands
| | - Sjors R B van de Ven
- Department of Biological Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Wieke A J van Dijk
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology - Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, De Boelelaan 1117, Amsterdam, the Netherlands
| | - Eco J C de Geus
- Department of Biological Psychology, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Sophia E Kramer
- Amsterdam UMC location Vrije Universiteit Amsterdam, Otolaryngology - Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, De Boelelaan 1117, Amsterdam, the Netherlands
| |
Collapse
|
8
|
Silva BCS, Araújo ES, Valenti VE, Jacob LCB, Alvarenga KDF. The effects of auditory stimulation on heart rate variability in healthy individuals with normal hearing and with hearing loss: a systematic review and meta-analysis. Codas 2024; 36:e20230111. [PMID: 38836828 PMCID: PMC11189151 DOI: 10.1590/2317-1782/20242023111en] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2023] [Accepted: 01/03/2024] [Indexed: 06/06/2024] Open
Abstract
PURPOSE To analyze the effects of auditory stimulation on heart rate variability (HRV) indices in healthy individuals with normal hearing and with hearing loss, regardless of type and/or grade, by means of a systematic review. RESEARCH STRATEGIES This is a systematic review with a meta-analysis that addresses the following question: in healthy individuals with normal hearing and/or with hearing loss, what are the effects of auditory stimulation on HRV indices in comparison to silence? We consulted the Cochrane Library, Embase, LILACS, PubMed, Web of Science, and Scopus databases and the gray literature (Google Scholar, OpenGrey, and ProQuest). SELECTION CRITERIA There were no restrictions as to period or language of publication. DATA ANALYSIS We identified 451 records, an additional 261 in the gray literature, and five studies in a search through the references, resulting in a total of 717 records, with 171 duplicate records. After screening the titles and abstracts of 546 studies, we excluded 490 and considered 56 studies in full to assess their eligibility. RESULTS Nine of these studies were included in the systematic review, eight of which were suitable for the meta-analysis. CONCLUSION It is suggested that auditory stimulation may influence the RMSSD, pNN50, SDNN, RRTri and SD2 indices of HRV in healthy adults with normal hearing.
Collapse
Affiliation(s)
- Bárbara Cristiane Sordi Silva
- Departamento de Fonoaudiologia, Faculdade de Odontologia de Bauru – FOB, Universidade de São Paulo – USP - Bauru (SP), Brasil.
| | - Eliene Silva Araújo
- Departamento de Fonoaudiologia, Universidade Federal do Rio Grande do Norte – UFRN - Natal (RN), Brasil.
| | - Vitor Engrácia Valenti
- Departamento de Fonoaudiologia, Faculdade de Filosofia e Ciências, Universidade Estadual Paulista – UNESP - Marília (SP), Brasil.
| | - Lilian Cássia Bórnia Jacob
- Departamento de Fonoaudiologia, Faculdade de Odontologia de Bauru – FOB, Universidade de São Paulo – USP - Bauru (SP), Brasil.
| | - Katia de Freitas Alvarenga
- Departamento de Fonoaudiologia, Faculdade de Odontologia de Bauru – FOB, Universidade de São Paulo – USP - Bauru (SP), Brasil.
| |
Collapse
|
9
|
Green GD, Jacewicz E, Santosa H, Arzbecker LJ, Fox RA. Evaluating Speaker-Listener Cognitive Effort in Speech Communication Through Brain-to-Brain Synchrony: A Pilot Functional Near-Infrared Spectroscopy Investigation. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:1339-1359. [PMID: 38535722 DOI: 10.1044/2024_jslhr-23-00476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/09/2024]
Abstract
PURPOSE We explore a new approach to the study of cognitive effort involved in listening to speech by measuring the brain activity in a listener in relation to the brain activity in a speaker. We hypothesize that the strength of this brain-to-brain synchrony (coupling) reflects the magnitude of cognitive effort involved in verbal communication and includes both listening effort and speaking effort. We investigate whether interbrain synchrony is greater in native-to-native versus native-to-nonnative communication using functional near-infrared spectroscopy (fNIRS). METHOD Two speakers participated, a native speaker of American English and a native speaker of Korean who spoke English as a second language. Each speaker was fitted with the fNIRS cap and told short stories. The native English speaker provided the English narratives, and the Korean speaker provided both the nonnative (accented) English and Korean narratives. In separate sessions, fNIRS data were obtained from seven English monolingual participants ages 20-24 years who listened to each speaker's stories. After listening to each story in native and nonnative English, they retold the content, and their transcripts and audio recordings were analyzed for comprehension and discourse fluency, measured in the number of hesitations and articulation rate. No story retellings were obtained for narratives in Korean (an incomprehensible language for English listeners). Utilizing fNIRS technique termed sequential scanning, we quantified the brain-to-brain synchronization in each speaker-listener dyad. RESULTS For native-to-native dyads, multiple brain regions associated with various linguistic and executive functions were activated. There was a weaker coupling for native-to-nonnative dyads, and only the brain regions associated with higher order cognitive processes and functions were synchronized. All listeners understood the content of all stories, but they hesitated significantly more when retelling stories told in accented English. The nonnative speaker hesitated significantly more often than the native speaker and had a significantly slower articulation rate. There was no brain-to-brain coupling during listening to Korean, indicating a break in communication when listeners failed to comprehend the speaker. CONCLUSIONS We found that effortful speech processing decreased interbrain synchrony and delayed comprehension processes. The obtained brain-based and behavioral patterns are consistent with our proposal that cognitive effort in verbal communication pertains to both the listener and the speaker and that brain-to-brain synchrony can be an indicator of differences in their cumulative communicative effort. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.25452142.
Collapse
Affiliation(s)
- Geoff D Green
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | - Ewa Jacewicz
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | | | - Lian J Arzbecker
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| | - Robert A Fox
- Department of Speech and Hearing Science, The Ohio State University, Columbus
| |
Collapse
|
10
|
Plain B, Pielage H, Kramer SE, Richter M, Saunders GH, Versfeld NJ, Zekveld AA, Bhuiyan TA. Combining Cardiovascular and Pupil Features Using k-Nearest Neighbor Classifiers to Assess Task Demand, Social Context, and Sentence Accuracy During Listening. Trends Hear 2024; 28:23312165241232551. [PMID: 38549351 PMCID: PMC10981225 DOI: 10.1177/23312165241232551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Revised: 01/04/2024] [Accepted: 01/25/2024] [Indexed: 04/01/2024] Open
Abstract
In daily life, both acoustic factors and social context can affect listening effort investment. In laboratory settings, information about listening effort has been deduced from pupil and cardiovascular responses independently. The extent to which these measures can jointly predict listening-related factors is unknown. Here we combined pupil and cardiovascular features to predict acoustic and contextual aspects of speech perception. Data were collected from 29 adults (mean = 64.6 years, SD = 9.2) with hearing loss. Participants performed a speech perception task at two individualized signal-to-noise ratios (corresponding to 50% and 80% of sentences correct) and in two social contexts (the presence and absence of two observers). Seven features were extracted per trial: baseline pupil size, peak pupil dilation, mean pupil dilation, interbeat interval, blood volume pulse amplitude, pre-ejection period and pulse arrival time. These features were used to train k-nearest neighbor classifiers to predict task demand, social context and sentence accuracy. The k-fold cross validation on the group-level data revealed above-chance classification accuracies: task demand, 64.4%; social context, 78.3%; and sentence accuracy, 55.1%. However, classification accuracies diminished when the classifiers were trained and tested on data from different participants. Individually trained classifiers (one per participant) performed better than group-level classifiers: 71.7% (SD = 10.2) for task demand, 88.0% (SD = 7.5) for social context, and 60.0% (SD = 13.1) for sentence accuracy. We demonstrated that classifiers trained on group-level physiological data to predict aspects of speech perception generalized poorly to novel participants. Individually calibrated classifiers hold more promise for future applications.
Collapse
Affiliation(s)
- Bethany Plain
- Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands
- Eriksholm Research Centre, Snekkersten, Denmark
| | - Hidde Pielage
- Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands
- Eriksholm Research Centre, Snekkersten, Denmark
| | - Sophia E. Kramer
- Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands
| | - Michael Richter
- School of Psychology, Liverpool John Moores University, Liverpool, UK
| | - Gabrielle H. Saunders
- Manchester Centre for Audiology and Deafness (ManCAD), University of Manchester, Manchester, UK
| | - Niek J. Versfeld
- Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands
| | - Adriana A. Zekveld
- Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, the Netherlands
| | | |
Collapse
|
11
|
Slugocki C, Kuk F, Korhonen P. Alpha-Band Dynamics of Hearing Aid Wearers Performing the Repeat-Recall Test (RRT). Trends Hear 2024; 28:23312165231222098. [PMID: 38549287 PMCID: PMC10981257 DOI: 10.1177/23312165231222098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Revised: 11/28/2023] [Accepted: 12/06/2023] [Indexed: 04/01/2024] Open
Abstract
This study measured electroencephalographic activity in the alpha band, often associated with task difficulty, to physiologically validate self-reported effort ratings from older hearing-impaired listeners performing the Repeat-Recall Test (RRT)-an integrative multipart assessment of speech-in-noise performance, context use, and auditory working memory. Following a single-blind within-subjects design, 16 older listeners (mean age = 71 years, SD = 13, 9 female) with a moderate-to-severe degree of bilateral sensorineural hearing loss performed the RRT while wearing hearing aids at four fixed signal-to-noise ratios (SNRs) of -5, 0, 5, and 10 dB. Performance and subjective ratings of listening effort were assessed for complementary versions of the RRT materials with high/low availability of semantic context. Listeners were also tested with a version of the RRT that omitted the memory (i.e., recall) component. As expected, results showed alpha power to decrease significantly with increasing SNR from 0 through 10 dB. When tested with high context sentences, alpha was significantly higher in conditions where listeners had to recall the sentence materials compared to conditions where the recall requirement was omitted. When tested with low context sentences, alpha power was relatively high irrespective of the memory component. Within-subjects, alpha power was related to listening effort ratings collected across the different RRT conditions. Overall, these results suggest that the multipart demands of the RRT modulate both neural and behavioral measures of listening effort in directions consistent with the expected/designed difficulty of the RRT conditions.
Collapse
Affiliation(s)
- Christopher Slugocki
- Office of Research in Clinical Amplification (ORCA-USA), WS Audiology, Lisle, IL, USA
| | - Francis Kuk
- Office of Research in Clinical Amplification (ORCA-USA), WS Audiology, Lisle, IL, USA
| | - Petri Korhonen
- Office of Research in Clinical Amplification (ORCA-USA), WS Audiology, Lisle, IL, USA
| |
Collapse
|
12
|
Mohammadi Y, Østergaard J, Graversen C, Andersen OK, Biurrun Manresa J. Validity and reliability of self-reported and neural measures of listening effort. Eur J Neurosci 2023; 58:4357-4370. [PMID: 37984406 DOI: 10.1111/ejn.16187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 10/17/2023] [Accepted: 10/23/2023] [Indexed: 11/22/2023]
Abstract
Listening effort can be defined as a measure of cognitive resources used by listeners to perform a listening task. Various methods have been proposed to measure this effort, yet their reliability remains unestablished, a crucial step before their application in research or clinical settings. This study encompassed 32 participants undertaking speech-in-noise tasks across two sessions, approximately a week apart. They listened to sentences and word lists at varying signal-to-noise ratios (SNRs) (-9, -6, -3 and 0 dB), then retaining them for roughly 3 s. We evaluated the test-retest reliability of self-reported effort ratings, theta (4-7 Hz) and alpha (8-13 Hz) oscillatory power, suggested previously as neural markers of listening effort. Additionally, we examined the reliability of correct word percentages. Both relative and absolute reliability were assessed using intraclass correlation coefficients (ICC) and Bland-Altman analysis. We also computed the standard error of measurement (SEM) and smallest detectable change (SDC). Our findings indicated heightened frontal midline theta power for word lists compared to sentences during the retention phase under high SNRs (0 dB, -3 dB), likely indicating a greater memory load for word lists. We observed SNR's impact on alpha power in the right central region during the listening phase and frontal theta power during the retention phase in sentences. Overall, the reliability analysis demonstrated satisfactory between-session variability for correct words and effort ratings. However, neural measures (frontal midline theta power and right central alpha power) displayed substantial variability, even though group-level outcomes appeared consistent across sessions.
Collapse
Affiliation(s)
- Yousef Mohammadi
- Integrative Neuroscience, Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Jan Østergaard
- Department of Electronic Systems, Aalborg University, Aalborg, Denmark
| | - Carina Graversen
- Integrative Neuroscience, Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
- Center for Neuroplasticity and Pain (CNAP), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Ole Kaeseler Andersen
- Integrative Neuroscience, Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
- Center for Neuroplasticity and Pain (CNAP), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - José Biurrun Manresa
- Center for Neuroplasticity and Pain (CNAP), Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
- Institute for Research and Development in Bioengineering and Bioinformatics (IBB), CONICET-UNER, Oro Verde, Argentina
| |
Collapse
|
13
|
Aliakbaryhosseinabadi S, Keidser G, May T, Dau T, Wendt D, Rotger-Griful S. The Effects of Noise and Simulated Conductive Hearing Loss on Physiological Response Measures During Interactive Conversations. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2023; 66:4009-4024. [PMID: 37625145 DOI: 10.1044/2023_jslhr-23-00063] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/27/2023]
Abstract
PURPOSE The purpose of this work was to study the effects of background noise and hearing attenuation associated with earplugs on three physiological measures, assumed to be markers of effort investment and arousal, during interactive communication. METHOD Twelve pairs of older people (average age of 63.2 years) with age-adjusted normal hearing took part in a face-to-face communication to solve a Diapix task. Communication was held in different levels of babble noise (0, 60, and 70 dBA) and with two levels of hearing attenuation (0 and 25 dB) in quiet. The physiological measures obtained included pupil size, heart rate variability, and skin conductance. In addition, subjective ratings of perceived communication success, frustration, and effort were obtained. RESULTS Ratings of perceived success, frustration, and effort confirmed that communication was more difficult in noise and with approximately 25-dB hearing attenuation and suggested that the implemented levels of noise and hearing attenuation resulted in comparable communication difficulties. Background noise at 70 dBA and hearing attenuation both led to an initial increase in pupil size (associated with effort), but only the effect of the background noise was sustained throughout the conversation. The 25-dB hearing attenuation led to a significant decrease of the high-frequency power of heart rate variability and a significant increase of skin conductance level, measured as the average z value of the electrodermal activity amplitude. CONCLUSION This study demonstrated that several physiological measures appear to be viable indicators of changing communication conditions, with pupillometry and cardiovascular as well as electrodermal measures potentially being markers of communication difficulty.
Collapse
Affiliation(s)
- Susan Aliakbaryhosseinabadi
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
- Hearing System Section, Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Gitte Keidser
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
- Department of Behavioral Sciences and Learning, Linnaeus Center HEAD, Linköping University, Sweden
| | - Tobias May
- Hearing System Section, Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Torsten Dau
- Hearing System Section, Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark
| | - Dorothea Wendt
- Eriksholm Research Centre, Oticon A/S, Snekkersten, Denmark
- Hearing System Section, Department of Health Technology, Technical University of Denmark, Kongens Lyngby, Denmark
| | | |
Collapse
|
14
|
Manno FAM, Cheung P, Basnet V, Khan MS, Mao Y, Pan L, Ma V, Cho WC, Tian S, An Z, Feng Y, Cai YL, Pienkowski M, Lau C. Subtle alterations of vestibulomotor functioning in conductive hearing loss. Front Neurosci 2023; 17:1057551. [PMID: 37706156 PMCID: PMC10495589 DOI: 10.3389/fnins.2023.1057551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2022] [Accepted: 06/08/2023] [Indexed: 09/15/2023] Open
Abstract
Introduction Conductive hearing loss (CHL) attenuates the ability to transmit air conducted sounds to the ear. In humans, severe hearing loss is often accompanied by alterations to other neural systems, such as the vestibular system; however, the inter-relations are not well understood. The overall goal of this study was to assess vestibular-related functioning proxies in a rat CHL model. Methods Male Sprague-Dawley rats (N=134, 250g, 2months old) were used in a CHL model which produced a >20dB threshold shift induced by tympanic membrane puncture. Auditory brainstem response (ABRs) recordings were used to determine threshold depth at different times before and after CHL. ABR threshold depths were assessed both manually and by an automated ABR machine learning algorithm. Vestibular-related functioning proxy assessment was performed using the rotarod, balance beam, elevator vertical motion (EVM) and Ferris-wheel rotation (FWR) assays. Results The Pre-CHL (control) threshold depth was 27.92dB±11.58dB compared to the Post-CHL threshold depth of 50.69dB±13.98dB (mean±SD) across the frequencies tested. The automated ABR machine learning algorithm determined the following threshold depths: Pre-CHL=24.3dB, Post-CHL same day=56dB, Post-CHL 7 days=41.16dB, and Post-CHL 1 month=32.5dB across the frequencies assessed (1, 2, 4, 8, 16, and 32kHz). Rotarod assessment of motor function was not significantly different between pre and post-CHL (~1week) rats for time duration (sec) or speed (RPM), albeit the former had a small effect size difference. Balance beam time to transverse was significantly longer for post-CHL rats, likely indicating a change in motor coordination. Further, failure to cross was only noted for CHL rats. The defection count was significantly reduced for CHL rats compared to control rats following FWR, but not EVM. The total distance traveled during open-field examination after EVM was significantly different between control and CHL rats, but not for FWR. The EVM is associated with linear acceleration (acting in the vertical plane: up-down) stimulating the saccule, while the FWR is associated with angular acceleration (centrifugal rotation about a circular axis) stimulating both otolith organs and semicircular canals; therefore, the difference in results could reflect the specific vestibular-organ functional role. Discussion Less movement (EVM) and increase time to transverse (balance beam) may be associated with anxiety and alterations to defecation patterns (FWR) may result from autonomic disturbances due to the impact of hearing loss. In this regard, vestibulomotor deficits resulting in changes in balance and motion could be attributed to comodulation of auditory and vestibular functioning. Future studies should manipulate vestibular functioning directly in rats with CHL.
Collapse
Affiliation(s)
- Francis A. M. Manno
- Department of Physics, East Carolina University, Greenville, NC, United States
- Department of Biomedical Engineering, Center for Imaging Science, Whiting School of Engineering, Johns Hopkins University, Baltimore, MD, United States
- Center for Advanced Nuclear Safety and Sustainable Development, City University of Hong Kong, Kowloon, Hong Kong SAR, China
- Department of Physics, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Pikting Cheung
- Department of Physics, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Vardhan Basnet
- Department of Physics, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | | | - Yuqi Mao
- Department of Nautical Injury Prevention, Faculty of Navy Medicine, Second Military Medical University, Shanghai, China
| | - Leilei Pan
- Department of Nautical Injury Prevention, Faculty of Navy Medicine, Second Military Medical University, Shanghai, China
| | - Victor Ma
- Department of Clinical Oncology, Queen Elizabeth Hospital, Kowloon, Hong Kong SAR, China
| | - William C. Cho
- Department of Clinical Oncology, Queen Elizabeth Hospital, Kowloon, Hong Kong SAR, China
| | - Shile Tian
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
| | - Ziqi An
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
| | - Yanqiu Feng
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
- Guangdong Provincial Key Laboratory of Medical Image Processing and Guangdong Province Engineering Laboratory for Medical Imaging and Diagnostic Technology, Southern Medical University, Guangzhou, China
- Key Laboratory of Mental Health of the Ministry of Education, Guangdong-Hong Kong-Macao Greater Bay Area Center for Brain Science and Brain-Inspired Intelligence, Guangdong Province Key Laboratory of Psychiatric Disorders, Department of Neurobiology, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China
| | - Yi-Ling Cai
- Department of Physics, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| | - Martin Pienkowski
- Osborne College of Audiology, Salus University, Elkins Park, PA, United States
| | - Condon Lau
- Center for Advanced Nuclear Safety and Sustainable Development, City University of Hong Kong, Kowloon, Hong Kong SAR, China
- Department of Physics, City University of Hong Kong, Kowloon, Hong Kong SAR, China
| |
Collapse
|
15
|
Sparks S, Pinto J, Hayes G, Spitschan M, Bulte DP. The impact of Alzheimer's disease risk factors on the pupillary light response. Front Neurosci 2023; 17:1248640. [PMID: 37650103 PMCID: PMC10463762 DOI: 10.3389/fnins.2023.1248640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Accepted: 07/31/2023] [Indexed: 09/01/2023] Open
Abstract
Alzheimer's disease (AD) is the leading cause of dementia, and its prevalence is increasing and is expected to continue to increase over the next few decades. Because of this, there is an urgent requirement to determine a way to diagnose the disease, and to target interventions to delay and ideally stop the onset of symptoms, specifically those impacting cognition and daily livelihood. The pupillary light response (PLR) is controlled by the sympathetic and parasympathetic branches of the autonomic nervous system, and impairments to the pupillary light response (PLR) have been related to AD. However, most of these studies that assess the PLR occur in patients who have already been diagnosed with AD, rather than those who are at a higher risk for the disease but without a diagnosis. Determining whether the PLR is similarly impaired in subjects before an AD diagnosis is made and before cognitive symptoms of the disease begin, is an important step before using the PLR as a diagnostic tool. Specifically, identifying whether the PLR is impaired in specific at-risk groups, considering both genetic and non-genetic risk factors, is imperative. It is possible that the PLR may be impaired in association with some risk factors but not others, potentially indicating different pathways to neurodegeneration that could be distinguished using PLR. In this work, we review the most common genetic and lifestyle-based risk factors for AD and identify established relationships between these risk factors and the PLR. The evidence here shows that many AD risk factors, including traumatic brain injury, ocular and intracranial hypertension, alcohol consumption, depression, and diabetes, are directly related to changes in the PLR. Other risk factors currently lack sufficient literature to make any conclusions relating directly to the PLR but have shown links to impairments in the parasympathetic nervous system; further research should be conducted in these risk factors and their relation to the PLR.
Collapse
Affiliation(s)
- Sierra Sparks
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, United Kingdom
| | - Joana Pinto
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, United Kingdom
| | - Genevieve Hayes
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, United Kingdom
| | - Manuel Spitschan
- TUM Department of Sport and Health Sciences (TUM SG), Chronobiology and Health, Technical University of Munich, Munich, Germany
- TUM Institute for Advanced Study (TUM-IAS), Technical University of Munich, Garching, Germany
- Max Planck Institute for Biological Cybernetics, Translational Sensory and Circadian Neuroscience, Tübingen, Germany
| | - Daniel P. Bulte
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
16
|
Cui ME, Herrmann B. Eye Movements Decrease during Effortful Speech Listening. J Neurosci 2023; 43:5856-5869. [PMID: 37491313 PMCID: PMC10423048 DOI: 10.1523/jneurosci.0240-23.2023] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2023] [Revised: 06/09/2023] [Accepted: 07/18/2023] [Indexed: 07/27/2023] Open
Abstract
Hearing impairment affects many older adults but is often diagnosed decades after speech comprehension in noisy situations has become effortful. Accurate assessment of listening effort may thus help diagnose hearing impairment earlier. However, pupillometry-the most used approach to assess listening effort-has limitations that hinder its use in practice. The current study explores a novel way to assess listening effort through eye movements. Building on cognitive and neurophysiological work, we examine the hypothesis that eye movements decrease when speech listening becomes challenging. In three experiments with human participants from both sexes, we demonstrate, consistent with this hypothesis, that fixation duration increases and spatial gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (simple sentences, naturalistic stories). In contrast, pupillometry was less sensitive to speech masking during story listening, suggesting pupillometric measures may not be as effective for the assessments of listening effort in naturalistic speech-listening paradigms. Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in the brain regions that support the regulation of eye movements, such as frontal eye field and superior colliculus, are modulated when listening is effortful.SIGNIFICANCE STATEMENT Assessment of listening effort is critical for early diagnosis of age-related hearing loss. Pupillometry is most used but has several disadvantages. The current study explores a novel way to assess listening effort through eye movements. We examine the hypothesis that eye movements decrease when speech listening becomes effortful. We demonstrate, consistent with this hypothesis, that fixation duration increases and gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (sentences, naturalistic stories). Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in brain regions that support the regulation of eye movements are modulated when listening is effortful.
Collapse
Affiliation(s)
- M Eric Cui
- Rotman Research Institute, Baycrest Academy for Research and Education, North York, Ontario M6A 2E1, Canada
- Department of Psychology, University of Toronto, Toronto, Ontario M5S 1A1, Canada
| | - Björn Herrmann
- Rotman Research Institute, Baycrest Academy for Research and Education, North York, Ontario M6A 2E1, Canada
- Department of Psychology, University of Toronto, Toronto, Ontario M5S 1A1, Canada
| |
Collapse
|
17
|
Cartocci G, Inguscio BMS, Giliberto G, Vozzi A, Giorgi A, Greco A, Babiloni F, Attanasio G. Listening Effort in Tinnitus: A Pilot Study Employing a Light EEG Headset and Skin Conductance Assessment during the Listening to a Continuous Speech Stimulus under Different SNR Conditions. Brain Sci 2023; 13:1084. [PMID: 37509014 PMCID: PMC10377270 DOI: 10.3390/brainsci13071084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 07/07/2023] [Accepted: 07/13/2023] [Indexed: 07/30/2023] Open
Abstract
Background noise elicits listening effort. What else is tinnitus if not an endogenous background noise? From such reasoning, we hypothesized the occurrence of increased listening effort in tinnitus patients during listening tasks. Such a hypothesis was tested by investigating some indices of listening effort through electroencephalographic and skin conductance, particularly parietal and frontal alpha and electrodermal activity (EDA). Furthermore, tinnitus distress questionnaires (THI and TQ12-I) were employed. Parietal alpha values were positively correlated to TQ12-I scores, and both were negatively correlated to EDA; Pre-stimulus frontal alpha correlated with the THI score in our pilot study; finally, results showed a general trend of increased frontal alpha activity in the tinnitus group in comparison to the control group. Parietal alpha during the listening to stimuli, positively correlated to the TQ12-I, appears to reflect a higher listening effort in tinnitus patients and the perception of tinnitus symptoms. The negative correlation between both listening effort (parietal alpha) and tinnitus symptoms perception (TQ12-I scores) with EDA levels could be explained by a less responsive sympathetic nervous system to prepare the body to expend increased energy during the "fight or flight" response, due to pauperization of energy from tinnitus perception.
Collapse
Affiliation(s)
- Giulia Cartocci
- Department of Molecular Medicine, Sapienza University of Rome, 00161 Rome, Italy
- Department of Research and Development, BrainSigns Ltd., 00198 Rome, Italy
| | - Bianca Maria Serena Inguscio
- Department of Research and Development, BrainSigns Ltd., 00198 Rome, Italy
- Department of Human Neuroscience, Sapienza University of Rome, 00185 Rome, Italy
| | - Giovanna Giliberto
- Department of Molecular Medicine, Sapienza University of Rome, 00161 Rome, Italy
| | - Alessia Vozzi
- Department of Research and Development, BrainSigns Ltd., 00198 Rome, Italy
- SAIMLAL Department, Sapienza University of Rome, 00185 Rome, Italy
| | - Andrea Giorgi
- Department of Research and Development, BrainSigns Ltd., 00198 Rome, Italy
- SAIMLAL Department, Sapienza University of Rome, 00185 Rome, Italy
| | - Antonio Greco
- Department of Sense Organs, Sapienza University of Rome, 00161 Rome, Italy
| | - Fabio Babiloni
- Department of Molecular Medicine, Sapienza University of Rome, 00161 Rome, Italy
- Department of Research and Development, BrainSigns Ltd., 00198 Rome, Italy
- Department of Computer Science, Hangzhou Dianzi University, Hangzhou 310005, China
| | | |
Collapse
|
18
|
Du EY, Jiang K, Carlson MC, Reed NS, Deal JA. Hearing Impairment and Allostatic Load in Older Adults. JAMA Otolaryngol Head Neck Surg 2023; 149:597-606. [PMID: 37200015 PMCID: PMC10196929 DOI: 10.1001/jamaoto.2023.0948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2023] [Accepted: 03/24/2023] [Indexed: 05/19/2023]
Abstract
Importance Allostatic load, the cumulative strain that results from the chronic stress response, is associated with poor health outcomes. Increased cognitive load and impaired communication associated with hearing loss could potentially be associated with higher allostatic load, but few studies to date have quantified this association. Objective To investigate if audiometric hearing loss is associated with allostatic load and evaluate if the association varies by demographic factors. Design, Setting, Participants This cross-sectional survey used nationally representative data from the National Health and Nutrition Examination Survey. Audiometric testing was conducted from 2003 to 2004 (ages 20-69 years) and 2009 to 2010 (70 years or older). The study was restricted to participants aged 50 years or older, and the analysis was stratified based on cycle. The data were analyzed between October 2021 and October 2022. Exposure A 4-frequency (0.5-4.0 kHz) pure tone average was calculated in the better-hearing ear and modeled continuously and categorically (<25 dB hearing level [dB HL], no hearing loss; 26-40 dB HL, mild hearing loss; ≥41 dB HL, moderate or greater hearing loss). Main Outcome and Measures Allostatic load score (ALS) was defined using laboratory measurements of 8 biomarkers (systolic/diastolic blood pressure, body mass index [calculated as weight in kilograms divided by height in meters squared], and total serum and high-density lipoprotein cholesterol, glycohemoglobin, albumin, and C-reactive protein levels). Each biomarker was assigned a point if it was in the highest risk quartile based on statistical distribution and then summed to yield the ALS (range, 0-8). Linear regression models adjusted for demographic and clinical covariates. Sensitivity analysis included using clinical cut points for ALS and subgroup stratification. Results In 1412 participants (mean [SD] age, 59.7 [5.9] years; 293 women [51.9%]; 130 [23.0%] Hispanic, 89 [15.8%] non-Hispanic Black, and 318 [55.3%] non-Hispanic White individuals), a modest association was suggested between hearing loss and ALS (ages 50-69 years: β = 0.19 [95% CI, 0.02-0.36] per 10 dB HL; 70 years or older: β = 0.10 [95% CI, 0.02-0.18] per 10 dB HL) among non-hearing aid users. Results were not clearly reflected in the sensitivity analysis with clinical cut points for ALS or modeling hearing loss categorically. Sex-based stratifications identified a stronger association among male individuals (men 70 years or older: β = 0.22 [95% CI, 0.12-0.32] per 10 dB HL; women: β = 0.08 [95% CI, -0.04 to 0.20] per 10 dB HL). Conclusion and Relevance The study findings did not clearly support an association between hearing loss and ALS. While hearing loss has been shown to be associated with increased risk for numerous health comorbidities, its association with the chronic stress response and allostasis may be less than that of other health conditions.
Collapse
Affiliation(s)
- Eric Y. Du
- Cochlear Center for Hearing and Public Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Kening Jiang
- Cochlear Center for Hearing and Public Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Michelle C. Carlson
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
- Department of Mental Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Nicholas S. Reed
- Cochlear Center for Hearing and Public Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| | - Jennifer A. Deal
- Cochlear Center for Hearing and Public Health, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
- Department of Epidemiology, Johns Hopkins Bloomberg School of Public Health, Baltimore, Maryland
| |
Collapse
|
19
|
Venkitakrishnan S, Wu YH. Facial Expressions as an Index of Listening Difficulty and Emotional Response. Semin Hear 2023; 44:166-187. [PMID: 37122878 PMCID: PMC10147507 DOI: 10.1055/s-0043-1766104] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/07/2023] Open
Abstract
Knowledge about listening difficulty experienced during a task can be used to better understand speech perception processes, to guide amplification outcomes, and can be used by individuals to decide whether to participate in communication. Another factor affecting these decisions is individuals' emotional response which has not been measured objectively previously. In this study, we describe a novel method of measuring listening difficulty and affect of individuals in adverse listening situations using automatic facial expression algorithm. The purpose of our study was to determine if facial expressions of confusion and frustration are sensitive to changes in listening difficulty. We recorded speech recognition scores, facial expressions, subjective listening effort scores, and subjective emotional responses in 33 young participants with normal hearing. We used the signal-to-noise ratios of -1, +2, and +5 dB SNR and quiet conditions to vary the difficulty level. We found that facial expression of confusion and frustration increased with increase in difficulty level, but not with change in each level. We also found a relationship between facial expressions and both subjective emotion ratings and subjective listening effort. Emotional responses in the form of facial expressions show promise as a measure of affect and listening difficulty. Further research is needed to determine the specific contribution of affect to communication in challenging listening environments.
Collapse
Affiliation(s)
- Soumya Venkitakrishnan
- Department of Communication Sciences and Disorders, California State University, Sacramento, California
| | - Yu-Hsiang Wu
- Department of Communication Sciences and Disorders, University of Iowa, Iowa City, Iowa
| |
Collapse
|
20
|
Shields C, Sladen M, Bruce IA, Kluk K, Nichani J. Exploring the Correlations Between Measures of Listening Effort in Adults and Children: A Systematic Review with Narrative Synthesis. Trends Hear 2023; 27:23312165221137116. [PMID: 36636020 PMCID: PMC9982391 DOI: 10.1177/23312165221137116] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023] Open
Abstract
Listening effort (LE) describes the cognitive resources needed to process an auditory message. Our understanding of this notion remains in its infancy, hindering our ability to appreciate how it impacts individuals with hearing impairment effectively. Despite the myriad of proposed measurement tools, a validated method remains elusive. This is complicated by the seeming lack of association between tools demonstrated via correlational analyses. This review aims to systematically review the literature relating to the correlational analyses between different measures of LE. Five databases were used- PubMed, Cochrane, EMBASE, PsychINFO, and CINAHL. The quality of the evidence was assessed using the GRADE criteria and risk of bias with ROBINS-I/GRADE tools. Each statistically significant analysis was classified using an approved system for medical correlations. The final analyses included 48 papers, equating to 274 correlational analyses, of which 99 reached statistical significance (36.1%). Within these results, the most prevalent classifications were poor or fair. Moreover, when moderate or very strong correlations were observed, they tended to be dependent on experimental conditions. The quality of evidence was graded as very low. These results show that measures of LE are poorly correlated and supports the multi-dimensional concept of LE. The lack of association may be explained by considering where each measure operates along the effort perception pathway. Moreover, the fragility of significant correlations to specific conditions further diminishes the hope of finding an all-encompassing tool. Therefore, it may be prudent to focus on capturing the consequences of LE rather than the notion itself.
Collapse
Affiliation(s)
- Callum Shields
- ENT department, Royal Manchester
Children's Hospital, Manchester, UK,University of Manchester, Manchester, UK,Callum Shields, ENT department, Royal
Manchester Children's Hospital, Manchester, UK.
| | - Mark Sladen
- ENT department, Royal Manchester
Children's Hospital, Manchester, UK
| | | | | | - Jaya Nichani
- ENT department, Royal Manchester
Children's Hospital, Manchester, UK
| |
Collapse
|
21
|
Moon K, Lee M, Han K. Effects of
3D
virtual reality motionless imagery training program with an avatar. Psych J 2022; 12:169-177. [PMID: 36336337 DOI: 10.1002/pchj.614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Accepted: 09/09/2022] [Indexed: 11/09/2022]
Abstract
The present study aimed to explore the effects of motionless imagery training with an avatar in virtual reality (VR) on emotion, cognition, and physiological response changes in healthy adults. Participants were 30 healthy adults aged between 19 and 35 years. All participants were randomly divided into the experimental group (n = 18), which executed the imagery training with an avatar in VR, or the control group (n = 12), which merely experienced the VR without an avatar. Both groups underwent the intervention, a 20-min session, 3 times a week for 6 weeks. VR experience questionnaires and physiological response changes were measured at pre- and post-test and emotional states and cognition tests were measured at pre-, post-, and follow-up test. The experimental group showed no significant changes in the Presence Questionnaire (PQ) and the Simulator Sickness Questionnaire (SSQ) after the intervention while the control group showed a significant decrease in the PQ after the intervention. In all emotional states, there were no significant differences in the interaction between times and groups. A significant main effect of time was revealed in all cognition tests except the delayed recall and the delayed recognition in K-Auditory Verbal Learning Test (K-AVLT). In physiological response changes, the experimental group showed significant improvements in the electromyogram (EMG) at rectus femoris on the left side after the intervention. Thus, imagery training with an avatar in VR can be considered to be effective for enhancements of cognitions and physiological response changes.
Collapse
Affiliation(s)
- Kyung‐Ji Moon
- Division of Sport Science Pusan National University Busan Republic of Korea
| | - Myung‐Chul Lee
- Division of Sport Science Pusan National University Busan Republic of Korea
| | - Kyung‐Hun Han
- Division of Sport Science Pusan National University Busan Republic of Korea
| |
Collapse
|
22
|
Impact of Effortful Word Recognition on Supportive Neural Systems Measured by Alpha and Theta Power. Ear Hear 2022; 43:1549-1562. [DOI: 10.1097/aud.0000000000001211] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
23
|
Grenzebach J, Romanus E. Quantifying the Effect of Noise on Cognitive Processes: A Review of Psychophysiological Correlates of Workload. Noise Health 2022; 24:199-214. [PMID: 36537445 PMCID: PMC10088430 DOI: 10.4103/nah.nah_34_22] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
Noise is present in most work environments, including emissions from machines and devices, irrelevant speech from colleagues, and traffic noise. Although it is generally accepted that noise below the permissible exposure limits does not pose a considerable risk for auditory effects like hearing impairments. Yet, noise can have a direct adverse effect on cognitive performance (non-auditory effects like workload or stress). Under certain circumstances, the observable performance for a task carried out in silence compared to noisy surroundings may not differ. One possible explanation for this phenomenon needs further investigation: individuals may invest additional cognitive resources to overcome the distraction from irrelevant auditory stimulation. Recent developments in measurements of psychophysiological correlates and analysis methods of load-related parameters can shed light on this complex interaction. These objective measurements complement subjective self-report of perceived effort by quantifying unnoticed noise-related cognitive workload. In this review, literature databases were searched for peer-reviewed journal articles that deal with an at least partially irrelevant "auditory stimulation" during an ongoing "cognitive task" that is accompanied by "psychophysiological correlates" to quantify the "momentary workload." The spectrum of assessed types of "auditory stimulations" extended from speech stimuli (varying intelligibility), oddball sounds (repeating short tone sequences), and auditory stressors (white noise, task-irrelevant real-life sounds). The type of "auditory stimulation" was related (speech stimuli) or unrelated (oddball, auditory stressor) to the type of primary "cognitive task." The types of "cognitive tasks" include speech-related tasks, fundamental psychological assessment tasks, and real-world/simulated tasks. The "psychophysiological correlates" include pupillometry and eye-tracking, recordings of brain activity (hemodynamic, potentials), cardiovascular markers, skin conductance, endocrinological markers, and behavioral markers. The prevention of negative effects on health by unexpected stressful soundscapes during mental work starts with the continuous estimation of cognitive workload triggered by auditory noise. This review gives a comprehensive overview of methods that were tested for their sensitivity as markers of workload in various auditory settings during cognitive processing.
Collapse
|
24
|
Listening Effort Measured Using a Dual-task Paradigm in Adults With Different Amounts of Noise Exposure. Ear Hear 2021; 43:899-912. [PMID: 34619684 DOI: 10.1097/aud.0000000000001138] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
OBJECTIVES Excessive noise levels can result in hearing damage and/or hearing-related symptoms, thereby leading to impaired communication and, eventually a decrease in the quality of life. Moreover, in daily practice, subjects often indicate that listening in noisy situations is a challenging and often exhausting experience, even in the absence of a clinically significant hearing loss. Hence, a person's perceived difficulty of the listening situation will also be important to consider. It has been suggested that beyond the peripheral factors, there are some central cognitive correlates of speech understanding that are essential for communication abilities. The aim of the present study was to evaluate the effect of the amount of noise exposure on hearing as measured by pure-tone audiometry and otoacoustic emissions (OAEs) on the one hand and listening effort measured using a dual-task paradigm on the other hand. DESIGN The study included 152 adults between 18 and 40 years of age. First, participants completed a self-administered questionnaire regarding the amount of noise exposure. Second, hearing status was evaluated using pure-tone audiometry and transient evoked OAEs (TEOAEs) as well as distortion product OAEs (DPOAEs). Finally, listening effort was evaluated using a dual-task paradigm, which consisted of a primary speech-recognition task in different listening conditions and a secondary visual memory task that were performed both separately and simultaneously. Based on the quartiles of their subjective estimation of noise exposure, the participants were categorized into a group with low noise exposure (lower quartile), moderate noise exposure (two middle quartiles), and high noise exposure (upper quartile). RESULTS There was no significant difference in hearing thresholds between the participants with low, moderate, and high noise exposure for each frequency of the pure-tone audiometry. In contrast, more absent TEOAEs and DPOAEs were found in the high noise exposed group. Regarding the primary speech-recognition task of the dual-task paradigm, no significant difference in speech recognition was found between the different groups of noise exposure. For the amount of listening effort, it was found that across all listening conditions subjects with high noise exposure expend significantly more listening effort compared with subjects with low and moderate noise exposure. CONCLUSIONS This study is a first exploration of the effects of different amounts of noise exposure on listening effort showing that, listening effort is increased in subjects with high noise exposure compared with subjects with low and medium noise exposure. The most plausible hypothesis pertains to an effect of noise exposure on the peripheral and central auditory system, or a combination of effects on both the auditory system and the high-level cognitive functions necessary for speech understanding in the subjects with high levels of noise exposure. As such, a test for listening effort would be useful as part of a comprehensive test battery within the assessment of subjects exposed to noise.
Collapse
|
25
|
Plain B, Pielage H, Richter M, Bhuiyan TA, Lunner T, Kramer SE, Zekveld AA. Social observation increases the cardiovascular response of hearing-impaired listeners during a speech reception task. Hear Res 2021; 410:108334. [PMID: 34450568 DOI: 10.1016/j.heares.2021.108334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/18/2021] [Revised: 07/21/2021] [Accepted: 08/04/2021] [Indexed: 11/25/2022]
Abstract
Certain cardiovascular measures allow for distinction between sympathetic and parasympathetic nervous system activity. Applied during listening, these measures may provide a novel and complementary insight into listening effort. To date, few studies have implemented cardiovascular measures of listening effort and seldom have these included hearing-impaired participants. These studies have generally measured changes in cardiovascular parameters while manipulating environmental factors, such as listening difficulty. Yet, listening effort is also known to be moderated by individual factors, including the importance of performing successfully. In this study, we aimed to manipulate success importance by adding observers to the traditional laboratory set-up. Twenty-nine hearing-impaired participants performed a speech reception task both alone and in the presence of two observers. Auditory stimuli consisted of Danish Hearing in Noise Test (HINT) sentences masked by four-talker babble. Sentences were delivered at two individually adapted signal-to-noise ratios, corresponding to 50 and 80% of sentences correct. We measured change scores, relative to baseline, of pre-ejection period, two indices of heart rate variability, heart rate and blood pressure (systolic, diastolic, and mean arterial pressure). After each condition, participants rated their effort investment, stress, tendency to give up and preference to change the situation to improve audibility. A multivariate analysis revealed that cardiovascular reactivity increased in the presence of the observers, compared to when the task was performed alone. More specifically, systolic, diastolic, and mean arterial blood pressure increased while observed. Interestingly, participants' subjective ratings were sensitive only to intelligibility level, not the observation state. This study was the first to report results from a range of different cardiovascular variables measured from hearing-impaired participants during a speech reception task. Due to the timing of the observers' presence, we were not able to conclusively attribute these physiological changes to being task related. Therefore, instead of representing listening effort, we suggest that the increased cardiovascular response detected during observation reveals increased physiological stress associated with potential evaluation.
Collapse
Affiliation(s)
- Bethany Plain
- Amsterdam UMC, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands; Eriksholm Research Centre, Snekkersten, Denmark.
| | - Hidde Pielage
- Amsterdam UMC, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands; Eriksholm Research Centre, Snekkersten, Denmark
| | - Michael Richter
- School of Psychology, Liverpool John Moores University, Liverpool, United Kingdom
| | | | | | - Sophia E Kramer
- Amsterdam UMC, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| | - Adriana A Zekveld
- Amsterdam UMC, Vrije Universiteit Amsterdam, Otolaryngology Head and Neck Surgery, Ear & Hearing, Amsterdam Public Health Research Institute, Amsterdam, the Netherlands
| |
Collapse
|
26
|
Vladimirova TY, Aizenshtadt LV. [Features of tinnitus in older patients with autonomic dysfunction]. Vestn Otorinolaringol 2021; 86:9-13. [PMID: 34269017 DOI: 10.17116/otorino2021860319] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
OBJECTIVE To establish the features of tinnitus in older age patients with autonomic dysfunction. MATERIAL AND METHODS We examined 94 patients aged 60 to 93 years (average age is 75.4±3.2 years). Patients with an imbalance of the autonomic nervous system were identified according to the questionnaire of A.M. Wayne and Kerdo's autonomic index. The questionnaires assessing the strength of subjective ear noise, the psychoemotional state of patients, the impact of tinnitus on various spheres of life were used in this study. RESULTS It was revealed that more than 50% of patients of older age groups with tinnitus had a dysfunction of the autonomic nervous system. Patients with parasympathicotonia more often noted bilateral persistent subjective ear noise than patients with sympathicotonia. CONCLUSIONS Autonomic dysfunction could be the cause of sleep disturbances, psychoemotional disorders and a decrease in the quality of life.
Collapse
|
27
|
Francis AL, Bent T, Schumaker J, Love J, Silbert N. Listener characteristics differentially affect self-reported and physiological measures of effort associated with two challenging listening conditions. Atten Percept Psychophys 2021; 83:1818-1841. [PMID: 33438149 PMCID: PMC8084824 DOI: 10.3758/s13414-020-02195-9] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/16/2020] [Indexed: 12/14/2022]
Abstract
Listeners vary in their ability to understand speech in adverse conditions. Differences in both cognitive and linguistic capacities play a role, but increasing evidence suggests that such factors may contribute differentially depending on the listening challenge. Here, we used multilevel modeling to evaluate contributions of individual differences in age, hearing thresholds, vocabulary, selective attention, working memory capacity, personality traits, and noise sensitivity to variability in measures of comprehension and listening effort in two listening conditions. A total of 35 participants completed a battery of cognitive and linguistic tests as well as a spoken story comprehension task using (1) native-accented English speech masked by speech-shaped noise and (2) nonnative accented English speech without masking. Masker levels were adjusted individually to ensure each participant would show (close to) equivalent word recognition performance across the two conditions. Dependent measures included comprehension tests results, self-rated effort, and electrodermal, cardiovascular, and facial electromyographic measures associated with listening effort. Results showed varied patterns of responsivity across different dependent measures as well as across listening conditions. In particular, results suggested that working memory capacity may play a greater role in the comprehension of nonnative accented speech than noise-masked speech, while hearing acuity and personality may have a stronger influence on physiological responses affected by demands of understanding speech in noise. Furthermore, electrodermal measures may be more strongly affected by affective response to noise-related interference while cardiovascular responses may be more strongly affected by demands on working memory and lexical access.
Collapse
Affiliation(s)
- Alexander L Francis
- Department of Speech, Language and Hearing Sciences, Purdue University, Lyles-Porter Hall, 715 Clinic Dr., West Lafayette, IN, 47907, USA.
| | - Tessa Bent
- Department of Speech, Language and Hearing Sciences, Indiana University, Bloomington, IN, USA
| | - Jennifer Schumaker
- Department of Speech, Language and Hearing Sciences, Purdue University, Lyles-Porter Hall, 715 Clinic Dr., West Lafayette, IN, 47907, USA
| | - Jordan Love
- Department of Speech, Language and Hearing Sciences, Purdue University, Lyles-Porter Hall, 715 Clinic Dr., West Lafayette, IN, 47907, USA
| | - Noah Silbert
- Applied Research Laboratory for Intelligence and Security, University of Maryland, College Park, MD, USA
| |
Collapse
|
28
|
Reinhart P, Griffin K, Micheyl C. Changes in Heart Rate Variability Following Acoustic Therapy in Individuals With Tinnitus. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2021; 64:1413-1419. [PMID: 33820426 DOI: 10.1044/2021_jslhr-20-00596] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Purpose The aim of the study was to investigate changes in autonomic function, as measured by heart rate variability, in individuals with tinnitus following acoustic therapy implemented using tinnitus maskers presented via hearing aids. Method Twenty-six individuals with tinnitus and hearing impairment completed an 8-week field trial wearing hearing aids providing acoustic therapy via three tinnitus masker options set just below minimum masking level. Tinnitus handicap was measured using the Tinnitus Handicap Inventory at baseline (before starting acoustic therapy) and posttreatment (at end of 8-week trial). Resting heart rate and heart rate variability were measured using electrocardiography at baseline and posttreatment. Results There was a significant decrease in tinnitus handicap posttreatment compared to baseline. There was no change in heart rate, but there was a significant increase in heart rate variability posttreatment compared to baseline. Conclusions Acoustic therapy using tinnitus maskers delivered via hearing aids provided tinnitus relief and produced a concurrent increase in heart rate variability, suggesting a decrease in stress. Heart rate variability is a potential biomarker for tracking efficacy of acoustic therapy; however, further research is required.
Collapse
|
29
|
Alhanbali S, Munro KJ, Dawes P, Perugia E, Millman RE. Associations between pre-stimulus alpha power, hearing level and performance in a digits-in-noise task. Int J Audiol 2021; 61:197-204. [PMID: 33794733 DOI: 10.1080/14992027.2021.1899314] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Abstract
OBJECTIVE Baseline electroencephalography (EEG) alpha power, i.e. that measured prior to stimulus presentation, is a potential objective predictor of task performance. Here we assessed the predictive power of EEG alpha on performance accuracy in a digits-in-noise recognition task, factoring in hearing thresholds and age. DESIGN EEG alpha power, recorded while participants listened to target digits presented in a noise background, was analysed during two different baseline periods: i) a pre-stimulus baseline (pre-STIM) free from any acoustic stimulus, and ii) a pre-target baseline (pre-TARG) recorded in background noise only. STUDY SAMPLE Eighty-five participants with either normal hearing or aided hearing impairment (age range: 55-85 years old, 42 male). RESULTS Hierarchical multiple regression analyses indicated that i) lower hearing thresholds and, to a lesser extent, higher pre-STIM alpha power were associated with improved performance accuracy ii) alpha power in pre-STIM and pre-TARG were highly correlated across individuals but pre-TARG alpha power was not a significant predictor of performance accuracy. CONCLUSION Investigations of baseline EEG alpha power as a predictor of speech-in-noise performance accuracy should control for associations between hearing thresholds and measures of EEG baseline periods.
Collapse
Affiliation(s)
- Sara Alhanbali
- Manchester Centre for Audiology and Deafness, School of Health Sciences, University of Manchester, Manchester, UK.,Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK.,Department of Hearing and Speech Science, School of Rehabilitation Sciences, The University of Jordan, Amman, Jordan
| | - Kevin J Munro
- Manchester Centre for Audiology and Deafness, School of Health Sciences, University of Manchester, Manchester, UK.,Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| | - Piers Dawes
- Manchester Centre for Audiology and Deafness, School of Health Sciences, University of Manchester, Manchester, UK.,Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| | - Emanuele Perugia
- Manchester Centre for Audiology and Deafness, School of Health Sciences, University of Manchester, Manchester, UK.,Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| | - Rebecca E Millman
- Manchester Centre for Audiology and Deafness, School of Health Sciences, University of Manchester, Manchester, UK.,Manchester University Hospitals NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| |
Collapse
|
30
|
Investigating the Influences of Task Demand and Reward on Cardiac Pre-Ejection Period Reactivity During a Speech-in-Noise Task. Ear Hear 2020; 42:718-731. [PMID: 33201048 PMCID: PMC8088822 DOI: 10.1097/aud.0000000000000971] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
OBJECTIVES Effort investment during listening varies as a function of task demand and motivation. Several studies have manipulated both these factors to elicit and measure changes in effort associated with listening. The cardiac pre-ejection period (PEP) is a relatively novel measure in the field of cognitive hearing science. This measure, which reflects sympathetic nervous system activity on the heart, has previously been implemented during a tone discrimination task but not during a speech-in-noise task. Therefore, the primary goal of this study was to explore the influences of signal to noise ratio (SNR) and monetary reward level on PEP reactivity during a speech-in-noise task. DESIGN Thirty-two participants with normal hearing (mean age = 22.22 years, SD = 3.03) were recruited at VU University Medical Center. Participants completed a Dutch speech-in-noise test with a single-interfering-talker masking noise. Six fixed SNRs, selected to span the entire psychometric performance curve, were presented in a block-wise fashion. Participants could earn a low (€0.20) or high (€5.00) reward by obtaining a score of ≥70% of words correct in each block. The authors analyzed PEP reactivity: the change in PEP measured during the task, relative to the baseline during rest. Two separate methods of PEP analysis were used, one including data from the whole task block and the other including data obtained during presentation of the target sentences only. After each block, participants rated their effort investment, performance, tendency to give up, and the perceived difficulty of the task. They also completed the need for recovery questionnaire and the reading span test, which are indices of additional factors (fatigue and working memory capacity, respectively) that are known to influence listening effort. RESULTS Average sentence perception scores ranged from 2.73 to 91.62%, revealing a significant effect of SNR. In addition, an improvement in performance was elicited by the high, compared to the low reward level. A linear relationship between SNR and PEP reactivity was demonstrated: at the lower SNRs PEP reactivity was the most negative, indicating greater effort investment compared to the higher SNRs. The target stimuli method of PEP analysis was more sensitive to this effect than the block-wise method. Contrary to expectations, no significant impact of reward on PEP reactivity was found in the present dataset. Also, there was no physiological evidence that participants were disengaged, even when performance was poor. A significant correlation between need for recovery scores and average PEP reactivity was demonstrated, indicating that a lower need for recovery was associated with less effort investment. CONCLUSIONS This study successfully implemented the measurement of PEP during a standard speech-in-noise test and included two distinct methods of PEP analysis. The results revealed for the first time that PEP reactivity varies linearly with task demand during a speech-in-noise task, although the effect size was small. No effect of reward on PEP was demonstrated. Finally, participants with a higher need for recovery score invested more effort, as shown by average PEP reactivity, than those with a lower need for recovery score.
Collapse
|
31
|
Abstract
OBJECTIVES The objective of this study was to evaluate the sensitivity and reliability of one subjective (rating scale) and three objective (dual-task paradigm, pupillometry, and skin conductance response amplitude) measures of listening effort across multiple signal to noise ratios (SNRs). DESIGN Twenty adults with normal hearing attended two sessions and listened to sentences presented in quiet and in stationary noise at three different SNRs: 0, -3, and -5 dB. Listening effort was assessed by examining change in reaction time (dual-task paradigm), change in peak to peak pupil diameter (pupillometry), and change in mean skin conductance response amplitude; self-reported listening effort on a scale from 0 to 100 was also evaluated. Responses were averaged within each SNR and based on three word recognition ability categories (≤50%, 51% to 71%, and >71%) across all SNRs. Measures were considered reliable if there were no significant changes between sessions, and intraclass correlation coefficients were a minimum of 0.40. Effect sizes were calculated to compare the sensitivity of the measures. RESULTS Intraclass correlation coefficient values indicated fair-to-moderate reliability for all measures while individual measurement sensitivity was variable. Self-reports were sensitive to listening effort but were less reliable, given that subjective effort was greater during the dual task than either of the physiologic measures. The dual task was sensitive to a narrow range of word recognition abilities but was less reliable as it exhibited a global decrease in reaction time across sessions. Pupillometry was consistently sensitive and reliable to changes in listening effort. Skin conductance response amplitude was not sensitive or reliable while the participants listened to the sentences. Skin conductance response amplitude during the verbal response was sensitive to poor (≤50%) speech recognition abilities; however, it was less reliable as there was a significant change in amplitude across sessions. CONCLUSIONS In this study, pupillometry was the most sensitive and reliable objective measure of listening effort. Intersession variability significantly influenced the other objective measures of listening effort, which suggests challenges for cross-study comparability. Therefore, intraclass correlation coefficients combined with other statistical tests more fully describe the reliability of measures of listening effort across multiple difficulties. Minimizing intersession variability will increase measurement sensitivity. Further work toward standardized methods and analysis will strengthen our understanding of the reliability and sensitivity of measures of listening effort and better facilitate cross-modal and cross-study comparisons.
Collapse
|
32
|
Abstract
OBJECTIVES Listening effort can be defined as the cognitive resources required to perform a listening task. The literature on listening effort is as confusing as it is voluminous: measures of listening effort rarely correlate with each other and sometimes result in contradictory findings. Here, we directly compared simultaneously recorded multimodal measures of listening effort. After establishing the reliability of the measures, we investigated validity by quantifying correlations between measures and then grouping-related measures through factor analysis. DESIGN One hundred and sixteen participants with audiometric thresholds ranging from normal to severe hearing loss took part in the study (age range: 55 to 85 years old, 50.3% male). We simultaneously measured pupil size, electroencephalographic alpha power, skin conductance, and self-report listening effort. One self-report measure of fatigue was also included. The signal to noise ratio (SNR) was adjusted at 71% criterion performance using sequences of 3 digits. The main listening task involved correct recall of a random digit from a sequence of six presented at a SNR where performance was around 82 to 93%. Test-retest reliability of the measures was established by retesting 30 participants 7 days after the initial session. RESULTS With the exception of skin conductance and the self-report measure of fatigue, interclass correlation coefficients (ICC) revealed good test-retest reliability (minimum ICC: 0.71). Weak or nonsignificant correlations were identified between measures. Factor analysis, using only the reliable measures, revealed four underlying dimensions: factor 1 included SNR, hearing level, baseline alpha power, and performance accuracy; factor 2 included pupillometry; factor 3 included alpha power (during speech presentation and during retention); factor 4 included self-reported listening effort and baseline alpha power. CONCLUSIONS The good ICC suggests that poor test reliability is not the reason for the lack of correlation between measures. We have demonstrated that measures traditionally used as indicators of listening effort tap into multiple underlying dimensions. We therefore propose that there is no "gold standard" measure of listening effort and that different measures of listening effort should not be used interchangeably. When choosing method(s) to measure listening effort, the nature of the task and aspects of increased listening demands that are of interest should be taken into account. The findings of this study provide a framework for understanding and interpreting listening effort measures.
Collapse
|
33
|
Dwyer RT, Gifford RH, Bess FH, Dorman M, Spahr A, Hornsby BWY. Diurnal Cortisol Levels and Subjective Ratings of Effort and Fatigue in Adult Cochlear Implant Users: A Pilot Study. Am J Audiol 2019; 28:686-696. [PMID: 31430174 PMCID: PMC6808310 DOI: 10.1044/2019_aja-19-0009] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022] Open
Abstract
Purpose There is a growing body of literature that suggests a linkage between impaired auditory function, increased listening effort, and fatigue in children and adults with hearing loss. Research suggests this linkage may be associated with hearing loss–related variations in diurnal cortisol levels. Here, we examine variations in cortisol profiles between young adults with and without severe sensorineural hearing loss and examine associations between cortisol and subjective measures of listening effort and fatigue. Method This study used a repeated-measures, matched-pair design. Two groups (n = 8 per group) of adults enrolled in audiology programs participated, 1 group of adults with hearing loss (AHL) and 1 matched control group without hearing loss. Salivary cortisol samples were collected at 7 time points over a 2-week period and used to quantify physiological stress. Subjective measures of listening effort, stress, and fatigue were also collected to investigate relationships between cortisol levels, perceived stress, and fatigue. Results Subjective ratings revealed that AHL required significantly more effort and concentration on typical auditory tasks than the control group. Likewise, complaints of listening-related fatigue were more frequent and more of a problem in everyday life for AHL compared to the control group. There was a significant association between subjective ratings of listening effort and listening-related fatigue for our AHL, but not for the control group. In contrast, there was no significant difference in cortisol measures between groups, nor were there significant associations between cortisol and any subjective measure. Conclusions Young AHL experience more effortful listening than their normal hearing peers. This increased effort is associated with increased reports of listening-related fatigue. However, diurnal cortisol profiles were not significantly different between groups nor were they associated with these perceived differences.
Collapse
Affiliation(s)
- Robert T. Dwyer
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN
| | - René H. Gifford
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN
- Department of Otolaryngology, Vanderbilt University Medical Center, Nashville, TN
| | - Fred H. Bess
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN
- Department of Otolaryngology, Vanderbilt University Medical Center, Nashville, TN
| | - Michael Dorman
- Department of Speech and Hearing Science, Arizona State University, Tempe
| | | | - Benjamin W. Y. Hornsby
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN
| |
Collapse
|
34
|
Xu D, Francis AL. Relationships Among Self-Reported Hearing Problems, Psychological Distress, and Cardiovascular Disease in U.S. Adults, National Health Interview Survey 1997-2017. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2019; 62:2872-2881. [PMID: 31339788 DOI: 10.1044/2019_jslhr-h-18-0511] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Objective The purpose of this study was to explore the hypothesis that the relationship between hearing problems and cardiovascular disease (CVD) includes a connection to psychological distress. Design We used generalized structural equation modeling to assess relationships between self-reported measures of hearing problems, psychological distress, and CVD in a pooled sample of 623,416 adult respondents in the 1997-2017 National Health Interview Survey. Hearing status without hearing aids was self-reported on an ordinal scale and further grouped for this study into 3 categories (excellent or good hearing, little or moderate trouble hearing, and a lot of trouble or deaf). Six CVDs (stroke, angina pectoris, hypertension, heart attack, coronary heart disease, or other heart condition/disease) were incorporated as a latent variable. Psychological distress was evaluated by the Kessler 6 Scale (Kessler et al., 2010). All estimates were population weighted, and standard errors were adjusted for a complex survey design. Results Nearly 83% reported excellent or good hearing, 14% reported a little or moderate trouble hearing, and 3% reported a lot of trouble hearing or said they were deaf. Hearing problems were positively associated with CVD. Relative to those reporting excellent/good hearing, adults reporting trouble hearing had a higher probability of CVD. Hearing problems were also significantly associated with psychological distress. When psychological distress was applied to the model, positive associations between hearing problems and CVD were attenuated but still significant. Results are consistent with the hypothesis that the connection between self-reported hearing problems and CVD is mediated through psychological distress. Conclusions The relationship between self-reported hearing problems and CVD is mediated by psychological distress. Further research is needed to identify causal pathways and psychophysiological mechanisms involved in this relationship and to identify effective methods for addressing cardiovascular health-related psychosocial factors in the treatment of hearing impairment.
Collapse
Affiliation(s)
- Dongjuan Xu
- School of Nursing, Purdue University, West Lafayette, IN
- Center on Aging and the Life Course, Purdue University, West Lafayette, IN
| | - Alexander L Francis
- Center on Aging and the Life Course, Purdue University, West Lafayette, IN
- Department of Speech, Language, & Hearing Sciences, Purdue University, West Lafayette, IN
| |
Collapse
|
35
|
Francis AL, Love J. Listening effort: Are we measuring cognition or affect, or both? WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2019; 11:e1514. [PMID: 31381275 DOI: 10.1002/wcs.1514] [Citation(s) in RCA: 58] [Impact Index Per Article: 11.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2019] [Revised: 07/07/2019] [Accepted: 07/10/2019] [Indexed: 12/14/2022]
Abstract
Listening effort is increasingly recognized as a factor in communication, particularly for and with nonnative speakers, for the elderly, for individuals with hearing impairment and/or for those working in noise. However, as highlighted by McGarrigle et al., International Journal of Audiology, 2014, 53, 433-445, the term "listening effort" encompasses a wide variety of concepts, including the engagement and control of multiple possibly distinct neural systems for information processing, and the affective response to the expenditure of those resources in a given context. Thus, experimental or clinical methods intended to objectively quantify listening effort may ultimately reflect a complex interaction between the operations of one or more of those information processing systems, and/or the affective and motivational response to the demand on those systems. Here we examine theoretical, behavioral, and psychophysiological factors related to resolving the question of what we are measuring, and why, when we measure "listening effort." This article is categorized under: Linguistics > Language in Mind and Brain Psychology > Theory and Methods Psychology > Attention Psychology > Emotion and Motivation.
Collapse
Affiliation(s)
- Alexander L Francis
- Department of Speech, Language and Hearing Sciences, Purdue University, West Lafayette, Indiana
| | - Jordan Love
- Department of Speech, Language and Hearing Sciences, Purdue University, West Lafayette, Indiana
| |
Collapse
|
36
|
Hughes SE, Rapport F, Watkins A, Boisvert I, McMahon CM, Hutchings HA. Study protocol for the validation of a new patient-reported outcome measure (PROM) of listening effort in cochlear implantation: the Listening Effort Questionnaire-Cochlear Implant (LEQ-CI). BMJ Open 2019; 9:e028881. [PMID: 31289085 PMCID: PMC6629460 DOI: 10.1136/bmjopen-2018-028881] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Revised: 05/14/2019] [Accepted: 05/17/2019] [Indexed: 12/26/2022] Open
Abstract
INTRODUCTION Listening effort may be defined as the cognitive resources needed to understand an auditory message. A sustained requirement for listening effort is known to have a negative impact on individuals' sense of social connectedness, well-being and quality of life. A number of hearing-specific patient-reported outcome measures (PROMs) exist currently; however, none adequately assess listening effort as it is experienced in the listening situations of everyday life. The Listening Effort Questionnaire-Cochlear Implant (LEQ-CI) is a new, hearing-specific PROM designed to assess perceived listening effort as experienced by adult CI patients. It is the aim of this study to conduct the first psychometric evaluation of the LEQ-CI's measurement properties. METHODS AND ANALYSIS This study is a phased, prospective, multi-site validation study in a UK population of adults with severe-profound sensorineural hearing loss who meet local candidacy criteria for CI. In phase 1, 250 CI patients from four National Health Service CI centres will self-complete a paper version of the LEQ-CI. Factor analysis will establish unidimensionality and Rasch analysis will evaluate item fit, differential item functioning, response scale ordering, targeting of persons and items, and reliability. Classical test theory methods will assess acceptability/data completeness, scaling assumptions, targeting and internal consistency reliability. Phase 1 results will inform refinements to the LEQ-CI. In phase 2, a new sample of adult CI patients (n=100) will self-complete the refined LEQ-CI, the Speech, Spatial and Qualities of Hearing Scale, the Nijmegen Cochlear Implant Questionnaire and the Fatigue Assessment Scale to assess construct validity. ETHICS AND DISSEMINATION This study was approved by the Abertawe Bro Morgannwg University Health Board/Swansea University Joint Study Review Committee and the Newcastle and North Tyneside 2 Research Ethics Committee, Ref: 18/NE/0320. Dissemination will be in high-quality journals, conference presentations and SEH's doctoral dissertation.
Collapse
Affiliation(s)
- Sarah E Hughes
- Swansea University Medical School, Swansea University, Swansea, UK
- South Wales Cochlear Implant Programme, Bridgend, UK
| | - Frances Rapport
- Australian Institute of Health Innovation, Macquarie University, Sydney, New South Wales, Australia
| | - Alan Watkins
- Swansea University Medical School, Swansea University, Swansea, UK
| | - Isabelle Boisvert
- Department of Linguistics (Audiology Section), Macquarie University, Sydney, New South Wales, Australia
- The HEARing CRC, Melbourne, Australia
| | - Catherine M McMahon
- Department of Linguistics (Audiology Section), Macquarie University, Sydney, New South Wales, Australia
- The HEARing CRC, Melbourne, Australia
| | | |
Collapse
|
37
|
Lau MK, Hicks C, Kroll T, Zupancic S. Effect of Auditory Task Type on Physiological and Subjective Measures of Listening Effort in Individuals With Normal Hearing. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2019; 62:1549-1560. [PMID: 31063438 DOI: 10.1044/2018_jslhr-h-17-0473] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Purpose Listening effort has traditionally been measured using subjective rating scales and behavioral measures. Recent physiological measures of listening effort have utilized pupil dilation. Using a combination of physiological and subjective measures of listening effort, this study aimed to identify differences in listening effort during 2 auditory tasks: sentence recognition and word recognition. Method Pupil dilation and subjective ratings of listening effort were obtained for auditory tasks utilizing AzBio sentences recognition and Northwestern University Auditory Test No. 6 words recognition, across 3 listening situations: in quiet, at +6 dB signal-to-noise ratio, and at 0 dB signal-to-noise ratio. Task accuracy was recorded for each of the 6 conditions, as well as peak pupil dilation and a subjective rating of listening effort. Results A significant impact of listening situation (quiet vs. noise) and task type (sentence recognition vs. word recognition) on both physiological and subjective measures was found. There was a significant interaction between listening situation and task type, suggesting that contextual cues may only be beneficial when audibility is uncompromised. The current study found no correlation between the physiological and subjective measures, possibly suggesting that these measures analyze different aspects of cognitive effort in a listening task.
Collapse
Affiliation(s)
- Marcy K Lau
- Department of Audiology & Speech Pathology, East Tennessee State University, Johnson City
| | - Candace Hicks
- Department of Speech, Language, & Hearing Sciences, Texas Tech University Health Sciences Center, Lubbock
| | - Tobias Kroll
- Department of Speech, Language, & Hearing Sciences, Texas Tech University Health Sciences Center, Lubbock
| | - Steven Zupancic
- Department of Speech, Language, & Hearing Sciences, Texas Tech University Health Sciences Center, Lubbock
| |
Collapse
|
38
|
Beck JE, Zaugg TL, Egge JL, Lima EN, Thielman EJ. Progressive Tinnitus Management at Two Veterans Affairs Medical Centers: Clinical Implementation With Modified Protocols. Am J Audiol 2019; 28:162-173. [PMID: 31022363 DOI: 10.1044/2018_aja-ttr17-18-0040] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023] Open
Abstract
Purpose This is a description of the clinical implementation and outcomes of progressive tinnitus management (PTM) at 2 Veterans Affairs (VA) medical centers: Both programs modified the protocol originally described by PTM developers. Method Modifications at both sites were classified according to an evidence-based framework set forth by Stirman, Miller, Toder, and Calloway (2013) . The Iowa City VA PTM program clinicians made 2 modifications and the Asheville, North Carolina, VA PTM program clinicians made 6 modifications to the standard PTM protocol. Pre-post outcome measures were analyzed for 20 veterans who completed the Iowa City program and for 200 veterans who completed the Asheville program. Results Veterans who completed the Iowa City program showed a statistically significant decrease in the average Tinnitus Handicap Inventory score ( Newman, Jacobson, & Spitzer, 1996 ). Veterans who completed the Asheville PTM program showed a statistically significant decrease in the average Tinnitus Functional Index (TFI) score. Outcomes in Asheville were compared to outcomes of a clinical trial of PTM conducted by the developers of PTM. The clinical work in Asheville resulted in a greater mean reduction on the TFI and a larger effect size using the TFI as compared to the results of the PTM clinical trial. Conclusions Clinician-directed modifications to PTM that are made to address the unique needs and circumstances of an individual clinic have potential to result in positive outcomes for patients. Clinicians providing care for patients with tinnitus using PTM who modify the protocol to meet the needs of their local setting are encouraged to collect and report the outcomes of their modifications to improve understanding of the impact of various types of modifications to PTM and other evidence-based practices.
Collapse
Affiliation(s)
- Jenifer E. Beck
- Audiology and Speech Pathology Service, Charles George Veterans Affairs Medical Center, Asheville, North Carolina
| | - Tara L. Zaugg
- VA Rehabilitation Research and Development National Center for Rehabilitative Auditory Research, VA Portland Health Care System, Oregon
| | - Jessica L. Egge
- Audiology and Speech Pathology Service, Iowa City Veterans Affairs Health Care System, Iowa
| | - Elizabeth N. Lima
- Learning Resources Service, Charles George Veterans Affairs Medical Center, Asheville, North Carolina
| | - Emily J. Thielman
- VA Rehabilitation Research and Development National Center for Rehabilitative Auditory Research, VA Portland Health Care System, Oregon
| |
Collapse
|
39
|
Emotionally conditioning the target-speech voice enhances recognition of the target speech under "cocktail-party" listening conditions. Atten Percept Psychophys 2019; 80:871-883. [PMID: 29473143 DOI: 10.3758/s13414-018-1489-8] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Under a noisy "cocktail-party" listening condition with multiple people talking, listeners can use various perceptual/cognitive unmasking cues to improve recognition of the target speech against informational speech-on-speech masking. One potential unmasking cue is the emotion expressed in a speech voice, by means of certain acoustical features. However, it was unclear whether emotionally conditioning a target-speech voice that has none of the typical acoustical features of emotions (i.e., an emotionally neutral voice) can be used by listeners for enhancing target-speech recognition under speech-on-speech masking conditions. In this study we examined the recognition of target speech against a two-talker speech masker both before and after the emotionally neutral target voice was paired with a loud female screaming sound that has a marked negative emotional valence. The results showed that recognition of the target speech (especially the first keyword in a target sentence) was significantly improved by emotionally conditioning the target speaker's voice. Moreover, the emotional unmasking effect was independent of the unmasking effect of the perceived spatial separation between the target speech and the masker. Also, (skin conductance) electrodermal responses became stronger after emotional learning when the target speech and masker were perceptually co-located, suggesting an increase of listening efforts when the target speech was informationally masked. These results indicate that emotionally conditioning the target speaker's voice does not change the acoustical parameters of the target-speech stimuli, but the emotionally conditioned vocal features can be used as cues for unmasking target speech.
Collapse
|
40
|
Rovetti J, Goy H, Pichora-Fuller MK, Russo FA. Functional Near-Infrared Spectroscopy as a Measure of Listening Effort in Older Adults Who Use Hearing Aids. Trends Hear 2019; 23:2331216519886722. [PMID: 31722613 PMCID: PMC6856975 DOI: 10.1177/2331216519886722] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2019] [Revised: 09/25/2019] [Accepted: 10/01/2019] [Indexed: 02/06/2023] Open
Abstract
Listening effort may be reduced when hearing aids improve access to the acoustic signal. However, this possibility is difficult to evaluate because many neuroimaging methods used to measure listening effort are incompatible with hearing aid use. Functional near-infrared spectroscopy (fNIRS), which can be used to measure the concentration of oxygen in the prefrontal cortex (PFC), appears to be well-suited to this application. The first aim of this study was to establish whether fNIRS could measure cognitive effort during listening in older adults who use hearing aids. The second aim was to use fNIRS to determine if listening effort, a form of cognitive effort, differed depending on whether or not hearing aids were used when listening to sound presented at 35 dB SL (flat gain). Sixteen older adults who were experienced hearing aid users completed an auditory n-back task and a visual n-back task; both tasks were completed with and without hearing aids. We found that PFC oxygenation increased with n-back working memory demand in both modalities, supporting the use of fNIRS to measure cognitive effort during listening in this population. PFC oxygenation was weakly and nonsignificantly correlated with self-reported listening effort and reaction time, respectively, suggesting that PFC oxygenation assesses a dimension of listening effort that differs from these other measures. Furthermore, the extent to which hearing aids reduced PFC oxygenation in the left lateral PFC was positively correlated with age and pure-tone average thresholds. The implications of these findings as well as future directions are discussed.
Collapse
Affiliation(s)
- Joseph Rovetti
- Department of Psychology, Ryerson University, Toronto, ON,
Canada
| | - Huiwen Goy
- Department of Psychology, Ryerson University, Toronto, ON,
Canada
| | | | - Frank A. Russo
- Department of Psychology, Ryerson University, Toronto, ON,
Canada
- Toronto Rehabilitation Institute, ON, Canada
| |
Collapse
|
41
|
Moore TM, Picou EM. A Potential Bias in Subjective Ratings of Mental Effort. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2018; 61:2405-2421. [PMID: 30208416 PMCID: PMC6195049 DOI: 10.1044/2018_jslhr-h-17-0451] [Citation(s) in RCA: 33] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/05/2017] [Revised: 03/28/2018] [Accepted: 05/21/2018] [Indexed: 05/19/2023]
Abstract
PURPOSE Subjective reports of listening effort are frequently inconsistent with behavioral and physiological findings. A potential explanation is that participants unwittingly substitute an easier question when faced with a judgment that requires computationally expensive analysis (i.e., heuristic response strategies). The purpose of this study was to investigate whether participants substitute the question "How did I perform?" when asked "How much effort did that take?". METHOD Participants completed 2 sets of online surveys containing a text-based, multiple-choice synonym task. Expected performance and mental effort were manipulated across sets in 4 experiments, using a visual masking technique shown to correlate with speech-reception-testing in noise. Experiment 1 was designed to yield stable accuracy and differing effort across sets. Experiment 2 elicited differing accuracy and stable effort. Experiments 3 and 4 manipulated accuracy and performance in opposite directions. Participants included 273 adults (aged 19-68 years, M = 38.4 years). RESULTS Experiment 1 revealed no influence of perceived performance on ratings of effort when accuracy was stable. Experiment 2 showed that ratings of effort differed inversely with ratings of performance (lower performance and increased effort). Experiments 3 and 4 also demonstrated that participants rated effort in a manner inversely related to performance, regardless of the effort inherent in the condition. CONCLUSIONS Participants likely substitute an easier question when asked to rate the multidimensional construct of mental effort. The results presented here suggest that perceived performance can serve as a ready heuristic and may explain the dissociation between subjective measures of listening effort and behavioral and physiological measures.
Collapse
Affiliation(s)
- Travis M. Moore
- Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, TN
| | - Erin M. Picou
- Department of Hearing and Speech Sciences, Vanderbilt University, Nashville, TN
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN
| |
Collapse
|
42
|
Psychophysiological measurement of affective responses during speech perception. Hear Res 2018; 369:103-119. [PMID: 30135023 DOI: 10.1016/j.heares.2018.07.007] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/31/2017] [Revised: 07/02/2018] [Accepted: 07/13/2018] [Indexed: 02/07/2023]
Abstract
When people make decisions about listening, such as whether to continue attending to a particular conversation or whether to wear their hearing aids to a particular restaurant, they do so on the basis of more than just their estimated performance. Recent research has highlighted the vital role of more subjective qualities such as effort, motivation, and fatigue. Here, we argue that the importance of these factors is largely mediated by a listener's emotional response to the listening challenge, and suggest that emotional responses to communication challenges may provide a crucial link between day-to-day communication stress and long-term health. We start by introducing some basic concepts from the study of emotion and affect. We then develop a conceptual framework to guide future research on this topic through examination of a variety of autonomic and peripheral physiological responses that have been employed to investigate both cognitive and affective phenomena related to challenging communication. We conclude by suggesting the need for further investigation of the links between communication difficulties, emotional response, and long-term health, and make some recommendations intended to guide future research on affective psychophysiology in speech communication.
Collapse
|
43
|
Hearing Handicap and Speech Recognition Correlate With Self-Reported Listening Effort and Fatigue. Ear Hear 2018; 39:470-474. [DOI: 10.1097/aud.0000000000000515] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
44
|
Abstract
OBJECTIVES To undertake a systematic review of available evidence on the effect of hearing impairment and hearing aid amplification on listening effort. Two research questions were addressed: Q1) does hearing impairment affect listening effort? and Q2) can hearing aid amplification affect listening effort during speech comprehension? DESIGN English language articles were identified through systematic searches in PubMed, EMBASE, Cinahl, the Cochrane Library, and PsycINFO from inception to August 2014. References of eligible studies were checked. The Population, Intervention, Control, Outcomes, and Study design strategy was used to create inclusion criteria for relevance. It was not feasible to apply a meta-analysis of the results from comparable studies. For the articles identified as relevant, a quality rating, based on the 2011 Grading of Recommendations Assessment, Development, and Evaluation Working Group guidelines, was carried out to judge the reliability and confidence of the estimated effects. RESULTS The primary search produced 7017 unique hits using the keywords: hearing aids OR hearing impairment AND listening effort OR perceptual effort OR ease of listening. Of these, 41 articles fulfilled the Population, Intervention, Control, Outcomes, and Study design selection criteria of: experimental work on hearing impairment OR hearing aid technologies AND listening effort OR fatigue during speech perception. The methods applied in those articles were categorized into subjective, behavioral, and physiological assessment of listening effort. For each study, the statistical analysis addressing research question Q1 and/or Q2 was extracted. In seven articles more than one measure of listening effort was provided. Evidence relating to Q1 was provided by 21 articles that reported 41 relevant findings. Evidence relating to Q2 was provided by 27 articles that reported 56 relevant findings. The quality of evidence on both research questions (Q1 and Q2) was very low, according to the Grading of Recommendations Assessment, Development, and Evaluation Working Group guidelines. We tested the statistical evidence across studies with nonparametric tests. The testing revealed only one consistent effect across studies, namely that listening effort was higher for hearing-impaired listeners compared with normal-hearing listeners (Q1) as measured by electroencephalographic measures. For all other studies, the evidence across studies failed to reveal consistent effects on listening effort. CONCLUSION In summary, we could only identify scientific evidence from physiological measurement methods, suggesting that hearing impairment increases listening effort during speech perception (Q1). There was no scientific, finding across studies indicating that hearing aid amplification decreases listening effort (Q2). In general, there were large differences in the study population, the control groups and conditions, and the outcome measures applied between the studies included in this review. The results of this review indicate that published listening effort studies lack consistency, lack standardization across studies, and have insufficient statistical power. The findings underline the need for a common conceptual framework for listening effort to address the current shortcomings.
Collapse
|
45
|
Abstract
OBJECTIVE Clinical studies are often facing missing data. Data can be missing for various reasons, for example, patients moved, certain measurements are only administered in high-risk groups, and patients are unable to attend clinic because of their health status. There are various ways to handle these missing data (e.g., complete cases analyses, mean substitution). Each of these techniques potentially influences both the analyses and the results of a study. The first aim of this structured review was to analyze how often researchers in the field of otorhinolaryngology/head & neck surgery report missing data. The second aim was to systematically describe how researchers handle missing data in their analyses. The third aim was to provide a solution on how to deal with missing data by means of the multiple imputation technique. With this review, we aim to contribute to a higher quality of reporting in otorhinolaryngology research. DESIGN Clinical studies among the 398 most recently published research articles in three major journals in the field of otorhinolaryngology/head & neck surgery were analyzed based on how researchers reported and handled missing data. RESULTS Of the 316 clinical studies, 85 studies reported some form of missing data. Of those 85, only a small number (12 studies, 3.8%) actively handled the missingness in their data. The majority of researchers exclude incomplete cases, which results in biased outcomes and a drop in statistical power. CONCLUSIONS Within otorhinolaryngology research, missing data are largely ignored and underreported, and consequently, handled inadequately. This has major impact on the results and conclusions drawn from this research. Based on the outcomes of this review, we provide solutions on how to deal with missing data. To illustrate, we clarify the use of multiple imputation techniques, which recently became widely available in standard statistical programs.
Collapse
|
46
|
Dritsakis G, Kikidis D, Koloutsou N, Murdin L, Bibas A, Ploumidou K, Laplante-Lévesque A, Pontoppidan NH, Bamiou DE. Clinical validation of a public health policy-making platform for hearing loss (EVOTION): protocol for a big data study. BMJ Open 2018; 8:e020978. [PMID: 29449298 PMCID: PMC5829902 DOI: 10.1136/bmjopen-2017-020978] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
INTRODUCTION The holistic management of hearing loss (HL) requires an understanding of factors that predict hearing aid (HA) use and benefit beyond the acoustics of listening environments. Although several predictors have been identified, no study has explored the role of audiological, cognitive, behavioural and physiological data nor has any study collected real-time HA data. This study will collect 'big data', including retrospective HA logging data, prospective clinical data and real-time data via smart HAs, a mobile application and biosensors. The main objective is to enable the validation of the EVOTION platform as a public health policy-making tool for HL. METHODS AND ANALYSIS This will be a big data international multicentre study consisting of retrospective and prospective data collection. Existing data from approximately 35 000 HA users will be extracted from clinical repositories in the UK and Denmark. For the prospective data collection, 1260 HA candidates will be recruited across four clinics in the UK and Greece. Participants will complete a battery of audiological and other assessments (measures of patient-reported HA benefit, mood, cognition, quality of life). Patients will be offered smart HAs and a mobile phone application and a subset will also be given wearable biosensors, to enable the collection of dynamic real-life HA usage data. Big data analytics will be used to detect correlations between contextualised HA usage and effectiveness, and different factors and comorbidities affecting HL, with a view to informing public health decision-making. ETHICS AND DISSEMINATION Ethical approval was received from the London South East Research Ethics Committee (17/LO/0789), the Hippokrateion Hospital Ethics Committee (1847) and the Athens Medical Center's Ethics Committee (KM140670). Results will be disseminated through national and international events in Greece and the UK, scientific journals, newsletters, magazines and social media. Target audiences include HA users, clinicians, policy-makers and the general public. TRIAL REGISTRATION NUMBER NCT03316287; Pre-results.
Collapse
Affiliation(s)
- Giorgos Dritsakis
- Ear Institute, University College London, London, UK
- Royal National Throat Nose & Ear Hospital, London, UK
| | - Dimitris Kikidis
- 1st Department of Otolaryngology, National and Kapodistrian University of Athens, Hippocrateion Hospital, Athens, Greece
| | | | - Louisa Murdin
- Guy’s and St Thomas’ NHS Foundation Trust, London, UK
| | - Athanasios Bibas
- 1st Department of Otolaryngology, National and Kapodistrian University of Athens, Hippocrateion Hospital, Athens, Greece
| | | | | | | | - Doris-Eva Bamiou
- Ear Institute, University College London, London, UK
- Royal National Throat Nose & Ear Hospital, London, UK
- NIHR University College London Hospitals Biomedical Research Centre, London, UK
| |
Collapse
|
47
|
Picou EM, Ricketts TA. The relationship between speech recognition, behavioural listening effort, and subjective ratings. Int J Audiol 2018; 57:457-467. [DOI: 10.1080/14992027.2018.1431696] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Affiliation(s)
- Erin M. Picou
- Vanderbilt University Medical Center, Nashville, TN, USA
| | | |
Collapse
|
48
|
Huber R, Krüger M, Meyer BT. Single-ended prediction of listening effort using deep neural networks. Hear Res 2018; 359:40-49. [PMID: 29373159 DOI: 10.1016/j.heares.2017.12.014] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/11/2017] [Revised: 12/03/2017] [Accepted: 12/23/2017] [Indexed: 10/18/2022]
Abstract
The effort required to listen to and understand noisy speech is an important factor in the evaluation of noise reduction schemes. This paper introduces a model for Listening Effort prediction from Acoustic Parameters (LEAP). The model is based on methods from automatic speech recognition, specifically on performance measures that quantify the degradation of phoneme posteriorgrams produced by a deep neural net: Noise or artifacts introduced by speech enhancement often result in a temporal smearing of phoneme representations, which is measured by comparison of phoneme vectors. This procedure does not require a priori knowledge about the processed speech, and is therefore single-ended. The proposed model was evaluated using three datasets of noisy speech signals with listening effort ratings obtained from normal hearing and hearing impaired subjects. The prediction quality was compared to several baseline models such as the ITU-T standard P.563 for single-ended speech quality assessment, the American National Standard ANIQUE+ for single-ended speech quality assessment, and a single-ended SNR estimator. In all three datasets, the proposed new model achieved clearly better prediction accuracies than the baseline models; correlations with subjective ratings were above 0.9. So far, the model is trained on the specific noise types used in the evaluation. Future work will be concerned with overcoming this limitation by training the model on a variety of different noise types in a multi-condition way in order to make it generalize to unknown noise types.
Collapse
Affiliation(s)
- Rainer Huber
- Medizinische Physik and Cluster of Excellence Hearing4all, Carl-von-Ossietzky Universität Oldenburg, Carl-von-Ossietzky-Str. 9-11, 26129 Oldenburg, Germany.
| | - Melanie Krüger
- Hörzentrum Oldenburg, Marie-Curie-Str. 2, 26129 Oldenburg, Germany.
| | - Bernd T Meyer
- Medizinische Physik and Cluster of Excellence Hearing4all, Carl-von-Ossietzky Universität Oldenburg, Carl-von-Ossietzky-Str. 9-11, 26129 Oldenburg, Germany.
| |
Collapse
|
49
|
Autonomic Nervous System Reactivity During Speech Repetition Tasks: Heart Rate Variability and Skin Conductance. Ear Hear 2018; 37 Suppl 1:118S-25S. [PMID: 27355761 DOI: 10.1097/aud.0000000000000305] [Citation(s) in RCA: 77] [Impact Index Per Article: 12.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
Cognitive and emotional challenges may elicit a physiological stress response that can include arousal of the sympathetic nervous system (fight or flight response) and withdrawal of the parasympathetic nervous system (responsible for recovery and rest). This article reviews studies that have used measures of electrodermal activity (skin conductance) and heart rate variability (HRV) to index sympathetic and parasympathetic activity during auditory tasks. In addition, the authors present results from a new study with normal-hearing listeners examining the effects of speaking rate on changes in skin conductance and high-frequency HRV (HF-HRV). Sentence repetition accuracy for normal and fast speaking rates was measured in noise using signal to noise ratios that were adjusted to approximate 80% accuracy (+3 dB fast rate; 0 dB normal rate) while monitoring skin conductance and HF-HRV activity. A significant increase in skin conductance level (reflecting sympathetic nervous system arousal) and a decrease in HF-HRV (reflecting parasympathetic nervous system withdrawal) were observed with an increase in speaking rate indicating sensitivity of both measures to increased task demand. Changes in psychophysiological reactivity with increased auditory task demand may reflect differences in listening effort, but other person-related factors such as motivation and stress may also play a role. Further research is needed to understand how psychophysiological activity during listening tasks is influenced by the acoustic characteristics of stimuli, task demands, and by the characteristics and emotional responses of the individual.
Collapse
|
50
|
Cortisol, Chromogranin A, and Pupillary Responses Evoked by Speech Recognition Tasks in Normally Hearing and Hard-of-Hearing Listeners: A Pilot Study. Ear Hear 2018; 37 Suppl 1:126S-35S. [PMID: 27355762 DOI: 10.1097/aud.0000000000000311] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
Abstract
Pupillometry is one method that has been used to measure processing load expended during speech understanding. Notably, speech perception (in noise) tasks can evoke a pupil response. It is not known if there is concurrent activation of the sympathetic nervous system as indexed by salivary cortisol and chromogranin A (CgA) and whether such activation differs between normally hearing (NH) and hard-of-hearing (HH) adults. Ten NH and 10 adults with mild-to-moderate hearing loss (mean age 52 years) participated. Two speech perception tests were administered in random order: one in quiet targeting 100% correct performance and one in noise targeting 50% correct performance. Pupil responses and salivary samples for cortisol and CgA analyses were collected four times: before testing, after the two speech perception tests, and at the end of the session. Participants rated their perceived accuracy, effort, and motivation. Effects were examined using repeated-measures analyses of variance. Correlations between outcomes were calculated. HH listeners had smaller peak pupil dilations (PPDs) than NH listeners in the speech in noise condition only. No group or condition effects were observed for the cortisol data, but HH listeners tended to have higher cortisol levels across conditions. CgA levels were larger at the pretesting time than at the three other test times. Hearing impairment did not affect CgA. Self-rated motivation correlated most often with cortisol or PPD values. The three physiological indicators of cognitive load and stress (PPD, cortisol, and CgA) are not equally affected by speech testing or hearing impairment. Each of them seem to capture a different dimension of sympathetic nervous system activity.
Collapse
|