A Potential Bias in Subjective Ratings of Mental Effort

Mood shapes the impact of reward on perceived fatigue from listening

Knowledge of the underlying mechanisms of effortful listening could help to reduce cases of social withdrawal and mitigate fatigue, especially in older adults. However, the relationship between transient effort and longer term fatigue is likely to be more complex than originally thought. Here, we manipulated the presence/absence of monetary reward to examine the role of motivation and mood state in governing changes in perceived effort and fatigue from listening. In an online study, 185 participants were randomly assigned to either a "reward" (n = 91) or "no-reward" (n = 94) group and completed a dichotic listening task along with a series of questionnaires assessing changes over time in perceived effort, mood, and fatigue. Effort ratings were higher overall in the reward group, yet fatigue ratings in that group showed a shallower linear increase over time. Mediation analysis revealed an indirect effect of reward on fatigue ratings via perceived mood state; reward induced a more positive mood state which was associated with reduced fatigue. These results suggest that: (1) listening conditions rated as more "effortful" may be less fatiguing if the effort is deemed worthwhile, and (2) alterations to one's mood state represent a potential mechanism by which fatigue may be elicited during unrewarding listening situations.

Hearing Impairment: Reduced Pupil Dilation Response and Frontal Activation During Degraded Speech Perception

PURPOSE

A relevant aspect of listening is the effort required during speech processing, which can be assessed by pupillometry. Here, we assessed the pupil dilation response of normal-hearing (NH) and hard of hearing (HH) individuals during listening to clear sentences and masked or degraded sentences. We combined this assessment with functional magnetic resonance imaging (fMRI) to investigate the neural correlates of the pupil dilation response.

METHOD

Seventeen NH participants (Mage = 46 years) were compared to 17 HH participants (Mage = 45 years) who were individually matched in age and educational level. Participants repeated sentences that were presented clearly, that were distorted, or that were masked. The sentence intelligibility level of masked and distorted sentences was 50% correct. Silent baseline trials were presented as well. Performance measures, pupil dilation responses, and fMRI data were acquired.

RESULTS

HH individuals had overall poorer speech reception than the NH participants, but not for noise-vocoded speech. In addition, an interaction effect was observed with smaller pupil dilation responses in HH than in NH listeners for the degraded speech conditions. Hearing impairment was associated with higher activation across conditions in the left superior temporal gyrus, as compared to the silent baseline. However, the region of interest analysis indicated lower activation during degraded speech relative to clear speech in bilateral frontal regions and the insular cortex, for HH compared to NH listeners. Hearing impairment was also associated with a weaker relation between the pupil response and activation in the right inferior frontal gyrus. Overall, degraded speech evoked higher frontal activation than clear speech.

CONCLUSION

Brain areas associated with attentional and cognitive-control processes may be increasingly recruited when speech is degraded and are related to the pupil dilation response, but this relationship is weaker in HH listeners.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.27162135.

Listening Effort Measured With Pupillometry in Cochlear Implant Users Depends on Sound Level, But Not on the Signal to Noise Ratio When Using the Matrix Test

OBJECTIVES

We investigated whether listening effort is dependent on task difficulty for cochlear implant (CI) users when using the Matrix speech-in-noise test. To this end, we measured peak pupil dilation (PPD) at a wide range of signal to noise ratios (SNR) by systematically changing the noise level at a constant speech level, and vice versa.

DESIGN

A group of mostly elderly CI users performed the Dutch/Flemish Matrix test in quiet and in multitalker babble at different SNRs. SNRs were set relative to the speech-recognition threshold (SRT), namely at SRT, and 5 and 10 dB above SRT (0 dB, +5 dB, and +10 dB re SRT). The latter 2 conditions were obtained by either varying speech level (at a fixed noise level of 60 dBA) or by varying noise level (with a fixed speech level). We compared these PPDs with those of a group of typical hearing (TH) listeners. In addition, listening effort was assessed with subjective ratings on a Likert scale.

RESULTS

PPD for the CI group did not significantly depend on SNR, whereas SNR significantly affected PPDs for TH listeners. Subjective effort ratings depended significantly on SNR for both groups. For CI users, PPDs were significantly larger, and effort was rated higher when speech was varied, and noise was fixed for CI users. By contrast, for TH listeners effort ratings were significantly higher and performance scores lower when noise was varied, and speech was fixed.

CONCLUSIONS

The lack of a significant effect of varying SNR on PPD suggests that the Matrix test may not be a feasible speech test for measuring listening effort with pupillometric measures for CI users. A rating test appeared more promising in this population, corroborating earlier reports that subjective measures may reflect different dimensions of listening effort than pupil dilation. Establishing the SNR by varying speech or noise level can have subtle, but significant effects on measures of listening effort, and these effects can differ between TH listeners and CI users.

Acoustic- Versus Intelligibility-Based Assessment of Subjective Listening Difficulty Measured With the Repeat-Recall Test

OBJECTIVES

To contrast interpretations of listening effort ratings when judged against acoustic- versus intelligibility-based normative references.

DESIGN

Existing data collected from 66 normal-hearing adult listeners, comprising 2730 trials of the Repeat-Recall Test, were used to establish norms of subjective listening effort ratings for six ranges of intelligibility. Data from 21 aided hearing-impaired listeners were then used to contrast intelligibility-based norms against acoustic-based norms when interpreting listening effort ratings measured in omnidirectional and directional microphone conditions.

RESULTS

Whereas acoustic-based norms effectively demonstrated reduced effort for directional versus omnidirectional microphone modes, intelligibility-based references controlled for listeners' performance biases and improved the consistency with which subjective ratings were ranked across the two microphone conditions.

CONCLUSIONS

The choice of normative reference should be carefully considered when judging listening effort ratings from hearing-impaired individuals against those of their normal-hearing peers. Whereas acoustic-based references may be more useful for evaluating the benefits of hearing aid technology, intelligibility-based references may be better suited to identifying listeners with poor subjective experiences for speech-in-noise related to factors beyond intelligibility.

Empatica E4 Assessment of Child Physiological Measures of Listening Effort During Remote and In-Person Communication

PURPOSE

Telepractice is a growing service model that delivers aural rehabilitation to deaf and hard-of hearing children via telecommunications technology. Despite known benefits of telepractice, this delivery approach may increase patients' listening effort (LE) characterized as an allocation of cognitive resources toward an auditory task. The study tested techniques for collecting physiological measures of LE in normal-hearing (NH) children during remote (referred to as tele-) and in-person communication using the wearable Empatica E4 wristband.

METHOD

Participants were 10 children (age range: 9-12 years old) who came to two tele- and two in-person weekly sessions, order counterbalanced. During each session, the children heard a short passage read by the clinical provider, completed an auditory passage comprehension task, and self-rated their effort as a part of the larger study. Measures of electrodermal activity and blood volume pulse amplitude were collected from the child E4 wristband.

RESULTS

No differences in child subjective, physiological measures of LE or passage comprehension scores were found between in-person sessions and telesessions. However, an effect of treatment duration on subjective and physiological measures of LE was identified. Children self-reported a significant increase in LE over time. However, their physiological measures demonstrated a trend indicating a decrease in LE. A significant association between subjective measures and the passage comprehension task was found suggesting that those children who reported more effort demonstrated a higher proportion of correct responses.

CONCLUSIONS

The study demonstrated the feasibility of collection of physiological measures of LE in NH children during remote and in-person communication using the E4 wristband. The results suggest that measures of LE are multidimensional and may reflect different sources of, or cognitive responses to, increased listening demand.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.27122064.

Relations Among Multiple Dimensions of Self-Reported Listening Effort in Response to an Auditory Psychomotor Vigilance Task

PURPOSE

Listening effort is a broad construct, and there is no consensus on how to subdivide listening effort into dimensions. This project focuses on the subjective experience of effortful listening and tests if cognitive workload, mental fatigue, and mood are interrelated dimensions.

METHOD

Two online studies tested young adults (n = 74 and n = 195) and measured subjective workload, fatigue (subscales of fatigue and energy), and mood (subscales of positive and negative mood) before and after a challenging listening task. In the listening effort task, participants responded to intermittent 1-kHz target tones in continuous white noise for approximately 12 min.

RESULTS

Correlations and principal component analysis showed that fatigue and mood were distinct but interrelated constructs that weakly correlated with workload. Effortful listening provoked increased fatigue and decreased energy and positive mood yet did not influence negative mood or workload.

CONCLUSIONS

The findings suggest that self-reported listening effort has multiple dimensions that can have different responses to the same effortful listening episode. The results can help guide evidence-based development of clinical listening effort tests and may reveal mechanisms for how listening effort relates to quality of life in those with hearing impairment.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.26418976.

A Multimodal Approach to Measuring Listening Effort: A Systematic Review on the Effects of Auditory Task Demand on Physiological Measures and Their Relationship

OBJECTIVES

Listening effort involves the mental effort required to perceive an auditory stimulus, for example in noisy environments. Prolonged increased listening effort, for example due to impaired hearing ability, may increase risk of health complications. It is therefore important to identify valid and sensitive measures of listening effort. Physiological measures have been shown to be sensitive to auditory task demand manipulations and are considered to reflect changes in listening effort. Such measures include pupil dilation, alpha power, skin conductance level, and heart rate variability. The aim of the current systematic review was to provide an overview of studies to listening effort that used multiple physiological measures. The two main questions were: (1) what is the effect of changes in auditory task demand on simultaneously acquired physiological measures from various modalities? and (2) what is the relationship between the responses in these physiological measures?

DESIGN

Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, relevant articles were sought in PubMed, PsycInfo, and Web of Science and by examining the references of included articles. Search iterations with different combinations of psychophysiological measures were performed in conjunction with listening effort-related search terms. Quality was assessed using the Appraisal Tool for Cross-Sectional Studies.

RESULTS

A total of 297 articles were identified from three databases, of which 27 were included. One additional article was identified from reference lists. Of the total 28 included articles, 16 included an analysis regarding the relationship between the physiological measures. The overall quality of the included studies was reasonable.

CONCLUSIONS

The included studies showed that most of the physiological measures either show no effect to auditory task demand manipulations or a consistent effect in the expected direction. For example, pupil dilation increased, pre-ejection period decreased, and skin conductance level increased with increasing auditory task demand. Most of the relationships between the responses of these physiological measures were nonsignificant or weak. The physiological measures varied in their sensitivity to auditory task demand manipulations. One of the identified knowledge gaps was that the included studies mostly used tasks with high-performance levels, resulting in an underrepresentation of the physiological changes at lower performance levels. This makes it difficult to capture how the physiological responses behave across the full psychometric curve. Our results support the Framework for Understanding Effortful Listening and the need for a multimodal approach to listening effort. We furthermore discuss focus points for future studies.

Effects of hearing acuity on psychophysiological responses to effortful speech perception

In recent studies, psychophysiological measures have been used as markers of listening effort, but there is limited research on the effect of hearing loss on such measures. The aim of the current study was to investigate the effect of hearing acuity on physiological responses and subjective measures acquired during different levels of listening demand, and to investigate the relationship between these measures. A total of 125 participants (37 males and 88 females, age range 37-72 years, pure-tone average hearing thresholds at the best ear between -5.0 to 68.8 dB HL and asymmetry between ears between 0.0 and 87.5 dB) completed a listening task. A speech reception threshold (SRT) test was used with target sentences spoken by a female voice masked by male speech. Listening demand was manipulated using three levels of intelligibility: 20 % correct speech recognition, 50 %, and 80 % (IL20 %/IL50 %/IL80 %, respectively). During the task, peak pupil dilation (PPD), heart rate (HR), pre-ejection period (PEP), respiratory sinus arrhythmia (RSA), and skin conductance level (SCL) were measured. For each condition, subjective ratings of effort, performance, difficulty, and tendency to give up were also collected. Linear mixed effects models tested the effect of intelligibility level, hearing acuity, hearing asymmetry, and tinnitus complaints on the physiological reactivity (compared to baseline) and subjective measures. PPD and PEP reactivity showed a non-monotonic relationship with intelligibility level, but no such effects were found for HR, RSA, or SCL reactivity. Participants with worse hearing acuity had lower PPD at all intelligibility levels and showed lower PEP baseline levels. Additionally, PPD and SCL reactivity were lower for participants who reported suffering from tinnitus complaints. For IL80 %, but not IL50 % or IL20 %, participants with worse hearing acuity rated their listening effort to be relatively high compared to participants with better hearing. The reactivity of the different physiological measures were not or only weakly correlated with each other. Together, the results suggest that hearing acuity may be associated with altered sympathetic nervous system (re)activity. Research using psychophysiological measures as markers of listening effort to study the effect of hearing acuity on such measures are best served by the use of the PPD and PEP.

Characteristics of the quick repeat-recall test (Q-RRT)

OBJECTIVE

To determine the reliability and validity of the Quick Repeat-Recall Test (Q-RRT).

DESIGN

Within-subject repeated measures. Participants completed the Q-RRT at a speech level of 75 dB SPL in 2 noise configurations at signal-to-noise ratios of 5, 10, and 15 dB in a counterbalanced order, along with the full-RRT. The Q-RRT was repeated after 1-3 weeks to estimate within-session and between-session reliability. Participants also completed external validation measures relating speech-in-noise ability (Hearing-In-Noise Test, HINT), memory (Reading Span Test, RST; Forward Digit Span Test, DST-F), and noise acceptance (Tracking of Noise Tolerance, TNT).

STUDY SAMPLE

Twenty-five normal-hearing listeners (mean age = 63.9 years).

RESULTS

Group Repeat and Recall scores were similar between the full-RRT and the Q-RRT. However, Listening Effort and Tolerable Time ratings were significantly poorer for the full-RRT than the Q-RRT. The average repeat scores correlated with the HINT scores, while the recall scores correlated with the DST-F and RST scores. Tolerable Time ratings also correlated with the TNT scores. Within-session and between-session test-retest reliability using intraclass correlation coefficients were fair-to-excellent (0.41-0.91) depending on the outcome measures.

CONCLUSIONS

The Q-RRT is a reliable and valid measure of speech-in-noise ability, working memory, listening effort, and noise acceptance.

Contributions of listening effort and intelligibility to cortical tracking of speech in adverse listening conditions

Cortical tracking of speech is vital for speech segmentation and is linked to speech intelligibility. However, there is no clear consensus as to whether reduced intelligibility leads to a decrease or an increase in cortical speech tracking, warranting further investigation of the factors influencing this relationship. One such factor is listening effort, defined as the cognitive resources necessary for speech comprehension, and reported to have a strong negative correlation with speech intelligibility. Yet, no studies have examined the relationship between speech intelligibility, listening effort, and cortical tracking of speech. The aim of the present study was thus to examine these factors in quiet and distinct adverse listening conditions. Forty-nine normal hearing adults listened to sentences produced casually, presented in quiet and two adverse listening conditions: cafeteria noise and reverberant speech. Electrophysiological responses were registered with electroencephalogram, and listening effort was estimated subjectively using self-reported scores and objectively using pupillometry. Results indicated varying impacts of adverse conditions on intelligibility, listening effort, and cortical tracking of speech, depending on the preservation of the speech temporal envelope. The more distorted envelope in the reverberant condition led to higher listening effort, as reflected in higher subjective scores, increased pupil diameter, and stronger cortical tracking of speech in the delta band. These findings suggest that using measures of listening effort in addition to those of intelligibility is useful for interpreting cortical tracking of speech results. Moreover, reading and phonological skills of participants were positively correlated with listening effort in the cafeteria condition, suggesting a special role of expert language skills in processing speech in this noisy condition. Implications for future research and theories linking atypical cortical tracking of speech and reading disorders are further discussed.

Input-related demands: vocoded sentences evoke different pupillometrics and subjective listening effort than sentences in speech-shaped noise

OBJECTIVES

The Framework for Effortful Listening (FUEL) suggests five input-related demands can alter listening effort: source, transmission, listener, message and context factors. We hypothesised that vocoded sentences represented a source factor degradation and sentences in speech-shaped noise represented a transmission factor degradation. We used pupillometry and a subjective scale to examine our hypothesis.

DESIGN

Participants listened to vocoded sentences and sentences in speech-shaped noise at several difficulty levels designed to produce similar word recognition abilities; they also listened to unprocessed sentences. Within-participant pupillometrics and subjective listening effort were analysed. Post-hoc analyses were performed to examine if word recognition accuracy differentially influenced pupil responses.

STUDY SAMPLES

Twenty young adults with normal hearing.

RESULTS

Baseline pupil diameter was significantly smaller, peak pupil dilation was significantly larger, peak pupil dilation latency was significantly shorter, and subjective listening effort was significantly greater for the vocoded sentences than the sentences-in-noise. Word recognition ability also affected pupillometrics, but only for the vocoded sentences.

CONCLUSIONS

Our findings suggest that source factor degradations result in greater listening effort than transmission factor degradations. Future research should address how clinical interventions tailored towards different input-related demands may lead to reduced listening effort and improve patient outcomes.

Note on the Dual-Task Paradigm and its Use to Measure Listening Effort

People regularly communicate in complex environments, requiring them to flexibly shift their attention across multiple sources of sensory information. Increasing recruitment of the executive functions that support successful speech comprehension in these multitasking settings is thought to contribute to the sense of effort that listeners often experience. One common research method employed to quantify listening effort is the dual-task paradigm in which individuals recognize speech and concurrently perform a secondary (often visual) task. Effort is operationalized as performance decrements on the secondary task as speech processing demands increase. However, recent reviews have noted critical inconsistencies in the results of dual-task experiments, likely in part due to how and when the two tasks place demands on a common set of mental resources and how flexibly individuals can allocate their attention to them. We propose that in order to move forward to address this gap, we need to first look backward: better integrating theoretical models of resource capacity and allocation as well as of task-switching that have been historically developed in domains outside of hearing research (viz., cognitive psychology and neuroscience). With this context in mind, we describe how dual-task experiments could be designed and interpreted such that they provide better and more robust insights into the mechanisms that contribute to effortful listening.

Automated Measurement of Speech Recognition, Reaction Time, and Speech Rate and Their Relation to Self-Reported Listening Effort for Normal-Hearing and Hearing-Impaired Listeners Using various Maskers

In speech audiometry, the speech-recognition threshold (SRT) is usually established by adjusting the signal-to-noise ratio (SNR) until 50% of the words or sentences are repeated correctly. However, these conditions are rarely encountered in everyday situations. Therefore, for a group of 15 young participants with normal hearing and a group of 12 older participants with hearing impairment, speech-recognition scores were determined at SRT and at four higher SNRs using several stationary and fluctuating maskers. Participants' verbal responses were recorded, and participants were asked to self-report their listening effort on a categorical scale (self-reported listening effort, SR-LE). The responses were analyzed using an Automatic Speech Recognizer (ASR) and compared to the results of a human examiner. An intraclass correlation coefficient of r = .993 for the agreement between their corresponding speech-recognition scores was observed. As expected, speech-recognition scores increased with increasing SNR and decreased with increasing SR-LE. However, differences between speech-recognition scores for fluctuating and stationary maskers were observed as a function of SNR, but not as a function of SR-LE. The verbal response time (VRT) and the response speech rate (RSR) of the listeners' responses were measured using an ASR. The participants with hearing impairment showed significantly lower RSRs and higher VRTs compared to the participants with normal hearing. These differences may be attributed to differences in age, hearing, or both. With increasing SR-LE, VRT increased and RSR decreased. The results show the possibility of deriving a behavioral measure, VRT, measured directly from participants' verbal responses during speech audiometry, as a proxy for SR-LE.

The Benefit of Hearing Aids as Measured by Listening Accuracy, Subjective Listening Effort, and Functional Near Infrared Spectroscopy

There is broad consensus that listening effort is an important outcome for measuring hearing performance. However, there remains debate on the best ways to measure listening effort. This study sought to measure neural correlates of listening effort using functional near-infrared spectroscopy (fNIRS) in experienced adult hearing aid users. The study evaluated impacts of amplification and signal-to-noise ratio (SNR) on cerebral blood oxygenation, with the expectation that easier listening conditions would be associated with less oxygenation in the prefrontal cortex. Thirty experienced adult hearing aid users repeated sentence-final words from low-context Revised Speech Perception in Noise Test sentences. Participants repeated words at a hard SNR (individual SNR-50) or easy SNR (individual SNR-50 + 10 dB), while wearing hearing aids fit to prescriptive targets or without wearing hearing aids. In addition to assessing listening accuracy and subjective listening effort, prefrontal blood oxygenation was measured using fNIRS. As expected, easier listening conditions (i.e., easy SNR, with hearing aids) led to better listening accuracy, lower subjective listening effort, and lower oxygenation across the entire prefrontal cortex compared to harder listening conditions. Listening accuracy and subjective listening effort were also significant predictors of oxygenation.

Eye Movements Decrease during Effortful Speech Listening

Hearing impairment affects many older adults but is often diagnosed decades after speech comprehension in noisy situations has become effortful. Accurate assessment of listening effort may thus help diagnose hearing impairment earlier. However, pupillometry-the most used approach to assess listening effort-has limitations that hinder its use in practice. The current study explores a novel way to assess listening effort through eye movements. Building on cognitive and neurophysiological work, we examine the hypothesis that eye movements decrease when speech listening becomes challenging. In three experiments with human participants from both sexes, we demonstrate, consistent with this hypothesis, that fixation duration increases and spatial gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (simple sentences, naturalistic stories). In contrast, pupillometry was less sensitive to speech masking during story listening, suggesting pupillometric measures may not be as effective for the assessments of listening effort in naturalistic speech-listening paradigms. Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in the brain regions that support the regulation of eye movements, such as frontal eye field and superior colliculus, are modulated when listening is effortful.SIGNIFICANCE STATEMENT Assessment of listening effort is critical for early diagnosis of age-related hearing loss. Pupillometry is most used but has several disadvantages. The current study explores a novel way to assess listening effort through eye movements. We examine the hypothesis that eye movements decrease when speech listening becomes effortful. We demonstrate, consistent with this hypothesis, that fixation duration increases and gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (sentences, naturalistic stories). Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in brain regions that support the regulation of eye movements are modulated when listening is effortful.

Auditory-Perceptual and Pupillometric Evaluation of Vocal Roughness and Listening Effort in Tracheoesophageal Speech

OBJECTIVES

This study evaluated auditory-perceptual judgments of perceived vocal roughness (VR) and listening effort (LE) along with pupillometric responses in response to speech samples produced by tracheoesophageal (TE) talkers.

METHODS

Twenty normal-hearing, naive young adults (eight men and twelve women) served as listeners. Listeners were divided into two groups: (1) a with-anchor (WA) group (four men and six women) and (2) a no-anchor (NA) group (four men and six women). All were presented with speech samples produced by twenty TE talkers; listeners evaluated two auditory-perceptual dimensions-VR and LE-using visual analog scales. Anchors were provided to the WA group as an external referent for their ratings. In addition, during the auditory-perceptual task, each listener's pupil reactions also were recorded with peak pupil dilation (PPD) measures extracted as a physiologic indicator associated with the listening task.

RESULTS

High interrater reliability was obtained for both the WA and NA groups. High correlations also were observed between auditory-perceptual ratings of roughness and LE, and between PPD values and ratings of both dimensions for the WA group. The inclusion of an anchor during the auditory-perceptual task improved interrater reliability ratings, but it also imposed an increased demand on listeners.

CONCLUSIONS

Data obtained offer insights into the relationship between subjective indices of voice quality (ie, auditory-perceptual evaluation) and physiologic responses (PPD) to the abnormal voice quality that characterizes TE talkers. Furthermore, these data provide information on the inclusion/exclusion of audio anchors and potential increases in listener demand in response to abnormal voice quality.

Facial Expressions as an Index of Listening Difficulty and Emotional Response

Knowledge about listening difficulty experienced during a task can be used to better understand speech perception processes, to guide amplification outcomes, and can be used by individuals to decide whether to participate in communication. Another factor affecting these decisions is individuals' emotional response which has not been measured objectively previously. In this study, we describe a novel method of measuring listening difficulty and affect of individuals in adverse listening situations using automatic facial expression algorithm. The purpose of our study was to determine if facial expressions of confusion and frustration are sensitive to changes in listening difficulty. We recorded speech recognition scores, facial expressions, subjective listening effort scores, and subjective emotional responses in 33 young participants with normal hearing. We used the signal-to-noise ratios of -1, +2, and +5 dB SNR and quiet conditions to vary the difficulty level. We found that facial expression of confusion and frustration increased with increase in difficulty level, but not with change in each level. We also found a relationship between facial expressions and both subjective emotion ratings and subjective listening effort. Emotional responses in the form of facial expressions show promise as a measure of affect and listening difficulty. Further research is needed to determine the specific contribution of affect to communication in challenging listening environments.

The role of effort in understanding academic achievements: empirical evidence from China

From the perspective of comparative education, it has often been stressed that Chinese families hold high expectations on school achievement and believe in the pay-off of effort. However, the literature on the relationship between effort and academic achievement is limited. Individual effort is not widely considered a significant cause of educational disparities, which often is mainly attributed to structural and contextual factors, such as family socioeconomic status (SES). Using the China Education Panel Survey (CEPS 2013, 2014), this study examined the role of effort in affecting educational outcomes and investigated the interplay between effort and family socioeconomic status. The results showed that effort has a positive impact on academic performance, though to a lesser degree than family SES. The study also discovered that low-SES students tend to exert more effort than high-SES students and that the effect of effort is greater for low-SES students. These findings underlined the importance of individual effort for academic success, particularly for low-SES students, and suggested policies that aim at enhancing motivation and engagement.

Effects of Critical Distance and Reverberation on Listening Effort in Adults

PURPOSE

Mixed historical data on how listening effort is affected by reverberation and listener-to-speaker distance challenge existing models of listening effort. This study investigated the effects of reverberation and listener-to-speaker distance on behavioral and subjective measures of listening effort: (a) when listening at a fixed signal-to-noise ratio (SNR) and (b) at SNRs that were manipulated so that word recognition would be comparable across different reverberation times and listening distances. It was expected that increased reverberation would increase listening effort but only when listening outside critical distance.

METHOD

Nineteen adults (21-40 years) with no hearing loss completed a dual-task paradigm. The primary task was word recognition and the secondary task was timed word categorization; response times indexed behavioral listening effort. Additionally, participants provided subjective ratings in each condition. Testing was completed at two reverberation levels (moderate and high, RT₃₀ = 469 and 1,223 ms, respectively) and at two listener-to-speaker distances (inside and outside critical distance for the test room, 1.25 and 4 m, respectively).

RESULTS

Increased reverberation and listening distances worsened word recognition performance and both behavioral and subjective listening effort. The effect of reverberation was exacerbated when listeners were outside critical distance. Subjective experience of listening effort persisted even when word recognition was comparable across conditions.

CONCLUSIONS

Longer reverberation times or listening outside the room's critical distance negatively affected behavioral and subjective listening effort. This study extends understanding of listening effort in reverberant rooms by highlighting the effect of listener's position relative to the room's critical distance.

Benefits of Text Supplementation on Sentence Recognition and Subjective Ratings With and Without Facial Cues for Listeners With Normal Hearing

OBJECTIVES

Recognizing speech through telecommunication can be challenging in unfavorable listening conditions. Text supplementation or provision of facial cues can facilitate speech recognition under some circumstances. However, our understanding of the combined benefit of text and facial cues in telecommunication is limited. The purpose of this study was to investigate the potential benefit of text supplementation for sentence recognition scores and subjective ratings of spoken speech with and without facial cues available.

DESIGN

Twenty adult females (M = 24 years, range 21 to 29 years) with normal hearing performed a sentence recognition task and also completed a subjective rating questionnaire in 24 conditions. The conditions varied by integrity of the available facial cues (clear facial cues, slight distortion facial cues, great distortion facial cues, no facial cues), signal-to-noise ratio (quiet, +1 dB, -3 dB), and text availability (with text, without text). When present, the text was an 86 to 88% accurate transcription of the auditory signal presented at a 500 ms delay relative to the auditory signal.

RESULTS

The benefits of text supplementation were largest when facial cues were not available and when the signal-to-noise ratio was unfavorable. Although no recognition score benefit was present in quiet, recognition benefit was significant in all levels of background noise for all levels of facial cue integrity. Moreover, participant subjective ratings of text benefit were robust and present even in the absence of recognition benefit. Consistent with previous literature, facial cues were beneficial for sentence recognition scores in the most unfavorable signal-to-noise ratio, even when greatly distorted. It is interesting that, although all levels of facial cues were beneficial for recognition scores, participants rated a significant benefit only with clear facial cues.

CONCLUSIONS

The benefit of text for auditory-only and auditory-visual speech recognition is evident in recognition scores and subjective ratings; the benefit is larger and more robust for subjective ratings than for scores. Therefore, text supplementation might provide benefit that extends beyond speech recognition scores. Combined, these findings support the use of text supplementation in telecommunication, even when facial cues are concurrently present, such as during teleconferencing or watching television.

Beyond Speech Intelligibility: Quantifying Behavioral and Perceived Listening Effort in Response to Dysarthric Speech

PURPOSE

This study investigated whether listener processing of dysarthric speech requires the recruitment of more cognitive resources (i.e., higher levels of listening effort) than neurotypical speech. We also explored relationships between behavioral listening effort, perceived listening effort, and objective measures of word transcription accuracy.

METHOD

A word recall paradigm was used to index behavioral listening effort. The primary task involved word transcription, whereas a memory task involved recalling words from previous sentences. Nineteen listeners completed the paradigm twice, once while transcribing dysarthric speech and once while transcribing neurotypical speech. Perceived listening effort was rated using a visual analog scale.

RESULTS

Results revealed significant effects of dysarthria on the likelihood of correct word recall, indicating that the transcription of dysarthric speech required higher levels of behavioral listening effort relative to neurotypical speech. There was also a significant relationship between transcription accuracy and measures of behavioral listening effort, such that listeners who were more accurate in understanding dysarthric speech exhibited smaller changes in word recall when listening to dysarthria. The subjective measure of perceived listening effort did not have a statistically significant correlation with measures of behavioral listening effort or transcription accuracy.

CONCLUSIONS

Results suggest that cognitive resources, particularly listeners' working memory capacity, are more taxed when deciphering dysarthric versus neurotypical speech. An increased demand on these resources may affect a listener's ability to remember aspects of their conversations with people with dysarthria, even when the speaker is fully intelligible.

Factors Predicting Mental Effort Associated With Verbal Fluency: Cue Types, Switching, and Fear of Negative Evaluation

PURPOSE

Verbal fluency, a task frequently employed in neuropsychological assessment, provides important word productivity data but little information about subjective effort associated with demand monitoring and resource allocation. In two experiments, this study investigated the effects of task variables (semantic vs. phonemic cues; alternating vs. nonalternating conditions) and personal factors (fear of negative evaluation and trait anxiety) on subjective effort for a wide variety of verbal fluency tasks in neurotypical individuals.

METHOD

Twenty-one adults completed eight verbal fluency tasks in Experiment 1. The tasks were selected to examine effort reported for verbal fluency that differed in (a) cue types and (b) the disruptions of clustering strategies. In Experiment 2, a separate group of 50 adults completed two verbal fluency tasks twice in separate sessions. Participants also completed social-emotional measures including fear of negative evaluation and trait anxiety. Working memory was assessed as a control variable.

RESULTS

Experiment 1 showed greater effort for completing semantic than phonemic cue tasks and greater effort for alternating than nonalternating conditions. Alternating semantic verbal fluency yielded the greatest effort among all tasks. Differences in effort could not be accounted for by performance alone. Experiment 2 showed that greater fear toward negative evaluation was associated with greater effort. The relationship between fear and effort was not related to trait anxiety or moderated by performance levels or repeated testing.

CONCLUSIONS

Knowledge about factors that impact subjective effort in neurotypical individuals is fundamental to accurate interpretation of effort reported by clinical populations. This study demonstrated the multifaceted nature of subjective effort that could not be accounted for by performance alone. In addition to task variables, effort assessment needs to consider the impact of social-emotional factors such as fear toward negative evaluation.

Assessment methods for determining small changes in hearing performance over time

Although the behavioral pure-tone threshold audiogram is considered the gold standard for quantifying hearing loss, assessment of speech understanding, especially in noise, is more relevant to quality of life but is only partly related to the audiogram. Metrics of speech understanding in noise are therefore an attractive target for assessing hearing over time. However, speech-in-noise assessments have more potential sources of variability than pure-tone threshold measures, making it a challenge to obtain results reliable enough to detect small changes in performance. This review examines the benefits and limitations of speech-understanding metrics and their application to longitudinal hearing assessment, and identifies potential sources of variability, including learning effects, differences in item difficulty, and between- and within-individual variations in effort and motivation. We conclude by recommending the integration of non-speech auditory tests, which provide information about aspects of auditory health that have reduced variability and fewer central influences than speech tests, in parallel with the traditional audiogram and speech-based assessments.

Remote Microphone Systems Can Improve Listening-in-Noise Accuracy and Listening Effort for Youth With Autism

OBJECTIVES

This study examined whether remote microphone (RM) systems improved listening-in-noise performance in youth with autism. We explored effects of RM system use on both listening-in-noise accuracy and listening effort in a well-characterized sample of participants with autism. We hypothesized that listening-in-noise accuracy would be enhanced and listening effort reduced, on average, when participants used the RM system. Furthermore, we predicted that effects of RM system use on listening-in-noise accuracy and listening effort would vary according to participant characteristics. Specifically, we hypothesized that participants who were chronologically older, had greater nonverbal cognitive and language ability, displayed fewer features of autism, and presented with more typical sensory and multisensory profiles might exhibit greater benefits of RM system use than participants who were younger, had less nonverbal cognitive or language ability, displayed more features of autism, and presented with greater sensory and multisensory disruptions.

DESIGN

We implemented a within-subjects design to investigate our hypotheses, wherein 32 youth with autism completed listening-in-noise testing with and without an RM system. Listening-in-noise accuracy and listening effort were evaluated simultaneously using a dual-task paradigm for stimuli varying in complexity (i.e., syllable-, word-, sentence-, and passage-level). In addition, several putative moderators of RM system effects (i.e., sensory and multisensory function, language, nonverbal cognition, and broader features of autism) on outcomes of interest were evaluated.

RESULTS

Overall, RM system use resulted in higher listening-in-noise accuracy in youth with autism compared with no RM system use. The observed benefits were all large in magnitude, although the benefits on average were greater for more complex stimuli (e.g., key words embedded in sentences) and relatively smaller for less complex stimuli (e.g., syllables). Notably, none of the putative moderators significantly influenced the effects of the RM system on listening-in-noise accuracy, indicating that RM system benefits did not vary according to any of the participant characteristics assessed. On average, RM system use did not have an effect on listening effort across all youth with autism compared with no RM system use but instead yielded effects that varied according to participant profile. Specifically, moderated effects indicated that RM system use was associated with increased listening effort for youth who had (a) average to below-average nonverbal cognitive ability, (b) below-average language ability, and (c) reduced audiovisual integration. RM system use was also associated with decreased listening effort for youth with very high nonverbal cognitive ability.

CONCLUSIONS

This study extends prior work by showing that RM systems have the potential to boost listening-in-noise accuracy for youth with autism. However, this boost in accuracy was coupled with increased listening effort, as indexed by longer reaction times while using an RM system, for some youth with autism, perhaps suggesting greater engagement in the listening-in-noise tasks when using the RM system for youth who had lower cognitive abilities, were less linguistically able, and/or have difficulty integrating seen and heard speech. These findings have important implications for clinical practice, suggesting RM system use in classrooms could potentially improve listening-in-noise performance for some youth with autism.

Listening in 2020: A Survey of Adults' Experiences With Pandemic-Related Disruptions

PURPOSE

The COVID-19 pandemic has introduced lifestyle changes that may negatively impact communication, including the pervasive use of face masks and videoconferencing technology. Here, we examine the effects of age and self-rated hearing on subjective measures of speech understanding via a survey accessed by adults residing in the United States.

METHOD

Responses to an online survey were obtained from adults (21 years of age and older) during the summer and fall of 2020. The survey included questions about hearing and speech understanding in a variety of scenarios and different listening conditions, including when communicating with people using face masks in quiet and noisy environments and when using videoconferencing.

RESULTS

Data from 1,703 surveys were analyzed. In general, the use of face masks led to the perception of poorer speech understanding and greater need for concentration, especially in noisy environments. When responses from all participants were considered, poorer self-rated communication ability was noted as age increased. However, among people who categorized their overall hearing as "Excellent" or "Good," younger adults rated their speech understanding ability in noisy situations as poorer than middle-age or older adults. Among people who rated their overall hearing as "Fair" or "Poor," middle-age adults indicated having more difficulty communicating with people using face masks, as compared with older adults. Examination of open-ended responses suggested that the strategies individuals use when communicating with people wearing face masks vary by age and self-rated hearing. Notably, middle-age and older adults were more likely to report using strategies that could put them at risk (e.g., asking others to remove their face masks).

CONCLUSIONS

Even younger adults with self-perceived good hearing are not immune to communication challenges brought about by face masks. Among individuals with similar degrees of self-rated hearing, the expected increase in communication difficulty with age was not noted among our respondents.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.16528431.

Reduced Semantic Context and Signal-to-Noise Ratio Increase Listening Effort As Measured Using Functional Near-Infrared Spectroscopy

OBJECTIVES

Understanding speech-in-noise can be highly effortful. Decreasing the signal-to-noise ratio (SNR) of speech increases listening effort, but it is relatively unclear if decreasing the level of semantic context does as well. The current study used functional near-infrared spectroscopy to evaluate two primary hypotheses: (1) listening effort (operationalized as oxygenation of the left lateral PFC) increases as the SNR decreases and (2) listening effort increases as context decreases.

DESIGN

Twenty-eight younger adults with normal hearing completed the Revised Speech Perception in Noise Test, in which they listened to sentences and reported the final word. These sentences either had an easy SNR (+4 dB) or a hard SNR (-2 dB), and were either low in semantic context (e.g., "Tom could have thought about the sport") or high in context (e.g., "She had to vacuum the rug"). PFC oxygenation was measured throughout using functional near-infrared spectroscopy.

RESULTS

Accuracy on the Revised Speech Perception in Noise Test was worse when the SNR was hard than when it was easy, and worse for sentences low in semantic context than high in context. Similarly, oxygenation across the entire PFC (including the left lateral PFC) was greater when the SNR was hard, and left lateral PFC oxygenation was greater when context was low.

CONCLUSIONS

These results suggest that activation of the left lateral PFC (interpreted here as reflecting listening effort) increases to compensate for acoustic and linguistic challenges. This may reflect the increased engagement of domain-general and domain-specific processes subserved by the dorsolateral prefrontal cortex (e.g., cognitive control) and inferior frontal gyrus (e.g., predicting the sensory consequences of articulatory gestures), respectively.

Social observation increases the cardiovascular response of hearing-impaired listeners during a speech reception task

Certain cardiovascular measures allow for distinction between sympathetic and parasympathetic nervous system activity. Applied during listening, these measures may provide a novel and complementary insight into listening effort. To date, few studies have implemented cardiovascular measures of listening effort and seldom have these included hearing-impaired participants. These studies have generally measured changes in cardiovascular parameters while manipulating environmental factors, such as listening difficulty. Yet, listening effort is also known to be moderated by individual factors, including the importance of performing successfully. In this study, we aimed to manipulate success importance by adding observers to the traditional laboratory set-up. Twenty-nine hearing-impaired participants performed a speech reception task both alone and in the presence of two observers. Auditory stimuli consisted of Danish Hearing in Noise Test (HINT) sentences masked by four-talker babble. Sentences were delivered at two individually adapted signal-to-noise ratios, corresponding to 50 and 80% of sentences correct. We measured change scores, relative to baseline, of pre-ejection period, two indices of heart rate variability, heart rate and blood pressure (systolic, diastolic, and mean arterial pressure). After each condition, participants rated their effort investment, stress, tendency to give up and preference to change the situation to improve audibility. A multivariate analysis revealed that cardiovascular reactivity increased in the presence of the observers, compared to when the task was performed alone. More specifically, systolic, diastolic, and mean arterial blood pressure increased while observed. Interestingly, participants' subjective ratings were sensitive only to intelligibility level, not the observation state. This study was the first to report results from a range of different cardiovascular variables measured from hearing-impaired participants during a speech reception task. Due to the timing of the observers' presence, we were not able to conclusively attribute these physiological changes to being task related. Therefore, instead of representing listening effort, we suggest that the increased cardiovascular response detected during observation reveals increased physiological stress associated with potential evaluation.

Listening Effort Is Not the Same as Speech Intelligibility Score

Listening effort is a valuable and important notion to measure because it is among the primary complaints of people with hearing loss. It is tempting and intuitive to accept speech intelligibility scores as a proxy for listening effort, but this link is likely oversimplified and lacks actionable explanatory power. This study was conducted to explain the mechanisms of listening effort that are not captured by intelligibility scores, using sentence-repetition tasks where specific kinds of mistakes were prospectively planned or analyzed retrospectively. Effort measured as changes in pupil size among 20 listeners with normal hearing and 19 listeners with cochlear implants. Experiment 1 demonstrates that mental correction of misperceived words increases effort even when responses are correct. Experiment 2 shows that for incorrect responses, listening effort is not a function of the proportion of words correct but is rather driven by the types of errors, position of errors within a sentence, and the need to resolve ambiguity, reflecting how easily the listener can make sense of a perception. A simple taxonomy of error types is provided that is both intuitive and consistent with data from these two experiments. The diversity of errors in these experiments implies that speech perception tasks can be designed prospectively to elicit the mistakes that are more closely linked with effort. Although mental corrective action and number of mistakes can scale together in many experiments, it is possible to dissociate them to advance toward a more explanatory (rather than correlational) account of listening effort.

Postural Control While Listening in Younger and Middle-Aged Adults

OBJECTIVES

The motivation for this research is to determine whether a listening-while-balancing task would be sensitive to quantifying listening effort in middle age. The premise behind this exploratory work is that a decrease in postural control would be demonstrated in challenging acoustic conditions, more so in middle-aged than in younger adults.

DESIGN

A dual-task paradigm was employed with speech understanding as one task and postural control as the other. For the speech perception task, participants listened to and repeated back sentences in the presence of other sentences or steady-state noise. Targets and maskers were presented in both spatially-coincident and spatially-separated conditions. The postural control task required participants to stand on a force platform either in normal stance (with feet approximately shoulder-width apart) or in tandem stance (with one foot behind the other). Participants also rated their subjective listening effort at the end of each block of trials.

RESULTS

Postural control was poorer for both groups of participants when the listening task was completed at a more adverse (vs. less adverse) signal-to-noise ratio. When participants were standing normally, postural control in dual-task conditions was negatively associated with degree of high-frequency hearing loss, with individuals who had higher pure-tone thresholds exhibiting poorer balance. Correlation analyses also indicated that reduced speech recognition ability was associated with poorer postural control in both single- and dual-task conditions. Middle-aged participants exhibited larger dual-task costs when the masker was speech, as compared to when it was noise. Individuals who reported expending greater effort on the listening task exhibited larger dual-task costs when in normal stance.

CONCLUSIONS

Listening under challenging acoustic conditions can have a negative impact on postural control, more so in middle-aged than in younger adults. One explanation for this finding is that the increased effort required to successfully listen in adverse environments leaves fewer resources for maintaining balance, particularly as people age. These results provide preliminary support for using this type of ecologically-valid dual-task paradigm to quantify the costs associated with understanding speech in adverse acoustic environments.

Listening Effort in School-Age Children With Normal Hearing Compared to Children With Limited Useable Hearing Unilaterally

Objectives Children with limited hearing unilaterally might experience more listening effort than children with normal hearing, yet previous studies have not confirmed this. This study compared listening effort in school-age children with normal hearing and children with limited hearing unilaterally using behavioral and subjective listening effort measures. Design Two groups of school-age children (aged 7-12 years) participated: 19 with limited hearing unilaterally and 18 with normal hearing bilaterally. Participants completed digit triplet recognition tasks in quiet and in noise (-12 dB SNR) in three loudspeaker conditions: midline, direct, and indirect. Verbal response times during the recognition task were interpreted as behavioral listening effort. Subjective ratings of "task difficulty" and "hard to think" were interpreted as subjective listening effort. Participant age was included as a covariate in analysis of behavioral data. Results Noise negatively affected digit triplet recognition for both groups in the midline loudspeaker condition and for participants with limited hearing unilaterally in the direct and indirect conditions. Relative to their peers with normal hearing, children with limited hearing unilaterally exhibited significantly longer response times and higher ratings of effort only in the noisy, indirect condition. Differences between groups were evident even when age differences were controlled for statistically. Conclusions Using behavioral and subjective indices of listening effort, children with limited unilateral hearing demonstrated significantly more listening effort relative to their peers with normal hearing during the difficult indirect listening condition. Implications include classroom accommodations to limit indirect listening situations for children with limited useable hearing unilaterally and consideration of intervention options.

Individual Hearing Aid Benefit in Real Life Evaluated Using Ecological Momentary Assessment

Ecological momentary assessment (EMA) was used in 24 adults with mild-to-moderate hearing loss who were seeking first hearing-aid (HA) fitting or HA renewal. At two stages in the aural rehabilitation process, just before HA fitting and after an average 3-month HA adjustment period, the participants used a smartphone-based EMA system for 3 to 4 days. A questionnaire app allowed for the description of the environmental context as well as assessments of various hearing-related dimensions and of well-being. In total, 2,042 surveys were collected. The main objectives of the analysis were threefold: First, describing the "auditory reality" of future and experienced HA users; second, examining the effects of HA fitting for individual participants, as well as for the subgroup of first-time HA-users; and third, reviewing whether the EMA data collected in the unaided condition predicted who ultimately decided for or against permanent HA use. The participants reported hearing-related disabilities across the full range of daily listening tasks, but communication events took the largest share. The effect of the HA intervention was small in experienced HA users. Generally, much larger changes and larger interindividual differences were observed in first-time compared with experienced HA users in all hearing-related dimensions. Changes were not correlated with hearing loss or with the duration of the HA adjustment period. EMA data collected in the unaided condition did not predict the cancelation of HA fitting. The study showed that EMA is feasible in a general population of HA candidates for establishing individual and multidimensional profiles of real-life hearing experiences.

The Presence of Another Individual Influences Listening Effort, But Not Performance

OBJECTIVES

The aim of this study was to modify a speech perception in noise test to assess whether the presence of another individual (copresence), relative to being alone, affected listening performance and effort expenditure. Furthermore, this study assessed if the effect of the other individual's presence on listening effort was influenced by the difficulty of the task and whether participants had to repeat the sentences they listened to or not.

DESIGN

Thirty-four young, normal-hearing participants (mean age: 24.7 years) listened to spoken Dutch sentences that were masked with a stationary noise masker and presented through a loudspeaker. The participants alternated between repeating sentences (active condition) and not repeating sentences (passive condition). They did this either alone or together with another participant in the booth. When together, participants took turns repeating sentences. The speech-in-noise test was performed adaptively at three intelligibility levels (20%, 50%, and 80% sentences correct) in a block-wise fashion. During testing, pupil size was recorded as an objective outcome measure of listening effort.

RESULTS

Lower speech intelligibility levels were associated with increased peak pupil dilation (PPDs) and doing the task in the presence of another individual (compared with doing it alone) significantly increased PPD. No interaction effect between intelligibility and copresence on PPD was found. The results suggested that the change of PPD between doing the task alone or together was especially apparent for people who started the experiment in the presence of another individual. Furthermore, PPD was significantly lower during passive listening, compared with active listening. Finally, it seemed that performance was unaffected by copresence.

CONCLUSION

The increased PPDs during listening in the presence of another participant suggest that more effort was invested during the task. However, it seems that the additional effort did not result in a change of performance. This study showed that at least one aspect of the social context of a listening situation (in this case copresence) can affect listening effort, indicating that social context might be important to consider in future cognitive hearing research.

Changing the narrative for hearing health in the broader context of healthy living: a call to action

OBJECTIVE

To discuss the steps necessary to facilitate hearing health care in the context of well-being and healthy living.

DESIGN

Common themes among the articles in this special supplement of the International Journal of Audiology were used to identify issues that must be addressed if audiology is to move from being hearing-focussed to taking a holistic perspective of hearing care in the context of healthy aging. These are discussed within the context of other published literature.

RESULTS AND CONCLUSIONS

Three needs were identified: (i) Increased interdisciplinary education to raise awareness of the interplay between hearing and health. (ii) Increased emphasis on counselling education in audiology programs so that audiologists are equipped with the knowledge, competence and confidence to provide counselling and emotional support to their patients, beyond care. (iii) Redefinition of therapeutic goal setting and hearing outcomes to include aspects of well-being, so that audiologists can capture and patients realise that that good hearing outcomes can have a direct positive impact on a person's quality of life that extends beyond their improved ability to hear. It was emphasised that each of these needs to be considered within the context of the audiologists' scope of practice and audiologists' well-being.

Measuring the Subjective Cost of Listening Effort Using a Discounting Task

Purpose Objective measures of listening effort have been gaining prominence, as they provide metrics to quantify the difficulty of understanding speech under a variety of circumstances. A key challenge has been to develop paradigms that enable the complementary measurement of subjective listening effort in a quantitatively precise manner. In this study, we introduce a novel decision-making paradigm to examine age-related and individual differences in subjective effort during listening. Method Older and younger adults were presented with spoken sentences mixed with speech-shaped noise at multiple signal-to-noise ratios (SNRs). On each trial, subjects were offered the choice between completing an easier listening trial (presented at +20 dB SNR) for a smaller monetary reward and completing a harder listening trial (presented at either +4, 0, -4, -8, or -12 dB SNR) for a greater monetary reward. By varying the amount of the reward offered for the easier option, the subjective value of performing effortful listening trials at each SNR could be assessed. Results Older adults discounted the value of effortful listening to a greater degree than young adults, opting to accept less money in order to avoid more difficult SNRs. Additionally, older adults with poorer hearing and smaller working memory capacities were more likely to choose easier trials; however, in younger adults, no relationship with hearing or working memory was found. Self-reported measures of economic status did not affect these relationships. Conclusions These findings suggest that subjective listening effort depends on factors including, but not necessarily limited to, hearing and working memory. Additionally, this study demonstrates that economic decision-making paradigms can be a useful approach for assessing subjective listening effort and may prove beneficial in future research.

Effect of transcranial direct current stimulation on post-stroke fatigue

Background

Fatigue is one of the most commonly reported symptoms post-stroke, which has a severe impact on the quality of life. Post-stroke fatigue is associated with reduced motor cortical excitability, specifically of the affected hemisphere.

Objective

The aim of this exploratory study was to assess whether fatigue symptoms can be reduced by increasing cortical excitability using anodal transcranial direct current stimulation (tDCS).

Methods

In this sham-controlled, double-blind intervention study, tDCS was applied bilaterally over the primary motor cortex in a single session in thirty stroke survivors with high severity of fatigue. A questionnaire-based measure of trait fatigue (primary outcome) was obtained before, after a week and 5 weeks post stimulation. Secondary outcome measures of state fatigue, motor cortex neurophysiology and perceived effort were also assessed pre, immediately post, a week and 5 weeks post stimulation.

Results

Anodal tDCS significantly improved fatigue symptoms a week after real stimulation when compared to sham stimulation. There was also a significant change in motor cortex neurophysiology of the affected hemisphere and perceived effort, a week after stimulation. The degree of improvement in fatigue was associated with baseline anxiety levels.

Conclusion

A single session of anodal tDCS improves fatigue symptoms with the effect lasting up to a week post stimulation. tDCS may therefore be a useful tool for managing fatigue symptoms post-stroke.

Trial registration

NCT04634864

Date of registration

17/11/2020–“retrospectively registered”.

Exploring the relationship between effort perception and poststroke fatigue

OBJECTIVE

To test the hypothesis that poststroke fatigue, a chronic, pathologic fatigue condition, is driven by altered effort perception.

METHODS

Fifty-eight nondepressed, mildly impaired stroke survivors with varying severity of fatigue completed the study. Self-reported fatigue (trait and state), perceived effort (PE; explicit and implicit), and motor performance were measured in a handgrip task. Trait fatigue was measured with the Fatigue Severity Scale-7 and Neurologic Fatigue Index. State fatigue was measured with a visual analog scale (VAS). Length of hold at target force, overshoot above target force, and force variability in handgrip task were measures of motor performance. PE was measured with a VAS (explicit PE) and line length estimation, a novel implicit measure of PE.

RESULTS

Regression analysis showed that 11.6% of variance in trait fatigue was explained by implicit PE (R = 0.34; p = 0.012). Greater fatigue was related to longer length of hold at target force (R = 0.421, p < 0.001). A backward regression showed that length of hold explained explicit PE in the 20% force condition (R = 0.306, p = 0.021) and length of hold and overshoot above target force explained explicit PE in the 40% (R = 0.399, p = 0.014 and 0.004) force condition. In the 60% force condition, greater explicit PE was explained by higher force variability (R = 0.315, p = 0.017). None of the correlations were significant for state fatigue.

CONCLUSION

Trait fatigue, but not state fatigue, correlating with measures of PE and motor performance, may suggest that altered perception may lead to high fatigue mediated by changes in motor performance. This finding furthers our mechanistic understanding of poststroke fatigue.

Effortful listening under the microscope: Examining relations between pupillometric and subjective markers of effort and tiredness from listening

Effort during listening is commonly measured using the task-evoked pupil response (TEPR); a pupillometric marker of physiological arousal. However, studies to date report no association between TEPR and perceived effort. One possible reason for this is the way in which self-report effort measures are typically administered, namely as a single data point collected at the end of a testing session. Another possible reason is that TEPR might relate more closely to the experience of tiredness from listening than to effort per se. To examine these possibilities, we conducted two preregistered experiments that recorded subjective ratings of effort and tiredness from listening at multiple time points and examined their covariance with TEPR over the course of listening tasks varying in levels of acoustic and attentional demand. In both experiments, we showed a within-subject association between TEPR and tiredness from listening, but no association between TEPR and effort. The data also suggest that the effect of task difficulty on the experience of tiredness from listening may go undetected using the traditional approach of collecting a single data point at the end of a listening block. Finally, this study demonstrates the utility of a novel correlation analysis technique ("rmcorr"), which can be used to overcome statistical power constraints commonly found in the literature. Teasing apart the subjective and physiological mechanisms that underpin effortful listening is a crucial step toward addressing these difficulties in older and/or hearing-impaired individuals.

The Cost of Intrinsic and Extrinsic Cognitive Demands on Auditory Functioning in Older Adults With Normal Hearing or Using Hearing Aids

OBJECTIVES

We investigated the impact of both intrinsic and extrinsic cognitive demands on auditory and secondary task performance in older adults with normal hearing (NH) and adults using hearing aids (HAs) in an ecologically relevant listening environment.

DESIGN

Fifteen adults with NH and 15 adults using HAs (60 to 72 years of age) were recruited to perform the "Audiovisual True-to-Life Assessment of Auditory Rehabilitation"-paradigm (AVATAR), which combines an auditory-visual speech-in-noise task with three secondary tasks on either auditory localization or visual short-term memory in a preload multitask paradigm. Intrinsic demands were altered by presenting speech either at equivalent speech accuracy levels of 50% correct (SPIN50%) or equivalent speech-to-noise ratios of +5dB SNR (SPIN+5dB). We manipulated the amount of extrinsic cognitive demands by including one (dual condition) or three secondary tasks (quadruple condition). Performance decrements on the secondary tasks were considered to reflect an increase in resource allocation to speech understanding and thus an increase in listening effort. In addition, we administered a cognitive test battery as well as a questionnaire on self-reported hearing difficulties and subjective measures of effort and motivation.

RESULTS

Speech understanding and secondary task performance on the visual short-term memory task were lower in the SPIN50% condition compared to SPIN+5dB. Whereas speech understanding at SPIN50% was equally high in the dual and quadruple conditions, the quadruple condition resulted in lower secondary task performance on the visual short-term memory task, higher levels of self-reported effort, and lower motivation compared to the dual-task condition. The same was true for experimental conditions at SPIN+5dB. Additionally, adults with NH outperformed adults using HAs on speech understanding, auditory localization, and self-reported hearing abilities, but no group differences were observed on secondary task costs or cognitive measures.

CONCLUSIONS

This study showed that, irrespective of the hearing status of the listener, speech performance was not affected by the amount of extrinsic cognitive demands, but was worse and required more effort under conditions with a more negative SNR. Also, increasing the extrinsic cognitive demands resulted in lower performance on one of the secondary tasks, suggesting that more complex listening environments require more effort. Although adults with NH outperformed HA users on speech understanding and auditory localization, the two groups did not differ with respect to secondary task costs.

Comparisons of the Sensitivity and Reliability of Multiple Measures of Listening Effort

OBJECTIVES

The objective of this study was to evaluate the sensitivity and reliability of one subjective (rating scale) and three objective (dual-task paradigm, pupillometry, and skin conductance response amplitude) measures of listening effort across multiple signal to noise ratios (SNRs).

DESIGN

Twenty adults with normal hearing attended two sessions and listened to sentences presented in quiet and in stationary noise at three different SNRs: 0, -3, and -5 dB. Listening effort was assessed by examining change in reaction time (dual-task paradigm), change in peak to peak pupil diameter (pupillometry), and change in mean skin conductance response amplitude; self-reported listening effort on a scale from 0 to 100 was also evaluated. Responses were averaged within each SNR and based on three word recognition ability categories (≤50%, 51% to 71%, and >71%) across all SNRs. Measures were considered reliable if there were no significant changes between sessions, and intraclass correlation coefficients were a minimum of 0.40. Effect sizes were calculated to compare the sensitivity of the measures.

RESULTS

Intraclass correlation coefficient values indicated fair-to-moderate reliability for all measures while individual measurement sensitivity was variable. Self-reports were sensitive to listening effort but were less reliable, given that subjective effort was greater during the dual task than either of the physiologic measures. The dual task was sensitive to a narrow range of word recognition abilities but was less reliable as it exhibited a global decrease in reaction time across sessions. Pupillometry was consistently sensitive and reliable to changes in listening effort. Skin conductance response amplitude was not sensitive or reliable while the participants listened to the sentences. Skin conductance response amplitude during the verbal response was sensitive to poor (≤50%) speech recognition abilities; however, it was less reliable as there was a significant change in amplitude across sessions.

CONCLUSIONS

In this study, pupillometry was the most sensitive and reliable objective measure of listening effort. Intersession variability significantly influenced the other objective measures of listening effort, which suggests challenges for cross-study comparability. Therefore, intraclass correlation coefficients combined with other statistical tests more fully describe the reliability of measures of listening effort across multiple difficulties. Minimizing intersession variability will increase measurement sensitivity. Further work toward standardized methods and analysis will strengthen our understanding of the reliability and sensitivity of measures of listening effort and better facilitate cross-modal and cross-study comparisons.

Test-Retest Reliability of Ecological Momentary Assessment in Audiology Research

BACKGROUND

Ecological momentary assessment (EMA) is a methodology involving repeated surveys to collect in situ data that describe respondents' current or recent experiences and related contexts in their natural environments. Audiology literature investigating the test-retest reliability of EMA is scarce.

PURPOSE

This article examines the test-retest reliability of EMA in measuring the characteristics of listening contexts and listening experiences.

RESEARCH DESIGN

An observational study.

STUDY SAMPLE

Fifty-one older adults with hearing loss.

DATA COLLECTION AND ANALYSIS

The study was part of a larger study that examined the effect of hearing aid technologies. The larger study had four trial conditions and outcome was measured using a smartphone-based EMA system. After completing the four trial conditions, participants repeated one of the conditions to examine the EMA test-retest reliability. The EMA surveys contained questions that assessed listening context characteristics including talker familiarity, talker location, and noise location, as well as listening experiences including speech understanding, listening effort, loudness satisfaction, and hearing aid satisfaction. The data from multiple EMA surveys collected by each participant were aggregated in each of the test and retest conditions. Test-retest correlation on the aggregated data was then calculated for each EMA survey question to determine the reliability of EMA.

RESULTS

At the group level, listening context characteristics and listening experience did not change between the test and retest conditions. The test-retest correlation varied across the EMA questions, with the highest being the questions that assessed talker location (median r = 1.0), reverberation (r = 0.89), and speech understanding (r = 0.85), and the lowest being the items that quantified noise location (median r = 0.63), talker familiarity (r = 0.46), listening effort (r = 0.61), loudness satisfaction (r = 0.60), and hearing aid satisfaction (r = 0.61).

CONCLUSION

Several EMA questions yielded appropriate test-retest reliability results. The lower test-retest correlations for some EMA survey questions were likely due to fewer surveys completed by participants and poorly designed questions. Therefore, the present study stresses the importance of using validated questions in EMA. With sufficient numbers of surveys completed by respondents and with appropriately designed survey questions, EMA could have reasonable test-retest reliability in audiology research.

Top-down modulation of neural envelope tracking: The interplay with behavioral, self-report and neural measures of listening effort

When listening to natural speech, our brain activity tracks the slow amplitude modulations of speech, also called the speech envelope. Moreover, recent research has demonstrated that this neural envelope tracking can be affected by top-down processes. The present study was designed to examine if neural envelope tracking is modulated by the effort that a person expends during listening. Five measures were included to quantify listening effort: two behavioral measures based on a novel dual-task paradigm, a self-report effort measure and two neural measures related to phase synchronization and alpha power. Electroencephalography responses to sentences, presented at a wide range of subject-specific signal-to-noise ratios, were recorded in thirteen young, normal-hearing adults. A comparison of the five measures revealed different effects of listening effort as a function of speech understanding. Reaction times on the primary task and self-reported effort decreased with increasing speech understanding. In contrast, reaction times on the secondary task and alpha power showed a peak-shaped behavior with highest effort at intermediate speech understanding levels. With regard to neural envelope tracking, we found that the reaction times on the secondary task and self-reported effort explained a small part of the variability in theta-band envelope tracking. Speech understanding was found to strongly modulate neural envelope tracking. More specifically, our results demonstrated a robust increase in envelope tracking with increasing speech understanding. The present study provides new insights in the relations among different effort measures and highlights the potential of neural envelope tracking to objectively measure speech understanding in young, normal-hearing adults.

Degree of Hearing Loss Affects Bilateral Hearing Aid Benefits in Ecologically Relevant Laboratory Conditions

Purpose Previous evidence supports benefits of bilateral hearing aids, relative to unilateral hearing aid use, in laboratory environments using audio-only (AO) stimuli and relatively simple tasks. The purpose of this study was to evaluate bilateral hearing aid benefits in ecologically relevant laboratory settings, with and without visual cues. In addition, we evaluated the relationship between bilateral benefit and clinically viable predictive variables. Method Participants included 32 adult listeners with hearing loss ranging from mild-moderate to severe-profound. Test conditions varied by hearing aid fitting type (unilateral, bilateral) and modality (AO, audiovisual). We tested participants in complex environments that evaluated the following domains: sentence recognition, word recognition, behavioral listening effort, gross localization, and subjective ratings of spatialization. Signal-to-noise ratio was adjusted to provide similar unilateral speech recognition performance in both modalities and across procedures. Results Significant and similar bilateral benefits were measured for both modalities on all tasks except listening effort, where bilateral benefits were not identified in either modality. Predictive variables were related to bilateral benefits in some conditions. With audiovisual stimuli, increasing hearing loss, unaided speech recognition in noise, and unaided subjective spatial ability were significantly correlated with increased benefits for many outcomes. With AO stimuli, these same predictive variables were not significantly correlated with outcomes. No predictive variables were correlated with bilateral benefits for sentence recognition in either modality. Conclusions Hearing aid users can expect significant bilateral hearing aid advantages for ecologically relevant, complex laboratory tests. Although future confirmatory work is necessary, these data indicate the presence of vision strengthens the relationship between bilateral benefits and degree of hearing loss.

Listening effort: Are we measuring cognition or affect, or both?

Listening effort is increasingly recognized as a factor in communication, particularly for and with nonnative speakers, for the elderly, for individuals with hearing impairment and/or for those working in noise. However, as highlighted by McGarrigle et al., International Journal of Audiology, 2014, 53, 433-445, the term "listening effort" encompasses a wide variety of concepts, including the engagement and control of multiple possibly distinct neural systems for information processing, and the affective response to the expenditure of those resources in a given context. Thus, experimental or clinical methods intended to objectively quantify listening effort may ultimately reflect a complex interaction between the operations of one or more of those information processing systems, and/or the affective and motivational response to the demand on those systems. Here we examine theoretical, behavioral, and psychophysiological factors related to resolving the question of what we are measuring, and why, when we measure "listening effort." This article is categorized under: Linguistics > Language in Mind and Brain Psychology > Theory and Methods Psychology > Attention Psychology > Emotion and Motivation.

Moderate Reverberation Does Not Increase Subjective Fatigue, Subjective Listening Effort, or Behavioral Listening Effort in School-Aged Children

Background noise and reverberation levels in typical classrooms have negative effects on speech recognition, but their effects on listening effort and fatigue are less well understood. Based on the Framework for Understanding Effortful Listening, noise and reverberation would be expected to increase both listening effort and fatigue. However, previous investigations of the effects of reverberation for adults have resulted in mixed findings. Some discrepancies in the literature might be accounted for by methodological differences; behavioral and subjective indices of listening effort do not often align in adults. The effects of sustained listening on self-reported fatigue in school-aged children are also not well understood. The purposes of this project were to (1) evaluate the effects of noise and reverberation on listening effort in school-aged children using behavioral and subjective measures, (2) compare subjective and behavioral indices of listening effort, and (3) evaluate the effects of reverberation on self-reported fatigue. Twenty typically developing children (10-17 years old) participated. Participants completed dual-task testing in two rooms that varied in terms of reverberation, an audiometric sound booth and a moderately reverberant room. In each room, testing was completed in quiet and in two levels of background noise. Participants provided subjective ratings of listening effort after completing the dual-task in each listening condition. Subjective ratings of fatigue were completed before and after testing in each level of reverberation. Results revealed background noise, not reverberation, increased behavioral and subjective listening effort. Subjective ratings of perceived performance, ease of listening, and desire to control the listening situation revealed a similar pattern of results as word recognition performance, making them poor candidates for providing an indication of behavioral listening effort. However, ratings of time perception were moderately correlated with behavioral listening effort. Finally, sustained listening for approximately 25 min increased self-reported fatigue, although changes in fatigue were comparable in low and moderately reverberant environments. In total, these data offer no evidence that a moderate level of reverberation increases listening effort or fatigue, but the data do support the reduction of background noise in classrooms.

Functional Near-Infrared Spectroscopy as a Measure of Listening Effort in Older Adults Who Use Hearing Aids

Listening effort may be reduced when hearing aids improve access to the acoustic signal. However, this possibility is difficult to evaluate because many neuroimaging methods used to measure listening effort are incompatible with hearing aid use. Functional near-infrared spectroscopy (fNIRS), which can be used to measure the concentration of oxygen in the prefrontal cortex (PFC), appears to be well-suited to this application. The first aim of this study was to establish whether fNIRS could measure cognitive effort during listening in older adults who use hearing aids. The second aim was to use fNIRS to determine if listening effort, a form of cognitive effort, differed depending on whether or not hearing aids were used when listening to sound presented at 35 dB SL (flat gain). Sixteen older adults who were experienced hearing aid users completed an auditory n-back task and a visual n-back task; both tasks were completed with and without hearing aids. We found that PFC oxygenation increased with n-back working memory demand in both modalities, supporting the use of fNIRS to measure cognitive effort during listening in this population. PFC oxygenation was weakly and nonsignificantly correlated with self-reported listening effort and reaction time, respectively, suggesting that PFC oxygenation assesses a dimension of listening effort that differs from these other measures. Furthermore, the extent to which hearing aids reduced PFC oxygenation in the left lateral PFC was positively correlated with age and pure-tone average thresholds. The implications of these findings as well as future directions are discussed.