1
|
Holmer E, Rönnberg J, Asutay E, Tirado C, Ekberg M. Facial mimicry interference reduces working memory accuracy for facial emotion expressions. PLoS One 2024; 19:e0306113. [PMID: 38924006 PMCID: PMC11207140 DOI: 10.1371/journal.pone.0306113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Accepted: 06/11/2024] [Indexed: 06/28/2024] Open
Abstract
Facial mimicry, the tendency to imitate facial expressions of other individuals, has been shown to play a critical role in the processing of emotion expressions. At the same time, there is evidence suggesting that its role might change when the cognitive demands of the situation increase. In such situations, understanding another person is dependent on working memory. However, whether facial mimicry influences working memory representations for facial emotion expressions is not fully understood. In the present study, we experimentally interfered with facial mimicry by using established behavioral procedures, and investigated how this interference influenced working memory recall for facial emotion expressions. Healthy, young adults (N = 36) performed an emotion expression n-back paradigm with two levels of working memory load, low (1-back) and high (2-back), and three levels of mimicry interference: high, low, and no interference. Results showed that, after controlling for block order and individual differences in the perceived valence and arousal of the stimuli, the high level of mimicry interference impaired accuracy when working memory load was low (1-back) but, unexpectedly, not when load was high (2-back). Working memory load had a detrimental effect on performance in all three mimicry conditions. We conclude that facial mimicry might support working memory for emotion expressions when task load is low, but that the supporting effect possibly is reduced when the task becomes more cognitively challenging.
Collapse
Affiliation(s)
- Emil Holmer
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
- Linnaeus Centre HEAD, Linköping University, Linköping, Sweden
| | - Jerker Rönnberg
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
- Linnaeus Centre HEAD, Linköping University, Linköping, Sweden
| | - Erkin Asutay
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
- JEDI Lab, Linköping University, Linköping, Sweden
| | - Carlos Tirado
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
| | - Mattias Ekberg
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden
| |
Collapse
|
2
|
Jin T, Liu X, Chen C, Xia Y, Liu X, Lv M, Li L. The impact of environmental noise on drivers' cognitive abilities: A case study on in-vehicle voice interaction interfaces. APPLIED ERGONOMICS 2024; 117:104247. [PMID: 38335864 DOI: 10.1016/j.apergo.2024.104247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/30/2023] [Revised: 01/29/2024] [Accepted: 02/02/2024] [Indexed: 02/12/2024]
Abstract
To investigate the impact of environmental noise on the cognitive abilities of drivers, this study, using in-vehicle voice interaction as an example, conducted laboratory experiments to assess the effects of road traffic noise, entertainment noise, and white noise stimuli on drivers' attention and short-term memory. The noise levels simulated to mimic acoustic conditions during car driving ranged from 35 dB(A) to 65 dB(A). The conclusions drawn were as follows: (1) Noise levels directly influenced subjective annoyance levels, with annoyance linearly increasing as noise levels escalated; (2) Both attention and short-term memory task reaction times of drivers were significantly influenced by noise types. Compared to traffic noise and white noise, drivers' cognitive efficiency was lower under entertainment noise. (3) Performance in complex cognitive tasks was more susceptible to noise levels compared to simple cognitive tasks; (4) Experimentally, it was found that drivers exhibited the highest cognitive efficiency in cognitive tasks when the environmental noise level was 55 dB(A), as opposed to noise levels of 35 dB(A), 45 dB(A), and 65 dB(A).
Collapse
Affiliation(s)
- Tao Jin
- College of Mechanical and Electrical Engineering, China University of Petroleum (East China), Qingdao, 266580, China.
| | - Xiaoxu Liu
- College of Mechanical and Electrical Engineering, China University of Petroleum (East China), Qingdao, 266580, China
| | - Chunpeng Chen
- College of Mechanical and Electrical Engineering, China University of Petroleum (East China), Qingdao, 266580, China
| | - Yuting Xia
- College of Mechanical and Electrical Engineering, China University of Petroleum (East China), Qingdao, 266580, China
| | - Xinyu Liu
- College of Mechanical and Electrical Engineering, China University of Petroleum (East China), Qingdao, 266580, China
| | - Meiyu Lv
- College of Mechanical and Electrical Engineering, China University of Petroleum (East China), Qingdao, 266580, China
| | - Li Li
- Qingdao Product Quality Testing Research Institute, Qingdao, 266101, China
| |
Collapse
|
3
|
Landry M, da Silva Castanheira J, Raz A, Baillet S, Sackur J. A lateralized alpha-band marker of the interference of exogenous attention over endogenous attention. Cereb Cortex 2024; 34:bhad457. [PMID: 38044466 PMCID: PMC10793586 DOI: 10.1093/cercor/bhad457] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 10/27/2023] [Accepted: 10/27/2023] [Indexed: 12/05/2023] Open
Abstract
Current theories of attention differentiate exogenous from endogenous orienting of visuospatial attention. While both forms of attention orienting engage different functional systems, endogenous and exogenous attention are thought to share resources, as shown by empirical evidence of their functional interactions. The present study aims to uncover the neurobiological basis of how salient events that drive exogenous attention disrupts endogenous attention processes. We hypothesize that interference from exogenous attention over endogenous attention involves alpha-band activity, a neural marker of visuospatial attention. To test this hypothesis, we contrast the effects of endogenous attention across two experimental tasks while we recorded electroencephalography (n = 32, both sexes): a single cueing task where endogenous attention is engaged in isolation, and a double cueing task where endogenous attention is concurrently engaged with exogenous attention. Our results confirm that the concurrent engagement of exogenous attention interferes with endogenous attention processes. We also found that changes in alpha-band activity mediate the relationship between endogenous attention and its effect on task performance, and that the interference of exogenous attention on endogenous attention occurs via the moderation of this indirect effect. Altogether, our results substantiate a model of attention, whereby endogenous and exogenous attentional processes involve the same neurophysiological resources. SIGNIFICANCE STATEMENT Scientists differentiate top-down from bottom-up visuospatial attention processes. While bottom-up attention is rapidly engaged by emerging demands from the environment, top-down attention in contrast reflects slow voluntary shifts of spatial attention. Several lines of research substantiate the idea that top-down and bottom-up attentional processes involve distinct functional systems. An increasing number of studies, however, argue that both attention systems share brain processing resources. The current study examines how salient visual events that engage bottom-up processes interfere with top-down attentional processes. Using neurophysiological recordings and multivariate pattern classification techniques, the authors show that these patterns of interference occur within the alpha-band of neural activity (8-12 Hz), which implies that bottom-up and top-down attention processes share this narrow-band frequency brain resource. The results further demonstrate that patterns of alpha-band activity explains, in part, the interference between top-down and bottom-up attention at the behavioral level.
Collapse
Affiliation(s)
- Mathieu Landry
- Laboratoire de Sciences Cognitives et Psycholinguistique, ENS, PSL University, EHESS, CNRS, Paris 75005, France
| | | | - Amir Raz
- Institute for Interdisciplinary Behavioral and Brain Sciences, Chapman University, Irvine, CA, 92618, USA
| | - Sylvain Baillet
- Montreal Neurological Institute, McGill University, Montreal, Qc, H3A 2B4, Canada
| | - Jérôme Sackur
- Laboratoire de Sciences Cognitives et Psycholinguistique, ENS, PSL University, EHESS, CNRS, Paris 75005, France
- École Polytechnique, Palaiseau 91120, France
| |
Collapse
|
4
|
Meyers E, Alves M, Teugels A, Torta DM. No Evidence That Working Memory Modulates the Plasticity of the Nociceptive System, as Measured by Secondary Mechanical Hypersensitivity. THE JOURNAL OF PAIN 2023; 24:1931-1945. [PMID: 37271351 DOI: 10.1016/j.jpain.2023.05.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2023] [Revised: 05/05/2023] [Accepted: 05/31/2023] [Indexed: 06/06/2023]
Abstract
The effect of cognition on the plasticity of the nociceptive system remains controversial. In this study, we examined whether working memory can buffer against the development of secondary hypersensitivity. Thirty-five healthy women participated in 3 experimental conditions. In each condition, they underwent electrical stimulation of the skin for 2 minutes (middle-frequency electrical stimulation [MFS]), which induces secondary hypersensitivity. During MFS, participants executed either an individually tailored and rewarded n-back task (working memory condition), a rewarded reaction-time task (non-working memory condition), or no task at all (control condition). Before and after MFS, participants rated the self-reported intensity and unpleasantness of mechanical pinprick stimuli. Fear of MFS was also assessed. Heart rate variability was measured to examine potential differences between the 3 conditions and steady-state evoked potentials to the electrical stimulation were recorded to investigate differences in cortical responses. We report no significant difference in hypersensitivity between the 3 conditions. Moreover, engaging in the cognitive tasks did not affect the heart rate variability or the steady-state evoked potentials. Interestingly, higher fear of MFS predicted greater hypersensitivity. In conclusion, we found no evidence that working memory affects the plasticity of the nociceptive system, yet pain-related fear plays a role. PERSPECTIVE: This study shows that the execution of a cognitive task, irrespective of cognitive load or working memory, does not significantly modulate the development of secondary hypersensitivity, heart rate variability, or steady-state evoked potentials. However, higher pain-related fear seems to contribute to greater hypersensitivity.
Collapse
Affiliation(s)
- Elke Meyers
- Health Psychology, Faculty of Psychology and Educational Sciences, Katholieke Universiteit Leuven, Leuven, Belgium
| | - Maryna Alves
- Health Psychology, Faculty of Psychology and Educational Sciences, Katholieke Universiteit Leuven, Leuven, Belgium; Health Psychology, Faculty of Psychology and Educational Sciences, Ghent University, Ghent, Belgium
| | - Anouk Teugels
- Health Psychology, Faculty of Psychology and Educational Sciences, Katholieke Universiteit Leuven, Leuven, Belgium
| | - Diana M Torta
- Health Psychology, Faculty of Psychology and Educational Sciences, Katholieke Universiteit Leuven, Leuven, Belgium
| |
Collapse
|
5
|
Brown A, Pinto D, Burgart K, Zvilichovsky Y, Zion-Golumbic E. Neurophysiological Evidence for Semantic Processing of Irrelevant Speech and Own-Name Detection in a Virtual Café. J Neurosci 2023; 43:5045-5056. [PMID: 37336758 PMCID: PMC10324990 DOI: 10.1523/jneurosci.1731-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Revised: 04/18/2023] [Accepted: 04/27/2023] [Indexed: 06/21/2023] Open
Abstract
The well-known "cocktail party effect" refers to incidental detection of salient words, such as one's own-name, in supposedly unattended speech. However, empirical investigation of the prevalence of this phenomenon and the underlying mechanisms has been limited to extremely artificial contexts and has yielded conflicting results. We introduce a novel empirical approach for revisiting this effect under highly ecological conditions, by immersing participants in a multisensory Virtual Café and using realistic stimuli and tasks. Participants (32 female, 18 male) listened to conversational speech from a character at their table, while a barista in the back of the café called out food orders. Unbeknownst to them, the barista sometimes called orders containing either their own-name or words that created semantic violations. We assessed the neurophysiological response-profile to these two probes in the task-irrelevant barista stream by measuring participants' brain activity (EEG), galvanic skin response and overt gaze-shifts.SIGNIFICANCE STATEMENT We found distinct neural and physiological responses to participants' own-name and semantic violations, indicating their incidental semantic processing despite being task-irrelevant. Interestingly, these responses were covert in nature and gaze-patterns were not associated with word-detection responses. This study emphasizes the nonexclusive nature of attention in multimodal ecological environments and demonstrates the brain's capacity to extract linguistic information from additional sources outside the primary focus of attention.
Collapse
Affiliation(s)
- Adi Brown
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| | - Danna Pinto
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| | - Ksenia Burgart
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| | - Yair Zvilichovsky
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| | - Elana Zion-Golumbic
- Gonda Center for Multidisciplinary Brain Research, Bar-Ilan University, Ramat Gan, Israel, 5290002
| |
Collapse
|
6
|
Kaufman M, Zion Golumbic E. Listening to two speakers: Capacity and tradeoffs in neural speech tracking during Selective and Distributed Attention. Neuroimage 2023; 270:119984. [PMID: 36854352 DOI: 10.1016/j.neuroimage.2023.119984] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 02/06/2023] [Accepted: 02/24/2023] [Indexed: 02/27/2023] Open
Abstract
Speech comprehension is severely compromised when several people talk at once, due to limited perceptual and cognitive resources. In such circumstances, top-down attention mechanisms can actively prioritize processing of task-relevant speech. However, behavioral and neural evidence suggest that this selection is not exclusive, and the system may have sufficient capacity to process additional speech input as well. Here we used a data-driven approach to contrast two opposing hypotheses regarding the system's capacity to co-represent competing speech: Can the brain represent two speakers equally or is the system fundamentally limited, resulting in tradeoffs between them? Neural activity was measured using magnetoencephalography (MEG) as human participants heard concurrent speech narratives and engaged in two tasks: Selective Attention, where only one speaker was task-relevant and Distributed Attention, where both speakers were equally relevant. Analysis of neural speech-tracking revealed that both tasks engaged a similar network of brain regions involved in auditory processing, attentional control and speech processing. Interestingly, during both Selective and Distributed Attention the neural representation of competing speech showed a bias towards one speaker. This is in line with proposed 'bottlenecks' for co-representation of concurrent speech and suggests that good performance on distributed attention tasks may be achieved by toggling attention between speakers over time.
Collapse
Affiliation(s)
- Maya Kaufman
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan University, Ramat Gan, Israel
| | - Elana Zion Golumbic
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan University, Ramat Gan, Israel.
| |
Collapse
|
7
|
Kaiser S, Buchner A, Mieth L, Bell R. Negative target stimuli do not influence cross-modal auditory distraction. PLoS One 2022; 17:e0274803. [PMID: 36206210 PMCID: PMC9544019 DOI: 10.1371/journal.pone.0274803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Accepted: 09/03/2022] [Indexed: 11/19/2022] Open
Abstract
The present study served to test whether emotion modulates auditory distraction in a serial-order reconstruction task. If auditory distraction results from an attentional trade-off between the targets and distractors, auditory distraction should decrease when attention is focused on targets with high negative arousal. Two experiments (with a total N of 284 participants) were conducted to test whether auditory distraction is influenced by target emotion. In Experiment 1 it was examined whether two benchmark effects of auditory distraction-the auditory-deviant effect and the changing-state effect-differ as a function of whether negative high-arousal targets or neutral low-arousal targets are used. Experiment 2 complements Experiment 1 by testing whether target emotion modulates the disruptive effects of reversed sentential speech and steady-state distractor sequences relative to a quiet control condition. Even though the serial order of negative high-arousal targets was better remembered than that of neutral low-arousal targets, demonstrating an emotional facilitation effect on serial-order reconstruction, auditory distraction was not modulated by target emotion. The results provide support of the automatic-capture account according to which auditory distraction, regardless of the specific type of auditory distractor sequence that has to be ignored, is a fundamentally stimulus-driven effect that is rooted in the automatic processing of the to-be-ignored auditory stream and remains unaffected by emotional-motivational factors.
Collapse
Affiliation(s)
- Saskia Kaiser
- Department of Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
- * E-mail:
| | - Axel Buchner
- Department of Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Laura Mieth
- Department of Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Raoul Bell
- Department of Experimental Psychology, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| |
Collapse
|
8
|
De Winne J, Devos P, Leman M, Botteldooren D. With No Attention Specifically Directed to It, Rhythmic Sound Does Not Automatically Facilitate Visual Task Performance. Front Psychol 2022; 13:894366. [PMID: 35756201 PMCID: PMC9226390 DOI: 10.3389/fpsyg.2022.894366] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 05/19/2022] [Indexed: 11/22/2022] Open
Abstract
In a century where humans and machines—powered by artificial intelligence or not—increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was developed where participants are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography (EEG), should be recorded. This approach can be subject to a future work.
Collapse
Affiliation(s)
- Jorg De Winne
- Department of Information Technology, WAVES, Ghent University, Ghent, Belgium.,Department of Art, Music and Theater Studies, Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, Ghent, Belgium
| | - Paul Devos
- Department of Information Technology, WAVES, Ghent University, Ghent, Belgium
| | - Marc Leman
- Department of Art, Music and Theater Studies, Institute for Psychoacoustics and Electronic Music (IPEM), Ghent University, Ghent, Belgium
| | - Dick Botteldooren
- Department of Information Technology, WAVES, Ghent University, Ghent, Belgium
| |
Collapse
|
9
|
Blomberg R, Johansson Capusan A, Signoret C, Danielsson H, Rönnberg J. The Effects of Working Memory Load on Auditory Distraction in Adults With Attention Deficit Hyperactivity Disorder. Front Hum Neurosci 2021; 15:771711. [PMID: 34916918 PMCID: PMC8670091 DOI: 10.3389/fnhum.2021.771711] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2021] [Accepted: 11/08/2021] [Indexed: 12/23/2022] Open
Abstract
Cognitive control provides us with the ability to inter alia, regulate the locus of attention and ignore environmental distractions in accordance with our goals. Auditory distraction is a frequently cited symptom in adults with attention deficit hyperactivity disorder (aADHD)-yet few task-based fMRI studies have explored whether deficits in cognitive control (associated with the disorder) impedes on the ability to suppress/compensate for exogenously evoked cortical responses to noise in this population. In the current study, we explored the effects of auditory distraction as function of working memory (WM) load. Participants completed two tasks: an auditory target detection (ATD) task in which the goal was to actively detect salient oddball tones amidst a stream of standard tones in noise, and a visual n-back task consisting of 0-, 1-, and 2-back WM conditions whilst concurrently ignoring the same tonal signal from the ATD task. Results indicated that our sample of young aADHD (n = 17), compared to typically developed controls (n = 17), had difficulty attenuating auditory cortical responses to the task-irrelevant sound when WM demands were high (2-back). Heightened auditory activity to task-irrelevant sound was associated with both poorer WM performance and symptomatic inattentiveness. In the ATD task, we observed a significant increase in functional communications between auditory and salience networks in aADHD. Because performance outcomes were on par with controls for this task, we suggest that this increased functional connectivity in aADHD was likely an adaptive mechanism for suboptimal listening conditions. Taken together, our results indicate that aADHD are more susceptible to noise interference when they are engaged in a primary task. The ability to cope with auditory distraction appears to be related to the WM demands of the task and thus the capacity to deploy cognitive control.
Collapse
Affiliation(s)
- Rina Blomberg
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden.,Swedish Institute for Disability Research, Linköping University, Linköping, Sweden
| | - Andrea Johansson Capusan
- Department of Psychiatry, Linköping University, Linköping, Sweden.,Department of Clinical and Experimental Medicine, Linköping University, Linköping, Sweden.,Center for Social and Affective Neuroscience, Linköping University, Linköping, Sweden
| | - Carine Signoret
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden.,Swedish Institute for Disability Research, Linköping University, Linköping, Sweden
| | - Henrik Danielsson
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden.,Swedish Institute for Disability Research, Linköping University, Linköping, Sweden
| | - Jerker Rönnberg
- Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden.,Swedish Institute for Disability Research, Linköping University, Linköping, Sweden.,Center for Medical Image Science and Visualization, Linköping University, Linköping, Sweden
| |
Collapse
|
10
|
Wang X, Xu L. Speech perception in noise: Masking and unmasking. J Otol 2021; 16:109-119. [PMID: 33777124 PMCID: PMC7985001 DOI: 10.1016/j.joto.2020.12.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2020] [Revised: 12/03/2020] [Accepted: 12/06/2020] [Indexed: 11/23/2022] Open
Abstract
Speech perception is essential for daily communication. Background noise or concurrent talkers, on the other hand, can make it challenging for listeners to track the target speech (i.e., cocktail party problem). The present study reviews and compares existing findings on speech perception and unmasking in cocktail party listening environments in English and Mandarin Chinese. The review starts with an introduction section followed by related concepts of auditory masking. The next two sections review factors that release speech perception from masking in English and Mandarin Chinese, respectively. The last section presents an overall summary of the findings with comparisons between the two languages. Future research directions with respect to the difference in literature on the reviewed topic between the two languages are also discussed.
Collapse
Affiliation(s)
- Xianhui Wang
- Communication Sciences and Disorders, Ohio University, Athens, OH, 45701, USA
| | - Li Xu
- Communication Sciences and Disorders, Ohio University, Athens, OH, 45701, USA
| |
Collapse
|
11
|
Williams ZJ, He JL, Cascio CJ, Woynaroski TG. A review of decreased sound tolerance in autism: Definitions, phenomenology, and potential mechanisms. Neurosci Biobehav Rev 2021; 121:1-17. [PMID: 33285160 PMCID: PMC7855558 DOI: 10.1016/j.neubiorev.2020.11.030] [Citation(s) in RCA: 63] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2020] [Revised: 11/11/2020] [Accepted: 11/12/2020] [Indexed: 12/23/2022]
Abstract
Atypical behavioral responses to environmental sounds are common in autistic children and adults, with 50-70 % of this population exhibiting decreased sound tolerance (DST) at some point in their lives. This symptom is a source of significant distress and impairment across the lifespan, contributing to anxiety, challenging behaviors, reduced community participation, and school/workplace difficulties. However, relatively little is known about its phenomenology or neurocognitive underpinnings. The present article synthesizes a large body of literature on the phenomenology and pathophysiology of DST-related conditions to generate a comprehensive theoretical account of DST in autism. Notably, we argue against conceptualizing DST as a unified construct, suggesting that it be separated into three phenomenologically distinct conditions: hyperacusis (the perception of everyday sounds as excessively loud or painful), misophonia (an acquired aversive reaction to specific sounds), and phonophobia (a specific phobia of sound), each responsible for a portion of observed DST behaviors. We further elaborate our framework by proposing preliminary neurocognitive models of hyperacusis, misophonia, and phonophobia that incorporate neurophysiologic findings from studies of autism.
Collapse
Affiliation(s)
- Zachary J Williams
- Medical Scientist Training Program, Vanderbilt University School of Medicine, 221 Eskind Biomedical Library and Learning Center, 2209 Garland Ave., Nashville, TN, 37240, United States; Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, 1215 21st Avenue South, Medical Center East, Room 8310, Nashville, TN, 37232, United States; Vanderbilt Brain Institute, Vanderbilt University, 7203 Medical Research Building III, 465 21st Avenue South, Nashville, TN, 37232, United States; Frist Center for Autism and Innovation, Vanderbilt University, 2414 Highland Avenue, Suite 115, Nashville, TN, 37212, United States.
| | - Jason L He
- Department of Forensic and Neurodevelopmental Sciences, Sackler Institute for Translational Neurodevelopment, Institute of Psychiatry, Psychology and Neuroscience, King's College London, Strand Building, Strand Campus, Strand, London, WC2R 2LS, London, United Kingdom.
| | - Carissa J Cascio
- Vanderbilt Brain Institute, Vanderbilt University, 7203 Medical Research Building III, 465 21st Avenue South, Nashville, TN, 37232, United States; Frist Center for Autism and Innovation, Vanderbilt University, 2414 Highland Avenue, Suite 115, Nashville, TN, 37212, United States; Department of Psychiatry and Behavioral Sciences, Vanderbilt University Medical Center, 2254 Village at Vanderbilt, 1500 21st Ave South, Nashville, TN, 37212, United States; Vanderbilt Kennedy Center, Vanderbilt University Medical Center, 110 Magnolia Cir, Nashville, TN, 37203, United States.
| | - Tiffany G Woynaroski
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, 1215 21st Avenue South, Medical Center East, Room 8310, Nashville, TN, 37232, United States; Vanderbilt Brain Institute, Vanderbilt University, 7203 Medical Research Building III, 465 21st Avenue South, Nashville, TN, 37232, United States; Frist Center for Autism and Innovation, Vanderbilt University, 2414 Highland Avenue, Suite 115, Nashville, TN, 37212, United States; Vanderbilt Kennedy Center, Vanderbilt University Medical Center, 110 Magnolia Cir, Nashville, TN, 37203, United States.
| |
Collapse
|
12
|
Mahajan Y, Kim J, Davis C. Does working memory protect against auditory distraction in older adults? BMC Geriatr 2020; 20:515. [PMID: 33256631 PMCID: PMC7708091 DOI: 10.1186/s12877-020-01909-w] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2020] [Accepted: 11/17/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Past research indicates that when younger adults are engaged in a visual working memory task, they are less distracted by novel auditory stimuli than when engaged in a visual task that does not require working memory. The current study aimed to determine whether working memory affords the same protection to older adults. METHOD We examined behavioral and EEG responses in 16 younger and 16 older adults to distractor sounds when the listeners performed two visual tasks; one that required working memory (W1) and the other that did not (W0). Auditory distractors were presented in an oddball paradigm, participants were exposed to either standard tones (600 Hz: 80%) or various novel environmental sounds (20%). RESULTS It was found that: 1) when presented with novel vs standard sounds, older adults had faster correct response times in the W1 visual task than in the W0 task, indicating that they were less distracted by the novel sound; there was no difference in error rates. Younger adults did not show a task effect for correct response times but made slightly more errors when a novel sound was presented in the W1 task compared to the W0 task. 2) In older adults (but not the younger adults), the amplitude of N1 was smaller in the W1 condition compared to the W0 condition. 3) The working memory manipulation had no effect on MMN amplitude in older adults. 4) For the W1 compared to W0 task, the amplitude of P3a was attenuated for the older adults but not for the younger adults. CONCLUSIONS These results suggest that during the working memory manipulation older adults were able to engage working memory to reduce the processing of task-irrelevant sounds.
Collapse
Affiliation(s)
- Yatin Mahajan
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, New South Wales, Australia
- The HEARing Cooperative Research Centre, Melbourne, Victoria, Australia
| | - Jeesun Kim
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, New South Wales, Australia
| | - Chris Davis
- The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, New South Wales, Australia.
- The HEARing Cooperative Research Centre, Melbourne, Victoria, Australia.
| |
Collapse
|
13
|
Bayramova R, Toffalini E, Bonato M, Grassi M. Auditory selective attention under working memory load. PSYCHOLOGICAL RESEARCH 2020; 85:2667-2681. [PMID: 33146781 PMCID: PMC8440250 DOI: 10.1007/s00426-020-01437-7] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2020] [Accepted: 10/09/2020] [Indexed: 10/31/2022]
Abstract
Can cognitive load enhance concentration on task-relevant information and help filter out distractors? Most of the prior research in the area of selective attention has focused on visual attention or cross-modal distraction and has yielded controversial results. Here, we studied whether working memory load can facilitate selective attention when both target and distractor stimuli are auditory. We used a letter n-back task with four levels of working memory load and two levels of distraction: congruent and incongruent distractors. This combination of updating and inhibition tasks allowed us to manipulate working memory load within the selective attention task. Participants sat in front of three loudspeakers and were asked to attend to the letter presented from the central loudspeaker while ignoring that presented from the flanking ones (spoken by a different person), which could be the same letter as the central one (congruent) or a different (incongruent) letter. Their task was to respond whether or not the central letter matched the letter presented n (0, 1, 2, or 3) trials back. Distraction was measured in terms of the difference in reaction time and accuracy on trials with incongruent versus congruent flankers. We found reduced interference from incongruent flankers in 2- and 3-back conditions compared to 0- and 1-back conditions, whereby higher working memory load almost negated the effect of incongruent flankers. These results suggest that high load on verbal working memory can facilitate inhibition of distractors in the auditory domain rather than make it more difficult as sometimes claimed.
Collapse
Affiliation(s)
- Rena Bayramova
- Department of General Psychology, University of Padova, Via Venezia, 8, Padua, Italy
| | - Enrico Toffalini
- Department of General Psychology, University of Padova, Via Venezia, 8, Padua, Italy
| | - Mario Bonato
- Department of General Psychology, University of Padova, Via Venezia, 8, Padua, Italy.
| | - Massimo Grassi
- Department of General Psychology, University of Padova, Via Venezia, 8, Padua, Italy
| |
Collapse
|
14
|
A crowd of emotional voices influences the perception of emotional faces: Using adaptation, stimulus salience, and attention to probe audio-visual interactions for emotional stimuli. Atten Percept Psychophys 2020; 82:3973-3992. [PMID: 32935292 DOI: 10.3758/s13414-020-02104-0] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Correctly assessing the emotional state of others is a crucial part of social interaction. While facial expressions provide much information, faces are often not viewed in isolation, but occur with concurrent sounds, usually voices, which also provide information about the emotion being portrayed. Many studies have examined the crossmodal processing of faces and sounds, but results have been mixed, with different paradigms yielding different results. Using a psychophysical adaptation paradigm, we carried out a series of four experiments to determine whether there is a perceptual advantage when faces and voices match in emotion (congruent), versus when they do not match (incongruent). We presented a single face and a crowd of voices, a crowd of faces and a crowd of voices, a single face of reduced salience and a crowd of voices, and tested this last condition with and without attention directed to the emotion in the face. While we observed aftereffects in the hypothesized direction (adaptation to faces conveying positive emotion yielded negative, contrastive, perceptual aftereffects), we only found a congruent advantage (stronger adaptation effects) when faces were attended and of reduced salience, in line with the theory of inverse effectiveness.
Collapse
|
15
|
Paying attention to speech: The role of working memory capacity and professional experience. Atten Percept Psychophys 2020; 82:3594-3605. [PMID: 32676806 DOI: 10.3758/s13414-020-02091-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Managing attention in multispeaker environments is a challenging feat that is critical for human performance. However, why some people are better than others in allocating attention appropriately remains highly unknown. Here, we investigated the contribution of two factors-working memory capacity (WMC) and professional experience-to performance on two different types of attention task: selective attention to one speaker and distributed attention among multiple concurrent speakers. We compared performance across three groups: individuals with low (n = 20) and high (n = 25) WMC, and aircraft pilots (n = 24), whose profession poses extremely high demands for both selective and distributed attention to speech. Results suggests that selective attention is highly effective, with good performance maintained under increasingly adverse conditions, whereas performance decreases substantially with the requirement to distribute attention among a larger number of speakers. Importantly, both types of attention benefit from higher WMC, suggesting reliance on some common capacity-limited resources. However, only selective attention was further improved in the pilots, pointing to its flexible and trainable nature, whereas distributed attention seems to suffer from more fixed and severe processing bottlenecks.
Collapse
|
16
|
Turatto M, Bonetti F, Chiandetti C, Pascucci D. Context-specific distractors rejection: contextual cues control long-term habituation of attentional capture by abrupt onsets. VISUAL COGNITION 2019. [DOI: 10.1080/13506285.2019.1580233] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Massimo Turatto
- Center for Mind/Brain Sciences, University of Trento, Trento, Italy
| | | | | | - David Pascucci
- Department of Psychology, University of Fribourg, Fribourg, Switzerland
| |
Collapse
|
17
|
De Tommaso M, Turatto M. Learning to ignore salient distractors: Attentional set and habituation. VISUAL COGNITION 2019. [DOI: 10.1080/13506285.2019.1583298] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
| | - Massimo Turatto
- Center for Mind/Brain Sciences, University of Trento, Trento, Italy
| |
Collapse
|
18
|
Abstract
The current research employed a classic irrelevant sound effect paradigm and investigated the talker-specific content of the irrelevant speech. Specifically, we aimed to determine if the participants' familiarity with the irrelevant speech's talker affected the magnitude of the irrelevant sound effect. Experiment 1 was an exploration of talker familiarity established in a natural listening environment (i.e., a university classroom) in which we manipulated the participants' relationships with the talker. In Experiment 2, we manipulated the participants' familiarity with the talker via 4 days of controlled exposure to the target talker's audio recordings. For both Experiments 1 and 2, a robust effect of irrelevant speech was found; however, regardless of the talker manipulation, talker familiarity did not influence the size of the effect. We interpreted the results within the processing view of the auditory distraction effect and highlighted the notion that talker familiarity may be more vulnerable than once thought.
Collapse
Affiliation(s)
- Brittan A Barker
- 1 Department of Communicative Disorders and Deaf Education, Utah State University, Logan, UT, USA
| | - Emily M Elliott
- 2 Department of Psychology, Louisiana State University, Baton Rouge, LA, USA
| |
Collapse
|
19
|
Koshkin R, Shtyrov Y, Myachykov A, Ossadtchi A. Testing the efforts model of simultaneous interpreting: An ERP study. PLoS One 2018; 13:e0206129. [PMID: 30356337 PMCID: PMC6200263 DOI: 10.1371/journal.pone.0206129] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2018] [Accepted: 10/08/2018] [Indexed: 11/18/2022] Open
Abstract
We utilized the event-related potential (ERP) technique to study neural activity associated with different levels of working memory (WM) load during simultaneous interpretation (SI) of continuous prose. The amplitude of N1 and P1 components elicited by task-irrelevant tone probes was significantly modulated as a function of WM load but not the direction of interpretation. Furthermore, the latency of the P1 increased significantly with WM load. The WM load effect on N1 latency, however, did not reach significance. Larger negativity under lower WM loads suggests that more attention is available to process the source message, providing the first electrophysiological evidence in support of the Efforts Model of SI. Relationships between the direction of interpretation and median WM load are also discussed.
Collapse
Affiliation(s)
| | - Yury Shtyrov
- NRU Higher School of Economics, Moscow, Russia
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University, Aarhus, Denmark
| | - Andriy Myachykov
- NRU Higher School of Economics, Moscow, Russia
- Department of Psychology, Northumbria University, Newcastle-upon-Tyne, United Kingdom
| | | |
Collapse
|
20
|
Rodrigues PFS, Pandeirada JNS. When visual stimulation of the surrounding environment affects children's cognitive performance. J Exp Child Psychol 2018; 176:140-149. [PMID: 30149955 DOI: 10.1016/j.jecp.2018.07.014] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2018] [Revised: 07/10/2018] [Accepted: 07/12/2018] [Indexed: 11/27/2022]
Abstract
Visual distraction is widely studied in children, particularly in visuospatial cognitive tasks. In these studies, targets and distractors are usually shown in the same display (e.g., the computer screen). However, children are constantly exposed to visually enriched environments (e.g., elementary school classrooms), and little is known about their influence on children's cognition. Although the importance of the surrounding environment is well recognized in the literature, few experimental studies have explored this question. We propose an alternative paradigm to study visual distraction in children that brings together the rigor of experimental psychology and more ecological validity on the exposure to potential environmental distractors. Our study was designed to investigate whether a high-load versus low-load visual surrounding environment influences children's cognitive performance as evaluated by four different cognitive tasks. A sample of 64 children (aged 8-12 years) completed two sessions in two environmental conditions: a high-load visual surrounding environment and a low-load environment. In each session, they performed visuospatial attention and memory tasks. Overall, the results suggested that the high-load visual environment affected children's cognitive performance given that children performed better in the low-load visual environment (e.g., higher percentage of hits, higher Corsi span). Understanding the impact that a visually rich surrounding environment has on children's cognitive processes that support more complex ones is important to support recommendations on how the environment should be organized to foster better daily activities.
Collapse
Affiliation(s)
- Pedro F S Rodrigues
- Center for Health Technology and Services Research (CINTESIS.UA), Department of Education and Psychology, University of Aveiro, Campus Universitário de Santiago, 3810-193 Aveiro, Portugal; Institute for Biomedical Imaging and Life Sciences (IBILI), University of Coimbra, Azinhaga Santa Comba, Celas, 3000-548 Coimbra, Portugal.
| | - Josefa N S Pandeirada
- Center for Health Technology and Services Research (CINTESIS.UA), Department of Education and Psychology, University of Aveiro, Campus Universitário de Santiago, 3810-193 Aveiro, Portugal
| |
Collapse
|
21
|
Sun K, Echevarria Sanchez GM, De Coensel B, Van Renterghem T, Talsma D, Botteldooren D. Personal Audiovisual Aptitude Influences the Interaction Between Landscape and Soundscape Appraisal. Front Psychol 2018; 9:780. [PMID: 29910750 PMCID: PMC5992386 DOI: 10.3389/fpsyg.2018.00780] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2017] [Accepted: 05/02/2018] [Indexed: 11/13/2022] Open
Abstract
It has been established that there is an interaction between audition and vision in the appraisal of our living environment, and that this appraisal is influenced by personal factors. Here, we test the hypothesis that audiovisual aptitude influences appraisal of our sonic and visual environment. To measure audiovisual aptitude, an auditory deviant detection experiment was conducted in an ecologically valid and complex context. This experiment allows us to distinguish between accurate and less accurate listeners. Additionally, it allows to distinguish between participants that are easily visually distracted and those who are not. To do so, two previously conducted laboratory experiments were re-analyzed. The first experiment focuses on self-reported noise annoyance in a living room context, whereas the second experiment focuses on the perceived pleasantness of using outdoor public spaces. In the first experiment, the influence of visibility of vegetation on self-reported noise annoyance was modified by audiovisual aptitude. In the second one, it was found that the overall appraisal of walking across a bridge is influenced by audiovisual aptitude, in particular when a visually intrusive noise barrier is used to reduce highway traffic noise levels. We conclude that audiovisual aptitude may affect the appraisal of the living environment.
Collapse
Affiliation(s)
- Kang Sun
- Department of Information Technology, Ghent University, Ghent, Belgium
| | | | - Bert De Coensel
- Department of Information Technology, Ghent University, Ghent, Belgium
| | | | - Durk Talsma
- Department of Experimental Psychology, Ghent University, Ghent, Belgium
| | - Dick Botteldooren
- Department of Information Technology, Ghent University, Ghent, Belgium
| |
Collapse
|
22
|
Tusch ES, Alperin BR, Holcomb PJ, Daffner KR. Increased Early Processing of Task-Irrelevant Auditory Stimuli in Older Adults. PLoS One 2016; 11:e0165645. [PMID: 27806081 PMCID: PMC5091907 DOI: 10.1371/journal.pone.0165645] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2016] [Accepted: 10/14/2016] [Indexed: 11/23/2022] Open
Abstract
The inhibitory deficit hypothesis of cognitive aging posits that older adults' inability to adequately suppress processing of irrelevant information is a major source of cognitive decline. Prior research has demonstrated that in response to task-irrelevant auditory stimuli there is an age-associated increase in the amplitude of the N1 wave, an ERP marker of early perceptual processing. Here, we tested predictions derived from the inhibitory deficit hypothesis that the age-related increase in N1 would be 1) observed under an auditory-ignore, but not auditory-attend condition, 2) attenuated in individuals with high executive capacity (EC), and 3) augmented by increasing cognitive load of the primary visual task. ERPs were measured in 114 well-matched young, middle-aged, young-old, and old-old adults, designated as having high or average EC based on neuropsychological testing. Under the auditory-ignore (visual-attend) task, participants ignored auditory stimuli and responded to rare target letters under low and high load. Under the auditory-attend task, participants ignored visual stimuli and responded to rare target tones. Results confirmed an age-associated increase in N1 amplitude to auditory stimuli under the auditory-ignore but not auditory-attend task. Contrary to predictions, EC did not modulate the N1 response. The load effect was the opposite of expectation: the N1 to task-irrelevant auditory events was smaller under high load. Finally, older adults did not simply fail to suppress the N1 to auditory stimuli in the task-irrelevant modality; they generated a larger response than to identical stimuli in the task-relevant modality. In summary, several of the study's findings do not fit the inhibitory-deficit hypothesis of cognitive aging, which may need to be refined or supplemented by alternative accounts.
Collapse
Affiliation(s)
- Erich S. Tusch
- Center for Brain/Mind Medicine, Division of Cognitive and Behavioral Neurology, Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, 221 Longwood Avenue, Boston, MA, 02115, United States of America
| | - Brittany R. Alperin
- Department of Psychology, Oregon Health and Science University, 3181 S.W. Sam Jackson Park Rd., Portland, OR, 97239, United States of America
| | - Phillip J. Holcomb
- Department of Psychology, Tufts University, 490 Boston Avenue, Medford, MA, 02155, United States of America
| | - Kirk R. Daffner
- Center for Brain/Mind Medicine, Division of Cognitive and Behavioral Neurology, Department of Neurology, Brigham and Women's Hospital, Harvard Medical School, 221 Longwood Avenue, Boston, MA, 02115, United States of America
| |
Collapse
|
23
|
Petsas T, Harrison J, Kashino M, Furukawa S, Chait M. The effect of distraction on change detection in crowded acoustic scenes. Hear Res 2016; 341:179-189. [PMID: 27598040 PMCID: PMC5090045 DOI: 10.1016/j.heares.2016.08.015] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/14/2016] [Revised: 08/23/2016] [Accepted: 08/31/2016] [Indexed: 11/13/2022]
Abstract
In this series of behavioural experiments we investigated the effect of distraction on the maintenance of acoustic scene information in short-term memory. Stimuli are artificial acoustic ‘scenes’ composed of several (up to twelve) concurrent tone-pip streams (‘sources’). A gap (1000 ms) is inserted partway through the ‘scene’; Changes in the form of an appearance of a new source or disappearance of an existing source, occur after the gap in 50% of the trials. Listeners were instructed to monitor the unfolding ‘soundscapes’ for these events. Distraction was measured by presenting distractor stimuli during the gap. Experiments 1 and 2 used a dual task design where listeners were required to perform a task with varying attentional demands (‘High Demand’ vs. ‘Low Demand’) on brief auditory (Experiment 1a) or visual (Experiment 1b) signals presented during the gap. Experiments 2 and 3 required participants to ignore distractor sounds and focus on the change detection task. Our results demonstrate that the maintenance of scene information in short-term memory is influenced by the availability of attentional and/or processing resources during the gap, and that this dependence appears to be modality specific. We also show that these processes are susceptible to bottom up driven distraction even in situations when the distractors are not novel, but occur on each trial. Change detection performance is systematically linked with the, independently determined, perceptual salience of the distractor sound. The findings also demonstrate that the present task may be a useful objective means for determining relative perceptual salience. Distraction is measured by presenting distractor stimuli during a scene gap. Scene maintenance in memory depends on availability of resources during the gap. This dependence appears to be modality specific. Scene maintenance also prone to bottom up distraction even when distractors not novel. Performance depends on the perceptual salience of the distractor sound.
Collapse
Affiliation(s)
| | | | - Makio Kashino
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, 3-1, Morinosato-Wakamiya, Atsugi-shi, Kanagawa, Japan
| | - Shigeto Furukawa
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, 3-1, Morinosato-Wakamiya, Atsugi-shi, Kanagawa, Japan
| | - Maria Chait
- UCL Ear Institute, 332 Gray's Inn Rd, London, UK.
| |
Collapse
|
24
|
Simon SS, Tusch ES, Holcomb PJ, Daffner KR. Increasing Working Memory Load Reduces Processing of Cross-Modal Task-Irrelevant Stimuli Even after Controlling for Task Difficulty and Executive Capacity. Front Hum Neurosci 2016; 10:380. [PMID: 27536226 PMCID: PMC4971070 DOI: 10.3389/fnhum.2016.00380] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2016] [Accepted: 07/13/2016] [Indexed: 12/02/2022] Open
Abstract
The classic account of the load theory (LT) of attention suggests that increasing cognitive load leads to greater processing of task-irrelevant stimuli due to competition for limited executive resource that reduces the ability to actively maintain current processing priorities. Studies testing this hypothesis have yielded widely divergent outcomes. The inconsistent results may, in part, be related to variability in executive capacity (EC) and task difficulty across subjects in different studies. Here, we used a cross-modal paradigm to investigate whether augmented working memory (WM) load leads to increased early distracter processing, and controlled for the potential confounders of EC and task difficulty. Twenty-three young subjects were engaged in a primary visual WM task, under high and low load conditions, while instructed to ignore irrelevant auditory stimuli. Demands of the high load condition were individually titrated to make task difficulty comparable across subjects with differing EC. Event-related potentials (ERPs) were used to measure neural activity in response to stimuli presented in both the task relevant modality (visual) and task-irrelevant modality (auditory). Behavioral results indicate that the load manipulation and titration procedure of the primary visual task were successful. ERPs demonstrated that in response to visual target stimuli, there was a load-related increase in the posterior slow wave, an index of sustained attention and effort. Importantly, under high load, there was a decrease of the auditory N1 in response to distracters, a marker of early auditory processing. These results suggest that increased WM load is associated with enhanced attentional engagement and protection from distraction in a cross-modal setting, even after controlling for task difficulty and EC. Our findings challenge the classic LT and offer support for alternative models.
Collapse
Affiliation(s)
- Sharon S Simon
- Division of Cognitive and Behavioral Neurology, Department of Neurology, Center for Brain/Mind Medicine - Brigham and Women's Hospital, Harvard Medical School, BostonMA, USA; Old Age Research Group (PROTER), Institute of Psychiatry, University of São Paulo School of MedicineSão Paulo, Brazil
| | - Erich S Tusch
- Division of Cognitive and Behavioral Neurology, Department of Neurology, Center for Brain/Mind Medicine - Brigham and Women's Hospital, Harvard Medical School, Boston MA, USA
| | | | - Kirk R Daffner
- Division of Cognitive and Behavioral Neurology, Department of Neurology, Center for Brain/Mind Medicine - Brigham and Women's Hospital, Harvard Medical School, Boston MA, USA
| |
Collapse
|
25
|
Causse M, Peysakhovich V, Fabre EF. High Working Memory Load Impairs Language Processing during a Simulated Piloting Task: An ERP and Pupillometry Study. Front Hum Neurosci 2016; 10:240. [PMID: 27252639 PMCID: PMC4879132 DOI: 10.3389/fnhum.2016.00240] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2015] [Accepted: 05/09/2016] [Indexed: 11/13/2022] Open
Abstract
Given the important amount of visual and auditory linguistic information that pilots have to process, operating an aircraft generates a high working-memory load (WML). In this context, the ability to focus attention on relevant information and to remain responsive to concurrent stimuli might be altered. Consequently, understanding the effects of WML on the processing of both linguistic targets and distractors is of particular interest in the study of pilot performance. In the present work, participants performed a simplified piloting task in which they had to follow one of three colored aircraft, according to specific written instructions (i.e., the written word for the color corresponding to the color of one of the aircraft) and to ignore either congruent or incongruent concurrent auditory distractors (i.e., a spoken name of color). The WML was manipulated with an n-back sub-task. Participants were instructed to apply the current written instruction in the low WML condition, and the 2-back written instruction in the high WML condition. Electrophysiological results revealed a major effect of WML at behavioral (i.e., decline of piloting performance), electrophysiological, and autonomic levels (i.e., greater pupil diameter). Increased WML consumed resources that could not be allocated to the processing of the linguistic stimuli, as indexed by lower P300/P600 amplitudes. Also, significantly, lower P600 responses were measured in incongruent vs. congruent trials in the low WML condition, showing a higher difficulty reorienting attention toward the written instruction, but this effect was canceled in the high WML condition. This suppression of interference in the high load condition is in line with the engagement/distraction trade-off model. We propose that P300/P600 components could be reliable indicators of WML and that they allow an estimation of its impact on the processing of linguistic stimuli.
Collapse
Affiliation(s)
- Mickaël Causse
- Département Conception et Conduite des Véhicules Aéronautiques et Spatiaux, Institut Supérieur de l'Aéronautique et de l'EspaceToulouse, France; Ecole de Psychologie, Université LavalQuébec, QC, Canada
| | - Vsevolod Peysakhovich
- Département Conception et Conduite des Véhicules Aéronautiques et Spatiaux, Institut Supérieur de l'Aéronautique et de l'Espace Toulouse, France
| | - Eve F Fabre
- Département Conception et Conduite des Véhicules Aéronautiques et Spatiaux, Institut Supérieur de l'Aéronautique et de l'Espace Toulouse, France
| |
Collapse
|
26
|
Marsh JE, Vachon F, Sörqvist P. Increased distractibility in schizotypy: Independent of individual differences in working memory capacity? Q J Exp Psychol (Hove) 2016; 70:565-578. [PMID: 27028661 DOI: 10.1080/17470218.2016.1172094] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
Individuals with schizophrenia typically show increased levels of distractibility. This has been attributed to impaired working memory capacity (WMC), since lower WMC is typically associated with higher distractibility, and schizophrenia is typically associated with impoverished WMC. Here, participants performed verbal and spatial serial recall tasks that were accompanied by to-be-ignored speech tokens. For the few trials wherein one speech token was replaced with a different token, impairment was produced to task scores (a deviation effect). Participants subsequently completed a schizotypy questionnaire and a WMC measure. Higher schizotypy scores were associated with lower WMC (as measured with operation span, OSPAN), but WMC and schizotypy scores explained unique variance in relation to the mean magnitude of the deviation effect. These results suggest that schizotypy is associated with heightened domain-general distractibility, but that this is independent of its relationship with WMC.
Collapse
Affiliation(s)
- John E Marsh
- a School of Psychology , University of Central Lancashire , Preston , UK.,b Department of Building, Energy and Environmental Engineering , University of Gävle , Gävle , Sweden
| | - François Vachon
- c École de psychologie , Université Laval , Québec , QC , Canada
| | - Patrik Sörqvist
- b Department of Building, Energy and Environmental Engineering , University of Gävle , Gävle , Sweden
| |
Collapse
|
27
|
Francis AL, MacPherson MK, Chandrasekaran B, Alvar AM. Autonomic Nervous System Responses During Perception of Masked Speech may Reflect Constructs other than Subjective Listening Effort. Front Psychol 2016; 7:263. [PMID: 26973564 PMCID: PMC4772584 DOI: 10.3389/fpsyg.2016.00263] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2015] [Accepted: 02/10/2016] [Indexed: 12/05/2022] Open
Abstract
Typically, understanding speech seems effortless and automatic. However, a variety of factors may, independently or interactively, make listening more effortful. Physiological measures may help to distinguish between the application of different cognitive mechanisms whose operation is perceived as effortful. In the present study, physiological and behavioral measures associated with task demand were collected along with behavioral measures of performance while participants listened to and repeated sentences. The goal was to measure psychophysiological reactivity associated with three degraded listening conditions, each of which differed in terms of the source of the difficulty (distortion, energetic masking, and informational masking), and therefore were expected to engage different cognitive mechanisms. These conditions were chosen to be matched for overall performance (keywords correct), and were compared to listening to unmasked speech produced by a natural voice. The three degraded conditions were: (1) Unmasked speech produced by a computer speech synthesizer, (2) Speech produced by a natural voice and masked byspeech-shaped noise and (3) Speech produced by a natural voice and masked by two-talker babble. Masked conditions were both presented at a -8 dB signal to noise ratio (SNR), a level shown in previous research to result in comparable levels of performance for these stimuli and maskers. Performance was measured in terms of proportion of key words identified correctly, and task demand or effort was quantified subjectively by self-report. Measures of psychophysiological reactivity included electrodermal (skin conductance) response frequency and amplitude, blood pulse amplitude and pulse rate. Results suggest that the two masked conditions evoked stronger psychophysiological reactivity than did the two unmasked conditions even when behavioral measures of listening performance and listeners’ subjective perception of task demand were comparable across the three degraded conditions.
Collapse
Affiliation(s)
- Alexander L Francis
- Department of Speech, Language and Hearing Sciences, Purdue University, West Lafayette IN, USA
| | - Megan K MacPherson
- School of Communication Science and Disorders, Florida State University, Tallahassee FL, USA
| | - Bharath Chandrasekaran
- Department of Communication Sciences and Disorders, University of Texas at Austin Austin, TX, USA
| | - Ann M Alvar
- Department of Speech, Language and Hearing Sciences, Purdue University, West Lafayette IN, USA
| |
Collapse
|
28
|
Hurtig A, Keus van de Poll M, Pekkola EP, Hygge S, Ljung R, Sörqvist P. Children's Recall of Words Spoken in Their First and Second Language: Effects of Signal-to-Noise Ratio and Reverberation Time. Front Psychol 2016; 6:2029. [PMID: 26834665 PMCID: PMC4712295 DOI: 10.3389/fpsyg.2015.02029] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2015] [Accepted: 12/21/2015] [Indexed: 11/13/2022] Open
Abstract
Speech perception runs smoothly and automatically when there is silence in the background, but when the speech signal is degraded by background noise or by reverberation, effortful cognitive processing is needed to compensate for the signal distortion. Previous research has typically investigated the effects of signal-to-noise ratio (SNR) and reverberation time in isolation, whilst few have looked at their interaction. In this study, we probed how reverberation time and SNR influence recall of words presented in participants' first- (L1) and second-language (L2). A total of 72 children (10 years old) participated in this study. The to-be-recalled wordlists were played back with two different reverberation times (0.3 and 1.2 s) crossed with two different SNRs (+3 dBA and +12 dBA). Children recalled fewer words when the spoken words were presented in L2 in comparison with recall of spoken words presented in L1. Words that were presented with a high SNR (+12 dBA) improved recall compared to a low SNR (+3 dBA). Reverberation time interacted with SNR to the effect that at +12 dB the shorter reverberation time improved recall, but at +3 dB it impaired recall. The effects of the physical sound variables (SNR and reverberation time) did not interact with language.
Collapse
Affiliation(s)
- Anders Hurtig
- Department of Building, Energy and Environmental Engineering, University of GävleGävle, Sweden; Linnaeus Centre HEAD, Swedish Institute for Disability Research, University of LinköpingLinköping, Sweden; Department of Education, Health and Social Studies, University of DalarnaFalun, Sweden
| | | | - Elina P Pekkola
- Department of Building, Energy and Environmental Engineering, University of Gävle Gävle, Sweden
| | - Staffan Hygge
- Department of Building, Energy and Environmental Engineering, University of Gävle Gävle, Sweden
| | - Robert Ljung
- Department of Building, Energy and Environmental Engineering, University of Gävle Gävle, Sweden
| | - Patrik Sörqvist
- Department of Building, Energy and Environmental Engineering, University of GävleGävle, Sweden; Linnaeus Centre HEAD, Swedish Institute for Disability Research, University of LinköpingLinköping, Sweden
| |
Collapse
|
29
|
Halin N, Marsh JE, Sörqvist P. Central load reduces peripheral processing: Evidence from incidental memory of background speech. Scand J Psychol 2015; 56:607-12. [PMID: 26355647 DOI: 10.1111/sjop.12246] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2015] [Accepted: 06/28/2015] [Indexed: 11/30/2022]
Abstract
Is there a trade-off between central (working memory) load and peripheral (perceptual) processing? To address this question, participants were requested to undertake an n-back task in one of two levels of central/cognitive load (i.e., 1-back or 2-back) in the presence of a to-be-ignored story presented via headphones. Participants were told to ignore the background story, but they were given a surprise memory test of what had been said in the background story, immediately after the n-back task was completed. Memory was poorer in the high central load (2-back) condition in comparison with the low central load (1-back) condition. Hence, when people compensate for higher central load, by increasing attentional engagement, peripheral processing is constrained. Moreover, participants with high working memory capacity (WMC) - with a superior ability for attentional engagement - remembered less of the background story, but only in the low central load condition. Taken together, peripheral processing - as indexed by incidental memory of background speech - is constrained when task engagement is high.
Collapse
Affiliation(s)
- Niklas Halin
- Department of Building, Energy and Environmental Engineering, University of Gävle, Gävle, Sweden
| | - John E Marsh
- Department of Building, Energy and Environmental Engineering, University of Gävle, Gävle, Sweden.,School of Psychology, University of Central Lancashire, Preston, UK
| | - Patrik Sörqvist
- Department of Building, Energy and Environmental Engineering, University of Gävle, Gävle, Sweden
| |
Collapse
|
30
|
Abstract
In this article, we outline our view of how concentration shields against distraction. We argue that higher levels of concentration make people less susceptible to distraction for two reasons. One reason is that the undesired processing of the background environment is reduced. For example, when people play a difficult video game, as opposed to an easy game, they are less likely to notice what people in the background are saying. The other reason is that the locus of attention becomes more steadfast. For example, when people are watching an entertaining episode of their favorite television series, as opposed to a less absorbing show, attention is less likely to be diverted away from the screen by a ringing telephone. The theoretical underpinnings of this perspective, and potential implications for applied settings, are addressed.
Collapse
Affiliation(s)
- Patrik Sörqvist
- Department of Building, Energy and Environmental Engineering, University of Gävle
| | - John E Marsh
- Department of Building, Energy and Environmental Engineering, University of Gävle ; School of Psychology, University of Central Lancashire
| |
Collapse
|
31
|
Scharinger C, Soutschek A, Schubert T, Gerjets P. When flanker meets the n‐back: What EEG and pupil dilation data reveal about the interplay between the two central‐executive working memory functions inhibition and updating. Psychophysiology 2015; 52:1293-304. [DOI: 10.1111/psyp.12500] [Citation(s) in RCA: 70] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2014] [Accepted: 06/15/2015] [Indexed: 12/27/2022]
Affiliation(s)
| | - Alexander Soutschek
- Laboratory for Social and Neural Systems ResearchUniversity of ZurichZurich Switzerland
- Department of PsychologyHumboldt‐University of BerlinBerlin Germany
| | - Torsten Schubert
- Department of PsychologyHumboldt‐University of BerlinBerlin Germany
| | | |
Collapse
|
32
|
Lin G, Carlile S. Costs of switching auditory spatial attention in following conversational turn-taking. Front Neurosci 2015; 9:124. [PMID: 25941466 PMCID: PMC4403343 DOI: 10.3389/fnins.2015.00124] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2015] [Accepted: 03/26/2015] [Indexed: 11/17/2022] Open
Abstract
Following a multi-talker conversation relies on the ability to rapidly and efficiently shift the focus of spatial attention from one talker to another. The current study investigated the listening costs associated with shifts in spatial attention during conversational turn-taking in 16 normally-hearing listeners using a novel sentence recall task. Three pairs of syntactically fixed but semantically unpredictable matrix sentences, recorded from a single male talker, were presented concurrently through an array of three loudspeakers (directly ahead and +/−30° azimuth). Subjects attended to one spatial location, cued by a tone, and followed the target conversation from one sentence to the next using the call-sign at the beginning of each sentence. Subjects were required to report the last three words of each sentence (speech recall task) or answer multiple choice questions related to the target material (speech comprehension task). The reading span test, attention network test, and trail making test were also administered to assess working memory, attentional control, and executive function. There was a 10.7 ± 1.3% decrease in word recall, a pronounced primacy effect, and a rise in masker confusion errors and word omissions when the target switched location between sentences. Switching costs were independent of the location, direction, and angular size of the spatial shift but did appear to be load dependent and only significant for complex questions requiring multiple cognitive operations. Reading span scores were positively correlated with total words recalled, and negatively correlated with switching costs and word omissions. Task switching speed (Trail-B time) was also significantly correlated with recall accuracy. Overall, this study highlights (i) the listening costs associated with shifts in spatial attention and (ii) the important role of working memory in maintaining goal relevant information and extracting meaning from dynamic multi-talker conversations.
Collapse
Affiliation(s)
- Gaven Lin
- Auditory Neuroscience Laboratory, Department of Physiology, School of Medical Sciences, University of Sydney Sydney, NSW, Australia
| | - Simon Carlile
- Auditory Neuroscience Laboratory, Department of Physiology, School of Medical Sciences, University of Sydney Sydney, NSW, Australia
| |
Collapse
|
33
|
Sörqvist P. On interpretation and task selection in studies on the effects of noise on cognitive performance. Front Psychol 2014; 5:1249. [PMID: 25400615 PMCID: PMC4214222 DOI: 10.3389/fpsyg.2014.01249] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2014] [Accepted: 10/14/2014] [Indexed: 11/13/2022] Open
Abstract
THIS PAPER DISCUSSES TWO THINGS RESEARCHERS SHOULD CONSIDER WHEN SELECTING TASKS FOR COGNITIVE NOISE STUDIES AND INTERPRETING THEIR FINDINGS: (a) The "process impurity" problem and (b) the propensity of sound to capture attention. Theoretical and methodological problems arise when the effects of noise on complex tasks (e.g., reading comprehension) are interpreted as reflecting an impairment of a specific cognitive process/system/skill. One reason for this is that complex tasks are, by definition, process impure (i.e., they involve several, distinct cognitive processes/systems/skills). Another reason is that sound can capture attention. When sound captures attention, the impairment to task scores is caused by an interruption, not by malfunctioning cognitive processes/systems/skills. Selecting more "process pure" tasks (e.g., the Stroop task) is not a solution to these problems. On the contrary, it introduces further problems with generalizability and representativeness. It is argued that cognitive noise researchers should employ representative noise, representative tasks (which are necessarily complex/process impure), and interpret the results on a behavioral level of analysis rather than on a cognitive level of analysis.
Collapse
Affiliation(s)
- Patrik Sörqvist
- Department of Building, Energy, and Environmental Engineering, University of Gävle, GävleSweden
- Linnaeus Centre HEAD, Swedish Institute for Disability Research, Linköping University, LinköpingSweden
| |
Collapse
|
34
|
|