1
|
Brilliant, Yaar-Soffer Y, Herrmann CS, Henkin Y, Kral A. Theta and alpha oscillatory signatures of auditory sensory and cognitive loads during complex listening. Neuroimage 2024; 289:120546. [PMID: 38387743 DOI: 10.1016/j.neuroimage.2024.120546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 02/07/2024] [Accepted: 02/15/2024] [Indexed: 02/24/2024] Open
Abstract
The neuronal signatures of sensory and cognitive load provide access to brain activities related to complex listening situations. Sensory and cognitive loads are typically reflected in measures like response time (RT) and event-related potentials (ERPs) components. It's, however, strenuous to distinguish the underlying brain processes solely from these measures. In this study, along with RT- and ERP-analysis, we performed time-frequency analysis and source localization of oscillatory activity in participants performing two different auditory tasks with varying degrees of complexity and related them to sensory and cognitive load. We studied neuronal oscillatory activity in both periods before the behavioral response (pre-response) and after it (post-response). Robust oscillatory activities were found in both periods and were differentially affected by sensory and cognitive load. Oscillatory activity under sensory load was characterized by decrease in pre-response (early) theta activity and increased alpha activity. Oscillatory activity under cognitive load was characterized by increased theta activity, mainly in post-response (late) time. Furthermore, source localization revealed specific brain regions responsible for processing these loads, such as temporal and frontal lobe, cingulate cortex and precuneus. The results provide evidence that in complex listening situations, the brain processes sensory and cognitive loads differently. These neural processes have specific oscillatory signatures and are long lasting, extending beyond the behavioral response.
Collapse
Affiliation(s)
- Brilliant
- Department of Experimental Otology, Hannover Medical School, 30625 Hannover, Germany.
| | - Y Yaar-Soffer
- Department of Communication Disorder, Tel Aviv University, 5262657 Tel Aviv, Israel; Hearing, Speech and Language Center, Sheba Medical Center, 5265601 Tel Hashomer, Israel
| | - C S Herrmann
- Experimental Psychology Division, University of Oldenburg, 26111 Oldenburg, Germany
| | - Y Henkin
- Department of Communication Disorder, Tel Aviv University, 5262657 Tel Aviv, Israel; Hearing, Speech and Language Center, Sheba Medical Center, 5265601 Tel Hashomer, Israel
| | - A Kral
- Department of Experimental Otology, Hannover Medical School, 30625 Hannover, Germany
| |
Collapse
|
2
|
Ding X, Ji H, Yu W, Xu L, Lin Y, Sun Y. Dissociation between temporal attention and Consciousness: Unconscious temporal cue induces temporal expectation effect. Conscious Cogn 2024; 119:103670. [PMID: 38422759 DOI: 10.1016/j.concog.2024.103670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 02/21/2024] [Accepted: 02/21/2024] [Indexed: 03/02/2024]
Abstract
The debate over the independence of attention and consciousness is ongoing. Prior studies have established that invisible spatial cues can direct attention. However, our exploration extends beyond spatial dimensions to temporal information as a potent guide for attention. A intriguing question arises: Can unconscious temporal cues trigger attentional orienting? To investigate, we employed a modified reaction-time task in Experiments 1 and 2, using Gabor stimuli or human facial stimuli as temporal cues rendered invisible through continuous flash suppression. We aimed to uncover temporal expectation effects (TE effects) without conscious awareness. Moreover, Experiments 3 and 4 probed the boundaries of this unconscious processing, assessing whether conscious temporal cues could modulate TE effects. Our results confirm that invisible temporal cues can induce TE effects, and these effects can be overridden by conscious temporal cues. This dissociation between temporal attention and consciousness provide a new perspective on our understanding of their relationship.
Collapse
Affiliation(s)
- Xiaowei Ding
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Huichao Ji
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University, Guangzhou, People's Republic of China; Department of Psychology, Yale University, New Haven, USA
| | - Wenhao Yu
- School of Psychology, Shandong Normal University, Jinan, People's Republic of China
| | - Luzi Xu
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University, Guangzhou, People's Republic of China
| | - Youting Lin
- Department of Neurology, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, People's Republic of China.
| | - Yanliang Sun
- School of Psychology, Shandong Normal University, Jinan, People's Republic of China.
| |
Collapse
|
3
|
Pomper U, Curetti LZ, Chait M. Neural dynamics underlying successful auditory short-term memory performance. Eur J Neurosci 2023; 58:3859-3878. [PMID: 37691137 PMCID: PMC10946728 DOI: 10.1111/ejn.16140] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 08/18/2023] [Accepted: 08/19/2023] [Indexed: 09/12/2023]
Abstract
Listeners often operate in complex acoustic environments, consisting of many concurrent sounds. Accurately encoding and maintaining such auditory objects in short-term memory is crucial for communication and scene analysis. Yet, the neural underpinnings of successful auditory short-term memory (ASTM) performance are currently not well understood. To elucidate this issue, we presented a novel, challenging auditory delayed match-to-sample task while recording MEG. Human participants listened to 'scenes' comprising three concurrent tone pip streams. The task was to indicate, after a delay, whether a probe stream was present in the just-heard scene. We present three key findings: First, behavioural performance revealed faster responses in correct versus incorrect trials as well as in 'probe present' versus 'probe absent' trials, consistent with ASTM search. Second, successful compared with unsuccessful ASTM performance was associated with a significant enhancement of event-related fields and oscillatory activity in the theta, alpha and beta frequency ranges. This extends previous findings of an overall increase of persistent activity during short-term memory performance. Third, using distributed source modelling, we found these effects to be confined mostly to sensory areas during encoding, presumably related to ASTM contents per se. Parietal and frontal sources then became relevant during the maintenance stage, indicating that effective STM operation also relies on ongoing inhibitory processes suppressing task-irrelevant information. In summary, our results deliver a detailed account of the neural patterns that differentiate successful from unsuccessful ASTM performance in the context of a complex, multi-object auditory scene.
Collapse
Affiliation(s)
- Ulrich Pomper
- Ear InstituteUniversity College LondonLondonUK
- Faculty of PsychologyUniversity of ViennaViennaAustria
| | | | - Maria Chait
- Ear InstituteUniversity College LondonLondonUK
| |
Collapse
|
4
|
Shen L, Wu Z, Yue Z, Li B, Chen Q, Han B. Prior Knowledge Uses Prestimulus Alpha Band Oscillations and Persistent Poststimulus Neural Templates for Conscious Perception. J Neurosci 2023; 43:6164-6175. [PMID: 37536980 PMCID: PMC10476639 DOI: 10.1523/jneurosci.0263-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2023] [Revised: 07/21/2023] [Accepted: 07/26/2023] [Indexed: 08/05/2023] Open
Abstract
Prior knowledge has a profound impact on the way we perceive the world. However, it remains unclear how the prior knowledge is maintained in our brains and thereby influences the subsequent conscious perception. The Dalmatian dog illusion is a perfect tool to study prior knowledge, where the picture is initially perceived as noise. Once the prior knowledge was introduced, a Dalmatian dog could be consciously seen, and the picture immediately became meaningful. Using pictures with hidden objects as standard stimuli and similar pictures without hidden objects as deviant stimuli, we investigated the neural representation of prior knowledge and its impact on conscious perception in an oddball paradigm using electroencephalogram (EEG) in both male and female human subjects. We found that the neural patterns between the prestimulus alpha band oscillations and poststimulus EEG activity were significantly more similar for the standard stimuli than for the deviant stimuli after prior knowledge was provided. Furthermore, decoding analysis revealed that persistent neural templates were evoked after the introduction of prior knowledge, similar to that evoked in the early stages of visual processing. In conclusion, the current study suggests that prior knowledge uses alpha band oscillations in a multivariate manner in the prestimulus period and induces specific persistent neural templates in the poststimulus period, enabling the conscious perception of the hidden objects.SIGNIFICANCE STATEMENT The visual world we live in is not always optimal. In dark or noisy environments, prior knowledge can help us interpret imperfect sensory signals and enable us to consciously perceive hidden objects. However, we still know very little about how prior knowledge works at the neural level. Using the Dalmatian dog illusion and multivariate methods, we found that prior knowledge uses prestimulus alpha band oscillations to carry information about the hidden object and exerts a persistent influence in the poststimulus period by inducing specific neural templates. Our findings provide a window into the neural underpinnings of prior knowledge and offer new insights into the role of alpha band oscillations and neural templates associated with conscious perception.
Collapse
Affiliation(s)
- Lu Shen
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Zehua Wu
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University, Guangzhou 510275, China
| | - Zhenzhu Yue
- Department of Psychology, Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Sun Yat-sen University, Guangzhou 510275, China
| | - Bing Li
- Department of Psychology, Jilin University, Changchun 130012, China
| | - Qi Chen
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
| | - Biao Han
- Center for Studies of Psychological Application, South China Normal University, Guangzhou 510631, China
- School of Psychology, South China Normal University, Guangzhou 510631, China
| |
Collapse
|
5
|
Nobre AC, van Ede F. Attention in flux. Neuron 2023; 111:971-986. [PMID: 37023719 DOI: 10.1016/j.neuron.2023.02.032] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 02/22/2023] [Indexed: 04/08/2023]
Abstract
Selective attention comprises essential infrastructural functions supporting cognition-anticipating, prioritizing, selecting, routing, integrating, and preparing signals to guide adaptive behavior. Most studies have examined its consequences, systems, and mechanisms in a static way, but attention is at the confluence of multiple sources of flux. The world advances, we operate within it, our minds change, and all resulting signals progress through multiple pathways within the dynamic networks of our brains. Our aim in this review is to raise awareness of and interest in three important facets of how timing impacts our understanding of attention. These include the challenges posed to attention by the timing of neural processing and psychological functions, the opportunities conferred to attention by various temporal structures in the environment, and how tracking the time courses of neural and behavioral modulations with continuous measures yields surprising insights into the workings and principles of attention.
Collapse
Affiliation(s)
- Anna C Nobre
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK; Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, UK.
| | - Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, Amsterdam 1081BT, the Netherlands.
| |
Collapse
|
6
|
Herrmann B, Maess B, Henry MJ, Obleser J, Johnsrude IS. Neural signatures of task-related fluctuations in auditory attention and age-related changes. Neuroimage 2023; 268:119883. [PMID: 36657693 DOI: 10.1016/j.neuroimage.2023.119883] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Revised: 01/11/2023] [Accepted: 01/15/2023] [Indexed: 01/18/2023] Open
Abstract
Listening in everyday life requires attention to be deployed dynamically - when listening is expected to be difficult and when relevant information is expected to occur - to conserve mental resources. Conserving mental resources may be particularly important for older adults who often experience difficulties understanding speech. In the current study, we use electro- and magnetoencephalography to investigate the neural and behavioral mechanics of attention regulation during listening and the effects that aging has on these. We first show in younger adults (17-31 years) that neural alpha oscillatory activity indicates when in time attention is deployed (Experiment 1) and that deployment depends on listening difficulty (Experiment 2). Experiment 3 investigated age-related changes in auditory attention regulation. Middle-aged and older adults (54-72 years) show successful attention regulation but appear to utilize timing information differently compared to younger adults (20-33 years). We show a notable age-group dissociation in recruited brain regions. In younger adults, superior parietal cortex underlies alpha power during attention regulation, whereas, in middle-aged and older adults, alpha power emerges from more ventro-lateral areas (posterior temporal cortex). This difference in the sources of alpha activity between age groups only occurred during task performance and was absent during rest (Experiment S1). In sum, our study suggests that middle-aged and older adults employ different neural control strategies compared to younger adults to regulate attention in time under listening challenges.
Collapse
Affiliation(s)
- Björn Herrmann
- Department of Psychology, The University of Western Ontario, London, ON N6A 3K7, Canada; Rotman Research Institute, Baycrest, Toronto, ON, Canada; Department of Psychology, University of Toronto, Toronto, ON, Canada.
| | - Burkhard Maess
- Brain Networks Group, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Molly J Henry
- Max Planck Research Group "Neural and Environmental Rhythms", Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, Lübeck, Germany
| | - Ingrid S Johnsrude
- Department of Psychology, The University of Western Ontario, London, ON N6A 3K7, Canada; School of Communication Sciences & Disorders, The University of Western Ontario, London, ON, Canada
| |
Collapse
|
7
|
The effect of temporal expectation on the correlations of frontal neural activity with alpha oscillation and sensory-motor latency. Sci Rep 2023; 13:2012. [PMID: 36737634 PMCID: PMC9898494 DOI: 10.1038/s41598-023-29310-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2022] [Accepted: 02/02/2023] [Indexed: 02/05/2023] Open
Abstract
In a dynamic environment, we seek to enhance behavioral responses by anticipating future events. Previous studies have shown that the probability distribution of the timing of future events could shape our expectation of event timing; furthermore, the modulation of alpha oscillation is known to be a critical neural factor. However, a link between the modulation of alpha oscillation by temporal expectation and single neural activity is missing. In this study, we investigated how temporal expectation modulated frontal neural activities and behavioral reaction time by recording neural activity from the frontal eye field smooth pursuit eye movement region of monkeys while they performed a smooth pursuit eye movement task. We found that the temporal expectation reduced the coherence between the neural spiking and alpha frequency of the local field potential, along with the trial-by-trial correlation between the neural spiking activity and pursuit latency. This result suggests that the desynchronization of alpha oscillation by temporal expectation would be related to the decorrelation of population neural activity, which could be the neural source of reaction time enhancement by temporal expectation.
Collapse
|
8
|
Chen FW, Li CH, Kuo BC. Temporal expectation based on the duration variability modulates alpha oscillations during working memory retention. Neuroimage 2023; 265:119789. [PMID: 36481414 DOI: 10.1016/j.neuroimage.2022.119789] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2022] [Revised: 11/22/2022] [Accepted: 12/03/2022] [Indexed: 12/12/2022] Open
Abstract
While maintaining information over a delay of time, working memory (WM) also allows individuals to prepare the mnemonic contents for prospective utilisation. However, it remains unclear whether the expectation of the time of WM test could modulate neural responses during the retention interval of WM and subsequent performance. Here, we investigated whether temporal expectations based on the variability of delay duration can modulate 9-13 Hz alpha oscillations during WM retention and whether the expectation-induced alpha activity was associated with WM performance. Participants performed a retro-cueing WM task with magnetoencephalography (MEG) (Experiment 1) and a standard WM task with electroencephalography (EEG) (Experiment 2). The expectation of the timing of the WM test was manipulated by the temporal structure of the tasks with small or large variability in the delay durations. We showed that alpha oscillations during retention interval and WM performance varied with duration variability in both of the MEG and EEG experiments. The novel finding was greater alpha-power attenuation over the left frontal and parietal regions during WM retention when the duration variability was small and the test onset was predictable, compared to when the duration variability was large and the test onset was less predictable. Importantly, we observed a positive relationship in variability difference between the response benefit and alpha-power attenuation in the left posterior parietal regions at both MEG-source and EEG-electrode levels. Finally, we confirmed the behavioural benefit when a condition with a fixed delay-duration was included in a behavioural experiment (Experiment 3). When conjoined, the delay duration enables individuals to anticipate when the relevant information would be put to work, and alpha oscillations track the anticipatory states during WM maintenance.
Collapse
Affiliation(s)
- Fang-Wen Chen
- Department of Psychology, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei 10617, Taiwan
| | - Chun-Hui Li
- Department of Psychology, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei 10617, Taiwan
| | - Bo-Cheng Kuo
- Department of Psychology, National Taiwan University, No. 1, Sec. 4, Roosevelt Road, Taipei 10617, Taiwan.
| |
Collapse
|
9
|
Loyola-Navarro R, Moënne-Loccoz C, Vergara RC, Hyafil A, Aboitiz F, Maldonado PE. Voluntary self-initiation of the stimuli onset improves working memory and accelerates visual and attentional processing. Heliyon 2022; 8:e12215. [PMID: 36578387 PMCID: PMC9791366 DOI: 10.1016/j.heliyon.2022.e12215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Revised: 08/25/2022] [Accepted: 11/30/2022] [Indexed: 12/14/2022] Open
Abstract
The ability of an organism to voluntarily control the stimuli onset modulates perceptual and attentional functions. Since stimulus encoding is an essential component of working memory (WM), we conjectured that controlling the initiation of the perceptual process would positively modulate WM. To corroborate this proposition, we tested twenty-five healthy subjects in a modified-Sternberg WM task under three stimuli presentation conditions: an automatic presentation of the stimuli, a self-initiated presentation of the stimuli (through a button press), and a self-initiated presentation with random-delay stimuli onset. Concurrently, we recorded the subjects' electroencephalographic signals during WM encoding. We found that the self-initiated condition was associated with better WM accuracy, and earlier latencies of N1, P2 and P3 evoked potential components representing visual, attentional and mental review of the stimuli processes, respectively. Our work demonstrates that self-initiated stimuli enhance WM performance and accelerate early visual and attentional processes deployed during WM encoding. We also found that self-initiated stimuli correlate with an increased attentional state compared to the other two conditions, suggesting a role for temporal stimuli predictability. Our study remarks on the relevance of self-control of the stimuli onset in sensory, attentional and memory updating processing for WM.
Collapse
Affiliation(s)
- Rocio Loyola-Navarro
- Departamento de Neurociencia, Universidad de Chile, Santiago, Chile
- Biomedical Neuroscience Institute (BNI), Santiago, Chile
- Departamento de Educación Diferencial, Universidad Metropolitana de Ciencias de la Educación, Santiago, Chile
- Center for Advanced Research in Education, Institute of Education, Universidad de Chile, Santiago, Chile
| | - Cristóbal Moënne-Loccoz
- Departamento de Ciencias de la Salud, Pontificia Universidad Católica de Chile, Santiago, Chile
- Centro Nacional de Inteligencia Artificial (CENIA), Santiago, Chile
| | - Rodrigo C. Vergara
- Departamento de Kinesiología, Universidad Metropolitana de Ciencias de la Educación, Santiago, Chile
- Centro Nacional de Inteligencia Artificial (CENIA), Santiago, Chile
- Centro de Investigación en Educación, Universidad Metropolitana de Ciencias de la Educación (CIE-UMCE), Santiago, Chile
| | | | - Francisco Aboitiz
- Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Pedro E. Maldonado
- Departamento de Neurociencia, Universidad de Chile, Santiago, Chile
- Biomedical Neuroscience Institute (BNI), Santiago, Chile
- Centro Nacional de Inteligencia Artificial (CENIA), Santiago, Chile
- Corresponding author.
| |
Collapse
|
10
|
Xiu B, Paul BT, Chen JM, Le TN, Lin VY, Dimitrijevic A. Neural responses to naturalistic audiovisual speech are related to listening demand in cochlear implant users. Front Hum Neurosci 2022; 16:1043499. [DOI: 10.3389/fnhum.2022.1043499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Accepted: 10/21/2022] [Indexed: 11/09/2022] Open
Abstract
There is a weak relationship between clinical and self-reported speech perception outcomes in cochlear implant (CI) listeners. Such poor correspondence may be due to differences in clinical and “real-world” listening environments and stimuli. Speech in the real world is often accompanied by visual cues, background environmental noise, and is generally in a conversational context, all factors that could affect listening demand. Thus, our objectives were to determine if brain responses to naturalistic speech could index speech perception and listening demand in CI users. Accordingly, we recorded high-density electroencephalogram (EEG) while CI users listened/watched a naturalistic stimulus (i.e., the television show, “The Office”). We used continuous EEG to quantify “speech neural tracking” (i.e., TRFs, temporal response functions) to the show’s soundtrack and 8–12 Hz (alpha) brain rhythms commonly related to listening effort. Background noise at three different signal-to-noise ratios (SNRs), +5, +10, and +15 dB were presented to vary the difficulty of following the television show, mimicking a natural noisy environment. The task also included an audio-only (no video) condition. After each condition, participants subjectively rated listening demand and the degree of words and conversations they felt they understood. Fifteen CI users reported progressively higher degrees of listening demand and less words and conversation with increasing background noise. Listening demand and conversation understanding in the audio-only condition was comparable to that of the highest noise condition (+5 dB). Increasing background noise affected speech neural tracking at a group level, in addition to eliciting strong individual differences. Mixed effect modeling showed that listening demand and conversation understanding were correlated to early cortical speech tracking, such that high demand and low conversation understanding occurred with lower amplitude TRFs. In the high noise condition, greater listening demand was negatively correlated to parietal alpha power, where higher demand was related to lower alpha power. No significant correlations were observed between TRF/alpha and clinical speech perception scores. These results are similar to previous findings showing little relationship between clinical speech perception and quality-of-life in CI users. However, physiological responses to complex natural speech may provide an objective measure of aspects of quality-of-life measures like self-perceived listening demand.
Collapse
|
11
|
Abstract
Playing a musical instrument engages numerous cognitive abilities, including sensory perception, selective attention, and short-term memory. Mounting evidence indicates that engaging these cognitive functions during musical training will improve performance of these same functions. Yet, it remains unclear the extent these benefits may extend to nonmusical tasks, and what neural mechanisms may enable such transfer. Here, we conducted a preregistered randomized clinical trial where nonmusicians underwent 8 wk of either digital musical rhythm training or word search as control. Only musical rhythm training placed demands on short-term memory, as well as demands on visual perception and selective attention, which are known to facilitate short-term memory. As hypothesized, only the rhythm training group exhibited improved short-term memory on a face recognition task, thereby providing important evidence that musical rhythm training can benefit performance on a nonmusical task. Analysis of electroencephalography data showed that neural activity associated with sensory processing and selective attention were unchanged by training. Rather, rhythm training facilitated neural activity associated with short-term memory encoding, as indexed by an increased P3 of the event-related potential to face stimuli. Moreover, short-term memory maintenance was enhanced, as evidenced by increased two-class (face/scene) decoding accuracy. Activity from both the encoding and maintenance periods each highlight the right superior parietal lobule (SPL) as a source for training-related changes. Together, these results suggest musical rhythm training may improve memory for faces by facilitating activity within the SPL to promote how memories are encoded and maintained, which can be used in a domain-general manner to enhance performance on a nonmusical task.
Collapse
|
12
|
Lai J, Price CN, Bidelman GM. Brainstem speech encoding is dynamically shaped online by fluctuations in cortical α state. Neuroimage 2022; 263:119627. [PMID: 36122686 PMCID: PMC10017375 DOI: 10.1016/j.neuroimage.2022.119627] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 09/12/2022] [Indexed: 11/25/2022] Open
Abstract
Experimental evidence in animals demonstrates cortical neurons innervate subcortex bilaterally to tune brainstem auditory coding. Yet, the role of the descending (corticofugal) auditory system in modulating earlier sound processing in humans during speech perception remains unclear. Here, we measured EEG activity as listeners performed speech identification tasks in different noise backgrounds designed to tax perceptual and attentional processing. We hypothesized brainstem speech coding might be tied to attention and arousal states (indexed by cortical α power) that actively modulate the interplay of brainstem-cortical signal processing. When speech-evoked brainstem frequency-following responses (FFRs) were categorized according to cortical α states, we found low α FFRs in noise were weaker, correlated positively with behavioral response times, and were more "decodable" via neural classifiers. Our data provide new evidence for online corticofugal interplay in humans and establish that brainstem sensory representations are continuously yoked to (i.e., modulated by) the ebb and flow of cortical states to dynamically update perceptual processing.
Collapse
Affiliation(s)
- Jesyin Lai
- Institute for Intelligent Systems, University of Memphis, Memphis, TN, USA; School of Communication Sciences and Disorders, University of Memphis, Memphis, TN, USA; Diagnostic Imaging Department, St. Jude Children's Research Hospital, Memphis, TN, USA.
| | - Caitlin N Price
- Institute for Intelligent Systems, University of Memphis, Memphis, TN, USA; School of Communication Sciences and Disorders, University of Memphis, Memphis, TN, USA; Department of Audiology and Speech Pathology, University of Arkansas for Medical Sciences, Little Rock, AR, USA
| | - Gavin M Bidelman
- Institute for Intelligent Systems, University of Memphis, Memphis, TN, USA; School of Communication Sciences and Disorders, University of Memphis, Memphis, TN, USA; Department of Speech, Language and Hearing Sciences, Indiana University, 2631 East Discovery Parkway, Bloomington, IN 47408, USA; Program in Neuroscience, Indiana University, 1101 E 10th St, Bloomington, IN 47405, USA.
| |
Collapse
|
13
|
Consequences of predictable temporal structure in multi-task situations. Cognition 2022; 225:105156. [DOI: 10.1016/j.cognition.2022.105156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2021] [Revised: 04/26/2022] [Accepted: 04/28/2022] [Indexed: 11/21/2022]
|
14
|
Age-related differences in the neural network interactions underlying the predictability gain. Cortex 2022; 154:269-286. [DOI: 10.1016/j.cortex.2022.05.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2021] [Revised: 03/30/2022] [Accepted: 05/03/2022] [Indexed: 11/20/2022]
|
15
|
Cao F, Zeng K, Li W, Liu S, Zhang L, Katembu S, Xu Q. Influence of scene-based expectation on facial expression perception: the moderating effect of cognitive load. Biol Psychol 2021; 168:108247. [PMID: 34968555 DOI: 10.1016/j.biopsycho.2021.108247] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2021] [Revised: 12/19/2021] [Accepted: 12/23/2021] [Indexed: 11/24/2022]
Abstract
Prior expectations play an important role in the process of perception. In real life, facial expressions always appear within a scene, which enables individuals to generate predictions that affect facial expression judgments. In the present study, using event-related potentials, we investigated the influence of scene-based expectation on facial expression processing. In addition, we used a cognitive task to manipulate cognitive load to interfere with scene-based expectation. Results showed that under the condition of sufficient cognitive resources, faces elicited more negative N170 amplitudes and more positive N400 amplitudes when the emotional valence of the scenes and faces was congruent. However, in the condition of cognitive load, no such difference was observed. The findings suggested that the effect of expectation on facial expression recognition emerges during both the early and late stages of facial expression processing, and the effect is weakened when cognitive resources are occupied by unrelated tasks.
Collapse
Affiliation(s)
- Feizhen Cao
- Department of Psychology, Ningbo University, Ningbo, China
| | - Ke Zeng
- School of Medical Humanities, Capital Medical University, Beijing, China
| | - Wanyue Li
- School of Psychology, South China Normal University, Guangzhou, China
| | - Shen Liu
- School of Humanities and Social Sciences, University of Science and Technology of China, Hefei, China
| | - Lin Zhang
- Department of Psychology, Ningbo University, Ningbo, China
| | - Stephen Katembu
- Department of Psychology, Humboldt Universität zu Berlin, Berlin, Germany
| | - Qiang Xu
- Department of Psychology, Ningbo University, Ningbo, China.
| |
Collapse
|
16
|
Ten Oever S, Sack AT, Oehrn CR, Axmacher N. An engram of intentionally forgotten information. Nat Commun 2021; 12:6443. [PMID: 34750407 PMCID: PMC8575985 DOI: 10.1038/s41467-021-26713-x] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Accepted: 10/12/2021] [Indexed: 12/20/2022] Open
Abstract
Successful forgetting of unwanted memories is crucial for goal-directed behavior and mental wellbeing. While memory retention strengthens memory traces, it is unclear what happens to memory traces of events that are actively forgotten. Using intracranial EEG recordings from lateral temporal cortex, we find that memory traces for actively forgotten information are partially preserved and exhibit unique neural signatures. Memory traces of successfully remembered items show stronger encoding-retrieval similarity in gamma frequency patterns. By contrast, encoding-retrieval similarity of item-specific memory traces of actively forgotten items depend on activity at alpha/beta frequencies commonly associated with functional inhibition. Additional analyses revealed selective modification of item-specific patterns of connectivity and top-down information flow from dorsolateral prefrontal cortex to lateral temporal cortex in memory traces of intentionally forgotten items. These results suggest that intentional forgetting relies more on inhibitory top-down connections than intentional remembering, resulting in inhibitory memory traces with unique neural signatures and representational formats.
Collapse
Affiliation(s)
- Sanne Ten Oever
- Max Planck Institute for Psycholinguistics, Wundtlaan 1, 6525XD, Nijmegen, The Netherlands.
- Donders Centre for Cognitive Neuroimaging, Radboud University, Kapittelweg 29, 6525EN, Nijmegen, The Netherlands.
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Oxfordlaan 55, 6229EV, Maastricht, The Netherlands.
| | - Alexander T Sack
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Oxfordlaan 55, 6229EV, Maastricht, The Netherlands
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience (MHeNs), Brain and Nerve Centre, Maastricht University Medical Centre+ (MUMC+), Debyelaan 25, 6229HX, Maastricht, The Netherlands
| | - Carina R Oehrn
- Department of Neurology, Philipps-University of Marburg, Biegenstraße 10, 35037, Marburg, Germany
- Center for Mind, Brain and Behavior (CMBB), Philipps-University Marburg, Biegenstraße 10, 35037, Marburg, Germany
| | - Nikolai Axmacher
- Department of Neuropsychology, Faculty of Psychology, Institute of Cognitive Neuroscience, Ruhr University Bochum, Universitätsstraße 150, 44801, Bochum, Germany.
- State Key Laboratory of Cognitive Neuroscience and Learning and IDG/McGovern Institute for Brain Research, Beijing Normal University, 19 Xinjiekou Outer St, Beijing, 100875, China.
| |
Collapse
|
17
|
De Groote E, Eqlimi E, Bockstael A, Botteldooren D, Santens P, De Letter M. Parkinson's disease affects the neural alpha oscillations associated with speech-in-noise processing. Eur J Neurosci 2021; 54:7355-7376. [PMID: 34617350 DOI: 10.1111/ejn.15477] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2021] [Revised: 09/03/2021] [Accepted: 09/21/2021] [Indexed: 11/29/2022]
Abstract
Parkinson's disease (PD) has increasingly been associated with auditory dysfunction, including alterations regarding the control of auditory information processing. Although these alterations may interfere with the processing of speech in degraded listening conditions, behavioural studies have generally found preserved speech-in-noise recognition in PD. However, behavioural speech audiometry does not capture the neurophysiological mechanisms supporting speech-in-noise processing. Therefore, the aim of this study was to investigate the neural oscillatory mechanisms associated with speech-in-noise processing in PD. Twelve persons with PD and 12 age- and gender-matched healthy controls (HCs) were included in this study. Persons with PD were studied in the medication off condition. All subjects underwent an audiometric screening and performed a sentence-in-noise recognition task under simultaneous electroencephalography (EEG) recording. Behavioural speech recognition scores and self-reported ratings of effort, performance, and motivation were collected. Time-frequency analysis of EEG data revealed no significant difference between persons with PD and HCs regarding delta-theta (2-8 Hz) inter-trial phase coherence to noise and sentence onset. In contrast, significantly increased alpha (8-12 Hz) power was found in persons with PD compared with HCs during the sentence-in-noise recognition task. Behaviourally, persons with PD demonstrated significantly decreased speech recognition scores, whereas no significant differences were found regarding effort, performance, and motivation ratings. These results suggest that persons with PD allocate more cognitive resources to support speech-in-noise processing. The interpretation of this finding is discussed in the context of a top-down mediated compensation mechanism for inefficient filtering and degradation of auditory input in PD.
Collapse
Affiliation(s)
- Evelien De Groote
- Department of Rehabilitation Sciences, BrainComm Research Group, Ghent University, Ghent, Belgium
| | - Ehsan Eqlimi
- Department of Information Technology, WAVES Research Group, Ghent University, Ghent, Belgium
| | - Annelies Bockstael
- Department of Information Technology, WAVES Research Group, Ghent University, Ghent, Belgium
| | - Dick Botteldooren
- Department of Information Technology, WAVES Research Group, Ghent University, Ghent, Belgium
| | - Patrick Santens
- Department of Neurology, Ghent University Hospital, Ghent, Belgium
| | - Miet De Letter
- Department of Rehabilitation Sciences, BrainComm Research Group, Ghent University, Ghent, Belgium
| |
Collapse
|
18
|
Tracking Cognitive Spare Capacity During Speech Perception With EEG/ERP: Effects of Cognitive Load and Sentence Predictability. Ear Hear 2021; 41:1144-1157. [PMID: 32282402 DOI: 10.1097/aud.0000000000000856] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
OBJECTIVES Listening to speech in adverse listening conditions is effortful. Objective assessment of cognitive spare capacity during listening can serve as an index of the effort needed to understand speech. Cognitive spare capacity is influenced both by signal-driven demands posed by listening conditions and top-down demands intrinsic to spoken language processing, such as memory use and semantic processing. Previous research indicates that electrophysiological responses, particularly alpha oscillatory power, may index listening effort. However, it is not known how these indices respond to memory and semantic processing demands during spoken language processing in adverse listening conditions. The aim of the present study was twofold: first, to assess the impact of memory demands on electrophysiological responses during recognition of degraded, spoken sentences, and second, to examine whether predictable sentence contexts increase or decrease cognitive spare capacity during listening. DESIGN Cognitive demand was varied in a memory load task in which young adult participants (n = 20) viewed either low-load (one digit) or high-load (seven digits) sequences of digits, then listened to noise-vocoded spoken sentences that were either predictable or unpredictable, and then reported the final word of the sentence and the digits. Alpha oscillations in the frequency domain and event-related potentials in the time domain of the electrophysiological data were analyzed, as was behavioral accuracy for both words and digits. RESULTS Measured during sentence processing, event-related desynchronization of alpha power was greater (more negative) under high load than low load and was also greater for unpredictable than predictable sentences. A complementary pattern was observed for the P300/late positive complex (LPC) to sentence-final words, such that P300/LPC amplitude was reduced under high load compared with low load and for unpredictable compared with predictable sentences. Both words and digits were identified more quickly and accurately on trials in which spoken sentences were predictable. CONCLUSIONS Results indicate that during a sentence-recognition task, both cognitive load and sentence predictability modulate electrophysiological indices of cognitive spare capacity, namely alpha oscillatory power and P300/LPC amplitude. Both electrophysiological and behavioral results indicate that a predictive sentence context reduces cognitive demands during listening. Findings contribute to a growing literature on objective measures of cognitive demand during listening and indicate predictable sentence context as a top-down factor that can support ease of listening.
Collapse
|
19
|
Kulkarni M, Hannula DE. Temporal Regularity May Not Improve Memory for Item-Specific Detail. Front Psychol 2021; 12:623402. [PMID: 33776845 PMCID: PMC7991072 DOI: 10.3389/fpsyg.2021.623402] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 02/15/2021] [Indexed: 11/16/2022] Open
Abstract
Regularities in event timing allow for the allocation of attention to critical time-points when an event is most likely to occur, leading to improved visual perception. Results from recent studies indicate that similar benefits may extend to memory for scenes and objects. Here, we investigated whether benefits of temporal regularity are evident when detailed, item-specific representations are necessary for successful recognition memory performance. In Experiments 1 and 2, pictures of objects were presented with either predictable or randomized event timing, in separate encoding blocks. In the test phase, old and new objects were presented, intermixed with perceptually similar exemplars of encoded objects. In Experiment 3 we attempted to replicate previously reported memory enhancements for scenes. In contrast to predictions, temporal regularity did not affect response times (RT) or improve recognition memory accuracy in any of our experiments. These results suggest that any effects of temporal expectation on memory are subtle and may be sensitive to minor changes in task parameters. In sum, indirect upregulation of attention through imposed temporal structure may not be sufficient to have downstream effects on memory performance.
Collapse
Affiliation(s)
| | - Deborah E. Hannula
- Department of Psychology, University of Wisconsin – Milwaukee, Milwaukee, WI, United States
| |
Collapse
|
20
|
Wöstmann M, Maess B, Obleser J. Orienting auditory attention in time: Lateralized alpha power reflects spatio-temporal filtering. Neuroimage 2020; 228:117711. [PMID: 33385562 PMCID: PMC7903158 DOI: 10.1016/j.neuroimage.2020.117711] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2020] [Revised: 11/27/2020] [Accepted: 12/21/2020] [Indexed: 12/30/2022] Open
Abstract
The deployment of neural alpha (8–12 Hz) lateralization in service of spatial attention is well-established: Alpha power increases in the cortical hemisphere ipsilateral to the attended hemifield, and decreases in the contralateral hemisphere, respectively. Much less is known about humans’ ability to deploy such alpha lateralization in time, and to thus exploit alpha power as a spatio-temporal filter. Here we show that spatially lateralized alpha power does signify – beyond the direction of spatial attention – the distribution of attention in time and thereby qualifies as a spatio-temporal attentional filter. Participants (N = 20) selectively listened to spoken numbers presented on one side (left vs right), while competing numbers were presented on the other side. Key to our hypothesis, temporal foreknowledge was manipulated via a visual cue, which was either instructive and indicated the to-be-probed number position (70% valid) or neutral. Temporal foreknowledge did guide participants’ attention, as they recognized numbers from the to-be-attended side more accurately following valid cues. In the magnetoencephalogram (MEG), spatial attention to the left versus right side induced lateralization of alpha power in all temporal cueing conditions. Modulation of alpha lateralization at the 0.8 Hz presentation rate of spoken numbers was stronger following instructive compared to neutral temporal cues. Critically, we found stronger modulation of lateralized alpha power specifically at the onsets of temporally cued numbers. These results suggest that the precisely timed hemispheric lateralization of alpha power qualifies as a spatio-temporal attentional filter mechanism susceptible to top-down behavioural goals.
Collapse
Affiliation(s)
- Malte Wöstmann
- Department of Psychology, University of Lübeck, Germany; Center of Brain, Behavior and Metabolism (CBBM), University of Lübeck, Lübeck, Germany.
| | - Burkhard Maess
- Max-Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, Germany; Center of Brain, Behavior and Metabolism (CBBM), University of Lübeck, Lübeck, Germany
| |
Collapse
|
21
|
Barne LC, de Lange FP, Cravo AM. Prestimulus alpha power is related to the strength of stimulus representation. Cortex 2020; 132:250-257. [DOI: 10.1016/j.cortex.2020.08.017] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2020] [Revised: 06/01/2020] [Accepted: 08/27/2020] [Indexed: 10/23/2022]
|
22
|
Jin W, Nobre AC, van Ede F. Temporal Expectations Prepare Visual Working Memory for Behavior. J Cogn Neurosci 2020; 32:2320-2332. [PMID: 32897120 PMCID: PMC8357348 DOI: 10.1162/jocn_a_01626] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Working memory enables us to retain past sensations in service of anticipated task demands. How we prepare for anticipated task demands during working memory retention remains poorly understood. Here, we focused on the role of time—asking how temporal expectations help prepare for ensuing memory-guided behavior. We manipulated the expected probe time in a delayed change-detection task and report that temporal expectation can have a profound influence on memory-guided behavioral performance. EEG measurements corroborated the utilization of temporal expectations: demonstrating the involvement of a classic EEG signature of temporal expectation—the contingent negative variation—in the context of working memory. We also report the influence of temporal expectations on 2 EEG signatures associated with visual working memory—the lateralization of 8- to 12-Hz alpha activity, and the contralateral delay activity. We observed a dissociation between these signatures, whereby alpha lateralization (but not the contralateral delay activity) adapted to the time of expected memory utilization. These data show how temporal expectations prepare visual working memory for behavior and shed new light on the electrophysiological markers of both temporal expectation and working memory.
Collapse
Affiliation(s)
- Wen Jin
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging.,University of Oxford
| | - Anna C Nobre
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging.,University of Oxford
| | - Freek van Ede
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging.,Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam
| |
Collapse
|
23
|
Cortical Tracking of Speech in Delta Band Relates to Individual Differences in Speech in Noise Comprehension in Older Adults. Ear Hear 2020; 42:343-354. [PMID: 32826508 DOI: 10.1097/aud.0000000000000923] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
OBJECTIVES Understanding speech in adverse listening environments is challenging for older adults. Individual differences in pure tone averages and working memory are known to be critical indicators of speech in noise comprehension. Recent studies have suggested that tracking of the speech envelope in cortical oscillations <8 Hz may be an important mechanism related to speech comprehension by segmenting speech into words and phrases (delta, 1 to 4 Hz) or phonemes and syllables (theta, 4 to 8 Hz). The purpose of this study was to investigate the extent to which individual differences in pure tone averages, working memory, and cortical tracking of the speech envelope relate to speech in noise comprehension in older adults. DESIGN Cortical tracking of continuous speech was assessed using electroencephalography in older adults (60 to 80 years). Participants listened to speech in quiet and in the presence of noise (time-reversed speech) and answered comprehension questions. Participants completed Forward Digit Span and Backward Digit Span as measures of working memory, and pure tone averages were collected. An index of reduction in noise (RIN) was calculated by normalizing the difference between raw cortical tracking in quiet and in noise. RESULTS Comprehension question performance was greater for speech in quiet than for speech in noise. The relationship between RIN and speech in noise comprehension was assessed while controlling for the effects of individual differences in pure tone averages and working memory. Delta band RIN correlated with speech in noise comprehension, while theta band RIN did not. CONCLUSIONS Cortical tracking by delta oscillations is robust to the effects of noise. These findings demonstrate that the magnitude of delta band RIN relates to individual differences in speech in noise comprehension in older adults. Delta band RIN may serve as a neural metric of speech in noise comprehension beyond the effects of pure tone averages and working memory.
Collapse
|
24
|
Baroni F, Morillon B, Trébuchon A, Liégeois-Chauvel C, Olasagasti I, Giraud AL. Converging intracortical signatures of two separated processing timescales in human early auditory cortex. Neuroimage 2020; 218:116882. [PMID: 32439539 DOI: 10.1016/j.neuroimage.2020.116882] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 03/30/2020] [Accepted: 04/23/2020] [Indexed: 11/15/2022] Open
Abstract
Neural oscillations in auditory cortex are argued to support parsing and representing speech constituents at their corresponding temporal scales. Yet, how incoming sensory information interacts with ongoing spontaneous brain activity, what features of the neuronal microcircuitry underlie spontaneous and stimulus-evoked spectral fingerprints, and what these fingerprints entail for stimulus encoding, remain largely open questions. We used a combination of human invasive electrophysiology, computational modeling and decoding techniques to assess the information encoding properties of brain activity and to relate them to a plausible underlying neuronal microarchitecture. We analyzed intracortical auditory EEG activity from 10 patients while they were listening to short sentences. Pre-stimulus neural activity in early auditory cortical regions often exhibited power spectra with a shoulder in the delta range and a small bump in the beta range. Speech decreased power in the beta range, and increased power in the delta-theta and gamma ranges. Using multivariate machine learning techniques, we assessed the spectral profile of information content for two aspects of speech processing: detection and discrimination. We obtained better phase than power information decoding, and a bimodal spectral profile of information content with better decoding at low (delta-theta) and high (gamma) frequencies than at intermediate (beta) frequencies. These experimental data were reproduced by a simple rate model made of two subnetworks with different timescales, each composed of coupled excitatory and inhibitory units, and connected via a negative feedback loop. Modeling and experimental results were similar in terms of pre-stimulus spectral profile (except for the iEEG beta bump), spectral modulations with speech, and spectral profile of information content. Altogether, we provide converging evidence from both univariate spectral analysis and decoding approaches for a dual timescale processing infrastructure in human auditory cortex, and show that it is consistent with the dynamics of a simple rate model.
Collapse
Affiliation(s)
- Fabiano Baroni
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland; School of Engineering, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
| | - Benjamin Morillon
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France
| | - Agnès Trébuchon
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France; Clinical Neurophysiology and Epileptology Department, Timone Hospital, Assistance Publique Hôpitaux de Marseille, Marseille, France
| | - Catherine Liégeois-Chauvel
- Aix Marseille Université, Institut National de la Santé et de la Recherche Médicale (INSERM), Institut de Neurosciences des Systémes (INS), Marseille, France; Department of Neurological Surgery, University of Pittsburgh, PA, 15213, USA
| | - Itsaso Olasagasti
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland
| | - Anne-Lise Giraud
- Department of Fundamental Neuroscience, University of Geneva, Geneva, Switzerland
| |
Collapse
|
25
|
Liu H, Li B, Wang X, He Y. Role of joint language control during cross-language communication: evidence from cross-frequency coupling. Cogn Neurodyn 2020; 15:191-205. [PMID: 33854639 DOI: 10.1007/s11571-020-09594-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2019] [Revised: 04/17/2020] [Accepted: 04/29/2020] [Indexed: 01/03/2023] Open
Abstract
How do bilingual interlocutors inhibit interference from the non-target language to achieve brain-to-brain information exchange in a task to simulate a bilingual speaker-listener interaction. In the current study, two electroencephalogram devices were employed to record pairs of participants' performances in a joint language switching task. Twenty-eight (14 pairs) unbalanced Chinese-English bilinguals (L1 Chinese) were instructed to name pictures in the appropriate language according to the cue. The phase-amplitude coupling analysis was employed to reveal the large-scale brain network responsible for joint language control between interlocutors. We found that (1) speakers and listeners coordinately suppressed cross-language interference through cross-frequency coupling, as shown in the increased delta/theta phase-amplitude and delta/alpha phase-amplitude coupling when switching to L2 than switching to L1; (2) speakers and listeners were both able to simultaneously inhibit cross-person item-level interference which was demonstrated by stronger cross-frequency coupling in the cross person condition compared to the within person condition. These results indicate that current bilingual models (e.g., the inhibitory control model) should incorporate mechanisms that address inhibiting interference sourced in both language and person (i.e., cross-language and cross-person item-level interference) synchronously through joint language control in dynamic cross-language communication.
Collapse
Affiliation(s)
- Huanhuan Liu
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, 116029 China.,Beijing Key Laboratory of Applied Experimental Psychology, Faculty of Psychology, Beijing Normal University, Beijing, 100875 China.,Key Laboratory of Brain and Cognitive Neurosience, Liaoning Province, Dalian, 116029 China
| | - Baike Li
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, 116029 China.,Beijing Key Laboratory of Applied Experimental Psychology, Faculty of Psychology, Beijing Normal University, Beijing, 100875 China
| | - Xin Wang
- Department of Linguistics, Faculty of Human Sciences, Macquarie University, Sydney, Australia
| | - Yuying He
- Research Center of Brain and Cognitive Neuroscience, Liaoning Normal University, Dalian, 116029 China
| |
Collapse
|
26
|
Weisz N, Kraft NG, Demarchi G. Auditory cortical alpha/beta desynchronization prioritizes the representation of memory items during a retention period. eLife 2020; 9:55508. [PMID: 32378513 PMCID: PMC7242024 DOI: 10.7554/elife.55508] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2020] [Accepted: 05/05/2020] [Indexed: 12/11/2022] Open
Abstract
To-be-memorized information in working-memory could be protected against distracting influences by processes of functional inhibition or prioritization. Modulations of oscillations in the alpha to beta range in task-relevant sensory regions have been suggested to play an important role for both mechanisms. We adapted a Sternberg task variant to the auditory modality, with a strong or a weak distracting sound presented at a predictable time during the retention period. Using a time-generalized decoding approach, relatively decreased strength of memorized information was found prior to strong distractors, paralleled by decreased pre-distractor alpha/beta power in the left superior temporal gyrus (lSTG). Over the entire group, reduced beta power in lSTG was associated with relatively increased strength of memorized information. The extent of alpha power modulations within participants was negatively correlated with strength of memorized information. Overall, our results are compatible with a prioritization account, but point to nuanced differences between alpha and beta oscillations.
Collapse
Affiliation(s)
- Nathan Weisz
- Centre for Cognitive Neuroscience and Department of Psychology, Paris-Lodron Universität Salzburg, Salzburg, Austria
| | - Nadine Gabriele Kraft
- Centre for Cognitive Neuroscience and Department of Psychology, Paris-Lodron Universität Salzburg, Salzburg, Austria
| | - Gianpaolo Demarchi
- Centre for Cognitive Neuroscience and Department of Psychology, Paris-Lodron Universität Salzburg, Salzburg, Austria
| |
Collapse
|
27
|
Oscillations in the auditory system and their possible role. Neurosci Biobehav Rev 2020; 113:507-528. [PMID: 32298712 DOI: 10.1016/j.neubiorev.2020.03.030] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2019] [Revised: 03/25/2020] [Accepted: 03/30/2020] [Indexed: 12/26/2022]
Abstract
GOURÉVITCH, B., C. Martin, O. Postal, J.J. Eggermont. Oscillations in the auditory system, their possible role. NEUROSCI BIOBEHAV REV XXX XXX-XXX, 2020. - Neural oscillations are thought to have various roles in brain processing such as, attention modulation, neuronal communication, motor coordination, memory consolidation, decision-making, or feature binding. The role of oscillations in the auditory system is less clear, especially due to the large discrepancy between human and animal studies. Here we describe many methodological issues that confound the results of oscillation studies in the auditory field. Moreover, we discuss the relationship between neural entrainment and oscillations that remains unclear. Finally, we aim to identify which kind of oscillations could be specific or salient to the auditory areas and their processing. We suggest that the role of oscillations might dramatically differ between the primary auditory cortex and the more associative auditory areas. Despite the moderate presence of intrinsic low frequency oscillations in the primary auditory cortex, rhythmic components in the input seem crucial for auditory processing. This allows the phase entrainment between the oscillatory phase and rhythmic input, which is an integral part of stimulus selection within the auditory system.
Collapse
|
28
|
Wöstmann M, Schmitt LM, Obleser J. Does Closing the Eyes Enhance Auditory Attention? Eye Closure Increases Attentional Alpha-Power Modulation but Not Listening Performance. J Cogn Neurosci 2020; 32:212-225. [DOI: 10.1162/jocn_a_01403] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
Abstract
In challenging listening conditions, closing the eyes is a strategy with intuitive appeal to improve auditory attention and perception. On the neural level, closing the eyes increases the power of alpha oscillations (∼10 Hz), which are a prime signature of auditory attention. Here, we test whether eye closure benefits neural and behavioral signatures of auditory attention and perception. Participants (n = 22) attended to one of two alternating streams of spoken numbers with open or closed eyes in a darkened chamber. After each trial, participants indicated whether probes had been among the to-be-attended or to-be-ignored numbers. In the EEG, states of relative high versus low alpha power accompanied the presentation of attended versus ignored numbers. Importantly, eye closure did not only increase the overall level of absolute alpha power but also the attentional modulation thereof. Behaviorally, however, neither perceptual sensitivity nor response criterion was affected by eye closure. To further examine whether this behavioral null result would conceptually replicate in a simple auditory detection task, a follow-up experiment was conducted that required participants (n = 19) to detect a near-threshold target tone in noise. As in the main experiment, our results provide evidence for the absence of any difference in perceptual sensitivity and criterion for open versus closed eyes. In summary, we demonstrate here that the modulation of the human alpha rhythm by auditory attention is increased when participants close their eyes. However, our results speak against the widely held belief that eye closure per se improves listening behavior.
Collapse
|
29
|
Jenson D, Thornton D, Harkrider AW, Saltuklaroglu T. Influences of cognitive load on sensorimotor contributions to working memory: An EEG investigation of mu rhythm activity during speech discrimination. Neurobiol Learn Mem 2019; 166:107098. [DOI: 10.1016/j.nlm.2019.107098] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2019] [Revised: 09/11/2019] [Accepted: 10/09/2019] [Indexed: 11/16/2022]
|
30
|
Shang Y, Hinkley LB, Cai C, Mizuiri D, Cheung SW, Nagarajan SS. Cross-modal plasticity in adult single-sided deafness revealed by alpha band resting-state functional connectivity. Neuroimage 2019; 207:116376. [PMID: 31756519 DOI: 10.1016/j.neuroimage.2019.116376] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2019] [Revised: 10/10/2019] [Accepted: 11/17/2019] [Indexed: 12/26/2022] Open
Abstract
Single-sided deafness (SSD) or profound unilateral hearing loss is the condition where the transfer of acoustic information to the brain is restricted to one ear. SSD impairment is most evident under adverse acoustic environments with overlapping interference, which burdens cognitive resources. It is known that bilateral deafness induces cross-modal brain plasticity within visual cortical areas. Here we investigate whether similar cross-modal plasticity is observed in adult-onset SSD. In SSD patients (n = 29) and matched controls (n = 29) we estimated voxel level resting-state power and functional connectivity in the alpha band (8-12 Hz) from magnetoencephalography (MEG) data. We examined both global functional connectivity (mean functional connectivity of each voxel with the rest of the brain), and seeded functional connectivity of primary auditory cortices (A1), primary visual cortices (V1) and posterior cingulate cortex (PCC) of the default mode network (DMN). Power reduction was observed in left auditory cortex. Global functional connectivity showed reduction in frontal cortices and enhancement in visual cortex. Seeded functional connectivity of auditory cortices showed reduction in temporal, frontal and occipital regions, and enhancement in parietal cortex. Interestingly, seeded functional connectivity of visual cortices showed enhancement in visual cortices, inferior parietal lobe, post-central gyrus, and the precuneus, and reduction in auditory cortex. Seeded functional connectivity of PCC showed reduction in frontal cortical regions that are part of the DMN, attention, and working memory networks. Adult-onset SSD exhibited widespread cross-modal brain plasticity involving alterations in auditory, visual, attention, working memory and default mode networks.
Collapse
Affiliation(s)
- Yingying Shang
- Department of Otorhinolaryngology, Peking Union Medical College Hospital, Beijing, 100730, China; Department of Otolaryngology-Head and Neck Surgery, University of California, San Francisco, CA, 94115, USA.
| | - Leighton B Hinkley
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, 94143, USA
| | - Chang Cai
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, 94143, USA
| | - Danielle Mizuiri
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, 94143, USA
| | - Steven W Cheung
- Department of Otolaryngology-Head and Neck Surgery, University of California, San Francisco, CA, 94115, USA
| | - Srikantan S Nagarajan
- Department of Otolaryngology-Head and Neck Surgery, University of California, San Francisco, CA, 94115, USA; Department of Radiology and Biomedical Imaging, University of California, San Francisco, CA, 94143, USA.
| |
Collapse
|
31
|
Sorati M, Behne DM. Musical Expertise Affects Audiovisual Speech Perception: Findings From Event-Related Potentials and Inter-trial Phase Coherence. Front Psychol 2019; 10:2562. [PMID: 31803107 PMCID: PMC6874039 DOI: 10.3389/fpsyg.2019.02562] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2019] [Accepted: 10/29/2019] [Indexed: 12/03/2022] Open
Abstract
In audiovisual speech perception, visual information from a talker's face during mouth articulation is available before the onset of the corresponding audio speech, and thereby allows the perceiver to use visual information to predict the upcoming audio. This prediction from phonetically congruent visual information modulates audiovisual speech perception and leads to a decrease in N1 and P2 amplitudes and latencies compared to the perception of audio speech alone. Whether audiovisual experience, such as with musical training, influences this prediction is unclear, but if so, may explain some of the variations observed in previous research. The current study addresses whether audiovisual speech perception is affected by musical training, first assessing N1 and P2 event-related potentials (ERPs) and in addition, inter-trial phase coherence (ITPC). Musicians and non-musicians are presented the syllable, /ba/ in audio only (AO), video only (VO), and audiovisual (AV) conditions. With the predictory effect of mouth movement isolated from the AV speech (AV-VO), results showed that, compared to audio speech, both groups have a lower N1 latency and P2 amplitude and latency. Moreover, they also showed lower ITPCs in the delta, theta, and beta bands in audiovisual speech perception. However, musicians showed significant suppression of N1 amplitude and desynchronization in the alpha band in audiovisual speech, not present for non-musicians. Collectively, the current findings indicate that early sensory processing can be modified by musical experience, which in turn can explain some of the variations in previous AV speech perception research.
Collapse
Affiliation(s)
- Marzieh Sorati
- Department of Psychology, Norwegian University of Science and Technology, Trondheim, Norway
| | | |
Collapse
|
32
|
Tavano A, Schröger E, Kotz SA. Beta power encodes contextual estimates of temporal event probability in the human brain. PLoS One 2019; 14:e0222420. [PMID: 31557168 PMCID: PMC6762064 DOI: 10.1371/journal.pone.0222420] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2019] [Accepted: 08/29/2019] [Indexed: 12/30/2022] Open
Abstract
To prepare for an impending event of unknown temporal distribution, humans internally increase the perceived probability of event onset as time elapses. This effect is termed the hazard rate of events. We tested how the neural encoding of hazard rate changes by providing human participants with prior information on temporal event probability. We recorded behavioral and electroencephalographic (EEG) data while participants listened to continuously repeating five-tone sequences, composed of four standard tones followed by a non-target deviant tone, delivered at slow (1.6 Hz) or fast (4 Hz) rates. The task was to detect a rare target tone, which equiprobably appeared at either position two, three or four of the repeating sequence. In this design, potential target position acts as a proxy for elapsed time. For participants uninformed about the target's distribution, elapsed time to uncertain target onset increased response speed, displaying a significant hazard rate effect at both slow and fast stimulus rates. However, only in fast sequences did prior information about the target's temporal distribution interact with elapsed time, suppressing the hazard rate. Importantly, in the fast, uninformed condition pre-stimulus power synchronization in the beta band (Beta 1, 15-19 Hz) predicted the hazard rate of response times. Prior information suppressed pre-stimulus power synchronization in the same band, while still significantly predicting response times. We conclude that Beta 1 power does not simply encode the hazard rate, but-more generally-internal estimates of temporal event probability based upon contextual information.
Collapse
Affiliation(s)
- Alessandro Tavano
- BioCog, Cognitive Incl. Biological Psychology, Institute of Psychology, University of Leipzig, Leipzig, Germany
- Department of Neuroscience, Max Planck Institute for Empirical Aesthetics, Frankfurt am Main, Germany
| | - Erich Schröger
- BioCog, Cognitive Incl. Biological Psychology, Institute of Psychology, University of Leipzig, Leipzig, Germany
| | - Sonja A. Kotz
- Department of Neuropsychology, Max-Planck-Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
- Faculty of Psychology and Neuroscience, Department of Neuropsychology and Psychopharmacology, Maastricht University, Maastricht, The Netherlands
| |
Collapse
|
33
|
Herbst SK, Obleser J. Implicit temporal predictability enhances pitch discrimination sensitivity and biases the phase of delta oscillations in auditory cortex. Neuroimage 2019; 203:116198. [PMID: 31539590 DOI: 10.1016/j.neuroimage.2019.116198] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2019] [Revised: 08/23/2019] [Accepted: 09/14/2019] [Indexed: 10/26/2022] Open
Abstract
Can human listeners use implicit temporal contingencies in auditory input to form temporal predictions, and if so, how are these predictions represented endogenously? To assess this question, we implicitly manipulated temporal predictability in an auditory pitch discrimination task: unbeknownst to participants, the pitch of the standard tone could either be deterministically predictive of the temporal onset of the target tone, or convey no predictive information. Predictive and non-predictive conditions were presented interleaved in one stream, and separated by variable inter-stimulus intervals such that there was no dominant stimulus rhythm throughout. Even though participants were unaware of the implicit temporal contingencies, pitch discrimination sensitivity (the slope of the psychometric function) increased when the onset of the target tone was predictable in time (N = 49, 28 female, 21 male). Concurrently recorded EEG data (N = 24) revealed that standard tones that conveyed temporal predictions evoked a more negative N1 component than non-predictive standards. We observed no significant differences in oscillatory power or phase coherence between conditions during the foreperiod. Importantly, the phase angle of delta oscillations (1-3 Hz) in auditory areas in the post-standard and pre-target time windows predicted behavioral pitch discrimination sensitivity. This suggests that temporal predictions are encoded in delta oscillatory phase during the foreperiod interval. In sum, we show that auditory perception benefits from implicit temporal contingencies, and provide evidence for a role of slow neural oscillations in the endogenous representation of temporal predictions, in absence of exogenously driven entrainment to rhythmic input.
Collapse
Affiliation(s)
- Sophie K Herbst
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23552, Lübeck, Germany; NeuroSpin, CEA, DRF/Joliot; INSERM Cognitive Neuroimaging Unit; Université Paris-Sud, Université Paris-Saclay; Bât 145Gif s/ Yvette, 91190 France.
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, Ratzeburger Allee 160, 23552, Lübeck, Germany
| |
Collapse
|
34
|
Tseng YL, Liu HH, Liou M, Tsai AC, Chien VSC, Shyu ST, Yang ZS. Lingering Sound: Event-Related Phase-Amplitude Coupling and Phase-Locking in Fronto-Temporo-Parietal Functional Networks During Memory Retrieval of Music Melodies. Front Hum Neurosci 2019; 13:150. [PMID: 31178706 PMCID: PMC6538802 DOI: 10.3389/fnhum.2019.00150] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2018] [Accepted: 04/23/2019] [Indexed: 01/22/2023] Open
Abstract
Brain oscillations and connectivity have emerged as promising measures of evaluating memory processes, including encoding, maintenance, and retrieval, as well as the related executive function. Although many studies have addressed the neural mechanisms underlying working memory, most of these studies have focused on the visual modality. Neurodynamics and functional connectivity related to auditory working memory are yet to be established. In this study, we explored the dynamic of high density (128-channel) electroencephalography (EEG) in a musical delayed match-to-sample task (DMST), in which 36 participants were recruited and were instructed to recognize and distinguish the target melodies from similar distractors. Event-related spectral perturbations (ERSPs), event-related phase-amplitude couplings (ERPACs), and phase-locking values (PLVs) were used to determine the corresponding brain oscillations and connectivity. First, we observed that low-frequency oscillations in the frontal, temporal, and parietal regions were increased during the processing of both target and distracting melodies. Second, the cross-frequency coupling between low-frequency phases and high-frequency amplitudes was elevated in the frontal and parietal regions when the participants were distinguishing between the target from distractor, suggesting that the phase-amplitude coupling could be an indicator of neural mechanisms underlying memory retrieval. Finally, phase-locking, an index evaluating brain functional connectivity, revealed that there was fronto-temporal phase-locking in the theta band and fronto-parietal phase-locking in the alpha band during the recognition of the two stimuli. These findings suggest the existence of functional connectivity and the phase-amplitude coupling in the neocortex during musical memory retrieval, and provide a highly resolved timeline to evaluate brain dynamics. Furthermore, the inter-regional phase-locking and phase-amplitude coupling among the frontal, temporal and parietal regions occurred at the very beginning of musical memory retrieval, which might reflect the precise timing when cognitive resources were involved in the retrieval of targets and the rejection of similar distractors. To the best of our knowledge, this is the first EEG study employing a naturalistic task to study auditory memory processes and functional connectivity during memory retrieval, results of which can shed light on the use of natural stimuli in studies that are closer to the real-life applications of cognitive evaluations, mental treatments, and brain-computer interface.
Collapse
Affiliation(s)
- Yi-Li Tseng
- Department of Electrical Engineering, Fu Jen Catholic University, New Taipei City, Taiwan.,Institute of Statistical Science, Academia Sinica, Taipei, Taiwan
| | - Hong-Hsiang Liu
- Department of Psychology, National Taiwan University, Taipei, Taiwan
| | - Michelle Liou
- Institute of Statistical Science, Academia Sinica, Taipei, Taiwan
| | - Arthur C Tsai
- Institute of Statistical Science, Academia Sinica, Taipei, Taiwan
| | - Vincent S C Chien
- Institute of Statistical Science, Academia Sinica, Taipei, Taiwan.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Shuoh-Tyng Shyu
- Department of Electrical Engineering, Fu Jen Catholic University, New Taipei City, Taiwan
| | - Zhi-Shun Yang
- Department of Electrical Engineering, Fu Jen Catholic University, New Taipei City, Taiwan
| |
Collapse
|
35
|
A division of labor between power and phase coherence in encoding attention to stimulus streams. Neuroimage 2019; 193:146-156. [PMID: 30877058 DOI: 10.1016/j.neuroimage.2019.03.018] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2018] [Revised: 02/20/2019] [Accepted: 03/08/2019] [Indexed: 11/22/2022] Open
Abstract
Both time-based (when) and feature-based (what) aspects of attention facilitate behavior, so it is natural to hypothesize additive effects. We tested this conjecture by recording response behavior and electroencephalographic (EEG) data to auditory pitch changes, embedded at different time lags in a continuous sound stream. Participants reacted more rapidly to larger rather than smaller feature change magnitudes (deviancy), as well as to changes appearing after longer rather than shorter waiting times (hazard rate of response times). However, the feature and time dimensions of attention separately contributed to response speed, with no significant interaction. Notably, phase coherence at low frequencies (delta and theta bands, 1-7 Hz) predominantly reflected attention capture by feature changes, while oscillatory power at higher frequency bands, alpha (8-12 Hz) and beta (13-25 Hz) reflected the orienting of attention in time. Power and phase coherence predicted different portions of response speed variance, suggesting a division of labor in encoding sensory attention in complex auditory scenes.
Collapse
|
36
|
Pérez A, Dumas G, Karadag M, Duñabeitia JA. Differential brain-to-brain entrainment while speaking and listening in native and foreign languages. Cortex 2018; 111:303-315. [PMID: 30598230 DOI: 10.1016/j.cortex.2018.11.026] [Citation(s) in RCA: 37] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2018] [Revised: 09/28/2018] [Accepted: 11/29/2018] [Indexed: 10/27/2022]
Abstract
The study explores interbrain neural coupling when interlocutors engage in a conversation whether it be in their native or nonnative language. To this end, electroencephalographic hyperscanning was used to study brain-to-brain phase synchronization during a two-person turn-taking verbal exchange with no visual contact, in either a native or a foreign language context. Results show that the coupling strength between brain signals is increased in both, the native language context and the foreign language context, specifically, in the alpha frequency band. A difference in brain-to speech entrainment to native and foreign languages is also shown. These results indicate that between brain similarities in the timing of neural activations and their spatial distributions change depending on the language code used. We argue that factors like linguistic alignment, joint attention and brain-entrainment to speech operate with a language-idiosyncratic neural configuration, modulating the alignment of neural activity between speakers and listeners. Other possible factors leading to the differential interbrain synchronization patterns as well as the potential features of brain-to-brain entrainment as a mechanism are briefly discussed. We concluded that linguistic context should be considered when addressing interpersonal communication. The findings here open doors to quantifying linguistic interactions.
Collapse
Affiliation(s)
- Alejandro Pérez
- Centre for French & Linguistics, University of Toronto Scarborough, Toronto, Canada; Psychology Department, University of Toronto Scarborough, Toronto, Canada; BCBL, Basque Center on Cognition Brain and Language, Donostia-San Sebastián, Spain.
| | - Guillaume Dumas
- Human Genetics and Cognitive Functions Unit, Institut Pasteur, Paris, France; CNRS UMR 3571 Genes, Synapses and Cognition, Institut Pasteur, Paris, France; Human Genetics and Cognitive Functions, University Paris Diderot, Sorbonne Paris Cité, Paris, France
| | - Melek Karadag
- Centre for Speech, Language and the Brain, Department of Psychology, University of Cambridge, Cambridge, United Kingdom
| | - Jon Andoni Duñabeitia
- BCBL, Basque Center on Cognition Brain and Language, Donostia-San Sebastián, Spain; Facultad de Lenguas y Educación, Universidad Nebrija, Madrid, Spain
| |
Collapse
|
37
|
Thornton D, Harkrider AW, Jenson D, Saltuklaroglu T. Sensorimotor activity measured via oscillations of EEG mu rhythms in speech and non-speech discrimination tasks with and without segmentation demands. BRAIN AND LANGUAGE 2018; 187:62-73. [PMID: 28431691 DOI: 10.1016/j.bandl.2017.03.011] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/28/2016] [Revised: 01/24/2017] [Accepted: 03/31/2017] [Indexed: 06/07/2023]
Abstract
Better understanding of the role of sensorimotor processing in speech and non-speech segmentation can be achieved with more temporally precise measures. Twenty adults made same/different discriminations of speech and non-speech stimuli pairs, with and without segmentation demands. Independent component analysis of 64-channel EEG data revealed clear sensorimotor mu components, with characteristic alpha and beta peaks, localized to premotor regions in 70% of participants.Time-frequency analyses of mu components from accurate trials showed that (1) segmentation tasks elicited greater event-related synchronization immediately following offset of the first stimulus, suggestive of inhibitory activity; (2) strong late event-related desynchronization in all conditions, suggesting that working memory/covert replay contributed substantially to sensorimotor activity in all conditions; (3) stronger beta desynchronization in speech versus non-speech stimuli during stimulus presentation, suggesting stronger auditory-motor transforms for speech versus non-speech stimuli. Findings support the continued use of oscillatory approaches for helping understand segmentation and other cognitive tasks.
Collapse
Affiliation(s)
- David Thornton
- University of Tennessee Health Science Center, United States.
| | | | - David Jenson
- University of Tennessee Health Science Center, United States
| | | |
Collapse
|
38
|
Murphy E, Benítez-Burraco A. Toward the Language Oscillogenome. Front Psychol 2018; 9:1999. [PMID: 30405489 PMCID: PMC6206218 DOI: 10.3389/fpsyg.2018.01999] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2018] [Accepted: 09/28/2018] [Indexed: 12/20/2022] Open
Abstract
Language has been argued to arise, both ontogenetically and phylogenetically, from specific patterns of brain wiring. We argue that it can further be shown that core features of language processing emerge from particular phasal and cross-frequency coupling properties of neural oscillations; what has been referred to as the language ‘oscillome.’ It is expected that basic aspects of the language oscillome result from genetic guidance, what we will here call the language ‘oscillogenome,’ for which we will put forward a list of candidate genes. We have considered genes for altered brain rhythmicity in conditions involving language deficits: autism spectrum disorders, schizophrenia, specific language impairment and dyslexia. These selected genes map on to aspects of brain function, particularly on to neurotransmitter function. We stress that caution should be adopted in the construction of any oscillogenome, given the range of potential roles particular localized frequency bands have in cognition. Our aim is to propose a set of genome-to-language linking hypotheses that, given testing, would grant explanatory power to brain rhythms with respect to language processing and evolution.
Collapse
Affiliation(s)
- Elliot Murphy
- Division of Psychology and Language Sciences, University College London, London, United Kingdom.,Department of Psychology, University of Westminster, London, United Kingdom
| | - Antonio Benítez-Burraco
- Department of Spanish Language, Linguistics and Literary Theory, University of Seville, Seville, Spain
| |
Collapse
|
39
|
Ma X, Ding N, Tao Y, Yang YF. Differences in Neurocognitive Mechanisms Underlying the Processing of Center-Embedded and Non–embedded Musical Structures. Front Hum Neurosci 2018; 12:425. [PMID: 30405379 PMCID: PMC6206303 DOI: 10.3389/fnhum.2018.00425] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2018] [Accepted: 10/01/2018] [Indexed: 11/13/2022] Open
Abstract
In music, chords are organized into hierarchical structures based on recursive or embedded syntax. How the brain extracts recursive grammar is a central question in musical cognition and other cognitive neuroscience, but the precise mechanism remains unclear. By analyzing event related potentials (ERPs) and neural oscillatory activity, the present study investigated neurocognitive mechanisms underlying the processing of center-embedded structure in music by examining the differences in center-embedded and non-embedded structure processing and evaluating how these differences are affected by musical proficiency. Based on Western musical proficiency, the subjects were divided into two groups, non-experts and experts. The results revealed that for non-experts, the processing of center-embedded structure elicited greater early right-anterior negativity (ERAN) and N5 components as well as, reduced alpha and gamma activities than did the non-embedded structure. For experts, no significant difference in the ERP response was observed between the processing of non-embedded and center-embedded structures; however, the processing of center-embedded structure elicited increased beta activity compared to non-embedded structure. These findings indicate that listeners different in proficiency would rely on different cognitive neural mechanisms in music processing with the syntactic complexity increases.
Collapse
Affiliation(s)
- Xie Ma
- Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- College of Educational Science and Management, Yunnan Normal University, Kunming, China
- Key Laboratory of Educational Informatization for Nationalities, Yunnan Normal University, Kunming, China
| | - Nai Ding
- College of Biomedical Engineering and Instrument Sciences, Zhejiang University, Hangzhou, China
- Key Laboratory for Biomedical Engineering of Ministry of Education, Zhejiang University, Hangzhou, China
- State Key Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou, China
| | - Yun Tao
- College of Educational Science and Management, Yunnan Normal University, Kunming, China
- Key Laboratory of Educational Informatization for Nationalities, Yunnan Normal University, Kunming, China
| | - Yu Fang Yang
- Institute of Psychology, Chinese Academy of Sciences, Beijing, China
- *Correspondence: Yu Fang Yang
| |
Collapse
|
40
|
Drijvers L, Özyürek A, Jensen O. Alpha and Beta Oscillations Index Semantic Congruency between Speech and Gestures in Clear and Degraded Speech. J Cogn Neurosci 2018; 30:1086-1097. [DOI: 10.1162/jocn_a_01301] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Previous work revealed that visual semantic information conveyed by gestures can enhance degraded speech comprehension, but the mechanisms underlying these integration processes under adverse listening conditions remain poorly understood. We used MEG to investigate how oscillatory dynamics support speech–gesture integration when integration load is manipulated by auditory (e.g., speech degradation) and visual semantic (e.g., gesture congruency) factors. Participants were presented with videos of an actress uttering an action verb in clear or degraded speech, accompanied by a matching (mixing gesture + “mixing”) or mismatching (drinking gesture + “walking”) gesture. In clear speech, alpha/beta power was more suppressed in the left inferior frontal gyrus and motor and visual cortices when integration load increased in response to mismatching versus matching gestures. In degraded speech, beta power was less suppressed over posterior STS and medial temporal lobe for mismatching compared with matching gestures, showing that integration load was lowest when speech was degraded and mismatching gestures could not be integrated and disambiguate the degraded signal. Our results thus provide novel insights on how low-frequency oscillatory modulations in different parts of the cortex support the semantic audiovisual integration of gestures in clear and degraded speech: When speech is clear, the left inferior frontal gyrus and motor and visual cortices engage because higher-level semantic information increases semantic integration load. When speech is degraded, posterior STS/middle temporal gyrus and medial temporal lobe are less engaged because integration load is lowest when visual semantic information does not aid lexical retrieval and speech and gestures cannot be integrated.
Collapse
Affiliation(s)
| | - Asli Özyürek
- Radboud University
- Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands
| | | |
Collapse
|
41
|
Temporal Expectation Modulates the Cortical Dynamics of Short-Term Memory. J Neurosci 2018; 38:7428-7439. [PMID: 30012685 DOI: 10.1523/jneurosci.2928-17.2018] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2017] [Revised: 07/09/2018] [Accepted: 07/10/2018] [Indexed: 11/21/2022] Open
Abstract
Increased memory load is often signified by enhanced neural oscillatory power in the alpha range (8-13 Hz), which is taken to reflect inhibition of task-irrelevant brain regions. The corresponding neural correlates of memory decay, however, are not yet well understood. In the current study, we investigated auditory short-term memory decay in humans using a delayed matching-to-sample task with pure-tone sequences. First, in a behavioral experiment, we modeled memory performance over six different delay-phase durations. Second, in a MEG experiment, we assessed alpha-power modulations over three different delay-phase durations. In both experiments, the temporal expectation for the to-be-remembered sound was manipulated so that it was either temporally expected or not. In both studies, memory performance declined over time, but this decline was weaker when the onset time of the to-be-remembered sound was expected. Similarly, patterns of alpha power in and alpha-tuned connectivity between sensory cortices changed parametrically with delay duration (i.e., decrease in occipitoparietal regions, increase in temporal regions). Temporal expectation not only counteracted alpha-power decline in heteromodal brain areas (i.e., supramarginal gyrus), but also had a beneficial effect on memory decay, counteracting memory performance decline. Correspondingly, temporal expectation also boosted alpha connectivity within attention networks known to play an active role during memory maintenance. The present data show how patterns of alpha power orchestrate short-term memory decay and encourage a more nuanced perspective on alpha power across brain space and time beyond its inhibitory role.SIGNIFICANCE STATEMENT Our sensory memories of the physical world fade quickly. We show here that this decay of short-term memory can be counteracted by so-called temporal expectation; that is, knowledge of when to expect a sensory event that an individual must remember. We also show that neural oscillations in the "alpha" (8-13 Hz) range index both the degree of memory decay (for brief sound patterns) and the respective memory benefit from temporal expectation. Spatially distributed cortical patterns of alpha power show opposing effects in auditory versus visual sensory cortices. Moreover, alpha-tuned connectivity changes within supramodal attention networks reflect the allocation of neural resources as short-term memory representations fade.
Collapse
|
42
|
Lim SJ, Wöstmann M, Geweke F, Obleser J. The Benefit of Attention-to-Memory Depends on the Interplay of Memory Capacity and Memory Load. Front Psychol 2018. [PMID: 29520246 PMCID: PMC5827549 DOI: 10.3389/fpsyg.2018.00184] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
Humans can be cued to attend to an item in memory, which facilitates and enhances the perceptual precision in recalling this item. Here, we demonstrate that this facilitating effect of attention-to-memory hinges on the overall degree of memory load. The benefit an individual draws from attention-to-memory depends on her overall working memory performance, measured as sensitivity (d') in a retroactive cue (retro-cue) pitch discrimination task. While listeners maintained 2, 4, or 6 auditory syllables in memory, we provided valid or neutral retro-cues to direct listeners' attention to one, to-be-probed syllable in memory. Participants' overall memory performance (i.e., perceptual sensitivity d') was relatively unaffected by the presence of valid retro-cues across memory loads. However, a more fine-grained analysis using psychophysical modeling shows that valid retro-cues elicited faster pitch-change judgments and improved perceptual precision. Importantly, as memory load increased, listeners' overall working memory performance correlated with inter-individual differences in the degree to which precision improved (r = 0.39, p = 0.029). Under high load, individuals with low working memory profited least from attention-to-memory. Our results demonstrate that retrospective attention enhances perceptual precision of attended items in memory but listeners' optimal use of informative cues depends on their overall memory abilities.
Collapse
Affiliation(s)
- Sung-Joo Lim
- Department of Psychology, University of Lübeck, Lübeck, Germany.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Malte Wöstmann
- Department of Psychology, University of Lübeck, Lübeck, Germany.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Frederik Geweke
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Jonas Obleser
- Department of Psychology, University of Lübeck, Lübeck, Germany.,Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| |
Collapse
|
43
|
States and traits of neural irregularity in the age-varying human brain. Sci Rep 2017; 7:17381. [PMID: 29234128 PMCID: PMC5727296 DOI: 10.1038/s41598-017-17766-4] [Citation(s) in RCA: 67] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2017] [Accepted: 11/30/2017] [Indexed: 12/11/2022] Open
Abstract
Sensory representations, and thus human percepts, of the physical world are susceptible to fluctuations in brain state or “neural irregularity”. Furthermore, aging brains display altered levels of neural irregularity. We here show that a single, within-trial, information-theoretic measure (weighted permutation entropy) captures neural irregularity in the human electroencephalogram as a proxy for both, trait-like differences between individuals of varying age, and state-like fluctuations that bias perceptual decisions. First, the overall level of neural irregularity increased with participants’ age, paralleled by a decrease in variability over time, likely indexing age-related changes at structural and functional levels of brain activity. Second, states of higher neural irregularity were associated with optimized sensory encoding and a subsequently increased probability of choosing the first of two physically identical stimuli to be higher in pitch. In sum, neural irregularity not only characterizes behaviourally relevant brain states, but also can identify trait-like changes that come with age.
Collapse
|
44
|
|
45
|
Larrain-Valenzuela J, Zamorano F, Soto-Icaza P, Carrasco X, Herrera C, Daiber F, Aboitiz F, Billeke P. Theta and Alpha Oscillation Impairments in Autistic Spectrum Disorder Reflect Working Memory Deficit. Sci Rep 2017; 7:14328. [PMID: 29085047 PMCID: PMC5662653 DOI: 10.1038/s41598-017-14744-8] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2017] [Accepted: 10/17/2017] [Indexed: 11/09/2022] Open
Abstract
A dysfunction in the excitatory-inhibitory (E/I) coordination in neuronal assembly has been proposed as a possible neurobiological mechanism of Autistic Spectrum Disorder (ASD). However, the potential impact of this mechanism in cognitive performance is not fully explored. Since the main consequence of E/I dysfunction is an impairment in oscillatory activity and its underlying cognitive computations, we assessed the electroencephalographic activity of ASD and typically developing (TD) subjects during a working-memory task. We found that ASD subjects committed more errors than TD subjects. Moreover, TD subjects demonstrated a parametric modulation in the power of alpha and theta band while ASD subjects did not demonstrate significant modulations. The preceding leads to significant differences between the groups in both the alpha power placed on the occipital cortex and the theta power placed on the left premotor and the right prefrontal cortex. The impaired theta modulation correlated with autistic symptoms. The results indicated that ASD may present an alteration in the recruitment of the oscillatory activity during working-memory, and this alteration could be related to the physiopathology of the disorder.
Collapse
Affiliation(s)
- Josefina Larrain-Valenzuela
- División de Neurociencia, Centro de Investigación en Complejidad Social (neuroCICS), Universidad del Desarrollo, Av. Las Condes 12461, Las Condes, Santiago, 7590943, Chile
| | - Francisco Zamorano
- División de Neurociencia, Centro de Investigación en Complejidad Social (neuroCICS), Universidad del Desarrollo, Av. Las Condes 12461, Las Condes, Santiago, 7590943, Chile.,Unidad de Imágenes Cuantitativas Avanzadas, Departamento de Imágenes, Clínica Alemana de Santiago, Av. Vitacura 5951, Vitacura, 7650568, Chile
| | - Patricia Soto-Icaza
- Laboratorio de Neurociencias Cognitivas, Departamento de Psiquiatría, Centro Interdisciplinario de Neurociencia, Pontificia Universidad Católica de Chile, Marcoleta 391, Santiago, 8330024, Chile
| | - Ximena Carrasco
- Laboratorio de Neurociencias Cognitivas, Departamento de Psiquiatría, Centro Interdisciplinario de Neurociencia, Pontificia Universidad Católica de Chile, Marcoleta 391, Santiago, 8330024, Chile
| | - Claudia Herrera
- Sociedad de Psiquiatría y Neurología de la Infancia y Adolescencia de Chile, Esmeralda 678, Santiago, 8320053, Chile
| | - Francisca Daiber
- Laboratorio de Neurociencias Cognitivas, Departamento de Psiquiatría, Centro Interdisciplinario de Neurociencia, Pontificia Universidad Católica de Chile, Marcoleta 391, Santiago, 8330024, Chile
| | - Francisco Aboitiz
- Laboratorio de Neurociencias Cognitivas, Departamento de Psiquiatría, Centro Interdisciplinario de Neurociencia, Pontificia Universidad Católica de Chile, Marcoleta 391, Santiago, 8330024, Chile
| | - Pablo Billeke
- División de Neurociencia, Centro de Investigación en Complejidad Social (neuroCICS), Universidad del Desarrollo, Av. Las Condes 12461, Las Condes, Santiago, 7590943, Chile.
| |
Collapse
|
46
|
Wisniewski MG, Thompson ER, Iyer N. Theta- and alpha-power enhancements in the electroencephalogram as an auditory delayed match-to-sample task becomes impossibly difficult. Psychophysiology 2017; 54:1916-1928. [PMID: 28792606 DOI: 10.1111/psyp.12968] [Citation(s) in RCA: 31] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2016] [Revised: 05/15/2017] [Accepted: 06/24/2017] [Indexed: 01/06/2023]
Abstract
Recent studies have related enhancements of theta- (∼4-8 Hz) and alpha-power (∼8-13 Hz) to listening effort based on parallels between enhancement and task difficulty. In contrast, nonauditory works demonstrate that, although increases in difficulty are initially accompanied by increases in effort, effort decreases when a task becomes so difficult as to exceed one's ability. Given the latter, we examined whether theta- and alpha-power enhancements thought to reflect effortful listening show a quadratic trend across levels of listening difficulty from impossible to easy. Listeners (n = 14) performed an auditory delayed match-to-sample task with frequency-modulated tonal sweeps under impossible, difficult (at ∼70.7% correct threshold), and easy (well above threshold) conditions. Frontal midline theta-power and posterior alpha-power enhancements were observed during the retention interval, with greatest enhancement in the difficult condition. Independent component-based analyses of data suggest that theta-power enhancements stemmed from medial frontal sources at or near the anterior cingulate cortex, whereas alpha-power effects stemmed from occipital cortices. Results support the notion that theta- and alpha-power enhancements reflect effortful cognitive processes during listening, related to auditory working memory and the inhibition of task-irrelevant cortical processing regions, respectively. Theta- and alpha-power dynamics can be used to characterize the cognitive processes that make up effortful listening, including qualitatively different types of listening effort.
Collapse
Affiliation(s)
| | - Eric R Thompson
- U.S. Air Force Research Laboratory, Wright-Patterson Air Force Base, Ohio, USA
| | - Nandini Iyer
- U.S. Air Force Research Laboratory, Wright-Patterson Air Force Base, Ohio, USA
| |
Collapse
|
47
|
Koerner TK, Zhang Y, Nelson PB, Wang B, Zou H. Neural indices of phonemic discrimination and sentence-level speech intelligibility in quiet and noise: A P3 study. Hear Res 2017; 350:58-67. [DOI: 10.1016/j.heares.2017.04.009] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/07/2016] [Revised: 04/12/2017] [Accepted: 04/16/2017] [Indexed: 10/19/2022]
|
48
|
Zoefel B, VanRullen R. Oscillatory Mechanisms of Stimulus Processing and Selection in the Visual and Auditory Systems: State-of-the-Art, Speculations and Suggestions. Front Neurosci 2017; 11:296. [PMID: 28603483 PMCID: PMC5445505 DOI: 10.3389/fnins.2017.00296] [Citation(s) in RCA: 45] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2017] [Accepted: 05/11/2017] [Indexed: 01/16/2023] Open
Abstract
All sensory systems need to continuously prioritize and select incoming stimuli in order to avoid overflow or interference, and provide a structure to the brain's input. However, the characteristics of this input differ across sensory systems; therefore, and as a direct consequence, each sensory system might have developed specialized strategies to cope with the continuous stream of incoming information. Neural oscillations are intimately connected with this selection process, as they can be used by the brain to rhythmically amplify or attenuate input and therefore represent an optimal tool for stimulus selection. In this paper, we focus on oscillatory processes for stimulus selection in the visual and auditory systems. We point out both commonalities and differences between the two systems and develop several hypotheses, inspired by recently published findings: (1) The rhythmic component in its input is crucial for the auditory, but not for the visual system. The alignment between oscillatory phase and rhythmic input (phase entrainment) is therefore an integral part of stimulus selection in the auditory system whereas the visual system merely adjusts its phase to upcoming events, without the need for any rhythmic component. (2) When input is unpredictable, the visual system can maintain its oscillatory sampling, whereas the auditory system switches to a different, potentially internally oriented, “mode” of processing that might be characterized by alpha oscillations. (3) Visual alpha can be divided into a faster occipital alpha (10 Hz) and a slower frontal alpha (7 Hz) that critically depends on attention.
Collapse
Affiliation(s)
- Benedikt Zoefel
- Université Paul SabatierToulouse, France.,Centre de Recherche Cerveau et Cognition (CerCo), Centre National de la Recherche Scientifique, University of Toulouse, UMR5549Toulouse, France.,Nathan Kline Institute for Psychiatric ResearchOrangeburg, NY, United States
| | - Rufin VanRullen
- Université Paul SabatierToulouse, France.,Centre de Recherche Cerveau et Cognition (CerCo), Centre National de la Recherche Scientifique, University of Toulouse, UMR5549Toulouse, France
| |
Collapse
|
49
|
Ramyead A, Kometer M, Studerus E, Baumeler D, von Rotz R, Riecher-Rössler A. Alpha oscillations underlie working memory abnormalities in the psychosis high-risk state. Biol Psychol 2017; 126:12-18. [PMID: 28385625 DOI: 10.1016/j.biopsycho.2017.04.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2016] [Revised: 03/17/2017] [Accepted: 04/02/2017] [Indexed: 11/17/2022]
Abstract
Working memory (WM) functioning, known to be modulated by neural oscillations, is impaired in schizophrenic psychoses. It remains unclear whether in the psychosis high-risk state, WM encoding is altered or whether patients are impaired at shielding their WM against distractors. We employed single-trial analyses of neurophysiological and behavioral data recorded during a WM paradigm, designed to include predictable distractors, on 18 patients with an at-risk mental state for psychosis (ARMS, 26.1±5.45 years) and 21 healthy controls (HCs, 25.5±3.95 years). Strong distractors were associated with reduced WM accuracy (p=0.036), but only ARMS patients required more processing time for strong distractors (p=0.002). Increased parieto-occipital alpha amplitude preceding distractor presentations was associated with enhanced accuracy only in HCs (p=0.009). During encoding, increased intertrial alpha phase locking values were associated with increased performance. Reduced shielding mechanisms against distractors in ARMS patients could lead to defective WM maintenance, which may result in significant confusion that may contribute to the formation of psychotic symptoms.
Collapse
Affiliation(s)
- Avinash Ramyead
- University of Basel Psychiatric Clinics, Center for Gender Research and Early Detection, Basel, Switzerland; Department of Psychiatry, Weill Institute for Neurosciences, University of California, San Francisco, USA
| | - Michael Kometer
- Neuropsychopharmacology and Brain Imaging Research Unit, Department of Psychiatry, Psychotherapy and Psychosomatics, Hospital of Psychiatry, University of Zurich, Switzerland
| | - Erich Studerus
- University of Basel Psychiatric Clinics, Center for Gender Research and Early Detection, Basel, Switzerland
| | - Denise Baumeler
- University of Basel Psychiatric Clinics, Center for Gender Research and Early Detection, Basel, Switzerland
| | - Robin von Rotz
- University of Basel Psychiatric Clinics, Center for Gender Research and Early Detection, Basel, Switzerland
| | - Anita Riecher-Rössler
- University of Basel Psychiatric Clinics, Center for Gender Research and Early Detection, Basel, Switzerland.
| |
Collapse
|
50
|
Dimitrijevic A, Smith ML, Kadis DS, Moore DR. Cortical Alpha Oscillations Predict Speech Intelligibility. Front Hum Neurosci 2017; 11:88. [PMID: 28286478 PMCID: PMC5323373 DOI: 10.3389/fnhum.2017.00088] [Citation(s) in RCA: 51] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2016] [Accepted: 02/13/2017] [Indexed: 12/21/2022] Open
Abstract
Understanding speech in noise (SiN) is a complex task involving sensory encoding and cognitive resources including working memory and attention. Previous work has shown that brain oscillations, particularly alpha rhythms (8–12 Hz) play important roles in sensory processes involving working memory and attention. However, no previous study has examined brain oscillations during performance of a continuous speech perception test. The aim of this study was to measure cortical alpha during attentive listening in a commonly used SiN task (digits-in-noise, DiN) to better understand the neural processes associated with “top-down” cognitive processing in adverse listening environments. We recruited 14 normal hearing (NH) young adults. DiN speech reception threshold (SRT) was measured in an initial behavioral experiment. EEG activity was then collected: (i) while performing the DiN near SRT; and (ii) while attending to a silent, close-caption video during presentation of identical digit stimuli that the participant was instructed to ignore. Three main results were obtained: (1) during attentive (“active”) listening to the DiN, a number of distinct neural oscillations were observed (mainly alpha with some beta; 15–30 Hz). No oscillations were observed during attention to the video (“passive” listening); (2) overall, alpha event-related synchronization (ERS) of central/parietal sources were observed during active listening when data were grand averaged across all participants. In some participants, a smaller magnitude alpha event-related desynchronization (ERD), originating in temporal regions, was observed; and (3) when individual EEG trials were sorted according to correct and incorrect digit identification, the temporal alpha ERD was consistently greater on correctly identified trials. No such consistency was observed with the central/parietal alpha ERS. These data demonstrate that changes in alpha activity are specific to listening conditions. To our knowledge, this is the first report that shows almost no brain oscillatory changes during a passive task compared to an active task in any sensory modality. Temporal alpha ERD was related to correct digit identification.
Collapse
Affiliation(s)
- Andrew Dimitrijevic
- Otolaryngology-Head and Neck Surgery, Sunnybrook Health Sciences CentreToronto, ON, Canada; Hurvitz Brain Sciences, Evaluative Clinical Sciences, Sunnybrook Research InstituteToronto, ON, Canada; Faculty of Medicine, Otolaryngology-Head and Neck SurgeryUniversity of Toronto, Toronto, ON, Canada
| | - Michael L Smith
- Communication Sciences Research Center, Cincinnati Children's Hospital Medical CenterCincinnati, OH, USA; Speech and Hearing Sciences, University of WashingtonSeattle, WA, USA
| | - Darren S Kadis
- Pediatric Neuroimaging Research Consortium, Cincinnati Children's Hospital Medical CenterCincinnati, OH, USA; Division of Neurology, Cincinnati Children's Hospital Medical CenterCincinnati, OH, USA; Department of Pediatrics, University of Cincinnati, College of MedicineCincinnati, OH, USA
| | - David R Moore
- Communication Sciences Research Center, Cincinnati Children's Hospital Medical CenterCincinnati, OH, USA; Department of Otolaryngology, University of CincinnatiCincinnati, OH, USA
| |
Collapse
|